I have a neo4j database that updates in real time. I'm running a bunch of GDS algorithms like wcc, similarity and centrality measures to assign scores at a node level (these calculated scores are stored as properties at node level).
I have a batch that runs every hour to calculate these values.
Every time the batch job is run, cypher projections for the whole database are created and scores are recalculated for the whole database and assigned to their respective nodes.
What is the best way to calculate these scores only for the newly added nodes to the database and not the whole database?
Currently, I'm creating partial projections of the newly added nodes and running batch job on those projections but is there a better way to do this? (possibly a config that would enable me to calculate these scores only on the newly added data)