cancel
Showing results for 
Search instead for 
Did you mean: 

Head's Up! These forums are read-only. All users and content have migrated. Please join us at community.neo4j.com.

apoc.periodic.iterate do not work in create large relation

The following code

 

CALL apoc.periodic.iterate("MATCH(e:Process) MATCH (f:ParentProcess{pid:e.parentID})    RETURN  e,f",

"CREATE(f)-[r:create_process_to]->(e)",

{batchSize:5000, parallel: true}) YIELD batch

 

Showed the error message : The allocation of an extra 2.0 MiB would use more than the limit 21.0 GiB. Currently using 21.0 GiB. dbms.memory.transaction.total.max threshold reached

 

After setting the related-configuration, although the error message do not show up but it spend sever hours and no any result was showed, even I changed Batchsize into (100,500,1000).

 

This may because there're 640 millions nodes, since in the cases of 300 millions node it turn the result wtih only 1 hours successfully.

 

Problem : How can I get over in this situation (at least show the result...) except create index for them which I were trying now.

 

Conf. setting :

Peter_Lian_0-1673938369537.png

Since recommended :  (There're 512 GB Memory in my computer)

Peter_Lian_1-1673938399918.png

 

 

0 REPLIES 0
Nodes 2022
Nodes
NODES 2022, Neo4j Online Education Summit

All the sessions of the conference are now available online