Python session terminated

[tal_shainfeld]

Hi
I use Ne4j 4.1 with Python.
Have to upload nodes from a complex text file. can't create a CSV since the file will be too complex.
I set in Python the timeout to 200S but anyway the upload is stopped after 100 new nodes, and then the session waits in idle status till it terminated.

[gal_bello]

Tal, can you please share an example of the complex text file itself?

Thanks,
Gal

[tal_shainfeld]

Hi Gal
This is part of the file I processed (names and nicknames)
But don't think it is a relevant cause the problem is with the upload to Neo4j after processing.
Aaron, Aron – Ron, Ronnie, Ronny;

Abel – Abe, Abie;

Abner – Ab, Abbie;

Abraham, Abram – Abe, Abie, Bram;

Adam – Ad, Addie, Addy, Ade;

Adelbert, Adalbert – Ad, Ade, Al, Bert, Bertie, Del;

Adrian – Ade;

Alan, Allan, Allen – Al;

Albert – Al, Bert, Bertie;

[gal_bello]

Thanks.
If timeout is the main issue here, you can try and work in smaller transactions batches(10,100,1000,10000,100000) to control memory usages, which will make the commits on a smaller batch and might assist.
Have you tried: apoc.periodic.iterate() or apoc.periodic.commit()?

You can look into that: https://neo4j.com/labs/apoc/4.1/graph-updates/periodic-execution/

Hope it helps,
Gal