Parquet files

[christybibin2]

Is Neo 4j supports parquet files,zip ,.tarz files? Can we import these files to Neo 4j?

[jorenvandevonde]

Hi christybibin2,

welcome to the neo4j community.

In the neo4j apoc import docs you can find all supported file formats apart from LOAD CSV. (https://neo4j.com/docs/labs/apoc/current/import/)
In the LOAD CSV description you can find supported compression methods for CSV files
(https://neo4j.com/docs/cypher-manual/4.0/clauses/load-csv/#query-load-csv-introduction)

To answer your question on parquet; I cannot find any function that supports the format, so I believe it isn't supported. You will have to convert the parquet data to CSV or JSON.
For compressed files you are limited concerning the compressed file format. From what I understand you can provide LOAD CSV or the APOC function with compressed files limited to gzip and deflate for remote files and ZIP for local files.

Hope this helps you.
Kind regards,
Joren

[clem]

This should be a feature request.

In principle, this shouldn't be too hard to do, as there exist Java Parquet libraries, so it's just a question of gluing them together the Java-Neo4J API's:

see:

stackoverflow.com

how to read a parquet file, in a standalone java code?

java, parquet

asked by teddy teddy on 07:44PM - 19 Feb 15 UTC

[anthapu]

If you are ok with using a python client then you can use this utility to ingest parquet files into neo4j.

github.com

neo4j-field/pyingest

parquet

Contribute to neo4j-field/pyingest development by creating an account on GitHub.

[carib]

I have data stored in parquet files as well. Not seeing any documentation that Neo4j supports data imports from parquet files:

https://neo4j.com/labs/apoc/4.0/overview/apoc.load/

https://neo4j.com/developer/data-import/

I have about 50 million records that I need to use to update the properites in the relationships in my graph.

What is the best way to go about this? Should I proceed to use the Python client to ingest this data into Neo4j?