Head's Up! These forums are read-only. All users and content have migrated. Please join us at community.neo4j.com.
04-29-2021 07:25 AM
Hello,
I'm trying to export to Amazon S3 as indicated in the documentation as follows:
CALL apoc.export.csv.query(
"MATCH (a:Person) RETURN a.name",
"s3://s3.eu-west-1.amazonaws.com/<BUCKET_NAME>/example.csv?accessKey=<MY_ACCESS_KEY>&secretKey=<MY_SECRET_KEY>",
{}
)
I always get a error:
Neo.ClientError.Procedure.ProcedureCallFailed
Failed to invoke procedure apoc.export.csv.query
:
Caused by: java.io.FileNotFoundException: s3:/s3-eu-west-1.amazonaws.com/<BUCKET_NAME>/example.csv?accessKey=<MY_ACCESS_KEY>&secretKey=<MY_SECRET_KEY> (No such file or directory)
I get the same error both by running the export command from the Neo4j Web Browser client, and by running a post directly on the endpoint http://ipserver:7474/db/data/transaction/commit
The configurations are:
In neo4j.conf there are these entries:
dbms.active_database=graph
dbms.directories.plugins=plugins
unsupported.dbms.executiontime_limit.enabled=false
dbms.allow_format_migration=true
dbms.memory.heap.initial_size=8g
dbms.memory.heap.max_size=8g
dbms.memory.pagecache.size=5g
dbms.connector.bolt.enabled=true
dbms.connector.bolt.tls_level=DISABLED
dbms.connector.bolt.listen_address=0.0.0.0:7687
dbms.connector.http.enabled=true
dbms.connector.http.listen_address=0.0.0.0:7474
dbms.connector.https.enabled=true
dbms.directories.certificates and associated files
dbms.logs.debug.rotation.size=1m
dbms.logs.query.enabled=false
dbms.logs.query.threshold=200s
dbms.logs.query.rotation.size=1m
dbms.logs.security.rotation.delay=300s
ha.pull_interval=10
ha.heartbeat_timeout=40s
dbms.tx_log.rotation.retention_policy=false
dbms.shell.enabled=true
dbms.jvm.additional=-XX:+UseG1GC
dbms.jvm.additional=-XX:-OmitStackTraceInFastThrow
dbms.jvm.additional=-XX:+AlwaysPreTouch
dbms.jvm.additional=-XX:+UnlockExperimentalVMOptions
dbms.jvm.additional=-XX:+TrustFinalNonStaticFields
dbms.jvm.additional=-XX:+DisableExplicitGC
dbms.jvm.additional=-Djdk.tls.ephemeralDHKeySize=2048
dbms.windows_service_name=neo4j
dbms.jvm.additional=-Dunsupported.dbms.udc.source=tarball
dbms.security.procedures.unrestricted=apoc.,algo.
dbms.security.procedures.whitelist=apoc.,algo.
dbms.security.allow_csv_import_from_file_urls=true
apoc.import.file.use_neo4j_config=false
apoc.import.file.enabled=true
apoc.export.file.enabled=true
Can you tell me what the problem could be?
Thank you
Antonio Bruno
04-29-2021 01:04 PM
Can you share your debug.log I would like to see if the URL handler for s3 files was installed correctly.
04-29-2021 01:52 PM
04-30-2021 12:20 AM
Actually in the log there are WARNs for some classes that are not loaded but I don't understand why?
...
2021-04-29 20:33:45.669+0000 WARN [o.n.k.i.p.Procedures] Failed to load com.amazonaws.services.s3.AmazonS3EncryptionClient
from plugin jar /opt/neo4j/3.2.6/plugins/aws-java-sdk-s3-1.11.250.jar
: com/amazonaws/services/kms/AWSKMS
2021-04-29 20:33:45.676+0000 WARN [o.n.k.i.p.Procedures] Failed to load com.amazonaws.services.s3.AmazonS3EncryptionClientBuilder
from plugin jar /opt/neo4j/3.2.6/plugins/aws-java-sdk-s3-1.11.250.jar
: com/amazonaws/services/kms/AWSKMS
2021-04-29 20:33:45.678+0000 WARN [o.n.k.i.p.Procedures] Failed to load com.amazonaws.services.s3.AmazonS3EncryptionClientParamsWrapper
from plugin jar /opt/neo4j/3.2.6/plugins/aws-java-sdk-s3-1.11.250.jar
: com/amazonaws/services/kms/AWSKMS
2021-04-29 20:33:45.679+0000 WARN [o.n.k.i.p.Procedures] Failed to load com.amazonaws.services.s3.AmazonS3EncryptionClientParams
from plugin jar /opt/neo4j/3.2.6/plugins/aws-java-sdk-s3-1.11.250.jar
: com/amazonaws/services/kms/AWSKMS
2021-04-29 20:33:45.789+0000 WARN [o.n.k.i.p.Procedures] Failed to load com.amazonaws.services.s3.internal.crypto.ContentCryptoMaterial
from plugin jar /opt/neo4j/3.2.6/plugins/aws-java-sdk-s3-1.11.250.jar
: com/amazonaws/services/kms/AWSKMS
...
07-21-2022 02:25 PM
Did you ever solve what the issue was, I'm experiencing the same thing and I'm configured just as you did.
All the sessions of the conference are now available online