cancel
Showing results for 
Search instead for 
Did you mean: 

Head's Up! These forums are read-only. All users and content have migrated. Please join us at community.neo4j.com.

Run the etl from cli it won't escape special characters in DB data and fails

npatel
Node Clone

command:

./bin/neo4j-etl export \
--mapping-file "D:\orchardws/mysql_neo4j_mapping2.json" \
--rdbms:password "" --rdbms:user "root" --rdbms:schema neo4j_mapping --rdbms:url "jdbc:mysql://localhost:3306/neo4j_mapping?autoReconnect=true&useSSL=false&useCursorFetch=true&allowPublicKeyRetrieval=true" \
--import-tool "D:\graphDBData\neo4jDatabases\database-90cbfcf9-27ba-4e65-8793-30b15713a4a6\installation-3.5.2/bin" \
--csv-directory "D:\graphDBData\neo4jDatabases\database-90cbfcf9-27ba-4e65-8793-30b15713a4a6\installation-3.5.2/import" \
--options-file "D:\graphDBData\neo4jDatabases\database-90cbfcf9-27ba-4e65-8793-30b15713a4a6\installation-3.5.2/import/import-tool-options.json" \
--using "cypher:direct" --neo4j:url "bolt://localhost:7687" --neo4j:user "neo4j" --neo4j:password "letmein" \
--exclusion-mode-tables INCLUDE \
--tables -l releases,artist_info \
--schemas -l neo4j_mapping \
--debug

error

INFO: Creating Neo4j store from CSV...
INFO: Direct driver instance 1768792843 created for server address localhost:7687
SEVERE: [0xd1e7efc4] Fatal error occurred in the pipeline
org.neo4j.driver.v1.exceptions.DatabaseException: At D:\graphDBData\neo4jDatabases\database-90cbfcf9-27ba-4e65-8793-30b15713a4a6\installation-3.5.2\import\csv-005\neo4j_mapping\NODE_artrelationsauth0.artistinfo_ec207b75-1927-4bfd-942a-f0d69bcbe393.csv @ position 49958905 -  there's a field starting with a quote and whereas it ends that quote there seems to be characters in that field after that ending quote. That isn't supported. This is what I read: '","AA'
        at org.neo4j.driver.internal.util.ErrorUtil.newNeo4jError(ErrorUtil.java:66)
        at org.neo4j.driver.internal.async.inbound.InboundMessageDispatcher.handleFailureMessage(InboundMessageDispatcher.java:137
)
        at org.neo4j.driver.internal.messaging.PackStreamMessageFormatV1$ReaderV1.unpackFailureMessage(PackStreamMessageFormatV1.j

I have the latest version of plugin and Neo4j 3.5.2 DB, but still get this error. I took the mapping file that was generated by UI as the end result we want to run this from CLI not from UI. So I tried adding MYSQL REPLACE in mapping.json file thinking it is still a MYSQL query. It did not fail but did not create any Artist nodes either. CSV in import folder was blank too.

{
      "name":"NODE_artrelationsauth0.artistinfo_ec207b75-1927-4bfd-942a-f0d69bcbe393",
      "schema":"neo4j_mapping",
      "graph-object-type":"Node",
      "sql":"SELECT `neo4j_mapping`.`artist_info`.`artist_id` AS `artist_id`, REPLACE(`neo4j_mapping`.`artist_info`.`name`, '\\', '') AS `name`, \"Artist\" AS `_NODE_LABEL_` FROM `neo4j_mapping`.`artist_info`",
      "mappings":[
        ...... ........... 
        {
            "column":{
               "type":"SimpleColumn",
               "role":"Data",
               "table":"artist_info",
               "schema":"neo4j_mapping",
               "name":"name",
               "alias":"name",
               "sql-data-type":"VARCHAR",
               "column-value-selection-strategy":"SelectColumnValue"
            },
            "field":{
               "type":"Data",
               "name":"name",
               "neo4j-data-type":"String",
               "is-array":false
            }
         },
0 REPLIES 0