Inconsistent data store

[tomswinkels]

Hi,

Us data of Neo4j is inconsistent, we have run neo4j-admin check-consistency.

We can fix the data with https://github.com/jexp/store-utils then there are 6 records removed copying of 80610658 relationship records took 2418 seconds (33337 rec/s). Unused Records 11433462 (14%) Removed Records 6 (0%).

But we want to see what the problems are, in de readme of store-utils we find a config for store_copy_log_dir and bad_entries_log_dir, but they folders are everytime empty.

Is there some option to see what the inconsistent problems are?

[michael_hunger]

Did you run a consistency check before? That should show you the inconsistencies.

See: https://neo4j.com/docs/operations-manual/current/tools/consistency-checker/

Sorry, it seems that I meant to use those two settings but they are currently ignored.

Did you check: target-db/store-copy.log ?

[tomswinkels]

Yes, see here the results;

consistency check

ERROR: The string block is not in use.
	Property[24853620,used=true,prev=-1,next=24853619,PropertyBlock[blocks=1,SHORT_STRING,key=87,value=hausa],PropertyBlock[blocks=1,LONG,key=18,value=1511211638],PropertyBlock[blocks=1,LONG,key=19,value=1528306804],PropertyBlock[blocks=1,STRING,key=198,firstDynamic=74917274]]
	Inconsistent with: PropertyBlock[blocks=1,STRING,key=198,firstDynamic=74917274] DynamicRecord[74917274,used=false,(120),type=-1,data=byte[size=120],start=true,next=74917275]
ERROR: The string block is not in use.
	Property[20252482,used=true,prev=20253629,next=-1,PropertyBlock[blocks=2,SHORT_STRING,key=205,value=added_video],PropertyBlock[blocks=1,SHORT_STRING,key=117,value=video],PropertyBlock[blocks=1,STRING,key=87,firstDynamic=70320644]]
	Inconsistent with: PropertyBlock[blocks=1,STRING,key=87,firstDynamic=70320644] DynamicRecord[70320644,used=false,(11),type=-1,data=byte[size=11],start=true,next=-1]
ERROR: The string block is not in use.
	Property[37120413,used=true,prev=37120541,next=37120308,PropertyBlock[blocks=1,STRING,key=87,firstDynamic=78115552],PropertyBlock[blocks=1,LONG,key=18,value=1528289905],PropertyBlock[blocks=1,STRING,key=36,firstDynamic=75655778],PropertyBlock[blocks=1,STRING,key=23,firstDynamic=74917275]]
	Inconsistent with: PropertyBlock[blocks=1,STRING,key=23,firstDynamic=74917275] DynamicRecord[74917275,used=false,(11),type=-1,data=byte[size=11],start=true,next=-1]
ERROR: The next block is not in use.
	DynamicRecord[70957033,used=true,(120),type=-1,data=byte[size=120],start=false,next=73256095]
	Inconsistent with: DynamicRecord[73256095,used=false,(120),type=-1,data=byte[size=120],start=true,next=92974166]
ERROR: The next block is not in use.
	DynamicRecord[76735940,used=true,(120),type=-1,data=byte[size=120],start=true,next=70320644]
	Inconsistent with: DynamicRecord[70320644,used=false,(11),type=-1,data=byte[size=11],start=true,next=-1]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=739, descriptor=Index( GENERAL, :label[159](property[24]) ), provider={key=lucene+native, version=2.0}] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=743, descriptor=Index( GENERAL, :label[98](property[87]) ), provider={key=lucene+native, version=2.0}] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=745, descriptor=Index( GENERAL, :label[130](property[87]) ), provider={key=lucene+native, version=2.0}] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=747, descriptor=Index( UNIQUE, :label[216](property[16]) ), provider={key=lucene+native, version=2.0}, owner=750] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=754, descriptor=Index( UNIQUE, :label[206](property[16]) ), provider={key=lucene+native, version=2.0}, owner=757] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=761, descriptor=Index( UNIQUE, :label[206](property[87]) ), provider={key=lucene+native, version=2.0}, owner=764] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=775, descriptor=Index( UNIQUE, :label[132](property[16]) ), provider={key=lucene+native, version=2.0}, owner=778] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=782, descriptor=Index( UNIQUE, :label[165](property[16]) ), provider={key=lucene+native, version=2.0}, owner=785] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=789, descriptor=Index( UNIQUE, :label[246](property[16]) ), provider={key=lucene+native, version=2.0}, owner=792] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=796, descriptor=Index( UNIQUE, :label[108](property[16]) ), provider={key=lucene+native, version=2.0}, owner=799] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=803, descriptor=Index( UNIQUE, :label[106](property[16]) ), provider={key=lucene+native, version=2.0}, owner=806] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=810, descriptor=Index( UNIQUE, :label[96](property[16]) ), provider={key=lucene+native, version=2.0}, owner=813] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=817, descriptor=Index( UNIQUE, :label[10](property[16]) ), provider={key=lucene+native, version=2.0}, owner=820] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=824, descriptor=Index( UNIQUE, :label[10](property[22]) ), provider={key=lucene+native, version=2.0}, owner=827] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=831, descriptor=Index( UNIQUE, :label[0](property[16]) ), provider={key=lucene+native, version=2.0}, owner=834] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=838, descriptor=Index( UNIQUE, :label[113](property[16]) ), provider={key=lucene+native, version=2.0}, owner=841] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=845, descriptor=Index( UNIQUE, :label[134](property[16]) ), provider={key=lucene+native, version=2.0}, owner=848] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=852, descriptor=Index( UNIQUE, :label[47](property[16]) ), provider={key=lucene+native, version=2.0}, owner=855] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=859, descriptor=Index( UNIQUE, :label[150](property[16]) ), provider={key=lucene+native, version=2.0}, owner=862] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=866, descriptor=Index( UNIQUE, :label[204](property[16]) ), provider={key=lucene+native, version=2.0}, owner=869] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=873, descriptor=Index( UNIQUE, :label[212](property[16]) ), provider={key=lucene+native, version=2.0}, owner=876] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=880, descriptor=Index( UNIQUE, :label[210](property[16]) ), provider={key=lucene+native, version=2.0}, owner=883] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=887, descriptor=Index( UNIQUE, :label[217](property[16]) ), provider={key=lucene+native, version=2.0}, owner=890] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=894, descriptor=Index( UNIQUE, :label[215](property[16]) ), provider={key=lucene+native, version=2.0}, owner=897] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=901, descriptor=Index( UNIQUE, :label[223](property[16]) ), provider={key=lucene+native, version=2.0}, owner=904] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=908, descriptor=Index( UNIQUE, :label[238](property[16]) ), provider={key=lucene+native, version=2.0}, owner=911] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=915, descriptor=Index( UNIQUE, :label[209](property[16]) ), provider={key=lucene+native, version=2.0}, owner=918] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=922, descriptor=Index( UNIQUE, :label[239](property[16]) ), provider={key=lucene+native, version=2.0}, owner=925] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=929, descriptor=Index( UNIQUE, :label[36](property[57]) ), provider={key=lucene+native, version=2.0}, owner=932] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=936, descriptor=Index( UNIQUE, :label[37](property[57]) ), provider={key=lucene+native, version=2.0}, owner=939] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=943, descriptor=Index( UNIQUE, :label[35](property[57]) ), provider={key=lucene+native, version=2.0}, owner=946] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=950, descriptor=Index( UNIQUE, :label[34](property[57]) ), provider={key=lucene+native, version=2.0}, owner=953] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=957, descriptor=Index( UNIQUE, :label[131](property[16]) ), provider={key=lucene+native, version=2.0}, owner=960] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=964, descriptor=Index( UNIQUE, :label[14](property[16]) ), provider={key=lucene+native, version=2.0}, owner=967] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=971, descriptor=Index( UNIQUE, :label[14](property[52]) ), provider={key=lucene+native, version=2.0}, owner=974] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=978, descriptor=Index( UNIQUE, :label[15](property[16]) ), provider={key=lucene+native, version=2.0}, owner=981] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=985, descriptor=Index( UNIQUE, :label[15](property[54]) ), provider={key=lucene+native, version=2.0}, owner=988] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=992, descriptor=Index( UNIQUE, :label[60](property[57]) ), provider={key=lucene+native, version=2.0}, owner=995] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=999, descriptor=Index( UNIQUE, :label[13](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1002] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1006, descriptor=Index( UNIQUE, :label[24](property[57]) ), provider={key=lucene+native, version=2.0}, owner=1009] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1013, descriptor=Index( UNIQUE, :label[24](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1016] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1020, descriptor=Index( UNIQUE, :label[205](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1023] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1027, descriptor=Index( UNIQUE, :label[208](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1030] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1034, descriptor=Index( UNIQUE, :label[128](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1037] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1041, descriptor=Index( UNIQUE, :label[129](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1044] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1048, descriptor=Index( UNIQUE, :label[94](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1051] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1055, descriptor=Index( UNIQUE, :label[247](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1058] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1062, descriptor=Index( UNIQUE, :label[227](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1065] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1069, descriptor=Index( UNIQUE, :label[194](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1072] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1076, descriptor=Index( UNIQUE, :label[76](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1079] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1083, descriptor=Index( UNIQUE, :label[76](property[22]) ), provider={key=lucene+native, version=2.0}, owner=1086] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1090, descriptor=Index( UNIQUE, :label[159](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1093] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1097, descriptor=Index( UNIQUE, :label[211](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1100] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1104, descriptor=Index( UNIQUE, :label[93](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1107] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1111, descriptor=Index( UNIQUE, :label[93](property[162]) ), provider={key=lucene+native, version=2.0}, owner=1114] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1118, descriptor=Index( UNIQUE, :label[125](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1121] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1125, descriptor=Index( UNIQUE, :label[73](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1128] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1132, descriptor=Index( UNIQUE, :label[142](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1135] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1139, descriptor=Index( UNIQUE, :label[38](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1142] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1146, descriptor=Index( UNIQUE, :label[196](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1149] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1153, descriptor=Index( UNIQUE, :label[253](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1156] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1160, descriptor=Index( UNIQUE, :label[103](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1163] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1167, descriptor=Index( UNIQUE, :label[257](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1170] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1174, descriptor=Index( GENERAL, :label[134](property[58]) ), provider={key=lucene+native, version=2.0}] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1176, descriptor=Index( GENERAL, :label[134](property[159]) ), provider={key=lucene+native, version=2.0}] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1178, descriptor=Index( GENERAL, :label[259](property[159]) ), provider={key=lucene+native, version=2.0}] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1180, descriptor=Index( GENERAL, :label[259](property[58]) ), provider={key=lucene+native, version=2.0}] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1182, descriptor=Index( UNIQUE, :label[261](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1185] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1189, descriptor=Index( UNIQUE, :label[261](property[1073]) ), provider={key=lucene+native, version=2.0}, owner=1192] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1196, descriptor=Index( GENERAL, :label[113](property[58]) ), provider={key=lucene+native, version=2.0}] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1198, descriptor=Index( GENERAL, :label[113](property[159]) ), provider={key=lucene+native, version=2.0}] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1200, descriptor=Index( UNIQUE, :label[118](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1203] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1207, descriptor=Index( GENERAL, :label[118](property[243]) ), provider={key=lucene+native, version=2.0}] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1209, descriptor=Index( GENERAL, :label[118](property[241]) ), provider={key=lucene+native, version=2.0}] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1211, descriptor=Index( GENERAL, :label[118](property[364]) ), provider={key=lucene+native, version=2.0}] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1213, descriptor=Index( GENERAL, :label[118](property[242]) ), provider={key=lucene+native, version=2.0}] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1215, descriptor=Index( UNIQUE, :label[69](property[22], property[117]) ), provider={key=lucene+native, version=2.0}, owner=1218] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1222, descriptor=Index( GENERAL, :label[125](property[895]) ), provider={key=lucene+native, version=2.0}] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1224, descriptor=Index( UNIQUE, :label[198](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1227] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1234, descriptor=Index( GENERAL, :label[108](property[18]) ), provider={key=lucene+native, version=2.0}] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1236, descriptor=Index( UNIQUE, :label[71](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1239] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1243, descriptor=Index( UNIQUE, :label[242](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1246] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1250, descriptor=Index( UNIQUE, :label[107](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1253] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1257, descriptor=Index( UNIQUE, :label[124](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1260] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1264, descriptor=Index( UNIQUE, :label[110](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1267] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1271, descriptor=Index( UNIQUE, :label[260](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1274] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1278, descriptor=Index( UNIQUE, :label[225](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1281] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1285, descriptor=Index( UNIQUE, :label[225](property[17]) ), provider={key=lucene+native, version=2.0}, owner=1288] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1292, descriptor=Index( UNIQUE, :label[133](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1295] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1299, descriptor=Index( UNIQUE, :label[148](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1302] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1306, descriptor=Index( UNIQUE, :label[171](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1309] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1313, descriptor=Index( UNIQUE, :label[75](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1316] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1320, descriptor=Index( UNIQUE, :label[153](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1323] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1327, descriptor=Index( UNIQUE, :label[236](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1330] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1341, descriptor=Index( UNIQUE, :label[189](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1344] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1348, descriptor=Index( UNIQUE, :label[189](property[449]) ), provider={key=lucene+native, version=2.0}, owner=1351] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1355, descriptor=Index( UNIQUE, :label[109](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1358] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1362, descriptor=Index( UNIQUE, :label[109](property[17]) ), provider={key=lucene+native, version=2.0}, owner=1365] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1372, descriptor=Index( UNIQUE, :label[121](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1375] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1379, descriptor=Index( GENERAL, :label[121](property[292]) ), provider={key=lucene+native, version=2.0}] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1381, descriptor=Index( UNIQUE, :label[186](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1384] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1388, descriptor=Index( GENERAL, :label[186](property[457]) ), provider={key=lucene+native, version=2.0}] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1390, descriptor=Index( GENERAL, :label[186](property[458]) ), provider={key=lucene+native, version=2.0}] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1392, descriptor=Index( GENERAL, :label[36](property[576]) ), provider={key=lucene+native, version=2.0}] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1394, descriptor=Index( GENERAL, :label[36](property[574]) ), provider={key=lucene+native, version=2.0}] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1396, descriptor=Index( UNIQUE, :label[189](property[66], property[67]) ), provider={key=lucene+native, version=2.0}, owner=1399] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1403, descriptor=Index( UNIQUE, :label[21](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1406] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1410, descriptor=Index( GENERAL, :label[96](property[18]) ), provider={key=lucene+native, version=2.0}] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1412, descriptor=Index( UNIQUE, :label[166](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1415] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1419, descriptor=Index( UNIQUE, :label[61](property[17]) ), provider={key=lucene+native, version=2.0}, owner=1422] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1426, descriptor=Index( UNIQUE, :label[61](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1429] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1433, descriptor=Index( UNIQUE, :label[187](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1436] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1440, descriptor=Index( UNIQUE, :label[70](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1443] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1447, descriptor=Index( UNIQUE, :label[57](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1450] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1454, descriptor=Index( UNIQUE, :label[57](property[73]) ), provider={key=lucene+native, version=2.0}, owner=1457] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1461, descriptor=Index( UNIQUE, :label[162](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1464] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1474, descriptor=Index( UNIQUE, :label[105](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1477] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1481, descriptor=Index( UNIQUE, :label[112](property[16]) ), provider={key=lucene+native, version=2.0}, owner=1484] ]
WARN : Index was not properly shutdown and rebuild is required.
	Index[ IndexRule[id=1488, descriptor=Index( UNIQUE, :label[103](property[204]) ), provider={key=lucene+native, version=2.0}, owner=1491] ]
WARN : Inconsistencies found: ConsistencySummaryStatistics{
	Number of errors: 5
	Number of warnings: 119
	Number of inconsistent PROPERTY records: 3
	Number of inconsistent STRING_PROPERTY records: 2
}

[tomswinkels]

copy-store.log

To use your existing Neo4j 3.3.x installation set NEO4J_HOME to your Neo4j directory. Currently set to: 
Usage: copy-store.sh [community|enterprise] source.db target.db [RELS,TO,SKIP] [props,to,skip] [Labels,To,Skip] [Labels,To,Delete,Nodes]

Using: Heap 4G Pagecache 2G Edition 'enterprise' from '/var/lib/neo4j/data/databases/graph.db' to '/var/lib/neo4j/data/databases/graph.db.fixed' skipping labels: '', removing nodes with labels: '' rels: '' props '' Keeping Node Ids: 

Please note that you will need this memory (2G + 1G + 4G) as it opens 2 databases one for reading and one for writing.

[INFO] Error stacktraces are turned on.
[INFO] Scanning for projects...
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building store-util 3.4.5
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ store-util ---
[INFO] Deleting /usr/src/store-utils/target
[INFO] 
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ store-util ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /usr/src/store-utils/src/main/resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ store-util ---
[INFO] Compiling 7 source files to /usr/src/store-utils/target/classes
[WARNING] /usr/src/store-utils/src/main/java/org/neo4j/tool/StoreComparer.java:[56,101] [deprecation] setConfig(Map<String,String>) in GraphDatabaseBuilder has been deprecated
[WARNING] /usr/src/store-utils/src/main/java/org/neo4j/tool/StoreComparer.java:[57,101] [deprecation] setConfig(Map<String,String>) in GraphDatabaseBuilder has been deprecated
[WARNING] /usr/src/store-utils/src/main/java/org/neo4j/tool/StoreComparer.java:[59,25] [try] auto-closeable resource srcDbTx is never referenced in body of corresponding try statement
[WARNING] /usr/src/store-utils/src/main/java/org/neo4j/tool/StoreComparer.java:[60,25] [try] auto-closeable resource targetDbTx is never referenced in body of corresponding try statement
[WARNING] /usr/src/store-utils/src/main/java/org/neo4j/tool/StoreUpdate.java:[17,15] [unchecked] unchecked conversion
[WARNING]     Map
/usr/src/store-utils/src/main/java/org/neo4j/tool/StoreUpdate.java:[33,95] [deprecation] setConfig(Map<String,String>) in GraphDatabaseBuilder has been deprecated
[WARNING] /usr/src/store-utils/src/main/java/org/neo4j/tool/PropertyAnalyzer.java:[85,15] [unchecked] unchecked conversion
[WARNING]     Map
/usr/src/store-utils/src/main/java/org/neo4j/tool/PropertyAnalyzer.java:[99,112] [deprecation] setConfig(Map<String,String>) in GraphDatabaseBuilder has been deprecated
[INFO] 
[INFO] >>> exec-maven-plugin:1.1:java (default-cli) > validate @ store-util >>>
[INFO] 
[INFO] <<< exec-maven-plugin:1.1:java (default-cli) < validate @ store-util <<<
[INFO] 
[INFO] --- exec-maven-plugin:1.1:java (default-cli) @ store-util ---
Copying from /var/lib/neo4j/data/databases/graph.db to /var/lib/neo4j/data/databases/graph.db.fixed ingoring rel-types [] ignoring properties [] ignoring labels [] removing nodes with labels [] keep node ids true 
.................................................. 500000 / 39629359 (1%) unused 500000 removed 0
.................................................. 1000000 / 39629359 (2%) unused 1000000 removed 0
.................................................. 1500000 / 39629359 (3%) unused 1500000 removed 0
.................................................. 2000000 / 39629359 (5%) unused 1969847 removed 0
.................................................. 2500000 / 39629359 (6%) unused 2463615 removed 0
.................................................. 3000000 / 39629359 (7%) unused 2938646 removed 0
.................................................. 3500000 / 39629359 (8%) unused 3396768 removed 0
.................................................. 4000000 / 39629359 (10%) unused 3647862 removed 0
.................................................. 4500000 / 39629359 (11%) unused 4029536 removed 0
.................................................. 5000000 / 39629359 (12%) unused 4353964 removed 0
.................................................. 5500000 / 39629359 (13%) unused 4593107 removed 0
.................................................. 6000000 / 39629359 (15%) unused 4931211 removed 0
.................................................. 6500000 / 39629359 (16%) unused 5418344 removed 0
.................................................. 7000000 / 39629359 (17%) unused 5764279 removed 0
.................................................. 7500000 / 39629359 (18%) unused 5986148 removed 0
.................................................. 8000000 / 39629359 (20%) unused 6108864 removed 0
.................................................. 8500000 / 39629359 (21%) unused 6226507 removed 0
.................................................. 9000000 / 39629359 (22%) unused 6328743 removed 0
.................................................. 9500000 / 39629359 (23%) unused 6378556 removed 0
.................................................. 10000000 / 39629359 (25%) unused 6405981 removed 0
.................................................. 10500000 / 39629359 (26%) unused 6424808 removed 0
.................................................. 11000000 / 39629359 (27%) unused 6458360 removed 0
.................................................. 11500000 / 39629359 (29%) unused 6562721 removed 0
.................................................. 12000000 / 39629359 (30%) unused 6572744 removed 0
.................................................. 12500000 / 39629359 (31%) unused 6592536 removed 0
.................................................. 13000000 / 39629359 (32%) unused 6605850 removed 0
.................................................. 13500000 / 39629359 (34%) unused 6632171 removed 0
.................................................. 14000000 / 39629359 (35%) unused 6661701 removed 0
.................................................. 14500000 / 39629359 (36%) unused 6673651 removed 0
.................................................. 15000000 / 39629359 (37%) unused 6716329 removed 0
.................................................. 15500000 / 39629359 (39%) unused 6745091 removed 0
.................................................. 16000000 / 39629359 (40%) unused 6763609 removed 0
.................................................. 16500000 / 39629359 (41%) unused 6844474 removed 0
.................................................. 17000000 / 39629359 (42%) unused 6886183 removed 0
.................................................. 17500000 / 39629359 (44%) unused 6982565 removed 0
.................................................. 18000000 / 39629359 (45%) unused 7072914 removed 0
.................................................. 18500000 / 39629359 (46%) unused 7183279 removed 0
.................................................. 19000000 / 39629359 (47%) unused 7291219 removed 0
.................................................. 19500000 / 39629359 (49%) unused 7355959 removed 0
.................................................. 20000000 / 39629359 (50%) unused 7446855 removed 0
.................................................. 20500000 / 39629359 (51%) unused 7496371 removed 0
.................................................. 21000000 / 39629359 (52%) unused 7633374 removed 0
.................................................. 21500000 / 39629359 (54%) unused 7690677 removed 0
.................................................. 22000000 / 39629359 (55%) unused 7959543 removed 0
.................................................. 22500000 / 39629359 (56%) unused 8119818 removed 0
.................................................. 23000000 / 39629359 (58%) unused 8221578 removed 0
.................................................. 23500000 / 39629359 (59%) unused 8235231 removed 0
.................................................. 24000000 / 39629359 (60%) unused 8345483 removed 0
.................................................. 24500000 / 39629359 (61%) unused 8505492 removed 0
.................................................. 25000000 / 39629359 (63%) unused 8517198 removed 0
.................................................. 25500000 / 39629359 (64%) unused 8638152 removed 0
.................................................. 26000000 / 39629359 (65%) unused 8728158 removed 0
.................................................. 26500000 / 39629359 (66%) unused 8809561 removed 0
.................................................. 27000000 / 39629359 (68%) unused 8902750 removed 0
.................................................. 27500000 / 39629359 (69%) unused 9060561 removed 0
.................................................. 28000000 / 39629359 (70%) unused 9126075 removed 0
.................................................. 28500000 / 39629359 (71%) unused 9278204 removed 0
.................................................. 29000000 / 39629359 (73%) unused 9339029 removed 0
.................................................. 29500000 / 39629359 (74%) unused 9487764 removed 0
.................................................. 30000000 / 39629359 (75%) unused 9609592 removed 0
.................................................. 30500000 / 39629359 (76%) unused 9762430 removed 0
.................................................. 31000000 / 39629359 (78%) unused 9795571 removed 0
.................................................. 31500000 / 39629359 (79%) unused 9930737 removed 0
.................................................. 32000000 / 39629359 (80%) unused 10146225 removed 0
.................................................. 32500000 / 39629359 (82%) unused 10194650 removed 0
.................................................. 33000000 / 39629359 (83%) unused 10277770 removed 0
.................................................. 33500000 / 39629359 (84%) unused 10283462 removed 0
.................................................. 34000000 / 39629359 (85%) unused 10289118 removed 0
.................................................. 34500000 / 39629359 (87%) unused 10293078 removed 0
.................................................. 35000000 / 39629359 (88%) unused 10298868 removed 0
.................................................. 35500000 / 39629359 (89%) unused 10299052 removed 0
.................................................. 36000000 / 39629359 (90%) unused 10306441 removed 0
.................................................. 36500000 / 39629359 (92%) unused 10307648 removed 0
.................................................. 37000000 / 39629359 (93%) unused 10311266 removed 0
.................................................. 37500000 / 39629359 (94%) unused 10319205 removed 0
.................................................. 38000000 / 39629359 (95%) unused 10320628 removed 0
.................................................. 38500000 / 39629359 (97%) unused 10329755 removed 0
.................................................. 39000000 / 39629359 (98%) unused 10338651 removed 0
.................................................. 39500000 / 39629359 (99%) unused 10348514 removed 0
............
 copying of 39629360 node records took 6419 seconds (6173 rec/s). Unused Records 10355765 (26%). Removed Records 0 (0%).
.................................................. 500000 / 80610657 (0%) unused 499969 removed 0
.................................................. 1000000 / 80610657 (1%) unused 999278 removed 0
.................................................. 1500000 / 80610657 (1%) unused 1483437 removed 0
.................................................. 2000000 / 80610657 (2%) unused 1975282 removed 0
.................................................. 2500000 / 80610657 (3%) unused 2343753 removed 0
.................................................. 3000000 / 80610657 (3%) unused 2645057 removed 0
.................................................. 3500000 / 80610657 (4%) unused 3061552 removed 0
.................................................. 4000000 / 80610657 (4%) unused 3396080 removed 0
.................................................. 4500000 / 80610657 (5%) unused 3604763 removed 0
.................................................. 5000000 / 80610657 (6%) unused 3739363 removed 0
.................................................. 5500000 / 80610657 (6%) unused 3893352 removed 0
.................................................. 6000000 / 80610657 (7%) unused 4026771 removed 0
.................................................. 6500000 / 80610657 (8%) unused 4215357 removed 0
.................................................. 7000000 / 80610657 (8%) unused 4307620 removed 0
.................................................. 7500000 / 80610657 (9%) unused 4356053 removed 0
.................................................. 8000000 / 80610657 (9%) unused 4425599 removed 0
.................................................. 8500000 / 80610657 (10%) unused 4522548 removed 0
.................................................. 9000000 / 80610657 (11%) unused 4599568 removed 0
.................................................. 9500000 / 80610657 (11%) unused 4605390 removed 0
.................................................. 10000000 / 80610657 (12%) unused 4610648 removed 0
.................................................. 10500000 / 80610657 (13%) unused 4612118 removed 0
.................................................. 11000000 / 80610657 (13%) unused 4613551 removed 0
.................................................. 11500000 / 80610657 (14%) unused 4615250 removed 0
.................................................. 12000000 / 80610657 (14%) unused 4617221 removed 0
.................................................. 12500000 / 80610657 (15%) unused 4618626 removed 0
.................................................. 13000000 / 80610657 (16%) unused 4621618 removed 0
.................................................. 13500000 / 80610657 (16%) unused 4622873 removed 0
.................................................. 14000000 / 80610657 (17%) unused 4624770 removed 0
.................................................. 14500000 / 80610657 (17%) unused 4625892 removed 0
.................................................. 15000000 / 80610657 (18%) unused 4629885 removed 0
.................................................. 15500000 / 80610657 (19%) unused 4632716 removed 0
.................................................. 16000000 / 80610657 (19%) unused 4635337 removed 0
.................................................. 16500000 / 80610657 (20%) unused 4645960 removed 1
.................................................. 17000000 / 80610657 (21%) unused 4649691 removed 1
.................................................. 17500000 / 80610657 (21%) unused 4652610 removed 1
.................................................. 18000000 / 80610657 (22%) unused 4656072 removed 1
.................................................. 18500000 / 80610657 (22%) unused 4656730 removed 1
.................................................. 19000000 / 80610657 (23%) unused 4658845 removed 1
.................................................. 19500000 / 80610657 (24%) unused 4661078 removed 1
.................................................. 20000000 / 80610657 (24%) unused 4664098 removed 2
.................................................. 20500000 / 80610657 (25%) unused 4665969 removed 2
.................................................. 21000000 / 80610657 (26%) unused 4666036 removed 2
.................................................. 21500000 / 80610657 (26%) unused 4666840 removed 2
.................................................. 22000000 / 80610657 (27%) unused 4675724 removed 2
.................................................. 22500000 / 80610657 (27%) unused 4679366 removed 2
.................................................. 23000000 / 80610657 (28%) unused 4682282 removed 2
.................................................. 23500000 / 80610657 (29%) unused 4687375 removed 2
.................................................. 24000000 / 80610657 (29%) unused 4699262 removed 2
.................................................. 24500000 / 80610657 (30%) unused 4737155 removed 2
.................................................. 25000000 / 80610657 (31%) unused 4739477 removed 2
.................................................. 25500000 / 80610657 (31%) unused 4756872 removed 2
.................................................. 26000000 / 80610657 (32%) unused 4855719 removed 2
.................................................. 26500000 / 80610657 (32%) unused 4860188 removed 2
.................................................. 27000000 / 80610657 (33%) unused 4861574 removed 2
.................................................. 27500000 / 80610657 (34%) unused 4876869 removed 2
.................................................. 28000000 / 80610657 (34%) unused 4947773 removed 2
.................................................. 28500000 / 80610657 (35%) unused 4978007 removed 2
.................................................. 29000000 / 80610657 (35%) unused 5005810 removed 2
.................................................. 29500000 / 80610657 (36%) unused 5094600 removed 2
.................................................. 30000000 / 80610657 (37%) unused 5240647 removed 2
.................................................. 30500000 / 80610657 (37%) unused 5278852 removed 2
.................................................. 31000000 / 80610657 (38%) unused 5381877 removed 2
.................................................. 31500000 / 80610657 (39%) unused 5445060 removed 3
.................................................. 32000000 / 80610657 (39%) unused 5468458 removed 3
.................................................. 32500000 / 80610657 (40%) unused 5587889 removed 3
.................................................. 33000000 / 80610657 (40%) unused 5630913 removed 3
.................................................. 33500000 / 80610657 (41%) unused 5712809 removed 3
.................................................. 34000000 / 80610657 (42%) unused 5733844 removed 3
.................................................. 34500000 / 80610657 (42%) unused 5797436 removed 3
.................................................. 35000000 / 80610657 (43%) unused 5886845 removed 3
.................................................. 35500000 / 80610657 (44%) unused 5944240 removed 3
.................................................. 36000000 / 80610657 (44%) unused 5957680 removed 3
.................................................. 36500000 / 80610657 (45%) unused 6050320 removed 3
.................................................. 37000000 / 80610657 (45%) unused 6205485 removed 3
.................................................. 37500000 / 80610657 (46%) unused 6454019 removed 3
.................................................. 38000000 / 80610657 (47%) unused 6553903 removed 3
.................................................. 38500000 / 80610657 (47%) unused 6713752 removed 3
.................................................. 39000000 / 80610657 (48%) unused 6771598 removed 3
.................................................. 39500000 / 80610657 (49%) unused 6795208 removed 3
.................................................. 40000000 / 80610657 (49%) unused 6810001 removed 3
.................................................. 40500000 / 80610657 (50%) unused 6823608 removed 3
.................................................. 41000000 / 80610657 (50%) unused 6840200 removed 3
.................................................. 41500000 / 80610657 (51%) unused 6998763 removed 3
.................................................. 42000000 / 80610657 (52%) unused 7085067 removed 3
.................................................. 42500000 / 80610657 (52%) unused 7144984 removed 3
.................................................. 43000000 / 80610657 (53%) unused 7168405 removed 3
.................................................. 43500000 / 80610657 (53%) unused 7171629 removed 3
.................................................. 44000000 / 80610657 (54%) unused 7205065 removed 3
.................................................. 44500000 / 80610657 (55%) unused 7359539 removed 3
.................................................. 45000000 / 80610657 (55%) unused 7417734 removed 3
.................................................. 45500000 / 80610657 (56%) unused 7443039 removed 3
.................................................. 46000000 / 80610657 (57%) unused 7467873 removed 3
.................................................. 46500000 / 80610657 (57%) unused 7535116 removed 3
.................................................. 47000000 / 80610657 (58%) unused 7713069 removed 3
.................................................. 47500000 / 80610657 (58%) unused 7749979 removed 3
.................................................. 48000000 / 80610657 (59%) unused 7798559 removed 3
.................................................. 48500000 / 80610657 (60%) unused 7928689 removed 3
.................................................. 49000000 / 80610657 (60%) unused 8161258 removed 3
.................................................. 49500000 / 80610657 (61%) unused 8265474 removed 3
.................................................. 50000000 / 80610657 (62%) unused 8344496 removed 3
.................................................. 50500000 / 80610657 (62%) unused 8535746 removed 3
.................................................. 51000000 / 80610657 (63%) unused 8576552 removed 3
.................................................. 51500000 / 80610657 (63%) unused 8623587 removed 3
.................................................. 52000000 / 80610657 (64%) unused 8657825 removed 3
.................................................. 52500000 / 80610657 (65%) unused 8744354 removed 3
.................................................. 53000000 / 80610657 (65%) unused 8893624 removed 3
.................................................. 53500000 / 80610657 (66%) unused 8917808 removed 3
.................................................. 54000000 / 80610657 (66%) unused 8980470 removed 3
.................................................. 54500000 / 80610657 (67%) unused 9176640 removed 3
.................................................. 55000000 / 80610657 (68%) unused 9246931 removed 3
.................................................. 55500000 / 80610657 (68%) unused 9435676 removed 3
.................................................. 56000000 / 80610657 (69%) unused 9467009 removed 3
.................................................. 56500000 / 80610657 (70%) unused 9493197 removed 3
.................................................. 57000000 / 80610657 (70%) unused 9682921 removed 3
.................................................. 57500000 / 80610657 (71%) unused 9947935 removed 3
.................................................. 58000000 / 80610657 (71%) unused 10173777 removed 3
.................................................. 58500000 / 80610657 (72%) unused 10294189 removed 3
.................................................. 59000000 / 80610657 (73%) unused 10307374 removed 3
.................................................. 59500000 / 80610657 (73%) unused 10376069 removed 3
.................................................. 60000000 / 80610657 (74%) unused 10637387 removed 3
.................................................. 60500000 / 80610657 (75%) unused 10657177 removed 3
.................................................. 61000000 / 80610657 (75%) unused 10660111 removed 3
.................................................. 61500000 / 80610657 (76%) unused 10666090 removed 3
.................................................. 62000000 / 80610657 (76%) unused 10668665 removed 3
.................................................. 62500000 / 80610657 (77%) unused 10679381 removed 5
.................................................. 63000000 / 80610657 (78%) unused 10780555 removed 5
.................................................. 63500000 / 80610657 (78%) unused 10782747 removed 5
.................................................. 64000000 / 80610657 (79%) unused 10783500 removed 5
.................................................. 64500000 / 80610657 (80%) unused 10794600 removed 6
.................................................. 65000000 / 80610657 (80%) unused 10836470 removed 6
.................................................. 65500000 / 80610657 (81%) unused 10837660 removed 6
.................................................. 66000000 / 80610657 (81%) unused 10849353 removed 6
.................................................. 66500000 / 80610657 (82%) unused 10881520 removed 6
.................................................. 67000000 / 80610657 (83%) unused 10885428 removed 6
.................................................. 67500000 / 80610657 (83%) unused 10889297 removed 6
.................................................. 68000000 / 80610657 (84%) unused 10938393 removed 6
.................................................. 68500000 / 80610657 (84%) unused 10939356 removed 6
.................................................. 69000000 / 80610657 (85%) unused 10939579 removed 6
.................................................. 69500000 / 80610657 (86%) unused 10945179 removed 6
.................................................. 70000000 / 80610657 (86%) unused 10983490 removed 6
.................................................. 70500000 / 80610657 (87%) unused 10987677 removed 6
.................................................. 71000000 / 80610657 (88%) unused 10996881 removed 6
.................................................. 71500000 / 80610657 (88%) unused 11001495 removed 6
.................................................. 72000000 / 80610657 (89%) unused 11030461 removed 6
.................................................. 72500000 / 80610657 (89%) unused 11031334 removed 6
.................................................. 73000000 / 80610657 (90%) unused 11032664 removed 6
.................................................. 73500000 / 80610657 (91%) unused 11038701 removed 6
.................................................. 74000000 / 80610657 (91%) unused 11080760 removed 6
.................................................. 74500000 / 80610657 (92%) unused 11107361 removed 6
.................................................. 75000000 / 80610657 (93%) unused 11108276 removed 6
.................................................. 75500000 / 80610657 (93%) unused 11109194 removed 6
.................................................. 76000000 / 80610657 (94%) unused 11117905 removed 6
.................................................. 76500000 / 80610657 (94%) unused 11167292 removed 6
.................................................. 77000000 / 80610657 (95%) unused 11169537 removed 6
.................................................. 77500000 / 80610657 (96%) unused 11170090 removed 6
.................................................. 78000000 / 80610657 (96%) unused 11177488 removed 6
.................................................. 78500000 / 80610657 (97%) unused 11246712 removed 6
.................................................. 79000000 / 80610657 (98%) unused 11295064 removed 6
.................................................. 79500000 / 80610657 (98%) unused 11298077 removed 6
.................................................. 80000000 / 80610657 (99%) unused 11348524 removed 6
.................................................. 80500000 / 80610657 (99%) unused 11414632 removed 6
...........
 copying of 80610658 relationship records took 2418 seconds (33337 rec/s). Unused Records 11433462 (14%) Removed Records 6 (0%)
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:29 h
[INFO] Finished at: 2018-08-23T12:44:04+02:00
[INFO] Final Memory: 39M/4096M
[INFO] ------------------------------------------------------------------------

Where can i find the problems, and can we fix that manually?

[michael_hunger]

You cannot fix them manually, you'd have to binary-edit the store.
Bascially there are 5 properties that are broken. So if you can you can after running store-utils find the nodes with those properties and re-set them.

[tomswinkels]

We don't know witch nodes are have problems. Store-utils don't tell us witch nodes are deleted or broken. How can we find the nodes?

[michael_hunger]

Are you 100% sure there is no store-copy.log in your target database directory?

[tomswinkels]

In the target database directory (/var/lib/neo4j/data/databases/graph.db/store-copy.log) there is a store-copy.log but the file is empty.

[tomswinkels]

We found some corrupt records with the Neo4j browser. When we delete that record we get some error.

MATCH (n:RssItem) WHERE ID(n) = 19926597 DETACH DELETE n

Neo.DatabaseError.General.UnknownError: DynamicRecord[74917275,used=false,(0),type=-1,data=byte[],start=true,next=-1] not in use

Is there some option for delete that records?

[michael_hunger]

You can just use the store that store-utils generated.

Really weird though that store-copy.log is empty, it should contain info about the skipped relationships.

[tomswinkels]

But we can not use store-utils on a running database.

So we need to tell us customers that we have downtime for +/- 5 hours.

I think when we fix the data with store-utils this are the steps;

• Backup last data of Neo4j
• Remove all indexes
• Stop Neo4j service
• Run store-utils (2.5 hours)
• Start Neo4j
• Create all indexes (alot of indexes)

In the best case we don't want have a downtime of +/- 5 hours, is there some other way to fix the problem?

[michael_hunger]

Unfortunately fixing store errors is not something you can do online.

You only need the enterprise indexes, but you need to recreate them all.

If you have more time, I can see if I find time in the next weeks to finish the work on the faster version of store-utils. That faster version will also use more CPUs and I/O so it would benefit from a larger machine to run on.

Alternatively you can try to go via support.

[tomswinkels]

Today we wanted run the store-utils on us production server but we get this error;

root@neo01:~/store-util-3.4.5# export NEO4J_HOME=/usr/bin/neo4j
root@neo01:~/store-util-3.4.5# ./copy-store.sh enterprise /root/corrupt.db /root/test.db
To use your existing Neo4j 3.3.x installation set NEO4J_HOME to your Neo4j directory. Currently set to: /usr/bin/neo4j
Usage: copy-store.sh [community|enterprise] source.db target.db [RELS,TO,SKIP] [props,to,skip] [Labels,To,Skip] [Labels,To,Delete,Nodes]

Using: Heap 4G Pagecache 2G Edition ‘enterprise’ from ‘/root/corrupt.db’ to ‘/root/test.db’ skipping labels: ‘’, removing nodes with labels: ‘’ rels: ‘’ props ‘’ Keeping Node Ids: 

Please note that you will need this memory (2G + 1G + 4G) as it opens 2 databases one for reading and one for writing.

[INFO] Error stacktraces are turned on.
[INFO] Scanning for projects...
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building store-util 3.4.5
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ store-util ---
[INFO] 
[INFO] --- maven-resources-plugin:2.3:resources (default-resources) @ store-util ---
[INFO] Using ‘UTF-8’ encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /root/store-util-3.4.5/src/main/resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ store-util ---
[INFO] No sources to compile
[INFO] 
[INFO] >>> exec-maven-plugin:1.1:java (default-cli) @ store-util >>>
[INFO] 
[INFO] <<< exec-maven-plugin:1.1:java (default-cli) @ store-util <<<
[INFO] 
[INFO] --- exec-maven-plugin:1.1:java (default-cli) @ store-util ---
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 2:54.337s
[INFO] Finished at: Fri Sep 07 07:13:04 CEST 2018
[INFO] Final Memory: 14M/4096M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.1:java (default-cli) on project store-util: An exception occured while executing the Java class. org.neo4j.tool.StoreCopy -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.1:java (default-cli) on project store-util: An exception occured while executing the Java class. org.neo4j.tool.StoreCopy
	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:217)
	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
	at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
	at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
	at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
	at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
	at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
	at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
	at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
	at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
	at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
	at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
	at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
	at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: An exception occured while executing the Java class. org.neo4j.tool.StoreCopy
	at org.codehaus.mojo.exec.ExecJavaMojo.execute(ExecJavaMojo.java:345)
	at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101)
	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209)
	... 19 more
Caused by: java.lang.ClassNotFoundException: org.neo4j.tool.StoreCopy
	at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
	at org.codehaus.mojo.exec.ExecJavaMojo$1.run(ExecJavaMojo.java:283)
	at java.lang.Thread.run(Thread.java:748)
[ERROR] 
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:

We running it on Ubuntu 14.04.

Do you now what the error is?

[michael_hunger]

Did you just clone the repo? Or download the release?

[tomswinkels]

We have fix it to delete Java 7, and use Java 8.

[michael_hunger]

Oh sorry, I was not aware that there is an issue with Java7 thanks for finding it out.

I make a note in the readme, and probably add a check in the script.

[tim_hanssen]

Solution; We fixed the issue by running https://github.com/jexp/store-utils with Java 8 on our data store.

[michael_hunger]

Glad it worked out in the end.

[rvenkat6]

Hi,

Am facing the below error on store-utils-3.5.1. Any help will be highly appreciated.

[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.1:java (default-cli) on project store-util: An exception occured while executing the Java class. null: InvocationTargetException: Error starting org.neo4j.kernel.impl.factory.GraphDatabaseFacadeFactory, /xtra200/neo4j/databases/graph.db: Component 'org.neo4j.kernel.NeoStoreDataSource@6ebf13f2' was successfully initialized, but failed to start. Please see the attached cause exception "Tried to get index provider with name {key=native-btree, version=1.0} whereas available providers in this session being [lucene-1.0, lucene+native-1.0, lucene+native-2.0], and default being lucene+native-2.0". org.neo4j.kernel.lifecycle.LifecycleException: Component 'org.neo4j.kernel.impl.storageengine.impl.recordstorage.RecordStorageEngine@6e5c49fb' failed to initialize. Please see the attached cause exception "Tried to get index provider with name {key=native-btree, version=1.0} whereas available providers in this session being [lucene-1.0, lucene+native-1.0, lucene+native-2.0], and default being lucene+native-2.0". -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.1:java (default-cli) on project store-util: An exception occured while executing the Java class. null

[rvenkat6 · Accepted solution]

The issue has been resolved after adding setting.xml file in the .m2 dir.

Regards
Krishnan

[yashsrivastava0]

Hi,
I am running Store-util 3.5.20. against store size ~1TB.

i am noticing this everytime i run store util, compaction is getting stuck at 99% at this stage.

.................................................. 6774500000 / 6774780801 (99%) unused 689968897 removed 0
............................
copying of 6774780802 relationship records took 9066 seconds (747273 rec/s). Unused Records 689969492 (10%) Removed Records 0 (0%)
Stopping target database

In the Store-copy.log i can see below exception (this is complete log in store-copy.log):
Node: 1696917795 java.io.IOException: Exception in the page eviction thread
Node: 1696917796 java.io.IOException: Exception in the page eviction thread
Node: 1696917797 java.io.IOException: Exception in the page eviction thread

does this means, its not able to complete because of these NODES, is there a way we can skip these while running store util?
Could someone has similar issue and suggest me?

Regards,
Yash Srivastava

[JnMik]

I realized yesterday that one of my backup fail to pass the consistency check.

When I run the consistency checker on the backup, it fails but never create the report.
Is the report supposed to be created for backups as well or only for databases ?

I'm using this
neo4j-admin check-consistency --backup <db_name> --report-dir="/tmp" --check-indexes=true --check-graph=true --check-index-structure=true --check-label-scan-store=true