Failed to migrate a dump from neo4j 3.5.6 community edition to neo4j 4.1 enterprise edition

[raghad_baiad]

I'm trying to migrate a database dump from 3.5.6 community edition neo4j to 4.1 enterprise version. I know that the only way to load a dump from a community edition is to tar the dump and load it in the newer version. I followed couple of guides to do that and made sure that dbms.allow_upgrade=true is in the neo4j.conf file. However, I'm getting the following error while trying to start the service. Although, I have tested on 3.5.6 to 3.5.21 migration and it worked fine org.neo4j.kernel.lifecycle.LifecycleAdapter$3@d520439' was successfully initialized, but failed to start. Please see the attached cause exception "Cannot map files with a filePageSize (0) that is less than 8 bytes | GBPTree[file:/var/lib/neo4j/data/databases/vodafone/neostore.id]".

the size of neostore.id is 9B and it was always like that just wondering why it is an issue in migrating from neo4j 3.5.xx to neo4j 4.1

a snippest of debug.log:
2020-08-11 16:13:48.873+0000 INFO [c.n.c.c.c.m.RaftMembershipManager] [vodafone] Membership state before recovery: RaftMembershipState{committed=MembershipEntry{logIndex=0, members=[MemberId{02a2f441}, MemberId{578213ac}, MemberId{ceae9be9}]}, appended=null, ordinal=0}
2020-08-11 16:13:48.873+0000 INFO [c.n.c.c.c.m.RaftMembershipManager] [vodafone] Recovering from: 2 to: 6
2020-08-11 16:13:48.874+0000 INFO [c.n.c.c.c.m.RaftMembershipManager] [vodafone] Membership state after recovery: RaftMembershipState{committed=MembershipEntry{logIndex=0, members=[MemberId{02a2f441}, MemberId{578213ac}, MemberId{ceae9be9}]}, appended=null, ordinal=0}
2020-08-11 16:13:48.875+0000 INFO [c.n.c.c.c.m.RaftMembershipManager] [vodafone] Target membership: [MemberId{02a2f441}, MemberId{ceae9be9}]
2020-08-11 16:13:48.881+0000 INFO [c.n.c.d.a.GlobalTopologyState] The core replicated states for database DatabaseId{00000000} changed
previous state was:
MemberId{02a2f441}=DiscoveryDatabaseState{DatabaseId{00000000}, operatorState=STARTED, result=SUCCESS}
MemberId{578213ac}=DiscoveryDatabaseState{DatabaseId{00000000}, operatorState=STOPPED, result=SUCCESS}
MemberId{ceae9be9}=DiscoveryDatabaseState{DatabaseId{00000000}, operatorState=STARTED, result=SUCCESS}
current state is:
MemberId{02a2f441}=DiscoveryDatabaseState{DatabaseId{00000000}, operatorState=STARTED, result=SUCCESS}
MemberId{578213ac}=DiscoveryDatabaseState{DatabaseId{00000000}, operatorState=STARTED, result=SUCCESS}
MemberId{ceae9be9}=DiscoveryDatabaseState{DatabaseId{00000000}, operatorState=STARTED, result=SUCCESS}
2020-08-11 16:13:48.963+0000 INFO [c.n.c.c.c.l.p.PruningScheduler] [vodafone] PruningScheduler stopping
2020-08-11 16:13:48.976+0000 ERROR [c.n.d.ClusteredDbmsReconciler] Encountered error when attempting to reconcile database vodafone from state 'EnterpriseDatabaseState{databaseId=DatabaseId{97d658a1[vodafone]}, operatorState=STOPPED, failed=false}' to state 'online' Unable to start database DatabaseId{97d658a1[vodafone]}
org.neo4j.dbms.api.DatabaseManagementException: Unable to start database DatabaseId{97d658a1[vodafone]}
at com.neo4j.dbms.database.ClusteredMultiDatabaseManager.startDatabase(ClusteredMultiDatabaseManager.java:68)
at com.neo4j.dbms.database.ClusteredMultiDatabaseManager.startDatabase(ClusteredMultiDatabaseManager.java:30)
at com.neo4j.dbms.database.MultiDatabaseManager.forSingleDatabase(MultiDatabaseManager.java:134)
at com.neo4j.dbms.database.MultiDatabaseManager.startDatabase(MultiDatabaseManager.java:119)
at com.neo4j.dbms.Transition$Prepared.doTransitionAction(Transition.java:101)
at com.neo4j.dbms.Transition$Prepared.doTransition(Transition.java:88)
at com.neo4j.dbms.DbmsReconciler.doTransitionStep(DbmsReconciler.java:346)
at com.neo4j.dbms.DbmsReconciler.doTransitionStep(DbmsReconciler.java:347)
at com.neo4j.dbms.DbmsReconciler.doTransitionStep(DbmsReconciler.java:347)
at com.neo4j.dbms.DbmsReconciler.lambda$doTransitions$11(DbmsReconciler.java:315)
at com.neo4j.dbms.DbmsReconciler.namedJob(DbmsReconciler.java:326)
at com.neo4j.dbms.DbmsReconciler.doTransitions(DbmsReconciler.java:316)
at com.neo4j.dbms.DbmsReconciler.lambda$doTransitions$9(DbmsReconciler.java:307)
at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1700)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:834)
Caused by: org.neo4j.kernel.lifecycle.LifecycleException: Component 'org.neo4j.kernel.lifecycle.LifecycleAdapter$3@d520439' was successfully initialized, but failed to start. Please see the attached cause exception "Cannot map files with a filePageSize (0) that is less than 8 bytes | GBPTree[file:/var/lib/neo4j/data/databases/vodafone/neostore.id]".
at org.neo4j.kernel.lifecycle.LifeSupport$LifecycleInstance.start(LifeSupport.java:463)
at org.neo4j.kernel.lifecycle.LifeSupport.start(LifeSupport.java:110)
at com.neo4j.causalclustering.common.ClusteredDatabase.start(ClusteredDatabase.java:39)
at com.neo4j.dbms.database.ClusteredMultiDatabaseManager.startDatabase(ClusteredMultiDatabaseManager.java:64)
... 18 more
Caused by: java.lang.IllegalArgumentException: Cannot map files with a filePageSize (0) that is less than 8 bytes | GBPTree[file:/var/lib/neo4j/data/databases/vodafone/neostore.id]
at org.neo4j.io.pagecache.impl.muninn.MuninnPageCache.map(MuninnPageCache.java:387)
at org.neo4j.dbms.database.DatabasePageCache.map(DatabasePageCache.java:66)
at org.neo4j.io.pagecache.PageCache.map(PageCache.java:92)
at org.neo4j.index.internal.gbptree.GBPTree.mapWithCorrectPageSize(GBPTree.java:1007)
at org.neo4j.index.internal.gbptree.GBPTree.openExistingIndexFile(GBPTree.java:717)
at org.neo4j.index.internal.gbptree.GBPTree.readHeader(GBPTree.java:788)
at org.neo4j.internal.id.indexed.IndexedIdGenerator.readHeader(IndexedIdGenerator.java:648)
at org.neo4j.internal.id.indexed.IndexedIdGenerator.(IndexedIdGenerator.java:358)
at org.neo4j.internal.id.DefaultIdGeneratorFactory.instantiate(DefaultIdGeneratorFactory.java:89)
at org.neo4j.internal.id.DefaultIdGeneratorFactory.open(DefaultIdGeneratorFactory.java:78)
at org.neo4j.kernel.impl.store.CommonAbstractStore.openIdGenerator(CommonAbstractStore.java:616)
at org.neo4j.kernel.impl.store.CommonAbstractStore.initialise(CommonAbstractStore.java:154)
at org.neo4j.kernel.impl.store.NeoStores.initialize(NeoStores.java:260)
at org.neo4j.kernel.impl.store.NeoStores.createMetadataStore(NeoStores.java:523)
at org.neo4j.kernel.impl.store.StoreType$15.open(StoreType.java:148)
at org.neo4j.kernel.impl.store.NeoStores.openStore(NeoStores.java:253)
at org.neo4j.kernel.impl.store.NeoStores.getOrOpenStore(NeoStores.java:298)
at org.neo4j.kernel.impl.store.NeoStores.verifyRecordFormat(NeoStores.java:178)
at org.neo4j.kernel.impl.store.NeoStores.(NeoStores.java:116)
at org.neo4j.kernel.impl.store.StoreFactory.openNeoStores(StoreFactory.java:135)
at org.neo4j.kernel.impl.store.StoreFactory.openAllNeoStores(StoreFactory.java:99)
at org.neo4j.internal.recordstorage.RecordStorageEngine.(RecordStorageEngine.java:165)
at org.neo4j.internal.recordstorage.RecordStorageEngineFactory.instantiate(RecordStorageEngineFactory.java:130)
at org.neo4j.kernel.recovery.Recovery.performRecovery(Recovery.java:308)
at org.neo4j.kernel.recovery.Recovery.performRecovery(Recovery.java:257)
at org.neo4j.kernel.recovery.RecoveryFacade.recovery(RecoveryFacade.java:56)
at com.neo4j.causalclustering.core.CoreDatabase.lambda$new$0(CoreDatabase.java:42)
at org.neo4j.kernel.lifecycle.LifecycleAdapter$3.start(LifecycleAdapter.java:86)
at org.neo4j.kernel.lifecycle.LifeSupport$LifecycleInstance.start(LifeSupport.java:442)
... 21 more

[stefan_armbrust]

The dump format has meanwhile changed.

Best way is upgrade your instance to 3.5. and take a dump from there. Be sure to do a clean shutdown prior to upgrading.

[david_rosenblum]

What steps did you perform on the 4.1 server?
Did you set dbms.allow_upgrade=true?
Restart the 4.1 server after setting that?
Use neo4j-admin load command to get the dump file on the 4.1 server?
run a create database ?