Transferring database from version 4.4.7 to 5.2.0(The selected target store format 'AF4.3.0' ERROR)

[cuneyttyler]

I have a database in my old server which is version 4.4.7. Now I have a new server and transferred the data files to it. However, I can't find 4.4.7 version to install. So I installed 5.2.0 hoping that dbms.allow_upgrade=true will take care of the store version issue but it didn't. Actually, this option doesn't exist in the .conf file anymore. So when I started the database, in the debug log it says 'The selected target store format 'AF4.3.0' '. Any suggestions on how to use a 4.3 store version in the latest neo4j?

[dana_canzano]

@cuneyttyler 

https://neo4j.com/docs/upgrade-migration-guide/current/version-5/migration/

[cuneyttyler]

Now that I have 4.4.15 in my new server, so now the store version is the same with the old database. Now I'm not having this problem. I'll keep that link in case of future migrations. Although, when starting database, it performs a recovery which takes a bit time. But it stopped at %50 with the log message below:

Detected VM stop-the-world pause: {pauseTime=10134, gcTime=10146, gcCount=1}
2022-12-09 20:34:58.069+0000 INFO  [o.n.k.r.Recovery] [neo4j/1911c521]   50% completed
2022-12-09 20:35:00.771+0000 INFO  [o.n.k.i.i.s.TokenIndexProvider] [neo4j/1911c521] Schema index cleanup job registered: descriptor=Index( id=1, name='index_343aff4e', type='TOKEN LOOKUP', schema=(:<any-labels>), indexProvider='token-lookup-1.0' ), indexFile=/var/lib/neo4j/data/databases/neo4j/neostore.labelscanstore.db
2022-12-09 20:35:00.772+0000 INFO  [o.n.k.i.i.s.TokenIndexProvider] [neo4j/1911c521] Schema index cleanup job registered: descriptor=Index( id=1, name='index_343aff4e', type='TOKEN LOOKUP', schema=(:<any-labels>), indexProvider='token-lookup-1.0' ), indexFile=/var/lib/neo4j/data/databases/neo4j/neostore.labelscanstore.db
2022-12-09 20:35:00.776+0000 INFO  [o.n.k.i.i.s.TokenIndexProvider] [neo4j/1911c521] Schema index cleanup job started: descriptor=Index( id=1, name='index_343aff4e', type='TOKEN LOOKUP', schema=(:<any-labels>), indexProvider='token-lookup-1.0' ), indexFile=/var/lib/neo4j/data/databases/neo4j/neostore.labelscanstore.db
2022-12-09 20:35:00.776+0000 INFO  [o.n.k.i.i.s.TokenIndexProvider] [neo4j/1911c521] Schema index cleanup job started: descriptor=Index( id=1, name='index_343aff4e', type='TOKEN LOOKUP', schema=(:<any-labels>), indexProvider='token-lookup-1.0' ), indexFile=/var/lib/neo4j/data/databases/neo4j/neostore.labelscanstore.db
2022-12-09 20:35:01.090+0000 INFO  [o.n.k.i.i.s.TokenIndexProvider] [neo4j/1911c521] Schema index cleanup job registered: descriptor=Index( id=2, name='index_f7700477', type='TOKEN LOOKUP', schema=-[:<any-types>]-, indexProvider='token-lookup-1.0' ), indexFile=/var/lib/neo4j/data/databases/neo4j/neostore.relationshiptypescanstore.db
2022-12-09 20:35:01.090+0000 INFO  [o.n.k.i.i.s.TokenIndexProvider] [neo4j/1911c521] Schema index cleanup job registered: descriptor=Index( id=2, name='index_f7700477', type='TOKEN LOOKUP', schema=-[:<any-types>]-, indexProvider='token-lookup-1.0' ), indexFile=/var/lib/neo4j/data/databases/neo4j/neostore.relationshiptypescanstore.db
2022-12-09 20:35:01.317+0000 INFO  [o.n.k.i.i.s.GenericNativeIndexProvider] [neo4j/1911c521] Schema index cleanup job registered: descriptor=Index( id=3, name='INDEX_ENTITY_DBPEDIA_URI', type='GENERAL BTREE', schema=(:Label[0] {PropertyKey[10]}), indexProvider='native-btree-1.0' ), indexFile=/var/lib/neo4j/data/databases/neo4j/schema/index/native-btree-1.0/3/index-3
2022-12-09 20:35:01.317+0000 INFO  [o.n.k.i.i.s.GenericNativeIndexProvider] [neo4j/1911c521] Schema index cleanup job registered: descriptor=Index( id=3, name='INDEX_ENTITY_DBPEDIA_URI', type='GENERAL BTREE', schema=(:Label[0] {PropertyKey[10]}), indexProvider='native-btree-1.0' ), indexFile=/var/lib/neo4j/data/databases/neo4j/schema/index/native-btree-1.0/3/index-3
2022-12-09 20:35:01.477+0000 INFO  [o.n.k.i.i.s.GenericNativeIndexProvider] [neo4j/1911c521] Schema index cleanup job registered: descriptor=Index( id=4, name='INDEX_ENTITY_WIKIDATA_ID', type='GENERAL BTREE', schema=(:Label[0] {PropertyKey[19]}), indexProvider='native-btree-1.0' ), indexFile=/var/lib/neo4j/data/databases/neo4j/schema/index/native-btree-1.0/4/index-4
2022-12-09 20:35:01.477+0000 INFO  [o.n.k.i.i.s.GenericNativeIndexProvider] [neo4j/1911c521] Schema index cleanup job registered: descriptor=Index( id=4, name='INDEX_ENTITY_WIKIDATA_ID', type='GENERAL BTREE', schema=(:Label[0] {PropertyKey[19]}), indexProvider='native-btree-1.0' ), indexFile=/var/lib/neo4j/data/databases/neo4j/schema/index/native-btree-1.0/4/index-4
2022-12-09 20:35:01.988+0000 INFO  [o.n.k.i.i.s.GenericNativeIndexProvider] [neo4j/1911c521] Schema index cleanup job registered: descriptor=Index( id=5, name='INDEX_META_PROPERTY_URI', type='GENERAL BTREE', schema=(:Label[1] {PropertyKey[23]}), indexProvider='native-btree-1.0' ), indexFile=/var/lib/neo4j/data/databases/neo4j/schema/index/native-btree-1.0/5/index-5
2022-12-09 20:35:01.989+0000 INFO  [o.n.k.i.i.s.GenericNativeIndexProvider] [neo4j/1911c521] Schema index cleanup job registered: descriptor=Index( id=5, name='INDEX_META_PROPERTY_URI', type='GENERAL BTREE', schema=(:Label[1] {PropertyKey[23]}), indexProvider='native-btree-1.0' ), indexFile=/var/lib/neo4j/data/databases/neo4j/schema/index/native-btree-1.0/5/index-5
2022-12-09 20:35:02.408+0000 INFO  [o.n.k.i.i.s.GenericNativeIndexProvider] [neo4j/1911c521] Schema index cleanup job registered: descriptor=Index( id=6, name='INDEX_ENTITY_NAME', type='GENERAL BTREE', schema=(:Label[0] {PropertyKey[22]}), indexProvider='native-btree-1.0' ), indexFile=/var/lib/neo4j/data/databases/neo4j/schema/index/native-btree-1.0/6/index-6
2022-12-09 20:35:02.409+0000 INFO  [o.n.k.i.i.s.GenericNativeIndexProvider] [neo4j/1911c521] Schema index cleanup job registered: descriptor=Index( id=6, name='INDEX_ENTITY_NAME', type='GENERAL BTREE', schema=(:Label[0] {PropertyKey[22]}), indexProvider='native-btree-1.0' ), indexFile=/var/lib/neo4j/data/databases/neo4j/schema/index/native-btree-1.0/6/index-6
2022-12-09 20:35:20.022+0000 WARN  [o.n.k.i.c.VmPauseMonitorComponent] Detected VM stop-the-world pause: {pauseTime=247, gcTime=0, gcCount=0}
2022-12-09 20:35:20.150+0000 INFO  [o.n.k.i.i.s.TokenIndexProvider] [neo4j/1911c521] Schema index cleanup job finished: descriptor=Index( id=1, name='index_343aff4e', type='TOKEN LOOKUP', schema=(:<any-labels>), indexProvider='token-lookup-1.0' ), indexFile=/var/lib/neo4j/data/databases/neo4j/neostore.labelscanstore.db Number of pages visited: 141975, Number of tree nodes: 141974, Number of cleaned crashed pointers: 42, Time spent: 19s 373ms
2022-12-09 20:35:20.151+0000 INFO  [o.n.k.i.i.s.TokenIndexProvider] [neo4j/1911c521] Schema index cleanup job finished: descriptor=Index( id=1, name='index_343aff4e', type='TOKEN LOOKUP', schema=(:<any-labels>), indexProvider='token-lookup-1.0' ), indexFile=/var/lib/neo4j/data/databases/neo4j/neostore.labelscanstore.db Number of pages visited: 141975, Number of tree nodes: 141974, Number of cleaned crashed pointers: 42, Time spent: 19s 373ms
2022-12-09 20:35:20.151+0000 INFO  [o.n.k.i.i.s.TokenIndexProvider] [neo4j/1911c521] Schema index cleanup job closed: descriptor=Index( id=1, name='index_343aff4e', type='TOKEN LOOKUP', schema=(:<any-labels>), indexProvider='token-lookup-1.0' ), indexFile=/var/lib/neo4j/data/databases/neo4j/neostore.labelscanstore.db
2022-12-09 20:35:20.151+0000 INFO  [o.n.k.i.i.s.TokenIndexProvider] [neo4j/1911c521] Schema index cleanup job closed: descriptor=Index( id=1, name='index_343aff4e', type='TOKEN LOOKUP', schema=(:<any-labels>), indexProvider='token-lookup-1.0' ), indexFile=/var/lib/neo4j/data/databases/neo4j/neostore.labelscanstore.db
2022-12-09 20:35:20.152+0000 INFO  [o.n.k.i.i.s.TokenIndexProvider] [neo4j/1911c521] Schema index cleanup job started: descriptor=Index( id=2, name='index_f7700477', type='TOKEN LOOKUP', schema=-[:<any-types>]-, indexProvider='token-lookup-1.0' ), indexFile=/var/lib/neo4j/data/databases/neo4j/neostore.relationshiptypescanstore.db
2022-12-09 20:35:20.152+0000 INFO  [o.n.k.i.i.s.TokenIndexProvider] [neo4j/1911c521] Schema index cleanup job started: descriptor=Index( id=2, name='index_f7700477', type='TOKEN LOOKUP', schema=-[:<any-types>]-, indexProvider='token-lookup-1.0' ), indexFile=/var/lib/neo4j/data/databases/neo4j/neostore.relationshiptypescanstore.db
2022-12-09 20:35:21.059+0000 WARN  [o.n.k.i.c.VmPauseMonitorComponent] Detected VM stop-the-world pause: {pauseTime=636, gcTime=808, gcCount=1}
2022-12-09 20:35:23.419+0000 INFO  [o.n.k.i.i.s.GenericNativeIndexProvider] [neo4j/1911c521] Schema index cleanup job registered: descriptor=Index( id=8, name='INDEX_ENTITY_TYPE', type='GENERAL BTREE', schema=(:Label[0] {PropertyKey[25]}), indexProvider='native-btree-1.0' ), indexFile=/var/lib/neo4j/data/databases/neo4j/schema/index/native-btree-1.0/8/index-8
2022-12-09 20:35:23.420+0000 INFO  [o.n.k.i.i.s.GenericNativeIndexProvider] [neo4j/1911c521] Schema index cleanup job registered: descriptor=Index( id=8, name='INDEX_ENTITY_TYPE', type='GENERAL BTREE', schema=(:Label[0] {PropertyKey[25]}), indexProvider='native-btree-1.0' ), indexFile=/var/lib/neo4j/data/databases/neo4j/schema/index/native-btree-1.0/8/index-8
2022-12-09 20:35:23.521+0000 INFO  [o.n.k.i.i.s.GenericNativeIndexProvider] [neo4j/1911c521] Schema index cleanup job registered: descriptor=Index( id=9, name='PROPERTY_NAME', type='GENERAL BTREE', schema=(:Label[2] {PropertyKey[22]}), indexProvider='native-btree-1.0' ), indexFile=/var/lib/neo4j/data/databases/neo4j/schema/index/native-btree-1.0/9/index-9
2022-12-09 20:35:23.522+0000 INFO  [o.n.k.i.i.s.GenericNativeIndexProvider] [neo4j/1911c521] Schema index cleanup job registered: descriptor=Index( id=9, name='PROPERTY_NAME', type='GENERAL BTREE', schema=(:Label[2] {PropertyKey[22]}), indexProvider='native-btree-1.0' ), indexFile=/var/lib/neo4j/data/databases/neo4j/schema/index/native-btree-1.0/9/index-9
2022-12-09 20:35:27.079+0000 INFO  [o.n.k.i.i.s.GenericNativeIndexProvider] [neo4j/1911c521] Schema index cleanup job registered: descriptor=Index( id=12, name='INDEX_ENTITY_SHORT_DESCRIPTION', type='GENERAL BTREE', schema=(:Label[0] {PropertyKey[28]}), indexProvider='native-btree-1.0' ), indexFile=/var/lib/neo4j/data/databases/neo4j/schema/index/native-btree-1.0/12/index-12
2022-12-09 20:35:27.079+0000 INFO  [o.n.k.i.i.s.GenericNativeIndexProvider] [neo4j/1911c521] Schema index cleanup job registered: descriptor=Index( id=12, name='INDEX_ENTITY_SHORT_DESCRIPTION', type='GENERAL BTREE', schema=(:Label[0] {PropertyKey[28]}), indexProvider='native-btree-1.0' ), indexFile=/var/lib/neo4j/data/databases/neo4j/schema/index/native-btree-1.0/12/index-12
2022-12-09 20:35:27.080+0000 INFO  [o.n.k.i.a.i.IndexingService] [neo4j/1911c521] IndexingService.init: indexes not specifically mentioned above are ONLINE
2022-12-09 20:35:32.816+0000 WARN  [o.n.k.i.c.VmPauseMonitorComponent] Detected VM stop-the-world pause: {pauseTime=248, gcTime=0, gcCount=0}
2022-12-09 20:35:33.338+0000 WARN  [o.n.k.i.c.VmPauseMonitorComponent] Detected VM stop-the-world pause: {pauseTime=322, gcTime=0, gcCount=0}

Should I expect the recovery to continue or does this stop the recovery process?

Thanks.

[ameyasoft]

Do you have a backup of your database from the old server?

[cuneyttyler]

I didn't create a backup because my disk space wasn't enough on my old server. I transferred the data and transaction folders of my database and put them in the new server on desired place. Now it's recovering and the current issue is that it seems to stop at around 50%. My database is about 350 GB in size and it takes some time to recover. 

[ameyasoft]

Thanks for your reply. Let me know once the recovery  process completes.

[cuneyttyler]

It is OK now, it took about 2 hours to recover.

[ameyasoft]

Glad to know that. What's the status now? Were you able to open your db in V5? 

[cuneyttyler]

I actually installed 4.3 which uses the same storage format with my old db. If I want to migrate to v5 in the future, I will create a backup properly and than use that for migration. For now, v4.3 is okay.

[ameyasoft]

Thanks for the update.Since you are in version  4.3 you will have some issues with store format when you try to migrate to version 5.