Checkpoint failed no nio in java.library.path

[erflor]

Hello,

I'm working on a project that is utilizing neo4j. My knowledge with it is a bit limited so I apologize if this question is a bit simplistic.

We ran across an issue where our neo4j server went down. Looking at the logs I'm having troubling narrowing down what was the root cause .

The server reported 'Checkpoint triggered by "Scheduled checkpoint for time threshold"' and then it started throwing exceptions. The first is 'Checkpoint failed no nio in java.library.path' and then 'Could not initialize class sun.nio.fs.UnixCopyFile'. I've done a few google searches but haven't been able to find a solid lead.

Has anyone come across this and if so, what could have thrown this? I was told that on one server an update on the server had occurred but for another, as far as we can tell, nothing special had happened. We were able to restart the server and haven't seen the error since, but like I mentioned above, I would like to determine what caused it and if there's a way to prevent it.

The following is the stack trace:

2020-05-04 19:34:14.329+0000 INFO [o.n.k.i.t.l.c.CheckPointerImpl] Checkpoint triggered by "Scheduled checkpoint for time threshold" @ txId: 42401 checkpoint started...
2020-05-04 19:34:14.461+0000 ERROR [o.n.k.i.t.l.c.CheckPointerImpl] Checkpoint failed no nio in java.library.path
java.lang.UnsatisfiedLinkError: no nio in java.library.path
	at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1871)
	at java.lang.Runtime.loadLibrary0(Runtime.java:871)
	at java.lang.System.loadLibrary(System.java:1124)
	at sun.nio.fs.UnixCopyFile$2.run(UnixCopyFile.java:612)
	at sun.nio.fs.UnixCopyFile$2.run(UnixCopyFile.java:609)
	at java.security.AccessController.doPrivileged(Native Method)
	at sun.nio.fs.UnixCopyFile.<clinit>(UnixCopyFile.java:609)
	at sun.nio.fs.UnixFileSystemProvider.move(UnixFileSystemProvider.java:262)
	at java.nio.file.Files.move(Files.java:1395)
	at org.apache.lucene.store.FSDirectory.renameFile(FSDirectory.java:239)
	at org.apache.lucene.store.NRTCachingDirectory.renameFile(NRTCachingDirectory.java:172)
	at org.apache.lucene.store.LockValidatingDirectoryWrapper.renameFile(LockValidatingDirectoryWrapper.java:56)
	at org.apache.lucene.index.SegmentInfos.finishCommit(SegmentInfos.java:851)
	at org.apache.lucene.index.IndexWriter.finishCommit(IndexWriter.java:3006)
	at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2977)
	at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2935)
	at org.neo4j.kernel.api.impl.index.AbstractLuceneIndex.flush(AbstractLuceneIndex.java:238)
	at org.neo4j.kernel.api.impl.index.AbstractLuceneIndex.markAsOnline(AbstractLuceneIndex.java:460)
	at org.neo4j.kernel.api.impl.index.WritableAbstractDatabaseIndex.markAsOnline(WritableAbstractDatabaseIndex.java:177)
	at org.neo4j.kernel.api.impl.index.AbstractLuceneIndexAccessor.force(AbstractLuceneIndexAccessor.java:85)
	at org.neo4j.kernel.impl.index.schema.fusion.FusionIndexAccessor.lambda$force$1(FusionIndexAccessor.java:77)
	at org.neo4j.kernel.impl.index.schema.fusion.InstanceSelector.consumeAndChainException(InstanceSelector.java:193)
	at org.neo4j.kernel.impl.index.schema.fusion.InstanceSelector.forAll(InstanceSelector.java:134)
	at org.neo4j.kernel.impl.index.schema.fusion.FusionIndexAccessor.force(FusionIndexAccessor.java:77)
	at org.neo4j.kernel.impl.api.index.OnlineIndexProxy.force(OnlineIndexProxy.java:141)
	at org.neo4j.kernel.impl.api.index.AbstractDelegatingIndexProxy.force(AbstractDelegatingIndexProxy.java:79)
	at org.neo4j.kernel.impl.api.index.ContractCheckingIndexProxy.force(ContractCheckingIndexProxy.java:128)
	at org.neo4j.kernel.impl.api.index.IndexingService.lambda$forceAll$10(IndexingService.java:764)
	at org.neo4j.kernel.impl.api.index.IndexingService.lambda$indexProxyOperation$f3401ac3$1(IndexingService.java:773)
	at org.eclipse.collections.impl.map.mutable.primitive.LongObjectHashMap.forEachKeyValue(LongObjectHashMap.java:669)
	at org.neo4j.kernel.impl.api.index.IndexMap.forEachIndexProxy(IndexMap.java:133)
	at org.neo4j.kernel.impl.api.index.IndexingService.forceAll(IndexingService.java:764)
	at org.neo4j.kernel.impl.storageengine.impl.recordstorage.RecordStorageEngine.flushAndForce(RecordStorageEngine.java:415)
	at org.neo4j.kernel.impl.transaction.log.checkpoint.CheckPointerImpl.doCheckPoint(CheckPointerImpl.java:179)
	at org.neo4j.kernel.impl.transaction.log.checkpoint.CheckPointerImpl.checkPointIfNeeded(CheckPointerImpl.java:153)
	at org.neo4j.kernel.impl.transaction.log.checkpoint.CheckPointScheduler$1.run(CheckPointScheduler.java:65)
	at org.neo4j.kernel.impl.scheduler.ScheduledJobHandle.lambda$new$0(ScheduledJobHandle.java:83)
	at org.neo4j.kernel.impl.scheduler.ThreadPool.lambda$submit$0(ThreadPool.java:57)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2020-05-04 19:34:24.469+0000 INFO [o.n.k.i.t.l.c.CheckPointerImpl] Checkpoint triggered by "Scheduled checkpoint for time threshold" @ txId: 42401 checkpoint started...
2020-05-04 19:34:24.480+0000 ERROR [o.n.k.i.t.l.c.CheckPointerImpl] Checkpoint failed Could not initialize class sun.nio.fs.UnixCopyFile
java.lang.NoClassDefFoundError: Could not initialize class sun.nio.fs.UnixCopyFile
	at sun.nio.fs.UnixFileSystemProvider.move(UnixFileSystemProvider.java:262)
	at java.nio.file.Files.move(Files.java:1395)
	at org.apache.lucene.store.FSDirectory.renameFile(FSDirectory.java:239)
	at org.apache.lucene.store.NRTCachingDirectory.renameFile(NRTCachingDirectory.java:172)
	at org.apache.lucene.store.LockValidatingDirectoryWrapper.renameFile(LockValidatingDirectoryWrapper.java:56)
	at org.apache.lucene.index.SegmentInfos.finishCommit(SegmentInfos.java:851)
	at org.apache.lucene.index.IndexWriter.finishCommit(IndexWriter.java:3006)
	at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2977)
	at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2935)
	at org.neo4j.kernel.api.impl.index.AbstractLuceneIndex.flush(AbstractLuceneIndex.java:238)
	at org.neo4j.kernel.api.impl.index.AbstractLuceneIndex.markAsOnline(AbstractLuceneIndex.java:460)
	at org.neo4j.kernel.api.impl.index.WritableAbstractDatabaseIndex.markAsOnline(WritableAbstractDatabaseIndex.java:177)
	at org.neo4j.kernel.api.impl.index.AbstractLuceneIndexAccessor.force(AbstractLuceneIndexAccessor.java:85)
	at org.neo4j.kernel.impl.index.schema.fusion.FusionIndexAccessor.lambda$force$1(FusionIndexAccessor.java:77)
	at org.neo4j.kernel.impl.index.schema.fusion.InstanceSelector.consumeAndChainException(InstanceSelector.java:193)
	at org.neo4j.kernel.impl.index.schema.fusion.InstanceSelector.forAll(InstanceSelector.java:134)
	at org.neo4j.kernel.impl.index.schema.fusion.FusionIndexAccessor.force(FusionIndexAccessor.java:77)
	at org.neo4j.kernel.impl.api.index.OnlineIndexProxy.force(OnlineIndexProxy.java:141)
	at org.neo4j.kernel.impl.api.index.AbstractDelegatingIndexProxy.force(AbstractDelegatingIndexProxy.java:79)
	at org.neo4j.kernel.impl.api.index.ContractCheckingIndexProxy.force(ContractCheckingIndexProxy.java:128)
	at org.neo4j.kernel.impl.api.index.IndexingService.lambda$forceAll$10(IndexingService.java:764)
	at org.neo4j.kernel.impl.api.index.IndexingService.lambda$indexProxyOperation$f3401ac3$1(IndexingService.java:773)
	at org.eclipse.collections.impl.map.mutable.primitive.LongObjectHashMap.forEachKeyValue(LongObjectHashMap.java:669)
	at org.neo4j.kernel.impl.api.index.IndexMap.forEachIndexProxy(IndexMap.java:133)
	at org.neo4j.kernel.impl.api.index.IndexingService.forceAll(IndexingService.java:764)
	at org.neo4j.kernel.impl.storageengine.impl.recordstorage.RecordStorageEngine.flushAndForce(RecordStorageEngine.java:415)
	at org.neo4j.kernel.impl.transaction.log.checkpoint.CheckPointerImpl.doCheckPoint(CheckPointerImpl.java:179)
	at org.neo4j.kernel.impl.transaction.log.checkpoint.CheckPointerImpl.checkPointIfNeeded(CheckPointerImpl.java:153)
	at org.neo4j.kernel.impl.transaction.log.checkpoint.CheckPointScheduler$1.run(CheckPointScheduler.java:65)
	at org.neo4j.kernel.impl.scheduler.ScheduledJobHandle.lambda$new$0(ScheduledJobHandle.java:83)
	at org.neo4j.kernel.impl.scheduler.ThreadPool.lambda$submit$0(ThreadPool.java:57)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)