Please execute docker logs onlyoffice-elasticsearch and send the output.
There are a lot of logs, this looks like it might be relevant?
{"type": "server", "timestamp": "2024-01-30T13:42:40,975Z", "level": "ERROR", "component": "o.e.b.ElasticsearchUncaughtExceptionHandler", "cluster.name": "docker-cluster", "node.name": "69ed090a0697", "message": "uncaught exception in thread [main]",
"stacktrace": ["org.elasticsearch.bootstrap.StartupException: ElasticsearchException[Failure running machine learning native code. This could be due to running on an unsupported OS or distribution, missing OS libraries, or a problem with the temp directory. To bypass this problem by running Elasticsearch without machine learning functionality set [xpack.ml.enabled: false].]",
"at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:170) ~[elasticsearch-7.16.3.jar:7.16.3]",
"at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:157) ~[elasticsearch-7.16.3.jar:7.16.3]",
"at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:77) ~[elasticsearch-7.16.3.jar:7.16.3]",
"at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:112) ~[elasticsearch-cli-7.16.3.jar:7.16.3]",
"at org.elasticsearch.cli.Command.main(Command.java:77) ~[elasticsearch-cli-7.16.3.jar:7.16.3]",
"at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:122) ~[elasticsearch-7.16.3.jar:7.16.3]",
"at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:80) ~[elasticsearch-7.16.3.jar:7.16.3]",
"Caused by: org.elasticsearch.ElasticsearchException: Failure running machine learning native code. This could be due to running on an unsupported OS or distribution, missing OS libraries, or a problem with the temp directory. To bypass this problem by running Elasticsearch without machine learning functionality set [xpack.ml.enabled: false].",
"at org.elasticsearch.xpack.ml.MachineLearning.createComponents(MachineLearning.java:845) ~[?:?]",
"at org.elasticsearch.node.Node.lambda$new$18(Node.java:733) ~[elasticsearch-7.16.3.jar:7.16.3]",
"at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:273) ~[?:?]",
"at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1625) ~[?:?]",
"at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:509) ~[?:?]",
"at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?]",
"at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:921) ~[?:?]",
"at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]",
"at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:682) ~[?:?]",
"at org.elasticsearch.node.Node.<init>(Node.java:747) ~[elasticsearch-7.16.3.jar:7.16.3]",
"at org.elasticsearch.node.Node.<init>(Node.java:309) ~[elasticsearch-7.16.3.jar:7.16.3]",
"at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:234) ~[elasticsearch-7.16.3.jar:7.16.3]",
"at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:234) ~[elasticsearch-7.16.3.jar:7.16.3]",
"at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:434) ~[elasticsearch-7.16.3.jar:7.16.3]",
"at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:166) ~[elasticsearch-7.16.3.jar:7.16.3]",
"... 6 more"] }
Doubling the RAM for Elasticsearch and disabling xpack machine learning seems to be a solution:
onlyoffice-elasticsearch:
environment:
- "ES_JAVA_OPTS=-Xms2g -Xmx2g -Dlog4j2.formatMsgNoLookups=true"
- "xpack.ml.enabled=false"
Yes, try adding the “xpack.ml.enabled=false” env variable.
1 Like
Thanks @Carl everything is now working as far as I can see, however our client is unable to restore their backups to the server, can you suggest which logs might shed some light on the cause of their problem?
Is there any error in the interface when restoring a backup? Log of the Backup service is /var/log/onlyoffice/svcBackup.log (path inside the Community Server container).
Thanks @Carl this is what we have in /var/lib/docker/volumes/docker-communityserver_community_log/_data/svcBackup.log:
2024-01-30 20:15:20,903 ERROR [25] ASC - ICSharpCode.SharpZipLib.GZip.GZipException: Error GZIP header, first magic byte doesn't match
at ICSharpCode.SharpZipLib.GZip.GZipInputStream.ReadHeader () [0x00084] in <edb1d2cb661a4ce897a2519662670d87>:0
at ICSharpCode.SharpZipLib.GZip.GZipInputStream.Read (System.Byte[] buffer, System.Int32 offset, System.Int32 count) [0x00016] in <edb1d2cb661a4ce897a2519662670d87>:0
at System.IO.Stream+<>c.<BeginReadInternal>b__40_0 (System.Object <p0>) [0x0000b] in <f2b3ab7dfff746f594d2ef5b16ec3c90>:0
at System.Threading.Tasks.Task`1[TResult].InnerInvoke () [0x0002b] in <f2b3ab7dfff746f594d2ef5b16ec3c90>:0
at System.Threading.Tasks.Task.Execute () [0x00000] in <f2b3ab7dfff746f594d2ef5b16ec3c90>:0
--- End of stack trace from previous location where exception was thrown ---
at System.IO.Stream.EndRead (System.IAsyncResult asyncResult) [0x0004d] in <f2b3ab7dfff746f594d2ef5b16ec3c90>:0
at System.IO.Stream+<>c.<BeginEndReadAsync>b__45_1 (System.IO.Stream stream, System.IAsyncResult asyncResult) [0x00000] in <f2b3ab7dfff746f594d2ef5b16ec3c90>:0
at System.Threading.Tasks.TaskFactory`1+FromAsyncTrimPromise`1[TResult,TInstance].Complete (TInstance thisRef, System.Func`3[T1,T2,TResult] endMethod, System.IAsyncResult asyncResult, System.Boolean requiresSynchronization) [0x00000] in <f2b3ab7dfff746f594d2ef5b16ec3c90>:0
--- End of stack trace from previous location where exception was thrown ---
at ICSharpCode.SharpZipLib.Tar.TarBuffer.ReadRecordAsync (System.Threading.CancellationToken ct, System.Boolean isAsync) [0x000e5] in <edb1d2cb661a4ce897a2519662670d87>:0
at ICSharpCode.SharpZipLib.Tar.TarBuffer.ReadBlockIntAsync (System.Byte[] buffer, System.Threading.CancellationToken ct, System.Boolean isAsync) [0x000e6] in <edb1d2cb661a4ce897a2519662670d87>:0
at ICSharpCode.SharpZipLib.Tar.TarInputStream.GetNextEntryAsync (System.Threading.CancellationToken ct, System.Boolean isAsync) [0x00195] in <edb1d2cb661a4ce897a2519662670d87>:0
at ICSharpCode.SharpZipLib.Tar.TarInputStream.GetNextEntry () [0x00015] in <edb1d2cb661a4ce897a2519662670d87>:0
at (wrapper remoting-invoke-with-check) ICSharpCode.SharpZipLib.Tar.TarInputStream.GetNextEntry()
at ICSharpCode.SharpZipLib.Tar.TarArchive.ExtractContents (System.String destinationDirectory, System.Boolean allowParentTraversal) [0x00036] in <edb1d2cb661a4ce897a2519662670d87>:0
at ICSharpCode.SharpZipLib.Tar.TarArchive.ExtractContents (System.String destinationDirectory) [0x00000] in <edb1d2cb661a4ce897a2519662670d87>:0
at ASC.Data.Storage.ZipOperators.ZipReadOperator..ctor (System.String targetFile) [0x00052] in <bf310343a9f5480d97fb225c79ff20e6>:0
at ASC.Data.Backup.Tasks.RestorePortalTask.RunJob () [0x00026] in <852f5b92c20a4f98a658f47a06f86105>:0
at ASC.Data.Backup.Service.BackupWorker+RestoreProgressItem.RunJob () [0x0011a] in <852f5b92c20a4f98a658f47a06f86105>:0
2024-01-30 22:11:13,330 ERROR [26] ASC - ICSharpCode.SharpZipLib.GZip.GZipException: Error GZIP header, first magic byte doesn't match
at ICSharpCode.SharpZipLib.GZip.GZipInputStream.ReadHeader () [0x00084] in <edb1d2cb661a4ce897a2519662670d87>:0
at ICSharpCode.SharpZipLib.GZip.GZipInputStream.Read (System.Byte[] buffer, System.Int32 offset, System.Int32 count) [0x00016] in <edb1d2cb661a4ce897a2519662670d87>:0
at System.IO.Stream+<>c.<BeginReadInternal>b__40_0 (System.Object <p0>) [0x0000b] in <f2b3ab7dfff746f594d2ef5b16ec3c90>:0
at System.Threading.Tasks.Task`1[TResult].InnerInvoke () [0x0002b] in <f2b3ab7dfff746f594d2ef5b16ec3c90>:0
at System.Threading.Tasks.Task.Execute () [0x00000] in <f2b3ab7dfff746f594d2ef5b16ec3c90>:0
--- End of stack trace from previous location where exception was thrown ---
at System.IO.Stream.EndRead (System.IAsyncResult asyncResult) [0x0004d] in <f2b3ab7dfff746f594d2ef5b16ec3c90>:0
at System.IO.Stream+<>c.<BeginEndReadAsync>b__45_1 (System.IO.Stream stream, System.IAsyncResult asyncResult) [0x00000] in <f2b3ab7dfff746f594d2ef5b16ec3c90>:0
at System.Threading.Tasks.TaskFactory`1+FromAsyncTrimPromise`1[TResult,TInstance].Complete (TInstance thisRef, System.Func`3[T1,T2,TResult] endMethod, System.IAsyncResult asyncResult, System.Boolean requiresSynchronization) [0x00000] in <f2b3ab7dfff746f594d2ef5b16ec3c90>:0
--- End of stack trace from previous location where exception was thrown ---
at ICSharpCode.SharpZipLib.Tar.TarBuffer.ReadRecordAsync (System.Threading.CancellationToken ct, System.Boolean isAsync) [0x000e5] in <edb1d2cb661a4ce897a2519662670d87>:0
at ICSharpCode.SharpZipLib.Tar.TarBuffer.ReadBlockIntAsync (System.Byte[] buffer, System.Threading.CancellationToken ct, System.Boolean isAsync) [0x000e6] in <edb1d2cb661a4ce897a2519662670d87>:0
at ICSharpCode.SharpZipLib.Tar.TarInputStream.GetNextEntryAsync (System.Threading.CancellationToken ct, System.Boolean isAsync) [0x00195] in <edb1d2cb661a4ce897a2519662670d87>:0
at ICSharpCode.SharpZipLib.Tar.TarInputStream.GetNextEntry () [0x00015] in <edb1d2cb661a4ce897a2519662670d87>:0
at (wrapper remoting-invoke-with-check) ICSharpCode.SharpZipLib.Tar.TarInputStream.GetNextEntry()
at ICSharpCode.SharpZipLib.Tar.TarArchive.ExtractContents (System.String destinationDirectory, System.Boolean allowParentTraversal) [0x00036] in <edb1d2cb661a4ce897a2519662670d87>:0
at ICSharpCode.SharpZipLib.Tar.TarArchive.ExtractContents (System.String destinationDirectory) [0x00000] in <edb1d2cb661a4ce897a2519662670d87>:0
at ASC.Data.Storage.ZipOperators.ZipReadOperator..ctor (System.String targetFile) [0x00052] in <bf310343a9f5480d97fb225c79ff20e6>:0
at ASC.Data.Backup.Tasks.RestorePortalTask.RunJob () [0x00026] in <852f5b92c20a4f98a658f47a06f86105>:0
at ASC.Data.Backup.Service.BackupWorker+RestoreProgressItem.RunJob () [0x0011a] in <852f5b92c20a4f98a658f47a06f86105>:0
2024-01-30 22:59:57,145 ERROR [26] ASC - ICSharpCode.SharpZipLib.GZip.GZipException: Error GZIP header, first magic byte doesn't match
at ICSharpCode.SharpZipLib.GZip.GZipInputStream.ReadHeader () [0x00084] in <edb1d2cb661a4ce897a2519662670d87>:0
at ICSharpCode.SharpZipLib.GZip.GZipInputStream.Read (System.Byte[] buffer, System.Int32 offset, System.Int32 count) [0x00016] in <edb1d2cb661a4ce897a2519662670d87>:0
at System.IO.Stream+<>c.<BeginReadInternal>b__40_0 (System.Object <p0>) [0x0000b] in <f2b3ab7dfff746f594d2ef5b16ec3c90>:0
at System.Threading.Tasks.Task`1[TResult].InnerInvoke () [0x0002b] in <f2b3ab7dfff746f594d2ef5b16ec3c90>:0
at System.Threading.Tasks.Task.Execute () [0x00000] in <f2b3ab7dfff746f594d2ef5b16ec3c90>:0
--- End of stack trace from previous location where exception was thrown ---
at System.IO.Stream.EndRead (System.IAsyncResult asyncResult) [0x0004d] in <f2b3ab7dfff746f594d2ef5b16ec3c90>:0
at System.IO.Stream+<>c.<BeginEndReadAsync>b__45_1 (System.IO.Stream stream, System.IAsyncResult asyncResult) [0x00000] in <f2b3ab7dfff746f594d2ef5b16ec3c90>:0
at System.Threading.Tasks.TaskFactory`1+FromAsyncTrimPromise`1[TResult,TInstance].Complete (TInstance thisRef, System.Func`3[T1,T2,TResult] endMethod, System.IAsyncResult asyncResult, System.Boolean requiresSynchronization) [0x00000] in <f2b3ab7dfff746f594d2ef5b16ec3c90>:0
--- End of stack trace from previous location where exception was thrown ---
at ICSharpCode.SharpZipLib.Tar.TarBuffer.ReadRecordAsync (System.Threading.CancellationToken ct, System.Boolean isAsync) [0x000e5] in <edb1d2cb661a4ce897a2519662670d87>:0
at ICSharpCode.SharpZipLib.Tar.TarBuffer.ReadBlockIntAsync (System.Byte[] buffer, System.Threading.CancellationToken ct, System.Boolean isAsync) [0x000e6] in <edb1d2cb661a4ce897a2519662670d87>:0
at ICSharpCode.SharpZipLib.Tar.TarInputStream.GetNextEntryAsync (System.Threading.CancellationToken ct, System.Boolean isAsync) [0x00195] in <edb1d2cb661a4ce897a2519662670d87>:0
at ICSharpCode.SharpZipLib.Tar.TarInputStream.GetNextEntry () [0x00015] in <edb1d2cb661a4ce897a2519662670d87>:0
at (wrapper remoting-invoke-with-check) ICSharpCode.SharpZipLib.Tar.TarInputStream.GetNextEntry()
at ICSharpCode.SharpZipLib.Tar.TarArchive.ExtractContents (System.String destinationDirectory, System.Boolean allowParentTraversal) [0x00036] in <edb1d2cb661a4ce897a2519662670d87>:0
at ICSharpCode.SharpZipLib.Tar.TarArchive.ExtractContents (System.String destinationDirectory) [0x00000] in <edb1d2cb661a4ce897a2519662670d87>:0
at ASC.Data.Storage.ZipOperators.ZipReadOperator..ctor (System.String targetFile) [0x00052] in <bf310343a9f5480d97fb225c79ff20e6>:0
at ASC.Data.Backup.Tasks.RestorePortalTask.RunJob () [0x00026] in <852f5b92c20a4f98a658f47a06f86105>:0
at ASC.Data.Backup.Service.BackupWorker+RestoreProgressItem.RunJob () [0x0011a] in <852f5b92c20a4f98a658f47a06f86105>:0
I asked our client about the “any error in the interface” question and they replied:
There is no error in the interface. It just resets back to the home screen
I have asked our client to check that the archive can be extracted locally as this error above:
Error GZIP header, first magic byte doesn't match
Might indicate that the archive is not good to start with?
The backup that our client was trying to restore must have been corrupted, they have restored a new backup and that appears to work however when they try to reset their password they have reported that:
the URL from the Password Reset email isn’t resolving and is timing out
@carl is there a way I can update passwords directly in the MySQL database as password resets do not appear to work after data restores?
Or are some logs you could suggest I look at to try to track down this error?
I can’t see any evidence that any password reset email have been sent in the Postfix log at /var/lib/docker/volumes/docker-communityserver_mail_log/_data/maillog, there is however this pop-up when a password reset is requested:
Is there a log file other than maillog that would records outgoing SMTP email?