Issues

Select view

Select search mode

 
28 of 28

Lucene error

Ready for Release

Description

Got this error multiple times today. What might this be caused by?
I am using Zanata Platform 4.3.0.

2018-01-24 10:48:15,429 ERROR [org.hibernate.search.backend.impl.lucene.LuceneBackendQueueTask] (Hibernate Search sync consumer thread for index org.zanata.model.HTextFlowTarget) HSEARCH000072: Couldn't open the IndexWriter because of previous error: operation skipped, index ouf of sync! 2018-01-24 10:48:15,432 DEBUG [org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl] (default task-11) HHH000420: Closing un-released batch 2018-01-24 10:48:15,446 DEBUG [org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl] (pool-6-thread-7) Skipping aggressive release due to manual disabling 2018-01-24 10:48:15,448 DEBUG [org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl] (pool-6-thread-7) HHH000420: Closing un-released batch 2018-01-24 10:48:15,527 TRACE [org.jboss.as.server.deployment.scanner] (DeploymentScanner-threads - 2) Scanning directory C:\DESoftware\wildfly-10.1.0.Final\standalone\deployments for deployment content changes 2018-01-24 10:48:15,532 TRACE [org.jboss.as.server.deployment.scanner] (DeploymentScanner-threads - 2) Scan complete 2018-01-24 10:48:16,387 WARN [org.zanata.service.impl.TranslationMemoryServiceImpl] (default task-15) Lucene query returned 20 results (out of approx 68). Increasing zanata.tm.max.results might produce more matches. 2018-01-24 10:48:16,403 ERROR [org.zanata.service.impl.TranslationMemoryServiceImpl] (default task-15) Unexpected TextFlowTarget (state NeedReview): HTextFlowTarget{contents=[Type], locale=HLocale(localeId=en), state=NeedReview, comment=null, textFlow=[Type]}. You may need to re-index. 2018-01-24 10:48:16,404 ERROR [org.zanata.service.impl.TranslationMemoryServiceImpl] (default task-15) Unexpected TextFlowTarget (state NeedReview): HTextFlowTarget{contents=[Type], locale=HLocale(localeId=en), state=NeedReview, comment=null, textFlow=[Type]}. You may need to re-index. 2018-01-24 10:48:16,405 ERROR [org.zanata.service.impl.TranslationMemoryServiceImpl] (default task-15) Unexpected TextFlowTarget (state NeedReview): HTextFlowTarget{contents=[Type], locale=HLocale(localeId=en), state=NeedReview, comment=null, textFlow=[Type]}. You may need to re-index. 2018-01-24 10:48:16,405 ERROR [org.zanata.service.impl.TranslationMemoryServiceImpl] (default task-15) Unexpected TextFlowTarget (state NeedReview): HTextFlowTarget{contents=[Data type], locale=HLocale(localeId=en), state=NeedReview, comment=null, textFlow=[Data type]}. You may need to re-index. 2018-01-24 10:48:16,406 ERROR [org.zanata.service.impl.TranslationMemoryServiceImpl] (default task-15) Unexpected TextFlowTarget (state NeedReview): HTextFlowTarget{contents=[Type], locale=HLocale(localeId=en), state=NeedReview, comment=null, textFlow=[Type]}. You may need to re-index. 2018-01-24 10:48:16,406 ERROR [org.zanata.service.impl.TranslationMemoryServiceImpl] (default task-15) Unexpected TextFlowTarget (state NeedReview): HTextFlowTarget{contents=[Type], locale=HLocale(localeId=en), state=NeedReview, comment=null, textFlow=[Type]}. You may need to re-index. 2018-01-24 10:48:16,408 ERROR [org.zanata.service.impl.TranslationMemoryServiceImpl] (default task-15) Unexpected TextFlowTarget (state NeedReview): HTextFlowTarget{contents=[Type], locale=HLocale(localeId=en), state=NeedReview, comment=null, textFlow=[Type]}. You may need to re-index. 2018-01-24 10:48:16,408 ERROR [org.zanata.service.impl.TranslationMemoryServiceImpl] (default task-15) Unexpected TextFlowTarget (state NeedReview): HTextFlowTarget{contents=[Data type], locale=HLocale(localeId=en), state=NeedReview, comment=null, textFlow=[Data type]}. You may need to re-index. 2018-01-24 10:48:16,409 DEBUG [org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl] (default task-10) Skipping aggressive release due to manual disabling 2018-01-24 10:48:16,414 ERROR [org.hibernate.search.exception.impl.LogErrorHandler] (Hibernate Search sync consumer thread for index org.zanata.model.HTextFlowTarget) HSEARCH000058: Exception occurred org.apache.lucene.store.LockObtainFailedException: Lock held elsewhere: C:\Windows\System32\config\systemprofile\zanata\indexes\org.zanata.model.HTextFlowTarget\write.lock Primary Failure: Entity org.zanata.model.HTextFlowTarget Id 119655 Work Type org.hibernate.search.backend.AddLuceneWork : org.apache.lucene.store.LockObtainFailedException: Lock held elsewhere: C:\Windows\System32\config\systemprofile\zanata\indexes\org.zanata.model.HTextFlowTarget\write.lock at org.apache.lucene.store.SimpleFSLockFactory.obtainFSLock(SimpleFSLockFactory.java:85) [lucene-core-5.3.1.jar:5.3.1 1703449 - noble - 2015-09-17 01:38:09] at org.apache.lucene.store.FSLockFactory.obtainLock(FSLockFactory.java:41) [lucene-core-5.3.1.jar:5.3.1 1703449 - noble - 2015-09-17 01:38:09] at org.apache.lucene.store.BaseDirectory.obtainLock(BaseDirectory.java:45) [lucene-core-5.3.1.jar:5.3.1 1703449 - noble - 2015-09-17 01:38:09] at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:775) [lucene-core-5.3.1.jar:5.3.1 1703449 - noble - 2015-09-17 01:38:09] at org.hibernate.search.backend.impl.lucene.IndexWriterHolder.createNewIndexWriter(IndexWriterHolder.java:123) [hibernate-search-engine-5.5.1.Final.jar:5.5.1.Final] at org.hibernate.search.backend.impl.lucene.IndexWriterHolder.getIndexWriter(IndexWriterHolder.java:89) [hibernate-search-engine-5.5.1.Final.jar:5.5.1.Final] at org.hibernate.search.backend.impl.lucene.AbstractWorkspaceImpl.getIndexWriter(AbstractWorkspaceImpl.java:112) [hibernate-search-engine-5.5.1.Final.jar:5.5.1.Final] at org.hibernate.search.backend.impl.lucene.AbstractWorkspaceImpl.getIndexWriterDelegate(AbstractWorkspaceImpl.java:198) [hibernate-search-engine-5.5.1.Final.jar:5.5.1.Final] at org.hibernate.search.backend.impl.lucene.LuceneBackendQueueTask.applyUpdates(LuceneBackendQueueTask.java:80) [hibernate-search-engine-5.5.1.Final.jar:5.5.1.Final] at org.hibernate.search.backend.impl.lucene.LuceneBackendQueueTask.run(LuceneBackendQueueTask.java:46) [hibernate-search-engine-5.5.1.Final.jar:5.5.1.Final] at org.hibernate.search.backend.impl.lucene.SyncWorkProcessor$Consumer.applyChangesets(SyncWorkProcessor.java:145) [hibernate-search-engine-5.5.1.Final.jar:5.5.1.Final] at org.hibernate.search.backend.impl.lucene.SyncWorkProcessor$Consumer.run(SyncWorkProcessor.java:135) [hibernate-search-engine-5.5.1.Final.jar:5.5.1.Final] at java.lang.Thread.run(Unknown Source) [rt.jar:1.8.0_144] Caused by: java.nio.file.FileAlreadyExistsException: C:\Windows\System32\config\systemprofile\zanata\indexes\org.zanata.model.HTextFlowTarget\write.lock at sun.nio.fs.WindowsException.translateToIOException(Unknown Source) [rt.jar:1.8.0_144] at sun.nio.fs.WindowsException.rethrowAsIOException(Unknown Source) [rt.jar:1.8.0_144] at sun.nio.fs.WindowsException.rethrowAsIOException(Unknown Source) [rt.jar:1.8.0_144] at sun.nio.fs.WindowsFileSystemProvider.newByteChannel(Unknown Source) [rt.jar:1.8.0_144] at java.nio.file.Files.newByteChannel(Unknown Source) [rt.jar:1.8.0_144] at java.nio.file.Files.createFile(Unknown Source) [rt.jar:1.8.0_144] at org.apache.lucene.store.SimpleFSLockFactory.obtainFSLock(SimpleFSLockFactory.java:82) [lucene-core-5.3.1.jar:5.3.1 1703449 - noble - 2015-09-17 01:38:09] ... 12 more

Environment

None

Details

Assignee

Reporter

Tested Version/s

Fix versions

Affects versions

Priority

More fields

Created 24 January 2018 at 10:12
Updated 27 June 2018 at 02:12
Resolved 30 January 2018 at 01:50

Activity

Show:

Sean Flanigan29 January 2018 at 05:00

You need https://zanata.atlassian.net/browse/ZNTA-2349#icft=ZNTA-2349 (or try the Elastic Search back-end with a newer version of Hibernate Search - this might require a Hibernate upgrade too)

Oytun Tez29 January 2018 at 04:50

, what would be your suggestion for a clustered environment?

Sean Flanigan29 January 2018 at 00:58

It looks like I messed up the fix for ZNTA-1786, because I failed to actually set the locking strategy to native (as intended and even discussed with during the PR review).

I'll make a fix, but for now the workaround is just to delete all the .lock files before starting Zanata.

Oytun Tez27 January 2018 at 14:07

We are also encountering similar errors, in multiple workflows. , you may want to open a different ticket about this as you have been working on it.

The last similar error I have is this one (local Docker):

zanata_1 | 23:46:38,942 INFO [org.zanata.dao.TextFlowTargetHistoryDAO] (default task-25) HTextFlowTarget{contents=[dsfgsdfg], locale=HLocale(localeId=it), state=Translated, comment=null, textFlow=[Votre compte d\'acc?s:]} zanata_1 | 23:46:48,882 INFO [org.zanata.model.HGlossaryEntry] (default task-1) persist entity: HGlossaryEntry(sourceRef=, srcLocale=HLocale(localeId=fr)) zanata_1 | 23:46:48,902 INFO [org.zanata.model.HGlossaryTerm] (default task-1) persist entity: HGlossaryTerm(content=dgerg, comment=, glossaryEntry=HGlossaryEntry(sourceRef=, srcLocale=HLocale(localeId=fr)), locale=HLocale(localeId=it), lastModifiedBy=HPerson(super=HPerson@3405a708[id=1,versionNum=1], name=Administrator)) zanata_1 | 23:46:48,934 INFO [org.zanata.model.HGlossaryTerm] (default task-1) persist entity: HGlossaryTerm(content=Votre, comment=, glossaryEntry=HGlossaryEntry(sourceRef=, srcLocale=HLocale(localeId=fr)), locale=HLocale(localeId=fr), lastModifiedBy=HPerson(super=HPerson@3405a708[id=1,versionNum=1], name=Administrator)) zanata_1 | 23:46:49,038 ERROR [org.hibernate.search.exception.impl.LogErrorHandler] (Hibernate Search sync consumer thread for index org.zanata.model.HGlossaryTerm) HSEARCH000058: Exception occurred org.apache.lucene.store.LockObtainFailedException: Lock held elsewhere: /opt/jboss/zanata/indexes/org.zanata.model.HGlossaryTerm/write.lock zanata_1 | Primary Failure: zanata_1 | Entity org.zanata.model.HGlossaryTerm Id 12955 Work Type org.hibernate.search.backend.AddLuceneWork zanata_1 | Subsequent failures: zanata_1 | Entity org.zanata.model.HGlossaryTerm Id 12956 Work Type org.hibernate.search.backend.AddLuceneWork zanata_1 | : org.apache.lucene.store.LockObtainFailedException: Lock held elsewhere: /opt/jboss/zanata/indexes/org.zanata.model.HGlossaryTerm/write.lock zanata_1 | at org.apache.lucene.store.SimpleFSLockFactory.obtainFSLock(SimpleFSLockFactory.java:85) [lucene-core-5.3.1.jar:5.3.1 1703449 - noble - 2015-09-17 01:38:09] zanata_1 | at org.apache.lucene.store.FSLockFactory.obtainLock(FSLockFactory.java:41) [lucene-core-5.3.1.jar:5.3.1 1703449 - noble - 2015-09-17 01:38:09] zanata_1 | at org.apache.lucene.store.BaseDirectory.obtainLock(BaseDirectory.java:45) [lucene-core-5.3.1.jar:5.3.1 1703449 - noble - 2015-09-17 01:38:09] zanata_1 | at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:775) [lucene-core-5.3.1.jar:5.3.1 1703449 - noble - 2015-09-17 01:38:09] zanata_1 | at org.hibernate.search.backend.impl.lucene.IndexWriterHolder.createNewIndexWriter(IndexWriterHolder.java:123) [hibernate-search-engine-5.5.1.Final.jar:5.5.1.Final] zanata_1 | at org.hibernate.search.backend.impl.lucene.IndexWriterHolder.getIndexWriter(IndexWriterHolder.java:89) [hibernate-search-engine-5.5.1.Final.jar:5.5.1.Final] zanata_1 | at org.hibernate.search.backend.impl.lucene.AbstractWorkspaceImpl.getIndexWriter(AbstractWorkspaceImpl.java:112) [hibernate-search-engine-5.5.1.Final.jar:5.5.1.Final] zanata_1 | at org.hibernate.search.backend.impl.lucene.AbstractWorkspaceImpl.getIndexWriterDelegate(AbstractWorkspaceImpl.java:198) [hibernate-search-engine-5.5.1.Final.jar:5.5.1.Final] zanata_1 | at org.hibernate.search.backend.impl.lucene.LuceneBackendQueueTask.applyUpdates(LuceneBackendQueueTask.java:80) [hibernate-search-engine-5.5.1.Final.jar:5.5.1.Final] zanata_1 | at org.hibernate.search.backend.impl.lucene.LuceneBackendQueueTask.run(LuceneBackendQueueTask.java:46) [hibernate-search-engine-5.5.1.Final.jar:5.5.1.Final] zanata_1 | at org.hibernate.search.backend.impl.lucene.SyncWorkProcessor$Consumer.applyChangesets(SyncWorkProcessor.java:145) [hibernate-search-engine-5.5.1.Final.jar:5.5.1.Final] zanata_1 | at org.hibernate.search.backend.impl.lucene.SyncWorkProcessor$Consumer.run(SyncWorkProcessor.java:135) [hibernate-search-engine-5.5.1.Final.jar:5.5.1.Final] zanata_1 | at java.lang.Thread.run(Thread.java:745) [rt.jar:1.8.0_111] zanata_1 | Caused by: java.nio.file.FileAlreadyExistsException: /opt/jboss/zanata/indexes/org.zanata.model.HGlossaryTerm/write.lock zanata_1 | at sun.nio.fs.UnixException.translateToIOException(UnixException.java:88) [rt.jar:1.8.0_111] zanata_1 | at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) [rt.jar:1.8.0_111] zanata_1 | at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) [rt.jar:1.8.0_111] zanata_1 | at sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214) [rt.jar:1.8.0_111] zanata_1 | at java.nio.file.Files.newByteChannel(Files.java:361) [rt.jar:1.8.0_111] zanata_1 | at java.nio.file.Files.createFile(Files.java:632) [rt.jar:1.8.0_111] zanata_1 | at org.apache.lucene.store.SimpleFSLockFactory.obtainFSLock(SimpleFSLockFactory.java:82) [lucene-core-5.3.1.jar:5.3.1 1703449 - noble - 2015-09-17 01:38:09] zanata_1 | ... 12 more zanata_1 | zanata_1 | 23:46:49,047 ERROR [org.hibernate.search.backend.impl.lucene.LuceneBackendQueueTask] (Hibernate Search sync consumer thread for index org.zanata.model.HGlossaryTerm) HSEARCH000072: Couldn't open the IndexWriter because of previous error: operation skipped, index ouf of sync!

Sean Flanigan25 January 2018 at 01:07

If you're sure there isn't another copy of Zanata running, it's probably a leftover .lock file from a crashed process.

So you should probably delete all the write.lock files under {{C:\Windows\System32\config\systemprofile\zanata\indexes}} and restart Zanata.