Issues

Select view

List view

Detail view

Select search mode

Basic

JQL

28 of 28

Lucene error

Ready for Release

Description

Got this error multiple times today. What might this be caused by?
I am using Zanata Platform 4.3.0.

2018-01-24 10:48:15,429 ERROR [org.hibernate.search.backend.impl.lucene.LuceneBackendQueueTask] (Hibernate Search sync consumer thread for index org.zanata.model.HTextFlowTarget) HSEARCH000072: Couldn't open the IndexWriter because of previous error: operation skipped, index ouf of sync!
2018-01-24 10:48:15,432 DEBUG [org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl] (default task-11) HHH000420: Closing un-released batch
2018-01-24 10:48:15,446 DEBUG [org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl] (pool-6-thread-7) Skipping aggressive release due to manual disabling
2018-01-24 10:48:15,448 DEBUG [org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl] (pool-6-thread-7) HHH000420: Closing un-released batch
2018-01-24 10:48:15,527 TRACE [org.jboss.as.server.deployment.scanner] (DeploymentScanner-threads - 2) Scanning directory C:\DESoftware\wildfly-10.1.0.Final\standalone\deployments for deployment content changes
2018-01-24 10:48:15,532 TRACE [org.jboss.as.server.deployment.scanner] (DeploymentScanner-threads - 2) Scan complete
2018-01-24 10:48:16,387 WARN  [org.zanata.service.impl.TranslationMemoryServiceImpl] (default task-15) Lucene query returned 20 results (out of approx 68). Increasing zanata.tm.max.results might produce more matches.
2018-01-24 10:48:16,403 ERROR [org.zanata.service.impl.TranslationMemoryServiceImpl] (default task-15) Unexpected TextFlowTarget (state NeedReview): HTextFlowTarget{contents=[Type], locale=HLocale(localeId=en), state=NeedReview, comment=null, textFlow=[Type]}. You may need to re-index.
2018-01-24 10:48:16,404 ERROR [org.zanata.service.impl.TranslationMemoryServiceImpl] (default task-15) Unexpected TextFlowTarget (state NeedReview): HTextFlowTarget{contents=[Type], locale=HLocale(localeId=en), state=NeedReview, comment=null, textFlow=[Type]}. You may need to re-index.
2018-01-24 10:48:16,405 ERROR [org.zanata.service.impl.TranslationMemoryServiceImpl] (default task-15) Unexpected TextFlowTarget (state NeedReview): HTextFlowTarget{contents=[Type], locale=HLocale(localeId=en), state=NeedReview, comment=null, textFlow=[Type]}. You may need to re-index.
2018-01-24 10:48:16,405 ERROR [org.zanata.service.impl.TranslationMemoryServiceImpl] (default task-15) Unexpected TextFlowTarget (state NeedReview): HTextFlowTarget{contents=[Data type], locale=HLocale(localeId=en), state=NeedReview, comment=null, textFlow=[Data type]}. You may need to re-index.
2018-01-24 10:48:16,406 ERROR [org.zanata.service.impl.TranslationMemoryServiceImpl] (default task-15) Unexpected TextFlowTarget (state NeedReview): HTextFlowTarget{contents=[Type], locale=HLocale(localeId=en), state=NeedReview, comment=null, textFlow=[Type]}. You may need to re-index.
2018-01-24 10:48:16,406 ERROR [org.zanata.service.impl.TranslationMemoryServiceImpl] (default task-15) Unexpected TextFlowTarget (state NeedReview): HTextFlowTarget{contents=[Type], locale=HLocale(localeId=en), state=NeedReview, comment=null, textFlow=[Type]}. You may need to re-index.
2018-01-24 10:48:16,408 ERROR [org.zanata.service.impl.TranslationMemoryServiceImpl] (default task-15) Unexpected TextFlowTarget (state NeedReview): HTextFlowTarget{contents=[Type], locale=HLocale(localeId=en), state=NeedReview, comment=null, textFlow=[Type]}. You may need to re-index.
2018-01-24 10:48:16,408 ERROR [org.zanata.service.impl.TranslationMemoryServiceImpl] (default task-15) Unexpected TextFlowTarget (state NeedReview): HTextFlowTarget{contents=[Data type], locale=HLocale(localeId=en), state=NeedReview, comment=null, textFlow=[Data type]}. You may need to re-index.
2018-01-24 10:48:16,409 DEBUG [org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl] (default task-10) Skipping aggressive release due to manual disabling
2018-01-24 10:48:16,414 ERROR [org.hibernate.search.exception.impl.LogErrorHandler] (Hibernate Search sync consumer thread for index org.zanata.model.HTextFlowTarget) HSEARCH000058: Exception occurred org.apache.lucene.store.LockObtainFailedException: Lock held elsewhere: C:\Windows\System32\config\systemprofile\zanata\indexes\org.zanata.model.HTextFlowTarget\write.lock
Primary Failure:
	Entity org.zanata.model.HTextFlowTarget  Id 119655  Work Type  org.hibernate.search.backend.AddLuceneWork
: org.apache.lucene.store.LockObtainFailedException: Lock held elsewhere: C:\Windows\System32\config\systemprofile\zanata\indexes\org.zanata.model.HTextFlowTarget\write.lock
	at org.apache.lucene.store.SimpleFSLockFactory.obtainFSLock(SimpleFSLockFactory.java:85) [lucene-core-5.3.1.jar:5.3.1 1703449 - noble - 2015-09-17 01:38:09]
	at org.apache.lucene.store.FSLockFactory.obtainLock(FSLockFactory.java:41) [lucene-core-5.3.1.jar:5.3.1 1703449 - noble - 2015-09-17 01:38:09]
	at org.apache.lucene.store.BaseDirectory.obtainLock(BaseDirectory.java:45) [lucene-core-5.3.1.jar:5.3.1 1703449 - noble - 2015-09-17 01:38:09]
	at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:775) [lucene-core-5.3.1.jar:5.3.1 1703449 - noble - 2015-09-17 01:38:09]
	at org.hibernate.search.backend.impl.lucene.IndexWriterHolder.createNewIndexWriter(IndexWriterHolder.java:123) [hibernate-search-engine-5.5.1.Final.jar:5.5.1.Final]
	at org.hibernate.search.backend.impl.lucene.IndexWriterHolder.getIndexWriter(IndexWriterHolder.java:89) [hibernate-search-engine-5.5.1.Final.jar:5.5.1.Final]
	at org.hibernate.search.backend.impl.lucene.AbstractWorkspaceImpl.getIndexWriter(AbstractWorkspaceImpl.java:112) [hibernate-search-engine-5.5.1.Final.jar:5.5.1.Final]
	at org.hibernate.search.backend.impl.lucene.AbstractWorkspaceImpl.getIndexWriterDelegate(AbstractWorkspaceImpl.java:198) [hibernate-search-engine-5.5.1.Final.jar:5.5.1.Final]
	at org.hibernate.search.backend.impl.lucene.LuceneBackendQueueTask.applyUpdates(LuceneBackendQueueTask.java:80) [hibernate-search-engine-5.5.1.Final.jar:5.5.1.Final]
	at org.hibernate.search.backend.impl.lucene.LuceneBackendQueueTask.run(LuceneBackendQueueTask.java:46) [hibernate-search-engine-5.5.1.Final.jar:5.5.1.Final]
	at org.hibernate.search.backend.impl.lucene.SyncWorkProcessor$Consumer.applyChangesets(SyncWorkProcessor.java:145) [hibernate-search-engine-5.5.1.Final.jar:5.5.1.Final]
	at org.hibernate.search.backend.impl.lucene.SyncWorkProcessor$Consumer.run(SyncWorkProcessor.java:135) [hibernate-search-engine-5.5.1.Final.jar:5.5.1.Final]
	at java.lang.Thread.run(Unknown Source) [rt.jar:1.8.0_144]
Caused by: java.nio.file.FileAlreadyExistsException: C:\Windows\System32\config\systemprofile\zanata\indexes\org.zanata.model.HTextFlowTarget\write.lock
	at sun.nio.fs.WindowsException.translateToIOException(Unknown Source) [rt.jar:1.8.0_144]
	at sun.nio.fs.WindowsException.rethrowAsIOException(Unknown Source) [rt.jar:1.8.0_144]
	at sun.nio.fs.WindowsException.rethrowAsIOException(Unknown Source) [rt.jar:1.8.0_144]
	at sun.nio.fs.WindowsFileSystemProvider.newByteChannel(Unknown Source) [rt.jar:1.8.0_144]
	at java.nio.file.Files.newByteChannel(Unknown Source) [rt.jar:1.8.0_144]
	at java.nio.file.Files.createFile(Unknown Source) [rt.jar:1.8.0_144]
	at org.apache.lucene.store.SimpleFSLockFactory.obtainFSLock(SimpleFSLockFactory.java:82) [lucene-core-5.3.1.jar:5.3.1 1703449 - noble - 2015-09-17 01:38:09]
	... 12 more

Environment

None

Linked issues

is duplicated by

ZNTA-2370

Lucene write.lock error on translation save

Details

Assignee

Unassigned

Reporter

B L

Tested Version/s

None

Fix versions

platform-4.4.0

Affects versions

platform-4.3.0

Priority

unspecified

More fields

Created 24 January 2018 at 10:12

Updated 27 June 2018 at 02:12

Resolved 30 January 2018 at 01:50

Configure

Activity

Show:

Sean Flanigan29 January 2018 at 05:00

@Oytun Tez You need https://zanata.atlassian.net/browse/ZNTA-2349#icft=ZNTA-2349 (or try the Elastic Search back-end with a newer version of Hibernate Search - this might require a Hibernate upgrade too)

Oytun Tez29 January 2018 at 04:50

@Sean Flanigan, what would be your suggestion for a clustered environment?

Sean Flanigan29 January 2018 at 00:58

It looks like I messed up the fix for ZNTA-1786, because I failed to actually set the locking strategy to native (as intended and even discussed with @Former user during the PR review).

I'll make a fix, but for now the workaround is just to delete all the .lock files before starting Zanata.

Oytun Tez27 January 2018 at 14:07

We are also encountering similar errors, in multiple workflows. @Former user, you may want to open a different ticket about this as you have been working on it.

The last similar error I have is this one (local Docker):

zanata_1                 | 23:46:38,942 INFO  [org.zanata.dao.TextFlowTargetHistoryDAO] (default task-25) HTextFlowTarget{contents=[dsfgsdfg], locale=HLocale(localeId=it), state=Translated, comment=null, textFlow=[Votre compte d\'acc?s:]}
zanata_1                 | 23:46:48,882 INFO  [org.zanata.model.HGlossaryEntry] (default task-1) persist entity: HGlossaryEntry(sourceRef=, srcLocale=HLocale(localeId=fr))
zanata_1                 | 23:46:48,902 INFO  [org.zanata.model.HGlossaryTerm] (default task-1) persist entity: HGlossaryTerm(content=dgerg, comment=, glossaryEntry=HGlossaryEntry(sourceRef=, srcLocale=HLocale(localeId=fr)), locale=HLocale(localeId=it), lastModifiedBy=HPerson(super=HPerson@3405a708[id=1,versionNum=1], name=Administrator))
zanata_1                 | 23:46:48,934 INFO  [org.zanata.model.HGlossaryTerm] (default task-1) persist entity: HGlossaryTerm(content=Votre, comment=, glossaryEntry=HGlossaryEntry(sourceRef=, srcLocale=HLocale(localeId=fr)), locale=HLocale(localeId=fr), lastModifiedBy=HPerson(super=HPerson@3405a708[id=1,versionNum=1], name=Administrator))
zanata_1                 | 23:46:49,038 ERROR [org.hibernate.search.exception.impl.LogErrorHandler] (Hibernate Search sync consumer thread for index org.zanata.model.HGlossaryTerm) HSEARCH000058: Exception occurred org.apache.lucene.store.LockObtainFailedException: Lock held elsewhere: /opt/jboss/zanata/indexes/org.zanata.model.HGlossaryTerm/write.lock
zanata_1                 | Primary Failure:
zanata_1                 | 	Entity org.zanata.model.HGlossaryTerm  Id 12955  Work Type  org.hibernate.search.backend.AddLuceneWork
zanata_1                 | Subsequent failures:
zanata_1                 | 	Entity org.zanata.model.HGlossaryTerm  Id 12956  Work Type  org.hibernate.search.backend.AddLuceneWork
zanata_1                 | : org.apache.lucene.store.LockObtainFailedException: Lock held elsewhere: /opt/jboss/zanata/indexes/org.zanata.model.HGlossaryTerm/write.lock
zanata_1                 | 	at org.apache.lucene.store.SimpleFSLockFactory.obtainFSLock(SimpleFSLockFactory.java:85) [lucene-core-5.3.1.jar:5.3.1 1703449 - noble - 2015-09-17 01:38:09]
zanata_1                 | 	at org.apache.lucene.store.FSLockFactory.obtainLock(FSLockFactory.java:41) [lucene-core-5.3.1.jar:5.3.1 1703449 - noble - 2015-09-17 01:38:09]
zanata_1                 | 	at org.apache.lucene.store.BaseDirectory.obtainLock(BaseDirectory.java:45) [lucene-core-5.3.1.jar:5.3.1 1703449 - noble - 2015-09-17 01:38:09]
zanata_1                 | 	at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:775) [lucene-core-5.3.1.jar:5.3.1 1703449 - noble - 2015-09-17 01:38:09]
zanata_1                 | 	at org.hibernate.search.backend.impl.lucene.IndexWriterHolder.createNewIndexWriter(IndexWriterHolder.java:123) [hibernate-search-engine-5.5.1.Final.jar:5.5.1.Final]
zanata_1                 | 	at org.hibernate.search.backend.impl.lucene.IndexWriterHolder.getIndexWriter(IndexWriterHolder.java:89) [hibernate-search-engine-5.5.1.Final.jar:5.5.1.Final]
zanata_1                 | 	at org.hibernate.search.backend.impl.lucene.AbstractWorkspaceImpl.getIndexWriter(AbstractWorkspaceImpl.java:112) [hibernate-search-engine-5.5.1.Final.jar:5.5.1.Final]
zanata_1                 | 	at org.hibernate.search.backend.impl.lucene.AbstractWorkspaceImpl.getIndexWriterDelegate(AbstractWorkspaceImpl.java:198) [hibernate-search-engine-5.5.1.Final.jar:5.5.1.Final]
zanata_1                 | 	at org.hibernate.search.backend.impl.lucene.LuceneBackendQueueTask.applyUpdates(LuceneBackendQueueTask.java:80) [hibernate-search-engine-5.5.1.Final.jar:5.5.1.Final]
zanata_1                 | 	at org.hibernate.search.backend.impl.lucene.LuceneBackendQueueTask.run(LuceneBackendQueueTask.java:46) [hibernate-search-engine-5.5.1.Final.jar:5.5.1.Final]
zanata_1                 | 	at org.hibernate.search.backend.impl.lucene.SyncWorkProcessor$Consumer.applyChangesets(SyncWorkProcessor.java:145) [hibernate-search-engine-5.5.1.Final.jar:5.5.1.Final]
zanata_1                 | 	at org.hibernate.search.backend.impl.lucene.SyncWorkProcessor$Consumer.run(SyncWorkProcessor.java:135) [hibernate-search-engine-5.5.1.Final.jar:5.5.1.Final]
zanata_1                 | 	at java.lang.Thread.run(Thread.java:745) [rt.jar:1.8.0_111]
zanata_1                 | Caused by: java.nio.file.FileAlreadyExistsException: /opt/jboss/zanata/indexes/org.zanata.model.HGlossaryTerm/write.lock
zanata_1                 | 	at sun.nio.fs.UnixException.translateToIOException(UnixException.java:88) [rt.jar:1.8.0_111]
zanata_1                 | 	at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) [rt.jar:1.8.0_111]
zanata_1                 | 	at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) [rt.jar:1.8.0_111]
zanata_1                 | 	at sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214) [rt.jar:1.8.0_111]
zanata_1                 | 	at java.nio.file.Files.newByteChannel(Files.java:361) [rt.jar:1.8.0_111]
zanata_1                 | 	at java.nio.file.Files.createFile(Files.java:632) [rt.jar:1.8.0_111]
zanata_1                 | 	at org.apache.lucene.store.SimpleFSLockFactory.obtainFSLock(SimpleFSLockFactory.java:82) [lucene-core-5.3.1.jar:5.3.1 1703449 - noble - 2015-09-17 01:38:09]
zanata_1                 | 	... 12 more
zanata_1                 |
zanata_1                 | 23:46:49,047 ERROR [org.hibernate.search.backend.impl.lucene.LuceneBackendQueueTask] (Hibernate Search sync consumer thread for index org.zanata.model.HGlossaryTerm) HSEARCH000072: Couldn't open the IndexWriter because of previous error: operation skipped, index ouf of sync!

Sean Flanigan25 January 2018 at 01:07

@B L If you're sure there isn't another copy of Zanata running, it's probably a leftover .lock file from a crashed process.

So you should probably delete all the write.lock files under {{C:\Windows\System32\config\systemprofile\zanata\indexes}} and restart Zanata.