-
Notifications
You must be signed in to change notification settings - Fork 1.3k
Open
Labels
Description
Description
Too many open files exception from HandleLimitFS. The test combines data from 15 indexes with concurrent merges running, and I guess this specific combination of things tips it over the edge. The failure goes away with the addition of @HandleLimitFS.MaxOpenHandles(limit = HandleLimitFS.MaxOpenHandles.MAX_OPEN_FILES * 2)
java.nio.file.FileSystemException: /Users/romseygeek/projects/lucene/lucene/core/build/tests-tmp/lucene.index.TestAddIndexes_1E5FC7CB8A9D1419-001/index-NIOFSDirectory-001/_d_Asserting_0.tip: Too many open files
> at __randomizedtesting.SeedInfo.seed([1E5FC7CB8A9D1419:3EF818C45EEF09A5]:0)
> at org.apache.lucene.tests.mockfile.HandleLimitFS.onOpen(HandleLimitFS.java:67)
> at org.apache.lucene.tests.mockfile.HandleTrackingFS.callOpenHook(HandleTrackingFS.java:82)
> at org.apache.lucene.tests.mockfile.HandleTrackingFS.newFileChannel(HandleTrackingFS.java:202)
> at org.apache.lucene.tests.mockfile.FilterFileSystemProvider.newFileChannel(FilterFileSystemProvider.java:206)
> at java.base/java.nio.channels.FileChannel.open(FileChannel.java:301)
> at java.base/java.nio.channels.FileChannel.open(FileChannel.java:353)
> at org.apache.lucene.store.NIOFSDirectory.openInput(NIOFSDirectory.java:78)
> at org.apache.lucene.tests.util.LuceneTestCase.slowFileExists(LuceneTestCase.java:3127)
> at org.apache.lucene.tests.store.MockDirectoryWrapper.openInput(MockDirectoryWrapper.java:799)
> at org.apache.lucene.codecs.lucene103.blocktree.Lucene103BlockTreeTermsReader.<init>(Lucene103BlockTreeTermsReader.java:127)
> at org.apache.lucene.codecs.lucene104.Lucene104PostingsFormat.fieldsProducer(Lucene104PostingsFormat.java:425)
> at org.apache.lucene.tests.codecs.asserting.AssertingPostingsFormat.fieldsProducer(AssertingPostingsFormat.java:54)
> at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsReader.<init>(PerFieldPostingsFormat.java:315)
> at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat.fieldsProducer(PerFieldPostingsFormat.java:375)
> at org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:98)
> at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:95)
> at org.apache.lucene.index.StandardDirectoryReader.createOrReuseSegmentReader(StandardDirectoryReader.java:298)
> at org.apache.lucene.index.StandardDirectoryReader.createSegmentReaders(StandardDirectoryReader.java:241)
> at org.apache.lucene.index.StandardDirectoryReader$1.doBody(StandardDirectoryReader.java:96)
> at org.apache.lucene.index.StandardDirectoryReader$1.doBody(StandardDirectoryReader.java:84)
> at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:828)
> at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:107)
> at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:73)
> at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:109)
> at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:61)
> at org.apache.lucene.index.TestAddIndexes.testAddIndexesWithConcurrentMerges(TestAddIndexes.java:749)
Gradle command to reproduce
gradlew :lucene:core:test --tests "org.apache.lucene.index.TestAddIndexes.testAddIndexesWithConcurrentMerges" -Ptests.asserts=true -Ptests.file.encoding=ISO-8859-1 -Ptests.gui=true -Ptests.jvmargs= -Ptests.jvms=12 -Ptests.seed=1E5FC7CB8A9D1419 -Ptests.vectorsize=default