Skip to content

Failure in TestAddIndexes.testAddIndexesWithConcurrentMerges #15580

@romseygeek

Description

@romseygeek

Description

Too many open files exception from HandleLimitFS. The test combines data from 15 indexes with concurrent merges running, and I guess this specific combination of things tips it over the edge. The failure goes away with the addition of @HandleLimitFS.MaxOpenHandles(limit = HandleLimitFS.MaxOpenHandles.MAX_OPEN_FILES * 2)

java.nio.file.FileSystemException: /Users/romseygeek/projects/lucene/lucene/core/build/tests-tmp/lucene.index.TestAddIndexes_1E5FC7CB8A9D1419-001/index-NIOFSDirectory-001/_d_Asserting_0.tip: Too many open files
   >         at __randomizedtesting.SeedInfo.seed([1E5FC7CB8A9D1419:3EF818C45EEF09A5]:0)
   >         at org.apache.lucene.tests.mockfile.HandleLimitFS.onOpen(HandleLimitFS.java:67)
   >         at org.apache.lucene.tests.mockfile.HandleTrackingFS.callOpenHook(HandleTrackingFS.java:82)
   >         at org.apache.lucene.tests.mockfile.HandleTrackingFS.newFileChannel(HandleTrackingFS.java:202)
   >         at org.apache.lucene.tests.mockfile.FilterFileSystemProvider.newFileChannel(FilterFileSystemProvider.java:206)
   >         at java.base/java.nio.channels.FileChannel.open(FileChannel.java:301)
   >         at java.base/java.nio.channels.FileChannel.open(FileChannel.java:353)
   >         at org.apache.lucene.store.NIOFSDirectory.openInput(NIOFSDirectory.java:78)
   >         at org.apache.lucene.tests.util.LuceneTestCase.slowFileExists(LuceneTestCase.java:3127)
   >         at org.apache.lucene.tests.store.MockDirectoryWrapper.openInput(MockDirectoryWrapper.java:799)
   >         at org.apache.lucene.codecs.lucene103.blocktree.Lucene103BlockTreeTermsReader.<init>(Lucene103BlockTreeTermsReader.java:127)
   >         at org.apache.lucene.codecs.lucene104.Lucene104PostingsFormat.fieldsProducer(Lucene104PostingsFormat.java:425)
   >         at org.apache.lucene.tests.codecs.asserting.AssertingPostingsFormat.fieldsProducer(AssertingPostingsFormat.java:54)
   >         at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsReader.<init>(PerFieldPostingsFormat.java:315)
   >         at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat.fieldsProducer(PerFieldPostingsFormat.java:375)
   >         at org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:98)
   >         at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:95)
   >         at org.apache.lucene.index.StandardDirectoryReader.createOrReuseSegmentReader(StandardDirectoryReader.java:298)
   >         at org.apache.lucene.index.StandardDirectoryReader.createSegmentReaders(StandardDirectoryReader.java:241)
   >         at org.apache.lucene.index.StandardDirectoryReader$1.doBody(StandardDirectoryReader.java:96)
   >         at org.apache.lucene.index.StandardDirectoryReader$1.doBody(StandardDirectoryReader.java:84)
   >         at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:828)
   >         at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:107)
   >         at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:73)
   >         at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:109)
   >         at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:61)
   >         at org.apache.lucene.index.TestAddIndexes.testAddIndexesWithConcurrentMerges(TestAddIndexes.java:749)

Gradle command to reproduce

gradlew :lucene:core:test --tests "org.apache.lucene.index.TestAddIndexes.testAddIndexesWithConcurrentMerges" -Ptests.asserts=true -Ptests.file.encoding=ISO-8859-1 -Ptests.gui=true -Ptests.jvmargs= -Ptests.jvms=12 -Ptests.seed=1E5FC7CB8A9D1419 -Ptests.vectorsize=default

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions