Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] cuvs-java com.nvidia.cuvs.CagraRandomizedTest.testResultsTopKWithRandomValues test fails intermittently #631

Open
ChrisHegarty opened this issue Jan 31, 2025 · 1 comment
Labels
bug Something isn't working

Comments

@ChrisHegarty
Copy link
Contributor

Describe the bug
cuvs-java test fails intermittently, e.g.

[ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 2.031 s <<< FAILURE! -- in com.nvidia.cuvs.CagraRandomizedTest
[ERROR] com.nvidia.cuvs.CagraRandomizedTest.testResultsTopKWithRandomValues -- Time elapsed: 2.031 s <<< FAILURE!
java.lang.AssertionError: Not found in expected list: 1583
  at __randomizedtesting.SeedInfo.seed([93DF604C314D221A:BAF3BCD46F1EDC5A]:0)
  at org.junit.Assert.fail(Assert.java:89)
  at org.junit.Assert.assertTrue(Assert.java:42)
  at com.nvidia.cuvs/com.nvidia.cuvs.CuVSTestCase.compareResults(CuVSTestCase.java:83)
  at com.nvidia.cuvs/com.nvidia.cuvs.CagraRandomizedTest.tmpResultsTopKWithRandomValues(CagraRandomizedTest.java:98)
  at com.nvidia.cuvs/com.nvidia.cuvs.CagraRandomizedTest.testResultsTopKWithRandomValues(CagraRandomizedTest.java:29)
  at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103)
  at java.base/java.lang.reflect.Method.invoke(Method.java:580)
...

Steps/Code to reproduce bug
It's not clear if setting the random seed (-Dtests.seed) actually improves reproducibility.

./build java
cd java/cuvs-java
mvn -Dtests.seed=93DF604C314D221A test

Expected behavior
The test passes successfully every time.

Environment details (please complete the following information):

  • Environment location: [Bare-metal, Docker, Cloud(specify cloud provider)]
    • AWS g4dn.2xlarge, Ubuntu 22.04 + cuda 12.6
  • Method of RAFT install: [conda, Docker, or from source]
    • If method of install is [Docker], provide docker pull & docker run commands used

set the JAVA_HOME env variable to JDK 22

JAVA_HOME=/home/ubuntu/binaries/jdk-22.0.2/

Additional context
This fails in branch-25.02, with the commit that added the java-api:

commit 4ca47c92b03856e7d4ae328aabf6ee3e853a137e (...

Initial cut for a cuVS Java API (#450)
    
A Java API for cuVS for easy integration into Apache Lucene or other Java based projects.
@ChrisHegarty ChrisHegarty added the bug Something isn't working label Jan 31, 2025
@ChrisHegarty
Copy link
Contributor Author

/cc @chatman

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant