Skip to content

Commit

Permalink
Refactor approach to tolerance checking and tweak yaml configs (#2592)
Browse files Browse the repository at this point in the history
+ Wrapped up #2531 - revert to "default settings" for dense indexing - previously was applied for some configs,
  but not others. This PR makes indexing options consistent across all configs.
+ Tolerance values are now stored directly in the yaml configs, not centralized in run_regression.py
+ Changed MS MARCO v1 passage Cohere regressions to use same metrics as other regressions.
+ Updated topics - removed extra queries for BGE BEIR BioASQ
  • Loading branch information
lintool authored Sep 19, 2024
1 parent 204bc87 commit 9e0cd5b
Show file tree
Hide file tree
Showing 409 changed files with 2,292 additions and 537 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-arguana.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-arguana.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-arguana.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-arguana.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-arguana.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-arguana.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-bioasq.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-bioasq.bge-base-en-v1.5/ \
-M 16 -efC 500 -noMerge -quantize.int8 \
-M 16 -efC 500 -quantize.int8 \
>& logs/log.beir-v1.0.0-bioasq.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-bioasq.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-bioasq.bge-base-en-v1.5/ \
-M 16 -efC 500 -noMerge \
-M 16 -efC 500 \
>& logs/log.beir-v1.0.0-bioasq.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-climate-fever.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-climate-fever.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-climate-fever.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-climate-fever.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-climate-fever.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-climate-fever.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-gis.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-gis.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-gis.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-gis.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-gis.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-gis.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-mathematica.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-mathematica.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-mathematica.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-mathematica.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-mathematica.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-mathematica.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-physics.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-physics.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-physics.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-physics.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-physics.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-physics.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-programmers.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-programmers.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-programmers.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-programmers.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-programmers.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-programmers.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-stats.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-stats.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-stats.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-stats.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-stats.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-stats.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-tex.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-tex.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-tex.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-tex.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-tex.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-tex.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-unix.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-unix.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-unix.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-unix.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-unix.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-unix.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-webmasters.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-webmasters.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-webmasters.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-webmasters.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-webmasters.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-webmasters.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-wordpress.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-wordpress.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-wordpress.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-wordpress.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-wordpress.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-wordpress.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-dbpedia-entity.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-dbpedia-entity.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-dbpedia-entity.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-dbpedia-entity.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-dbpedia-entity.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-dbpedia-entity.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-fever.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-fever.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-fever.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-fever.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-fever.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-fever.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-fiqa.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-fiqa.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-fiqa.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-fiqa.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-fiqa.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-fiqa.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-hotpotqa.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-hotpotqa.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-hotpotqa.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-hotpotqa.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-hotpotqa.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-hotpotqa.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-nfcorpus.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-nfcorpus.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-nfcorpus.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-nfcorpus.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-nfcorpus.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-nfcorpus.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-nq.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-nq.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-nq.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-nq.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-nq.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-nq.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-quora.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-quora.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-quora.bge-base-en-v1.5 &
```

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-quora.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-quora.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-quora.bge-base-en-v1.5 &
```

Expand Down
Loading

0 comments on commit 9e0cd5b

Please sign in to comment.