Skip to content

Commit

Permalink
Test perf lookup int, rewrite of graphs
Browse files Browse the repository at this point in the history
  • Loading branch information
glorieux-f committed Aug 17, 2024
1 parent 5a61603 commit ff63057
Show file tree
Hide file tree
Showing 28 changed files with 867 additions and 762 deletions.
Binary file modified alix-cli/lib/alix-0.9.1-SNAPSHOT.jar
Binary file not shown.
289 changes: 142 additions & 147 deletions docs/allclasses-index.html

Large diffs are not rendered by default.

3 changes: 1 addition & 2 deletions docs/com/github/oeuvres/alix/lucene/search/FieldFacet.html
Original file line number Diff line number Diff line change
Expand Up @@ -489,9 +489,8 @@ <h3>formEnum</h3>
Searching for the word "dummy" may result in a count of occurrences of the word "dummy"
very different on each facet (withLotsOfDummy: a lot, withSomeDummy: some, withoutDummy: 0).


Query maybe restricted by a doc filter (a
corpus). If there are no search in the search, will cry. Returns an iterator
corpus). If there are no terms in the search, will cry. Returns an iterator
on search of this facet, with scores and other stats.</div>
<dl class="notes">
<dt>Parameters:</dt>
Expand Down
12 changes: 6 additions & 6 deletions docs/com/github/oeuvres/alix/lucene/search/FieldRail.html
Original file line number Diff line number Diff line change
Expand Up @@ -169,7 +169,7 @@ <h2>Method Summary</h2>
<div class="table-header col-second">Method</div>
<div class="table-header col-last">Description</div>
<div class="col-first even-row-color method-summary-table method-summary-table-tab2 method-summary-table-tab4"><code><a href="FormEnum.html" title="class in com.github.oeuvres.alix.lucene.search">FormEnum</a></code></div>
<div class="col-second even-row-color method-summary-table method-summary-table-tab2 method-summary-table-tab4"><code><a href="#coocs(org.apache.lucene.util.BytesRef%5B%5D,int,int,org.apache.lucene.util.BitSet)" class="member-name-link">coocs</a><wbr>(org.apache.lucene.util.BytesRef[]&nbsp;pivotBytes,
<div class="col-second even-row-color method-summary-table method-summary-table-tab2 method-summary-table-tab4"><code><a href="#coocs(int%5B%5D,int,int,org.apache.lucene.util.BitSet)" class="member-name-link">coocs</a><wbr>(int[]&nbsp;pivotIds,
int&nbsp;left,
int&nbsp;right,
org.apache.lucene.util.BitSet&nbsp;docFilter)</code></div>
Expand Down Expand Up @@ -345,9 +345,9 @@ <h3>FieldRail</h3>
<h2>Method Details</h2>
<ul class="member-list">
<li>
<section class="detail" id="coocs(org.apache.lucene.util.BytesRef[],int,int,org.apache.lucene.util.BitSet)">
<section class="detail" id="coocs(int[],int,int,org.apache.lucene.util.BitSet)">
<h3>coocs</h3>
<div class="member-signature"><span class="modifiers">public</span>&nbsp;<span class="return-type"><a href="FormEnum.html" title="class in com.github.oeuvres.alix.lucene.search">FormEnum</a></span>&nbsp;<span class="element-name">coocs</span><wbr><span class="parameters">(org.apache.lucene.util.BytesRef[]&nbsp;pivotBytes,
<div class="member-signature"><span class="modifiers">public</span>&nbsp;<span class="return-type"><a href="FormEnum.html" title="class in com.github.oeuvres.alix.lucene.search">FormEnum</a></span>&nbsp;<span class="element-name">coocs</span><wbr><span class="parameters">(int[]&nbsp;pivotIds,
int&nbsp;left,
int&nbsp;right,
org.apache.lucene.util.BitSet&nbsp;docFilter)</span>
Expand All @@ -357,7 +357,7 @@ <h3>coocs</h3>
params, set on the FormEnum object.</div>
<dl class="notes">
<dt>Parameters:</dt>
<dd><code>pivotBytes</code> - an ordered set of lucene terms.</dd>
<dd><code>pivotIds</code> - an set of lucene terms.</dd>
<dd><code>left</code> - width of context before a pivot.</dd>
<dd><code>right</code> - width of context after a pivot.</dd>
<dd><code>docFilter</code> - optional, set of lucene internal docId to restrict collect.</dd>
Expand All @@ -379,7 +379,7 @@ <h3>edges</h3>
throws <span class="exceptions"><a href="https://docs.oracle.com/en/java/javase/11/docs/api/java.base/java/io/IOException.html" title="class or interface in java.io" class="external-link">IOException</a></span></div>
<div class="block">Loop on a set of pivots, explore their context,
record edges between a set of cooccurents in these contexts.
The set coocIds should have been obtained by <a href="#coocs(org.apache.lucene.util.BytesRef%5B%5D,int,int,org.apache.lucene.util.BitSet)"><code>coocs(BytesRef[], int, int, BitSet)</code></a>.</div>
The set coocIds should have been obtained by <a href="#coocs(int%5B%5D,int,int,org.apache.lucene.util.BitSet)"><code>coocs(int[], int, int, BitSet)</code></a>.</div>
<dl class="notes">
<dt>Parameters:</dt>
<dd><code>pivotIds</code> - set of formId from a <a href="FieldText.html" title="class in com.github.oeuvres.alix.lucene.search"><code>FieldText</code></a>, word pivots to search around.</dd>
Expand Down Expand Up @@ -472,7 +472,7 @@ <h3>positions</h3>
<code>FieldCharsAbstract.bytesSorted(CharSequence[])</code>
or <code>FieldCharsAbstract.bytesSorted(int[])</code>,
get an ordered list of positions by docId.
Used by <a href="#coocs(org.apache.lucene.util.BytesRef%5B%5D,int,int,org.apache.lucene.util.BitSet)"><code>coocs(BytesRef[], int, int, BitSet)</code></a>.</div>
Used by <a href="#coocs(int%5B%5D,int,int,org.apache.lucene.util.BitSet)"><code>coocs(int[], int, int, BitSet)</code></a>.</div>
<dl class="notes">
<dt>Parameters:</dt>
<dd><code>pivotBytes</code> - mandatory, ordered set of terms of this field, as bytes.</dd>
Expand Down
4 changes: 2 additions & 2 deletions docs/com/github/oeuvres/alix/lucene/search/FormEnum.html
Original file line number Diff line number Diff line change
Expand Up @@ -392,7 +392,7 @@ <h2>Method Summary</h2>
int[]&nbsp;pivotIds)</code></div>
<div class="col-last odd-row-color method-summary-table method-summary-table-tab2 method-summary-table-tab4">
<div class="block">Scores a <a href="FormEnum.html" title="class in com.github.oeuvres.alix.lucene.search"><code>FormEnum</code></a> with freqs extracted from co-occurrences extraction
in a <a href="FieldRail.html#coocs(org.apache.lucene.util.BytesRef%5B%5D,int,int,org.apache.lucene.util.BitSet)"><code>FieldRail.coocs(BytesRef[], int, int, BitSet)</code></a>.</div>
in a <a href="FieldRail.html#coocs(int%5B%5D,int,int,org.apache.lucene.util.BitSet)"><code>FieldRail.coocs(int[], int, int, BitSet)</code></a>.</div>
</div>
<div class="col-first even-row-color method-summary-table method-summary-table-tab2 method-summary-table-tab4"><code>double</code></div>
<div class="col-second even-row-color method-summary-table method-summary-table-tab2 method-summary-table-tab4"><code><a href="#scoreByRank(int)" class="member-name-link">scoreByRank</a><wbr>(int&nbsp;rank)</code></div>
Expand Down Expand Up @@ -997,7 +997,7 @@ <h3>score</h3>
int[]&nbsp;pivotIds)</span>
throws <span class="exceptions"><a href="https://docs.oracle.com/en/java/javase/11/docs/api/java.base/java/io/IOException.html" title="class or interface in java.io" class="external-link">IOException</a></span></div>
<div class="block">Scores a <a href="FormEnum.html" title="class in com.github.oeuvres.alix.lucene.search"><code>FormEnum</code></a> with freqs extracted from co-occurrences extraction
in a <a href="FieldRail.html#coocs(org.apache.lucene.util.BytesRef%5B%5D,int,int,org.apache.lucene.util.BitSet)"><code>FieldRail.coocs(BytesRef[], int, int, BitSet)</code></a>. Scoring uses a “mutual information”
in a <a href="FieldRail.html#coocs(int%5B%5D,int,int,org.apache.lucene.util.BitSet)"><code>FieldRail.coocs(int[], int, int, BitSet)</code></a>. Scoring uses a “mutual information”
<a href="../../util/MI.html" title="enum in com.github.oeuvres.alix.util"><code>MI</code></a> formula (probability like, not tf-idf like). Parameters
are

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -71,7 +71,7 @@ <h2>Uses of <a href="../FormEnum.html" title="class in com.github.oeuvres.alix.l
<div class="table-header col-second">Method</div>
<div class="table-header col-last">Description</div>
<div class="col-first even-row-color"><code><a href="../FormEnum.html" title="class in com.github.oeuvres.alix.lucene.search">FormEnum</a></code></div>
<div class="col-second even-row-color"><span class="type-name-label">FieldRail.</span><code><a href="../FieldRail.html#coocs(org.apache.lucene.util.BytesRef%5B%5D,int,int,org.apache.lucene.util.BitSet)" class="member-name-link">coocs</a><wbr>(org.apache.lucene.util.BytesRef[]&nbsp;pivotBytes,
<div class="col-second even-row-color"><span class="type-name-label">FieldRail.</span><code><a href="../FieldRail.html#coocs(int%5B%5D,int,int,org.apache.lucene.util.BitSet)" class="member-name-link">coocs</a><wbr>(int[]&nbsp;pivotIds,
int&nbsp;left,
int&nbsp;right,
org.apache.lucene.util.BitSet&nbsp;docFilter)</code></div>
Expand Down Expand Up @@ -149,7 +149,7 @@ <h2>Uses of <a href="../FormEnum.html" title="class in com.github.oeuvres.alix.l
int[]&nbsp;pivotIds)</code></div>
<div class="col-last even-row-color">
<div class="block">Scores a <a href="../FormEnum.html" title="class in com.github.oeuvres.alix.lucene.search"><code>FormEnum</code></a> with freqs extracted from co-occurrences extraction
in a <a href="../FieldRail.html#coocs(org.apache.lucene.util.BytesRef%5B%5D,int,int,org.apache.lucene.util.BitSet)"><code>FieldRail.coocs(BytesRef[], int, int, BitSet)</code></a>.</div>
in a <a href="../FieldRail.html#coocs(int%5B%5D,int,int,org.apache.lucene.util.BitSet)"><code>FieldRail.coocs(int[], int, int, BitSet)</code></a>.</div>
</div>
<div class="col-first odd-row-color"><code><a href="../FormEnum.html" title="class in com.github.oeuvres.alix.lucene.search">FormEnum</a></code></div>
<div class="col-second odd-row-color"><span class="type-name-label">FormEnum.</span><code><a href="../FormEnum.html#sort(com.github.oeuvres.alix.lucene.search.FormIterator.Order)" class="member-name-link">sort</a><wbr>(<a href="../FormIterator.Order.html" title="enum in com.github.oeuvres.alix.lucene.search">FormIterator.Order</a>&nbsp;order)</code></div>
Expand Down
23 changes: 5 additions & 18 deletions docs/com/github/oeuvres/alix/util/EdgeMatrix.EdgeIt.html
Original file line number Diff line number Diff line change
Expand Up @@ -87,7 +87,7 @@ <h1 title="Class EdgeMatrix.EdgeIt" class="title">Class EdgeMatrix.EdgeIt</h1>
<div class="type-signature"><span class="modifiers">public class </span><span class="element-name type-name-label">EdgeMatrix.EdgeIt</span>
<span class="extends-implements">extends <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java.base/java/lang/Object.html" title="class or interface in java.lang" class="external-link">Object</a>
implements <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java.base/java/util/Iterator.html" title="class or interface in java.util" class="external-link">Iterator</a>&lt;<a href="Edge.html" title="class in com.github.oeuvres.alix.util">Edge</a>&gt;</span></div>
<div class="block">An iterator of edges.</div>
<div class="block">A complex iterator on edges, trying to avoid orphans.</div>
</section>
<section class="summary">
<ul class="summary-list">
Expand All @@ -113,12 +113,9 @@ <h2>Method Summary</h2>
<div class="col-first even-row-color method-summary-table method-summary-table-tab2 method-summary-table-tab4"><code><a href="Edge.html" title="class in com.github.oeuvres.alix.util">Edge</a></code></div>
<div class="col-second even-row-color method-summary-table method-summary-table-tab2 method-summary-table-tab4"><code><a href="#next()" class="member-name-link">next</a>()</code></div>
<div class="col-last even-row-color method-summary-table method-summary-table-tab2 method-summary-table-tab4">&nbsp;</div>
<div class="col-first odd-row-color method-summary-table method-summary-table-tab2 method-summary-table-tab4"><code>void</code></div>
<div class="col-second odd-row-color method-summary-table method-summary-table-tab2 method-summary-table-tab4"><code><a href="#remove()" class="member-name-link">remove</a>()</code></div>
<div class="col-last odd-row-color method-summary-table method-summary-table-tab2 method-summary-table-tab4">&nbsp;</div>
<div class="col-first even-row-color method-summary-table method-summary-table-tab2 method-summary-table-tab4"><code><a href="Edge.html" title="class in com.github.oeuvres.alix.util">Edge</a></code></div>
<div class="col-second even-row-color method-summary-table method-summary-table-tab2 method-summary-table-tab4"><code><a href="#top(int)" class="member-name-link">top</a><wbr>(int&nbsp;nodeId)</code></div>
<div class="col-last even-row-color method-summary-table method-summary-table-tab2 method-summary-table-tab4">
<div class="col-first odd-row-color method-summary-table method-summary-table-tab2 method-summary-table-tab4"><code><a href="Edge.html" title="class in com.github.oeuvres.alix.util">Edge</a></code></div>
<div class="col-second odd-row-color method-summary-table method-summary-table-tab2 method-summary-table-tab4"><code><a href="#top(int)" class="member-name-link">top</a><wbr>(int&nbsp;nodeId)</code></div>
<div class="col-last odd-row-color method-summary-table method-summary-table-tab2 method-summary-table-tab4">
<div class="block">Check if a node has relations</div>
</div>
</div>
Expand All @@ -129,7 +126,7 @@ <h3 id="methods-inherited-from-class-java.lang.Object">Methods inherited from cl
<code><a href="https://docs.oracle.com/en/java/javase/11/docs/api/java.base/java/lang/Object.html#clone()" title="class or interface in java.lang" class="external-link">clone</a>, <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java.base/java/lang/Object.html#equals(java.lang.Object)" title="class or interface in java.lang" class="external-link">equals</a>, <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java.base/java/lang/Object.html#finalize()" title="class or interface in java.lang" class="external-link">finalize</a>, <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java.base/java/lang/Object.html#getClass()" title="class or interface in java.lang" class="external-link">getClass</a>, <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java.base/java/lang/Object.html#hashCode()" title="class or interface in java.lang" class="external-link">hashCode</a>, <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java.base/java/lang/Object.html#notify()" title="class or interface in java.lang" class="external-link">notify</a>, <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java.base/java/lang/Object.html#notifyAll()" title="class or interface in java.lang" class="external-link">notifyAll</a>, <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java.base/java/lang/Object.html#toString()" title="class or interface in java.lang" class="external-link">toString</a>, <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java.base/java/lang/Object.html#wait()" title="class or interface in java.lang" class="external-link">wait</a>, <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java.base/java/lang/Object.html#wait(long)" title="class or interface in java.lang" class="external-link">wait</a>, <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java.base/java/lang/Object.html#wait(long,int)" title="class or interface in java.lang" class="external-link">wait</a></code></div>
<div class="inherited-list">
<h3 id="methods-inherited-from-class-java.util.Iterator">Methods inherited from interface&nbsp;java.util.<a href="https://docs.oracle.com/en/java/javase/11/docs/api/java.base/java/util/Iterator.html" title="class or interface in java.util" class="external-link">Iterator</a></h3>
<code><a href="https://docs.oracle.com/en/java/javase/11/docs/api/java.base/java/util/Iterator.html#forEachRemaining(java.util.function.Consumer)" title="class or interface in java.util" class="external-link">forEachRemaining</a></code></div>
<code><a href="https://docs.oracle.com/en/java/javase/11/docs/api/java.base/java/util/Iterator.html#forEachRemaining(java.util.function.Consumer)" title="class or interface in java.util" class="external-link">forEachRemaining</a>, <a href="https://docs.oracle.com/en/java/javase/11/docs/api/java.base/java/util/Iterator.html#remove()" title="class or interface in java.util" class="external-link">remove</a></code></div>
</section>
</li>
</ul>
Expand Down Expand Up @@ -185,16 +182,6 @@ <h3>getNext</h3>
</dl>
</section>
</li>
<li>
<section class="detail" id="remove()">
<h3>remove</h3>
<div class="member-signature"><span class="modifiers">public</span>&nbsp;<span class="return-type">void</span>&nbsp;<span class="element-name">remove</span>()</div>
<dl class="notes">
<dt>Specified by:</dt>
<dd><code><a href="https://docs.oracle.com/en/java/javase/11/docs/api/java.base/java/util/Iterator.html#remove()" title="class or interface in java.util" class="external-link">remove</a></code>&nbsp;in interface&nbsp;<code><a href="https://docs.oracle.com/en/java/javase/11/docs/api/java.base/java/util/Iterator.html" title="class or interface in java.util" class="external-link">Iterator</a>&lt;<a href="Edge.html" title="class in com.github.oeuvres.alix.util">Edge</a>&gt;</code></dd>
</dl>
</section>
</li>
</ul>
</section>
</li>
Expand Down
Loading

0 comments on commit ff63057

Please sign in to comment.