Skip to content

Commit

Permalink
Suggest chunking for large ELSER fields (#2660)
Browse files Browse the repository at this point in the history
(cherry picked from commit f4dacc9)
  • Loading branch information
seanstory authored and mergify[bot] committed Jan 30, 2024
1 parent 5882c10 commit f382ff9
Showing 1 changed file with 6 additions and 4 deletions.
10 changes: 6 additions & 4 deletions docs/en/stack/ml/nlp/ml-nlp-elser.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -408,9 +408,11 @@ image::images/ml-nlp-elser-v2-test.png[alt="Testing ELSER",align="center"]
* ELSER works best on small-to-medium sized fields that contain natural
language. For connector or web crawler use cases, this aligns best with fields
like _title_, _description_, _summary_, or _abstract_. As ELSER encodes the
first 512 tokens of a field, it may not be as good a match for `body_content` on
web crawler documents, or body fields resulting from extracting text from office
documents with connectors.
first 512 tokens of a field, it may not provide as relevant of results for large
fields. For example, `body_content` on web crawler documents, or body fields
resulting from extracting text from office documents with connectors. For larger
fields like these, consider "chunking" the content into multiple values, where
each chunk can be under 512 tokens.
* Larger documents take longer at ingestion time, and {infer} time per
document also increases the more fields in a document that need to be processed.
* The more fields your pipeline has to perform inference on, the longer it takes
Expand Down Expand Up @@ -521,4 +523,4 @@ image::images/ml-nlp-elser-v2-opt-bm-results.png[alt="ELSER V2 optimized benchma
respectively 14 docs/s and 16 docs/s, indicating a performance improvement due
to virtual cores of 12%.

image::images/ml-nlp-elser-v2-cp-bm-results.png[alt="ELSER V2 cross-platform benchmarks",align="center"]
image::images/ml-nlp-elser-v2-cp-bm-results.png[alt="ELSER V2 cross-platform benchmarks",align="center"]

0 comments on commit f382ff9

Please sign in to comment.