Skip to content

Commit

Permalink
ngram tokenizer backport
Browse files Browse the repository at this point in the history
  • Loading branch information
l-trotta committed Oct 28, 2024
1 parent dd79a33 commit 1a27080
Show file tree
Hide file tree
Showing 6 changed files with 49 additions and 50 deletions.
5 changes: 1 addition & 4 deletions output/openapi/elasticsearch-openapi.json

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

5 changes: 1 addition & 4 deletions output/openapi/elasticsearch-serverless-openapi.json

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

37 changes: 19 additions & 18 deletions output/schema/schema-serverless.json

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

37 changes: 19 additions & 18 deletions output/schema/schema.json

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

6 changes: 3 additions & 3 deletions output/typescript/types.ts

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

9 changes: 6 additions & 3 deletions specification/_types/analysis/tokenizers.ts
Original file line number Diff line number Diff line change
Expand Up @@ -38,9 +38,12 @@ export class EdgeNGramTokenizer extends TokenizerBase {
export class NGramTokenizer extends TokenizerBase {
type: 'ngram'
custom_token_chars?: string
max_gram: integer
min_gram: integer
token_chars: TokenChar[]
max_gram?: integer
min_gram?: integer
/**
* @server_default []
*/
token_chars?: TokenChar[]
}

export enum TokenChar {
Expand Down

0 comments on commit 1a27080

Please sign in to comment.