Adds LLM matrix for OSS models #6424
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
A documentation preview will be available soon. Request a new doc build by commenting
If your PR continues to fail for an unknown reason, the doc build pipeline may be broken. Elastic employees can check the pipeline status here. |
|
This pull request does not have a backport label. Could you fix it @benironside? 🙏
NOTE: |
nastasha-solomon
previously approved these changes
Jan 21, 2025
|
@benironside can we make all the OSS models in the assistant - general category "Good" please? sorry for the last minute change. cc: @jamesspi |
nastasha-solomon
approved these changes
Jan 21, 2025
mergify bot
pushed a commit
that referenced
this pull request
Jan 21, 2025
* First draft * Update llm-performance-matrix.asciidoc * links from BYO page to performance matrix * updates table format * fixes broken ref * inverts first matrix * flips tables * removes old tables * incorporates last min edit from James (cherry picked from commit 6d64b54) # Conflicts: # docs/serverless/AI-for-security/connect-to-byo-llm.asciidoc # docs/serverless/AI-for-security/llm-performance-matrix.asciidoc
mergify bot
pushed a commit
that referenced
this pull request
Jan 21, 2025
* First draft * Update llm-performance-matrix.asciidoc * links from BYO page to performance matrix * updates table format * fixes broken ref * inverts first matrix * flips tables * removes old tables * incorporates last min edit from James (cherry picked from commit 6d64b54) # Conflicts: # docs/serverless/AI-for-security/connect-to-byo-llm.asciidoc # docs/serverless/AI-for-security/llm-performance-matrix.asciidoc
This was referenced Jan 21, 2025
mergify bot
pushed a commit
that referenced
this pull request
Jan 21, 2025
* First draft * Update llm-performance-matrix.asciidoc * links from BYO page to performance matrix * updates table format * fixes broken ref * inverts first matrix * flips tables * removes old tables * incorporates last min edit from James (cherry picked from commit 6d64b54) # Conflicts: # docs/serverless/AI-for-security/connect-to-byo-llm.asciidoc # docs/serverless/AI-for-security/llm-performance-matrix.asciidoc
benironside
added a commit
that referenced
this pull request
Jan 21, 2025
* Adds LLM matrix for OSS models (#6424) * First draft * Update llm-performance-matrix.asciidoc * links from BYO page to performance matrix * updates table format * fixes broken ref * inverts first matrix * flips tables * removes old tables * incorporates last min edit from James (cherry picked from commit 6d64b54) # Conflicts: # docs/serverless/AI-for-security/connect-to-byo-llm.asciidoc # docs/serverless/AI-for-security/llm-performance-matrix.asciidoc * Delete docs/serverless directory and its contents --------- Co-authored-by: Benjamin Ironside Goldstein <[email protected]> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
benironside
added a commit
that referenced
this pull request
Jan 21, 2025
* Adds LLM matrix for OSS models (#6424) * First draft * Update llm-performance-matrix.asciidoc * links from BYO page to performance matrix * updates table format * fixes broken ref * inverts first matrix * flips tables * removes old tables * incorporates last min edit from James (cherry picked from commit 6d64b54) # Conflicts: # docs/serverless/AI-for-security/connect-to-byo-llm.asciidoc # docs/serverless/AI-for-security/llm-performance-matrix.asciidoc * Delete docs/serverless directory and its contents --------- Co-authored-by: Benjamin Ironside Goldstein <[email protected]> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
benironside
added a commit
that referenced
this pull request
Jan 22, 2025
* Adds LLM matrix for OSS models (#6424) * First draft * Update llm-performance-matrix.asciidoc * links from BYO page to performance matrix * updates table format * fixes broken ref * inverts first matrix * flips tables * removes old tables * incorporates last min edit from James (cherry picked from commit 6d64b54) # Conflicts: # docs/serverless/AI-for-security/connect-to-byo-llm.asciidoc # docs/serverless/AI-for-security/llm-performance-matrix.asciidoc * Delete docs/serverless directory and its contents --------- Co-authored-by: Benjamin Ironside Goldstein <[email protected]> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Fixes #6396 — adds a second matrix to the LLM performance matrix page that describes the performance of open-source models on our tasks. Also flips the existing matrix rows and columns so it can fit better in a browser window (minimize the need to scroll left-right).
Finally, makes a minor addition to the bring your own LLM guide, linking to the performance matrix since it now includes info about open source models.
Previews: