Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Embedding gpu #14253

Merged
merged 10 commits into from
Oct 10, 2024
Merged

Embedding gpu #14253

merged 10 commits into from
Oct 10, 2024

Conversation

NickM-27
Copy link
Sponsor Collaborator

@NickM-27 NickM-27 commented Oct 9, 2024

Proposed change

This adds support for running the image embeddings model on a GPU when the correct image is used. The text embedding model does not work well on GPU so only the image model is considered for this.

Type of change

  • Dependency upgrade
  • Bugfix (non-breaking change which fixes an issue)
  • New feature
  • Breaking change (fix/feature causing existing functionality to break)
  • Code quality improvements to existing code

Additional information

  • This PR fixes or closes issue: fixes #
  • This PR is related to issue:

Checklist

  • The code change is tested and works locally.
  • Local tests pass. Your PR cannot be merged unless tests pass
  • There is no commented out code in this PR.
  • The code has been formatted using Ruff (ruff format frigate)

Copy link

netlify bot commented Oct 9, 2024

Deploy Preview for frigate-docs canceled.

Name Link
🔨 Latest commit 401e867
🔍 Latest deploy log https://app.netlify.com/sites/frigate-docs/deploys/670731252c8419000849a514

docs/docs/configuration/semantic_search.md Outdated Show resolved Hide resolved
NickM-27 and others added 2 commits October 9, 2024 19:20
Co-authored-by: Josh Hawkins <[email protected]>
@NickM-27 NickM-27 marked this pull request as ready for review October 10, 2024 01:44
@NickM-27 NickM-27 merged commit bc3a061 into dev Oct 10, 2024
13 checks passed
@NickM-27 NickM-27 deleted the embedding-gpu branch October 10, 2024 01:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants