Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Right now
dspy.Retrieve
is not a useful abstraction, and we have too many prebuiltdspy.Retrieve
implementations. Although it would be nice to have DSPy play as a centralized hub for these retriever providers, this will quickly go outdated due to the maintenance challenge. Before our code smells, we are reworking thedspy.Retrieve
with the goal that:dspy.Retrieve
becomes a useful abstraction, which can help people instrument retrieval (withcallback
support), and save the retriever imlplementations.dspy.Retrieve
.Meanwhile, we realized that many retrievers require users to compute the embedding before querying, so we are exposing a
dspy.Embedding
interface, which is built on top of litellm, similar todspy.LM
.