Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[agent_farm][difficult] #1905

Open
theskcd opened this issue Jan 31, 2025 · 2 comments · May be fixed by #1906
Open

[agent_farm][difficult] #1905

theskcd opened this issue Jan 31, 2025 · 2 comments · May be fixed by #1906

Comments

@theskcd
Copy link
Contributor

theskcd commented Jan 31, 2025

I want to have a finish tool which provides data to a post completion script for sanity check..
I want to call this tool 'Wait...' this implies the LLM is going to think
It's like a backspace tool which the agent has access to, if it wants to course correct
We leave the option to the agentic model to invoke this tool and explore other options
We first try to get the model to use this tool, for which we want to create a new Tool called: Wait and allow the agent to take a step back and explore other options, we let the agentic LLM decide this and invoke it at will, we don't invoke it ourselves (ever, unless we get logits but thats another option)
we can also do this when we exceed a context window limit and let the agent do this

Take a first pass at building it,
I want the ToolType::Wait to be present
I want it to be part of the ToolInputPartial and have it registered with the tool/broker.rs as well

And then the ToolUseAgent should be registered with this tool as well
We can enable this when the reasoning is set to true in tool_use_agent_endpoint

@theskcd
Copy link
Contributor Author

theskcd commented Jan 31, 2025

ACK, on it!

@theskcd
Copy link
Contributor Author

theskcd commented Jan 31, 2025

I've pushed a new commit (3e2cc26) to this PR. Please review the changes.

@theskcd theskcd linked a pull request Jan 31, 2025 that will close this issue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant