You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I want to have a finish tool which provides data to a post completion script for sanity check..
I want to call this tool 'Wait...' this implies the LLM is going to think
It's like a backspace tool which the agent has access to, if it wants to course correct
We leave the option to the agentic model to invoke this tool and explore other options
We first try to get the model to use this tool, for which we want to create a new Tool called: Wait and allow the agent to take a step back and explore other options, we let the agentic LLM decide this and invoke it at will, we don't invoke it ourselves (ever, unless we get logits but thats another option)
we can also do this when we exceed a context window limit and let the agent do this
Take a first pass at building it,
I want the ToolType::Wait to be present
I want it to be part of the ToolInputPartial and have it registered with the tool/broker.rs as well
And then the ToolUseAgent should be registered with this tool as well
We can enable this when the reasoning is set to true in tool_use_agent_endpoint
The text was updated successfully, but these errors were encountered:
I want to have a finish tool which provides data to a post completion script for sanity check..
I want to call this tool 'Wait...' this implies the LLM is going to think
It's like a backspace tool which the agent has access to, if it wants to course correct
We leave the option to the agentic model to invoke this tool and explore other options
We first try to get the model to use this tool, for which we want to create a new Tool called: Wait and allow the agent to take a step back and explore other options, we let the agentic LLM decide this and invoke it at will, we don't invoke it ourselves (ever, unless we get logits but thats another option)
we can also do this when we exceed a context window limit and let the agent do this
Take a first pass at building it,
I want the ToolType::Wait to be present
I want it to be part of the ToolInputPartial and have it registered with the tool/broker.rs as well
And then the ToolUseAgent should be registered with this tool as well
We can enable this when the reasoning is set to true in tool_use_agent_endpoint
The text was updated successfully, but these errors were encountered: