Add Query for Model context protocol

[lnvestor]

Hi

Thanks for your efforts,

is there a way to use this i have MCP tools that will need KB is there a way to use this as query form my MCP tools

Thanks

[hhhuang]

While CAG is designed for retrieval-free operation by preloading all relevant knowledge into the model's context, you can use the KB required for your MCP tools as the preloaded context for the LLM. Format the KB into a structured or text-based format that fits the LLM's input requirements and precompute the key-value (KV) cache. Ensure the size of the KB is manageable within the LLM's context length. During inference, your MCP tools can send queries to the LLM, which generates responses directly from the preloaded KB.