[Feature Request] Add support for query breakdown functionality for knowledge base retrieval

[fillz-noh]

Describe the solution you'd like

I would like to add support for the query breakdown feature (Query modification). This feature helps break down complex questions into simpler ones that work better with knowledge base searches.

Why the solution needed

Users often ask questions in ways that don't work well for searching knowledge bases. The query breakdown feature can change these complex questions into better search terms. Using this together with the rerank feature from issue #695 might help improve RAG (Retrieval Augmented Generation) quality and give users more relevant answers.

Additional context

I believe both the query breakdown and rerank features can be added through the retrieve_and_generate configuration settings.

Implementation feasibility

• Yes, I am able to implement the feature and create a pull request.
• No, I am unable to implement the feature, but I am open to discussing the solution.

[statefb]

Thank you for the request. Currently we use the same query as user's input but much better to use optimized query reflecting the context such as conversation history.