[FEATURE]: move to LLM gateway - instead of directly managing LLM configs via langchain

[surapuramakhil]

Feature summary

move to LLM gateway - instead of directly managing LLM configs via langchain

Feature description

use LLM gateway - selfhosted docker image. make Lang chain to use open router for LLM access.

initially felt open router, but after evaluation it didn't sound like a good fit.

After a bit of research Portkey gateway seems to be a good fit.

https://github.com/Portkey-AI/gateway

Deepseek chat: https://chat.deepseek.com/a/chat/s/54e9dcbc-de7a-4d60-953d-cf34b571879e

Research wiki: https://github.com/surapuramakhil-org/Job_search_assistant/wiki/LLM-Gateway-Research

Motivation

No response

Alternatives considered

No response

Additional context

No response