Does Langsmith logs Ingestions basically embedding logs(recursive character text splitter, vectordb ingestion traces etc)

[akash97715]

I am trying to use langsmith as product for my project, thinking of enterprise one. One doubt does langsmith logs the embedding ingestion logs(Recursive charctertext splitter, vectordb storing piece)

[segfly]

I have a similar need, starting with tracking embedding API costs. Unlike the LLM/chat models, it does not appear that "langchain-provided" embedding models are integrated yet with langsmith (or maybe modules like langchain_openai are 3rd party maintained, and the maintainer hasn't done it yet - I don't know). I've been scouring the docs but can't find any mention of tracing embedding calls and it doesn't show up in langsmith traces out of the box.

It appears one has to annotate your own runnable/graphs to provide the metadata you wish (like tokens) and then add to langsmith settings your provider/model cost.

The tracing facility seems quite flexible. You can add traces to anything you wish and abuse the langsmith custom model to represent any kind of transaction costs (DB calls, API calls, embedding tokens, etc.).