LangGraph latency issues and inconsistent data in LangSmith

[nacartwright]

I'm running into an interesting problem that I'm attempting to troubleshoot with LangSmith.

I have a LangGraph agent that is a customer interview. It takes evidence, sends to an API to retrieve the next question, and repeats this until the API tells the agent it has enough evidence to make a decision and end the interview.

This involves a lot of tool calls and heavy use of state management.

The problem I'm having is when you get to about 8 turns of the conversation it is very slow to respond. When I look at the LangSmith trace I can see the total latency for that turn of conversation but when you look at the details of the steps it took (including inference) the numbers don't add up.

See the screenshot: