http chunked transfer stream issue

[airedwin]

This may not be an issue with chatbot-ui but was hoping someone would have better knowledge about the /chat api doing the streaming http chunked response.
On my local dev when querying the same model, it works as expected where the chatbot's response is streamed to the client
When I deploy this to our hosting infrastructure in kubernetes, it seems like the response is buffered before it is sent back to the client

I initially thought it was a nginx issue but I have set up a local nginx to have similar configuration to our kubernetes ingress. The only different is our hosted deployed is using SSL and local is not.

Anyone have any ideas on what I can do to get this streaming chunked response to work?

Working
https://github.com/mckaywrigley/chatbot-ui/assets/21992412/b0b7e7ad-4077-4fc5-8ff6-2f6e6bc0ed09

Not working
https://github.com/mckaywrigley/chatbot-ui/assets/21992412/52795b82-1dce-4983-9eb0-b337f65c354d

I have my nginx config with proxy_buffering off