Native environment for Langfuse tracing

[marcklingen]

Describe the feature or potential improvement

Add additional environment flag via all integrations (potentially to be set via environment variables).

First-level drop down selection to switch between environments across all product features (similar to Sentry).

Additional information

Currently managing multiple environments can be done via

• Tags on traces
• Different projects

[sfarthin]

I am curious about some of the details here.

1. Will data be segmented by environment and will there be separate user permissions per environment? Sometimes production data is sensitive and we want to keep that data hidden for most, but a lower environment will allow any developer to contribute.
2. If I use prompt management, will these prompts be different per environment? My recommendation is that the prompts are the same, but in the lower environments they are read-only. I've been working towards adopting prompt management, but worried about the scenario where switching from a development to a production environment means the prompt vanishes.

We've recently setup a separate project for staging and development. Do you see a fairly start forward path towards that and the feature envision'd here ?

[marcklingen]

Will data be segmented by environment and will there be separate user permissions per environment? Sometimes production data is sensitive and we want to keep that data hidden for most, but a lower environment will allow any developer to contribute.

Yes, we plan to add native environment support in tracing and then add role definitions that link to these environments (optionally)

If I use prompt management, will these prompts be different per environment? My recommendation is that the prompts are the same, but in the lower environments they are read-only. I've been working towards adopting prompt management, but worried about the scenario where switching from a development to a production environment means the prompt vanishes.

Yes, this is one of the motivations of adding support for environments in tracing to combine prompt management and deploy prompts across envs.

[marcklingen]

We've recently setup a separate project for staging and development. Do you see a fairly start forward path towards that and the feature envision'd here ?

I think starting today in separate projects is necessary if you need roles to align with the environments, but we plan to get to this soon

[jamesharling]

Yes, we plan to add native environment support in tracing and then add role definitions that link to these environments (optionally)

Would you envisage API keys being scoped to environments?

[marcklingen]

Good question, more narrowly scoped api keys and ui rbac roles are nice additions once native envs are available