Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LLM Token Consumption Metric #85138

Open
lambda-science opened this issue Feb 13, 2025 · 5 comments
Open

LLM Token Consumption Metric #85138

lambda-science opened this issue Feb 13, 2025 · 5 comments

Comments

@lambda-science
Copy link

Environment

SaaS (https://sentry.io/)

Steps to Reproduce

#83185
Re-opening this issue because I'm getting annoyed.

We've been told to wait for the new update, waited more than one month to finally have the feature deployed about AI token alerts deployed and we are back to the original error message.
I followed exactly this blog post,
https://blog.sentry.io/find-and-fix-performance-bottlenecks-with-sentrys-trace-explorer/
Clicked traces -> aggreagtes -> save as -> alert -> same error as 1.5 month ago.

Image

Expected Result

.

Actual Result

.

Product Area

Alerts

Link

No response

DSN

No response

Version

No response

@getsantry
Copy link
Contributor

getsantry bot commented Feb 13, 2025

Assigning to @getsentry/support for routing ⏲️

@lambda-science
Copy link
Author

lambda-science commented Feb 13, 2025

2 month ago it showed "Custom Measurement" instead of "Span" at the top but the error is the same.

Image

@getsantry
Copy link
Contributor

getsantry bot commented Feb 14, 2025

Routing to @getsentry/product-owners-alerts for triage ⏲️

@getsantry getsantry bot moved this from Waiting for: Support to Waiting for: Product Owner in GitHub Issues with 👀 3 Feb 14, 2025
@ceorourke
Copy link
Member

cc @colin-sentry and @shruthilayaj

@Dhrumil-Sentry
Copy link

Followed up with the user on Discord - The new Span Metrics solution should let him create such an alert, we had a bug that Shruthi fixed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: No status
Development

No branches or pull requests

4 participants