Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

nri-kafka: expose retry counts (for worker managing its own offsets) #129

Merged
merged 3 commits into from
Feb 12, 2025

Conversation

omnibs
Copy link
Member

@omnibs omnibs commented Feb 5, 2025

We're exposing how many times a message has been retried to consumer subscription handlers.

This allows consumers to implement a dead letter queue.

We're exposing that only for consumers that manage their own offsets, because that's where we're building a DLQ rn. If more people want DLQs, we can do it for regular subscribe too.

Only for worker managing its own offsets
@omnibs omnibs force-pushed the expose-retry-counts branch from 6a43312 to f63a71b Compare February 6, 2025 22:43
@omnibs omnibs force-pushed the expose-retry-counts branch from f63a71b to 592a930 Compare February 6, 2025 22:44
@omnibs omnibs marked this pull request as ready for review February 10, 2025 14:49
@omnibs omnibs requested a review from brian-carroll February 10, 2025 14:50
@omnibs
Copy link
Member Author

omnibs commented Feb 11, 2025

@brian-carroll friendly ping, in case this slipped through, bc the GH plugin doesn't ping the team for non-monorepo PRs

@brian-carroll
Copy link
Contributor

@brian-carroll friendly ping, in case this slipped through, bc the GH plugin doesn't ping the team for non-monorepo PRs

Oops, yeah totally missed it, sorry!

@omnibs omnibs enabled auto-merge February 11, 2025 18:05
Copy link
Contributor

@brian-carroll brian-carroll left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not sure if the test timeout is a bit excessive but am approving to unblock

main = Test.run tests
main = do
-- macos runners seem to be slow and fail on several kafka integration tests
System.Environment.setEnv "NRI_TEST_TIMEOUT" "240000"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Wow this is a lot.
I thought it was just a temporary thing while you were debugging but I see it's still there.
I guess if we need it, we need it!
How long do the tests actually take?

@omnibs omnibs added this pull request to the merge queue Feb 12, 2025
Merged via the queue into trunk with commit e32af41 Feb 12, 2025
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants