Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Kafka transactions #295

Open
JohnColeman-CTO opened this issue Jan 21, 2021 · 1 comment
Open

Kafka transactions #295

JohnColeman-CTO opened this issue Jan 21, 2021 · 1 comment

Comments

@JohnColeman-CTO
Copy link

Are transactions fully implemented?

I do not see anything in the code indicating that the feature is supported. This means that you cannot guarantee one time delivery in a consumer-producer pipeline.
@natansil
Copy link
Collaborator

Hi @JohnColeman-CTO,

Currently Greyhound does not have support for exactly-once-processing (i.e. Kafka transactions).
But we plan to introduce it in 2021.

The idea is to have an additional ExactlyOnceProcessor (which will encapsulate both a consumer and producer) alongside RecordConsumer (which provides at least once guarantees)

CC: @berman7

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@natansil @JohnColeman-CTO