You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'm running a supported version of the application which is listed here and the feature is not present there
Is your proposal related to a problem?
Hello all,
we recently got an issue with a topic that was very big but the messages looked small. Here what we saw:
When we open the message inside the UI nothing looked fishy and we had a message size of 800bytes and header of 200bytes.
However the topic had approximately 400 000 msg and it's size was more than 400 gb.
I started a Statistics run on this topic (I can't attach a screen here) but in the key size I saw:
total 13 MB | min 36 bytes | max 36 bytes | avg 36 bytes
and for values:
total 21 MB | min 55 bytes | max 59 bytes | avg 55 bytes
can you explain what the "total size" mean in the context ?
In the end I read directly the messages in the partition file inside the broker and saw that a header was repeated thousand times in a single message. The root cause was a miss configuration in the producer but in the kafka UI nothing show duplicate header.
Describe the feature you're interested in
If a message contains multiple time the same header, even with the same value, it would be nice to print the number of time this header is present in the message. This can highlight some producing problems
Describe alternatives you've considered
No response
Version you're running
0.7.1
Additional context
No response
The text was updated successfully, but these errors were encountered:
Issue submitter TODO list
Is your proposal related to a problem?
Hello all,
we recently got an issue with a topic that was very big but the messages looked small. Here what we saw:
total 13 MB | min 36 bytes | max 36 bytes | avg 36 bytes
and for values:
total 21 MB | min 55 bytes | max 59 bytes | avg 55 bytes
can you explain what the "total size" mean in the context ?
In the end I read directly the messages in the partition file inside the broker and saw that a header was repeated thousand times in a single message. The root cause was a miss configuration in the producer but in the kafka UI nothing show duplicate header.
Describe the feature you're interested in
If a message contains multiple time the same header, even with the same value, it would be nice to print the number of time this header is present in the message. This can highlight some producing problems
Describe alternatives you've considered
No response
Version you're running
0.7.1
Additional context
No response
The text was updated successfully, but these errors were encountered: