1

Assume my kafka log contains messages as below.

Offset-1 = non-transactional message
Offset-2 = non-transactional message
Offset-3 = transactional message1 for transaction T1
.
.
.
offset-13 = transaction message10 for transaction T1
offset-14 = commit transaction marker
offset-15 = non-transactional message
offset-16 = transactional message1 for transaction T2
.
.
.
offest-27 = abort marker for transaction T2

With the above situation,when I try to fetch latest stable offset using librdkafka function rd_kafka_query_watermark_offsets returns offset-28.Is there any function or a workaround that returns offset-15 by filtering out aborted transaction?

Improve this question
1
Related questions
286
What determines Kafka consumer offset?
1
Kafka Consumer Read Committed
8
how to get last committed offset from read_committed Kafka Consumer
Load 6 more related questions Show fewer related questions

0

Reset to default

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.