Question about resetting offsets and the high-level consumer
We have a topic whose consumers, on startup, only need to consume from the head of the topic. They don't need to consume old messages they may have missed. We would like to use the high-level consumer,...
View ArticleQuestion about resetting offsets and the high-level consumer
Bob, The high level consumer doesn't support resetting the starting offset right now. We will look into that post 0.8 as part of the consumer redesign. Thanks, Jun -- Jun Rao
View ArticleQuestion about resetting offsets and the high-level consumer
Really? So what does the autooffset.reset=largest do ? -- Michal Haris
View ArticleQuestion about resetting offsets and the high-level consumer
Found it in archives, autooffset.reset is only used when the consumer registering first time or the last committed offset is out-of-range, so that means that we have to create direct connection to the...
View ArticleQuestion about resetting offsets and the high-level consumer
It's easy if there is only a single consumer in the group. In general, however, there could be multiple consumers in the same group. So, some kind of coordination is needed. Thanks, Jun -- Jun Rao
View ArticleQuestion about resetting offsets and the high-level consumer
Of course assuming that none of the consumers in the group are interested in the missed messages in such case. -- Michal Haris
View ArticleQuestion about resetting offsets and the high-level consumer
It's more than that. For example, what if 2 consumers want to set different offsets for the same partition? Jun -- Jun Rao
View ArticleQuestion about resetting offsets and the high-level consumer
Well, resetting could follow the partition ownership where only owned partitions can be reset by any one consumer. There's definitely a case for consumer applications that are more about observing...
View Article
