CCDAK · Question #40
You are doing complex calculations using a machine learning framework on records fetched from a Kafka topic. It takes more about 6 minutes to process a record batch, and the consumer enters…
The correct answer is A. Increase max.poll.interval.ms to 600000. Here, we need to change the setting max.poll.interval.ms (default 300000) to its double in order to tell Kafka a consumer should be considered dead if the consumer only if it hasn't called the .poll() method in 10 minutes instead of 5.
Question
You are doing complex calculations using a machine learning framework on records fetched from a Kafka topic. It takes more about 6 minutes to process a record batch, and the consumer enters rebalances even though it's still running. How can you improve this scenario?
Options
- AIncrease max.poll.interval.ms to 600000
- BIncrease heartbeat.interval.ms to 600000
- CIncrease session.timeout.ms to 600000
- DAdd consumers to the consumer group and kill them right away
How the community answered
(29 responses)- A79% (23)
- B3% (1)
- C10% (3)
- D7% (2)
Explanation
Here, we need to change the setting max.poll.interval.ms (default 300000) to its double in order to tell Kafka a consumer should be considered dead if the consumer only if it hasn't called the .poll() method in 10 minutes instead of 5.
Topics
Community Discussion
No community discussion yet for this question.