i have set up a program to consume from a kafka topic.
it has been running fine, till ~ 25% of the messages (out of 2/3mil rows) are consumed, there would be a lot of reblance started happening.
i have tried to increase the `
and reduce the `
and to asynchronously process the messages. have tried to set up the `