Quantcast
Viewing latest article 3
Browse Latest Browse All 4

Trade-off between topics and partitions?

Hello, According to the Kafka FAQ "How do I choose the number of partitions for a topic", clusters with more than 10K partitions are not tested. I am looking for advice on how to scale the number of partitions beyond that. My use case is to publish messages to 1 million users, each with an unique user id. Users are not always connected but a user must receive published messages in order. What is the best way to divide topics and partitions for this use case? Do I need 1 million partitions? The -- Mission mission

Viewing latest article 3
Browse Latest Browse All 4

Trending Articles