Is Horizontal scaling of Zeebe brokers supported in Camunda Self Managed Cluster v8.6.9?

Camunda 8 Topics
1

Hello Everyone,

Is that Horizontal scaling of Zeebe brokers is supported in Camunda Self Managed Cluster v8.6.9?

  • Can we horizontally scale Cluster size (brokers: for example 3 brokers to 5 brokers?)
  • Can we horizontally scale Partitions?
  • Can we horizontally scale Replication factor?
2

Hi @aravindhrs - this docs page should help:

3

@nathan.loding How can we decide that how many partitions, replication factor for an cluster size? Lets say I have two camunda clusters which has cluster size as 3 (namespace: sales) and another cluster is having cluster size as 6 (namespace: finance).

  1. What is the strategy to decide the number of partitions & replication factor?
  2. Can partitions count can exceed cluster size?
  3. Do we have a method/formula to calculate the number of partitions to be created?
4

@aravindhrs - great questions, and there’s no exact formula. We do have some documentation that should help. The number of partitions depends on available resources and what throughput you’d like to achieve. The number of partitions can exceed the number of brokers.