Camunda Community Podcast
Dynamic Scaling of Zeebe Brokers: “Christmas is coming, so I’m going to get new orders, so I’m going to scale”
The newest episode of the Camunda Community Podcast is here!
On this episode, we discuss the dynamic scaling of Zeebe clusters. Host and Senior Developer Advocate @niall is joined by Senior Software Engineer Backend, @deepthi to learn more about this new feature and how it came to be, including the technical challenges we overcame and decisions we made, as well as what’s next for scaling Zeebe.
Zeebe, the cloud-native workflow and decision engine that powers Camunda 8, has many next-generation capabilities, including a language-agnostic approach so you can build clients in any programming language, enterprise-grade resilience, and horizontal scaling via a distributed architecture. We have further improved this last one by providing the ability to dynamically scale Zeebe brokers and are committed to further enhancing this feature in the future.
Listen to learn more about:
- How this “daisy of destiny” came to Niall’s attention
- The structure of the Zeebe team and Deepthi’s role on the Zeebe Distributed Platform Team
- What are the dynamic scaling Zeebe brokers?
- How users can dynamically add brokers
- What actually happens under the hood when dynamically scaling Zeebe
- How to scale down Zeebe
- Failover with scaling Zeebe
- What’s next for dynamic scaling
Episode Notes
For a full episode transcript and chapter markers, click here.
Learn more about Zeebe: Zeebe: Cloud-Native Workflow Engine | Camunda
Get started with Camunda 8 today:
Accounts | Sign Up - Camunda
Additional Resources:
[docs] Camunda 8 Concepts: Clusters
[docs] Zeebe Technical Concepts: Clustering
[docs] Create your cluster
[docs] Setting up a Zeebe cluster
[docs] Cluster Scaling
[github] Zeebe
[github issue] Dynamic resize of an existing Zeebe cluster
[github issue] [EPIC] Dynamic Scaling of Zeebe Cluster - Phat 1: Number of brokers
[github issue] Dynamically start and stop partitions
[blogpost] Zeebe Performance 2023 Year in Review
Visit our website.
Connect with us on LinkedIn, Facebook, Mastodon, Threads, and Bluesky.
Check out our videos on YouTube.
Tweet with us.