Hello,
I initially started Zeebe with 1 node, 1 partition, and 1 replica.
Now I would like to scale it to 3. Unfortunately, partitioning and replication are not working.
Before redeploying Zeebe, I first deleted the following two directories from my Zeebe node.
However, I don’t have the permissions to delete the PVC from the Kubernetes cluster.
rm -rf /usr/local/zebe/data
rm -rf /tmp/hsperfdata_camunda
Unfortunately, only one node is marked as ready.
NAME READY STATUS RESTARTS AGE
camunda-platform-elasticsearch-master-0 1/1 Running 0 6d23h
camunda-platform-elasticsearch-master-1 1/1 Running 0 6d23h
camunda-platform-elasticsearch-master-2 1/1 Running 0 6d23h
camunda-platform-zeebe-0 1/1 Running 0 28h
camunda-platform-zeebe-1 0/1 Running 0 28h
camunda-platform-zeebe-2 0/1 Running 0 28h
camunda-platform-zeebe-gateway-f5bc569f6-gcr2c 1/1 Running 0 47h
camunda-platform-zeebe-gateway-f5bc569f6-hctjn 1/1 Running 0 47h
[...]
kubectl describe pod camunda-platform-zeebe-1
Name: camunda-platform-zeebe-1
Namespace: gedechets-test
Priority: 0
Service Account: camunda-platform-zeebe
Node: tz-prx-prv-noprod-01-md-3-z86bh-sb98k-7z8k7/10.252.36.82
Start Time: Wed, 18 Jun 2025 09:07:07 +0200
Labels: app=camunda-platform
app.kubernetes.io/component=zeebe-broker
app.kubernetes.io/instance=camunda-platform
app.kubernetes.io/managed-by=Helm
app.kubernetes.io/name=camunda-platform
app.kubernetes.io/part-of=camunda-platform
app.kubernetes.io/version=8.5.19
apps.kubernetes.io/pod-index=1
controller-revision-hash=camunda-platform-zeebe-86b9d459f
helm.sh/chart=camunda-platform-10.8.0
statefulset.kubernetes.io/pod-name=camunda-platform-zeebe-1
Annotations: checksum/config: 238d7f1220782bd1e27ab102f61c339e2774dbeaa7c8523e8ee456799289e496
kubernetes.io/limit-ranger: LimitRanger plugin set: cpu, memory request for container zeebe
Status: Running
SeccompProfile: RuntimeDefault
IP: 100.96.5.138
IPs:
IP: 100.96.5.138
Controlled By: StatefulSet/camunda-platform-zeebe
Containers:
zeebe:
Container ID: containerd://21f646f36f2051d1887ac4bce950d209f1b39979e08fc03bd5dbd0393ac75d3f
Image: xxx:5000/camunda/zeebe:8.5.19
Image ID: xxx:5000/camunda/zeebe@sha256:f0734db254e1b86ee7e5862ce0e230aa6ec6b4dcc1e8b7c5fcd9030cbbdc78b1
Ports: 9600/TCP, 26501/TCP, 26502/TCP
Host Ports: 0/TCP, 0/TCP, 0/TCP
SeccompProfile: RuntimeDefault
State: Running
Started: Wed, 18 Jun 2025 09:07:19 +0200
Ready: False
Restart Count: 0
Requests:
cpu: 50m
memory: 128Mi
Readiness: http-get http://:9600/actuator/health/readiness delay=30s timeout=1s period=30s #success=1 #failure=5
Environment:
LC_ALL: C.UTF-8
K8S_NAME: camunda-platform-zeebe-1 (v1:metadata.name)
K8S_SERVICE_NAME: camunda-platform-zeebe
K8S_NAMESPACE: gedechets-test (v1:metadata.namespace)
ZEEBE_BROKER_NETWORK_ADVERTISEDHOST: $(K8S_NAME).$(K8S_SERVICE_NAME)
ZEEBE_BROKER_CLUSTER_INITIALCONTACTPOINTS: $(K8S_SERVICE_NAME)-0.$(K8S_SERVICE_NAME).$(K8S_NAMESPACE).svc:26502,$(K8S_SERVICE_NAME)-1.$(K8S_SERVICE_NAME).$(K8S_NAMESPACE).svc:26502,$(K8S_SERVICE_NAME)-2.$(K8S_SERVICE_NAME).$(K8S_NAMESPACE).svc:26502
ZEEBE_LOG_LEVEL: info
ZEEBE_BROKER_GATEWAY_ENABLE: false
ZEEBE_BROKER_EXPORTERS_ELASTICSEARCH_CLASSNAME: io.camunda.zeebe.exporter.ElasticsearchExporter
ZEEBE_BROKER_EXPORTERS_ELASTICSEARCH_ARGS_URL: http://camunda-platform-elasticsearch:9200
ZEEBE_BROKER_EXPORTERS_ELASTICSEARCH_ARGS_INDEX_PREFIX: zeebe-record
ZEEBE_BROKER_CLUSTER_PARTITIONSCOUNT: 3
ZEEBE_BROKER_CLUSTER_REPLICATIONFACTOR: 3
ZEEBE_BROKER_CLUSTER_CLUSTERSIZE: 3
JAVA_TOOL_OPTIONS: -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/usr/local/zeebe/data -XX:ErrorFile=/usr/local/zeebe/data/zeebe_error%p.log -XX:+ExitOnOutOfMemoryError
K8S_POD_NAME: camunda-platform-zeebe-1 (v1:metadata.name)
ZEEBE_BROKER_DATA_SNAPSHOTPERIOD: 5m
ZEEBE_BROKER_DATA_DISK_FREESPACE_REPLICATION: 2GB
ZEEBE_BROKER_DATA_DISK_FREESPACE_PROCESSING: 3GB
Mounts:
/exporters from exporters (rw)
/tmp from tmp (rw)
/usr/local/bin/startup.sh from config (rw,path="startup.sh")
/usr/local/zeebe/config/application.yaml from config (rw,path="application.yaml")
/usr/local/zeebe/data from data (rw)
Conditions:
Type Status
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
data:
Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)
ClaimName: data-camunda-platform-zeebe-1
ReadOnly: false
config:
Type: ConfigMap (a volume populated by a ConfigMap)
Name: camunda-platform-zeebe-configuration
Optional: false
exporters:
Type: EmptyDir (a temporary directory that shares a pod's lifetime)
Medium:
SizeLimit: <unset>
tmp:
Type: EmptyDir (a temporary directory that shares a pod's lifetime)
Medium:
SizeLimit: <unset>
QoS Class: Burstable
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning Unhealthy 55s (x4724 over 28h) kubelet Readiness probe failed: HTTP probe failed with statuscode: 503
curl --location 'http://localhost:9600/actuator/health/readiness'
{
"status": "OUT_OF_SERVICE"
}
Here are the logs of camunda-platform-zeebe-1
+ export ZEEBE_BROKER_CLUSTER_NODEID=1
+ ZEEBE_BROKER_CLUSTER_NODEID=1
++ ls -A /exporters/
+ '[' '' ']'
+ echo 'No exporters available.'
No exporters available.
+ '[' false = true ']'
+ exec /usr/local/zeebe/bin/broker
Picked up JAVA_TOOL_OPTIONS: -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/usr/local/zeebe/data -XX:ErrorFile=/usr/local/zeebe/data/zeebe_error%p.log -XX:+ExitOnOutOfMemoryError
______ ______ ______ ____ ______ ____ _____ ____ _ __ ______ _____
|___ / | ____| | ____| | _ \ | ____| | _ \ | __ \ / __ \ | |/ / | ____| | __ \
/ / | |__ | |__ | |_) | | |__ | |_) | | |__) | | | | | | ' / | |__ | |__) |
/ / | __| | __| | _ < | __| | _ < | _ / | | | | | < | __| | _ /
/ /__ | |____ | |____ | |_) | | |____ | |_) | | | \ \ | |__| | | . \ | |____ | | \ \
/_____| |______| |______| |____/ |______| |____/ |_| \_\ \____/ |_|\_\ |______| |_| \_\
2025-06-18 07:07:21.460 [] [main] [] INFO
io.camunda.zeebe.broker.StandaloneBroker - Starting StandaloneBroker v8.5.19 using Java 21.0.7 with PID 7 (/usr/local/zeebe/lib/camunda-zeebe-8.5.19.jar started by camunda in /usr/local/zeebe)
2025-06-18 07:07:21.463 [] [main] [] INFO
io.camunda.zeebe.broker.StandaloneBroker - The following 1 profile is active: "broker"
2025-06-18 07:07:23.570 [] [main] [] INFO
org.springframework.validation.beanvalidation.OptionalValidatorFactoryBean - Failed to set up a Bean Validation provider: jakarta.validation.NoProviderFoundException: Unable to create a Configuration, because no Jakarta Bean Validation provider could be found. Add a provider like Hibernate Validator (RI) to your classpath.
2025-06-18 07:07:24.090 [] [main] [] INFO
org.springframework.boot.web.embedded.netty.NettyWebServer - Netty started on port 8080 (http)
2025-06-18 07:07:24.176 [] [main] [] INFO
org.springframework.boot.actuate.endpoint.web.EndpointLinksResolver - Exposing 13 endpoints beneath base path '/actuator'
2025-06-18 07:07:24.227 [] [main] [] INFO
org.springframework.validation.beanvalidation.OptionalValidatorFactoryBean - Failed to set up a Bean Validation provider: jakarta.validation.NoProviderFoundException: Unable to create a Configuration, because no Jakarta Bean Validation provider could be found. Add a provider like Hibernate Validator (RI) to your classpath.
2025-06-18 07:07:24.240 [] [main] [] INFO
org.springframework.boot.web.embedded.netty.NettyWebServer - Netty started on port 9600 (http)
2025-06-18 07:07:24.252 [] [main] [] INFO
io.camunda.zeebe.broker.StandaloneBroker - Started StandaloneBroker in 3.237 seconds (process running for 4.297)
2025-06-18 07:07:24.259 [] [main] [] WARN
io.camunda.zeebe.broker.system - No backup store is configured. Backups will not be taken
2025-06-18 07:07:24.315 [] [main] [] INFO
io.camunda.zeebe.broker.exporter - Exporter closed
2025-06-18 07:07:24.328 [] [main] [] INFO
io.camunda.zeebe.broker.system - Starting broker 1 version 8.5.19
2025-06-18 07:07:24.331 [Broker-1] [zb-actors-2] [Startup] INFO
io.camunda.zeebe.broker.system - Startup Cluster Services
2025-06-18 07:07:24.344 [] [netty-messaging-event-epoll-server-0] [] INFO
io.atomix.cluster.messaging.impl.NettyMessagingService - TCP server listening for connections on 0.0.0.0:26502
2025-06-18 07:07:24.374 [] [netty-messaging-event-epoll-server-0] [] INFO
io.atomix.cluster.messaging.impl.NettyMessagingService - Started messaging service bound to [0.0.0.0:26502], advertising camunda-platform-zeebe-1.camunda-platform-zeebe:26502, and using plaintext
2025-06-18 07:07:24.399 [] [netty-unicast-event-nio-client-0] [] INFO
io.atomix.cluster.messaging.impl.NettyUnicastService - Started plaintext unicast service bound to 0.0.0.0:26502, advertising camunda-platform-zeebe-1.camunda-platform-zeebe:26502
2025-06-18 07:07:24.401 [] [atomix-cluster-0] [] INFO
io.atomix.cluster.discovery.BootstrapDiscoveryProvider - Local node Node{id=1, address=camunda-platform-zeebe-1.camunda-platform-zeebe:26502} joined the bootstrap service
2025-06-18 07:07:24.404 [] [atomix-cluster-0] [] INFO
io.atomix.cluster.protocol.swim - Started
2025-06-18 07:07:24.405 [] [atomix-cluster-0] [] INFO
io.atomix.cluster.impl.DefaultClusterMembershipService - Started cluster membership service for member Member{id=1, address=camunda-platform-zeebe-1.camunda-platform-zeebe:26502, properties={}}
2025-06-18 07:07:24.405 [] [atomix-cluster-0] [] INFO
io.atomix.cluster.messaging.impl.DefaultClusterCommunicationService - Started
2025-06-18 07:07:24.406 [] [atomix-cluster-0] [] INFO
io.atomix.cluster.messaging.impl.DefaultClusterEventService - Started
2025-06-18 07:07:24.407 [Broker-1] [zb-actors-1] [Startup] INFO
io.camunda.zeebe.broker.system - Startup Cluster Topology Manager
2025-06-18 07:07:27.627 [] [atomix-cluster-heartbeat-sender] [] INFO
io.atomix.cluster.protocol.swim - 1 - Member added Member{id=0, address=camunda-platform-zeebe-0.camunda-platform-zeebe:26502, properties={brokerInfo=EADJAAAABAAAAAAAAQAAAAMAAAABAAAAAAABCgAAAGNvbW1hbmRBcGk1AAAAY2FtdW5kYS1wbGF0Zm9ybS16ZWViZS0wLmNhbXVuZGEtcGxhdGZvcm0temVlYmU6MjY1MDEFAAEBAAAAAAwAAQEAAAABAAAAAAAAAAYAAAA4LjUuMTkFAAEBAAAAAQ==}}
2025-06-18 07:07:27.781 [Broker-1] [zb-actors-2] [Startup] INFO
io.camunda.zeebe.broker.system - Startup Disk Space Usage Monitor
2025-06-18 07:07:27.782 [Broker-1] [zb-actors-2] [Startup] INFO
io.camunda.zeebe.broker.system - Startup Health Monitor
2025-06-18 07:07:27.783 [Broker-1] [zb-actors-2] [Startup] INFO
io.camunda.zeebe.broker.system - Startup API Messaging Service
2025-06-18 07:07:27.786 [] [netty-messaging-event-epoll-server-0] [] INFO
io.atomix.cluster.messaging.impl.NettyMessagingService - TCP server listening for connections on 0.0.0.0:26501
2025-06-18 07:07:27.787 [] [netty-messaging-event-epoll-server-0] [] INFO
io.atomix.cluster.messaging.impl.NettyMessagingService - Started messaging service bound to [0.0.0.0:26501], advertising camunda-platform-zeebe-1.camunda-platform-zeebe:26501, and using plaintext
2025-06-18 07:07:27.788 [Broker-1] [zb-actors-2] [Startup] INFO
io.camunda.zeebe.broker.system - Startup Broker Transport
2025-06-18 07:07:27.791 [Broker-1] [zb-actors-2] [Startup] INFO
io.camunda.zeebe.broker.system - Startup Command API
2025-06-18 07:07:27.803 [Broker-1] [zb-actors-0] [Startup] INFO
io.camunda.zeebe.broker.system - Startup JobStreamService
2025-06-18 07:07:27.825 [Broker-1] [zb-actors-0] [Startup] INFO
io.camunda.zeebe.broker.system - Startup Partition Manager
2025-06-18 07:07:27.887 [Broker-1] [zb-actors-0] [Startup] INFO
io.camunda.zeebe.broker.system - Startup Broker Admin Interface
2025-06-18 07:07:29.672 [] [atomix-cluster-heartbeat-sender] [] INFO
io.atomix.cluster.protocol.swim - 1 - Member added Member{id=2, address=camunda-platform-zeebe-2.camunda-platform-zeebe:26502, properties={brokerInfo=EADJAAAABAACAAAAAQAAAAMAAAABAAAAAAABCgAAAGNvbW1hbmRBcGk1AAAAY2FtdW5kYS1wbGF0Zm9ybS16ZWViZS0yLmNhbXVuZGEtcGxhdGZvcm0temVlYmU6MjY1MDEFAAAMAAAGAAAAOC41LjE5BQAA}}
2025-06-18 07:07:34.414 [] [atomix-cluster-heartbeat-sender] [] INFO
io.atomix.cluster.protocol.swim - 1 - Member added Member{id=camunda-platform-zeebe-gateway-f5bc569f6-hctjn, address=100.96.5.113:26502, properties={event-service-topics-subscribed=KIIDAGpvYnNBdmFpbGFibOU=}}
2025-06-18 07:07:34.418 [] [atomix-cluster-heartbeat-sender] [] INFO
io.atomix.cluster.protocol.swim - 1 - Member added Member{id=camunda-platform-zeebe-gateway-f5bc569f6-gcr2c, address=100.96.2.39:26502, properties={event-service-topics-subscribed=KIIDAGpvYnNBdmFpbGFibOU=}}
Here is configuration file of camunda-platform-zeebe-1:
camunda@camunda-platform-zeebe-1:~$ cat /usr/local/zeebe/config/application.yaml
zeebe:
broker:
exporters:
elasticsearch:
className: "io.camunda.zeebe.exporter.ElasticsearchExporter"
args:
url: "http://camunda-platform-elasticsearch:9200"
index:
prefix: "zeebe-record"
retention:
enabled: true
minimumAge: "7d"
policyName: "zeebe-record-retention-policy"
gateway:
enable: true
network:
port: 26500
security:
enabled: false
authentication:
mode: none
network:
host: 0.0.0.0
commandApi:
port: 26501
internalApi:
port: 26502
monitoringApi:
port: "9600"
cluster:
clusterSize: "3"
replicationFactor: "3"
partitionsCount: "3"
clusterName: camunda-platform-zeebe
threads:
cpuThreadCount: "3"
ioThreadCount: "3"
Here are the env variables of camunda-platform-zeebe-1
camunda@camunda-platform-zeebe-1:~$ env
CAMUNDA_PLATFORM_ZEEBE_GATEWAY_PORT_8080_TCP=tcp://100.64.218.2:8080
GEDECHETS_PORT_80_TCP_PROTO=tcp
KUBERNETES_SERVICE_PORT_HTTPS=443
CAMUNDA_PLATFORM_OPERATE_PORT_80_TCP_ADDR=100.71.54.163
CAMUNDA_PLATFORM_ZEEBE_GATEWAY_SERVICE_HOST=100.64.218.2
ZEEBE_LOG_LEVEL=info
KUBERNETES_SERVICE_PORT=443
CAMUNDA_PLATFORM_ZEEBE_GATEWAY_SERVICE_PORT_REST=8080
CAMUNDA_PLATFORM_OPERATE_SERVICE_PORT_HTTP=80
CAMUNDA_PLATFORM_ZEEBE_GATEWAY_SERVICE_PORT_GATEWAY_BIS=80
HOSTNAME=camunda-platform-zeebe-1
ZEEBE_BROKER_NETWORK_ADVERTISEDHOST=camunda-platform-zeebe-1.camunda-platform-zeebe
CAMUNDA_PLATFORM_ELASTICSEARCH_SERVICE_PORT_TCP_TRANSPORT=9300
KEYCLOAK_PORT=tcp://100.67.210.225:80
ZEEBE_BROKER_GATEWAY_ENABLE=false
JAVA_HOME=/opt/java/openjdk
CAMUNDA_PLATFORM_ZEEBE_GATEWAY_PORT_8080_TCP_PROTO=tcp
ZEEBE_BROKER_EXPORTERS_ELASTICSEARCH_CLASSNAME=io.camunda.zeebe.exporter.ElasticsearchExporter
GEDECHETS_PORT=tcp://100.66.140.119:80
CAMUNDA_PLATFORM_ZEEBE_GATEWAY_PORT_26500_TCP_PORT=26500
GEDECHETS_PORT_80_TCP_PORT=80
KEYCLOAK_PORT_80_TCP=tcp://100.67.210.225:80
FRONTEND_PORT_80_TCP_PROTO=tcp
CAMUNDA_PLATFORM_ZEEBE_GATEWAY_PORT_80_TCP_ADDR=100.64.218.2
KEYCLOAK_PORT_80_TCP_ADDR=100.67.210.225
CAMUNDA_PLATFORM_ELASTICSEARCH_SERVICE_HOST=100.69.51.140
CAMUNDA_PLATFORM_OPERATE_SERVICE_HOST=100.71.54.163
PWD=/usr/local/zeebe
CAMUNDA_PLATFORM_ELASTICSEARCH_SERVICE_PORT_TCP_REST_API=9200
ZEEBE_BROKER_CLUSTER_INITIALCONTACTPOINTS=camunda-platform-zeebe-0.camunda-platform-zeebe.gedechets-test.svc:26502,camunda-platform-zeebe-1.camunda-platform-zeebe.gedechets-test.svc:26502,camunda-platform-zeebe-2.camunda-platform-zeebe.gedechets-test.svc:26502
CAMUNDA_PLATFORM_ZEEBE_GATEWAY_PORT_80_TCP_PORT=80
CAMUNDA_PLATFORM_ZEEBE_GATEWAY_PORT_80_TCP_PROTO=tcp
CAMUNDA_PLATFORM_ZEEBE_GATEWAY_PORT_9600_TCP_PORT=9600
ROCKSDB_MUSL_LIBC=false
GEDECHETS_PORT_80_TCP_ADDR=100.66.140.119
K8S_NAMESPACE=gedechets-test
ZEEBE_BROKER_DATA_DISK_FREESPACE_PROCESSING=3GB
K8S_SERVICE_NAME=camunda-platform-zeebe
CAMUNDA_PLATFORM_ZEEBE_GATEWAY_SERVICE_PORT_HTTP=9600
HOME=/usr/local/zeebe
KEYCLOAK_PORT_80_TCP_PROTO=tcp
LANG=C.UTF-8
KUBERNETES_PORT_443_TCP=tcp://100.64.0.1:443
KEYCLOAK_SERVICE_HOST=100.67.210.225
FRONTEND_SERVICE_PORT=80
CAMUNDA_PLATFORM_ZEEBE_GATEWAY_PORT=tcp://100.64.218.2:9600
ZEEBE_BROKER_EXPORTERS_ELASTICSEARCH_ARGS_INDEX_PREFIX=zeebe-record
CAMUNDA_PLATFORM_ELASTICSEARCH_PORT_9200_TCP_PROTO=tcp
CAMUNDA_PLATFORM_ZEEBE_GATEWAY_PORT_26500_TCP=tcp://100.64.218.2:26500
CAMUNDA_PLATFORM_ELASTICSEARCH_PORT_9300_TCP_PORT=9300
CAMUNDA_PLATFORM_ZEEBE_GATEWAY_PORT_9600_TCP=tcp://100.64.218.2:9600
K8S_NAME=camunda-platform-zeebe-1
K8S_POD_NAME=camunda-platform-zeebe-1
CAMUNDA_PLATFORM_ZEEBE_GATEWAY_SERVICE_PORT_GATEWAY=26500
CAMUNDA_PLATFORM_OPERATE_PORT_80_TCP_PROTO=tcp
CAMUNDA_PLATFORM_OPERATE_PORT=tcp://100.71.54.163:80
FRONTEND_PORT_80_TCP_PORT=80
CAMUNDA_PLATFORM_ZEEBE_GATEWAY_PORT_9600_TCP_ADDR=100.64.218.2
ZEEBE_STANDALONE_GATEWAY=false
CAMUNDA_PLATFORM_ZEEBE_GATEWAY_PORT_8080_TCP_PORT=8080
GEDECHETS_SERVICE_PORT=80
ZEEBE_BROKER_CLUSTER_PARTITIONSCOUNT=3
ZEEBE_BROKER_CLUSTER_CLUSTERSIZE=3
CAMUNDA_PLATFORM_ZEEBE_GATEWAY_PORT_26500_TCP_PROTO=tcp
CAMUNDA_PLATFORM_OPERATE_PORT_80_TCP_PORT=80
CAMUNDA_PLATFORM_ELASTICSEARCH_SERVICE_PORT=9200
TERM=xterm
FRONTEND_PORT_80_TCP=tcp://100.70.161.230:80
CAMUNDA_PLATFORM_ELASTICSEARCH_PORT_9300_TCP=tcp://100.69.51.140:9300
ZEEBE_RESTORE=false
CAMUNDA_PLATFORM_ZEEBE_GATEWAY_PORT_26500_TCP_ADDR=100.64.218.2
ZEEBE_BROKER_CLUSTER_REPLICATIONFACTOR=3
JAVA_TOOL_OPTIONS=-XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/usr/local/zeebe/data -XX:ErrorFile=/usr/local/zeebe/data/zeebe_error%p.log -XX:+ExitOnOutOfMemoryError
CAMUNDA_PLATFORM_ELASTICSEARCH_PORT_9200_TCP_ADDR=100.69.51.140
CAMUNDA_PLATFORM_ZEEBE_GATEWAY_PORT_8080_TCP_ADDR=100.64.218.2
SHLVL=1
FRONTEND_PORT_80_TCP_ADDR=100.70.161.230
ZEEBE_BROKER_DATA_DISK_FREESPACE_REPLICATION=2GB
KUBERNETES_PORT_443_TCP_PROTO=tcp
KEYCLOAK_SERVICE_PORT=80
CAMUNDA_PLATFORM_ELASTICSEARCH_PORT_9200_TCP=tcp://100.69.51.140:9200
KUBERNETES_PORT_443_TCP_ADDR=100.64.0.1
CAMUNDA_PLATFORM_ELASTICSEARCH_PORT_9300_TCP_PROTO=tcp
ZB_HOME=/usr/local/zeebe
CAMUNDA_PLATFORM_ZEEBE_GATEWAY_PORT_80_TCP=tcp://100.64.218.2:80
KUBERNETES_SERVICE_HOST=100.64.0.1
LC_ALL=C.UTF-8
KUBERNETES_PORT=tcp://100.64.0.1:443
KUBERNETES_PORT_443_TCP_PORT=443
ZEEBE_BROKER_DATA_SNAPSHOTPERIOD=5m
ZEEBE_BROKER_EXPORTERS_ELASTICSEARCH_ARGS_URL=http://camunda-platform-elasticsearch:9200
CAMUNDA_PLATFORM_ZEEBE_GATEWAY_PORT_9600_TCP_PROTO=tcp
CAMUNDA_PLATFORM_ELASTICSEARCH_PORT_9300_TCP_ADDR=100.69.51.140
GEDECHETS_SERVICE_HOST=100.66.140.119
GEDECHETS_PORT_80_TCP=tcp://100.66.140.119:80
CAMUNDA_PLATFORM_ELASTICSEARCH_PORT_9200_TCP_PORT=9200
PATH=/usr/local/zeebe/bin:/opt/java/openjdk/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
ZEEBE_BROKER_GATEWAY_NETWORK_HOST=0.0.0.0
FRONTEND_SERVICE_HOST=100.70.161.230
CAMUNDA_PLATFORM_OPERATE_PORT_80_TCP=tcp://100.71.54.163:80
KEYCLOAK_PORT_80_TCP_PORT=80
CAMUNDA_PLATFORM_OPERATE_SERVICE_PORT=80
CAMUNDA_PLATFORM_ELASTICSEARCH_PORT=tcp://100.69.51.140:9200
FRONTEND_PORT=tcp://100.70.161.230:80
CAMUNDA_PLATFORM_ZEEBE_GATEWAY_SERVICE_PORT=9600
_=/usr/bin/env
Here is the topology as described by the zeebe-gateway
curl --location 'http://localhost:8080/camunda/zeebe/v1/topology' --header 'Authorization: ••••••'
{
"brokers": [
{
"nodeId": 0,
"host": "camunda-platform-zeebe-0.camunda-platform-zeebe",
"port": 26501,
"version": "8.5.19"
},
{
"nodeId": 2,
"host": "camunda-platform-zeebe-2.camunda-platform-zeebe",
"port": 26501,
"version": "8.5.19"
},
{
"nodeId": 1,
"host": "camunda-platform-zeebe-1.camunda-platform-zeebe",
"port": 26501,
"version": "8.5.19"
}
],
"clusterSize": 3,
"partitionsCount": 1,
"replicationFactor": 1,
"gatewayVersion": "8.5.19"
}
Here is topology as described by the gateway
curl --location 'http://localhost:9600/camunda/zeebe/actuator/cluster'
{
"version": 3,
"brokers": [
{
"id": 1,
"state": "ACTIVE",
"version": 2,
"lastUpdatedAt": "2025-06-12T12:35:19.167112261Z",
"partitions": []
},
{
"id": 2,
"state": "ACTIVE",
"version": 2,
"lastUpdatedAt": "2025-06-12T12:35:19.202377156Z",
"partitions": []
},
{
"id": 0,
"state": "ACTIVE",
"version": 0,
"lastUpdatedAt": "0000-01-01T00:00:00Z",
"partitions": [
{
"id": 1,
"state": "ACTIVE",
"priority": 1
}
]
}
],
"lastChange": {
"id": 2,
"status": "COMPLETED",
"startedAt": "2025-06-12T12:35:19.058434922Z",
"completedAt": "2025-06-12T12:35:19.202959809Z"
}
}
And here is the call to notify the configuration modification.
curl --location 'http://localhost:9600/camunda/zeebe/actuator/cluster/brokers' --header 'Content-Type: application/json' --data '["0", "1", "2"]'
{
"changeId": 2,
"currentTopology": [
{
"id": 1,
"state": "ACTIVE",
"version": 2,
"lastUpdatedAt": "2025-06-12T12:35:19.167112261Z",
"partitions": []
},
{
"id": 2,
"state": "ACTIVE",
"version": 2,
"lastUpdatedAt": "2025-06-12T12:35:19.202377156Z",
"partitions": []
},
{
"id": 0,
"state": "ACTIVE",
"version": 0,
"lastUpdatedAt": "0000-01-01T00:00:00Z",
"partitions": [
{
"id": 1,
"state": "ACTIVE",
"priority": 1
}
]
}
],
"plannedChanges": [],
"expectedTopology": [
{
"id": 1,
"state": "ACTIVE",
"version": 2,
"lastUpdatedAt": "2025-06-12T12:35:19.167112261Z",
"partitions": []
},
{
"id": 2,
"state": "ACTIVE",
"version": 2,
"lastUpdatedAt": "2025-06-12T12:35:19.202377156Z",
"partitions": []
},
{
"id": 0,
"state": "ACTIVE",
"version": 0,
"lastUpdatedAt": "0000-01-01T00:00:00Z",
"partitions": [
{
"id": 1,
"state": "ACTIVE",
"priority": 1
}
]
}
]
}
I’m a bit stuck, thank you for your help.
JF