Hello.
I’m trying to install Camunda Platform 8 on our small dev kubernetes cluster (2 nodes: control-plane and worker), but I met an issue, that zeebe broker by some reason doesn’t connect to the gateway.
I’m using helm command from documentation, to install the platform:
helm install camunda-platform camunda/camunda-platform --values camunda-values.yaml
camunda-values.yaml contains next config:
camunda-values.yaml
global:
identity:
auth:
# Disable Identity authentication for local development
# it will fall back to basic-auth: demo/demo as default user
enabled: false
# Disable Identity for local development
identity:
enabled: false
keycloak:
enabled: false
# Disable Optimize
optimize:
enabled: false
# Reduce resource usage for Zeebe and Zeebe-Gateway
zeebe:
clusterSize: 1
partitionCount: 1
replicationFactor: 1
pvcSize: 10Gi
resources: {}
initResources: {}
zeebe-gateway:
replicas: 1
# Enable Outbound Connectors only
connectors:
enabled: true
inbound:
mode: "disabled"
# Configure Elasticsearch to make it running for local development
elasticsearch:
# Allow no backup for single node setups
clusterHealthCheckParams: "wait_for_status=yellow&timeout=1s"
master:
replicaCount: 1
persistence:
size: 5Gi
After deployment I see that zeebe pods are Running and ready
To frontrun the questions regarding operate and tasklist - they are not ready, because not able to get partitions list from zeebe.
So, if I open log for zeebe or zeebe-gateway, then I’ll not see that they are connected with each other:
zeebe broker logs
+ export ZEEBE_BROKER_CLUSTER_NODEID=0
+ ZEEBE_BROKER_CLUSTER_NODEID=0
++ ls -A /exporters/
+ '[' '' ']'
+ echo 'No exporters available.'
+ exec /usr/local/zeebe/bin/broker
No exporters available.
Picked up JAVA_TOOL_OPTIONS: -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/usr/local/zeebe/data -XX:ErrorFile=/usr/local/zeebe/data/zeebe_error%p.log -XX:+ExitOnOutOfMemoryError
______ ______ ______ ____ ______ ____ _____ ____ _ __ ______ _____
|___ / | ____| | ____| | _ \ | ____| | _ \ | __ \ / __ \ | |/ / | ____| | __ \
/ / | |__ | |__ | |_) | | |__ | |_) | | |__) | | | | | | ' / | |__ | |__) |
/ / | __| | __| | _ < | __| | _ < | _ / | | | | | < | __| | _ /
/ /__ | |____ | |____ | |_) | | |____ | |_) | | | \ \ | |__| | | . \ | |____ | | \ \
/_____| |______| |______| |____/ |______| |____/ |_| \_\ \____/ |_|\_\ |______| |_| \_\
2024-07-09 09:15:16.629 [] [main] [] INFO
io.camunda.zeebe.broker.StandaloneBroker - Starting StandaloneBroker v8.5.4 using Java 21.0.3 with PID 7 (/usr/local/zeebe/lib/camunda-zeebe-8.5.4.jar started by camunda in /usr/local/zeebe)
2024-07-09 09:15:16.689 [] [main] [] INFO
io.camunda.zeebe.broker.StandaloneBroker - The following 1 profile is active: "broker"
2024-07-09 09:15:24.425 [] [main] [] INFO
org.springframework.boot.web.embedded.netty.NettyWebServer - Netty started on port 8080
2024-07-09 09:15:24.723 [] [main] [] INFO
org.springframework.boot.actuate.endpoint.web.EndpointLinksResolver - Exposing 13 endpoint(s) beneath base path '/actuator'
2024-07-09 09:15:24.923 [] [main] [] INFO
org.springframework.boot.web.embedded.netty.NettyWebServer - Netty started on port 9600
2024-07-09 09:15:25.004 [] [main] [] INFO
io.camunda.zeebe.broker.StandaloneBroker - Started StandaloneBroker in 9.275 seconds (process running for 11.672)
2024-07-09 09:15:25.012 [] [main] [] WARN
io.camunda.zeebe.broker.system - No backup store is configured. Backups will not be taken
2024-07-09 09:15:25.219 [] [main] [] INFO
io.camunda.zeebe.broker.system - Starting broker 0 version 8.5.4
2024-07-09 09:15:25.226 [Broker-0] [zb-actors-2] [Startup] INFO
io.camunda.zeebe.broker.system - Startup Cluster Services
2024-07-09 09:15:25.308 [] [netty-messaging-event-epoll-server-0] [] INFO
io.atomix.cluster.messaging.impl.NettyMessagingService - TCP server listening for connections on 0.0.0.0:26502
2024-07-09 09:15:25.333 [] [netty-messaging-event-epoll-server-0] [] INFO
io.atomix.cluster.messaging.impl.NettyMessagingService - Started messaging service bound to [0.0.0.0:26502], advertising camunda-platform-zeebe-0.camunda-platform-zeebe.default.svc:26502, and using plaintext
2024-07-09 09:15:25.408 [] [netty-unicast-event-nio-client-0] [] INFO
io.atomix.cluster.messaging.impl.NettyUnicastService - Started plaintext unicast service bound to 0.0.0.0:26502, advertising camunda-platform-zeebe-0.camunda-platform-zeebe.default.svc:26502
2024-07-09 09:15:25.410 [] [atomix-cluster-0] [] INFO
io.atomix.cluster.discovery.BootstrapDiscoveryProvider - Local node Node{id=0, address=camunda-platform-zeebe-0.camunda-platform-zeebe.default.svc:26502} joined the bootstrap service
2024-07-09 09:15:25.414 [] [atomix-cluster-0] [] INFO
io.atomix.cluster.protocol.swim - Started
2024-07-09 09:15:25.414 [] [atomix-cluster-0] [] INFO
io.atomix.cluster.impl.DefaultClusterMembershipService - Started cluster membership service for member Member{id=0, address=camunda-platform-zeebe-0.camunda-platform-zeebe.default.svc:26502, properties={}}
2024-07-09 09:15:25.415 [] [atomix-cluster-0] [] INFO
io.atomix.cluster.messaging.impl.DefaultClusterCommunicationService - Started
2024-07-09 09:15:25.416 [] [atomix-cluster-0] [] INFO
io.atomix.cluster.messaging.impl.DefaultClusterEventService - Started
2024-07-09 09:15:25.416 [Broker-0] [zb-actors-0] [Startup] INFO
io.camunda.zeebe.broker.system - Startup Cluster Topology Manager
2024-07-09 09:15:25.826 [Broker-0] [zb-actors-0] [Startup] INFO
io.camunda.zeebe.broker.system - Startup Disk Space Usage Monitor
2024-07-09 09:15:25.828 [Broker-0] [zb-actors-0] [Startup] INFO
io.camunda.zeebe.broker.system - Startup Health Monitor
2024-07-09 09:15:25.830 [Broker-0] [zb-actors-0] [Startup] INFO
io.camunda.zeebe.broker.system - Startup API Messaging Service
2024-07-09 09:15:25.833 [] [netty-messaging-event-epoll-server-0] [] INFO
io.atomix.cluster.messaging.impl.NettyMessagingService - TCP server listening for connections on 0.0.0.0:26501
2024-07-09 09:15:25.889 [] [netty-messaging-event-epoll-server-0] [] INFO
io.atomix.cluster.messaging.impl.NettyMessagingService - Started messaging service bound to [0.0.0.0:26501], advertising camunda-platform-zeebe-0.camunda-platform-zeebe.default.svc:26501, and using plaintext
2024-07-09 09:15:25.890 [Broker-0] [zb-actors-0] [Startup] INFO
io.camunda.zeebe.broker.system - Startup Broker Transport
2024-07-09 09:15:25.897 [Broker-0] [zb-actors-0] [Startup] INFO
io.camunda.zeebe.broker.system - Startup Command API
2024-07-09 09:15:25.909 [Broker-0] [zb-actors-0] [Startup] INFO
io.camunda.zeebe.broker.system - Startup JobStreamService
2024-07-09 09:15:25.993 [Broker-0] [zb-actors-2] [Startup] INFO
io.camunda.zeebe.broker.system - Startup Partition Manager
2024-07-09 09:15:26.035 [Broker-0] [zb-actors-2] [Startup] INFO
io.camunda.zeebe.broker.partitioning.Partition - Startup Partition Directory
2024-07-09 09:15:26.036 [Broker-0] [zb-actors-2] [Startup] INFO
io.camunda.zeebe.broker.system - Startup Broker Admin Interface
2024-07-09 09:15:26.037 [Broker-0] [zb-actors-2] [Startup] INFO
io.camunda.zeebe.broker.partitioning.Partition - Startup Snapshot Store
2024-07-09 09:15:26.094 [Broker-0] [zb-actors-2] [Startup] INFO
io.camunda.zeebe.broker.partitioning.Partition - Startup Bootstrapped Raft Partition
2024-07-09 09:15:27.025 [Broker-0] [zb-actors-2] [Startup] INFO
io.atomix.raft.partition.impl.RaftPartitionServer - RaftPartitionServer{raft-partition-partition-1} - Server bootstrapping partition PartitionId{id=1, group=raft-partition}
2024-07-09 09:15:27.034 [Broker-0] [raft-server-0-1] [raft-server-1] INFO
io.atomix.raft.impl.RaftContext - RaftServer{raft-partition-partition-1} - Transitioning to FOLLOWER
2024-07-09 09:15:27.093 [Broker-0] [raft-server-0-1] [raft-server-1] INFO
io.atomix.raft.roles.FollowerRole - RaftServer{raft-partition-partition-1}{role=FOLLOWER} - Single member cluster. Transitioning directly to candidate.
2024-07-09 09:15:27.094 [Broker-0] [raft-server-0-1] [raft-server-1] INFO
io.atomix.raft.impl.RaftContext - RaftServer{raft-partition-partition-1} - Transitioning to CANDIDATE
2024-07-09 09:15:27.098 [Broker-0] [raft-server-0-1] [raft-server-1] INFO
io.atomix.raft.roles.CandidateRole - RaftServer{raft-partition-partition-1}{role=CANDIDATE} - Single member cluster. Transitioning directly to leader.
2024-07-09 09:15:27.099 [Broker-0] [raft-server-0-1] [raft-server-1] INFO
io.atomix.raft.impl.RaftContext - RaftServer{raft-partition-partition-1} - Transitioning to LEADER
2024-07-09 09:15:27.105 [Broker-0] [raft-server-0-1] [raft-server-1] INFO
io.atomix.raft.impl.RaftContext - RaftServer{raft-partition-partition-1} - Found leader 0
2024-07-09 09:15:27.118 [Broker-0] [raft-server-0-1] [raft-server-1] INFO
io.atomix.raft.impl.RaftContext - RaftServer{raft-partition-partition-1} - Setting firstCommitIndex to 1. RaftServer is ready only after it has committed events upto this index
2024-07-09 09:15:27.118 [Broker-0] [raft-server-0-1] [raft-server-1] INFO
io.atomix.raft.impl.RaftContext - RaftServer{raft-partition-partition-1} - Commit index is 1. RaftServer is ready
2024-07-09 09:15:27.124 [Broker-0] [raft-server-0-1] [raft-server-1] INFO
io.atomix.raft.impl.DefaultRaftServer - RaftServer{raft-partition-partition-1} - Server join completed. Waiting for the server to be READY
2024-07-09 09:15:27.125 [Broker-0] [raft-server-0-1] [raft-server-1] INFO
io.atomix.raft.partition.impl.RaftPartitionServer - RaftPartitionServer{raft-partition-partition-1} - Server successfully bootstrapped partition PartitionId{id=1, group=raft-partition} in 98ms
2024-07-09 09:15:27.125 [Broker-0] [zb-actors-0] [Startup] INFO
io.camunda.zeebe.broker.partitioning.Partition - Startup Zeebe Partition
2024-07-09 09:15:27.407 [Broker-0] [zb-actors-0] [ZeebePartition-1] INFO
io.camunda.zeebe.broker.system - Startup RocksDB metric timer
2024-07-09 09:15:27.410 [Broker-0] [zb-actors-0] [Startup] INFO
io.camunda.zeebe.broker.partitioning.Partition - Startup Partition Registration
2024-07-09 09:15:27.411 [Broker-0] [zb-actors-0] [Startup] INFO
io.camunda.zeebe.broker.partitioning.PartitionManagerImpl - Started partition 1
2024-07-09 09:15:27.416 [Broker-0] [zb-actors-0] [ZeebePartition-1] INFO
io.camunda.zeebe.broker.system - Transition to LEADER on term 1 requested.
2024-07-09 09:15:27.420 [Broker-0] [zb-actors-0] [ZeebePartition-1] INFO
io.camunda.zeebe.broker.system - Transition to LEADER on term 1 starting
2024-07-09 09:15:27.421 [Broker-0] [zb-actors-0] [ZeebePartition-1] INFO
io.camunda.zeebe.broker.system - Transition to LEADER on term 1 - transitioning LogStorage
2024-07-09 09:15:27.423 [Broker-0] [zb-actors-0] [ZeebePartition-1] INFO
io.camunda.zeebe.broker.system - Transition to LEADER on term 1 - transitioning LogStream
2024-07-09 09:15:27.427 [Broker-0] [zb-actors-0] [HealthCheckService] INFO
io.camunda.zeebe.broker.system - All partitions are installed. Broker is ready!
2024-07-09 09:15:27.429 [Broker-0] [zb-actors-2] [HealthCheckService] WARN
io.camunda.zeebe.broker.system - Partition-1 failed, marking it as unhealthy: Partition-1{status=UNHEALTHY, issue=HealthIssue[message=null, throwable=null, cause=ZeebePartition-1{status=UNHEALTHY, issue=HealthIssue[message=Services not installed, throwable=null, cause=null]}]}
2024-07-09 09:15:27.429 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
io.camunda.zeebe.broker.system - Transition to LEADER on term 1 - transitioning ZeebeDb
2024-07-09 09:15:27.738 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
io.camunda.zeebe.broker.system - Transition to LEADER on term 1 - transitioning Migration
2024-07-09 09:15:28.310 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
org.camunda.feel.FeelEngine - Engine created. [value-mapper: CompositeValueMapper(List(io.camunda.zeebe.feel.impl.MessagePackValueMapper@547fc6c2)), function-provider: io.camunda.zeebe.feel.impl.FeelFunctionProvider@4d133a6b, clock: io.camunda.zeebe.engine.processing.bpmn.clock.ZeebeFeelEngineClock@1cffbe0c, configuration: {externalFunctionsEnabled: false}]
2024-07-09 09:15:28.505 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
org.camunda.dmn.DmnEngine - DMN-Engine created. [value-mapper: CompositeValueMapper(List(io.camunda.zeebe.feel.impl.MessagePackValueMapper@4bf638dc)), function-provider: org.camunda.feel.context.FunctionProvider$EmptyFunctionProvider$@1e26e57e, audit-loggers: List(), configuration: Configuration(false,false,false)]
2024-07-09 09:15:28.508 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
org.camunda.feel.FeelEngine - Engine created. [value-mapper: CompositeValueMapper(List(org.camunda.dmn.NoUnpackValueMapper@37cc2a24)), function-provider: org.camunda.feel.context.FunctionProvider$EmptyFunctionProvider$@1e26e57e, clock: SystemClock, configuration: {externalFunctionsEnabled: false}]
2024-07-09 09:15:28.604 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
org.camunda.dmn.DmnEngine - DMN-Engine created. [value-mapper: CompositeValueMapper(List(io.camunda.zeebe.feel.impl.MessagePackValueMapper@3ed64f39)), function-provider: org.camunda.feel.context.FunctionProvider$EmptyFunctionProvider$@1e26e57e, audit-loggers: List(), configuration: Configuration(false,false,false)]
2024-07-09 09:15:28.604 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
org.camunda.feel.FeelEngine - Engine created. [value-mapper: CompositeValueMapper(List(org.camunda.dmn.NoUnpackValueMapper@64fc395b)), function-provider: org.camunda.feel.context.FunctionProvider$EmptyFunctionProvider$@1e26e57e, clock: SystemClock, configuration: {externalFunctionsEnabled: false}]
2024-07-09 09:15:28.707 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
io.camunda.zeebe.engine.state.migration - Starting processing of migration tasks (use LogLevel.DEBUG for more details) ...
2024-07-09 09:15:28.710 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
io.camunda.zeebe.engine.state.migration - Skipping ProcessMessageSubscriptionSentTimeMigration migration (1/18). It was determined it does not need to run right now.
2024-07-09 09:15:28.710 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
io.camunda.zeebe.engine.state.migration - Skipping MessageSubscriptionSentTimeMigration migration (2/18). It was determined it does not need to run right now.
2024-07-09 09:15:28.710 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
io.camunda.zeebe.engine.state.migration - Skipping TemporaryVariableMigration migration (3/18). It was determined it does not need to run right now.
2024-07-09 09:15:28.711 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
io.camunda.zeebe.engine.state.migration - Skipping DecisionMigration migration (4/18). It was determined it does not need to run right now.
2024-07-09 09:15:28.711 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
io.camunda.zeebe.engine.state.migration - Skipping DecisionRequirementsMigration migration (5/18). It was determined it does not need to run right now.
2024-07-09 09:15:28.711 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
io.camunda.zeebe.engine.state.migration - Starting ProcessInstanceByProcessDefinitionMigration migration (6/18)
2024-07-09 09:15:28.712 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
io.camunda.zeebe.engine.state.migration - Finished ProcessInstanceByProcessDefinitionMigration migration (6/18)
2024-07-09 09:15:28.712 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
io.camunda.zeebe.engine.state.migration - Starting JobTimeoutCleanupMigration migration (7/18)
2024-07-09 09:15:28.713 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
io.camunda.zeebe.engine.state.migration - Finished JobTimeoutCleanupMigration migration (7/18)
2024-07-09 09:15:28.713 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
io.camunda.zeebe.engine.state.migration - Starting JobBackoffCleanupMigration migration (8/18)
2024-07-09 09:15:28.713 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
io.camunda.zeebe.engine.state.migration - Finished JobBackoffCleanupMigration migration (8/18)
2024-07-09 09:15:28.714 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
io.camunda.zeebe.engine.state.migration - Skipping MultiTenancyProcessStateMigration migration (9/18). It was determined it does not need to run right now.
2024-07-09 09:15:28.714 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
io.camunda.zeebe.engine.state.migration - Skipping MultiTenancyDecisionStateMigration migration (10/18). It was determined it does not need to run right now.
2024-07-09 09:15:28.714 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
io.camunda.zeebe.engine.state.migration - Skipping MultiTenancyMessageStateMigration migration (11/18). It was determined it does not need to run right now.
2024-07-09 09:15:28.714 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
io.camunda.zeebe.engine.state.migration - Skipping MultiTenancyMessageStartEventSubscriptionStateMigration migration (12/18). It was determined it does not need to run right now.
2024-07-09 09:15:28.715 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
io.camunda.zeebe.engine.state.migration - Skipping MultiTenancyMessageSubscriptionStateMigration migration (13/18). It was determined it does not need to run right now.
2024-07-09 09:15:28.715 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
io.camunda.zeebe.engine.state.migration - Skipping MultiTenancyProcessMessageSubscriptionStateMigration migration (14/18). It was determined it does not need to run right now.
2024-07-09 09:15:28.715 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
io.camunda.zeebe.engine.state.migration - Skipping MultiTenancyJobStateMigration migration (15/18). It was determined it does not need to run right now.
2024-07-09 09:15:28.715 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
io.camunda.zeebe.engine.state.migration - Starting ColumnFamilyPrefixCorrectionMigration migration (16/18)
2024-07-09 09:15:28.717 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
io.camunda.zeebe.engine.state.migration - Finished ColumnFamilyPrefixCorrectionMigration migration (16/18)
2024-07-09 09:15:28.717 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
io.camunda.zeebe.engine.state.migration - Skipping MultiTenancySignalSubscriptionStateMigration migration (17/18). It was determined it does not need to run right now.
2024-07-09 09:15:28.717 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
io.camunda.zeebe.engine.state.migration - Starting JobBackoffRestoreMigration migration (18/18)
2024-07-09 09:15:28.719 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
io.camunda.zeebe.engine.state.migration - Finished JobBackoffRestoreMigration migration (18/18)
2024-07-09 09:15:28.720 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
io.camunda.zeebe.engine.state.migration - Completed processing of migration tasks (use LogLevel.DEBUG for more details) ...
2024-07-09 09:15:28.720 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
io.camunda.zeebe.broker.system - Transition to LEADER on term 1 - transitioning QueryService
2024-07-09 09:15:28.721 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
io.camunda.zeebe.broker.system - Transition to LEADER on term 1 - transitioning BackupStore
2024-07-09 09:15:28.722 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
io.camunda.zeebe.broker.system - Transition to LEADER on term 1 - transitioning BackupManager
2024-07-09 09:15:28.724 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
io.camunda.zeebe.broker.system - Transition to LEADER on term 1 - transitioning InterPartitionCommandService
2024-07-09 09:15:28.803 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
io.camunda.zeebe.broker.system - Transition to LEADER on term 1 - transitioning StreamProcessor
2024-07-09 09:15:28.913 [Broker-0] [zb-actors-1] [StreamProcessor-1] INFO
io.camunda.zeebe.logstreams - Recovered state of partition 1 from snapshot at position -1
2024-07-09 09:15:28.923 [Broker-0] [zb-actors-1] [StreamProcessor-1] INFO
org.camunda.feel.FeelEngine - Engine created. [value-mapper: CompositeValueMapper(List(io.camunda.zeebe.feel.impl.MessagePackValueMapper@7a96d662)), function-provider: io.camunda.zeebe.feel.impl.FeelFunctionProvider@38af6bc6, clock: io.camunda.zeebe.engine.processing.bpmn.clock.ZeebeFeelEngineClock@396ef0e1, configuration: {externalFunctionsEnabled: false}]
2024-07-09 09:15:28.924 [Broker-0] [zb-actors-1] [StreamProcessor-1] INFO
org.camunda.dmn.DmnEngine - DMN-Engine created. [value-mapper: CompositeValueMapper(List(io.camunda.zeebe.feel.impl.MessagePackValueMapper@6b1215d0)), function-provider: org.camunda.feel.context.FunctionProvider$EmptyFunctionProvider$@1e26e57e, audit-loggers: List(), configuration: Configuration(false,false,false)]
2024-07-09 09:15:28.924 [Broker-0] [zb-actors-1] [StreamProcessor-1] INFO
org.camunda.feel.FeelEngine - Engine created. [value-mapper: CompositeValueMapper(List(org.camunda.dmn.NoUnpackValueMapper@14f75459)), function-provider: org.camunda.feel.context.FunctionProvider$EmptyFunctionProvider$@1e26e57e, clock: SystemClock, configuration: {externalFunctionsEnabled: false}]
2024-07-09 09:15:28.925 [Broker-0] [zb-actors-1] [StreamProcessor-1] INFO
org.camunda.dmn.DmnEngine - DMN-Engine created. [value-mapper: CompositeValueMapper(List(io.camunda.zeebe.feel.impl.MessagePackValueMapper@695e89ff)), function-provider: org.camunda.feel.context.FunctionProvider$EmptyFunctionProvider$@1e26e57e, audit-loggers: List(), configuration: Configuration(false,false,false)]
2024-07-09 09:15:28.926 [Broker-0] [zb-actors-1] [StreamProcessor-1] INFO
org.camunda.feel.FeelEngine - Engine created. [value-mapper: CompositeValueMapper(List(org.camunda.dmn.NoUnpackValueMapper@2eac0084)), function-provider: org.camunda.feel.context.FunctionProvider$EmptyFunctionProvider$@1e26e57e, clock: SystemClock, configuration: {externalFunctionsEnabled: false}]
2024-07-09 09:15:29.025 [Broker-0] [zb-actors-1] [StreamProcessor-1] INFO
org.camunda.dmn.DmnEngine - DMN-Engine created. [value-mapper: CompositeValueMapper(List(io.camunda.zeebe.feel.impl.MessagePackValueMapper@26fa43ff)), function-provider: org.camunda.feel.context.FunctionProvider$EmptyFunctionProvider$@1e26e57e, audit-loggers: List(), configuration: Configuration(false,false,false)]
2024-07-09 09:15:29.026 [Broker-0] [zb-actors-1] [StreamProcessor-1] INFO
org.camunda.feel.FeelEngine - Engine created. [value-mapper: CompositeValueMapper(List(org.camunda.dmn.NoUnpackValueMapper@24dca223)), function-provider: org.camunda.feel.context.FunctionProvider$EmptyFunctionProvider$@1e26e57e, clock: SystemClock, configuration: {externalFunctionsEnabled: false}]
2024-07-09 09:15:29.029 [Broker-0] [zb-actors-1] [StreamProcessor-1] INFO
org.camunda.feel.FeelEngine - Engine created. [value-mapper: CompositeValueMapper(List(io.camunda.zeebe.feel.impl.MessagePackValueMapper@592ea768)), function-provider: io.camunda.zeebe.feel.impl.FeelFunctionProvider@27767e2a, clock: io.camunda.zeebe.engine.processing.bpmn.clock.ZeebeFeelEngineClock@22b5d365, configuration: {externalFunctionsEnabled: false}]
2024-07-09 09:15:29.109 [Broker-0] [zb-actors-1] [StreamProcessor-1] INFO
org.camunda.feel.FeelEngine - Engine created. [value-mapper: CompositeValueMapper(List(io.camunda.zeebe.feel.impl.MessagePackValueMapper@6884ce96)), function-provider: io.camunda.zeebe.feel.impl.FeelFunctionProvider@51cb9170, clock: io.camunda.zeebe.engine.processing.bpmn.clock.ZeebeFeelEngineClock@579231c7, configuration: {externalFunctionsEnabled: false}]
2024-07-09 09:15:29.110 [Broker-0] [zb-actors-1] [StreamProcessor-1] INFO
org.camunda.feel.FeelEngine - Engine created. [value-mapper: CompositeValueMapper(List(io.camunda.zeebe.feel.impl.MessagePackValueMapper@254a87ba)), function-provider: io.camunda.zeebe.feel.impl.FeelFunctionProvider@309331c2, clock: io.camunda.zeebe.engine.processing.bpmn.clock.ZeebeFeelEngineClock@33f12ee6, configuration: {externalFunctionsEnabled: false}]
2024-07-09 09:15:29.199 [Broker-0] [zb-actors-1] [StreamProcessor-1] INFO
org.camunda.dmn.DmnEngine - DMN-Engine created. [value-mapper: CompositeValueMapper(List(io.camunda.zeebe.feel.impl.MessagePackValueMapper@e7adff)), function-provider: org.camunda.feel.context.FunctionProvider$EmptyFunctionProvider$@1e26e57e, audit-loggers: List(), configuration: Configuration(false,false,false)]
2024-07-09 09:15:29.199 [Broker-0] [zb-actors-1] [StreamProcessor-1] INFO
org.camunda.feel.FeelEngine - Engine created. [value-mapper: CompositeValueMapper(List(org.camunda.dmn.NoUnpackValueMapper@3779e084)), function-provider: org.camunda.feel.context.FunctionProvider$EmptyFunctionProvider$@1e26e57e, clock: SystemClock, configuration: {externalFunctionsEnabled: false}]
2024-07-09 09:15:29.316 [Broker-0] [zb-actors-1] [StreamProcessor-1] INFO
io.camunda.zeebe.processor - Processor starts replay of events. [snapshot-position: -1, replay-mode: PROCESSING]
2024-07-09 09:15:29.318 [Broker-0] [zb-actors-1] [StreamProcessor-1] INFO
io.camunda.zeebe.processor - Processor finished replay, with [lastProcessedPosition: -1, lastWrittenPosition: -1]
2024-07-09 09:15:29.320 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
io.camunda.zeebe.broker.system - Transition to LEADER on term 1 - transitioning SnapshotDirector
2024-07-09 09:15:29.323 [Broker-0] [zb-actors-1] [ZeebePartition-1] INFO
io.camunda.zeebe.broker.system - Transition to LEADER on term 1 - transitioning ExporterDirector
2024-07-09 09:15:29.336 [Broker-0] [zb-actors-0] [ZeebePartition-1] INFO
io.camunda.zeebe.broker.system - Transition to LEADER on term 1 - transitioning BackupApiRequestHandler
2024-07-09 09:15:29.394 [Broker-0] [zb-actors-0] [ZeebePartition-1] INFO
io.camunda.zeebe.broker.system - Transition to LEADER on term 1 - transitioning Admin API
2024-07-09 09:15:29.397 [Broker-0] [zb-actors-0] [ZeebePartition-1] INFO
io.camunda.zeebe.broker.system - Transition to LEADER on term 1 completed
2024-07-09 09:15:29.409 [Broker-0] [zb-actors-0] [ZeebePartition-1] INFO
io.camunda.zeebe.broker.system - ZeebePartition-1 recovered, marking it as healthy
2024-07-09 09:15:29.410 [Broker-0] [zb-actors-0] [HealthCheckService] INFO
io.camunda.zeebe.broker.system - Partition-1 recovered, marking it as healthy
2024-07-09 09:15:29.696 [Broker-0] [zb-fs-workers-0] [Exporter-1] INFO
io.camunda.zeebe.broker.exporter.elasticsearch - Exporter opened
zeebe gateway logs
+ hostname -i
+ HOST=192.168.153.8
+ [ true = true ]
+ export ZEEBE_GATEWAY_NETWORK_HOST=0.0.0.0
+ export ZEEBE_GATEWAY_CLUSTER_HOST=192.168.153.8
+ exec /usr/local/zeebe/bin/gateway
Picked up JAVA_TOOL_OPTIONS: -XX:+ExitOnOutOfMemoryError
______ ______ ______ ____ ______ _____ _______ ______ __ __ __ __
|___ / | ____| | ____| | _ \ | ____| / ____| /\ |__ __| | ____| \ \ / / /\ \ \ / /
/ / | |__ | |__ | |_) | | |__ | | __ / \ | | | |__ \ \ /\ / / / \ \ \_/ /
/ / | __| | __| | _ < | __| | | |_ | / /\ \ | | | __| \ \/ \/ / / /\ \ \ /
/ /__ | |____ | |____ | |_) | | |____ | |__| | / ____ \ | | | |____ \ /\ / / ____ \ | |
/_____| |______| |______| |____/ |______| \_____| /_/ \_\ |_| |______| \/ \/ /_/ \_\ |_|
2024-07-09 09:14:00.396 [] [main] [] INFO
io.camunda.zeebe.gateway.StandaloneGateway - Starting StandaloneGateway v8.5.4 using Java 21.0.3 with PID 7 (/usr/local/zeebe/lib/camunda-zeebe-8.5.4.jar started by camunda in /usr/local/zeebe)
2024-07-09 09:14:00.399 [] [main] [] INFO
io.camunda.zeebe.gateway.StandaloneGateway - The following 1 profile is active: "gateway"
2024-07-09 09:14:19.490 [] [main] [] INFO
org.springframework.boot.web.embedded.netty.NettyWebServer - Netty started on port 8080
2024-07-09 09:14:19.996 [] [main] [] INFO
org.springframework.boot.actuate.endpoint.web.EndpointLinksResolver - Exposing 12 endpoint(s) beneath base path '/actuator'
2024-07-09 09:14:20.494 [] [main] [] INFO
org.springframework.boot.web.embedded.netty.NettyWebServer - Netty started on port 9600
2024-07-09 09:14:20.693 [] [main] [] INFO
io.camunda.zeebe.gateway.StandaloneGateway - Started StandaloneGateway in 22.51 seconds (process running for 29.392)
2024-07-09 09:14:20.701 [] [main] [] INFO
io.camunda.zeebe.gateway - Starting standalone gateway camunda-platform-zeebe-gateway-7557b5b5f6-9ldnn with version 8.5.4
2024-07-09 09:14:20.800 [] [netty-messaging-event-epoll-server-0] [] INFO
io.atomix.cluster.messaging.impl.NettyMessagingService - TCP server listening for connections on 192.168.153.8:26502
2024-07-09 09:14:20.999 [] [main] [] INFO
io.atomix.cluster.messaging.impl.NettyMessagingService - Started messaging service bound to [192.168.153.8:26502], advertising 192.168.153.8:26502, and using plaintext
2024-07-09 09:14:21.289 [] [netty-unicast-event-nio-client-0] [] INFO
io.atomix.cluster.messaging.impl.NettyUnicastService - Started plaintext unicast service bound to 0.0.0.0:26502, advertising 192.168.153.8:26502
2024-07-09 09:14:21.292 [] [atomix-cluster-0] [] INFO
io.atomix.cluster.discovery.BootstrapDiscoveryProvider - Local node Node{id=camunda-platform-zeebe-gateway-7557b5b5f6-9ldnn, address=192.168.153.8:26502} joined the bootstrap service
2024-07-09 09:14:21.297 [] [atomix-cluster-0] [] INFO
io.atomix.cluster.protocol.swim - Started
2024-07-09 09:14:21.298 [] [atomix-cluster-0] [] INFO
io.atomix.cluster.impl.DefaultClusterMembershipService - Started cluster membership service for member Member{id=camunda-platform-zeebe-gateway-7557b5b5f6-9ldnn, address=192.168.153.8:26502, properties={}}
2024-07-09 09:14:21.298 [] [atomix-cluster-0] [] INFO
io.atomix.cluster.messaging.impl.DefaultClusterCommunicationService - Started
2024-07-09 09:14:21.389 [] [atomix-cluster-0] [] INFO
io.atomix.cluster.messaging.impl.DefaultClusterEventService - Started
2024-07-09 09:14:22.093 [] [main] [] INFO
io.camunda.zeebe.gateway - Standalone gateway is started!
If I run zbctl it shows me, that there is no broker in cluster:
zbctl --insecure --address 192.168.153.8:26500 status
Cluster size: -1
Partitions count: 0
Replication factor: 0
Gateway version: 8.5.4
Brokers:
If I deploy camunda platform with same command and same config on my local machine (using kind), then all works well.
Could someone help me to understand what I missed, and what should I check, to find the reason, why broker doesn’t connect to gateway?