I correctyl installed, in my helm file, the last community Kafka exporter, version 3.1.1.
Everything is fine I can receive message from default topic called zeebe, now what I’m trying to do is do disable the default one and add another topic, as documentation says, something like as example
{ type: “event”, topic: zeebe-process-event } and { type: “”, topic: zeebe}
Type:“” should disable the topic specified.
Here my yml file to better understand:
zeebe:
pvcSize: “1Gi”
clusterSize: “3”
partitionCount: “1”
replicationFactor: “3”
kibana:
enabled: false
prometheus:
enabled: false
elasticsearch:
enabled: false
logLevel: DEBUG
env:
- name: ZEEBE_BROKER_EXPORTERS_KAFKA_ARGS_PRODUCER_SERVERS
value: acme-infrastructure-kafka:9092
- name: ZEEBE_BROKER_EXPORTERS_KAFKA_ARGS_PRODUCER_CLIENTID
value: “zeebe”
- name: ZEEBE_BROKER_EXPORTERS_KAFKA_ARGS_MAXBATCHSIZE
value: “100”
- name: ZEEBE_BROKER_EXPORTERS_KAFKA_ARGS_MAXBLOCKINGTIMEOUTMS
value: “1000”
- name: ZEEBE_BROKER_EXPORTERS_KAFKA_ARGS_FLUSHINTERVALMS
value: “1000”
- name: ZEEBE_BROKER_EXPORTERS_KAFKA_ARGS_PRODUCER_CONFIG
value: “linger.ms=5\nbuffer.memory=8388608\nbatch.size=32768\nmax.block.ms=5000”
- name: ZEEBE_BROKER_EXPORTERS_KAFKA_CLASSNAME
value: io.zeebe.exporters.kafka.KafkaExporter
- name: ZEEBE_BROKER_EXPORTERS_KAFKA_JARPATH
value: /usr/local/zeebe/exporters/zeebe-kafka-exporter.jar
- name: ZEEBE_BROKER_EXPORTERS_KAFKA_ARGS_RECORDS_DEFAULTS
value: “{ type: "", topic: zeebe }”
- name: ZEEBE_BROKER_EXPORTERS_KAFKA_ARGS_RECORDS_PROCESSEVENT
value: “{ type: "event", topic: zeebe-process-event }”gateway:
env:
- name: ZEEBE_GATEWAY_LONGPOLLING_ENABLED
value: “true”
extraInitContainers: |
- name: init-exporters-kafka
image: busybox:latest
imagePullPolicy: Always
command: [‘/bin/sh’, ‘-c’]
args: [‘wget --no-check-certificate https://www.acme.com/zeebe-kafka-exporter-3.1.1-jar-with-dependencies.jar -O /exporters/zeebe-kafka-exporter.jar;’]
volumeMounts:
- name: exporters
mountPath: /exporters/
In this case the exporter goes in exception:
Error starting ApplicationContext. To display the conditions report re-run your application with ‘debug’ enabled.
2022-03-21 08:12:04.735 [main] ERROR
org.springframework.boot.SpringApplication - Application run failed
java.lang.IllegalStateException: Failed to execute CommandLineRunner
at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:770) [spring-boot-2.6.1.jar:2.6.1]
at org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:751) [spring-boot-2.6.1.jar:2.6.1]
at org.springframework.boot.SpringApplication.run(SpringApplication.java:309) [spring-boot-2.6.1.jar:2.6.1]
at io.camunda.zeebe.broker.StandaloneBroker.main(StandaloneBroker.java:79) [camunda-cloud-zeebe-1.3.4.jar:1.3.4]
Caused by: java.lang.IllegalStateException: Failed to load exporter with configuration: ExporterCfg{, jarPath=‘/usr/local/zeebe/exporters/zeebe-kafka-exporter.jar’, className=‘io.zeebe.exporters.kafka.KafkaExporter’, args={producer={clientid=zeebe, servers=acme-infrastructure-kafka:9092, config=linger.ms=5
buffer.memory=8388608
batch.size=32768
max.block.ms=5000}, records={processevent={ type: “event”,topic: zeebe-process-event }, defaults={ type: “”,topic: zeebe }}, maxblockingtimeoutms=1000, maxbatchsize=100, flushintervalms=1000}}
at io.camunda.zeebe.broker.Broker.buildExporterRepository(Broker.java:149) ~[zeebe-broker-1.3.4.jar:1.3.4]
at io.camunda.zeebe.broker.Broker.(Broker.java:71) ~[zeebe-broker-1.3.4.jar:1.3.4]
at io.camunda.zeebe.broker.Broker.(Broker.java:50) ~[zeebe-broker-1.3.4.jar:1.3.4]
at io.camunda.zeebe.broker.StandaloneBroker.run(StandaloneBroker.java:92) ~[camunda-cloud-zeebe-1.3.4.jar:1.3.4]
at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:767) ~[spring-boot-2.6.1.jar:2.6.1]
… 3 more
If I don’t specify anything or just the topic name without the type, then it works but I received only message from general zeebe topic