Hi Team,
I am using 8.2.11 images of camunda 8.
I have below configuration for Zeebe in my values.yaml file
clusterSize: “3”
partitionCount: “3”
replicationFactor: “3”
cpuThreadCount: “3”
ioThreadCount: “3”
resources:
cpu: 800m
memory: 1200Mi
and persistentVolume: 10 Gi,
I run this with below Elastic search configuration
1 master node and 2 data nodes
However when I run my load test of 500 parallel request - I get below error-
In broker pods -
io.camunda.zeebe.exporter.ElasticsearchExporterException: Failed to flush bulk
and
In Gateway Pods -
io.camunda.zeebe.gateway.cmd.BrokerErrorException: Received error from broker (INTERNAL_ERROR): Failed to write client request to partition ‘1’, because the writer is full.
How do I fix this. Please provide guidance. Should I upgrade my resources ?
I also found this post regarding same issue - Endless errors on gateway because the writer is full · Issue #13018 · camunda/zeebe · GitHub
Do we have the fix for this issue.