I am using Camunda purely as a rules engine, where all the tasks in my BPMN workflow are business rule tasks. I’m sending each record for rule implementation using the .WithResult() method, and I get the results instantly. Since I am not using Operate, Optimize, or Tasklist, I set the disableExporter: true in helm charts.
Given that I don’t need to store data in Zeebe and I’m processing millions of process instances (PIs), I want to set the retention period as low as possible to free up memory. I’ve noticed that memory usage increases significantly after around 200,000 (number is not accurate) process instances.
How can I configure the system to minimize the retention period and free up memory effectively in this scenario? Are there any specific configurations I should focus on to manage memory better and ensure the system remains efficient?
I see memory usage is going up to 80-85% for each broker. How to free up the memory?