I can help you troubleshoot this issue. This is a common problem with Camunda self-managed deployments where processes deployed via Desktop Modeler aren’t visible in Operate. Let me address your specific questions:
Classification: Problem
1. How to Check if Data is Persisted in Operate
To verify if data is being properly exported and imported:
Check OpenSearch Indices:
Look for zeebe-record-* indices in your OpenSearch cluster
Verify these indices contain data after deploying a process
Check if the indices are being created and populated by Zeebe’s exporter
Check Operate Logs:
Look for importer errors or warnings about missing data
Check for any index-related issues in the Operate startup logs
Verify the Operate importer is running successfully
2. Why Data is NOT Pulled by Exporters
Based on your setup (Zeebe 8.7.2/8.7.4/8.7.7 with OpenSearch), here are the most likely causes:
Common Root Causes:
Index Template Issues
Incorrect mapping for fields like value.variables (should be mapped as keyword)
This prevents Operate from querying process instances even if data exists
Solution: Update your OpenSearch index templates with correct mappings
Exporter Configuration Problems
Index naming mismatches between Zeebe exporter and Operate expectations
Incorrect OpenSearch endpoint configuration
Known Issue: There was a bug with index prefixes in Helm charts causing data to be written to wrong indices
Version Compatibility
From Camunda 8.6.0+, Zeebe and Operate must run on exact same minor and patch versions
OpenSearch 2.9+ is required
Ensure you’re using the OpenSearch exporter (not Elasticsearch exporter)
Troubleshooting Steps:
Verify Zeebe Export:
# Check if zeebe-record indices exist and have data
curl -X GET "your-opensearch:9200/_cat/indices/zeebe-record-*?v"
Check Index Templates:
# Verify index templates are correct
curl -X GET "your-opensearch:9200/_index_template/zeebe-record-*"
Restart Operate:
After fixing any index/template issues, restart Operate to ensure it picks up changes
Test with Simple Process:
Deploy a basic process without complex BPMN features to isolate the issue
Immediate Actions:
Check your Zeebe configuration for the OpenSearch exporter settings
Verify all components (Zeebe, Operate, OpenSearch) are on compatible versions
Look for any index prefix misconfigurations in your deployment
Review Operate importer logs for specific error messages
Resolved - There was data inconsistency in opensearch DB. Cleared the all records under zeebe-record*, operate*, tasklist* and also data in PVC in k8 cluster.
post this restart the all the pods in k8.