Hi!
I’m getting a fatal error when trying to send a message event via rest api (engine-rest) on 7.11-7.13.
The message data contains both process instance Id and the business key, so the correlation must be instant.
As catalina.out shows, the task following the event finishes allright (got a log there), but then the process stops and tomcat hangs.
Tried to run engine both with H2 and PostgreSQL, H2 fails in 1 min, PG in 2 mins.
Message events in other processes seem to work fine, only one fails. Tried ro remove it and to add it again, tried to finish the process right after the event - nothing helps.
Moreover, I tried to change this to conditional event and send a variable to the process instance. Same s**t.
Another symptom - no response to http POST request with the message or the variables modification.
The screenshot of the diagram is attached.
Did anyone catch the same error?
the error:
04-Jun-2020 22:37:35.706 SEVERE [http-nio-8080-exec-3] org.camunda.commons.logging.BaseLogger.logError ENGINE-16004 Exception while closing command context: Java heap space
java.lang.OutOfMemoryError: Java heap space
at java.base/java.util.HashMap.resize(HashMap.java:699)
at java.base/java.util.HashMap.putVal(HashMap.java:624)
at java.base/java.util.HashMap.put(HashMap.java:607)
at java.base/sun.util.resources.OpenListResourceBundle.loadLookup(OpenListResourceBundle.java:146)
at java.base/sun.util.resources.OpenListResourceBundle.loadLookupTablesIfNecessary(OpenListResourceBundle.java:128)
at java.base/sun.util.resources.OpenListResourceBundle.handleKeySet(OpenListResourceBundle.java:96)
at java.base/java.util.ResourceBundle.containsKey(ResourceBundle.java:2305)
at java.base/sun.util.locale.provider.LocaleResources.getTimeZoneNames(LocaleResources.java:272)
at java.base/sun.util.locale.provider.TimeZoneNameProviderImpl.getDisplayNameArray(TimeZoneNameProviderImpl.java:127)
at java.base/sun.util.cldr.CLDRTimeZoneNameProviderImpl.getDisplayNameArray(CLDRTimeZoneNameProviderImpl.java:77)
at java.base/sun.util.locale.provider.TimeZoneNameProviderImpl.getDisplayName(TimeZoneNameProviderImpl.java:99)
at java.base/sun.util.locale.provider.TimeZoneNameUtility$TimeZoneNameGetter.getName(TimeZoneNameUtility.java:271)
at java.base/sun.util.locale.provider.TimeZoneNameUtility$TimeZoneNameGetter.getObject(TimeZoneNameUtility.java:229)
at java.base/sun.util.locale.provider.TimeZoneNameUtility$TimeZoneNameGetter.getObject(TimeZoneNameUtility.java:215)
at java.base/sun.util.locale.provider.LocaleServiceProviderPool.getLocalizedObjectImpl(LocaleServiceProviderPool.java:281)
at java.base/sun.util.locale.provider.LocaleServiceProviderPool.getLocalizedObject(LocaleServiceProviderPool.java:242)
at java.base/sun.util.locale.provider.TimeZoneNameUtility.retrieveDisplayNamesImpl(TimeZoneNameUtility.java:197)
at java.base/sun.util.locale.provider.TimeZoneNameUtility.retrieveDisplayName(TimeZoneNameUtility.java:150)
at java.base/java.util.TimeZone.getDisplayName(TimeZone.java:401)
at java.base/java.util.Date.toString(Date.java:1046)
at java.base/java.lang.String.valueOf(String.java:2951)
at java.base/java.lang.StringBuilder.append(StringBuilder.java:168)
at org.camunda.bpm.engine.impl.history.event.HistoricActivityInstanceEventEntity.toString(HistoricActivityInstanceEventEntity.java:176)
at java.base/java.lang.String.valueOf(String.java:2951)
at java.base/java.lang.StringBuilder.append(StringBuilder.java:168)
at org.camunda.bpm.engine.impl.db.entitymanager.DbEntityManager.validateId(DbEntityManager.java:606)
at org.camunda.bpm.engine.impl.db.entitymanager.DbEntityManager.insert(DbEntityManager.java:484)
at org.camunda.bpm.engine.impl.history.handler.DbHistoryEventHandler.insertOrUpdate(DbHistoryEventHandler.java:66)
at org.camunda.bpm.engine.impl.history.handler.DbHistoryEventHandler.handleEvent(DbHistoryEventHandler.java:49)
at org.camunda.bpm.engine.impl.history.handler.CompositeHistoryEventHandler.handleEvent(CompositeHistoryEventHandler.java:96)
at org.camunda.bpm.engine.impl.history.parser.HistoryExecutionListener.notify(HistoryExecutionListener.java:58)
at org.camunda.bpm.engine.impl.history.parser.HistoryExecutionListener.notify(HistoryExecutionListener.java:38)
I finally could get the jobs list. (CPU and memory are 100%)
How can I solve this? Cannot login CamundaApp
Is there a way to kill everything? Using the API I get timeout.
Hi @Denis_Nikolaev
Do you have any update on this? I am also facing the same issue…
Please find the log below
WARNING [http-nio-6300-exec-10] org.camunda.commons.logging.BaseLogger.logWarn ENGINE-REST-HTTP500 java.lang.OutOfMemoryError: Java heap space
at java.base/java.util.jar.Attributes.read(Attributes.java:395)
at java.base/java.util.jar.Manifest.read(Manifest.java:291)
at java.base/java.util.jar.Manifest.(Manifest.java:101)
at java.base/java.util.jar.Manifest.(Manifest.java:88)
at java.base/java.util.jar.JarFile.getManifestFromReference(JarFile.java:425)
at java.base/java.util.jar.JarFile.getManifest(JarFile.java:406)
at java.base/jdk.internal.loader.URLClassPath$JarLoader$2.getManifest(URLClassPath.java:874)
at java.base/java.net.URLClassLoader.defineClass(URLClassLoader.java:482)
at java.base/java.net.URLClassLoader$1.run(URLClassLoader.java:423)
at java.base/java.net.URLClassLoader$1.run(URLClassLoader.java:417)
at java.base/java.security.AccessController.executePrivileged(AccessController.java:784)
at java.base/java.security.AccessController.doPrivileged(AccessController.java:691)
at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:416)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:588)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:521)
at org.camunda.bpm.engine.impl.metrics.MetricsQueryImpl.sum(MetricsQueryImpl.java:108)
at org.camunda.bpm.engine.rest.sub.metrics.MetricsResourceImpl.sum(MetricsResourceImpl.java:54)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:567)
at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:140)
at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:295)
at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:249)
at org.jboss.resteasy.core.ResourceLocatorInvoker.invokeOnTargetObject(ResourceLocatorInvoker.java:138)
at org.jboss.resteasy.core.ResourceLocatorInvoker.invoke(ResourceLocatorInvoker.java:107)
at org.jboss.resteasy.core.ResourceLocatorInvoker.invokeOnTargetObject(ResourceLocatorInvoker.java:133)
at org.jboss.resteasy.core.ResourceLocatorInvoker.invoke(ResourceLocatorInvoker.java:101)
at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:406)
at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:213)
at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:228)
at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56)
14-Dec-2020 20:20:51.496 WARNING [http-nio-6300-exec-6] org.camunda.commons.logging.BaseLogger.logWarn ENGINE-REST-HTTP500 java.lang.OutOfMemoryError: Java heap space
at java.base/java.util.jar.Attributes.read(Attributes.java:395)
at java.base/java.util.jar.Manifest.read(Manifest.java:291)
at java.base/java.util.jar.Manifest.(Manifest.java:101)
at java.base/java.util.jar.Manifest.(Manifest.java:88)
at java.base/java.util.jar.JarFile.getManifestFromReference(JarFile.java:425)
at java.base/java.util.jar.JarFile.getManifest(JarFile.java:406)
at java.base/jdk.internal.loader.URLClassPath$JarLoader$2.getManifest(URLClassPath.java:874)
at java.base/java.net.URLClassLoader.defineClass(URLClassLoader.java:482)
at java.base/java.net.URLClassLoader$1.run(URLClassLoader.java:423)
at java.base/java.net.URLClassLoader$1.run(URLClassLoader.java:417)
at java.base/java.security.AccessController.executePrivileged(AccessController.java:784)
at java.base/java.security.AccessController.doPrivileged(AccessController.java:691)
at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:416)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:588)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:521)
at org.camunda.bpm.engine.impl.metrics.MetricsQueryImpl.sum(MetricsQueryImpl.java:108)
at org.camunda.bpm.engine.rest.sub.metrics.MetricsResourceImpl.sum(MetricsResourceImpl.java:54)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:567)
at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:140)
at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:295)
at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:249)
at org.jboss.resteasy.core.ResourceLocatorInvoker.invokeOnTargetObject(ResourceLocatorInvoker.java:138)
at org.jboss.resteasy.core.ResourceLocatorInvoker.invoke(ResourceLocatorInvoker.java:107)
at org.jboss.resteasy.core.ResourceLocatorInvoker.invokeOnTargetObject(ResourceLocatorInvoker.java:133)
at org.jboss.resteasy.core.ResourceLocatorInvoker.invoke(ResourceLocatorInvoker.java:101)
at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:406)
at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:213)
at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:228)
at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56)
14-Dec-2020 20:21:04.518 WARNING [http-nio-6300-exec-1] org.camunda.commons.logging.BaseLogger.logWarn ENGINE-REST-HTTP500 java.lang.OutOfMemoryError: Java heap space
14-Dec-2020 20:21:10.277 SEVERE [http-nio-6300-exec-10] org.apache.coyote.AbstractProtocol$ConnectionHandler.process Failed to complete processing of a request
java.lang.OutOfMemoryError: Java heap space
14-Dec-2020 20:21:15.453 SEVERE [http-nio-6300-exec-4] org.camunda.commons.logging.BaseLogger.logError ENGINE-16004 Exception while closing command context: Java heap space
java.lang.OutOfMemoryError: Java heap space
14-Dec-2020 20:21:15.973 WARNING [http-nio-6300-exec-4] org.camunda.commons.logging.BaseLogger.logWarn ENGINE-REST-HTTP500 java.lang.OutOfMemoryError: Java heap space
14-Dec-2020 20:21:26.312 WARNING [http-nio-6300-exec-2] org.camunda.commons.logging.BaseLogger.logWarn ENGINE-REST-HTTP500 java.lang.OutOfMemoryError: Java
