Hi,
I am using the Zeebe 0.21.1 client and broker. sometimes i getting some weird exception in broker and also the client taking a longer time to pull/listen the request.
here is exception in zeebe broker
10/16/2019 12:15:26 PM2019-10-16 06:45:26.930 [io.zeebe.gateway.impl.job.LongPollingActivateJobsHandler] [10.42.37.204:26501-zb-actors-0] WARN io.zeebe.gateway - Failed to complete io.zeebe.gateway.impl.broker.request.BrokerActivateJobsRequest@1fc07628
10/16/2019 12:15:26 PMio.grpc.StatusRuntimeException: CANCELLED: call already cancelled
10/16/2019 12:15:26 PM at io.grpc.Status.asRuntimeException(Status.java:524) ~[grpc-api-1.24.0.jar:1.24.0]
10/16/2019 12:15:26 PM at io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:368) ~[grpc-stub-1.24.0.jar:1.24.0]
10/16/2019 12:15:26 PM at io.zeebe.gateway.impl.job.LongPollingActivateJobsRequest.complete(LongPollingActivateJobsRequest.java:72) ~[zeebe-gateway-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM at io.zeebe.gateway.impl.job.LongPollingActivateJobsRequest.timeout(LongPollingActivateJobsRequest.java:94) ~[zeebe-gateway-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM at io.zeebe.gateway.impl.job.LongPollingActivateJobsHandler.lambda$addTimeOut$9(LongPollingActivateJobsHandler.java:176) ~[zeebe-gateway-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM at io.zeebe.util.sched.ActorJob.invoke(ActorJob.java:76) [zeebe-util-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM at io.zeebe.util.sched.ActorJob.execute(ActorJob.java:39) [zeebe-util-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM at io.zeebe.util.sched.ActorTask.execute(ActorTask.java:127) [zeebe-util-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM at io.zeebe.util.sched.ActorThread.executeCurrentTask(ActorThread.java:107) [zeebe-util-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM at io.zeebe.util.sched.ActorThread.doWork(ActorThread.java:91) [zeebe-util-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM at io.zeebe.util.sched.ActorThread.run(ActorThread.java:195) [zeebe-util-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM2019-10-16 06:45:26.931 [io.zeebe.gateway.impl.job.LongPollingActivateJobsHandler] [10.42.37.204:26501-zb-actors-0] WARN io.zeebe.gateway - Failed to complete io.zeebe.gateway.impl.broker.request.BrokerActivateJobsRequest@50203f27
10/16/2019 12:15:26 PMio.grpc.StatusRuntimeException: CANCELLED: call already cancelled
10/16/2019 12:15:26 PM at io.grpc.Status.asRuntimeException(Status.java:524) ~[grpc-api-1.24.0.jar:1.24.0]
10/16/2019 12:15:26 PM at io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:368) ~[grpc-stub-1.24.0.jar:1.24.0]
10/16/2019 12:15:26 PM at io.zeebe.gateway.impl.job.LongPollingActivateJobsRequest.complete(LongPollingActivateJobsRequest.java:72) ~[zeebe-gateway-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM at io.zeebe.gateway.impl.job.LongPollingActivateJobsRequest.timeout(LongPollingActivateJobsRequest.java:94) ~[zeebe-gateway-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM at io.zeebe.gateway.impl.job.LongPollingActivateJobsHandler.lambda$addTimeOut$9(LongPollingActivateJobsHandler.java:176) ~[zeebe-gateway-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM at io.zeebe.util.sched.ActorJob.invoke(ActorJob.java:76) [zeebe-util-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM at io.zeebe.util.sched.ActorJob.execute(ActorJob.java:39) [zeebe-util-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM at io.zeebe.util.sched.ActorTask.execute(ActorTask.java:127) [zeebe-util-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM at io.zeebe.util.sched.ActorThread.executeCurrentTask(ActorThread.java:107) [zeebe-util-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM at io.zeebe.util.sched.ActorThread.doWork(ActorThread.java:91) [zeebe-util-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM at io.zeebe.util.sched.ActorThread.run(ActorThread.java:195) [zeebe-util-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM2019-10-16 06:45:26.940 [io.zeebe.gateway.impl.job.LongPollingActivateJobsHandler] [10.42.37.204:26501-zb-actors-1] WARN io.zeebe.gateway - Failed to complete io.zeebe.gateway.impl.broker.request.BrokerActivateJobsRequest@5ced0b18
10/16/2019 12:15:26 PMio.grpc.StatusRuntimeException: CANCELLED: call already cancelled
10/16/2019 12:15:26 PM at io.grpc.Status.asRuntimeException(Status.java:524) ~[grpc-api-1.24.0.jar:1.24.0]
10/16/2019 12:15:26 PM at io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:368) ~[grpc-stub-1.24.0.jar:1.24.0]
10/16/2019 12:15:26 PM at io.zeebe.gateway.impl.job.LongPollingActivateJobsRequest.complete(LongPollingActivateJobsRequest.java:72) ~[zeebe-gateway-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM at io.zeebe.gateway.impl.job.LongPollingActivateJobsRequest.timeout(LongPollingActivateJobsRequest.java:94) ~[zeebe-gateway-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM at io.zeebe.gateway.impl.job.LongPollingActivateJobsHandler.lambda$addTimeOut$9(LongPollingActivateJobsHandler.java:176) ~[zeebe-gateway-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM at io.zeebe.util.sched.ActorJob.invoke(ActorJob.java:76) [zeebe-util-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM at io.zeebe.util.sched.ActorJob.execute(ActorJob.java:39) [zeebe-util-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM at io.zeebe.util.sched.ActorTask.execute(ActorTask.java:127) [zeebe-util-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM at io.zeebe.util.sched.ActorThread.executeCurrentTask(ActorThread.java:107) [zeebe-util-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM at io.zeebe.util.sched.ActorThread.doWork(ActorThread.java:91) [zeebe-util-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM at io.zeebe.util.sched.ActorThread.run(ActorThread.java:195) [zeebe-util-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM2019-10-16 06:45:26.941 [io.zeebe.gateway.impl.job.LongPollingActivateJobsHandler] [10.42.37.204:26501-zb-actors-1] WARN io.zeebe.gateway - Failed to complete io.zeebe.gateway.impl.broker.request.BrokerActivateJobsRequest@69745aaa
10/16/2019 12:15:26 PMio.grpc.StatusRuntimeException: CANCELLED: call already cancelled
10/16/2019 12:15:26 PM at io.grpc.Status.asRuntimeException(Status.java:524) ~[grpc-api-1.24.0.jar:1.24.0]
10/16/2019 12:15:26 PM at io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:368) ~[grpc-stub-1.24.0.jar:1.24.0]
10/16/2019 12:15:26 PM at io.zeebe.gateway.impl.job.LongPollingActivateJobsRequest.complete(LongPollingActivateJobsRequest.java:72) ~[zeebe-gateway-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM at io.zeebe.gateway.impl.job.LongPollingActivateJobsRequest.timeout(LongPollingActivateJobsRequest.java:94) ~[zeebe-gateway-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM at io.zeebe.gateway.impl.job.LongPollingActivateJobsHandler.lambda$addTimeOut$9(LongPollingActivateJobsHandler.java:176) ~[zeebe-gateway-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM at io.zeebe.util.sched.ActorJob.invoke(ActorJob.java:76) [zeebe-util-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM at io.zeebe.util.sched.ActorJob.execute(ActorJob.java:39) [zeebe-util-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM at io.zeebe.util.sched.ActorTask.execute(ActorTask.java:127) [zeebe-util-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM at io.zeebe.util.sched.ActorThread.executeCurrentTask(ActorThread.java:107) [zeebe-util-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM at io.zeebe.util.sched.ActorThread.doWork(ActorThread.java:91) [zeebe-util-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM at io.zeebe.util.sched.ActorThread.run(ActorThread.java:195) [zeebe-util-0.21.1.jar:0.21.1]
10/16/2019 12:15:26 PM2019-10-16 06:45:26.947 [io.zeebe.gateway.impl.job.LongPollingActivateJobsHandler] [10.42.37.204:26501-zb-actors-1] WARN io.zeebe.gateway - Failed to complete io.zeebe.gateway.impl.broker.request.BrokerActivateJobsRequest@217c706c
10/16/2019 12:15:26 PMio.grpc.StatusRuntimeException: CANCELLED: call already cancelled