CancelledError: ('AIO_CANCEL_STOP_WORKFLOW_REQUEST')

Problem to solve

We have multiple errors with the message CancelledError: ('AIO_CANCEL_STOP_WORKFLOW_REQUEST....

On a first glance these might be related to the session not stopping quickly enough when a stop request arrives.

Logs with the error in DWS

Workhorse logs

Proposal

1. Make sure this is actually related to sessions not closing quickly enough.
2. Increase the timeout or generally handle the situation in a way that this doesn't raise an error as it should have no user impact.

Further details

Links / references