Investigate and document why setting batch_size to greater than 1 result in not receiving some events

Problem

As mentioned in gitlab-org/duo-workflow/duo-workflow-service#159 (closed), Duo workflow service was not receiving all the events and changing batch_size from 3 to 1 fixed the issue.

Investigate and document why it is happening.

Currently, we are also using batch_size 10 in the AI-Gateway as well and it is possible that some events are getting dropped. Investigate that or as a quick fix make it to 1 for now.

Desired Outcome

We should understand under which cases this can happen and document it.

Proposed Solution

TBD

How to verify

TBD