Add de-duplication to Llm Completion Worker

What does this MR do and why?

De-duplicate the LLM::Completion worker.

If a second job is kicked with the same parameters while we are still taking care of the first job then we can deduplicate that job since we are already attempting to perform the work of fetching that data from the api.

MR acceptance checklist

This checklist encourages us to confirm any changes have been analyzed to reduce risks in quality, performance, reliability, security, and maintainability.

Edited by Allison Browne

Merge request reports

Loading