Add de-duplication to Llm Completion Worker
What does this MR do and why?
De-duplicate the LLM::Completion worker.
If a second job is kicked with the same parameters while we are still taking care of the first job then we can deduplicate that job since we are already attempting to perform the work of fetching that data from the api.
MR acceptance checklist
This checklist encourages us to confirm any changes have been analyzed to reduce risks in quality, performance, reliability, security, and maintainability.
-
I have evaluated the MR acceptance checklist for this MR.
Edited by Allison Browne