Estimate the completion date for the evaluation consolidation

Problem to solve

We keep working on the eval consolidation proposal following https://handbook.gitlab.com/handbook/engineering/architecture/design-documents/ai_evaluation_consolidation/.

At this moment, we also have the Evaluation runner(not defined in the proposal) that significantly impact our proposal already covering some planned phases and work.

The problem is that given all changes, the final date is not clearly set up and the final steps and not defined as well.

Given existing changes in our eval stack, re-visit the proposal attached above and define what has been done and what require to be done. As an outcome of this issue, we should have solid final steps required to close the proposal and the date when we plan to finish the consolidation work.

Proposal

Every ML engineer involved into the eval consolidation work comes with a message listing what has been done, what we still miss to complete given the eval runner changes. Based on this information, we'll create missing issues and define the final delivery date.

Links / references

cc @gitlab-org/ai-powered/ai-framework/engineering/machine-learning @wortschi

Edited by Alexander Chueshev