Add eval for the issue-to-mr flow
What does this merge request do and why?
- adds a new eval pipeline to test the
issue_to_merge_request
flow. - adds a new data collector based on the duo-workflow-service (DWS) api, which delegates the execution of duo-worflow-executor to DWS.
- adds a new simple boolean evaluator that checks if a merge request was created.
How to set up and validate locally
- Setup DAP in gdk with Remote Flows enabled (thus make sure you have a gitlab runner active in the tested project)
- On gitlab switch to branch
bc/issue-to-mr-seeder
and run the data seeder:
bundle exec rake gitlab:duo:dap_evals_seeder
- Now on CEF, run the eval as:
poetry run cef agent-platform evaluate .gitlab/agent_platform_templates/issue-to-mr.yaml
Merge request checklist
-
I've ran the affected pipeline(s) to validate that nothing is broken. -
Tests added for new functionality. If not, please raise an issue to follow up. -
Documentation added/updated, if needed.
Edited by Bruno Cardoso