Add troubleshoot slash command
What does this merge request do and why?
Root Causes Analysis has moved to /troubleshoot
via Duo Chat. This
change adds support to evaluation /troubleshoot
.
Relates to #254 (closed) & #391 (closed)
How to set up and validate locally
- Ensure GCP environment variables are setup.
- Check out to this merge request's branch.
- Make a copy of
data/config/root_cause_analysis/eval_slash_troubleshoot_experiment.example.json
.cp data/config/root_cause_analysis/eval_slash_troubleshoot_experiment{.example,}.json
- Update the
base_url
tohttps://gitlab.com
in the config. (We not yet support seeding local GDK). - Run the follow command to kick off the pipeline.
poetry run promptlib duo-chat eval --config-file=data/config/root_cause_analysis/eval_slash_troubleshoot_experiment.json --test-run --sample-size 1
Merge request checklist
-
I've ran the affected pipeline(s) to validate that nothing is broken. -
Tests added for new functionality. If not, please raise an issue to follow up. -
Documentation added/updated, if needed.
Edited by Tan Le