Skip to content

Add troubleshoot slash command

What does this merge request do and why?

Root Causes Analysis has moved to /troubleshoot via Duo Chat. This change adds support to evaluation /troubleshoot.

Relates to #254 (closed) & #391 (closed)

How to set up and validate locally

  1. Ensure GCP environment variables are setup.
  2. Check out to this merge request's branch.
  3. Make a copy of data/config/root_cause_analysis/eval_slash_troubleshoot_experiment.example.json.
    cp data/config/root_cause_analysis/eval_slash_troubleshoot_experiment{.example,}.json
  4. Update the base_url to https://gitlab.com in the config. (We not yet support seeding local GDK).
  5. Run the follow command to kick off the pipeline.
    poetry run promptlib duo-chat eval --config-file=data/config/root_cause_analysis/eval_slash_troubleshoot_experiment.json --test-run --sample-size 1

Merge request checklist

  • I've ran the affected pipeline(s) to validate that nothing is broken.
  • Tests added for new functionality. If not, please raise an issue to follow up.
  • Documentation added/updated, if needed.
Edited by Tan Le

Merge request reports

Loading