Skip to content

Draft: LLM vulnerability AI export

Gregory Havenga requested to merge ghavenga-llm-dump-tooling into master

What does this MR do and why?

This MR implements some tooling to export AI responses in bulk for the purposes of prompt and model validation.

Usage

The script usage is still a bit funky, but for now the easiest way is to open a rails console and run this line: load "tooling/llm/vulnerability/ai_analysis.rb"

Since the script has an embedded execution line, that line will execute the code after it's defined. (at the moment, modifying that's the easiest way to get what you want out of the script)

Because

MR acceptance checklist

This checklist encourages us to confirm any changes have been analyzed to reduce risks in quality, performance, reliability, security, and maintainability.

Edited by Gregory Havenga

Merge request reports