Consolidate Project Structure

Problem to solve

We would like to consolidate the project structure to deprecate unused features (prompt-library with Apache Beam) and promote ELI5 as the main method to run evaluation. This will help to reduce confusions and maintenance effort moving forward.

Proposal

• Remove /prompt-libary folder.
• Consolidate the dependency management and manage prompt-library and eli5 as 1 projects, e.g. pyproject.toml and Makefile.
• Rename the project to CEF.
• Update documentation accordingly.
• Ensure dependent projects/pipelines are pinned to versioned packages and not disrupted by this change.
  • ai-gateway
  • duo-workflow-tests
  • evaluation-runner

Out of scope

• Unifying the CLI structure since we are removing the prompt-library folder.

Further details

Links / references