Iterating on Code Suggestion Pipeline

Overview

As we are iterating on the code completion pipeline to add more models and make it scalable, here are the list of things we are looking to iterate on

  1. Currently the Code Suggestion Pipeline only has Code Completion. Add Code Generation to the Pipeline.
  2. Update to the latest version of the models for Gecko , text-bison , code-bison
  3. @srayner to document other refactoring of the pipeline as well. The goals are as follows:
    1. Create Config files that work for various models along with prompt templates to go with those configs so that future users or automated systems (like daily runs) have a working starting place to run these models and get good results. Doing this would result in the OutputV5 data being of a reasonable quality
    2. Generate OutputV5 for the Grafana Dashboards
    3. Document the process to successfully run all of these models along with the constituent parts of the config files for future system users.
  4. Add daily runs and Code Suggestion API ( similar to duo chat API)
Edited by Stephan Rayner