Support Google Codey API for Code Suggestions
# DRIs Please do not edit this summary without talking to @hbenson or @wayne first We want to implement phase ASAP and put all other work on hold if needed to achieve this. Goal: We want customers to have the highest quality experience for code suggestions. Have a feature flag or similar in the model gateway that, if set: If a customer allows 3rd party AI (https://docs.gitlab.com/ee/development/ai_features.html), route code suggestion request to the Google Codey model Have a different feature flag in the model gateway that if the above feature flag is set, it will do one of the following based on the setting if a customer does not allow 3rd party AI either: * Route to our model * Serve no suggestion If our model has higher-quality suggestions for some use cases now or in the future, we will consider that. Once phase 1 is confirmed to be working in production, we can resume other work.
epic