Implement model wrapper to serve Codegen using Triton python backend (!15) · Merge requests · GitLab.org / ModelOps / AI Assisted (formerly Applied ML) / Code Suggestions / AI Gateway

This MR proposes the model wrapper which will be used by Triton python backend to serve the original codegen model.

Edited Dec 15, 2022 by Alexander Chueshev

Implement model wrapper to serve Codegen using Triton python backend