Pre-package tokenizer files with Docker image (!238) · Merge requests · GitLab.org / ModelOps / AI Assisted (formerly Applied ML) / Code Suggestions / AI Gateway

Stan Hu requested to merge sh-prepackage-tokenizer-files into main Jul 20, 2023

This eliminates any downloads before startup, reducing delays in serving a request.

Edited Jul 20, 2023 by Stan Hu

Pre-package tokenizer files with Docker image