Turn symbol column into string
What does this merge request do and why?
This MR change the symbol column into STRING type and write the symbol count to it as json-serialized string. This way we can avoid table schema change when there are new symbols.
Ref: https://gitlab.com/gitlab-org/modelops/applied-ml/code-suggestions/prompt-library/-/issues/95
How to set up and validate locally
Merge request checklist
-
I've ran the eval_codebase.py
pipeline to validate that nothing is broken. -
Tests added for new functionality. If not, please raise an issue to follow up. -
Documentation added/updated, if needed.
Edited by Hongtao Yang