Lexical Analysis on very large files is slow

Parsing very large files like: df-raw-collection/masterwork_df_v1.31/objects/descriptor_shape_legends.txt Is very slow in the Lexical Analysis step. This probably is because of Regex searching, on long strings.

One test shows 187312 millisec (on release build) for the 7MB file.

Flamegraph need to be created to find out exact source of slowness. For more info look at https://gitlab.com/df-modding-tools/df-raw-language-server/-/blob/master/profiling.md

Maybe multi-line parallel parsing is a possibility at some point.