Implement Inko's lexer in Inko itself

Yorick Peterse requested to merge std-compiler-lexer into master


This adds std::compiler::lexer, which can be used to lex Inko source code into a sequence of tokens. These tokens in turn can be used to build an Abstract Syntax Tree.

Corresponding issue

#171 (closed)


Edited by Yorick Peterse

Merge request reports