aboutsummaryrefslogtreecommitdiff
path: root/src/tokenizer/machine
AgeCommit message (Collapse)Author
2023-09-28refactor: move machine impl details to machine moduleMartin Fischer
This commit separates the public API (the "Tokenizer") from the internal implementation (the "Machine") to make the code more readable.
2023-09-28refactor: move utils module under tokenizer::machineMartin Fischer