summaryrefslogtreecommitdiff
path: root/src/tokenizer
AgeCommit message (Expand)Author
2023-09-28break!: emit chars instead of stringsMartin Fischer
2023-09-28refactor: proxy emit_string calls through utilsMartin Fischer
2023-09-28refactor: move machine impl details to machine moduleMartin Fischer
2023-09-28refactor: move utils module under tokenizer::machineMartin Fischer
2023-09-28refactor: only use InternalState re-export for feature-gated internal APIMartin Fischer
2023-09-28refactor: move machine module under tokenizerMartin Fischer