summaryrefslogtreecommitdiff
path: root/src/tokenizer
AgeCommit message (Expand)Author
2023-09-28refactor: remove needless match & mapMartin Fischer
2023-09-28chore: rename variableMartin Fischer
2023-09-28feat: add offset to Trace::EndOfFileMartin Fischer
2023-09-28break!: move offsets out of TokenMartin Fischer
2023-09-28break!: emit chars instead of stringsMartin Fischer
2023-09-28refactor: proxy emit_string calls through utilsMartin Fischer
2023-09-28refactor: move machine impl details to machine moduleMartin Fischer
2023-09-28refactor: move utils module under tokenizer::machineMartin Fischer
2023-09-28refactor: only use InternalState re-export for feature-gated internal APIMartin Fischer
2023-09-28refactor: move machine module under tokenizerMartin Fischer