aboutsummaryrefslogtreecommitdiff
path: root/examples/tokenize.rs
diff options
context:
space:
mode:
authorMartin Fischer <martin@push-f.com>2023-08-16 17:07:06 +0200
committerMartin Fischer <martin@push-f.com>2023-08-19 06:41:55 +0200
commit681404e5036841ec45356f56f77cc5377f3640d9 (patch)
tree568f6cdd34e0366372ba1ad3c2d13f1b8e2b530c /examples/tokenize.rs
parentc021afde2c2bd4b8bdd9b3eec4b1660cb0a896e5 (diff)
refactor: decouple html5lib_tests from html5tokenizer
Previously we mapped the test tokens to our own token type. Now we do the reverse, which makes more sense as it enables us to easily add more detailed fields to our own token variants without having to worry about these fields not being present in the html5lib test data. (An alternative would be to normalize the values of these fields to some arbitrary value so that PartialEq still holds but seeing such normalized fields in the diff printed by pretty_assertions on a test failure would be quite confusing).
Diffstat (limited to 'examples/tokenize.rs')
0 files changed, 0 insertions, 0 deletions