html5tokenizer/integration_tests, branch v0.5.2Fork of html5gum with code span supporthttp://git.push-f.com/html5tokenizer/atom/integration_tests?h=v0.5.22023-09-28T09:00:01Zchore: rename integration tests2023-09-28T09:00:01ZMartin Fischermartin@push-f.com2023-09-27T07:25:12Zurn:sha1:b027ecdb397c2e378491f847660f8eeb740e8cf6chore: update html5lib-tests submodule to latest2023-09-28T09:00:01ZMartin Fischermartin@push-f.com2023-09-27T07:14:48Zurn:sha1:635a571ee76bf7fdaaf01c204f30289489b80c1achore: rename internal states as well2023-09-28T08:36:08ZMartin Fischermartin@push-f.com2023-09-04T18:47:52Zurn:sha1:bd446b6123e0b077a48e9f1e836affac78822f44
See the previous commit.
break!: remove CdataAction2023-09-28T08:36:08ZMartin Fischermartin@push-f.com2023-09-22T13:34:46Zurn:sha1:30b4adf60b9423968b0c9c6d23363f6d8cd99384
Which action the tokenizer takes depending on whether or not an
adjusted current node is present but not in the HTML namespace,
is an implementation detail and shouldn't be exposed in the API.
feat: implement BasicEmitter2023-09-28T08:36:08ZMartin Fischermartin@push-f.com2023-09-12T06:23:52Zurn:sha1:d913e6e91e43241b0105afbbad7db5c5bcda0255break!: move offsets out of Token2023-09-28T08:36:08ZMartin Fischermartin@push-f.com2023-09-10T17:37:34Zurn:sha1:852d5c6f2e65a5ab466662ae1c649a0ed25c70a9
Previously the Token enum contained the offsets using the O generic
type parameter, which could be a usize if you're tracking offsets or
a zero-sized type if you didn't care about offsets. This commit moves
all the byte offset and syntax information to a new Trace enum,
which has several advantages:
* Traces can now easily be stored separately, while the tokens are
fed to the tree builder. (The tree builder only has to keep track
of which tree nodes originate from which tokens.)
* No needless generics for functions that take a token but don't
care about offsets (a tree construction implementation is bound
to have many of such functions).
* The FromIterator<(String, String)> impl for AttributeMap no longer
has to specify arbitrary values for the spans and the value_syntax).
* The PartialEq implementation of Token is now much more useful
(since it no longer includes all the offsets).
* The Debug formatting of Token is now more readable
(since it no longer includes all the offsets).
* Function pointers to functions accepting tokens are possible.
(Since function pointer types may not have generic parameters.)
refactor: make TracingEmitter only work with usizes2023-09-28T08:36:08ZMartin Fischermartin@push-f.com2023-09-12T07:26:06Zurn:sha1:a03cea75d9d120a7519be91ec872b143b5d74276chore: add BasicEmitter stub2023-09-28T08:36:08ZMartin Fischermartin@push-f.com2023-09-12T07:03:56Zurn:sha1:14bc6f2cceed0fa578d6a1195266885bf57a5d4cbreak!: rename DefaultEmitter to TracingEmitter2023-09-28T08:36:08ZMartin Fischermartin@push-f.com2023-09-12T06:19:00Zurn:sha1:ad6ac5f0a825775c231e76cdc9016e61e54f4141refactor: decouple run_test_inner from DefaultEmitter2023-09-28T08:36:08ZMartin Fischermartin@push-f.com2023-09-11T16:24:20Zurn:sha1:ab373b495c8ed659e64158b764206dd2eaa35336