html5tokenizer/src, branch v0.5.2Fork of html5gum with code span supporthttp://git.push-f.com/html5tokenizer/atom/src?h=v0.5.22023-09-28T09:00:01Zchore: remove unnecessary generic param bounds2023-09-28T09:00:01ZMartin Fischermartin@push-f.com2023-09-28T06:25:09Zurn:sha1:8b2597814dee8486026326c2101820fa9f890e7bfix(tokenizer): don't lowercase temp chars in ScriptDataEndTagName2023-09-28T08:57:11ZMartin Fischermartin@push-f.com2023-09-26T06:22:21Zurn:sha1:ee8ab781672e7ab608e74a5b605eb189828f0afe
This bug resulted in e.g. "<script></SCRI" being wrongly tokenized as:
StartTag(StartTag { name: "script", self_closing: false, attributes: {} })
Char('<')
Char('/')
Char('s')
Char('c')
Char('r')
Char('i')
EndOfFile
Note that the Char tokens should be uppercase. (This bug could only be
observed when properly doing state switching via tree construction.)
chore: move StartTag::name field up2023-09-28T08:36:08ZMartin Fischermartin@push-f.com2023-09-27T06:55:31Zurn:sha1:3ddeb0cd2d9469bab8dcc49d63424cffb605141e
The Debug formatting is more readable when the name comes first.
feat: prettier Debug formatting for AttributeMap & Attribute2023-09-28T08:36:08ZMartin Fischermartin@push-f.com2023-09-25T11:01:51Zurn:sha1:5ebbe93bf3c62df8159204b2e79d66607f136c30break!: remove State::{ScriptDataEscaped, ScriptDataDoubleEscaped}2023-09-28T08:36:08ZMartin Fischermartin@push-f.com2023-09-28T08:22:52Zurn:sha1:9e4ad2e8d9b2f1c422bbe0d32aae2afa425769fa
These variants actually don't need to be exposed (to the tree builder).
break!: make AttributeMap::get return Option<&str>2023-09-28T08:36:08ZMartin Fischermartin@push-f.com2023-09-27T06:05:58Zurn:sha1:3c89744824ea6b8b32d82c2c37ac1de6d980709c
Most of the time you'll only be interested in the attribute value,
so the `get` method should directly return it instead of a wrapper type.
This also makes the API more predictable since e.g. the DOM getAttribute
method also returns a string. Lastly previously it was quite confusing
that map[key] wasn't equivalent to map.get(key).unwrap().
feat: impl Clone for Token & Event2023-09-28T08:36:08ZMartin Fischermartin@push-f.com2023-09-01T07:06:44Zurn:sha1:c75dce875cff03e59ec7b6bceed4ec63283a6477chore: rename internal states as well2023-09-28T08:36:08ZMartin Fischermartin@push-f.com2023-09-04T18:47:52Zurn:sha1:bd446b6123e0b077a48e9f1e836affac78822f44
See the previous commit.
break!: rename State variants2023-09-28T08:36:08ZMartin Fischermartin@push-f.com2023-09-04T18:32:23Zurn:sha1:4e0057344381a50cd76419be170eab3d9389f034
The spec refers to them only as RCDATA, RAWTEXT and PLAINTEXT.
See https://rust-lang.github.io/api-guidelines/naming.html.
break!: remove CdataAction2023-09-28T08:36:08ZMartin Fischermartin@push-f.com2023-09-22T13:34:46Zurn:sha1:30b4adf60b9423968b0c9c6d23363f6d8cd99384
Which action the tokenizer takes depending on whether or not an
adjusted current node is present but not in the HTML namespace,
is an implementation detail and shouldn't be exposed in the API.