From ee8ab781672e7ab608e74a5b605eb189828f0afe Mon Sep 17 00:00:00 2001
From: Martin Fischer <martin@push-f.com>
Date: Tue, 26 Sep 2023 08:22:21 +0200
Subject: fix(tokenizer): don't lowercase temp chars in ScriptDataEndTagName

This bug resulted in e.g. "<script></SCRI" being wrongly tokenized as:

    StartTag(StartTag { name: "script", self_closing: false, attributes: {} })
    Char('<')
    Char('/')
    Char('s')
    Char('c')
    Char('r')
    Char('i')
    EndOfFile

Note that the Char tokens should be uppercase. (This bug could only be
observed when properly doing state switching via tree construction.)
---
 CHANGELOG.md             | 5 +++++
 src/tokenizer/machine.rs | 2 +-
 2 files changed, 6 insertions(+), 1 deletion(-)

diff --git a/CHANGELOG.md b/CHANGELOG.md
index b05e51f..2702e96 100644
--- a/CHANGELOG.md
+++ b/CHANGELOG.md
@@ -14,6 +14,11 @@
 
 * Added a blanket implementation to implement `Reader` for boxed readers.
 
+#### Fixes
+
+* Removed incorrect lowercasing of char tokens when
+  an eof-in-tag error occurred in a `</script>` tag.
+
 #### Breaking changes
 
 * Byte offsets were moved out of the `Token` enum into a new `Trace` enum.
diff --git a/src/tokenizer/machine.rs b/src/tokenizer/machine.rs
index 944eb01..100f645 100644
--- a/src/tokenizer/machine.rs
+++ b/src/tokenizer/machine.rs
@@ -428,7 +428,7 @@ where
             }
             Some(x) if x.is_ascii_alphabetic() => {
                 slf.push_tag_name(ctostr!(x.to_ascii_lowercase()));
-                slf.temporary_buffer.push(x.to_ascii_lowercase());
+                slf.temporary_buffer.push(x);
                 Ok(ControlToken::Continue)
             }
             c => {
-- 
cgit v1.2.3