Age | Commit message (Collapse) | Author | |
---|---|---|---|
2021-11-27 | split up match-arms and tokenizer to isolate some tokenizer-internal state | Markus Unterwaditzer | |
purpose: don't want to expose self.to_reconsume to the consume() method |
index : html5tokenizer | ||
Fork of html5gum with code span support |
aboutsummaryrefslogtreecommitdiff |
Age | Commit message (Collapse) | Author | |
---|---|---|---|
2021-11-27 | split up match-arms and tokenizer to isolate some tokenizer-internal state | Markus Unterwaditzer | |
purpose: don't want to expose self.to_reconsume to the consume() method |