| Age | Commit message (Collapse) | Author | |
|---|---|---|---|
| 2021-11-30 | add spans feature | Martin Fischer | |
| 2021-11-30 | refactor: make tests independent of TokenizerOpts::default() | Martin Fischer | |
| 2021-11-30 | remove pointless associated type from TokenSink trait | Martin Fischer | |
| 2021-11-30 | refactor: use assert_matches! instead of assert_eq! | Martin Fischer | |
| 2021-11-30 | refactor: put line numbers first in test tuples | Martin Fischer | |
| 2021-11-29 | set tokenization state depending on tag name | Martin Fischer | |
| 2021-11-29 | docs: fix link & remove outdated comment | Martin Fischer | |
| 2021-11-29 | remove Tokenizer::set_plaintext_state | Martin Fischer | |
| 2021-11-29 | refactor: use ? operator for explicit control flow | Martin Fischer | |
| 2021-11-29 | refactor: use std::ops::ControlFlow | Martin Fischer | |
| 2021-11-29 | refactor: move return out of go! to clarify flow | Martin Fischer | |
| #!/usr/bin/env python3 import re text = '' for line in open('src/tokenizer/mod.rs'): if '$me.emit_current' in line: text += re.sub('return (\$me.emit_current_tag\(\));', lambda x: x.group(1), line) elif '$me:ident' in line: text += re.sub('return (ProcessResult::Continue);', lambda x: x.group(1), line) else: text += re.sub('go!\(self: (to|consume_char_ref|emit_tag)', lambda x: 'return ' + x.group(), line) with open('src/tokenizer/mod.rs', 'w') as f: f.write(text) | |||
| 2021-11-29 | refactor: remove no longer needed macro rules | Martin Fischer | |
| 2021-11-29 | refactor: split up go! macro calls | Martin Fischer | |
| #!/usr/bin/env python3 import re def split_go(match): inner = match.group(1) stmts = inner.split(';') text = '{' for stmt in stmts: if stmt.startswith(' reconsume '): text += 'self.reconsume = true;' stmt = ' to' + stmt[len(' reconsume'):] text += 'go!(self:{});'.format(stmt) return text + '}' text = '' with open('src/tokenizer/mod.rs') as f: for line in f: if '$me:ident' in line: # skip macro rules text += line else: text += re.sub('go!\(self:(.*)\)', split_go, line) with open('src/tokenizer/mod.rs', 'w') as f: f.write(text) import subprocess subprocess.call(['cargo', 'fmt']) | |||
| 2021-11-29 | refactor: eliminate line wrapping in go! macro | Martin Fischer | |
| 2021-11-29 | refactor: slightly simplify go! DSL | Martin Fischer | |
| 2021-11-29 | stop exporting buffer_queue::SetResult | Martin Fischer | |
| 2021-11-29 | stop re-exporting Token & TagKind variants | Martin Fischer | |
| 2021-11-29 | stop exporting internal states module | Martin Fischer | |
| 2021-11-19 | feature gate named-entities (making phf optional) | Martin Fischer | |
| 2021-11-19 | make test sink also emit CharacterTokens & ParseError | Martin Fischer | |
| 2021-11-19 | format code with cargo fmt | Martin Fischer | |
| 2021-11-12 | fix compiler warning about semicolons in macros | Martin Fischer | |
| See https://github.com/rust-lang/rust/issues/79813. | |||
| 2021-04-08 | drop log dependency | Martin Fischer | |
| 2021-04-08 | drop mac dependency | Martin Fischer | |
| 2021-04-08 | drop tendril dependency | Martin Fischer | |
| 2021-04-08 | drop markup5ever dependency | Martin Fischer | |
| 2021-04-08 | merge Attribute from markup5ever | Martin Fischer | |
| 2021-04-08 | merge buffer_queue and smallcharset from markup5ever | Martin Fischer | |
| 2021-04-08 | depend on tendril directly (instead of markup5ever::tendril) | Martin Fischer | |
| 2021-04-08 | make dependencies on markup5ever explicit | Martin Fischer | |
| 2021-04-08 | import https://github.com/servo/html5ever | Martin Fischer | |
| commit d1206daa740305f55a5fa159e43eb33afc359cb4 | |||
 |
index : html5tokenizer | |
| Fork of html5gum with code span support |
| aboutsummaryrefslogtreecommitdiff |