* Improve Markdown code block tokens
Code blocks without a language weren't tokenized.
Code blocks didn't have their ending ``` punctuation tokenized.
Code blocks used to only have one token. Now each block has the following tokens available for syntax highlighters:
- Starting and ending ``` punctuations
- Code block's language setting
- Code snippet
* Variable whitespace for MD code block ``` token
Allow for variable amount of whitespacing before ``` code blocks
* Reorder raw blocks
Raw blocks were preventing tokenizing as languaged blocks. Putting them on bottom resolves this.
* Fix MD block detection when following paragraph
Used to require a new line inbetween ``` code blocks and preceding paragraph text.
* Prevent broken language grammar leaks in MD fences
Prevents leaks in MD code fences while also capturing the closing fence punctuations.
* Update Markdown tokenizer test file
* Add rule for html comment in blocks
* Match common mark spec for html comments
* Updating tests and fixing some token names
* Fix style and script blocks
* Fix test file results
* Fixed markdown tests for new html logic
* Highlight Markdown Image Starting ! Puctuator
Issue #12835
Adds highlighting for the `!` that defines a markdown image link. This is colored the same as the `[` after it.
Closes#12835
* Fixed highlight test
