Summary:
- Support for a few more rare/legacy Perl syntax
- Tokenizer simplification, optimization and exception'ification
Details:
- Added support for the <<\EOF heredoc style
- Always create ->{type} in full-quote sections
- Converted more of the Tokenizer to use exceptions
- Optimized away a bunch of now-unneeded "or return undef"
- Optimized _set_token_class down to a single statement
- Inlined _set_token_class out of existance
- Cache and fast-clone PPI::Token::Whitespace->null
- Removed some superfluous parameter checks on private methods,
for conditions that would cause explosions and be noticed anyway.
- Removed the fancy options from PPI::Token::new