Lexer is removing chars

[anderson-joyle]

Lexer is removing chars from string inputs. This should work:

var expression = "\"AA" + char.ConvertFromUtf32(8203) + "BB\""; // expression.Length is 7
var tokens = TexlLexer.InvariantLexer.LexSource(expression, TexlLexer.Flags.None);
var stringToken = tokens[0] as StrLitToken; // stringToken.Legth 
Assert.Equal(stringToken.Value.Length, expression.Length - 2);