basic_rs icon indicating copy to clipboard operation
basic_rs copied to clipboard

Fully implement insignificant spaces in Scanner

Open yiransheng opened this issue 7 years ago • 0 comments

Currently, scanner is somewhat spaces insensitive, it can recognize tokens like "L E T".

However, certain cases are not covered, such as "< =".

Do a full audit, and make sure spaces are skipped when needed, and add unit tests for all token types.

yiransheng avatar Jan 10 '19 03:01 yiransheng