markdown-it-py icon indicating copy to clipboard operation
markdown-it-py copied to clipboard
verified publisher icon executablebooks

Check code base for UTF-16

Open chrisjsewell opened this issue 5 years ago • 1 comments

@chrisjsewell can you think of any other places in the codebase where this Javascript string (string of UTF-16 code units) versus Python3 string (string of Unicode codepoints) difference could cause issues.

I just realized we unintentionally fixed one instance of this in https://github.com/executablebooks/markdown-it-py/pull/70 :smile: The old entity data seemed to contain UTF-16 code units.

Originally posted by @hukkinj1 in https://github.com/executablebooks/markdown-it-py/issues/81#issuecomment-732506120

chrisjsewell avatar Dec 13 '20 11:12 chrisjsewell

https://github.com/tsutsu3/uc.micro-py seems like a place where an error like this might have slipped in.

hukkin avatar Dec 15 '20 18:12 hukkin