ml-stable-diffusion
ml-stable-diffusion copied to clipboard
numerical tokenization seems a miss
groups of numbers do not appear to be tokenized as a single weight.
i.e. 22 will parse to 2 and 2.
Here's evidence, but haven't had the chance to look through code of the tokenzier yet.