ml-aim
ml-aim copied to clipboard
what "offline tokenizers" have you tried?
Hi there. Thanks for the great work. In the paper, you mentioned that "We also consider a cross-entropy loss with patches converted to discrete tokens using an offline tokenizer". Recently, I've been working on a relevant project in which I want to tokenize images into discretized tokens in an unsupervised way (e.g. VQ-GAN). I'm wondering what offline tokenizers you've tried. Any help will be appreciated. Thanks!😀