ml-aim icon indicating copy to clipboard operation
ml-aim copied to clipboard

what "offline tokenizers" have you tried?

Open xiabingquan opened this issue 1 year ago • 0 comments

Hi there. Thanks for the great work. In the paper, you mentioned that "We also consider a cross-entropy loss with patches converted to discrete tokens using an offline tokenizer". Recently, I've been working on a relevant project in which I want to tokenize images into discretized tokens in an unsupervised way (e.g. VQ-GAN). I'm wondering what offline tokenizers you've tried. Any help will be appreciated. Thanks!😀

xiabingquan avatar Mar 07 '24 08:03 xiabingquan