Alejandro Vaca

Results 33 comments of Alejandro Vaca

I'm also highly interested in this, is there any update?

I'm also looking forward to v3 pretrain code. Is it planned to be available anytime soon? @BigBird01 :) Thanks in advance!

@BigBird01 hey, any updates on this? 😄

I'm gonna add here the trials I do myself with the corresponding memory usage: dim = 1024, seq_len=8960, depth=12, heads=16, batch_size=1: 8501MiB

For making it easier, I put the full code here: `symspell.load_dictionary('CREA_total.TXT', term_index=0, count_index=1, separator='\t', encoding='latin-1') result = symspell.word_segmentation('holaadiós') `

I'm also getting black images as output after training on custom data. However, the first patch is in color. For my training, I used train_patch_size of 60 (my LR images...

That it doesn't generate (token id 11) when calling generate, therefore it never stops generating. I have tried by setting `eos_token_id` to 193, which corresponds to `\n`, but I don't...