HiDhineshRaja

icon indicating an email [email protected]

icon location Bangalore, India

Results 1 comments of HiDhineshRaja

Maximum input token count 4919 exceeds limit of 4096 for train data in 03_Model_customization/03_continued_pretraining_titan_text.ipynb

I too face the same issue. I tried to reduce the chunksize to 10000 even though getting the same error after training about 2 hours