gk-kd issues

Repositories
Issues
Comments

Results 1 issues of


                                            gk-kd

Unexpected inference results from Flan-T5 XXL converted to ctranslate2 with version 4.2.1 and 4.1.1 (using tensor parallel)

I'm using the Flan-t5 XXL of the shelf model in our project and for deployment we have converted it to ctranslate2 version using following command **ct2-transformers-converter --model ~/input_folder/ --output_dir ~/flant5_ct2/**...

bug