tensor_parallel icon indicating copy to clipboard operation
tensor_parallel copied to clipboard

No implement of generate() when using models from hugging face.

Open 342215448 opened this issue 2 years ago • 0 comments

What an amazing work, however, when I tried to inference kosmos model from hugging face, there was an error: NotImplementedError: A model class needs to define a prepare_inputs_for_generation method in order to use .generate().

342215448 avatar Nov 14 '23 12:11 342215448