tensor_parallel
tensor_parallel copied to clipboard
No implement of generate() when using models from hugging face.
What an amazing work, however, when I tried to inference kosmos model from hugging face, there was an error:
NotImplementedError: A model class needs to define a prepare_inputs_for_generation method in order to use .generate().