TZeng20

Failing to load model using accelerate launch

5

Hi, Without using `accelerate launch`, I am able to load flan-t5-xxl and use it for inference without a problem ``` model_name = "google/flan-t5-xxl" tokenizer = AutoTokenizer.from_pretrained(model_name) model = T5ForConditionalGeneration.from_pretrained(model_name, device_map...

Cool project! Just a question about the yolo model, how is it used with reinforcement learning? Why is the output tensor of shape [10, 7, 7, 30]?

GPU and multiprocessing error with flask

2

Hi, I'm trying to use a spacy model with GPU + Flask/Gunicorn but run into trouble whenever there is some sort of multiprocessing. Is there a way to run Spacy...