Thomas E. Huang
Thomas E. Huang
We expect there to be tiny differences between runs, so the numbers won't be exactly the same. You can try rerunning the training to see what the results are.
The results could vary depending on your base model as well. We found the results to be fairly consistent with the same base model.
No, `ft-full` means fine-tuning the entire model rather than just the final layer.
It is working on my side. Can you double-check again?
What command are you running when using the demo? Seems like an issue on the demo side rather than the model.
Thanks for the detailed explanation. I'm actually asking for the command you used when running the `demo.py`. My suspicion of the issue is the demo, since your evaluation results are...
Oh, sorry I didn't see you already added the command you ran for the demo. It looks good to me, so I'll need to reproduce your issue on my side....
Apologies for the delay. Given that the demo works on the base model, that means the demo and model inference has no issues. That means the model itself has some...
Did you modify the code before running the demo? Seems like instead of the class name, the class ID is returned instead.
They should be available. If this is something that you need, we can provide that in the next update.