ttio2tech

I had do a simple fix for the GPTQ lib to make it work for LLaMA

1

It might be due to my python version (3.8). It complains about the string doesn't have .endwith method. But it seems from the GPTQ dependency library. I change the line...

difference between the paper and code

2

It seems that in your paper the train dataset is 'InstructorDoctor-205k' but in this repo, from the training command, the dataset is 'HealthCareMagic-100k.json' In the paper, the training was 'fine...

Thanks to this great work, I was able to self host the 7B version at [agireact.com](https://agireact.com) Can also access it via discord bot. [Server invite](https://discord.com/invite/SgmBydQ2Mn) Feel free to give it...

change seed from 1e7 to 10000000

1

I was using Python 3.12. but got an error 'TypeError: 'float' object cannot be interpreted as an integer". Seems the 1e7 caused the issue. changed it to int number.