ColossalAI
ColossalAI copied to clipboard
Is the BLOOM model supported? How to perform task tuning like medical model with LLaMA33B?
Hi @delltower Yes, BLOOM and LLaMA have been supported. https://github.com/hpcaitech/ColossalAI/tree/main/applications/Chat/examples#support-model Mainly by adding additional corresponding datasets