GLM
GLM copied to clipboard
THUDM
GLM (General Language Model)
I think it is suitable for Apple silicon M2 24G memory
I'm curious about the comparison of the three models on downstream tasks. Has anyone tried it?
According to the GLM paper, multi-task learning has two way, one is a mixture of the **blank infilling** object and the **sentence-level** objective, another is a mix of the **blank...
1. the repo contains pretrain_glm.py and scripts/ds_pretrain_nvidia.sh, and it got an args $1, so what is this $1？ is it the config_tasks/seq_blank.sh? 2. I want to know if the model...
My GPU is RTX3090 * 2, memory is 256g, and CPU is Intel (R) Xeon (R) gold 6230 CPU @ 2.10GHz. When I use the docker image glm-cuda112 provided to...
I read your paper with great interest. You seem to have a lot of novel ideas about how to improve the pretraining. Some of the scores are really impressive. I...
hi, i want to know how GLM can be adopted for ner task. By the way, does it perform well on text similarity task than bert? thx!
I found that the code in pretrain_glm.py is different from the description in your paper GLM, I don't know if I've misunderstood your code because there aren't many comments?
