LL3DA icon indicating copy to clipboard operation
LL3DA copied to clipboard

Model use

Open KongFulu opened this issue 1 year ago • 3 comments

Hello, can this large model be used directly and if it takes how long it takes to train

KongFulu avatar Apr 13 '24 06:04 KongFulu

I mean how long do I need to train if I use my own computer (4060)

KongFulu avatar Apr 13 '24 06:04 KongFulu

We have uploaded the pre-trained weights of the 3D generalist at https://huggingface.co/CH3COOK/LL3DA-weight-release/tree/main. It might be challenging to train our model on a single 4060 GPU, because of the heavy CUDA memory usage of large language models. Instead, you might try training your own model with smaller LLM backbones, i.e. GPT2, OPT-125m, etc.

ch3cook-fdu avatar Apr 13 '24 06:04 ch3cook-fdu

Nice work, I wonder if the finetuned model will be released or not.

yitianlian avatar Apr 26 '24 07:04 yitianlian