how to training the model?

[lishu2006ll]

Found untrained code? Where is the training code and raw data set?

[pjrenzov]

I would like to know same.

[jianjiabailu]

I would like to know same too

[Pearces1997]

Bumping this, would also like to see the training code and dataset

[HaiderSaleem]

for anyone wondering for fine tuning Shap-E or Point-E, here is another project Cap3D. The devs have provided code for fine tuning.

cap3D/text-to-3D/finetune_shapE.py at main · crockwell/Cap3D

[chenyg59]

for anyone wondering for fine tuning Shap-E or Point-E, here is another project Cap3D. The devs have provided code for fine tuning.

cap3D/text-to-3D/finetune_shapE.py at main · crockwell/Cap3D

Does the finetune_shapE.py code have the whole model of shap-e trained? It seems to me that the code only trains the transformer and diffusion parts, omitting the first two layers of cross attention and patch embedding. I'm not sure if I'm understanding correctly? I see that the data loaded during training is latent_code, how is this latent_code obtained?

[Aut0matas]

It seems to me that the code only trains the transformer and diffusion parts, omitting the first two layers of cross attention and patch embedding.

That is the point of "fine-tuning", through which just the weights of qkv projections are updated.

I see that the data loaded during training is latent_code, how is this latent_code obtained?

Through the "3D Encoder" as described at Fig.2 in the paper.