FoundationVision
Can LlamaGen predict a [EOS] token when inferencing?
If I simply add a [eos] token after tokenizing a image for training, and when inferencing, if [eos] is predicted, the model then stops generating. Will it work? What's your thought on this, thx!
emm.. It will work but it will be just useless since the model will do the exact step during inference since the image has a fix latent size.
But it will be usefull if you want to training on different spatial ratio image and add the information as the start token
Hi~ Adding a special token to enable different aspect ratio image generation is very promising. We will try this idea if possible in the future. Thx !
Yes, And my another suggest based on my training in many t2i models, add cross attention instead of add the token to the front will produce more promising result.