StableLM icon indicating copy to clipboard operation
StableLM copied to clipboard

Is it feasible to combine diffusion models and language models to mimic divergent thinking?

Open win10ogod opened this issue 3 years ago • 2 comments

Does using a diffusion model in a language model increase the generality of the language model?

win10ogod avatar Apr 20 '23 04:04 win10ogod

The goal of diffusion models is to learn the latent structure of a dataset by modeling the way in which data points diffuse through the latent space. When used in text generation, it means learning language structure and semantics. I think it should be able to be used in text generation. But I'm not an industry person, just a hobbyist.

win10ogod avatar Apr 22 '23 02:04 win10ogod