factor initialization

Open bhomass opened this issue 7 years ago • 2 comments

Any one see the logic in how the factors were initialized? apparently using QR decomposition to obtain 2 orthogonal matrices, dot product them by the lower of the two matrix dimensions, then divide by the square root of (n_topics + n_dim)

Does this guarantee a simplex condition? what exactly does this calculation do for you?

Sep 10 '18 23:09 bhomass

found this

https://stackoverflow.com/questions/38426349/how-to-create-random-orthonormal-matrix-in-python-numpy

Sep 16 '18 06:09 bhomass

Having determined that the initialization aims to generate orthonormal random vectors, I see no basis in that requirement at all from the original paper. What would you want to impose orthogonality among the initial topic mixture?

Sep 16 '18 18:09 bhomass