TopicModelsVB.jl icon indicating copy to clipboard operation
TopicModelsVB.jl copied to clipboard

Perplexity score

Open ValeriiBaidin opened this issue 5 years ago • 6 comments

Hi. I am sorry to bother you. What is the best way to get the perplexity score of the model (page 1008 http://www.cs.columbia.edu/~blei/papers/BleiNgJordan2003.pdf)

Thank you so much.

ValeriiBaidin avatar Nov 13 '20 20:11 ValeriiBaidin

Hi Valerii,

So the package doesn't currently have functionality for evaluation metrics. It's something you would need to implement yourself.

ericproffitt avatar Nov 13 '20 20:11 ericproffitt

Hi, @ericproffitt ,

I'm looking to implement a Coherence Score function or two to test out some models. Would you want me to put in a PR with those integrated here?

mrufsvold avatar Jan 21 '22 15:01 mrufsvold

Hi @mrufsvold,

Sure, if you'd like to, please add the functions at the bottom of the modelutils.jl file.

ericproffitt avatar Jan 23 '22 03:01 ericproffitt

Hey, @ericproffitt ! I finished my code, but I can't publish a branch to this repository, so I can't put in a PR. This is my first time submitting a PR to someone else's project so I'm not sure if I'm doing something wrong or if you have permissions locked down. Would you mind letting me know how best to submit the code?

mrufsvold avatar Feb 03 '22 16:02 mrufsvold

@mrufsvold You need to fork the repo and create your own branch, then open a pull request to merge changes on your branch into master. There are tutorials you can find online, this one for example: https://opensource.com/article/19/7/create-pull-request-github.

ericproffitt avatar Feb 03 '22 23:02 ericproffitt

Thanks, @ericproffitt . See #41

mrufsvold avatar Feb 04 '22 02:02 mrufsvold