Training for New Models

[marionchychy]

Hi there,

I love your work, I want to commit back some changes to help improve this.

My main issue is I'm having a very hard time figuring out how to use main_experiment/ to create new classifiers

Let's say I have a 50k dataset for GPT4

How would I specifically use the tools in /main_experiment to create a new n-gram-probability file and an updated lightgbm file as well?

Thank you