Gerald Woo
Gerald Woo
Input normalization - https://github.com/SalesforceAIResearch/pretrain-time-series-cloudops/blob/bf24685d894fe41973d20831430ef6a0324b5d54/pretraining/model/backbone/masked_encoder.py#L273-L274 Output normalization (loss) - https://github.com/SalesforceAIResearch/pretrain-time-series-cloudops/blob/bf24685d894fe41973d20831430ef6a0324b5d54/pretraining/model/backbone/masked_encoder.py#L451 Output normalization (predict) - https://github.com/SalesforceAIResearch/pretrain-time-series-cloudops/blob/bf24685d894fe41973d20831430ef6a0324b5d54/pretraining/model/backbone/masked_encoder.py#L543
Hey, thanks for the interest. Sure, I could work on adding these models to the repo - any particular models that you're looking at apart from PatchTST? It might take...
`forward` implements the standard pytorch forward function for forecasting. `create_predictor` returns a gluonts Predictor object, which applies will apply various data transformations given a dataset, and return an iterator of...
The checkpoint from MoiraiPretrain is used to load into MoiraiForecast, so in that sense, they are consistent. There are differences in processing the inputs to each object.
self.out_features_ls should be [8, 16, 32, 64, 128] based on the current hyperparameters. Not too sure what is the weights_logits that you are referring to. out_feat_size is a tensor representing...
I see.. I think I get what you mean, will look into it, thanks!
Seems like this is a pretty major bug, fixing it would make predictions with patch size 8, 16 (with the current configuration) have better outputs, and improve performance for low...
Firstly, you can check out the fine-tuning section in the README to get familiar with how to run a fine-tuning job. Then, to change the loss function, you can specify...
You could call `distr.mean` and feed it to the loss function. Not too sure how that will work out though. Some alternatives: 1. Fine-tune with the NLL, you can still...
Hey, thanks for catching this. I think you're right, it should be `prediction_length // patch_size`, will look into this.