Reg cocktails

[ravinkohli]

Types of changes

• [x] Breaking change (fix or feature that would cause existing functionality to not work as expected)

Note that a Pull Request should only contain one of refactoring, new features or documentation changes. Please separate these changes and send us individual PRs for each. For more information on how to create a good pull request, please refer to The anatomy of a perfect pull request.

Checklist:

• [x] My code follows the code style of this project.
• [x] My change requires a change to the documentation.
• [ ] I have updated the documentation accordingly.

• [x] Have you checked to ensure there aren't other open Pull Requests for the same update/change?
• [x] Have you added an explanation of what your changes do and why you'd like us to include them?
• [x] Have you written new tests for your core changes, as applicable?
• [x] Have you successfully ran tests with your changes locally?

Description

This PR contains code for the paper Regularization is all you need. The code is a duplicate of refactor_development_regularization_cocktails but it has been rebased with the development branch. It has not yet been benchmarked and compared to the refactor_development_regularization_cocktails, so there are no performance guarantees but it serves as the default branch for further works on Regularization Cocktails. It is not to be merged yet.

Motivation and Context

This PR is not to be merged right now.

How has this been tested?

I have added tests to ensure the basic functionality of the cocktails are working on top of the tests already present in development but they can and will definitely be improved.

[codecov[bot]]

Codecov Report

Base: 85.50% // Head: 85.16% // Decreases project coverage by -0.33% :warning:

Coverage data is based on head (34c704d) compared to base (0e574af). Patch coverage: 82.71% of modified lines in pull request are covered.

:exclamation: Current head 34c704d differs from pull request most recent head 873df9a. Consider uploading reports for the commit 873df9a to get more accurate results

Additional details and impacted files

@@               Coverage Diff               @@
##           development     #358      +/-   ##
===============================================
- Coverage        85.50%   85.16%   -0.34%     
===============================================
  Files              231      240       +9     
  Lines            16303    17059     +756     
  Branches          3009     3155     +146     
===============================================
+ Hits             13940    14529     +589     
- Misses            1524     1653     +129     
- Partials           839      877      +38     

Impacted Files	Coverage Δ
autoPyTorch/api/tabular_regression.py	100.00% <ø> (ø)
autoPyTorch/api/time_series_forecasting.py	59.15% <0.00%> (-3.54%)	:arrow_down:
autoPyTorch/data/base_target_validator.py	98.07% <ø> (ø)
autoPyTorch/datasets/base_dataset.py	80.14% <ø> (-0.14%)	:arrow_down:
autoPyTorch/datasets/resampling_strategy.py	96.15% <ø> (ø)
autoPyTorch/evaluation/tae.py	69.84% <ø> (ø)
autoPyTorch/evaluation/train_evaluator.py	87.50% <ø> (ø)
autoPyTorch/optimizer/smbo.py	75.91% <ø> (-4.53%)	:arrow_down:
.../tabular_preprocessing/TabularColumnTransformer.py	74.46% <ø> (ø)
...nents/preprocessing/tabular_preprocessing/utils.py	100.00% <ø> (ø)
... and 91 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.