Skip to content

Conversation

gui-miotto
Copy link
Contributor

No description provided.

…bins in the GradientBostingClassifier. The by-the-book approach would be to generate new metalearning data, but the impact of not doing so, in this case, should be very small
@@ -35,7 +35,7 @@ def test_default_configuration_regression(self):
predictor = regressor.fit(X_train_trans, Y_train)
predictions = predictor.predict(X_test_trans)
accuracy = sklearn.metrics.mean_squared_error(predictions, Y_test)
self.assertAlmostEqual(accuracy, 20.193400000000004, places=2)
self.assertAlmostEqual(accuracy, 17.93480710955056, places=2)
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The accuracies decreased. Couldn't figure out why, even after carefully inspecting the list of changes.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The metric is actually misnamed. Could you please change the metric to error? Then it's clear that it actually improved by going to 0.22.2.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah! This is good news. :-)
I'll rename it.

res["default_boston_iterative_sparse"] = None
res["default_diabetes"] = 0.32614416980439365
res["default_diabetes_iterative"] = None
res["default_diabetes_sparse"] = 0.1298841767742679
res["default_diabetes_sparse"] = 0.12989753681434824
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Apparently ridge regression had a small bug when dealing with X sparse. It has been fixed in v0.22.
Model details here: scikit-learn/scikit-learn#13995

@codecov-io
Copy link

Codecov Report

Merging #774 into development will decrease coverage by 0.04%.
The diff coverage is n/a.

Impacted file tree graph

@@               Coverage Diff               @@
##           development     #774      +/-   ##
===============================================
- Coverage        85.37%   85.33%   -0.05%     
===============================================
  Files              129      129              
  Lines             9204     9204              
===============================================
- Hits              7858     7854       -4     
- Misses            1346     1350       +4
Impacted Files Coverage Δ
...omponents/data_preprocessing/data_preprocessing.py 86.58% <ø> (ø) ⬆️
...ipeline/components/regression/gradient_boosting.py 87.2% <ø> (ø) ⬆️
...ine/components/classification/gradient_boosting.py 93.47% <ø> (ø) ⬆️
autosklearn/__init__.py 80% <ø> (ø) ⬆️
..._preprocessing/select_percentile_classification.py 82.75% <0%> (-6.9%) ⬇️
autosklearn/automl.py 81.63% <0%> (-0.37%) ⬇️
autosklearn/evaluation/abstract_evaluator.py 89.87% <0%> (+0.84%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 355fbea...e0a0511. Read the comment docs.

@mfeurer mfeurer merged commit b662db3 into automl:development Feb 12, 2020
@gui-miotto gui-miotto deleted the sklearn22 branch March 16, 2020 09:46
franchuterivera pushed a commit to franchuterivera/auto-sklearn that referenced this pull request Aug 21, 2020
* initial commit

* fix some unittests

* Edit configurations.csv to reflect the new value of the hyperpar max_bins in the GradientBostingClassifier. The by-the-book approach would be to generate new metalearning data, but the impact of not doing so, in this case, should be very small

* fixed some more unittests

* fixed some more unit tests

* changed assert values of the unit test of the extra_tree_regression feature preprocessing

* small variable renaming

* trying to fix the CI issue that makes all tests be executed before the examples

* Revert "trying to fix the CI issue that makes all tests be executed before the examples"

This reverts commit 0bb7f2a.

* try again to fix the CI issue

* try again to fix the CI issue

* trying to fix CI issue

* corrects typo
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants