AdaBoostClassifier
DashAI.back.models.scikit_learn.AdaBoostClassifier
AdaBoost classifier that adapts to misclassified samples iteratively.
AdaBoost fits a sequence of weak classifiers (decision stumps by default) on re-weighted training data, giving more weight to misclassified examples at each round. The final prediction is a weighted majority vote of all weak classifiers. AdaBoost is sensitive to noisy data and outliers.
Key hyperparameters include n_estimators, learning_rate, and
random_state. The implementation wraps scikit-learn's
AdaBoostClassifier.
References
- [1] Freund, Y. & Schapire, R.E. (1997). "A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting." Journal of Computer and System Sciences, 55(1), 119-139.
- [2] https://scikit-learn.org/stable/modules/generated/sklearn.ensemble.AdaBoostClassifier.html
Parameters
- n_estimators : integer, default=
50 - The maximum number of estimators at which boosting is terminated. In case of perfect fit, the learning procedure is stopped early.
- learning_rate : number, default=
1.0 - Weight applied to each classifier at each boosting iteration. A higher learning rate increases the contribution of each classifier.
- random_state, default=
None - The seed of the pseudo-random number generator. Pass an int for reproducible output, or None to not set a specific seed.