How to list all scikit-learn classifiers that support predict_proba()

Question:

I need a list of all scikit-learn classifiers that support the predict_proba() method. Since the documentation provides no easy way of getting that information, how can get this programatically?

Asked By: Toby

||
Source

Answers:

from sklearn.utils import all_estimators

estimators = all_estimators()

for name, class_ in estimators:
    if hasattr(class_, 'predict_proba'):
        print(name)

You can also use CalibratedClassifierCV to make any classifier into one that has predict_proba.

This was asked before on SO, but I can’t find it, so you should be excused for the duplicate 😉

Answered By: Andreas Mueller

AdaBoostClassifier

BaggingClassifier

BayesianGaussianMixture

BernoulliNB

CalibratedClassifierCV

ComplementNB

DecisionTreeClassifier

ExtraTreeClassifier

ExtraTreesClassifier

GaussianMixture

GaussianNB

GaussianProcessClassifier

GradientBoostingClassifier

KNeighborsClassifier

LabelPropagation

LabelSpreading

LinearDiscriminantAnalysis

LogisticRegression

LogisticRegressionCV

MLPClassifier

MultinomialNB

NuSVC

QuadraticDiscriminantAnalysis

RandomForestClassifier

SGDClassifier

SVC

_BinaryGaussianProcessClassifierLaplace

_ConstantPredictor

Answered By: Farzad Amirjavid

Those who are facing module not found for all_estimators in newer version of sklearn. Kindly try the following

import sklearn
estimators = sklearn.utils.all_estimators(type_filter=None)
for name, class_ in estimators:
    if hasattr(class_, 'predict_proba'):
        print(name)

Output: 

AdaBoostClassifier
BaggingClassifier
BayesianGaussianMixture
BernoulliNB
CalibratedClassifierCV
CategoricalNB
ClassifierChain
ComplementNB
DecisionTreeClassifier
DummyClassifier
ExtraTreeClassifier
ExtraTreesClassifier
GaussianMixture
GaussianNB
GaussianProcessClassifier
GradientBoostingClassifier
GridSearchCV
HalvingGridSearchCV
HalvingRandomSearchCV
HistGradientBoostingClassifier
KNeighborsClassifier
LabelPropagation
LabelSpreading
LinearDiscriminantAnalysis
LogisticRegression
LogisticRegressionCV
MLPClassifier
MultiOutputClassifier
MultinomialNB
NuSVC
OneVsRestClassifier
Pipeline
QuadraticDiscriminantAnalysis
RFE
RFECV
RadiusNeighborsClassifier
RandomForestClassifier
RandomizedSearchCV
SGDClassifier
SVC
SelfTrainingClassifier
StackingClassifier
VotingClassifier
Answered By: Am_official

If you are interested in a spesific type of estimator(say classifier), you could go with:

import sklearn
estimators = sklearn.utils.all_estimators(type_filter="classifier")
for name, class_ in estimators:
if not hasattr(class_, ‘predict_proba’):
print(name)

Answered By: ExcelinEfendisi

Actual import code you can get actual import code with it (sklearn 1.0.2):

from sklearn.utils import all_estimators

estimators = all_estimators(type_filter='classifier')
for name, class_ in estimators:
    module_name = str(class_).split("'")[1].split(".")[1]
    class_name = class_.__name__
    print(f'from sklearn.{module_name} import {class_name}')

Output

from sklearn.ensemble import AdaBoostClassifier
from sklearn.ensemble import BaggingClassifier
from sklearn.naive_bayes import BernoulliNB
from sklearn.calibration import CalibratedClassifierCV
from sklearn.naive_bayes import CategoricalNB
from sklearn.multioutput import ClassifierChain
from sklearn.naive_bayes import ComplementNB
from sklearn.tree import DecisionTreeClassifier
from sklearn.dummy import DummyClassifier
from sklearn.tree import ExtraTreeClassifier
from sklearn.ensemble import ExtraTreesClassifier
from sklearn.naive_bayes import GaussianNB
from sklearn.gaussian_process import GaussianProcessClassifier
from sklearn.ensemble import GradientBoostingClassifier
from sklearn.ensemble import HistGradientBoostingClassifier
from sklearn.neighbors import KNeighborsClassifier
from sklearn.semi_supervised import LabelPropagation
from sklearn.semi_supervised import LabelSpreading
from sklearn.discriminant_analysis import LinearDiscriminantAnalysis
from sklearn.svm import LinearSVC
from sklearn.linear_model import LogisticRegression
from sklearn.linear_model import LogisticRegressionCV
from sklearn.neural_network import MLPClassifier
from sklearn.multioutput import MultiOutputClassifier
from sklearn.naive_bayes import MultinomialNB
from sklearn.neighbors import NearestCentroid
from sklearn.svm import NuSVC
from sklearn.multiclass import OneVsOneClassifier
from sklearn.multiclass import OneVsRestClassifier
from sklearn.multiclass import OutputCodeClassifier
from sklearn.linear_model import PassiveAggressiveClassifier
from sklearn.linear_model import Perceptron
from sklearn.discriminant_analysis import QuadraticDiscriminantAnalysis
from sklearn.neighbors import RadiusNeighborsClassifier
from sklearn.ensemble import RandomForestClassifier
from sklearn.linear_model import RidgeClassifier
from sklearn.linear_model import RidgeClassifierCV
from sklearn.linear_model import SGDClassifier
from sklearn.svm import SVC
from sklearn.ensemble import StackingClassifier
from sklearn.ensemble import VotingClassifier

List of classification estimators

from sklearn.utils import all_estimators

estimators = all_estimators(type_filter='classifier')
i = 0
for name, class_ in estimators:
    print(f'{i}. {class_.__name__}')
    i += 1

Output (41 estimators)

  1. AdaBoostClassifier
  2. BaggingClassifier
  3. BernoulliNB
  4. CalibratedClassifierCV
  5. CategoricalNB
  6. ClassifierChain
  7. ComplementNB
  8. DecisionTreeClassifier
  9. DummyClassifier
  10. ExtraTreeClassifier
  11. ExtraTreesClassifier
  12. GaussianNB
  13. GaussianProcessClassifier
  14. GradientBoostingClassifier
  15. HistGradientBoostingClassifier
  16. KNeighborsClassifier
  17. LabelPropagation
  18. LabelSpreading
  19. LinearDiscriminantAnalysis
  20. LinearSVC
  21. LogisticRegression
  22. LogisticRegressionCV
  23. MLPClassifier
  24. MultiOutputClassifier
  25. MultinomialNB
  26. NearestCentroid
  27. NuSVC
  28. OneVsOneClassifier
  29. OneVsRestClassifier
  30. OutputCodeClassifier
  31. PassiveAggressiveClassifier
  32. Perceptron
  33. QuadraticDiscriminantAnalysis
  34. RadiusNeighborsClassifier
  35. RandomForestClassifier
  36. RidgeClassifier
  37. RidgeClassifierCV
  38. SGDClassifier
  39. SVC
  40. StackingClassifier
  41. VotingClassifier
Answered By: Sinba
Categories: questions Tags: ,
Answers are sorted by their score. The answer accepted by the question owner as the best is marked with
at the top-right corner.