谁能告诉我我的代码有什么问题?为什么我可以使用LinearRegression来预测鸢尾花数据集的概率,而KNeighborsClassifier却只给我0或1的结果,而它应该像LinearRegression那样给出结果呢?
from sklearn.datasets import load_irisfrom sklearn import metricsiris = load_iris()X = iris.datay = iris.targetfor train_index, test_index in skf: X_train, X_test = X_total[train_index], X_total[test_index] y_train, y_test = y_total[train_index], y_total[test_index]from sklearn.linear_model import LogisticRegressionln = LogisticRegression()ln.fit(X_train,y_train)ln.predict_proba(X_test)[:,1]
array([ 0.18075722, 0.08906078, 0.14693156, 0.10467766, 0.14823032, 0.70361962, 0.65733216, 0.77864636, 0.67203114, 0.68655163, 0.25219798, 0.3863194 , 0.30735105, 0.13963637, 0.28017798])
from sklearn.neighbors import KNeighborsClassifierknn = KNeighborsClassifier(n_neighbors=5, algorithm='ball_tree', metric='euclidean')knn.fit(X_train, y_train)knn.predict_proba(X_test)[0:10,1]
array([ 0., 0., 0., 0., 0., 1., 1., 1., 1., 1.])
回答:
因为KNN对概率的概念非常有限。它的估计只是基于最近邻居投票的比例。增加邻居数量到15或100,或者查询靠近决策边界的点,你会看到更多样化的结果。目前你的点总是有5个相同标签的邻居(因此概率为0或1)。