8000 Added gini coefficient to ranking and scorer by tagomatech · Pull Request #10084 · scikit-learn/scikit-learn · GitHub
[go: up one dir, main page]

Skip to content

Added gini coefficient to ranking and scorer #10084

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 4 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions sklearn/metrics/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -14,6 +14,7 @@
from .ranking import roc_curve
from .ranking import dcg_score
from .ranking import ndcg_score
from .ranking import gini

from .classification import accuracy_score
from .classification import classification_report
Expand Down
30 changes: 30 additions & 0 deletions sklearn/metrics/ranking.py
Original file line number Diff line number Diff line change
Expand Up @@ -858,3 +858,33 @@ def ndcg_score(y_true, y_score, k=5):
scores.append(actual / best)

return np.mean(scores)


def gini(y_true, y_score):
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Perhaps name this gini_score for consistency

""" Compute Gini coefficient

Compute the Gini coefficient as Gini = 2 × AUC - 1 [1].

Parameters
----------

y_true : array, shape = [n]
Actual target values for X.

y_score : array, shape = [n]
Probability estimates of the positive class.

Returns
-------
gini : float

References
----------
.. [1] David J. Hand and Robert J. Till (2001).
A Simple Generalisation of the Area Under the ROC Curve for
Multiple Class Classification Problems. In Machine Learning, 45,
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Your implementation does not currently extend to multiclass. You have merely implemented a chance corrected binary roc

pp.171–186 (Kluwer Academic Publishers).

"""

return 2*roc_auc_score(y_true, y_score)-1
2 changes: 1 addition & 1 deletion sklearn/metrics/scorer.py
Original file line number Diff line number Diff line change
Expand Up @@ -514,7 +514,7 @@ def make_scorer(score_func, greater_is_better=True, needs_proba=False,
log_loss_scorer = make_scorer(log_loss, greater_is_better=False,
needs_proba=True)
log_loss_scorer._deprecation_msg = deprecation_msg

gini_scorer = make_scorer(gini, greater_is_better=True)

# Clustering scores
adjusted_rand_scorer = make_scorer(adjusted_rand_score)
Expand Down
0