Skip to content

pydvl.valuation.utility

This module contains classes to manage and learn utility functions for the computation of values.

[Utility][pydvl.valuation.utility.Utility] holds information about model, data and scoring function (the latter being what one usually understands under utility in the general definition of Shapley value). Model-based evaluation methods define the utility as a retraining of the model on a subset of the data, which is then scored. Please see the documentation on Computing Data Values for more information.

Utilities can be automatically cached across machines when the cache is so configured and enabled upon construction.

DataUtilityLearning adds support for learning the scoring function to avoid repeated re-training of the model to compute the score.