What would you like to say?
In skore, we leverage a cache mechanism when computing the metrics by storing the prediction of models.
However, we did not look closely at all the places where we should be implementing similar strategy.
We should investigate in which particular function / method implementing a caching mechanism would be beneficial for the user.
To provide an example:
- reimplementing the permutation feature importance with predictions caching would be beneficial to compute additional metrics.