[pymvpa] extracting individual sample predictions from CV

Brian Murphy brian.murphy at unitn.it
Thu Jun 2 15:23:11 UTC 2011


Hi,

I've got a feeling this has already been mentioned on the list before, 
but can't find the relevant posts...

My question is, in a cross-validated training/testing and is there a 
built-in way to access the whole list of individual predictions for each 
sample, in the original sample order (rather getting the predictions 
separately for each fold, and recombining them by hand)?

... such that float(sum(ds.targets==predictions))/len(ds.targets) would 
give you the accuracy rate ...

And is there a standard way of getting the measure of confidence of the 
classifier in each prediction (binary, in my current case). This must be 
classifier specific, but I guess that GNB should give a probability for 
each of it's classifications.

thanks for any tips!

Brian



More information about the Pkg-ExpPsy-PyMVPA mailing list