[pymvpa] General Question about Evaluating Results form a Multiclass Problem
Hanson, Gavin Keith
ghanson0 at ku.edu
Wed Aug 13 22:45:44 UTC 2014
I’m just wondering if anyone has any advice on some ways to deal with evaluating classifier performance on a 4-way problem.
I’ve been using the BayesConfusionHypothesis tool which works quite well, but I just wondered what else was out there by way of quantitative evidence to insure that classifier accuracy isn’t being driven by perfect classification between 2 labels, and confusion between the other 2, or whatever. Just glancing at the confusion matrices can give us a good idea about what ROIs are confusing certain conditions, but a more objective solution would be nice.
The problem seems to be kinda sidestepped in some of the literature on pattern classification in MRI.
Gavin Hanson, B.S.
Department of Psychology
University of Kansas
1415 Jayhawk Blvd., 534 Fraser Hall
Lawrence, KS 66045
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the Pkg-ExpPsy-PyMVPA