[pymvpa] BayesConfusionHypothesis clarification

[Hanson, Gavin Keith]

Hi!
I did actually go ahead and try to implement this kind of analysis, and it appears to work very well!
I shuffled up the participant order for it, and found that it made no difference to 8 decimal places in the final posterior probabilities, which I assume is just rounding/float handling error.

I’d love to hear from Emanuele or another author of the tool to see if they have tried this kind of group analysis approach with the Bayes Confusion Hypothesis and what they might say about its validity, but it appears to be a viable approach to group analysis of classification performance and information content!

- Gavin

On Feb 16, 2014, at 3:21 AM, Michael Hanke <mih at debian.org> wrote:

> Hi,
> 
> On Tue, Feb 11, 2014 at 02:28:53AM +0000, Hanson, Gavin Keith wrote:
>> Hi all - I just want to make sure that I’m doing this right.
>> In the ‘default' implementation of the BayesConfusionHypothesis node, i.e.
>> 	cv = CrossValidation(clf, NFoldPartitioner(), errorfx=None, postproc=ChainNode([Confusion(labels=np.unique(ds.targets)), BayesConfusionHypothesis()]))
>> it’s set up to use a flat prior, correct?
>> If that’s the case, then if I have a set of participants and a nice anatomical ROI for each one, could I do a “group” bayesian hypothesis test for the information encoded in that ROI by chaining the posterior probabilities for one into the prior for the next, and the posterior for that into the prior of the next, etc? 
> 
> Sounds like a viable approach to me. You'd probbaly need to account for
> potential order effects.
> 
>> And if yes, then is the prior_Hs argument looking for an array of probabilities, or log probabilities? 
>> Finally, if I insure that my targets are in the same relative order for each subject - that is, ds.UT is in the same order for everyone, can I safely assume that I don’t need to explicitly pass a list of hypotheses to the ‘hypotheses' argument every time to make sure my array of priors is lining up with the appropriate hypotheses?
> 
> Maybe Emanuele -- the author of this functionality could comment on the
> details?
> 
> Cheers,
> 
> Michael
> 
> -- 
> Michael Hanke
> http://mih.voxindeserto.de
> 
> _______________________________________________
> Pkg-ExpPsy-PyMVPA mailing list
> Pkg-ExpPsy-PyMVPA at lists.alioth.debian.org
> http://lists.alioth.debian.org/cgi-bin/mailman/listinfo/pkg-exppsy-pymvpa