[pymvpa] Crossvalidation and permutation scheme on one run only

[Richard Dinga]

Hi,
I am running within subject searchlight on fast eventrelated data collected
only in one run per subject. Therefore no naturally independent blocks to
do my crossvalidation on. So far I thought about 3 approaches:

1. delete 20 seconds of data between training and test set
2. don't do anything and perform 10 fold CV without any adjustments
3. use some non CV based statistic like correlation distance

although 2 and 3 doesn’t seems reasonable.

Also, I would like to do a permutation test to find out if my results are
significant, but I am not sure how to set up a permutation scheme since it
seems like everything is dependent and nothing is exchangeable.

Any suggestions what to do in this situation?
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.alioth.debian.org/pipermail/pkg-exppsy-pymvpa/attachments/20160530/d0a9cce9/attachment.html>