[pymvpa] Sensitivity analysis
Dai Xijian
dairenyihao at 126.com
Tue Sep 2 13:09:38 UTC 2014
Dear all,
I faced with an embarrassing situation. I have completed some sensitivity analysis. When I used the script like below, I achieved a discouraging accuracy rate:0.51267.
clf = LinearCSVMC()
cv = CrossValidation(clf, NFoldPartitioner(), errorfx = lambda p,t:np.mean(p==t), enable_ca=['stats'],postproc = mean_sample())
sensana = clf.get_sensitivity_analyzer()
cv_sensana = RepeatedMeasure(sensana, ChainNode((NFoldPartitioner(), Splitter('partitions', attr_values=(1,)))))
acc = cv(ds)
sensmap_cv = cv_sensana(ds)
Then I want to improve the accuracy. So I firstly select 20% features which contributed most for the predicted accuracy. However, I achieved a lower accuracy rate:0.40268.
fsel = SensitivityBasedFeatureSelection(OneWayAnova(),FractionTailSelector(0.2,mode='select',tail='upper'))
fclf = FeatureSelectionClassifier(clf, fsel)
cv_sel = CrossValidation(fclf,NFoldPartitioner(), errorfx = lambda p,t:np.mean(p==t),enable_ca=['stats'],postproc = mean_sample())
sensana_sel = fclf.get_sensitivity_analyzer()
cv_sensana_sel = RepeatedMeasure(sensana_sel, ChainNode((NFoldPartitioner(), Splitter('partitions', attr_values=(1,)))))
acc_sel = cv_sel(ds)
sensmap_cv_sel = cv_sensana_sel(ds)
What's wrong? Would you tell me?
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.alioth.debian.org/pipermail/pkg-exppsy-pymvpa/attachments/20140902/cdf5c973/attachment.html>
More information about the Pkg-ExpPsy-PyMVPA
mailing list