[pymvpa] MemoryError

Yaroslav Halchenko debian at onerussian.com
Fri Jun 25 21:28:03 UTC 2010


> Hi, All,

>    I've been trying to load large datasets into pymvpa (15000 samples,
> 32000 features) on a 64bit Centos machine with 32GB of ram.
32k after masking, right?

> NiftiDataset builds a data set but only fills the first 7065 data
> elements (the remaining elements are zeros). It doesn't return an
by elements, do you mean samples (0th dimension of .samples) or features (1st
dimension)?  or do you really mean first 7065 elements in unraveled
array of 480000000 elements?

> error message. I've verified that the mvpa, nifticlib, pynifti and
> numpy packages that we have installed are _64. Does anyone have any
> guesses for potential solutions?
what is the output of

mvpa.wtf()

?

have you tried load with plain pynifti and seeing either all data looks
ok?

-- 
                                  .-.
=------------------------------   /v\  ----------------------------=
Keep in touch                    // \\     (yoh@|www.)onerussian.com
Yaroslav Halchenko              /(   )\               ICQ#: 60653192
                   Linux User    ^^-^^    [175555]





More information about the Pkg-ExpPsy-PyMVPA mailing list