[Python-modules-team] Bug#921463: python3-dask: recursion problem

[Ruano Ruano Javier]

Hello Diane,
The exact message is:

args2 = [_get_recursive(dsk, k, cache) for k in args]
  File "/usr/lib/python3/dist-packages/dask/core.py", line 136, in <listcomp>
    args2 = [_get_recursive(dsk, k, cache) for k in args]
  File "/usr/lib/python3/dist-packages/dask/core.py", line 132, in _get_recursive
    res = cache[x] = _get_recursive(dsk, dsk[x], cache)
  File "/usr/lib/python3/dist-packages/dask/core.py", line 128, in _get_recursive
    hashable = ishashable(x)
  File "/usr/lib/python3/dist-packages/dask/core.py", line 20, in ishashable
    hash(x)
RecursionError: maximum recursion depth exceeded while calling a Python object

I have used the
for i in listIndex:
    daskdataframe.loc[i].values.compute()

The daskdataframe is from a read_csv and the csv has 2.5 Gb Volume.


5 feb. 2019 22:53, Diane Trout <diane at ghic.org> escribió:

Could send me a small test program that triggers the bug?

I'll try looking at it and sending it upstream.

Thanks,
Diane

On Tue, 2019-02-05 at 20:33 +0100, javierruano wrote:
> Package: python3-dask
> Version: 1.0.0+dfsg-2
> Severity: normal
> Tags: lfs
>
> Dear Maintainer,
>
> *** Reporter, please consider answering these questions, where
> appropriate ***
> At the operation compute to dask.dataframe.
>   args2 = [_get_recursive(dsk, k, cache) for k in args]
>   File "/usr/lib/python3/dist-packages/dask/core.py", line 136, in
> <listcomp>
>     args2 = [_get_recursive(dsk, k, cache) for k in args]
>   File "/usr/lib/python3/dist-packages/dask/core.py", line 132, in
> _get_recursive
>
>  Information:
> Debian Release: buster/sid
>   APT prefers testing
>   APT policy: (500, 'testing'), (500, 'oldstable')
> Architecture: amd64 (x86_64)
>
> Kernel: Linux 4.18.0-3-amd64 (SMP w/8 CPU cores)
> Locale: LANG=en_GB.UTF-8, LC_CTYPE=en_GB.UTF-8 (charmap=UTF-8),
> LANGUAGE=en_GB:en (charmap=UTF-8)
> Shell: /bin/sh linked to /bin/dash
> Init: systemd (via /run/systemd/system)
> LSM: AppArmor: enabled
>
> Versions of packages python3-dask depends on:
> ii  python3        3.7.2-1
> ii  python3-toolz  0.9.0-1
>
> Versions of packages python3-dask recommends:
> ii  python3-cloudpickle  0.5.6-1
> ii  python3-numpy        1:1.16.1-1
> ii  python3-pandas       0.23.3-1
> ii  python3-partd        0.3.9-1
> ii  python3-requests     2.20.0-2
>
> Versions of packages python3-dask suggests:
> pn  ipython              <none>
> pn  python-dask-doc      <none>
> pn  python3-bcolz        <none>
> ii  python3-blosc        1.7.0+ds1-1
> pn  python3-boto         <none>
> pn  python3-distributed  <none>
> pn  python3-graphviz     <none>
> pn  python3-h5py         <none>
> ii  python3-psutil       5.5.0-1
> ii  python3-scipy        1.1.0-2
> pn  python3-skimage      <none>
> ii  python3-sklearn      0.20.2+dfsg-6
> pn  python3-sqlalchemy   <none>
> ii  python3-tables       3.4.4-2
>
> -- no debconf information
>


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://alioth-lists.debian.net/pipermail/python-modules-team/attachments/20190205/f71f4a63/attachment-0002.html>