[Python-modules-team] Bug#921463: Bug#921463: python3-dask: recursion problem

[Scott Kitterman]

This seems relevant:

https://github.com/python/typing/issues/523

Scott K


On Tuesday, February 05, 2019 11:02:56 PM Ruano Ruano Javier wrote:
> Hello Diane,
> The exact message is:
> 
> args2 = [_get_recursive(dsk, k, cache) for k in args]
>   File "/usr/lib/python3/dist-packages/dask/core.py", line 136, in
> <listcomp>
 args2 = [_get_recursive(dsk, k, cache) for k in args]
>   File "/usr/lib/python3/dist-packages/dask/core.py", line 132, in
> _get_recursive
 res = cache[x] = _get_recursive(dsk, dsk[x], cache)
>   File "/usr/lib/python3/dist-packages/dask/core.py", line 128, in
> _get_recursive
 hashable = ishashable(x)
>   File "/usr/lib/python3/dist-packages/dask/core.py", line 20, in
> ishashable
 hash(x)
> RecursionError: maximum recursion depth exceeded while calling a Python
> object
 
> I have used the
> for i in listIndex:
>     daskdataframe.loc[i].values.compute()
> 
> The daskdataframe is from a read_csv and the csv has 2.5 Gb Volume.
> 
> 
> 5 feb. 2019 22:53, Diane Trout <diane at ghic.org> escribió:
> 
> Could send me a small test program that triggers the bug?
> 
> I'll try looking at it and sending it upstream.
> 
> Thanks,
> Diane
> 
> On Tue, 2019-02-05 at 20:33 +0100, javierruano wrote:
> 
> > Package: python3-dask
> > Version: 1.0.0+dfsg-2
> > Severity: normal
> > Tags: lfs
> >
> >
> >
> > Dear Maintainer,
> >
> >
> >
> > *** Reporter, please consider answering these questions, where
> > appropriate ***
> > At the operation compute to dask.dataframe.
> > 
> >   args2 = [_get_recursive(dsk, k, cache) for k in args]
> >   File "/usr/lib/python3/dist-packages/dask/core.py", line 136, in
> > 
> > <listcomp>
> > 
> >     args2 = [_get_recursive(dsk, k, cache) for k in args]
> >   
> >   File "/usr/lib/python3/dist-packages/dask/core.py", line 132, in
> > 
> > _get_recursive
> >
> >
> >
> >  Information:
> > 
> > Debian Release: buster/sid
> > 
> >   APT prefers testing
> >   APT policy: (500, 'testing'), (500, 'oldstable')
> > 
> > Architecture: amd64 (x86_64)
> >
> >
> >
> > Kernel: Linux 4.18.0-3-amd64 (SMP w/8 CPU cores)
> > Locale: LANG=en_GB.UTF-8, LC_CTYPE=en_GB.UTF-8 (charmap=UTF-8),
> > LANGUAGE=en_GB:en (charmap=UTF-8)
> > Shell: /bin/sh linked to /bin/dash
> > Init: systemd (via /run/systemd/system)
> > LSM: AppArmor: enabled
> >
> >
> >
> > Versions of packages python3-dask depends on:
> > ii  python3        3.7.2-1
> > ii  python3-toolz  0.9.0-1
> >
> >
> >
> > Versions of packages python3-dask recommends:
> > ii  python3-cloudpickle  0.5.6-1
> > ii  python3-numpy        1:1.16.1-1
> > ii  python3-pandas       0.23.3-1
> > ii  python3-partd        0.3.9-1
> > ii  python3-requests     2.20.0-2
> >
> >
> >
> > Versions of packages python3-dask suggests:
> > pn  ipython              <none>
> > pn  python-dask-doc      <none>
> > pn  python3-bcolz        <none>
> > ii  python3-blosc        1.7.0+ds1-1
> > pn  python3-boto         <none>
> > pn  python3-distributed  <none>
> > pn  python3-graphviz     <none>
> > pn  python3-h5py         <none>
> > ii  python3-psutil       5.5.0-1
> > ii  python3-scipy        1.1.0-2
> > pn  python3-skimage      <none>
> > ii  python3-sklearn      0.20.2+dfsg-6
> > pn  python3-sqlalchemy   <none>
> > ii  python3-tables       3.4.4-2
> >
> >
> >
> > -- no debconf information
> >
> >
> 
> 
>