Bug#983328: pandas: sparse test_from_coo fails with scipy 1.6.1

[Drew Parsons]

Source: pandas
Version: 1.1.5+dfsg-2
Severity: normal
Control: affects -1 src:scipy

scipy 1.6.1 has been uploaded to experimental.
pandas fails autopkgtest with this scipy version.

e.g. see
https://ci.debian.net/data/autopkgtest/unstable/amd64/p/pandas/10621452/log.gz

The error is a discrepant dtype in TestAccessor.test_from_coo:

__________________________ TestAccessor.test_from_coo __________________________

self = <pandas.tests.arrays.sparse.test_array.TestAccessor object at 0x7fb78e8d9700>

    @td.skip_if_no_scipy
    def test_from_coo(self):
        import scipy.sparse
    
        row = [0, 3, 1, 0]
        col = [0, 3, 1, 2]
        data = [4, 5, 7, 9]
        sp_array = scipy.sparse.coo_matrix((data, (row, col)))
        result = pd.Series.sparse.from_coo(sp_array)
    
        index = pd.MultiIndex.from_arrays([[0, 0, 1, 3], [0, 2, 1, 3]])
        expected = pd.Series([4, 9, 7, 5], index=index, dtype="Sparse[int]")
>       tm.assert_series_equal(result, expected)
E       AssertionError: Attributes of Series are different
E       
E       Attribute "dtype" are different
E       [left]:  Sparse[float64, nan]
E       [right]: Sparse[int64, 0]

/usr/lib/python3/dist-packages/pandas/tests/arrays/sparse/test_array.py:1196: AssertionError


scipy 1.6.1 fixed some sparse matrix errors,
https://docs.scipy.org/doc/scipy-1.6.1/reference/release.1.6.1.html

One of the fixes affects coo dtype,
https://github.com/scipy/scipy/pull/13403
Perhaps it's triggering the pandas test failure though I'm not certain.


v1.2.2 is the latest pandas release
Has this error in test_from_coo been fixed in that latest release?





-- System Information:
Debian Release: bullseye/sid
  APT prefers unstable
  APT policy: (500, 'unstable'), (1, 'experimental')
Architecture: amd64 (x86_64)
Foreign Architectures: i386

Kernel: Linux 5.10.0-3-amd64 (SMP w/8 CPU threads)
Kernel taint flags: TAINT_OOT_MODULE
Locale: LANG=en_AU.UTF-8, LC_CTYPE=en_AU.UTF-8 (charmap=UTF-8), LANGUAGE=en_AU:en
Shell: /bin/sh linked to /usr/bin/dash
Init: systemd (via /run/systemd/system)
LSM: AppArmor: enabled