Bug#889539: pandas FTBFS: test failures

[Lumin]

Hi Andreas,

On 6 February 2018 at 11:10, Andreas Tille <andreas at an3as.eu> wrote:

> you did a really good job on latest pandas issues.  Do you think you can
> have a look at this problem as well?

I found no related upsteam issue about the failed tests. However there are
some links that might be useful:

https://stackoverflow.com/questions/40659212/futurewarning-elementwise-comparison-failed-returning-scalar-but-in-the-futur
https://stackoverflow.com/questions/15777951/how-to-suppress-pandas-future-warning

I noticed these lines [1] in the test log. The failures seem to be
numpy issues again
according to the stackoverflow answers.

Apart from that, the pandas packaging needs a patch [2] to reduce
autopkgtest failures.


> BTW, to upgrade pandas to the latest upstream version python-moto is
> needed.  I prepared the packaging (#777089) and may be there is only a
> minor issue to finalise this (see [1]).  It might be a sensible strategy
> To upgrade to latest pandas upstream to not spent to much time on the
> old code - however, I have no idea about compatibility issues of all of
> its rdepends.

I checked and tried to build that package. Feedbacks were sent in
another mail. I think the 0.20.3-12 upload is not necessary as long as
we manage to build the new pandas before the removal, because
there is no obvious bug in pandas itself -- the patch for -12 will be
workarounds to those external problems.


[1] debian/tmp/usr/lib/python2.7/dist-packages/pandas/tests/dtypes/test_missing.py::test_array_equivalent_compat
  /usr/lib/python2.7/dist-packages/numpy/core/numeric.py:2604:
FutureWarning: elementwise == comparison failed and returning scalar
instead; this will raise an error or perform elementwise comparison in
the future.
    return bool(asarray(a1 == a2).all())

debian/tmp/usr/lib/python2.7/dist-packages/pandas/tests/frame/test_analytics.py::TestDataFrameAnalytics::()::test_corr_int_and_boolean
  /usr/lib/python2.7/dist-packages/scipy/stats/stats.py:3577:
RuntimeWarning: invalid value encountered in double_scalars
    size * (size - 1) * (size - 2))

debian/tmp/usr/lib/python2.7/dist-packages/pandas/tests/plotting/test_boxplot_method.py::TestDataFramePlots::()::test_boxplot_legacy
  /usr/lib/python2.7/dist-packages/numpy/core/fromnumeric.py:57:
FutureWarning: reshape is deprecated and will raise in a subsequent
release. Please use .values.reshape(...) instead
    return getattr(obj, method)(*args, **kwds)
  /usr/lib/python2.7/dist-packages/numpy/core/fromnumeric.py:57:
FutureWarning: reshape is deprecated and will raise in a subsequent
release. Please use .values.reshape(...) instead
    return getattr(obj, method)(*args, **kwds)
  /usr/lib/python2.7/dist-packages/numpy/core/fromnumeric.py:57:
FutureWarning: reshape is deprecated and will raise in a subsequent
release. Please use .values.reshape(...) instead
    return getattr(obj, method)(*args, **kwds)
  /usr/lib/python2.7/dist-packages/numpy/core/fromnumeric.py:57:
FutureWarning: reshape is deprecated and will raise in a subsequent
release. Please use .values.reshape(...) instead
    return getattr(obj, method)(*args, **kwds)
  /usr/lib/python2.7/dist-packages/numpy/core/fromnumeric.py:57:
FutureWarning: reshape is deprecated and will raise in a subsequent
release. Please use .values.reshape(...) instead
    return getattr(obj, method)(*args, **kwds)
  /usr/lib/python2.7/dist-packages/numpy/core/fromnumeric.py:57:
FutureWarning: reshape is deprecated and will raise in a subsequent
release. Please use .values.reshape(...) instead
    return getattr(obj, method)(*args, **kwds)
  /usr/lib/python2.7/dist-packages/numpy/core/fromnumeric.py:57:
FutureWarning: reshape is deprecated and will raise in a subsequent
release. Please use .values.reshape(...) instead
    return getattr(obj, method)(*args, **kwds)
  /usr/lib/python2.7/dist-packages/numpy/core/fromnumeric.py:57:
FutureWarning: reshape is deprecated and will raise in a subsequent
release. Please use .values.reshape(...) instead
    return getattr(obj, method)(*args, **kwds)

debian/tmp/usr/lib/python2.7/dist-packages/pandas/tests/plotting/test_boxplot_method.py::TestDataFramePlots::()::test_boxplot_axis_limits
  /usr/lib/python2.7/dist-packages/numpy/core/fromnumeric.py:57:
FutureWarning: reshape is deprecated and will raise in a subsequent
release. Please use .values.reshape(...) instead
    return getattr(obj, method)(*args, **kwds)

debian/tmp/usr/lib/python2.7/dist-packages/pandas/tests/plotting/test_datetimelike.py::TestTSPlot::()::test_irreg_hf
  /usr/lib/python2.7/dist-packages/matplotlib/cbook/deprecation.py:106:
MatplotlibDeprecationWarning: Adding an axes using the same arguments
as a previous axes currently reuses the earlier instance.  In a future
version, a new instance will always be created and returned.
Meanwhile, this warning can be suppressed, and the future behavior
ensured, by passing a unique label to each axes instance.
    warnings.warn(message, mplDeprecation, stacklevel=1)
  /usr/lib/python2.7/dist-packages/_pytest/warnings.py:88:
UnicodeWarning: Warning is using unicode non convertible to ascii,
converting to a safe representation:
    /usr/lib/python2.7/dist-packages/matplotlib/cbook/deprecation.py:106:
MatplotlibDeprecationWarning: Adding an axes using the same arguments
as a previous axes currently reuses the earlier instance.  In a future
version, a new instance will always be created and returned.
Meanwhile, this warning can be suppressed, and the future behavior
ensured, by passing a unique label to each axes instance.
    warnings.warn(message, mplDeprecation, stacklevel=1)

[2]
diff --git a/debian/tests/control b/debian/tests/control
index 38521c8..ab54101 100644
--- a/debian/tests/control
+++ b/debian/tests/control
@@ -15,6 +15,7 @@ Depends: python-all,
          python-xlwt,
          python-bs4,
          python-html5lib,
+         python-pytest,
          xauth,
          xvfb

@@ -29,5 +30,6 @@ Depends: python3-all,
          python3-tk,
          python3-tz,
          python3-bs4,
+         python3-pytest,
          xauth,
          xvfb


-- 
Best,