[Reproducible-builds] Bug#833695: popularity-contest: http://popcon.debian.org/all-popcon-results.txt.gz contains

[Chris Lamb]

Package: popularity-contest
Version: 1.64
Severity: serious
X-Debbugs-CC: reproducible-builds at lists.alioth.debian.org

Hi,

Since (at least) 07-Aug-2016 14:04, the all-popcon-results.txt.gz file
contains an invalid line:

    Package: libfyba0-dbg                       0     2     0     0
--> Package: libf erdp-ommon                    0     0     0     1
    Package: libg++2.8.1.3-dbg                  0     0     0     1

That's (currently) line 54869. The "space" on the second line is actually
a 0xa0 character. This results in a few issues in dependent packages,
hence the RC severity.

$ python3
Python 3.5.2+ (default, Aug  5 2016, 08:07:14) 
[GCC 6.1.1 20160724] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import popcon
>>> popcon.package("foo")
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/lib/python3/dist-packages/popcon.py", line 145, in package
    raw = package_raw(*packages)
  File "/usr/lib/python3/dist-packages/popcon.py", line 189, in package_raw
    data = _fetch()
  File "/usr/lib/python3/dist-packages/popcon.py", line 108, in _fetch
    txt = _decompress(txt)
  File "/usr/lib/python3/dist-packages/popcon.py", line 134, in _decompress
    data = data.decode()
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xa0 in position 3574857: invalid start byte

You can see this happening here:

  https://jenkins.debian.net/view/reproducible/view/problems/job/reproducible_html_notes/

It also may also affect other packages:

  https://codesearch.debian.net/search?q=all-popcon-results.txt.gz&perpkg=1


Regards,

-- 
      ,''`.
     : :'  :     Chris Lamb
     `. `'`      lamby at debian.org / chris-lamb.co.uk
       `-