[Piuparts-devel] Bug#937293: Bug#919170: Bug#919170: Please update dependency to python3-debianbts

[Holger Levsen]

On Thu, Dec 26, 2019 at 11:26:31PM +0100, Nis Martensen wrote:
> On 26.12.2019 17.11, Holger Levsen wrote:
> > many thanks, merged and deployed, now this is left:
> 
> >   File "/srv/piuparts.debian.org/lib/python3/dist-packages/piupartslib/__init__.py", line 58, in readline
> >     empty = not self._refill()
> >   File "/srv/piuparts.debian.org/lib/python3/dist-packages/piupartslib/__init__.py", line 49, in _refill
> >     chunk = chunk.decode()
> > UnicodeDecodeError: 'utf-8' codec can't decode byte 0xc3 in position 14159: unexpected end of data
> 
> This did not happen in my test setup, but I have a theory of what is
> causing this. Could you check if
> https://salsa.debian.org/debian/piuparts/merge_requests/18
> fixes it?

indeed, this fixes it, but things still dont work, but on master I only
see this:

Traceback (most recent call last):
  File "/srv/piuparts.debian.org/share/piuparts/piuparts-master-backend", line 433, in <module>
    main()
  File "/srv/piuparts.debian.org/share/piuparts/piuparts-master-backend", line 425, in main
    while m.do_transaction():
  File "/srv/piuparts.debian.org/share/piuparts/piuparts-master-backend", line 268, in do_transaction
    self._commands[command](command, args)
  File "/srv/piuparts.debian.org/share/piuparts/piuparts-master-backend", line 323, in _reserve
    self._init_db()
  File "/srv/piuparts.debian.org/share/piuparts/piuparts-master-backend", line 202, in _init_db
    self._load_package_database(self._section)
  File "/srv/piuparts.debian.org/share/piuparts/piuparts-master-backend", line 219, in _load_package_database
    self._load_package_database(dep)
  File "/srv/piuparts.debian.org/share/piuparts/piuparts-master-backend", line 232, in _load_package_database
    config.get_arch()))
  File "/srv/piuparts.debian.org/lib/python3/dist-packages/piupartslib/packagesdb.py", line 455, in load_alternate_versions_from_packages_urls
    pf2.load_packages_urls(urls)
  File "/srv/piuparts.debian.org/lib/python3/dist-packages/piupartslib/packagesdb.py", line 181, in load_packages_urls
    (url, stream) = piupartslib.open_packages_url(url)
  File "/srv/piuparts.debian.org/lib/python3/dist-packages/piupartslib/__init__.py", line 96, in open_packages_url
    socket = urllib.request.urlopen(url + ext)
  File "/usr/lib/python3.7/urllib/request.py", line 222, in urlopen
    return opener.open(url, data, timeout)
  File "/usr/lib/python3.7/urllib/request.py", line 525, in open
    response = self._open(req, data)
  File "/usr/lib/python3.7/urllib/request.py", line 543, in _open
    '_open', req)
  File "/usr/lib/python3.7/urllib/request.py", line 503, in _call_chain
    result = func(*args)
  File "/usr/lib/python3.7/urllib/request.py", line 1345, in http_open
    return self.do_open(http.client.HTTPConnection, req)
  File "/usr/lib/python3.7/urllib/request.py", line 1320, in do_open
    r = h.getresponse()
  File "/usr/lib/python3.7/http/client.py", line 1321, in getresponse
    response.begin()
  File "/usr/lib/python3.7/http/client.py", line 296, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.7/http/client.py", line 257, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.7/socket.py", line 589, in readinto
    return self._sock.recv_into(b)
ConnectionResetError: [Errno 104] Connection reset by peer

and nothing really on the slave :/

so I dug depper on master and found that master was using mirror.bm.debian.org, which 
was shutdown recently and voila, it seems 0d44938b323e in develop branch was the last
bit to get piuparts working with python3 (hopefully, still needs more testing), 
and also the reason the (python2) stale branch broke recently.

So, piuparts.debian.org is running python3 code only now! At least for the piuparts service ;)

Thank you very much, Nis, for your help until here!

I do hope to do a final piuparts upload in 2019. We'll see if I manage during 36c3 ;)

-- 
cheers,
	Holger

-------------------------------------------------------------------------------
               holger@(debian|reproducible-builds|layer-acht).org
       PGP fingerprint: B8BF 5413 7B09 D35C F026 FE9D 091A B856 069A AA1C

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 833 bytes
Desc: not available
URL: <http://alioth-lists.debian.net/pipermail/piuparts-devel/attachments/20191227/0049eef1/attachment-0003.sig>