[pkg-lxc-devel] Bug#835530: Bug#835530: lxc: Repository used in Debian template doesn't work.

[Dryden Personalis]

Evgeni Golov schreef op 27-08-2016 15:37:
> Hi,
> 
> On Fri, Aug 26, 2016 at 06:44:34PM +0200, Dryden Personalis wrote:
> 
>> I am not sure if any newer version from testing unstable would have 
>> solved this,
> 
> No, the version in Stretch also uses httpredir.debian.org, which is
> the same as http.debian.net.
> 
>> But the mirror found in /usr/share/lxc/templates/lxc-debian:
>> 
>> http://http.debian.net/debian
>> 
>> Does not actually work for installing the base minimal system with 
>> debootstrap.
> 
> httpredir.debian.org/http.debian.net is just a redirector.
> I don't fully know how it decides which mirror to redirect you to, but
> those are the source of your issue.
> http://http.debian.net/demo.html tells you which mirror it tries to
> redirect you to.
> I think the maintainer of http.debian.net will love to know which
> mirrors are defective.
> 
>> It will simply fail to find many files. Upon removing the mirror from 
>> the file, the problem is fixed.
> 
> Then debootstrap uses ftp.debian.org. Yeah.
> 
> http.debian.net has worked quite fine as a default, and I think just
> using ftp.d.o will not be good for many users.

I am running the thing from a non-javascript host (only text) so I 
cannot use that page.

It is also hard to reproduce, sometimes eventually the thing will 
succeed, but if I retry individual downloads that fail, like:

wget -v -O 
/tmp/weird//var/cache/apt/archives/partial/liblzma5_5.1.1alpha+20120614-2+b3_amd64.deb 
http://http.debian.net/debian/pool/main/x/xz-utils/liblzma5_5.1.1alpha+20120614-2+b3_amd64.deb

Then I get success and it even connects to ftp.nl.debian.org (at 
location 130.89.149.21).

Also all downloads stop failing after a certain point; they don't just 
fail haphazardly. So either something goes wrong in the script, which 
would be odd (I have captured the wget output (command lines)) or there 
is a mirror that will stop responding when queried too much.

Let me just install a 0.5 second delay into the thing, see what it does.

And indeed, with even a 0.3 second delay (for each download) I cannot 
reproduce failure. There is a server that will ban you momentary if you 
download too much and too fast.

It might be that same 130.89.149.21. Let me try. Yup, that same mirror. 
This is not an ftp mirror, it is http:

Here is the log:




I: Checking component main on http://ftp.nl.debian.org/debian...
I: Retrieving acl 2.2.52-2
I: Validating acl 2.2.52-2
I: Retrieving libacl1 2.2.52-2
I: Validating libacl1 2.2.52-2
I: Retrieving adduser 3.113+nmu3
I: Validating adduser 3.113+nmu3
I: Retrieving apt 1.0.9.8.3
I: Validating apt 1.0.9.8.3
I: Retrieving libapt-pkg4.12 1.0.9.8.3
I: Validating libapt-pkg4.12 1.0.9.8.3
I: Retrieving libattr1 1:2.4.47-2
I: Validating libattr1 1:2.4.47-2
I: Retrieving libaudit-common 1:2.4-1
I: Validating libaudit-common 1:2.4-1
I: Retrieving libaudit1 1:2.4-1+b1
I: Validating libaudit1 1:2.4-1+b1
I: Retrieving base-files 8+deb8u5
I: Validating base-files 8+deb8u5
I: Retrieving base-passwd 3.5.37
I: Validating base-passwd 3.5.37
I: Retrieving bash 4.3-11+b1
I: Validating bash 4.3-11+b1
I: Retrieving libbz2-1.0 1.0.6-7+b3
I: Validating libbz2-1.0 1.0.6-7+b3
I: Retrieving libdebconfclient0 0.192
I: Validating libdebconfclient0 0.192
I: Retrieving coreutils 8.23-4
I: Validating coreutils 8.23-4
I: Retrieving libcryptsetup4 2:1.6.6-5
I: Validating libcryptsetup4 2:1.6.6-5
I: Retrieving dash 0.5.7-4+b1
I: Validating dash 0.5.7-4+b1
I: Retrieving libdb5.3 5.3.28-9
I: Validating libdb5.3 5.3.28-9
I: Retrieving debconf 1.5.56
I: Validating debconf 1.5.56
I: Retrieving debconf-i18n 1.5.56
I: Validating debconf-i18n 1.5.56
I: Retrieving debian-archive-keyring 2014.3
I: Validating debian-archive-keyring 2014.3
I: Retrieving debianutils 4.4+b1
I: Validating debianutils 4.4+b1
I: Retrieving diffutils 1:3.3-1+b1
I: Validating diffutils 1:3.3-1+b1
I: Retrieving dpkg 1.17.27
I: Validating dpkg 1.17.27
I: Retrieving e2fslibs 1.42.12-1.1
I: Validating e2fslibs 1.42.12-1.1
I: Retrieving e2fsprogs 1.42.12-1.1
I: Validating e2fsprogs 1.42.12-1.1
I: Retrieving libcomerr2 1.42.12-1.1
I: Validating libcomerr2 1.42.12-1.1
I: Retrieving libss2 1.42.12-1.1
I: Validating libss2 1.42.12-1.1
I: Retrieving findutils 4.4.2-9+b1
I: Validating findutils 4.4.2-9+b1
I: Retrieving gcc-4.8-base 4.8.4-1
I: Validating gcc-4.8-base 4.8.4-1
I: Retrieving gcc-4.9-base 4.9.2-10
I: Validating gcc-4.9-base 4.9.2-10
I: Retrieving libgcc1 1:4.9.2-10
I: Validating libgcc1 1:4.9.2-10
I: Retrieving libstdc++6 4.9.2-10
I: Validating libstdc++6 4.9.2-10
I: Retrieving libc-bin 2.19-18+deb8u4
I: Validating libc-bin 2.19-18+deb8u4
I: Retrieving libc6 2.19-18+deb8u4
I: Validating libc6 2.19-18+deb8u4
I: Retrieving multiarch-support 2.19-18+deb8u4
I: Validating multiarch-support 2.19-18+deb8u4
I: Retrieving gnupg 1.4.18-7+deb8u1
I: Validating gnupg 1.4.18-7+deb8u1
I: Retrieving gpgv 1.4.18-7+deb8u1
I: Validating gpgv 1.4.18-7+deb8u1
I: Retrieving grep 2.20-4.1
I: Validating grep 2.20-4.1
I: Retrieving gzip 1.6-4
W: Couldn't download package gzip (ver 1.6-4 arch amd64)
I: Retrieving hostname 3.15
W: Couldn't download package hostname (ver 3.15 arch amd64)
I: Retrieving init 1.22
W: Couldn't download package init (ver 1.22 arch amd64)
I: Retrieving insserv 1.14.0-5
W: Couldn't download package insserv (ver 1.14.0-5 arch amd64)
I: Retrieving libkmod2 18-3
W: Couldn't download package libkmod2 (ver 18-3 arch amd64)
I: Retrieving libcap2 1:2.24-8
W: Couldn't download package libcap2 (ver 1:2.24-8 arch amd64)
I: Retrieving libcap2-bin 1:2.24-8
W: Couldn't download package libcap2-bin (ver 1:2.24-8 arch amd64)
I: Retrieving libgcrypt20 1.6.3-2+deb8u1
W: Couldn't download package libgcrypt20 (ver 1.6.3-2+deb8u1 arch amd64)
I: Retrieving libgpg-error0 1.17-3
W: Couldn't download package libgpg-error0 (ver 1.17-3 arch amd64)
I: Retrieving liblocale-gettext-perl 1.05-8+b1
W: Couldn't download package liblocale-gettext-perl (ver 1.05-8+b1 arch 
amd64)
I: Retrieving libselinux1 2.3-2
W: Couldn't download package libselinux1 (ver 2.3-2 arch amd64)
I: Retrieving libsemanage-common 2.3-1
W: Couldn't download package libsemanage-common (ver 2.3-1 arch all)
I: Retrieving libsemanage1 2.3-1+b1
W: Couldn't download package libsemanage1 (ver 2.3-1+b1 arch amd64)
I: Retrieving libsepol1 2.3-2
W: Couldn't download package libsepol1 (ver 2.3-2 arch amd64)
I: Retrieving libtext-charwidth-perl 0.04-7+b3
W: Couldn't download package libtext-charwidth-perl (ver 0.04-7+b3 arch 
amd64)
I: Retrieving libtext-iconv-perl 1.7-5+b2
W: Couldn't download package libtext-iconv-perl (ver 1.7-5+b2 arch 
amd64)
I: Retrieving libtext-wrapi18n-perl 0.06-7
W: Couldn't download package libtext-wrapi18n-perl (ver 0.06-7 arch all)
I: Retrieving libusb-0.1-4 2:0.1.12-25
W: Couldn't download package libusb-0.1-4 (ver 2:0.1.12-25 arch amd64)
I: Retrieving lsb-base 4.1+Debian13+nmu1
W: Couldn't download package lsb-base (ver 4.1+Debian13+nmu1 arch all)
I: Retrieving dmsetup 2:1.02.90-2.2+deb8u1
W: Couldn't download package dmsetup (ver 2:1.02.90-2.2+deb8u1 arch 
amd64)
I: Retrieving libdevmapper1.02.1 2:1.02.90-2.2+deb8u1
W: Couldn't download package libdevmapper1.02.1 (ver 
2:1.02.90-2.2+deb8u1 arch amd64)
I: Retrieving mawk 1.3.3-17
W: Couldn't download package mawk (ver 1.3.3-17 arch amd64)
I: Retrieving libncurses5 5.9+20140913-1+b1
W: Couldn't download package libncurses5 (ver 5.9+20140913-1+b1 arch 
amd64)
I: Retrieving libncursesw5 5.9+20140913-1+b1
W: Couldn't download package libncursesw5 (ver 5.9+20140913-1+b1 arch 
amd64)
I: Retrieving libtinfo5 5.9+20140913-1+b1
W: Couldn't download package libtinfo5 (ver 5.9+20140913-1+b1 arch 
amd64)
I: Retrieving ncurses-base 5.9+20140913-1
W: Couldn't download package ncurses-base (ver 5.9+20140913-1 arch all)
I: Retrieving ncurses-bin 5.9+20140913-1+b1
W: Couldn't download package ncurses-bin (ver 5.9+20140913-1+b1 arch 
amd64)
I: Retrieving libpam-modules 1.1.8-3.1+deb8u1+b1
W: Couldn't download package libpam-modules (ver 1.1.8-3.1+deb8u1+b1 
arch amd64)
I: Retrieving libpam-modules-bin 1.1.8-3.1+deb8u1+b1
W: Couldn't download package libpam-modules-bin (ver 1.1.8-3.1+deb8u1+b1 
arch amd64)
I: Retrieving libpam-runtime 1.1.8-3.1+deb8u1
W: Couldn't download package libpam-runtime (ver 1.1.8-3.1+deb8u1 arch 
all)
I: Retrieving libpam0g 1.1.8-3.1+deb8u1+b1
W: Couldn't download package libpam0g (ver 1.1.8-3.1+deb8u1+b1 arch 
amd64)
I: Retrieving libpcre3 2:8.35-3.3+deb8u4
W: Couldn't download package libpcre3 (ver 2:8.35-3.3+deb8u4 arch amd64)
I: Retrieving perl-base 5.20.2-3+deb8u5
W: Couldn't download package perl-base (ver 5.20.2-3+deb8u5 arch amd64)
I: Retrieving libprocps3 2:3.3.9-9
W: Couldn't download package libprocps3 (ver 2:3.3.9-9 arch amd64)
I: Retrieving procps 2:3.3.9-9
W: Couldn't download package procps (ver 2:3.3.9-9 arch amd64)
I: Retrieving libreadline6 6.3-8+b3
W: Couldn't download package libreadline6 (ver 6.3-8+b3 arch amd64)
I: Retrieving readline-common 6.3-8
W: Couldn't download package readline-common (ver 6.3-8 arch all)
I: Retrieving sed 4.2.2-4+b1
W: Couldn't download package sed (ver 4.2.2-4+b1 arch amd64)
I: Retrieving sensible-utils 0.0.9
W: Couldn't download package sensible-utils (ver 0.0.9 arch all)
I: Retrieving login 1:4.2-3+deb8u1
W: Couldn't download package login (ver 1:4.2-3+deb8u1 arch amd64)
I: Retrieving passwd 1:4.2-3+deb8u1
W: Couldn't download package passwd (ver 1:4.2-3+deb8u1 arch amd64)
I: Retrieving libslang2 2.3.0-2
W: Couldn't download package libslang2 (ver 2.3.0-2 arch amd64)
I: Retrieving startpar 0.59-3
W: Couldn't download package startpar (ver 0.59-3 arch amd64)
I: Retrieving libsystemd0 215-17+deb8u4
W: Couldn't download package libsystemd0 (ver 215-17+deb8u4 arch amd64)
I: Retrieving libudev1 215-17+deb8u4
W: Couldn't download package libudev1 (ver 215-17+deb8u4 arch amd64)
I: Retrieving systemd 215-17+deb8u4
W: Couldn't download package systemd (ver 215-17+deb8u4 arch amd64)
I: Retrieving systemd-sysv 215-17+deb8u4
W: Couldn't download package systemd-sysv (ver 215-17+deb8u4 arch amd64)
I: Retrieving udev 215-17+deb8u4
W: Couldn't download package udev (ver 215-17+deb8u4 arch amd64)
I: Retrieving initscripts 2.88dsf-59
W: Couldn't download package initscripts (ver 2.88dsf-59 arch amd64)
I: Retrieving sysv-rc 2.88dsf-59
W: Couldn't download package sysv-rc (ver 2.88dsf-59 arch all)
I: Retrieving sysvinit-utils 2.88dsf-59
W: Couldn't download package sysvinit-utils (ver 2.88dsf-59 arch amd64)
I: Retrieving tar 1.27.1-2+b1
W: Couldn't download package tar (ver 1.27.1-2+b1 arch amd64)
I: Retrieving tzdata 2016d-0+deb8u1
W: Couldn't download package tzdata (ver 2016d-0+deb8u1 arch all)
I: Retrieving libustr-1.0-1 1.0.4-3+b2
W: Couldn't download package libustr-1.0-1 (ver 1.0.4-3+b2 arch amd64)
I: Retrieving bsdutils 1:2.25.2-6
W: Couldn't download package bsdutils (ver 1:2.25.2-6 arch amd64)
I: Retrieving libblkid1 2.25.2-6
W: Couldn't download package libblkid1 (ver 2.25.2-6 arch amd64)
I: Retrieving libmount1 2.25.2-6
W: Couldn't download package libmount1 (ver 2.25.2-6 arch amd64)
I: Retrieving libsmartcols1 2.25.2-6
W: Couldn't download package libsmartcols1 (ver 2.25.2-6 arch amd64)
I: Retrieving libuuid1 2.25.2-6
W: Couldn't download package libuuid1 (ver 2.25.2-6 arch amd64)
I: Retrieving mount 2.25.2-6
W: Couldn't download package mount (ver 2.25.2-6 arch amd64)
I: Retrieving util-linux 2.25.2-6
W: Couldn't download package util-linux (ver 2.25.2-6 arch amd64)
I: Retrieving liblzma5 5.1.1alpha+20120614-2+b3
W: Couldn't download package liblzma5 (ver 5.1.1alpha+20120614-2+b3 arch 
amd64)
I: Retrieving zlib1g 1:1.2.8.dfsg-2+b1
W: Couldn't download package zlib1g (ver 1:1.2.8.dfsg-2+b1 arch amd64)
E: Couldn't download packages: gzip hostname init insserv libkmod2 
libcap2 libcap2-bin libgcrypt20 libgpg-error0 liblocale-gettext-perl 
libselinux1 libsemanage-common libsemanage1 libsepol1 
libtext-charwidth-perl libtext-iconv-perl libtext-wrapi18n-perl 
libusb-0.1-4 lsb-base dmsetup libdevmapper1.02.1 mawk libncurses5 
libncursesw5 libtinfo5 ncurses-base ncurses-bin libpam-modules 
libpam-modules-bin libpam-runtime libpam0g libpcre3 perl-base libprocps3 
procps libreadline6 readline-common sed sensible-utils login passwd 
libslang2 startpar libsystemd0 libudev1 systemd systemd-sysv udev 
initscripts sysv-rc sysvinit-utils tar tzdata libustr-1.0-1 bsdutils 
libblkid1 libmount1 libsmartcols1 libuuid1 mount util-linux liblzma5 
zlib1g


I don't know the bandwidth of this system but it is not likely to be 
capped very low. So the first batch of successful packages happens 
within a few seconds.

Regards.