Bug#787990: game-data-packager: implement mirror checking scheme

[Alexandre Detiste]

Package: game-data-packager
Version: 42
Severity: wishlist


Nothing last forever on the internet. (GeoCities, GoogleCode...)

The URL in .yaml files needs to be actively/passively monitored.

*) active monitoring: this would need a custom spider

*) passive monitoring: set-up a custom web server as a last-resort
   that is appended to the list of servers found in the .yaml file

   This server doesn't even need to store all the files;
   the missing one would be listed as 404 in access.log.

   At this point, the user would have already faced on or
   several other broken links, so an extra one isn't that ugly.

   ~~~

   Then the access.log on the server can be monitored with a
   cron job and a list of broken link regularly computed
   and emailed to gdp at packages.d.o
   (todo: check threshold, stuff it in a DB...).

   I really don't care about gathering IP addresses of random
   g-d-p users; this can be hosted anywhere.

(see attached flowchart)

Alexandre



-- System Information:
Debian Release: stretch/sid
  APT prefers testing
  APT policy: (501, 'testing'), (450, 'unstable'), (400, 'experimental')
Architecture: amd64 (x86_64)
Foreign Architectures: i386

Kernel: Linux 3.19.0-trunk-amd64 (SMP w/6 CPU cores)
Locale: LANG=fr_BE.UTF-8, LC_CTYPE=fr_BE.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/dash
Init: systemd (via /run/systemd/system)

Versions of packages game-data-packager depends on:
ii  fakeroot        1.20.2-1
ii  python3         3.4.2-2
ii  python3-debian  0.1.27
ii  python3-yaml    3.11-2
pn  python3:any     <none>

game-data-packager recommends no packages.

Versions of packages game-data-packager suggests:
ii  arj                   3.10.22-13
ii  binutils              2.25-8
ii  cabextract            1.6-1
ii  cdparanoia            3.10.2+debian-11
ii  dynamite              0.1.1-2
ii  gcc                   4:4.9.2-4
ii  gir1.2-gtk-3.0        3.14.5-1
ii  gir1.2-pango-1.0      1.36.8-3
ii  innoextract           1.4-1+b1
ii  lgc-pg                1.2.6-1
ii  lhasa [lzh-archiver]  0.3.0-2
ii  make                  4.0-8.1
ii  p7zip-full            9.20.1~dfsg.1-4.1
ii  python3-gi            3.14.0-1
ii  unace-nonfree         2.5-8
pn  unrar-nonfree         <none>
ii  unshield              1.0-1
ii  unzip                 6.0-17
ii  vorbis-tools          1.4.0-6

-- Configuration Files:
/etc/game-data-packager.conf changed [not included]

-- no debconf information
-------------- next part --------------
A non-text attachment was scrubbed...
Name: mirror_qa.pdf
Type: application/pdf
Size: 80078 bytes
Desc: not available
URL: <http://lists.alioth.debian.org/pipermail/pkg-games-devel/attachments/20150607/80fd1e3b/attachment-0001.pdf>