[Aptitude-devel] Fully automatic aptitude documentation extractor for http://aptitude.alioth.debian.org/doc/

[Axel Beckert]

Hi,

I promised this a while ago and I've finally found the leisure and
time to implement it:

A small script (well, two scripts actually, but both quite simple)
which finds all aptitude-doc-* packages in Debian Unstable, downloads
them and extracts the contained HTML documentation for publishing it
on the web.

The script's instance is installed on Alioth in
/srv/home/groups/aptitude/bin/, uses /srv/home/groups/aptitude/tmp/ as
download area and extracts the docs to
/srv/home/groups/aptitude/htdocs/doc/ aka
http://aptitude.alioth.debian.org/doc/

I've created a git repository for it at
/git/aptitude/aptitude-documentation-fetcher.git/ which I would expect
to show up at
http://anonscm.debian.org/cgit/aptitude/aptitude-documentation-fetcher.git
but doesn't (yet).

Oh, and yes, http://aptitude.alioth.debian.org/doc/ is now uptodate
again.

I wonder if I should install a cron-job on Alioth running that script.
And if so, how often? Daily? Weekly?

It currently takes about one second (only, yes). It downloads the
package list and the packages only if they have changed (or are not
present; hanks to wget -N), but it always extracts all packages
without checking if they're already extracted.

(And it doesn't yet clean up old, previously downloaded packages yet. Will
add that later today. Another thing which may be helpful is also
tracking verions in Debian Experimental.)

		Regards, Axel
-- 
 ,''`.  |  Axel Beckert <abe at debian.org>, http://people.debian.org/~abe/
: :' :  |  Debian Developer, ftp.ch.debian.org Admin
`. `'   |  1024D: F067 EA27 26B9 C3FC 1486  202E C09E 1D89 9593 0EDE
  `-    |  4096R: 2517 B724 C5F6 CA99 5329  6E61 2FF9 CD59 6126 16B5
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 198 bytes
Desc: Digital signature
URL: <http://lists.alioth.debian.org/pipermail/aptitude-devel/attachments/20140727/5dbc23b5/attachment.sig>