[Debian-l10n-devel] Failure of Spider

[Felipe Augusto van de Wiel (faw)]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

On 22-05-2008 19:29, Nicolas François wrote:
> Hello,
> 
> I could reproduce a failure of dl10n-spider.
> 
> I'm wondering if you have logs of the cron jobs.
> I looking for something like:
> 
> Use of uninitialized value $_ in substitution (s///) at lib/Debian/L10n/Spider.pm line 158, <DATA> line 228.
> Use of uninitialized value $_ in substitution (s///) at lib/Debian/L10n/Spider.pm line 159, <DATA> line 228.
> Use of uninitialized value $_ in substitution (s///) at lib/Debian/L10n/Spider.pm line 160, <DATA> line 228.
> Can't call method "phrase" on an undefined value at lib/Debian/L10n/Spider.pm line 164, <DATA> line 228.
> 
> Felipe, if the cron job generates logs, could you try adding:
> print "html NOT DEFINED!!!\n" if not defined $html
> 
> On line 575 (after the call to get_message)
> 
> If the "html NOT DEFINED!!!" lines appear in the log, it means the
> download of the html pages fails sometimes.
> Some possible fixes could be:
>   * retry a few times before failing
>   * handle this error more gently, and keep the script running for the
>     next messages.
> 
> If no such "Use of uninitialized value" appear in the log, I will have to
> look further.
> 
> Cheers,

Sorry for the delay.

	The last log with 'uninitialized' is this:

- -------- Original Message --------
Subject: Cron <thuriaux at churro> /org/dl10n-stuff/bin/spiderhourly 2>&1 | tee -a /org/dl10n-stuff/log/spider.cron.$(date "+%Y%M%d-0000")
Date: Thu, 22 May 2008 20:00:28 +0200
From: root at i18n.debian.net (Cron Daemon)

Spider.pm arabic
Spider.pm Continue arabic from message 2007/6/4
Spider.pm catalan
Spider.pm Continue catalan from message 2008/5/13
Spider.pm german
Spider.pm Continue german from message 2008/5/190
Spider.pm english
Spider.pm Continue english from message 2008/5/3
Spider.pm spanish
Spider.pm Continue spanish from message 2008/5/90
Use of uninitialized value in split at lib/Debian/L10n/Spider.pm line 132.
Spider.pm french
Spider.pm Continue french from message 2008/5/311
Spider.pm: [fr:2008/5/312] [MAJ] po-debconf://openvpn/fr.po 3u Christian Perrier
Insert podebconf#fr.po#2008-05-22 16:49:39 +0000#maj#Christian Perrier#2008-05-00312##
Spider.pm: [fr:2008/5/313] Re: [RFR] po-debconf://multipath-tools/fr.po Christian Perrier
Spider.pm: [fr:2008/5/314] [TAF]	ddp://manuals/debian-faq/fr/{pkgtools,redist,software,support,uptoda	te}.sgml Simon Paillard
Spider.pm dutch
Spider.pm Continue dutch from message 2008/5/38
Spider.pm portuguese
Spider.pm Continue portuguese from message 2008/5/128
Spider.pm turkish
Spider.pm Continue turkish from message 2007/7/6


	I think everybody can write to the robots.

	I will create a local SVN just for the meta-data from the
robots, we should work together to improve the log handling, right
now it generates quite a few messages every day.

Kind regards,
- --
Felipe Augusto van de Wiel (faw)
"Debian. Freedom to code. Code to freedom!"
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.6 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFIPX8eCjAO0JDlykYRCImyAKDDlPndGJ5SsIZhiYr1V5LqdRg/2ACfeq+Q
Iw85/F3szl+frg/q1jALQ0M=
=U31a
-----END PGP SIGNATURE-----