[Teammetrics-discuss] First test run on blends.debian.net

[Andreas Tille]

Hi again,

On Wed, Aug 03, 2011 at 06:45:00PM +0530, Sukhbir Singh wrote:
> I recommend that you and I run this for at most two teams and then
> re-run it again just to be sure that everything is well and then we
> run it for all the 12 teams!

There seem to be some issues here.  It seems that after fetching one
single list its stops for some reason.  If I start nntpstat.py it seems
to use the information from the cache and start working on the next not
yet fetched list.  (It might perfectly be by chance that this happens
after fetching one list.)

You can see the log at

   blends.debian.net:/var/log/teammetrics/liststat.log

However, even in the parsing something seems to be wrong:

teammetrics=# SELECT project, count(*) from listarchives where domain='lists.debian.org' group by  project;
       project        | count 
----------------------+-------
 debian-accessibility |  3174
 debian-amd64         |     5

But the log says it has "about" that much articles in accessibility
(modulo SPAM) but having only 5 postings in amd64 is way to less:

2011-08-03 13:23:03,645 INFO:           Starting NNTPListStat
2011-08-03 13:23:03,646 INFO:   List 1 of 54
2011-08-03 13:23:04,427 INFO: Group 'gmane.linux.debian.devel.accessibility' has 3620 articles
2011-08-03 13:23:04,427 INFO: List is up to date, nothing to download
2011-08-03 13:23:04,427 INFO:   List 2 of 54
2011-08-03 13:23:05,524 INFO: Group 'gmane.linux.debian.ports.amd64' has 27246 articles
2011-08-03 13:23:05,525 INFO: List is up to date, nothing to download
2011-08-03 13:23:05,525 INFO:   List 3 of 54
2011-08-03 13:23:06,607 INFO: Group 'gmane.linux.debian.ports.arm' has 9886 articles
2011-08-03 13:23:06,607 INFO: Fetching message bodies for articles 1 - 10164

Currently it is fetching arm on blends.debian.net (so be careful to
start the program there!)

Kind regards

         Andreas.

-- 
http://fam-tille.de