[Teammetrics-discuss] Something new regarding Gmane.

Sukhbir Singh sukhbir.in at gmail.com
Thu Aug 4 13:30:22 UTC 2011


Workflow:

1. Fetch the articles from Gmane,
2. Create mbox archives.
3. Repeat (1, 2)  for all the teams.
4. Start parsing the mbox archives for all teams and FINALLY populate
the database.

So the database phase is at the end.

If you ask me why I did this, this is because to prevent modifying
liststat.py so that it just works ;) Also I thought to leave the
parsing operation to the end (a lucky side effect).

Note that if one list breaks (which should not), this will still allow
the other lists to be parsed and saved to the database. So it's cool
and I think we can just 'let it be'!



More information about the Teammetrics-discuss mailing list