[Teammetrics-discuss] How does filling up the database work?

[Sukhbir Singh]

(Sorry for replying late):

For a given mailing list on Alioth:

1. Download the mbox,
2. Parse it,
3. After parsed, create an entry in
'/var/cache/teammetrics/lists.hash' so that the mbox is NOT downloaded
and therefore NOT parsed again.
4. Populate the database.

So (4) cannot happen again if the mbox has already been downloaded and
parsed once.

For a given mailing list NNTP:

1. Assume there are X lists,
2. Fetch all the details for X lists,
3. Create mbox archives.
4. Parse them and then create an entry in:
'/var/cache/teammterics/nntplists.hash'.
5. Populate the database.

So for a given list which ended at article 100, the next time it runs,
it won't download or parse 1-100 articles again...