[Soc-coordination] Ninth report: Provide some metrics in Debile

[Clément Schreiner]

Hi, this is the ninth weekly report on my Summer of Code project 'Provide
some metrics in Debile'[1].

After I fixed the PGP issues I experienced last WE, I launched a few
batches of builds, larger than the ones I'd tested before.


The first thing I noticed is that the packages who do not honor the
CC/CXX variables are way more numerous (> 50%) than I expected. It could
be selection bias, but if the results are confirmed with a larger set of
packages, I'll have to look into solutions for running scan-build more
reliably.

However, I have a more important problem that I need to deal with
first. I've known for quite some time that debile-incoming's
performances are poor, but I thought (hoped) that my hack ensuring only
one process runs at a time would allow me to delay its
optimization. However, this week I got this, after it ran for almost 10
hours:

 [14500526.201825] Out of memory: Kill process 41740 (debile-incoming)
 score 31 or sacrifice child
 [14500526.201897] Killed process 41740 (debile-incoming)
 total-vm:926752kB, anon-rss:812292kB, file-rss:20kB

I have started working on the recursive tree traversal that's at
fault[2]. Using firewoes' unittest setup, I'm writing an iterative
algorithm, and I will improve it from there.


I also made some improvements to ricky[3][4] and loofah[5], and will
update the packages soon, once I've identified and fixed a small issue
in ricky:
  File "/usr/lib/python2.7/dist-packages/debian/deb822.py", line 251, in __getitem__
    value = self.__dict[key]
 KeyError: 'Checksums-Sha1'



Thanks for reading,

-------
Clément



[1]
[https://wiki.debian.org/SummerOfCode2014/StudentApplications/ClementSchreiner]
[2]
[https://github.com/Debian/firewoes/blob/master/firewoes/lib/hash.py#L96]
[3]
[https://github.com/paultag/ricky/commit/9ca0b4460c8f94dcf12865979582402801e2956b]
[4]
[https://github.com/paultag/ricky/commit/eb6fdb23c73c4d31c5d351c80f72f6705e7283d6
[5]
[https://github.com/paultag/loofah/commit/93779f772ab97d67c2d2fffe6500df00cf2be3a0]