<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN" "http://www.w3.org/TR/REC-html40/loose.dtd">
<html lang="en">
<head>
<meta content="text/html; charset=US-ASCII" http-equiv="Content-Type">
<title>
GitLab
</title>



<style>img {
max-width: 100%; height: auto;
}
</style>
</head>
<body>
<div class="content">

<h3>
Holger Levsen pushed to branch master
at <a href="https://salsa.debian.org/qa/jenkins.debian.net">Debian QA / jenkins.debian.net</a>
</h3>
<h4>
Commits:
</h4>
<ul>
<li>
<strong><a href="https://salsa.debian.org/qa/jenkins.debian.net/-/commit/6e6bae6a324cc5e8fa6e724c233132dcec60b8b3">6e6bae6a</a></strong>
<div>
<span>by Holger Levsen</span>
<i>at 2020-09-02T21:03:38+02:00</i>
</div>
<pre class="commit-message" style="white-space: pre-wrap; margin: 0;">reproducible trbo system health check: clarify wording, less is more

Signed-off-by: Holger Levsen <holger@layer-acht.org>
</pre>
</li>
<li>
<strong><a href="https://salsa.debian.org/qa/jenkins.debian.net/-/commit/d099a852bd994f1ff7e34dae6176f25f46d8ed13">d099a852</a></strong>
<div>
<span>by Holger Levsen</span>
<i>at 2020-09-02T21:04:07+02:00</i>
</div>
<pre class="commit-message" style="white-space: pre-wrap; margin: 0;">reproducible trbo system health check: color highlight important bad conditions

Signed-off-by: Holger Levsen <holger@layer-acht.org>
</pre>
</li>
</ul>
<h4>2 changed files:</h4>
<ul>
<li class="file-stats">
<a href="#25ca3adf2821c325ea034b2db5398d9e6ff24eef">
bin/jenkins-shell-monitor.sh
</a>
</li>
<li class="file-stats">
<a href="#862f419123dea7ff48660213ea868f4b676cd4af">
bin/reproducible_system_health.sh
</a>
</li>
</ul>
<h4>Changes:</h4>
<li id="25ca3adf2821c325ea034b2db5398d9e6ff24eef">
<a href="https://salsa.debian.org/qa/jenkins.debian.net/-/compare/13db97547efcd6b0001afd6ebaa0ca77ec8232d5...d099a852bd994f1ff7e34dae6176f25f46d8ed13#25ca3adf2821c325ea034b2db5398d9e6ff24eef"><strong>bin/jenkins-shell-monitor.sh</strong></a>
<hr>
<table class="code white" style="font-family: monospace; font-size: 90%;" bgcolor="#fff" width="100%" cellpadding="0" cellspacing="0">
<tr class="line_holder match" id="" style="line-height: 1.6;">
<td class="diff-line-num unfold js-unfold old_line" data-linenumber="30" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">...</td>
<td class="diff-line-num unfold js-unfold new_line" data-linenumber="30" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">...</td>
<td class="line_content match " style="padding-left: 0.5em; padding-right: 0.5em; color: rgba(0,0,0,0.3);" bgcolor="#fafafa">@@ -30,6 +30,11 @@ main_loop() {</td>
</tr>
<tr class="line_holder" id="" style="line-height: 1.6;">
<td class="diff-line-num old_line" data-linenumber="30" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
30
</td>
<td class="diff-line-num new_line" data-linenumber="30" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
30
</td>
<td class="line_content" style="padding-left: 0.5em; padding-right: 0.5em;">
<pre style="margin: 0;"> <span id="LC30" class="line" lang="shell"> ps fax <span class="o" style="font-weight: 600;">></span> <span class="nv" style="color: #008080;">$PSFAX</span></span>
</pre>
</td>
</tr>
<tr class="line_holder" id="" style="line-height: 1.6;">
<td class="diff-line-num old_line" data-linenumber="31" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
31
</td>
<td class="diff-line-num new_line" data-linenumber="31" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
31
</td>
<td class="line_content" style="padding-left: 0.5em; padding-right: 0.5em;">
<pre style="margin: 0;"> <span id="LC31" class="line" lang="shell"> <span class="nv" style="color: #008080;">LSOF</span><span class="o" style="font-weight: 600;">=</span><span class="si" style="color: #d14;">$(</span>lsof <span class="nt" style="color: #000080;">-n</span> | <span class="nb" style="color: #0086b3;">wc</span> <span class="nt" style="color: #000080;">-l</span><span class="si" style="color: #d14;">)</span></span>
</pre>
</td>
</tr>
<tr class="line_holder" id="" style="line-height: 1.6;">
<td class="diff-line-num old_line" data-linenumber="32" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
32
</td>
<td class="diff-line-num new_line" data-linenumber="32" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
32
</td>
<td class="line_content" style="padding-left: 0.5em; padding-right: 0.5em;">
<pre style="margin: 0;"> <span id="LC32" class="line" lang="shell"> <span class="nv" style="color: #008080;">SCHROOT_SESSIONS</span><span class="o" style="font-weight: 600;">=</span><span class="si" style="color: #d14;">$(</span>find /var/lib/schroot/session/ | <span class="nb" style="color: #0086b3;">wc</span> <span class="nt" style="color: #000080;">-l</span><span class="si" style="color: #d14;">)</span></span>
</pre>
</td>
</tr>
<tr class="line_holder new" id="" style="line-height: 1.6;">
<td class="diff-line-num new old_line" data-linenumber="33" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #c7f0d2; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#ddfbe6">
 
</td>
<td class="diff-line-num new new_line" data-linenumber="33" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #c7f0d2; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#ddfbe6">
33
</td>
<td class="line_content new" style="padding-left: 0.5em; padding-right: 0.5em;" bgcolor="#ecfdf0">
<pre style="margin: 0;">+<span id="LC33" class="line" lang="shell"> <span class="k" style="font-weight: 600;">if</span> <span class="o" style="font-weight: 600;">[</span> <span class="nv" style="color: #008080;">$SCHROOT_SESSIONS</span> <span class="nt" style="color: #000080;">-gt</span> 30000 <span class="o" style="font-weight: 600;">]</span> <span class="p">;</span> <span class="k" style="font-weight: 600;">then</span></span>
</pre>
</td>
</tr>
<tr class="line_holder new" id="" style="line-height: 1.6;">
<td class="diff-line-num new old_line" data-linenumber="33" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #c7f0d2; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#ddfbe6">
 
</td>
<td class="diff-line-num new new_line" data-linenumber="34" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #c7f0d2; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#ddfbe6">
34
</td>
<td class="line_content new" style="padding-left: 0.5em; padding-right: 0.5em;" bgcolor="#ecfdf0">
<pre style="margin: 0;">+<span id="LC34" class="line" lang="shell"><span class="k" style="font-weight: 600;">             </span><span class="nv" style="color: #008080;">SCHROOT_SESSIONS</span><span class="o" style="font-weight: 600;">=</span><span class="s2" style="color: #d14;">"</span><span class="se" style="color: #d14;">\0</span><span class="s2" style="color: #d14;">33[91m</span><span class="nv" style="color: #008080;">$SCHROOT_SESSIONS</span><span class="se" style="color: #d14;">\0</span><span class="s2" style="color: #d14;">33[0m"</span></span>
</pre>
</td>
</tr>
<tr class="line_holder new" id="" style="line-height: 1.6;">
<td class="diff-line-num new old_line" data-linenumber="33" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #c7f0d2; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#ddfbe6">
 
</td>
<td class="diff-line-num new new_line" data-linenumber="35" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #c7f0d2; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#ddfbe6">
35
</td>
<td class="line_content new" style="padding-left: 0.5em; padding-right: 0.5em;" bgcolor="#ecfdf0">
<pre style="margin: 0;">+<span id="LC35" class="line" lang="shell"> <span class="k" style="font-weight: 600;">elif</span> <span class="o" style="font-weight: 600;">[</span> <span class="nv" style="color: #008080;">$SCHROOT_SESSIONS</span> <span class="nt" style="color: #000080;">-gt</span> 15000 <span class="o" style="font-weight: 600;">]</span> <span class="p">;</span> <span class="k" style="font-weight: 600;">then</span></span>
</pre>
</td>
</tr>
<tr class="line_holder new" id="" style="line-height: 1.6;">
<td class="diff-line-num new old_line" data-linenumber="33" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #c7f0d2; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#ddfbe6">
 
</td>
<td class="diff-line-num new new_line" data-linenumber="36" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #c7f0d2; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#ddfbe6">
36
</td>
<td class="line_content new" style="padding-left: 0.5em; padding-right: 0.5em;" bgcolor="#ecfdf0">
<pre style="margin: 0;">+<span id="LC36" class="line" lang="shell"><span class="k" style="font-weight: 600;">             </span><span class="nv" style="color: #008080;">SCHROOT_SESSIONS</span><span class="o" style="font-weight: 600;">=</span><span class="s2" style="color: #d14;">"</span><span class="se" style="color: #d14;">\0</span><span class="s2" style="color: #d14;">33[93m</span><span class="nv" style="color: #008080;">$SCHROOT_SESSIONS</span><span class="se" style="color: #d14;">\0</span><span class="s2" style="color: #d14;">33[0m"</span></span>
</pre>
</td>
</tr>
<tr class="line_holder new" id="" style="line-height: 1.6;">
<td class="diff-line-num new old_line" data-linenumber="33" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #c7f0d2; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#ddfbe6">
 
</td>
<td class="diff-line-num new new_line" data-linenumber="37" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #c7f0d2; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#ddfbe6">
37
</td>
<td class="line_content new" style="padding-left: 0.5em; padding-right: 0.5em;" bgcolor="#ecfdf0">
<pre style="margin: 0;">+<span id="LC37" class="line" lang="shell"> <span class="k" style="font-weight: 600;">fi</span></span>
</pre>
</td>
</tr>
<tr class="line_holder" id="" style="line-height: 1.6;">
<td class="diff-line-num old_line" data-linenumber="33" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
33
</td>
<td class="diff-line-num new_line" data-linenumber="38" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
38
</td>
<td class="line_content" style="padding-left: 0.5em; padding-right: 0.5em;">
<pre style="margin: 0;"> <span id="LC38" class="line" lang="shell"><span class="k" style="font-weight: 600;">     </span><span class="nv" style="color: #008080;">SCHROOT_MOUNTS</span><span class="o" style="font-weight: 600;">=</span><span class="si" style="color: #d14;">$(</span>mount | <span class="nb" style="color: #0086b3;">grep</span> /run/schroot| <span class="nb" style="color: #0086b3;">wc</span> <span class="nt" style="color: #000080;">-l</span><span class="si" style="color: #d14;">)</span></span>
</pre>
</td>
</tr>
<tr class="line_holder" id="" style="line-height: 1.6;">
<td class="diff-line-num old_line" data-linenumber="34" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
34
</td>
<td class="diff-line-num new_line" data-linenumber="39" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
39
</td>
<td class="line_content" style="padding-left: 0.5em; padding-right: 0.5em;">
<pre style="margin: 0;"> <span id="LC39" class="line" lang="shell"> <span class="nv" style="color: #008080;">REPRO_JOBS</span><span class="o" style="font-weight: 600;">=</span><span class="si" style="color: #d14;">$(</span><span class="nb" style="color: #0086b3;">ls</span> ~jenkins/jobs/reproducible_<span class="k" style="font-weight: 600;">*</span> <span class="nt" style="color: #000080;">-1d</span> | <span class="nb" style="color: #0086b3;">wc</span> <span class="nt" style="color: #000080;">-l</span><span class="si" style="color: #d14;">)</span></span>
</pre>
</td>
</tr>
<tr class="line_holder" id="" style="line-height: 1.6;">
<td class="diff-line-num old_line" data-linenumber="35" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
35
</td>
<td class="diff-line-num new_line" data-linenumber="40" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
40
</td>
<td class="line_content" style="padding-left: 0.5em; padding-right: 0.5em;">
<pre style="margin: 0;"> <span id="LC40" class="line" lang="shell"> <span class="nv" style="color: #008080;">JOBS_RUNNING_TOTAL</span><span class="o" style="font-weight: 600;">=</span><span class="si" style="color: #d14;">$(</span><span class="nb" style="color: #0086b3;">grep</span> <span class="s1" style="color: #d14;">'_ /bin/bash /srv/jenkins/bin/'</span> <span class="nv" style="color: #008080;">$PSFAX</span> | egrep <span class="nt" style="color: #000080;">-v</span> <span class="s1" style="color: #d14;">'reproducible_worker.sh|reproducible_build.sh|jenkins-shell-monitor.sh'</span> | <span class="nb" style="color: #0086b3;">wc</span> <span class="nt" style="color: #000080;">-l</span><span class="si" style="color: #d14;">)</span></span>
</pre>
</td>
</tr>
<tr class="line_holder match" id="" style="line-height: 1.6;">
<td class="diff-line-num unfold js-unfold old_line" data-linenumber="58" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">...</td>
<td class="diff-line-num unfold js-unfold new_line" data-linenumber="63" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">...</td>
<td class="line_content match " style="padding-left: 0.5em; padding-right: 0.5em; color: rgba(0,0,0,0.3);" bgcolor="#fafafa">@@ -58,12 +63,17 @@ main_loop() {</td>
</tr>
<tr class="line_holder" id="" style="line-height: 1.6;">
<td class="diff-line-num old_line" data-linenumber="58" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
58
</td>
<td class="diff-line-num new_line" data-linenumber="63" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
63
</td>
<td class="line_content" style="padding-left: 0.5em; padding-right: 0.5em;">
<pre style="margin: 0;"> <span id="LC63" class="line" lang="shell">         <span class="nb" style="color: #0086b3;">echo</span> <span class="s2" style="color: #d14;">"logged in user sessions:                      </span><span class="si" style="color: #d14;">$(</span><span class="nb" style="color: #0086b3;">uptime</span> | rev |cut <span class="nt" style="color: #000080;">-d</span> <span class="s1" style="color: #d14;">','</span> <span class="nt" style="color: #000080;">-f1-4</span> | rev | <span class="nb" style="color: #0086b3;">cut</span> <span class="nt" style="color: #000080;">-d</span> <span class="s1" style="color: #d14;">','</span> <span class="nt" style="color: #000080;">-f1</span> | <span class="nb" style="color: #0086b3;">sed</span> <span class="s2" style="color: #d14;">"s#users##"</span> | xargs <span class="nb" style="color: #0086b3;">echo</span><span class="si" style="color: #d14;">)</span><span class="s2" style="color: #d14;">"</span></span>
</pre>
</td>
</tr>
<tr class="line_holder" id="" style="line-height: 1.6;">
<td class="diff-line-num old_line" data-linenumber="59" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
59
</td>
<td class="diff-line-num new_line" data-linenumber="64" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
64
</td>
<td class="line_content" style="padding-left: 0.5em; padding-right: 0.5em;">
<pre style="margin: 0;"> <span id="LC64" class="line" lang="shell">         <span class="nb" style="color: #0086b3;">echo</span> <span class="s2" style="color: #d14;">"logged in users:                              </span><span class="si" style="color: #d14;">$(</span>w <span class="nt" style="color: #000080;">-h</span> | <span class="nb" style="color: #0086b3;">awk</span> <span class="s1" style="color: #d14;">'{print $1}'</span> | <span class="nb" style="color: #0086b3;">sort</span> <span class="nt" style="color: #000080;">-u</span> | xargs <span class="nb" style="color: #0086b3;">echo</span><span class="si" style="color: #d14;">)</span><span class="s2" style="color: #d14;">"</span></span>
</pre>
</td>
</tr>
<tr class="line_holder" id="" style="line-height: 1.6;">
<td class="diff-line-num old_line" data-linenumber="60" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
60
</td>
<td class="diff-line-num new_line" data-linenumber="65" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
65
</td>
<td class="line_content" style="padding-left: 0.5em; padding-right: 0.5em;">
<pre style="margin: 0;"> <span id="LC65" class="line" lang="shell">         <span class="nb" style="color: #0086b3;">echo</span> <span class="s2" style="color: #d14;">"number of open files:                         </span><span class="nv" style="color: #008080;">$LSOF</span><span class="s2" style="color: #d14;">"</span></span>
</pre>
</td>
</tr>
<tr class="line_holder old" id="" style="line-height: 1.6;">
<td class="diff-line-num old old_line" data-linenumber="61" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #fac5cd; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#f9d7dc">
61
</td>
<td class="diff-line-num new_line old" data-linenumber="66" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #fac5cd; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#f9d7dc">
 
</td>
<td class="line_content old" style="padding-left: 0.5em; padding-right: 0.5em;" bgcolor="#fbe9eb">
<pre style="margin: 0;">-<span id="LC61" class="line" lang="shell">         <span class="nb" style="color: #0086b3;">echo</span> <span class="s2" style="color: #d14;">"schroot: (sessions / mounts)                  </span><span class="nv" style="color: #008080;">$SCHROOT_SESSIONS</span><span class="s2" style="color: #d14;"> / </span><span class="nv" style="color: #008080;">$SCHROOT_MOUNTS</span><span class="s2" style="color: #d14;">"</span></span>
</pre>
</td>
</tr>
<tr class="line_holder new" id="" style="line-height: 1.6;">
<td class="diff-line-num new old_line" data-linenumber="62" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #c7f0d2; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#ddfbe6">
 
</td>
<td class="diff-line-num new new_line" data-linenumber="66" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #c7f0d2; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#ddfbe6">
66
</td>
<td class="line_content new" style="padding-left: 0.5em; padding-right: 0.5em;" bgcolor="#ecfdf0">
<pre style="margin: 0;">+<span id="LC66" class="line" lang="shell">         <span class="nb" style="color: #0086b3;">echo</span> <span class="nt" style="color: #000080;"><span class="idiff left">-e</span></span><span class="idiff right"> </span><span class="s2" style="color: #d14;">"schroot: (sessions / mounts)                  </span><span class="nv" style="color: #008080;">$SCHROOT_SESSIONS</span><span class="s2" style="color: #d14;"> / </span><span class="nv" style="color: #008080;">$SCHROOT_MOUNTS</span><span class="s2" style="color: #d14;">"</span></span>
</pre>
</td>
</tr>
<tr class="line_holder" id="" style="line-height: 1.6;">
<td class="diff-line-num old_line" data-linenumber="62" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
62
</td>
<td class="diff-line-num new_line" data-linenumber="67" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
67
</td>
<td class="line_content" style="padding-left: 0.5em; padding-right: 0.5em;">
<pre style="margin: 0;"> <span id="LC67" class="line" lang="shell">         <span class="nb" style="color: #0086b3;">echo</span> <span class="s2" style="color: #d14;">"configured r-b jobs:                          </span><span class="nv" style="color: #008080;">$REPRO_JOBS</span><span class="s2" style="color: #d14;">"</span></span>
</pre>
</td>
</tr>
<tr class="line_holder" id="" style="line-height: 1.6;">
<td class="diff-line-num old_line" data-linenumber="63" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
63
</td>
<td class="diff-line-num new_line" data-linenumber="68" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
68
</td>
<td class="line_content" style="padding-left: 0.5em; padding-right: 0.5em;">
<pre style="margin: 0;"> <span id="LC68" class="line" lang="shell">         <span class="nb" style="color: #0086b3;">echo</span> <span class="s2" style="color: #d14;">"running jenkins jobs: (total/local/remote)    </span><span class="nv" style="color: #008080;">$JOBS_RUNNING_TOTAL</span><span class="s2" style="color: #d14;"> / </span><span class="nv" style="color: #008080;">$JOBS_RUNNING_LOCAL</span><span class="s2" style="color: #d14;"> / </span><span class="nv" style="color: #008080;">$JOBS_RUNNING_REMOTE</span><span class="s2" style="color: #d14;">"</span></span>
</pre>
</td>
</tr>
<tr class="line_holder" id="" style="line-height: 1.6;">
<td class="diff-line-num old_line" data-linenumber="64" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
64
</td>
<td class="diff-line-num new_line" data-linenumber="69" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
69
</td>
<td class="line_content" style="padding-left: 0.5em; padding-right: 0.5em;">
<pre style="margin: 0;"> <span id="LC69" class="line" lang="shell">         <span class="nb" style="color: #0086b3;">echo</span> <span class="s2" style="color: #d14;">"running debian r-b workers:                   </span><span class="nv" style="color: #008080;">$REPRO_WORKERS</span><span class="s2" style="color: #d14;">"</span></span>
</pre>
</td>
</tr>
<tr class="line_holder" id="" style="line-height: 1.6;">
<td class="diff-line-num old_line" data-linenumber="65" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
65
</td>
<td class="diff-line-num new_line" data-linenumber="70" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
70
</td>
<td class="line_content" style="padding-left: 0.5em; padding-right: 0.5em;">
<pre style="margin: 0;"> <span id="LC70" class="line" lang="shell">         <span class="nb" style="color: #0086b3;">echo</span> <span class="s2" style="color: #d14;">"running jenkings agents/nodes:                </span><span class="nv" style="color: #008080;">$JENKINS_AGENTS</span><span class="s2" style="color: #d14;">"</span></span>
</pre>
</td>
</tr>
<tr class="line_holder old" id="" style="line-height: 1.6;">
<td class="diff-line-num old old_line" data-linenumber="66" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #fac5cd; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#f9d7dc">
66
</td>
<td class="diff-line-num new_line old" data-linenumber="71" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #fac5cd; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#f9d7dc">
 
</td>
<td class="line_content old" style="padding-left: 0.5em; padding-right: 0.5em;" bgcolor="#fbe9eb">
<pre style="margin: 0;">-<span id="LC66" class="line" lang="shell">         <span class="nb" style="color: #0086b3;">echo</span> <span class="s2" style="color: #d14;">"nodes: (total/auto-offline/offline in git)    </span><span class="nv" style="color: #008080;">$NODES_TOTAL</span><span class="s2" style="color: #d14;"> / </span><span class="si" style="color: #d14;">$(</span><span class="nb" style="color: #0086b3;">grep</span> <span class="nt" style="color: #000080;">-v</span> ^# ~jenkins/offline_nodes | <span class="nb" style="color: #0086b3;">grep</span> <span class="nt" style="color: #000080;">-c</span> debian<span class="si" style="color: #d14;">)</span><span class="s2" style="color: #d14;"> / </span><span class="si" style="color: #d14;">$(</span><span class="nb" style="color: #0086b3;">grep</span> <span class="nt" style="color: #000080;">-v</span> ^# ~jenkins-adm/jenkins.debian.net/jenkins-home/offline_nodes | <span class="nb" style="color: #0086b3;">grep</span> <span class="nt" style="color: #000080;">-c</span> debian<span class="si" style="color: #d14;">)</span><span class="s2" style="color: #d14;">"</span></span>
</pre>
</td>
</tr>
<tr class="line_holder new" id="" style="line-height: 1.6;">
<td class="diff-line-num new old_line" data-linenumber="67" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #c7f0d2; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#ddfbe6">
 
</td>
<td class="diff-line-num new new_line" data-linenumber="71" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #c7f0d2; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#ddfbe6">
71
</td>
<td class="line_content new" style="padding-left: 0.5em; padding-right: 0.5em;" bgcolor="#ecfdf0">
<pre style="margin: 0;">+<span id="LC71" class="line" lang="shell">         <span class="nv" style="color: #008080;">NODES_OFFLINE</span><span class="o" style="font-weight: 600;">=</span><span class="s2" style="color: #d14;">"</span><span class="si" style="color: #d14;">$(</span><span class="nb" style="color: #0086b3;">grep</span> <span class="nt" style="color: #000080;">-v</span> ^# ~jenkins/offline_nodes | <span class="nb" style="color: #0086b3;">grep</span> <span class="nt" style="color: #000080;">-c</span> debian<span class="si" style="color: #d14;">)</span><span class="s2" style="color: #d14;">"</span></span>
</pre>
</td>
</tr>
<tr class="line_holder new" id="" style="line-height: 1.6;">
<td class="diff-line-num new old_line" data-linenumber="67" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #c7f0d2; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#ddfbe6">
 
</td>
<td class="diff-line-num new new_line" data-linenumber="72" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #c7f0d2; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#ddfbe6">
72
</td>
<td class="line_content new" style="padding-left: 0.5em; padding-right: 0.5em;" bgcolor="#ecfdf0">
<pre style="margin: 0;">+<span id="LC72" class="line" lang="shell">         <span class="nv" style="color: #008080;">NODES_GIT_OFFLINE</span><span class="o" style="font-weight: 600;">=</span><span class="s2" style="color: #d14;">"</span><span class="si" style="color: #d14;">$(</span><span class="nb" style="color: #0086b3;">grep</span> <span class="nt" style="color: #000080;">-v</span> ^# ~jenkins-adm/jenkins.debian.net/jenkins-home/offline_nodes | <span class="nb" style="color: #0086b3;">grep</span> <span class="nt" style="color: #000080;">-c</span> debian<span class="si" style="color: #d14;">)</span><span class="s2" style="color: #d14;">"</span></span>
</pre>
</td>
</tr>
<tr class="line_holder new" id="" style="line-height: 1.6;">
<td class="diff-line-num new old_line" data-linenumber="67" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #c7f0d2; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#ddfbe6">
 
</td>
<td class="diff-line-num new new_line" data-linenumber="73" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #c7f0d2; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#ddfbe6">
73
</td>
<td class="line_content new" style="padding-left: 0.5em; padding-right: 0.5em;" bgcolor="#ecfdf0">
<pre style="margin: 0;">+<span id="LC73" class="line" lang="shell">         <span class="k" style="font-weight: 600;">if</span> <span class="o" style="font-weight: 600;">[</span> <span class="s2" style="color: #d14;">"</span><span class="nv" style="color: #008080;">$NODES_OFFLINE</span><span class="s2" style="color: #d14;">"</span> <span class="o" style="font-weight: 600;">!=</span> <span class="s2" style="color: #d14;">"</span><span class="nv" style="color: #008080;">$NODES_GITOFFLINE</span><span class="s2" style="color: #d14;">"</span> <span class="o" style="font-weight: 600;">]</span> <span class="p">;</span> <span class="k" style="font-weight: 600;">then</span></span>
</pre>
</td>
</tr>
<tr class="line_holder new" id="" style="line-height: 1.6;">
<td class="diff-line-num new old_line" data-linenumber="67" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #c7f0d2; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#ddfbe6">
 
</td>
<td class="diff-line-num new new_line" data-linenumber="74" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #c7f0d2; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#ddfbe6">
74
</td>
<td class="line_content new" style="padding-left: 0.5em; padding-right: 0.5em;" bgcolor="#ecfdf0">
<pre style="margin: 0;">+<span id="LC74" class="line" lang="shell"><span class="k" style="font-weight: 600;">                     </span><span class="nv" style="color: #008080;">NODES_OFFLINE</span><span class="o" style="font-weight: 600;">=</span><span class="s2" style="color: #d14;">"</span><span class="se" style="color: #d14;">\0</span><span class="s2" style="color: #d14;">33[93m</span><span class="nv" style="color: #008080;">$NODES_OFFLINE</span><span class="se" style="color: #d14;">\0</span><span class="s2" style="color: #d14;">33[0m"</span></span>
</pre>
</td>
</tr>
<tr class="line_holder new" id="" style="line-height: 1.6;">
<td class="diff-line-num new old_line" data-linenumber="67" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #c7f0d2; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#ddfbe6">
 
</td>
<td class="diff-line-num new new_line" data-linenumber="75" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #c7f0d2; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#ddfbe6">
75
</td>
<td class="line_content new" style="padding-left: 0.5em; padding-right: 0.5em;" bgcolor="#ecfdf0">
<pre style="margin: 0;">+<span id="LC75" class="line" lang="shell">         <span class="k" style="font-weight: 600;">fi</span></span>
</pre>
</td>
</tr>
<tr class="line_holder new" id="" style="line-height: 1.6;">
<td class="diff-line-num new old_line" data-linenumber="67" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #c7f0d2; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#ddfbe6">
 
</td>
<td class="diff-line-num new new_line" data-linenumber="76" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #c7f0d2; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#ddfbe6">
76
</td>
<td class="line_content new" style="padding-left: 0.5em; padding-right: 0.5em;" bgcolor="#ecfdf0">
<pre style="margin: 0;">+<span id="LC76" class="line" lang="shell"><span class="k" style="font-weight: 600;">             </span><span class="nb" style="color: #0086b3;">echo</span> <span class="nt" style="color: #000080;">-e</span> <span class="s2" style="color: #d14;">"nodes: (total/auto-offline/offline in git)    </span><span class="nv" style="color: #008080;">$NODES_TOTAL</span><span class="s2" style="color: #d14;"> / </span><span class="nv" style="color: #008080;">$NODES_OFFLINE</span><span class="s2" style="color: #d14;"> / </span><span class="nv" style="color: #008080;">$NODES_GITOFFLINE</span><span class="s2" style="color: #d14;">"</span></span>
</pre>
</td>
</tr>
<tr class="line_holder" id="" style="line-height: 1.6;">
<td class="diff-line-num old_line" data-linenumber="67" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
67
</td>
<td class="diff-line-num new_line" data-linenumber="77" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
77
</td>
<td class="line_content" style="padding-left: 0.5em; padding-right: 0.5em;">
<pre style="margin: 0;"> <span id="LC77" class="line" lang="shell">         <span class="nb" style="color: #0086b3;">echo</span></span>
</pre>
</td>
</tr>
<tr class="line_holder" id="" style="line-height: 1.6;">
<td class="diff-line-num old_line" data-linenumber="68" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
68
</td>
<td class="diff-line-num new_line" data-linenumber="78" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
78
</td>
<td class="line_content" style="padding-left: 0.5em; padding-right: 0.5em;">
<pre style="margin: 0;"> <span id="LC78" class="line" lang="shell"><span class="nb" style="color: #0086b3;">              df</span> <span class="nt" style="color: #000080;">-h</span>  /dev/vda1 /var/lib/jenkins/userContent/reproducible /srv/workspace /tmp | <span class="nb" style="color: #0086b3;">awk</span> <span class="s1" style="color: #d14;">'{printf "%-45s %-6s %-6s %s\n", $6, $2, $4, $5}'</span></span>
</pre>
</td>
</tr>
<tr class="line_holder" id="" style="line-height: 1.6;">
<td class="diff-line-num old_line" data-linenumber="69" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
69
</td>
<td class="diff-line-num new_line" data-linenumber="79" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
79
</td>
<td class="line_content" style="padding-left: 0.5em; padding-right: 0.5em;">
<pre style="margin: 0;"> <span id="LC79" class="line" lang="shell">         free <span class="nt" style="color: #000080;">-h</span> | <span class="nb" style="color: #0086b3;">cut</span> <span class="nt" style="color: #000080;">-b1-47</span></span>
</pre>
</td>
</tr>

</table>
<br>
</li>
<li id="862f419123dea7ff48660213ea868f4b676cd4af">
<a href="https://salsa.debian.org/qa/jenkins.debian.net/-/compare/13db97547efcd6b0001afd6ebaa0ca77ec8232d5...d099a852bd994f1ff7e34dae6176f25f46d8ed13#862f419123dea7ff48660213ea868f4b676cd4af"><strong>bin/reproducible_system_health.sh</strong></a>
<hr>
<table class="code white" style="font-family: monospace; font-size: 90%;" bgcolor="#fff" width="100%" cellpadding="0" cellspacing="0">
<tr class="line_holder match" id="" style="line-height: 1.6;">
<td class="diff-line-num unfold js-unfold old_line" data-linenumber="363" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">...</td>
<td class="diff-line-num unfold js-unfold new_line" data-linenumber="363" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">...</td>
<td class="line_content match " style="padding-left: 0.5em; padding-right: 0.5em; color: rgba(0,0,0,0.3);" bgcolor="#fafafa">@@ -363,7 +363,7 @@ conditional_paragraph ${FAILED_SUSPECTS} "Failed jobs on nodes automatically mar</td>
</tr>
<tr class="line_holder" id="" style="line-height: 1.6;">
<td class="diff-line-num old_line" data-linenumber="363" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
363
</td>
<td class="diff-line-num new_line" data-linenumber="363" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
363
</td>
<td class="line_content" style="padding-left: 0.5em; padding-right: 0.5em;">
<pre style="margin: 0;"> <span id="LC363" class="line" lang="shell">conditional_paragraph <span class="k" style="font-weight: 600;">${</span><span class="nv" style="color: #008080;">UNSTABLE_SUSPECTS</span><span class="k" style="font-weight: 600;">}</span> <span class="s2" style="color: #d14;">"Unstable jobs on nodes automatically marked down by jenkins (with modifier > 1)"</span></span>
</pre>
</td>
</tr>
<tr class="line_holder" id="" style="line-height: 1.6;">
<td class="diff-line-num old_line" data-linenumber="364" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
364
</td>
<td class="diff-line-num new_line" data-linenumber="364" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
364
</td>
<td class="line_content" style="padding-left: 0.5em; padding-right: 0.5em;">
<pre style="margin: 0;"> <span id="LC364" class="line" lang="shell">write2healthfile <span class="s2" style="color: #d14;">"<hr><p>A stable jobs adds 3 to the score, an unstable job adds 1 and a failed job substracts something between 1 and 500 (indicated in brackets after the job name if not equal 1), depending on the importance of the job for the setup. Ignored jobs are not counted at all. If the final score is below zero it will be set to zero. Finally status is calculated by diving the score by three times the number of considered jobs and this gets multiplied with 255 to get a status between 0 and 255.</p><hr>"</span></span>
</pre>
</td>
</tr>
<tr class="line_holder" id="" style="line-height: 1.6;">
<td class="diff-line-num old_line" data-linenumber="365" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
365
</td>
<td class="diff-line-num new_line" data-linenumber="365" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
365
</td>
<td class="line_content" style="padding-left: 0.5em; padding-right: 0.5em;">
<pre style="margin: 0;"> <span id="LC365" class="line" lang="shell">conditional_paragraph <span class="k" style="font-weight: 600;">${</span><span class="nv" style="color: #008080;">IGNORED_JOBS</span><span class="k" style="font-weight: 600;">}</span> <span class="s2" style="color: #d14;">"Ignored jobs, because the nodes these are running on are <a href=</span><span class="se" style="color: #d14;">\"</span><span class="s2" style="color: #d14;">https://salsa.debian.org/qa/jenkins.debian.net/-/blob/master/jenkins-home/offline_nodes</span><span class="se" style="color: #d14;">\"</span><span class="s2" style="color: #d14;">>documented</a> to be offline"</span></span>
</pre>
</td>
</tr>
<tr class="line_holder old" id="" style="line-height: 1.6;">
<td class="diff-line-num old old_line" data-linenumber="366" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #fac5cd; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#f9d7dc">
366
</td>
<td class="diff-line-num new_line old" data-linenumber="366" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #fac5cd; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#f9d7dc">
 
</td>
<td class="line_content old" style="padding-left: 0.5em; padding-right: 0.5em;" bgcolor="#fbe9eb">
<pre style="margin: 0;">-<span id="LC366" class="line" lang="shell">conditional_paragraph <span class="k" style="font-weight: 600;">${</span><span class="nv" style="color: #008080;">KNOWN_BAD_JOBS</span><span class="k" style="font-weight: 600;">}</span> <span class="s2" style="color: #d14;">"Ignored jobs, because they are known to be disabled<span class="idiff left right"> as non-funtional</span>"</span></span>
</pre>
</td>
</tr>
<tr class="line_holder new" id="" style="line-height: 1.6;">
<td class="diff-line-num new old_line" data-linenumber="367" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #c7f0d2; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#ddfbe6">
 
</td>
<td class="diff-line-num new new_line" data-linenumber="366" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #c7f0d2; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#ddfbe6">
366
</td>
<td class="line_content new" style="padding-left: 0.5em; padding-right: 0.5em;" bgcolor="#ecfdf0">
<pre style="margin: 0;">+<span id="LC366" class="line" lang="shell">conditional_paragraph <span class="k" style="font-weight: 600;">${</span><span class="nv" style="color: #008080;">KNOWN_BAD_JOBS</span><span class="k" style="font-weight: 600;">}</span> <span class="s2" style="color: #d14;">"Ignored jobs, because they are known to be disabled"</span></span>
</pre>
</td>
</tr>
<tr class="line_holder" id="" style="line-height: 1.6;">
<td class="diff-line-num old_line" data-linenumber="367" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
367
</td>
<td class="diff-line-num new_line" data-linenumber="367" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
367
</td>
<td class="line_content" style="padding-left: 0.5em; padding-right: 0.5em;">
<pre style="margin: 0;"> <span id="LC367" class="line" lang="shell">write2healthfile <span class="s2" style="color: #d14;">"<hr><p><small>This page was last updated on </span><span class="si" style="color: #d14;">$(</span><span class="nb" style="color: #0086b3;">date</span> <span class="nt" style="color: #000080;">-u</span><span class="si" style="color: #d14;">)</span><span class="s2" style="color: #d14;"> by the <a href=</span><span class="se" style="color: #d14;">\"</span><span class="s2" style="color: #d14;">https://jenkins.debian.net/job/reproducible_system_health/</span><span class="se" style="color: #d14;">\"</span><span class="s2" style="color: #d14;">>reproducible_system_health</a> job.</small></p>"</span></span>
</pre>
</td>
</tr>
<tr class="line_holder" id="" style="line-height: 1.6;">
<td class="diff-line-num old_line" data-linenumber="368" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
368
</td>
<td class="diff-line-num new_line" data-linenumber="368" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
368
</td>
<td class="line_content" style="padding-left: 0.5em; padding-right: 0.5em;">
<pre style="margin: 0;"> <span id="LC368" class="line" lang="shell">write2healthfile <span class="s2" style="color: #d14;">"</body></html>"</span></span>
</pre>
</td>
</tr>
<tr class="line_holder" id="" style="line-height: 1.6;">
<td class="diff-line-num old_line" data-linenumber="369" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
369
</td>
<td class="diff-line-num new_line" data-linenumber="369" style="width: 35px; color: rgba(0,0,0,0.3); border-right-width: 1px; border-right-color: #f0f0f0; border-right-style: solid; padding: 0 5px;" align="right" bgcolor="#fafafa">
369
</td>
<td class="line_content" style="padding-left: 0.5em; padding-right: 0.5em;">
<pre style="margin: 0;"> <span id="LC369" class="line" lang="shell"><span class="nb" style="color: #0086b3;">echo</span> <span class="s2" style="color: #d14;">"</span><span class="si" style="color: #d14;">$(</span><span class="nb" style="color: #0086b3;">date</span> <span class="nt" style="color: #000080;">-u</span><span class="si" style="color: #d14;">)</span><span class="s2" style="color: #d14;"> - </span><span class="si" style="color: #d14;">$(</span><span class="nb" style="color: #0086b3;">basename</span> <span class="nv" style="color: #008080;">$HEALTH_FILE</span><span class="si" style="color: #d14;">)</span><span class="s2" style="color: #d14;">.html updated, visible at </span><span class="nv" style="color: #008080;">$REPRODUCIBLE_URL</span><span class="s2" style="color: #d14;">/</span><span class="si" style="color: #d14;">$(</span><span class="nb" style="color: #0086b3;">basename</span> <span class="nv" style="color: #008080;">$HEALTH_FILE</span><span class="si" style="color: #d14;">)</span><span class="s2" style="color: #d14;">.html."</span></span>
</pre>
</td>
</tr>

</table>
<br>
</li>

</div>
<div class="footer" style="margin-top: 10px;">
<p style="font-size: small; color: #777;">

<br>
<a href="https://salsa.debian.org/qa/jenkins.debian.net/-/compare/13db97547efcd6b0001afd6ebaa0ca77ec8232d5...d099a852bd994f1ff7e34dae6176f25f46d8ed13">View it on GitLab</a>.
<br>
You're receiving this email because of your account on salsa.debian.org.
If you'd like to receive fewer emails, you can
adjust your notification settings.



</p>
</div>
</body>
</html>