[Reproducible-builds] Proposal to double/triple capacity of the armhf build network
Vagrant Cascadian
vagrant at debian.org
Sun Dec 13 01:24:29 UTC 2015
This proposal outlines how to double or triple the current capacity of
the armhf reproducible build network by purchasing a variety of boards
and related equipment.
The current armhf reproducible build network is barely keeping up with
the demand, and it currently only supports "unstable". It would be
good to support "testing" and "experimental" as well. This will
require considerably more hardware, given that armhf is somewhat slow.
After several months, the armhf reproducible build network still hasn't
tested every package:
https://reproducible.debian.net/unstable/index_suite_armhf_stats.html
Compared to the amd64 reproducible build network which can rebuild the
unstable suite in roughly 4 days, it's painfully slow.
Some packages that were tested months ago haven't been tested against
changes in the current toolchain. A handful of long-running builds
have been blacklisted so as not to slow down testing the rest of the
archive.
The current armhf reproducible build network has 22 CPU cores and 10GB
of ram. This seems the simplest reasonable measure of the network's
capacity, and is used to compare the various proposal variations...
----------------------
Proposal 1, $USD1700:
Roughly double the current network.
Add six quad-core, 2GB ram boards, with moderate to good mainline
support.
Results
46 CPUs (+24), 22GB ram (+12), 13 systems (+6)
----------------------
Proposal 2, USD$3500:
Roughly triple (and then some) the current network.
Like Proposal 1, but twice as much of everything, possibly slightly
different boards to increase board diversity and/or add more ram (4GB
variants of hummingboard or firefly), which may impact cost to varying
degrees.
Results:
70 CPUs (+48), 34-8GB ram (+24-28), 19 systems (+12)
----------------------
Upgrade Proposal, USD$750:
Add roughly 50% of the current network.
Retire three dual-core machines and replace with three quad-core
machines with more ram and one extra raspberrypi 2b.
Results:
+10 CPUs, +6GB ram, +1 system
----------------------
Proposal 1 details:
|---+------+-------+----------------------------+-----------------+-----+-------+---------+---------+-----+-------+------+-----+------|
| | cost | unit | description | cpu | ram | cores | linux | u-boot | SSD | mSATA | USB- | uSD | USB- |
| | | price | | | | | | | | | sata | | TTL |
|---+------+-------+----------------------------+-----------------+-----+-------+---------+---------+-----+-------+------+-----+------|
| | 139 | | wandboard-quad | imx6q | 2 | 4 | 3.16 | yes | 1 | | | 1 | |
| | 19 | | USB serial adapter | a9 | | | | | | | | | |
| | 12 | | case | | | | | | | | | | |
| | 10 | | domestic shipping | | | | | | | | | | |
| | 17 | | power supply | | | | | | | | | | |
| | 10 | | ?? sata power adapter | | | | | | | | | | |
| | | | | | | | | | | | | | |
| | 83 | | odroid-xu4 w/ case/power | exynos5422 | 2 | 4 | 4.4 or | vendor | 1 | | 1 | 1 | |
| | 13 | | serial adapter | a7/a15 | | | 4.3 + | | | | | | |
| | 10 | | domestic shipping | | | | patches | | | | | | |
| | | | | | | | | | | | | | |
| | 278 | 139 | TWO cubieboard4 w/ case | allwinner-a80 | 2 | 4 | 4.2 | vendor/ | 1 | | 1 | 1 | 1 |
| | 36 | 18 | power supply 5v 4amp | a7/a15 | 2 | 4 | | maybe | 1 | | 1 | 1 | 1 |
| | | | | | | | | | | | | | |
| | 320 | 160 | TWO firefly 2g | rockchip-rk3288 | 2 | 4 | 4.2 | yes | 1 | | 1 | 1 | 1 |
| | 20 | 10 | ?? case | a17 | 2 | 4 | | | 1 | | 1 | 1 | 1 |
| | 20 | 10 | ?? power | | | | | | | | | | |
| | | | | | | | | | | | | | |
| | 130 | | 8 port remote power switch | | | | | | | | | | |
| | 8 | | 10-port USB hub for serial | | | | | | | | | | |
| | | | replace old ssd/msata/uSD | | | | | | 1 | 1 | | 2 | |
|---+------+-------+----------------------------+-----------------+-----+-------+---------+---------+-----+-------+------+-----+------|
| # | 315 | 45 | 120GB ssd | | | | | | | | | | |
| | | | | | | | | | | | | | |
| # | 50 | 10 | USB-sata adapter | | | | | | | | | | |
| | | | | | | | | | | | | | |
| # | 76 | 19 | USB-TTL/FTDI serial | | | | | | | | | | |
| # | 49 | 49 | 120GB msata | | | | | | | | | | |
| # | 40 | 5 | microSD 4G, class10 | | | | | | | | | | |
| | | | | | | | | | | | | | |
|---+------+-------+----------------------------+-----------------+-----+-------+---------+---------+-----+-------+------+-----+------|
| | cost | unit | description | | ram | cores | linux | u-boot | SSD | mSATA | USB- | uSD | USB- |
| | | price | | | | | | | | | sata | | TTL |
|---+------+-------+----------------------------+-----------------+-----+-------+---------+---------+-----+-------+------+-----+------|
| # | 1655 | | grand total | | 12 | 24 | | | 7 | 1 | 5 | 8 | 4 |
#+TBLFM: @24$2=(@24$3 * @34$10)::@26$2=(@26$3 * @34$12)::@28$2=(@28$3 * @34$14)::@29$2=(@29$3 * @34$11)::@30$2=(@30$3 * @34$13)::@34$2=vsum(@II.. at IIII)::@34$6=vsum(@II.. at III)::@34$7=vsum(@II.. at III)::@34$10=vsum(@II.. at III)::@34$11=vsum(@II.. at III)::@34$12=vsum(@II.. at III)::@34$13=vsum(@II.. at III)::@34$14=vsum(@II.. at III)
Upgrade Proposal Details:
|---+------+-------+--------------------------+--------------+-----+-------+-----------+--------+-----+-------+------+-----+------|
| | cost | unit | description | cpu | ram | cores | linux | u-boot | SSD | mSATA | USB- | uSD | USB- |
| | | price | | | | | | | | | sata | | TTL |
|---+------+-------+--------------------------+--------------+-----+-------+-----------+--------+-----+-------+------+-----+------|
| | | | retire 3 machines | | -3 | -6 | | | | | | | |
| | | | | | | | | | | | | | |
| | 98 | 49 | TWO Orange pi plus2 | allwinner-h3 | 2 | 4 | vendor | maybe | 1 | | | 1 | 1 |
| | 20 | 10 | ??international shipping | a7 | 2 | 4 | 4.5 maybe | | 1 | | | 1 | 1 |
| | 20 | 10 | ??case | | | | | | | | | | |
| | | | | | | | | | | | | | |
| | 47 | | raspberry pi 2b w/ power | bcm2386 | 1 | 4 | 4.x + | yes | 1 | | 1 | 1 | 1 |
| | 9 | | case | a7 | | | patches | | | | | | |
| | | | | | | | | | | | | | |
| | 200 | | hummingboad-i4ex | imx6q | 4 | 4 | maybe | maybe | | 1 | | 1 | 1 |
| | 10 | | ??case | a9 | | | | | | | | | |
| | 20 | | ??international shipping | | | | | | | | | | |
| | | | | | | | | | | | | | |
| | 20 | | 5v 10amp power supply | | | | | | | | | | |
| | 10 | | misc adapters | | | | | | | | | | |
| | 5 | | 4-way splitter | | | | | | | | | | |
|---+------+-------+--------------------------+--------------+-----+-------+-----------+--------+-----+-------+------+-----+------|
| # | 135 | 45 | ssd | | | | | | | | | | |
| | | | | | | | | | | | | | |
| # | 10 | 10 | USB-sata | | | | | | | | | | |
| | | | | | | | | | | | | | |
| # | 76 | 19 | USB-TTL/FTDI serial | | | | | | | | | | |
| # | 49 | 49 | msata | | | | | | | | | | |
| # | 20 | 5 | microsd | | | | | | | | | | |
| | | | | | | | | | | | | | |
|---+------+-------+--------------------------+--------------+-----+-------+-----------+--------+-----+-------+------+-----+------|
| | cost | unit | description | | ram | cores | linux | u-boot | SSD | mSATA | USB- | uSD | USB- |
| | | price | | | | | | | | | sata | | TTL |
|---+------+-------+--------------------------+--------------+-----+-------+-----------+--------+-----+-------+------+-----+------|
| # | 749 | | grand total | | 6 | 10 | | | 3 | 1 | 1 | 4 | 4 |
#+TBLFM: @5$2=(@5$3 * 2)::@19$2=(@19$3 * @29$10)::@21$2=(@21$3 * @29$12)::@23$2=(@23$3 * @29$14)::@24$2=(@24$3 * @29$11)::@25$2=(@25$3 * @29$13)::@29$2=vsum(@II.. at IIII)::@29$6=vsum(@II.. at III)::@29$7=vsum(@II.. at III)::@29$10=vsum(@II.. at III)::@29$11=vsum(@II.. at III)::@29$12=vsum(@II.. at III)::@29$13=vsum(@II.. at III)::@29$14=vsum(@II.. at III)
Appendix:
Boards and board-specific parts:
wandboard-quad:
http://www.mouser.com/ProductDetail/Wandboard/WBQUAD/?qs=cF9QIdCP5siVNjY/ywrBAA==
case:
http://www.mouser.com/ProductDetail/Wandboard/WBENCLOSURE/?qs=sGAEpiMZZMv%2bZqqdCpW8NyPQ99nKRg4V
power supply:
http://www.mouser.com/Search/ProductDetail.aspx?qs=9v8X2fPoQt6P5Du4F6Pv9w%3d%3d
USB serial adapter:
https://smile.amazon.com/gp/product/B008634VJY?psc=1&redirect=true&ref_=oh_aui_detailpage_o06_s01
odroid-xu4 w/ case/power :
http://ameridroid.com/products/odroid-xu4?quantity=1&variant_id=134
USB serial adapter:
http://ameridroid.com/products/usb-uart-module-kit2
raspberry pi 2 :
http://smile.amazon.com/CanaKit-Raspberry-Basic-Micro-Supply/dp/B00DG9D6IK/ref=sr_1_4?s=pc&ie=UTF8&qid=1449786606&sr=1-4&keywords=raspberry+pi2+power
case :
http://smile.amazon.com/Premium-Clear-Case-Raspberry-Model/dp/B00MQLB1N6/ref=sr_1_1?s=pc&ie=UTF8&qid=1449786233&sr=1-1&keywords=raspberry+pi2+case
cubieboard4 w/ case :
https://smile.amazon.com/gp/product/B00RTU1WLU/ref=ox_sc_sfl_title_25?ie=UTF8&psc=1&smid=A3UCASNNG2EZ1E
power supply 5v 4amp :
http://smile.amazon.com/DC-5V-adaper-cubieboard-CC-A80/dp/B00S1KOSC2/ref=pd_sim_147_1?ie=UTF8&dpID=51qd%2BbfPJRL&dpSrc=sims&preST=_AC_UL160_SR160%2C160_&refRID=1FG6G88QDDYTCX4VVTMH
firefly 2g :
https://smile.amazon.com/gp/product/B01716JHCM/ref=ox_sc_sfl_title_21?ie=UTF8&psc=1&smid=A1WAV9JJNZ1SS8
firefly 4G :
https://smile.amazon.com/gp/product/B00VGE1HZ6/ref=ox_sc_sfl_title_22?ie=UTF8&psc=1&smid=A35AFW9EVJYR0N
orange pi plus2 :
http://www.aliexpress.com/store/product/Orange-Pi-Plus-2-H3-Quad-Core-1-6GHZ-2GB-RAM-4K-Open-source-development-board/1553371_32516755321.html
hummingboard-i4x2 and hummingboard-i4x4 (it's a bunch of drop-down selections):
http://solid-run.com/product/hummingboard-carrier-pro/
Misc:
8 port remote power switch:
https://smile.amazon.com/gp/product/B00EZWD146/ref=ox_sc_sfl_title_11?ie=UTF8&psc=1&smid=A3D4241373L385
10-port USB hub for serial:
https://smile.amazon.com/gp/product/B00W5TIKOW?psc=1&redirect=true&ref_=oh_aui_detailpage_o07_s01
ssd :
https://smile.amazon.com/SanDisk-Internal-120GB-2-5-Inch-SDSSDA-120G-G25/dp/B00S9Q9UKS/ref=sr_1_1?ie=UTF8&qid=1449603674&sr=8-1&keywords=120g+ssd
https://smile.amazon.com/gp/product/B015ZBTTPA/ref=ox_sc_sfl_title_7?ie=UTF8&psc=1&smid=ADHGUDQHFUGFQ
USB-sata :
https://smile.amazon.com/gp/product/B00J3IAU8C/ref=ox_sc_sfl_title_20?ie=UTF8&psc=1&smid=A2HC58KVPP5OOH
https://smile.amazon.com/gp/product/B011M8YACM?psc=1&redirect=true&ref_=oh_aui_detailpage_o08_s01
microsd :
https://smile.amazon.com/gp/product/B016MJCPOQ/ref=ox_sc_sfl_title_13?ie=UTF8&psc=1&smid=AV36M47EXWJ1K
or
https://smile.amazon.com/gp/product/B015SKIW8S/ref=ox_sc_sfl_title_14?ie=UTF8&psc=1&smid=A1BYMXV4CSJFD6
5v 10amp power supply :
https://smile.amazon.com/gp/product/B015109EI2?psc=1&redirect=true&ref_=oh_aui_detailpage_o08_s00
msata 128G:
https://smile.amazon.com/KingSpec-128GB-mSATA-internal-solid/dp/B00Z6X7978/ref=sr_1_2?s=pc&ie=UTF8&qid=1449605999&sr=1-2&keywords=msata&refinements=p_n_feature_keywords_four_browse-bin%3A6075044011%2Cp_36%3A-6000%2Cp_n_feature_three_browse-bin%3A6797517011|6797518011%2Cp_76%3A1249137011
live well,
vagrant
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 818 bytes
Desc: not available
URL: <http://lists.alioth.debian.org/pipermail/reproducible-builds/attachments/20151212/d476d70a/attachment.sig>
More information about the Reproducible-builds
mailing list