[Pkg-javascript-devel] Rebuilding of nodejs reverse dependencies

[Jérémy Lal]

On Wed, Mar 16, 2022 at 10:19 PM Jérémy Lal <kapouer at melix.org> wrote:

>
>
> On Tue, Mar 15, 2022 at 1:01 PM Jérémy Lal <kapouer at melix.org> wrote:
>
>>
>>
>> On Tue, Mar 15, 2022 at 1:01 PM Jérémy Lal <kapouer at melix.org> wrote:
>>
>>>
>>>
>>> On Tue, Mar 15, 2022 at 11:42 AM Jérémy Lal <kapouer at melix.org> wrote:
>>>
>>>>
>>>>
>>>> On Tue, Mar 15, 2022 at 11:32 AM Nilesh Patra <nilesh at riseup.net>
>>>> wrote:
>>>>
>>>>> On 3/15/22 5:21 AM, Jérémy Lal wrote:
>>>>> > i've setup a specific salsa ci pipeline for this:
>>>>> > https://salsa.debian.org/js-team/nodejs/-/pipelines/358409 <
>>>>> https://salsa.debian.org/js-team/nodejs/-/pipelines/358409>
>>>>> >
>>>>> > As you can see, it has jobs for rebuilding reverse build-depends.
>>>>> > It is not meant to be triggered continuously (because it consumes a
>>>>> lot of resources),
>>>>> > one has to trigger it by hand, which I have done just before.
>>>>> >
>>>>> > I'd extend the list of jobs to the list of 1677 source packages
>>>>> build-depending on nodejs, but
>>>>> > it might consume too much time and space on salsa-ci...
>>>>> > [...]
>>>>>
>>>>> This is cool, but
>>>>> Please consider asking salsa CI admins if it is okay to trigger builds
>>>>> for large volumes of reverse dependencies.
>>>>> Several months back (IIRC) something similar happened in the ruby-team
>>>>> and the runners choked because of that
>>>>> and even salsa went down :)
>>>>>
>>>>
>>>> Yes,
>>>> https://salsa.debian.org/salsa/support/-/issues/291
>>>>
>>>> I'm waiting for an answer.
>>>> I only tried the rebuild of ~30 reverse build-deps of libnode-dev for
>>>> now.
>>>>
>>>
>>> The answer from the salsa admin is no.
>>> I'll do the minimal solution, then: fix libnode-dev reverse build-deps,
>>> and let other breakage happen in unstable.
>>>
>>
>> That is, unless someone knows where I can get a spare salsa ci runner.
>>
>
> So I ended up installing a gitlab-runner with nspawn-runner and a
> semi-active server I maintain.
> I documented the process here:
> https://wiki.debian.org/Salsa/Doc/CustomRunners/SystemdNspawnRunner
>
> salsa's driving that runner to rebuild the thousands of packages now.
> Minimal build time is 1 minute, so it should take about two days to
> rebuild the whole.
>
> After that, anyone knowing gitlab API and bugs.debian.org API could help
> to open FTBFS bugs ?
>

I started this:
https://salsa.debian.org/kapouer/dance

to fetch logs of failed jobs, and also to be able to retry jobs that failed
because of external reasons
(runner configuration issue, for example).
When all jobs are finished, i'll start to use "dance" to send bug reports.

Jérémy

>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://alioth-lists.debian.net/pipermail/pkg-javascript-devel/attachments/20220317/84a240f6/attachment.htm>