[From nobody Thu Jul 9 08:13:04 2026 Received: (at maintonly) by bugs.debian.org; 11 Nov 2020 14:35:40 +0000 X-Spam-Checker-Version: SpamAssassin 3.4.2-bugs.debian.org_2005_01_02 (2018-09-13) on buxtehude.debian.org X-Spam-Level: X-Spam-Status: No, score=-13.5 required=4.0 tests=BAYES_00,DIGITS_LETTERS, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_FROM, MD5_SHA1_SUM,RCVD_IN_DNSWL_NONE,SPF_HELO_NONE,SPF_PASS,TXREP autolearn=ham autolearn_force=no version=3.4.2-bugs.debian.org_2005_01_02 X-Spam-Bayes: score:0.0000 Tokens: new, 7; hammy, 150; neutral, 121; spammy, 0. spammytokens: hammytokens:0.000-+--autopkgtest, 0.000-+--sk:README, 0.000-+--sk:readme., 0.000-+--sk:README., 0.000-+--apparmor Return-path: <sudipm.mukherjee@gmail.com> Received: from mail-wr1-x435.google.com ([2a00:1450:4864:20::435]:39972) by buxtehude.debian.org with esmtps (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from <sudipm.mukherjee@gmail.com>) id 1kcrDo-0000cH-5q for maintonly@bugs.debian.org; Wed, 11 Nov 2020 14:35:40 +0000 Received: by mail-wr1-x435.google.com with SMTP id 33so2739191wrl.7 for <maintonly@bugs.debian.org>; Wed, 11 Nov 2020 06:35:39 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=date:from:message-id:subject:to; bh=QL1X6vh82bDjyUaJ/++mdkWeo84RtMNy5r3bQBtZwak=; b=NmghUZDre/Tf/+TIE6LKjYE1vkrDmc3d418dj/t1PkiZBmfnE5G3A4mOZ1o9PVZ0tG ieC+gcmpAqKoDUBiS9qrsUrCI/SMX0nkuH1XWCJHZED1HmnJIT19oX5KxxRlSmbf9SZw NeEepqiplfF3v+1GX968Iew8dxscuP9yyKyy+PGzzBTAvEHL9VApWVIkkFe4rNW/amyy x4AnGgu1fwRvNqdqmojpJqYv5+yHMShwadfk94eczySxewszio2Q8yKlepdrEZb1o1mS 9lK7x+2tzpHKNU0lKvTcrIEV1dcVRTRCtu9GP+wkKoNzbbUfPM7KcbWir4/5dGFoLB48 Cqhg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:message-id:subject:to; bh=QL1X6vh82bDjyUaJ/++mdkWeo84RtMNy5r3bQBtZwak=; b=GoqEwQcydQdKLJfXPjX8R3RnLwCxTwWH9O0pc34abcK6hMCETmHUQM629T557AKEqF 1gArwAKBS9BjEywQhuqi+9IzGw9a3ReUpc7Mxe43G5GHD5PrDJK3N/VOo3PIHdsuo4yX eusjR1oHVotVzEMV2UWAnCD27iYNVn88eDAk2MAT80bOo80L/2s0WcJsLC5wfPOLtpsk 5eeqMh0QzHEkZ18t4Sm+GhRanMjcSdJpbMkqCpF/PmjrvtCHmcUnnnoMtDmySFgT8oA9 tg1iCcB/XvH9mveXJtmFCV+dVMNeeIGD4tuVsedqSjI0sh3L11fhFLGh4pfM2/M4c4yB rlHA== X-Gm-Message-State: AOAM533KYszOyx0IMKTJCV7STrvfZmqcXwxmhaB3Sl4vkAc3SdvqHNWo th41MI+gZ/VyroSFmw5iUdkjB5dk/N73fw== X-Google-Smtp-Source: ABdhPJxEp4pjiRT/4TuUnhFNfgbrZKr3FHswp42R8jdRZ8tMH+4QFhL7ijHmtgjsV1innjj7shuJfA== X-Received: by 2002:adf:ef48:: with SMTP id c8mr30902117wrp.399.1605105338304; Wed, 11 Nov 2020 06:35:38 -0800 (PST) Received: from debian.vm (host-92-5-241-147.as43234.net. [92.5.241.147]) by smtp.gmail.com with ESMTPSA id k20sm2872398wmi.15.2020.11.11.06.35.37 for <maintonly@bugs.debian.org> (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 11 Nov 2020 06:35:37 -0800 (PST) Date: Wed, 11 Nov 2020 06:35:37 -0800 (PST) X-Google-Original-Date: Wed, 11 Nov 2020 14:04:59 GMT From: Sudip Mukherjee <sudipm.mukherjee@gmail.com> X-Google-Original-From: Sudip Mukherjee <sudip@debian.vm> Received: from debian.vm (localhost [127.0.0.1]) by debian.vm (8.15.2/8.15.2/Debian-20) with ESMTP id 0ABE4xZT020878 for <maintonly@bugs.debian.org>; Wed, 11 Nov 2020 14:04:59 GMT Received: (from sudip@localhost) by debian.vm (8.15.2/8.15.2/Submit) id 0ABE4x0F020877; Wed, 11 Nov 2020 14:04:59 GMT Message-Id: <202011111404.0ABE4x0F020877@debian.vm> Subject: node-jsbn: autopkgtest must be marked superficial To: <maintonly@bugs.debian.org> X-Mailer: mail (GNU Mailutils 3.10) Delivered-To: maintonly@bugs.debian.org Source: node-jsbn X-Debbugs-CC: elbrus@debian.org Severity: important Usertags: superficialtest Dear Maintainer, It has been noticed that the autopkgtest in node-jsbn is running a trivial command that does not provide significant test coverage: - nodejs -e "require('jsbn');" Executing that command is considered to be a trivial test, which does not provide significant coverage for a package as a whole. But these tests are a useful way to detect regressions in dependencies and prevent them from breaking your package. However, it is important that we are realistic about the level of test coverage provided by these commands: most regressions cannot be detected in this way. So it is not appropriate for packages with only superficial tests to have the reduced migration time to migrate from unstable to testing as that means less opportunity for testing by users compared to the package with no tests. To support this, the keyword "Restrictions: superficial" has been defined [1]. Packages where all tests are marked with this keyword are not considered for the reduced migration age from unstable to testing, and will not be allowed to migrate automatically in later stages of the freeze [2]. Its always better to have more extensive testing than having superficial testing, which again is better than having no test. Please consider i) Adding a non-trivial test, and/or ii) Mark the trivial test with "Restrictions: superficial", similar to [3] or [4]. The Release Team has listed this issue in the list of Release Critical Issues for bullseye [5] and has mentioned that the test must be marked superficial if it is not testing one of its own installed binary packages in some way. As a result, the severity of this bug report might be increased to serious in future. [1] https://salsa.debian.org/ci-team/autopkgtest/-/blob/master/doc/README.package-tests.rst#defined-restrictions [2] https://release.debian.org/bullseye/freeze_policy.html [3] https://salsa.debian.org/utopia-team/dbus/-/commit/a80908df7d119b181eec5eb0542634a30c2ad468 [4] https://salsa.debian.org/apparmor-team/apparmor/-/commit/580667513a097088ebe579884b38ac8d8666d3b3 [5] https://release.debian.org/bullseye/rc_policy.txt -- Regards Sudip ]