[From nobody Fri Sep 25 10:19:07 2026 Received: (at maintonly) by bugs.debian.org; 11 Nov 2020 14:05:02 +0000 X-Spam-Checker-Version: SpamAssassin 3.4.2-bugs.debian.org_2005_01_02 (2018-09-13) on buxtehude.debian.org X-Spam-Level: X-Spam-Status: No, score=-13.4 required=4.0 tests=BAYES_00,DIGITS_LETTERS, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_FROM, MD5_SHA1_SUM,RCVD_IN_DNSWL_NONE,SPF_HELO_NONE,SPF_PASS,TXREP autolearn=ham autolearn_force=no version=3.4.2-bugs.debian.org_2005_01_02 X-Spam-Bayes: score:0.0000 Tokens: new, 10; hammy, 150; neutral, 119; spammy, 0. spammytokens: hammytokens:0.000-+--autopkgtest, 0.000-+--sk:README, 0.000-+--sk:readme., 0.000-+--sk:README., 0.000-+--apparmor Return-path: <sudipm.mukherjee@gmail.com> Received: from mail-wr1-x429.google.com ([2a00:1450:4864:20::429]:46752) by buxtehude.debian.org with esmtps (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from <sudipm.mukherjee@gmail.com>) id 1kcqk9-0003xj-MB for maintonly@bugs.debian.org; Wed, 11 Nov 2020 14:05:01 +0000 Received: by mail-wr1-x429.google.com with SMTP id d12so2600579wrr.13 for <maintonly@bugs.debian.org>; Wed, 11 Nov 2020 06:05:01 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=date:from:message-id:subject:to; bh=u/EKGbe/jXZEDbr8ZPelJxJBGsnCbwdWDgQ7ld6ah5I=; b=Uyp75FgOZL99F4KYg+kgKYXjjnKpy+c956MjeKggFv6emPahSpkmdmBKYLEw0JVPuu p9/YGAVs5hFzBDLQFCtTPG/Ctoe8hp+T/3s/AjkbwzxR41F7vFU9FwS7tPUbq4EPwEXm cw/CALNjTlsEfoZXo2wccCZnUtvgh3zi/MsFEOXQl0N5tZXYZqEoi+lfabOzKZcN0Rmq oIK5/18XS0ieOLmhR4EEQN3H0vo7En1SdO7teVq3GGgLHIs1kztg24VaiMle+q+G7g7u cnfo3yPfpYR7+O6JjvY26CcjiGAvU7SmH1m0zjkOYSNZ7OLNK2FOs63YXlLhHnXjWRDp Qqgg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:message-id:subject:to; bh=u/EKGbe/jXZEDbr8ZPelJxJBGsnCbwdWDgQ7ld6ah5I=; b=FK87J8TQOhaRRxwDqPg21IzKhQUj8ikG1iPaIh08nk5kmVtY/VKRnvxCXdaJcMxt3t ie7pnY0C4c/48iB8vLtZVuK7iJT9aokzOfZ+ChYMHekJKKrlnomoYUmcXt52Vd5cS7BC RFiD+BwNuX+3M7vP7HLscvM0ng1qnrQ7b5IsBKMEuN2iWhZyNXc5Yx3oEGwdLhurs5s4 uolz/6XBpEI6lG5dRX8AJnhv4HR6RBYMKdm20i4SE6qKogt6Q5eKZpCwLs4H2qCvfWPu Ql+k9bU3NLkKaj2FC963XG+2g7q7gRMssxG3gSHqxUUVH4o3J8BQkfbE5t7IiimKlkX4 BNoA== X-Gm-Message-State: AOAM531kfm9ga+yT//Tqc72iuazsCJl1Awk7uaM3uSqNFaYBnvv57Ya5 418LvWqmQpbv8zK2xnQnEQMe7UU5A5WTwQ== X-Google-Smtp-Source: ABdhPJytSKfApktRgaxPbx9hWYkBwcKcbMXpG+JJjIL9gLnn4xk4XDdC+kqfHrlimrN5E01eUvARfA== X-Received: by 2002:adf:de91:: with SMTP id w17mr29329969wrl.84.1605103498978; Wed, 11 Nov 2020 06:04:58 -0800 (PST) Received: from debian.vm (host-92-5-241-147.as43234.net. [92.5.241.147]) by smtp.gmail.com with ESMTPSA id i6sm2788507wma.42.2020.11.11.06.04.54 for <maintonly@bugs.debian.org> (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 11 Nov 2020 06:04:57 -0800 (PST) Date: Wed, 11 Nov 2020 06:04:57 -0800 (PST) X-Google-Original-Date: Wed, 11 Nov 2020 14:04:54 GMT From: Sudip Mukherjee <sudipm.mukherjee@gmail.com> X-Google-Original-From: Sudip Mukherjee <sudip@debian.vm> Received: from debian.vm (localhost [127.0.0.1]) by debian.vm (8.15.2/8.15.2/Debian-20) with ESMTP id 0ABE4sso020716 for <maintonly@bugs.debian.org>; Wed, 11 Nov 2020 14:04:54 GMT Received: (from sudip@localhost) by debian.vm (8.15.2/8.15.2/Submit) id 0ABE4sdF020715; Wed, 11 Nov 2020 14:04:54 GMT Message-Id: <202011111404.0ABE4sdF020715@debian.vm> Subject: node-grunt-contrib-requirejs: autopkgtest must be marked superficial To: <maintonly@bugs.debian.org> X-Mailer: mail (GNU Mailutils 3.10) Delivered-To: maintonly@bugs.debian.org Source: node-grunt-contrib-requirejs X-Debbugs-CC: elbrus@debian.org Severity: important Usertags: superficialtest Dear Maintainer, It has been noticed that the autopkgtest in node-grunt-contrib-requirejs is running a trivial command that does not provide significant test coverage: - nodejs -e "require('grunt-contrib-requirejs');" Executing that command is considered to be a trivial test, which does not provide significant coverage for a package as a whole. But these tests are a useful way to detect regressions in dependencies and prevent them from breaking your package. However, it is important that we are realistic about the level of test coverage provided by these commands: most regressions cannot be detected in this way. So it is not appropriate for packages with only superficial tests to have the reduced migration time to migrate from unstable to testing as that means less opportunity for testing by users compared to the package with no tests. To support this, the keyword "Restrictions: superficial" has been defined [1]. Packages where all tests are marked with this keyword are not considered for the reduced migration age from unstable to testing, and will not be allowed to migrate automatically in later stages of the freeze [2]. Its always better to have more extensive testing than having superficial testing, which again is better than having no test. Please consider i) Adding a non-trivial test, and/or ii) Mark the trivial test with "Restrictions: superficial", similar to [3] or [4]. The Release Team has listed this issue in the list of Release Critical Issues for bullseye [5] and has mentioned that the test must be marked superficial if it is not testing one of its own installed binary packages in some way. As a result, the severity of this bug report might be increased to serious in future. [1] https://salsa.debian.org/ci-team/autopkgtest/-/blob/master/doc/README.package-tests.rst#defined-restrictions [2] https://release.debian.org/bullseye/freeze_policy.html [3] https://salsa.debian.org/utopia-team/dbus/-/commit/a80908df7d119b181eec5eb0542634a30c2ad468 [4] https://salsa.debian.org/apparmor-team/apparmor/-/commit/580667513a097088ebe579884b38ac8d8666d3b3 [5] https://release.debian.org/bullseye/rc_policy.txt -- Regards Sudip ]