[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Bug#970974: marked as done (trueprint: autopkgtest must be marked superficial)

Your message dated Wed, 10 Apr 2024 10:07:33 +0000
with message-id <E1ruUrd-004X4s-Ms@fasolo.debian.org>
and subject line Bug#970974: fixed in trueprint 5.4-6
has caused the Debian Bug report #970974,
regarding trueprint: autopkgtest must be marked superficial
to be marked as done.

This means that you claim that the problem has been dealt with.
If this is not the case it is now your responsibility to reopen the
Bug report if necessary, and/or fix the problem forthwith.

(NB: If you are a system administrator and have no idea what this
message is talking about, this may indicate a serious mail system
misconfiguration somewhere. Please contact owner@bugs.debian.org
immediately.)


-- 
970974: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=970974
Debian Bug Tracking System
Contact owner@bugs.debian.org with problems
--- Begin Message --- 
Source: trueprint
Severity: important
Usertags: superficialtest
X-Debbugs-CC: elbrus@debian.org

Dear Maintainer,

It has been noticed that the autopkgtest in trueprint is running a
trivial command that does not provide significant test coverage:

	-Test-Command: trueprint -H 
	-Test-Command: trueprint -V

Executing that command is considered to be a trivial test, which
does not provide significant coverage for a package as a whole.
But these tests are a useful way to detect regressions in dependencies
and prevent them from breaking your package.

However, it is important that we are realistic about the level of
test coverage provided by these commands: most regressions cannot be
detected in this way. So it is not appropriate for packages with only
superficial tests to have the reduced migration time to migrate from
unstable to testing as that means less opportunity for testing by users
compared to the package with no tests.

To support this, the keyword "Restrictions: superficial" has been
defined [1]. Packages where all tests are marked with this keyword are not
considered for the reduced migration age from unstable to testing, and
will not be allowed to migrate automatically in later stages of the
freeze [2].

Its always better to have more extensive testing than having
superficial testing, which again is better than having no test.

Please consider i) Adding a non-trivial test, and/or ii) Mark the
trivial test with "Restrictions: superficial", similar to
[3] or [4].

The Release Team has listed this issue in the list of Release Critical
Issues for bullseye [5] and has mentioned that the test must be marked
superficial if it is not testing one of its own installed binary
packages in some way. As a result, the severity of this bug report might
be increased to serious in future.

[1] https://salsa.debian.org/ci-team/autopkgtest/-/blob/master/doc/README.package-tests.rst#defined-restrictions
[2] https://release.debian.org/bullseye/freeze_policy.html
[3] https://salsa.debian.org/utopia-team/dbus/-/commit/a80908df7d119b181eec5eb0542634a30c2ad468
[4] https://salsa.debian.org/apparmor-team/apparmor/-/commit/580667513a097088ebe579884b38ac8d8666d3b3
[5] https://release.debian.org/bullseye/rc_policy.txt


--
Regards
Sudip

--- End Message ---
--- Begin Message --- 
Source: trueprint
Source-Version: 5.4-6
Done: Andreas Beckmann <anbe@debian.org>

We believe that the bug you reported is fixed in the latest version of
trueprint, which is due to be installed in the Debian FTP archive.

A summary of the changes between this version and the previous one is
attached.

Thank you for reporting the bug, which will now be closed.  If you
have further comments please address them to 970974@bugs.debian.org,
and the maintainer will reopen the bug report if appropriate.

Debian distribution maintenance software
pp.
Andreas Beckmann <anbe@debian.org> (supplier of updated trueprint package)

(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing ftpmaster@ftp-master.debian.org)


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

Format: 1.8
Date: Wed, 10 Apr 2024 11:45:04 +0200
Source: trueprint
Architecture: source
Version: 5.4-6
Distribution: unstable
Urgency: medium
Maintainer: Debian QA Group <packages@qa.debian.org>
Changed-By: Andreas Beckmann <anbe@debian.org>
Closes: 970974 1066481
Changes:
 trueprint (5.4-6) unstable; urgency=medium
 .
   * QA upload.
   * Fix building with -Werror=implicit-function-declaration.
     (Closes: #1066481)
   * Mark autopkgtests as superficial.  (Closes: #970974)
Checksums-Sha1:
 eb69a3cd1924d02493367ad35006971f9d263405 1906 trueprint_5.4-6.dsc
 4c3d2ff9c77e7bbf87bd70235685f43dd7d72b34 8860 trueprint_5.4-6.debian.tar.xz
 14a4ba6891c564ea357cfd3c112ecd9dfac4b698 5965 trueprint_5.4-6_source.buildinfo
Checksums-Sha256:
 ecfcaeecebfd8ef351844dbe6f55348a7d721db79777d93962111a4ad7647e2e 1906 trueprint_5.4-6.dsc
 c7a14b28c460407ff531321ca31d585a48b39cc0c42e6d1e3833a5cbbc363a92 8860 trueprint_5.4-6.debian.tar.xz
 953e8c50018bc1149048f535e759418bfd8ee3c76498c0fc4f51f5a437440900 5965 trueprint_5.4-6_source.buildinfo
Files:
 1daf51f6f82f32488071f6138e7a6368 1906 text optional trueprint_5.4-6.dsc
 b9c448eb98ce03bc25d3103d0dccc789 8860 text optional trueprint_5.4-6.debian.tar.xz
 523565e3ea4b5dd4df395be44e0c9673 5965 text optional trueprint_5.4-6_source.buildinfo

-----BEGIN PGP SIGNATURE-----

iQJEBAEBCAAuFiEE6/MKMKjZxjvaRMaUX7M/k1np7QgFAmYWX/kQHGFuYmVAZGVi
aWFuLm9yZwAKCRBfsz+TWentCIawD/9Pet7tFCLPr2SLDRAZEyWkgBo0bmjIjP8B
IU+vlZ026ElJJbHSw39faVHqniEwy9xbyAffZ3MvwxbTdMRjT1qbOBaFOgrSwOYa
E0YApv+yyxGt1AyHTeMNVo5TBXbQB4CfU+5au6hqIhO7s88aGiGyDNvIxke9JjP2
GFQXUnLStOPBno/VmF51b4ciJypjjmmI0YlCMaazbiczJtrvZkF9IkO5sP9Eq+9Y
WFkfXBNwZCXqjiTTrWl2kk78ZqfAScOVbYbWrmLbg8190SFD5QsJzGGR1wYRrFdt
+EaxJgka6cEaO3ZfkzRifUiziwR8WnTCOJ/ILtpzOtDst4jAJWzZbCn5sN7HxnO5
3CVo8GjHzn6ei9DyH6oTMSqdOyufk8w+doTchV8I86M7S3pvy9tSEBtzk5ssQ38D
1AwcxzRM3rM/fgR3feneAnCoOaSRPN9CpA6TlqTxVuxIFrjZ+Ui9fbxSF/7FWFY+
TxXfbjqAxuYJi6xJPxgu3yanmgwGPL4gHkBCMsEQ/bG9mt5MYGWGFeqb+B3F8Plr
SzS5pcnz5+c3uIixz23pNAecrczqouggMkmm8PgbFFJzV1PzgPayktHsHAZ5Ighx
RUzYSo8ZqhZWc1/cqsCWdCiPXT/pZiVWZZ/KUlKwKjYio4++F+CD22/p+jmx9v0z
Ez5x42aALA==
=eGAf
-----END PGP SIGNATURE-----

Attachment: pgpZ0IzCdJdnl.pgp
Description: PGP signature


--- End Message ---
Reply to: