Are regression/unit test suites being run on upstream sources?

[Jeroen van Wolffelaar]

On Sat, Aug 06, 2005 at 12:23:55AM -0400, Barry Hawkins wrote:
>     The thought that people might be avoiding these test suites in order
> to ignore issues that surface in using the free runtimes is quite
> disconcerting to me, so I wanted to bring that up and just make sure
> that we are all on the same page that, at the very least, an upstream
> source should pass its own unit tests when built as a Debian package.
> Short-circuiting those tests is a favor to noone, and a disservice to
> our larger Debian community, whom we hope to introduce to the wealth of
> software that a solid Java packaging effort can provide.

I couldn't agree more, and it is my strong feeling that any test
suite/regression test/whatever available should be run during package
build, and cause a build failure (unless the particular testcase is
known to fail and a thoughtful tradeoff has been made between fixing
the issue now and leaving this, presumably minor, defect in Debian).

For example, I enabled kaffe's buildtest suite just before Sarge was
released, but didn't make it to fail the build. The problem is that it
was way too late to actually go looking into all of them. But I think we
should do so now, early in the release cycle, and get all tests somewhat
fixed.

--Jeroen

-- 
Jeroen van Wolffelaar
Jeroen at wolffelaar.nl (also for Jabber & MSN; ICQ: 33944357)
http://Jeroen.A-Eskwadraat.nl