[debian-mysql] Ran full test suite for MariaDB 10.11.2 on Debian - passed!

[Daniel Black]

On Thu, Feb 23, 2023 at 4:45 PM Otto Kekäläinen <otto at debian.org> wrote:
>
> Hello!
>
> I ran over the weekend the full test suite (mtr --big-test) for
> MariaDB 10.11.2 in Debian 12 "Bookworm" and 6200+ tests passed
> successfully with zero failures (however over a thousand tests were
> skipped, potential max test count would be 7227).
>
> If you want to help with the testing effort, you can just `apt install
> mariadb-test` and a bit more to repeat it. Details in my personal blog
> at https://optimizedbyotto.com/post/grokking-mariadb-test-run-mtr/.

nice

>
> Additionally, I enabled full test suite (including --big-test) on in
> the post-build and pushed it to Launchpad
> (https://launchpad.net/~mysql-ubuntu/+archive/ubuntu/debian-mariadb/+builds?build_text=&build_state=all).
> Here are the results:
>
> amd64:
> Completed: Failed 8/6241 tests, 99.87% were successful.
> Failing test(s): disks.disks disks.disks_notembedded
> type_test.type_test_double unit.conc_connection
>
> ppc64el:
> Completed: Failed 8/6240 tests, 99.87% were successful.
> Failing test(s): disks.disks disks.disks_notembedded
> type_test.type_test_double unit.conc_connection
>
> arm64:
> Completed: Failed 8/6240 tests, 99.87% were successful.
> Failing test(s): disks.disks disks.disks_notembedded
> type_test.type_test_double unit.conc_connection

disk.* tests. *might* be that fixed with changes of the form:

-select sum(Total) > sum(Available), sum(Total)>sum(Used) from
information_schema.disks;
+select sum(Total) >= sum(Available), sum(Total)>sum(Used) from
information_schema.disks;

This could occrur if it is actually we've used much much less than
total that it almost doesn't register.

type_test.type_test_double is MDEV-22243

>
> armhf:
> Too many failed: Failed 19/1762 tests, 98.92% were successful.
> Failing test(s): federated.federatedx_versioning spider/bg.basic_sql
> spider/bg.spider_fixes_part spider.basic_sql spider.spider_fixes_part
> versioning.online versioning.partition period.versioning
> versioning.autoinc versioning.delete

upstream unsupported arch, So I guess this is about expected.

> Note the above only happened on Launchpad. On my own laptop the pass
> rate was 100%.
>
> Nice!
>
> Feels like 10.11 is the most solid MariaDB release ever :)

glad to hear it.

Few post release bugs, but pretty clear so far:

https://jira.mariadb.org/issues/?filter=-1&jql=(fixVersion%20%3D%2010.11%20or%20%20(status%3DClosed%20and%20%20fixVersion%20%3D10.11.3%20))%20and%20priority%20%3DBlocker

The real tests are the ones outside the test suite however.