[OE-core] [RFC PATCH] Add gnu testsuite execution for OEQA

[Burton, Ross]

On Tue, 9 Jul 2019 at 12:47, Nathan Rossi <nathan at nathanrossi.com> wrote:
> Just to clarify, by real hardware are you interested in the tests
> running against a system running with a oe distro + kernel. Or just
> running on e.g. the build host?
>
> As for the failing tests, do not put to much emphasis on the values
> provided. I am sure there are a number of tests that are failing due
> to minor configuration issues that simply need a deeper look at the
> test result and output to fix the issue. And the large number of
> failures for powerpc are due to qemu user failing due to illegal
> instruction.
>
> The goal would be to get the results similar to what other
> users/distro get, by reviewing results posted here:
> https://gcc.gnu.org/ml/gcc-testresults/.
> And for glibc the results from: https://sourceware.org/glibc/wiki/Release/2.29

Ah that's useful that they publish those.  So the test results for
2.29 on x86-64 are:

   5961 PASS
     21 UNSUPPORTED
     17 XFAIL
      2 XPASS

And your report has 1423 failures, so *something* is broken.  As you
say, some flaw in qemu-user is most likely the culprit there.  Compare
to the ARM results:

      9 FAIL
   5041 PASS
     31 UNSUPPORTED
     17 XFAIL
      2 XPASS

Your report has 64 failures, which is much closer even with qemu-user.

Ross