Testing

From Openembedded.org
Jump to navigation Jump to search

Overview

The OpenEmbedded Testing branch is a git branch of the OE metadata with the goal of providing a recent snapshot of OE that is known to be build-able for a subset of distros, machines, images, and host workstations. The goal of this effort is twofold:

  1. the testing branch represents a reasonably stable version of OE that builds for most tested combinations
  2. for all tested combinations, we list the last known-good-build tag so that users can always start with something that will build.

As an example on how to configure your test setup see TestingScript.

Test combinations

machine distro target workstation bitbake tester last successful build build type Current issues
mpc8315e-rdb minimal nas-server-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
p2020ds minimal nas-server-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemux86 minimal nas-server-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemuarm minimal nas-server-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemumips minimal nas-server-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemumipsel minimal nas-server-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
mpc8315e-rdb minimal native-sdk-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
p2020ds minimal native-sdk-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemux86 minimal native-sdk-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemuppc minimal native-sdk-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemuarm minimal native-sdk-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemumips minimal native-sdk-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemumips64 minimal native-sdk-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemumipsel minimal native-sdk-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
mpc8315e-rdb minimal console-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
p2020ds minimal console-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemux86 minimal console-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemuppc minimal console-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemuarm minimal console-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemush4 minimal console-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-06 clean jlime.org down, causes parse error
qemumips minimal console-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemumips64 minimal console-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemumipsel minimal console-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
hawkboard angstrom-2008.1 console-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
hawkboard angstrom-2010.x console-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
mini6410 angstrom-2008.1 console-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
mini6410 angstrom-2010.x console-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
mini2440 angstrom-2008.1 console-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
beagleboard angstrom-2008.1 console-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
beagleboard angstrom-2010.x console-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
mpc8315e-rdb minimal minimal-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
p2020ds minimal minimal-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemux86 minimal minimal-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemuppc minimal minimal-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemuarm minimal minimal-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemush4 minimal minimal-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-06 clean jlime.org down, causes parse error
qemumips minimal minimal-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemumips64 minimal minimal-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemumipsel minimal minimal-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
mpc8315e-rdb minimal-uclibc minimal-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemux86 minimal-uclibc minimal-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemuppc minimal-uclibc minimal-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemuarm minimal-uclibc minimal-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemush4 minimal-uclibc minimal-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-06 clean jlime.org down, causes parse error
qemumips minimal-uclibc minimal-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemumipsel minimal-uclibc minimal-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemux86 minimal x11-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemuppc minimal x11-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemuarm minimal x11-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemumips minimal x11-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemumips64 minimal x11-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemumipsel minimal x11-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemux86 minimal-uclibc x11-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemuppc minimal-uclibc x11-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemuarm minimal-uclibc x11-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemumips minimal-uclibc x11-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemumipsel minimal-uclibc x11-image RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
mpc8315e-rdb minimal meta-toolchain RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
p2020ds minimal meta-toolchain RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemux86 minimal meta-toolchain RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemuppc minimal meta-toolchain RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemuarm minimal meta-toolchain RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemush4 minimal meta-toolchain RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-06 clean jlime.org down, causes parse error
qemumips minimal meta-toolchain RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-06 clean
qemumips64 minimal meta-toolchain RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-06 clean
qemumipsel minimal meta-toolchain RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-06 clean
qemuarm minimal-uclibc meta-toolchain RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-13 clean
qemush4 minimal-uclibc meta-toolchain RHEL5 / Ubuntu 8.04 32-bit master trini [4] testing_2011-01-06 clean jlime.org down, causes parse error
beagleboard angstrom-2008.1 beagleboard-linuxtag2010-demo-image Ubuntu 10.10 64-bit master cbrake release-2010.12 clean testing-2010-12-10 failed with http://tinderbox.openembedded.net/packages/1321155/, testing-2010-12-30 failed with http://tinderbox.openembedded.org/public/logs/task/15929463.txt
beagleboard angstrom-2008.1 console-image Ubuntu 10.10 64-bit master cbrake testing_2010-12-30 clean
bug20 angstrom-2008.1 minimal-image console-image openjdk-6 meta-toolchain meta-toolchain-qte Ubuntu 9.04 64-bit 1.10.2 Stefan testing_2011-01-06 clean
bug20 angstrom-2008.1 minimal-image console-image openjdk-6 meta-toolchain meta-toolchain-qte Ubuntu 10.10 32-bit master Stefan testing_2011-01-06 clean
efikamx minimal native-sdk-image console-image x11-image Ubuntu 10.10 64-bit master khem testing_2010-12-24 clean
omap5912osk minimal console-image native-sdk-image x11-image Ubuntu 10.04 64-bit master khem testing_2010-12-24 clean
qemuarm minimal console-image native-sdk-image x11-image Ubuntu 10.04 64-bit master khem testing_2010-12-24 clean
qemumips minimal console-image native-sdk-image x11-image Ubuntu 10.04 64-bit master khem testing_2010-12-24 clean
qemumips64 minimal console-image native-sdk-image x11-image Ubuntu 10.04 64-bit master khem testing_2010-12-24 clean
qemuppc minimal console-image native-sdk-image x11-image Ubuntu 10.04 64-bit master khem testing_2010-12-24 clean
qemush4 minimal console-image native-sdk-image x11-image Ubuntu 10.04 64-bit master khem testing_2010-12-24 clean
qemux86 minimal console-image native-sdk-image x11-image Ubuntu 10.04 64-bit master khem testing_2010-12-24 clean
efikamx minimal-uclibc native-sdk-image console-image x11-image Ubuntu 10.10 64-bit master khem testing_2010-12-24 clean
omap5912osk minimal-uclibc console-image native-sdk-image x11-image Ubuntu 10.04 64-bit master khem testing_2010-12-24 clean
qemuarm minimal-uclibc console-image native-sdk-image x11-image Ubuntu 10.04 64-bit master khem testing_2010-12-24 clean
qemumips minimal-uclibc console-image native-sdk-image x11-image Ubuntu 10.04 64-bit master khem testing_2010-12-24 clean
qemuppc minimal-uclibc console-image native-sdk-image x11-image Ubuntu 10.04 64-bit master khem testing_2010-12-24 clean
qemush4 minimal-uclibc console-image native-sdk-image x11-image Ubuntu 10.04 64-bit master khem testing_2010-12-24 clean
qemux86 minimal-uclibc console-image native-sdk-image x11-image Ubuntu 10.04 64-bit master khem testing_2010-12-24 clean
qemumipsel minimal x11-image meta-toolchain Slackware 13.1 64-bit master grg release-2010.12 clean
qemumipsel minimal-uclibc minimal-image Slackware 13.1 64-bit master grg release-2010.12 clean
qemumipsel micro-uclibc micro-image Slackware 13.1 64-bit master grg release-2010.12 clean
qemuarm angstrom-2010.x x11-gpe-image Fedora 12 32-bit gthomas testing_2010-09-07 clean testing_2010-09-13 fails to build xf86-input-mouse
qemuarm angstrom-2010.x opie-image Fedora 12 32-bit gthomas testing_2010-09-07 clean
qemuarm angstrom-2010.x opie-kdepim-image Fedora 12 32-bit gthomas None clean fails to build pwmpi
beagleboard angstrom-2008.1 angstrom-gnome-image Ubuntu 9.10 32-bit gthomas testing_2010-08-30 clean
beagleboard angstrom-2010.x beagleboard-linuxtag2010-demo-image Fedora 12 32-bit gthomas None clean fails to build ti-dsplink if /opt is writeable
qemuarm angstrom-2008.1 x11-gpe-image Fedora 12 32-bit gthomas testing_2010-10-04 clean
beagleboard angstrom-2008.1 x11-gpe-image Fedora 12 32-bit gthomas testing_2010-10-04 clean
imote2 angstrom-2008.1 imote2-image Gentoo jic23 testing_2011-01-20 clean
imote2 angstrom-2008.1 meta-toolchain Gentoo jic23 testing_2011-01-20 clean
imote2 angstrom-2010.x imote2-image Gentoo jic23 testing_2011-01-20 clean
imote2 angstrom-2010.x meta-toolchain Gentoo jic23 testing_2011-01-20 clean
hipox angstrom-2008.1 minimal-image openSUSE 11.3 32-bit 1.10.2 Sledz [2] testing_2011-01-13 clean
hipox angstrom-2008.1 console-image openSUSE 11.3 32-bit 1.10.2 Sledz [2] testing_2011-01-13 clean
hipox angstrom-2008.1 angstrom-gnome-image openSUSE 11.3 32-bit 1.10.2 Sledz [2] None clean testing_2011-01-13: do_configure python_2.6.5 failed
hipox angstrom-2008.1 angstrom-x-image openSUSE 11.3 32-bit 1.10.2 Sledz [2] None clean testing_2011-01-06: do_configure epiphany failed
neek minimal console-image Ubuntu 10.04 64-bit 1.10 eFfeM [1] None clean testing_2011-01-20 QA issue in gtk-doc.bb
nslu2le slugos slugos-image Ubuntu 10.04 64-bit 1.10 eFfeM [1] testing_2011-01-20 clean
nslu2be slugos slugos-image Ubuntu 10.04 64-bit 1.10 eFfeM [1] testing_2011-01-20 clean
calamari minimal console-image Ubuntu 10.04 64-bit 1.10 eFfeM [1] testing_2011-01-13 clean testing_2011-01-20 fails building perl: http://tinderbox.openembedded.net/packages/1882105/

)

mpc8313e-rdb minimal console-image Ubuntu 10.04 64-bit 1.10 eFfeM [1] testing_2011-01-20 clean
sheevaplug minimal console-image Ubuntu 10.04 64-bit 1.10 eFfeM [1] testing_2011-01-20 clean
ts72xx angstrom-2008.1 minimal-image uclibc Ubuntu 10.04 64-bit master ynezz testing_2010-11-12 clean
ts72xx angstrom-2008.1 minimal-image glibc Ubuntu 10.04 64-bit master ynezz testing_2010-11-12 clean
ts72xx angstrom-2008.1 console-image uclibc Ubuntu 10.04 64-bit master ynezz testing_2010-11-12 clean x264-r2245-r7 FAILED http://tinderbox.openembedded.net/public/logs/task/10303075.txt
ts72xx angstrom-2008.1 console-image glibc Ubuntu 10.04 64-bit master ynezz testing_2010-11-12 clean
ts72xx angstrom-2010.x minimal-image glibc Ubuntu 10.04 64-bit master ynezz testing_2010-11-12 clean
ts72xx angstrom-2010.x minimal-image uclibc Ubuntu 10.04 64-bit master ynezz testing_2010-11-12 clean libiconv-1.13.1-r0 FAILED http://tinderbox.openembedded.net/public/logs/task/10280531.txt
ts72xx angstrom-2010.x console-image glibc Ubuntu 10.04 64-bit master ynezz testing_2010-11-12 clean
ts72xx angstrom-2010.x console-image uclibc Ubuntu 10.04 64-bit master ynezz testing_2010-11-12 clean libiconv-1.13.1-r0 FAILED http://tinderbox.openembedded.net/packages/986368/
x86 angstrom-2008.1 meta-toolchain Ubuntu 10.04 64-bit 1.10.1 tharvey testing_2010-12-23 clean
x86 angstrom-2008.1 console-image Ubuntu 10.04 64-bit 1.10.1 tharvey testing_2010-12-23 clean x264-r2245-r7 FAILED http://tinderbox.openembedded.net/packages/1402599/
overo angstrom-2008.1 meta-toolchain Ubuntu 10.04 64-bit 1.10.1 tharvey testing_2010-12-23 clean
overo angstrom-2008.1 meta-toolchain-qte Ubuntu 10.04 64-bit 1.10.1 tharvey testing_2010-12-23 clean
overo angstrom-2008.1 x-load Ubuntu 10.04 64-bit 1.10.1 tharvey testing_2010-12-23 clean
overo angstrom-2008.1 u-boot Ubuntu 10.04 64-bit 1.10.1 tharvey testing_2010-12-23 clean
overo angstrom-2008.1 console-image Ubuntu 10.04 64-bit 1.10.1 tharvey testing_2010-12-23 clean
overo angstrom-2008.1 x11-image Ubuntu 10.04 64-bit 1.10.1 tharvey testing_2010-12-23 clean Many QA Issues
akita, tosa angstrom-2008.1 console-image, x11-image, opie-image Debian Squeeze 64-bit master Jay7 release-2010.12 clean
collie angstrom-2008.1 console-image, x11-image, opie-image Debian Squeeze 64-bit master Jay7 release-2010.12 clean
ben-nanonote angstrom-2008.1 console-image, x11-image, opie-image Debian Squeeze 64-bit master Jay7 release-2010.12 clean
efikamx angstrom-2008.1 console-image, x11-image, opie-image Debian Squeeze 64-bit master Jay7 release-2010.12 clean
akita, tosa minimal console-image, x11-image, opie-image Debian Squeeze 64-bit master Jay7 release-2010.12 clean
collie minimal console-image, x11-image, opie-image Debian Squeeze 64-bit master Jay7 release-2010.12 clean
ben-nanonote minimal console-image, x11-image, opie-image Debian Squeeze 64-bit master Jay7 release-2010.12 clean
efikamx minimal console-image, x11-image, opie-image Debian Squeeze 64-bit master Jay7 release-2010.12 clean
akita angstrom-2008.1 minimal-image, x11-image Debian Lenny 64-bit 1.10.1 mckoan [3] none clean
ronetix-pm9263 kaeilos-2010 minimal-image, x11-image Debian Lenny 64-bit 1.10.1 mckoan [3] none clean
mc355 kaeilos-2010 minimal-image Debian Lenny 64-bit 1.10.1 mckoan [3] none clean
akita kaeilos minimal-image, x11-image Debian Lenny 64-bit 1.10.1 mckoan [3] none clean
ronetix-pm9263 kaeilos minimal-image, x11-image Debian Lenny 64-bit 1.10.1 mckoan [3] none clean
palmpre shr shr-lite-image Debian Sid 64-bit 1.11 morphis release-2010.12 8733e77 clean
at91sam9m10g45ek angstrom-2010.x console-image x11-image x11-gpe-image Red Hat Enterprise Linux Client release 5.2 64-bit 1.10.1 noglitch release-2010.12 a643fb8 clean
at91sam9g20ek angstrom-2010.x console-image Red Hat Enterprise Linux Client release 5.2 64-bit 1.10.1 noglitch release-2010.12 a643fb8 clean
machine distro target workstation bitbake tester last successful build build type Current issues

[1] Testing done by eFfeM. Resources kindly provided by Axon Digital Design
[2] Testing done by Sledz. Resources kindly provided by DResearch Digital Media Systems GmbH
[3] Testing done by mckoan. Resources kindly provided by Koan sas
[4] Testing done by Tom Rini. Resources kindly provided by Mentor Graphics

Testing Procedure

The general process for managing the testing branch is:

  1. Starting at approximately 9PM GMT of every week, the dev.openembedded.org branch is branched to the testing-next branch.
  2. Whoever creates the testing-next branch sends an email to the oe-devel list with a subject of "testing branch YYYY-MM-DD". All volunteers preferably do an incremental build (from last weeks snapshot), then clean tmp and do a clean build of the combinations they test. If time or resources are not available, then incremental builds are not required. After builds are complete, update the above chart, and report status/issues as replies to the above email.
  3. If most combinations build by following Thursday, the testing-next branch is merged to the testing branch. Regardless, the repository is tagged with the tested_YYYY-MM-DD tag. An annotated tag is used with a message that includes a text copy of the above table with variations that have been tested building for this cycle. The reason we tag after testing is complete is so that we can include status in the annotated tag. This way information about what was tested with each tagged version is captured in the repository. A link is added for easy reference to the log below.
  4. If a build fails, then issues are reported, and we try to get issues fixed before the next weeks testing cycle.
  5. Not every combination is tested on every cycle, due to availability of testers, so we list the last known built version in the above chart. Testers are responsible for updating the above chart.
  6. All testers are encouraged to use Tinderbox so problems are automatically reported and logged, and issues in the above chart can be linked to Tinderbox.

We strongly encourage chip and SBC/Module vendors to become involved in this effort to ensure OE works for your platforms.

Useful software

Testing Log

For a list of available test tags and results, see: http://cgit.openembedded.org/cgit.cgi/openembedded/refs/tags

Retrieved from "https://www.openembedded.org/w/index.php?title=Testing&oldid=3923"