Testing
Jump to navigation
Jump to search
| NOTE: This page has been identified as having content that is significantly out-of-date, usually because it refers to OpenEmbedded-Classic - for new projects, you should use OpenEmbedded-Core.
See OpenEmbedded Wiki Update Project for more details. |
Overview
The OpenEmbedded Testing branch is a git branch of the OE metadata with the goal of providing a recent snapshot of OE that is known to be build-able for a subset of distros, machines, images, and host workstations. The goal of this effort is twofold:
- the testing branch represents a reasonably stable version of OE that builds for most tested combinations
- for all tested combinations, we list the last known-good-build tag so that users can always start with something that will build.
As an example on how to configure your test setup see TestingScript.
Test combinations
| machine | distro | target | workstation | bitbake | tester | last successful build | build type | Current issues |
|---|---|---|---|---|---|---|---|---|
| mpc8315e-rdb | minimal minimal-uclibc | minimal-image meta-toolchain | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-28 | clean | |
| p2020ds | minimal minimal-uclibc | minimal-image meta-toolchain | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-28 | clean | |
| qemux86 | minimal minimal-uclibc | minimal-image meta-toolchain | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-28 | clean | |
| qemuppc | minimal minimal-uclibc | minimal-image meta-toolchain | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-28 | clean | |
| qemuarm | minimal minimal-uclibc | minimal-image meta-toolchain | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-28 | clean | |
| qemush4 | minimal minimal-uclibc | minimal-image meta-toolchain | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-28 | clean | |
| qemumips | minimal minimal-uclibc | minimal-image meta-toolchain | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-28 | clean | |
| qemumips64 | minimal minimal-uclibc | minimal-image meta-toolchain | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-28 | clean | |
| qemumipsel | minimal minimal-uclibc | minimal-image meta-toolchain | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-28 | clean | |
| mpc8315e-rdb | minimal | nas-server-image native-sdk-image console-image minimal-image x11-image meta-toolchain | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-20 | clean | |
| p2020ds | minimal | nas-server-image native-sdk-image console-image minimal-image x11-image meta-toolchain | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-20 | clean | |
| qemux86 | minimal | nas-server-image native-sdk-image console-image x11-image | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-13 | clean | |
| qemux86 | minimal | minimal-image meta-toolchain | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-20 | clean | Rest fixed in http://cgit.openembedded.org/cgit.cgi/openembedded/commit/?id=bd7a0fa284e9d3746513b97f4e5672aa3f82a6b2 |
| qemuppc | minimal | nas-server-image native-sdk-image console-image minimal-image x11-image meta-toolchain | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-20 | clean | |
| qemuarm | minimal | nas-server-image native-sdk-image console-image minimal-image x11-image meta-toolchain | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-20 | clean | |
| qemush4 | minimal | nas-server-image native-sdk-image console-image minimal-image x11-image meta-toolchain | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-20 | clean | |
| qemumips | minimal | nas-server-image native-sdk-image console-image minimal-image x11-image meta-toolchain | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-20 | clean | |
| qemumips64 | minimal | nas-server-image native-sdk-image console-image minimal-image x11-image meta-toolchain | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-20 | clean | |
| qemumipsel | minimal | nas-server-image native-sdk-image console-image minimal-image x11-image meta-toolchain | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-20 | clean | |
| mpc8315e-rdb | minimal-uclibc | nas-server-image native-sdk-image console-image minimal-image x11-image meta-toolchain | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-20 | clean | |
| p2020ds | minimal-uclibc | nas-server-image native-sdk-image console-image minimal-image x11-image | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-20 | clean | http://pastebin.com/62qMxWVu |
| qemux86 | minimal-uclibc | nas-server-image native-sdk-image console-image minimal-image x11-image meta-toolchain | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-20 | clean | |
| qemuppc | minimal-uclibc | nas-server-image native-sdk-image console-image minimal-image x11-image meta-toolchain | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-20 | clean | |
| qemuarm | minimal-uclibc | native-sdk-image console-image minimal-image x11-image meta-toolchain | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-20 | clean | http://pastebin.com/0tMmXnuP |
| qemush4 | minimal-uclibc | nas-server-image native-sdk-image console-image minimal-image x11-image meta-toolchain | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-20 | clean | |
| qemumips | minimal-uclibc | nas-server-image native-sdk-image console-image minimal-image x11-image meta-toolchain | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-20 | clean | |
| qemumips64 | minimal-uclibc | nas-server-image native-sdk-image console-image minimal-image x11-image meta-toolchain | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-20 | clean | |
| qemumipsel | minimal-uclibc | nas-server-image native-sdk-image console-image minimal-image x11-image meta-toolchain | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-20 | clean | |
| hawkboard | angstrom-2008.1 | console-image | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-20 | clean | |
| hawkboard | angstrom-2010.x | console-image | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-20 | clean | |
| mini6410 | angstrom-2008.1 | console-image | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-20 | clean | |
| mini6410 | angstrom-2010.x | console-image | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-20 | clean | |
| mini2440 | angstrom-2008.1 | console-image | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-20 | clean | |
| beagleboard | angstrom-2008.1 | console-image | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-20 | clean | |
| beagleboard | angstrom-2010.x | console-image | RHEL5 / Ubuntu 8.04 32-bit | master | trini [4] | testing_2011-01-20 | clean | |
| beagleboard | angstrom-2008.1 | beagleboard-linuxtag2010-demo-image | Ubuntu 10.10 64-bit | master | cbrake [5] | testing_2011-01-20 | clean | |
| beagleboard | angstrom-2008.1 | console-image | Ubuntu 10.10 64-bit | master | cbrake [5] | testing_2011-01-20 | clean | |
| beagleboard | angstrom-2008.1 | qt4-x11-demo-image (4.7.1) | Ubuntu 10.10 64-bit | master | cbrake [5] | testing_2011-01-20 | clean | |
| beagleboard | angstrom-2008.1 | qt4e-demo-image (4.7.1) | Ubuntu 10.10 64-bit | master | cbrake [5] | testing_2011-01-20 | clean | |
| bug20 | angstrom-2008.1 | minimal-image console-image openjdk-6 meta-toolchain meta-toolchain-qte | Ubuntu 9.04 64-bit | 1.10.2 | Stefan | testing_2011-01-06 | clean | |
| bug20 | angstrom-2008.1 | minimal-image console-image openjdk-6 meta-toolchain meta-toolchain-qte | Ubuntu 10.10 32-bit | master | Stefan | testing_2011-01-06 | clean | |
| efikamx | minimal | native-sdk-image console-image x11-image | Ubuntu 10.10 64-bit | master | khem | testing_2010-12-24 | clean | |
| omap5912osk | minimal | console-image native-sdk-image x11-image | Ubuntu 10.04 64-bit | master | khem | testing_2010-12-24 | clean | |
| qemuarm | minimal | console-image native-sdk-image x11-image | Ubuntu 10.04 64-bit | master | khem | testing_2010-12-24 | clean | |
| qemumips | minimal | console-image native-sdk-image x11-image | Ubuntu 10.04 64-bit | master | khem | testing_2010-12-24 | clean | |
| qemumips64 | minimal | console-image native-sdk-image x11-image | Ubuntu 10.04 64-bit | master | khem | testing_2010-12-24 | clean | |
| qemuppc | minimal | console-image native-sdk-image x11-image | Ubuntu 10.04 64-bit | master | khem | testing_2010-12-24 | clean | |
| qemush4 | minimal | console-image native-sdk-image x11-image | Ubuntu 10.04 64-bit | master | khem | testing_2010-12-24 | clean | |
| qemux86 | minimal | console-image native-sdk-image x11-image | Ubuntu 10.04 64-bit | master | khem | testing_2010-12-24 | clean | |
| efikamx | minimal-uclibc | native-sdk-image console-image x11-image | Ubuntu 10.10 64-bit | master | khem | testing_2010-12-24 | clean | |
| omap5912osk | minimal-uclibc | console-image native-sdk-image x11-image | Ubuntu 10.04 64-bit | master | khem | testing_2010-12-24 | clean | |
| qemuarm | minimal-uclibc | console-image native-sdk-image x11-image | Ubuntu 10.04 64-bit | master | khem | testing_2010-12-24 | clean | |
| qemumips | minimal-uclibc | console-image native-sdk-image x11-image | Ubuntu 10.04 64-bit | master | khem | testing_2010-12-24 | clean | |
| qemuppc | minimal-uclibc | console-image native-sdk-image x11-image | Ubuntu 10.04 64-bit | master | khem | testing_2010-12-24 | clean | |
| qemush4 | minimal-uclibc | console-image native-sdk-image x11-image | Ubuntu 10.04 64-bit | master | khem | testing_2010-12-24 | clean | |
| qemux86 | minimal-uclibc | console-image native-sdk-image x11-image | Ubuntu 10.04 64-bit | master | khem | testing_2010-12-24 | clean | |
| qemumipsel | minimal | x11-image meta-toolchain | Slackware 13.1 64-bit | master | grg | release-2010.12 | clean | |
| qemumipsel | minimal-uclibc | minimal-image | Slackware 13.1 64-bit | master | grg | release-2010.12 | clean | |
| qemumipsel | micro-uclibc | micro-image | Slackware 13.1 64-bit | master | grg | release-2010.12 | clean | |
| qemuarm | angstrom-2010.x | x11-gpe-image | Fedora 12 32-bit | gthomas | testing_2010-09-07 | clean | testing_2010-09-13 fails to build xf86-input-mouse | |
| qemuarm | angstrom-2010.x | opie-image | Fedora 12 32-bit | gthomas | testing_2010-09-07 | clean | ||
| qemuarm | angstrom-2010.x | opie-kdepim-image | Fedora 12 32-bit | gthomas | None | clean | fails to build pwmpi | |
| beagleboard | angstrom-2008.1 | angstrom-gnome-image | Ubuntu 9.10 32-bit | gthomas | testing_2010-08-30 | clean | ||
| beagleboard | angstrom-2010.x | beagleboard-linuxtag2010-demo-image | Fedora 12 32-bit | gthomas | None | clean | fails to build ti-dsplink if /opt is writeable | |
| qemuarm | angstrom-2008.1 | x11-gpe-image | Fedora 12 32-bit | gthomas | testing_2010-10-04 | clean | ||
| beagleboard | angstrom-2008.1 | x11-gpe-image | Fedora 12 32-bit | gthomas | testing_2010-10-04 | clean | ||
| imote2 | angstrom-2008.1 | imote2-image | Gentoo | jic23 | testing_2011-01-28 | clean | ||
| imote2 | angstrom-2008.1 | meta-toolchain | Gentoo | jic23 | testing_2011-01-28 | clean | ||
| imote2 | angstrom-2010.x | imote2-image | Gentoo | jic23 | testing_2011-01-28 | clean | ||
| imote2 | angstrom-2010.x | meta-toolchain | Gentoo | jic23 | testing_2011-01-28 | clean | ||
| hipox | angstrom-2008.1 | minimal-image | openSUSE 11.3 32-bit | 1.10.2 | Sledz [2] | testing_2011-01-28 | clean | testing_2011-02-03: do_configure libtool-native failed http://tinderbox.openembedded.net/packages/1924643/ |
| hipox | angstrom-2008.1 | console-image | openSUSE 11.3 32-bit | 1.10.2 | Sledz [2] | testing_2011-01-28 | clean | testing_2011-02-03: do_configure libtool-native failed |
| hipox | angstrom-2008.1 | angstrom-gnome-image | openSUSE 11.3 32-bit | 1.10.2 | Sledz [2] | testing_2011-01-28 | clean | testing_2011-02-03: do_configure libtool-native failed |
| hipox | angstrom-2008.1 | angstrom-x-image | openSUSE 11.3 32-bit | 1.10.2 | Sledz [2] | None | clean | testing_2011-02-03: do_configure libtool-native failed testing_2011-01-28: do_rootfs failed http://tinderbox.openembedded.net/packages/1903422/ |
| neek | minimal | console-image | Ubuntu 10.04 64-bit | 1.10 | eFfeM [1] | None | clean | testing_2011-02-03 QA issue in gtk-doc.bb |
| nslu2le | slugos | slugos-image | Ubuntu 10.04 64-bit | 1.10 | eFfeM [1] | testing_2011-02-03 | clean | |
| nslu2be | slugos | slugos-image | Ubuntu 10.04 64-bit | 1.10 | eFfeM [1] | testing_2011-02-03 | clean | |
| calamari | minimal | console-image | Ubuntu 10.04 64-bit | 1.10 | eFfeM [1] | testing_2011-02-03 | clean | builds but has QA issues with cups, libsdl-x11, python-sqlite3, binutils |
| mpc8313e-rdb | minimal | console-image | Ubuntu 10.04 64-bit | 1.10 | eFfeM [1] | testing_2011-02-03 | clean | builds but has QA issues with cups, libsdl-x11, python-sqlite3, binutils |
| sheevaplug | minimal | console-image | Ubuntu 10.04 64-bit | 1.10 | eFfeM [1] | testing_2011-02-03 | clean | builds but has QA issues with cups, libsdl-x11, python-sqlite3, binutils |
| ts72xx | angstrom-2008.1 | minimal-image uclibc | Ubuntu 10.04 64-bit | master | ynezz | testing_2010-11-12 | clean | |
| ts72xx | angstrom-2008.1 | minimal-image glibc | Ubuntu 10.04 64-bit | master | ynezz | testing_2010-11-12 | clean | |
| ts72xx | angstrom-2008.1 | console-image uclibc | Ubuntu 10.04 64-bit | master | ynezz | testing_2010-11-12 | clean | x264-r2245-r7 FAILED http://tinderbox.openembedded.net/public/logs/task/10303075.txt |
| ts72xx | angstrom-2008.1 | console-image glibc | Ubuntu 10.04 64-bit | master | ynezz | testing_2010-11-12 | clean | |
| ts72xx | angstrom-2010.x | minimal-image glibc | Ubuntu 10.04 64-bit | master | ynezz | testing_2010-11-12 | clean | |
| ts72xx | angstrom-2010.x | minimal-image uclibc | Ubuntu 10.04 64-bit | master | ynezz | testing_2010-11-12 | clean | libiconv-1.13.1-r0 FAILED http://tinderbox.openembedded.net/public/logs/task/10280531.txt |
| ts72xx | angstrom-2010.x | console-image glibc | Ubuntu 10.04 64-bit | master | ynezz | testing_2010-11-12 | clean | |
| ts72xx | angstrom-2010.x | console-image uclibc | Ubuntu 10.04 64-bit | master | ynezz | testing_2010-11-12 | clean | libiconv-1.13.1-r0 FAILED http://tinderbox.openembedded.net/packages/986368/ |
| x86 | angstrom-2008.1 | meta-toolchain | Ubuntu 10.04 64-bit | 1.10.1 | tharvey | testing_2010-12-23 | clean | |
| x86 | angstrom-2008.1 | console-image | Ubuntu 10.04 64-bit | 1.10.1 | tharvey | testing_2010-12-23 | clean | x264-r2245-r7 FAILED http://tinderbox.openembedded.net/packages/1402599/ |
| overo | angstrom-2008.1 | meta-toolchain | Ubuntu 10.04 64-bit | 1.10.1 | tharvey | testing_2010-12-23 | clean | |
| overo | angstrom-2008.1 | meta-toolchain-qte | Ubuntu 10.04 64-bit | 1.10.1 | tharvey | testing_2010-12-23 | clean | |
| overo | angstrom-2008.1 | x-load | Ubuntu 10.04 64-bit | 1.10.1 | tharvey | testing_2010-12-23 | clean | |
| overo | angstrom-2008.1 | u-boot | Ubuntu 10.04 64-bit | 1.10.1 | tharvey | testing_2010-12-23 | clean | |
| overo | angstrom-2008.1 | console-image | Ubuntu 10.04 64-bit | 1.10.1 | tharvey | testing_2010-12-23 | clean | |
| overo | angstrom-2008.1 | x11-image | Ubuntu 10.04 64-bit | 1.10.1 | tharvey | testing_2010-12-23 | clean | Many QA Issues |
| collie | angstrom-2010.x, minimal | console-image x11-image opie-image | Debian 6.0.1 (squeeze) /x86_64 | master e4acd09 | Jay7 | testing-next f0652d9 | clean, inc | |
| tosa, akita | angstrom-2010.x | console-image x11-image opie-image | Debian 6.0.1 (squeeze) /x86_64 | master e4acd09 | Jay7 | testing-next f0652d9 | clean | |
| tosa, akita | angstrom-2010.x | console-image x11-image opie-image | Debian 6.0.1 (squeeze) /x86_64 | master e4acd09 | Jay7 | testing-next f0652d9 | inc | udev_165.bb failed to build because of 'extras/mtd_probe/mtd_probe.h:20:26: fatal error: mtd/mtd-user.h: No such file or directory' (fixed after cleaning linux-libc-headers) |
| tosa, akita | minimal | console-image x11-image opie-image | Debian 6.0.1 (squeeze) /x86_64 | master e4acd09 | Jay7 | testing-next f0652d9 | clean, inc | |
| efikamx | angstrom-2010.x | console-image x11-image opie-image | Debian 6.0.1 (squeeze) /x86_64 | master e4acd09 | Jay7 | testing-next f0652d9 | clean, inc | |
| efikamx | minimal | console-image x11-image opie-image | Debian 6.0.1 (squeeze) /x86_64 | master e4acd09 | Jay7 | testing-next f0652d9 | clean | |
| efikamx | minimal | console-image x11-image opie-image | Debian 6.0.1 (squeeze) /x86_64 | master e4acd09 | Jay7 | testing-next f0652d9 | inc | xf86-input-mouse_1.7.0.bb failed because of old xorg-server (fixed after rebuild of virtual/xserver) |
| ben-nanonote | angstrom-2010.x, minimal | console-image x11-image opie-image | Debian 6.0.1 (squeeze) /x86_64 | master e4acd09 | Jay7 | testing-next f0652d9 | clean,inc | linux-kexecboot_2.6.38.bb failed to build because of no defconfig for this machine exists |
| akita | angstrom-2008.1 | minimal-image, x11-image | Debian Lenny 64-bit | 1.10.1 | mckoan [3] | none | clean | |
| ronetix-pm9263 | kaeilos-2010 | minimal-image, |
Debian Lenny 64-bit | 1.10.1 | mckoan [3] | none | clean | |
| mc355 | kaeilos-2010 | minimal-image | Debian Lenny 64-bit | 1.10.1 | mckoan [3] | none | clean | |
| akita | kaeilos | minimal-image, x11-image | Debian Lenny 64-bit | 1.10.1 | mckoan [3] | none | clean | |
| ronetix-pm9263 | kaeilos | minimal-image, x11-image | Debian Lenny 64-bit | 1.10.1 | mckoan [3] | none | clean | |
| palmpre | shr | shr-lite-image | Debian Sid 64-bit | 1.11 | morphis | release-2010.12 8733e77 | clean | |
| at91sam9m10g45ek | angstrom-2010.x | console-image x11-image x11-gpe-image | Red Hat Enterprise Linux Client release 5.2 64-bit | 1.10.1 | noglitch | release-2010.12 a643fb8 | clean | |
| at91sam9g20ek | angstrom-2010.x | console-image | Red Hat Enterprise Linux Client release 5.2 64-bit | 1.10.1 | noglitch | release-2010.12 a643fb8 | clean | |
| machine | distro | target | workstation | bitbake | tester | last successful build | build type | Current issues |
[1] Testing done by eFfeM. Resources kindly provided by Axon Digital Design
[2] Testing done by Sledz. Resources kindly provided by DResearch Digital Media Systems GmbH
[3] Testing done by mckoan. Resources kindly provided by Koan sas
[4] Testing done by Tom Rini. Resources kindly provided by Mentor Graphics
[5] Testing done by Cliff Brake. Resources kindly provided by BEC Systems
Testing Procedure
The general process for managing the testing branch is:
- Starting at approximately 9PM GMT on Thursday of every week, the master branch is merged to the testing-next branch. This is automatically done by a script running in a cron job on Cliff's workstation. The goal is to have the testing-branch in place so that all testers can starting building on Friday and build over the weekend when computers are more likely free.
- The above script sends an email to the oe-devel list with a subject of "testing branch YYYY-MM-DD". All volunteers preferably do an incremental build (from last weeks snapshot), then clean tmp and do a clean build of the combinations they test. If time or resources are not available, then incremental builds are not required. After builds are complete, update the above chart, and report status/issues as replies to the above email.
- If most combinations build by following Thursday, the testing-next branch is merged to the testing branch. Regardless, the repository is tagged with the tested_YYYY-MM-DD tag. An annotated tag is used with a message that includes a text copy of the above table with variations that have been tested building for this cycle. The reason we tag after testing is complete is so that we can include status in the annotated tag. This way information about what was tested with each tagged version is captured in the repository. A link is added for easy reference to the log below.
- If a build fails, then issues are reported, and we try to get issues fixed before the next weeks testing cycle.
- Not every combination is tested on every cycle, due to availability of testers, so we list the last known built version in the above chart. Testers are responsible for updating the above chart.
- All testers are encouraged to use Tinderbox so problems are automatically reported and logged, and issues in the above chart can be linked to Tinderbox.
We strongly encourage chip and SBC/Module vendors to become involved in this effort to ensure OE works for your platforms.
Useful software
- Hudson http://hudson-ci.org/
- BuildBot http://buildbot.net/trac
- TestBuilder by Jay7
- TestingScript by EFfeM
Testing Log
For a list of available test tags and results, see: http://cgit.openembedded.org/cgit.cgi/openembedded/refs/tags