[OE-core] [PATCH] oe-selftest: runqemu: add tests for qemu boot and shutdown

[Yeoh, Ee Peng]

Hi Richard,

Yes, we are testing an alternative way to stop qemu here. From my understand, the existing testcases stop qemu through killing the qemu process. While this testcase was testing that after executing the shutdown command inside qemu, qemu will stop as expected. 

Currently, QA team was manually testing the execution of shutdown command on various qemu architecture. The team had found an shutdown hung issue on qemuarm.  
https://bugzilla.yoctoproject.org/show_bug.cgi?id=12499

Hope this explain the intention of this testcase. Please let me you opinion and input. 

Thanks,
Yeoh Ee Peng 

-----Original Message-----
From: Richard Purdie [mailto:richard.purdie at linuxfoundation.org] 
Sent: Tuesday, April 10, 2018 5:41 PM
To: Yeoh, Ee Peng <ee.peng.yeoh at intel.com>; openembedded-core at lists.openembedded.org
Subject: Re: [OE-core] [PATCH] oe-selftest: runqemu: add tests for qemu boot and shutdown

On Mon, 2018-04-09 at 10:43 -0700, Yeoh Ee Peng wrote:
> QA team were testing qemu boot image and shutdown on each qemu 
> architecture manually. Add automated test to test qemu boot on
> ext4 and nfs, finally check that it can shutdown properly.
> 
> Original runqemu tests was dedicated for MACHINE=qemux86-64 and it was 
> testing various live image (iso and hddimg) will be able to boot while 
> live image was not supported on all qemu architecture.
> 
> The new tests were designed as a separate class as this tests focus on 
> testing qemu boot and shutdown on each qemu architecture.
> Furthermore, this tests focus on testing qemu could shutdown as 
> expected.
> 
> Signed-off-by: Yeoh Ee Peng <ee.peng.yeoh at intel.com>

I do have one other question about this. There are various other tests which boot qemu images. Would we be able to assume that because those tests work, the start/stop of qemu is working? Or is there a unique element we need to test specifically here?

Cheers,

Richard