From nobody Tue Oct 7 02:43:38 2025 Delivered-To: importer@patchew.org Authentication-Results: mx.zohomail.com; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; dmarc=fail(p=none dis=none) header.from=gmail.com ARC-Seal: i=1; a=rsa-sha256; t=1590406191; cv=none; d=zohomail.com; s=zohoarc; b=Kun5dfyeuQqcyli+yHbGcoHFZcGyif4GLnvUEsk7OLdEAiNkKVxSL0QInm+61JpPqJYE8vutD+B7pldEHBNNkeiDDMiBLk5b5uoF+1ibNzg5ojRxWB4fSvsc5H3P/gnTQ/w9b3keZ5PntY7VLXbJtk86vPAH5VpuTSyRvJ2Tv7g= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1590406191; h=Content-Type:Content-Transfer-Encoding:Cc:Date:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Archive:List-Help:List-Unsubscribe:MIME-Version:Message-ID:References:Sender:Subject:To; bh=sDFQvaTtydQkA1vruOwvmB1UukN2Stcon/JE4mUQ2X0=; b=dJdIL8p7eWGrla1Vzy78ROBaalfE/JzGGFRC8NVUUE7RuUertszoI7Y4htW4v1oOOxiGLlL2Ag+e+9dGvPt3/I6RK0P1RQTP4Y7LuJjZ5pSJIEeOonGGHW4c6x5Wv4ME5zjWd2EheirGSHagx/OeOw+jo8qgTIbRLWSUmyvDY08= ARC-Authentication-Results: i=1; mx.zohomail.com; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; dmarc=fail header.from= (p=none dis=none) header.from= Return-Path: Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) by mx.zohomail.com with SMTPS id 1590406191468785.7377230754943; Mon, 25 May 2020 04:29:51 -0700 (PDT) Received: from localhost ([::1]:43576 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jdBIk-0001AK-A0 for importer@patchew.org; Mon, 25 May 2020 07:29:50 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:57524) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1jdB99-00021M-8S for qemu-devel@nongnu.org; Mon, 25 May 2020 07:19:56 -0400 Received: from mail.ispras.ru ([83.149.199.45]:54930) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jdB98-0008Qp-7g for qemu-devel@nongnu.org; Mon, 25 May 2020 07:19:55 -0400 Received: from [127.0.1.1] (unknown [62.118.151.149]) by mail.ispras.ru (Postfix) with ESMTPSA id 40915CD466; Mon, 25 May 2020 14:19:53 +0300 (MSK) Subject: [PATCH 9/9] tests/acceptance: Linux boot test for record/replay From: Pavel Dovgalyuk To: qemu-devel@nongnu.org Date: Mon, 25 May 2020 14:19:53 +0300 Message-ID: <159040559302.2615.18392869399102145442.stgit@pasha-ThinkPad-X280> In-Reply-To: <159040554265.2615.8993443700754452381.stgit@pasha-ThinkPad-X280> References: <159040554265.2615.8993443700754452381.stgit@pasha-ThinkPad-X280> User-Agent: StGit/0.17.1-dirty MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Received-SPF: pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; envelope-from=qemu-devel-bounces+importer=patchew.org@nongnu.org; helo=lists.gnu.org; Received-SPF: softfail client-ip=83.149.199.45; envelope-from=Pavel.Dovgaluk@gmail.com; helo=mail.ispras.ru X-detected-operating-system: by eggs.gnu.org: First seen = 2020/05/25 07:19:03 X-ACL-Warn: Detected OS = Linux 3.11 and newer X-Spam_score_int: 17 X-Spam_score: 1.7 X-Spam_bar: + X-Spam_report: (1.7 / 5.0 requ) BAYES_00=-1.9, DKIM_ADSP_CUSTOM_MED=0.001, FORGED_GMAIL_RCVD=1, FREEMAIL_FROM=0.001, FROM_WORDY=1, NML_ADSP_CUSTOM_MED=0.9, SPF_SOFTFAIL=0.665, T_FILL_THIS_FORM_SHORT=0.01, URIBL_BLOCKED=0.001 autolearn=_AUTOLEARN X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: philmd@redhat.com, dovgaluk@ispras.ru, pavel.dovgaluk@ispras.ru, crosa@redhat.com, pbonzini@redhat.com, alex.bennee@linaro.org Errors-To: qemu-devel-bounces+importer=patchew.org@nongnu.org Sender: "Qemu-devel" This patch adds a test for record/replay, which boots Linux image from the disk and interacts with the network. The idea and code of this test is borrowed from boot_linux.py However, currently record/replay works only for x86_64, therefore other tests were excluded. Each test consists of the following phases: - downloading the disk image - recording the execution - replaying the execution Replay does not validates the output, but waits until QEMU finishes the execution. This is reasonable, because QEMU usually hangs when replay goes wrong. Signed-off-by: Pavel Dovgalyuk --- MAINTAINERS | 1=20 tests/acceptance/replay_linux.py | 140 ++++++++++++++++++++++++++++++++++= ++++ 2 files changed, 141 insertions(+) create mode 100644 tests/acceptance/replay_linux.py diff --git a/MAINTAINERS b/MAINTAINERS index e9a9ce4f66..97f066a9b2 100644 --- a/MAINTAINERS +++ b/MAINTAINERS @@ -2498,6 +2498,7 @@ F: include/sysemu/replay.h F: docs/replay.txt F: stubs/replay.c F: tests/acceptance/replay_kernel.py +F: tests/acceptance/replay_linux.py =20 IOVA Tree M: Peter Xu diff --git a/tests/acceptance/replay_linux.py b/tests/acceptance/replay_lin= ux.py new file mode 100644 index 0000000000..08eedb23ef --- /dev/null +++ b/tests/acceptance/replay_linux.py @@ -0,0 +1,140 @@ +# Record/replay test that boots a complete Linux system via a cloud image +# +# Copyright (c) 2020 ISP RAS +# +# Author: +# Pavel Dovgalyuk +# +# This work is licensed under the terms of the GNU GPL, version 2 or +# later. See the COPYING file in the top-level directory. + +import os + +from avocado_qemu import Test, BUILD_DIR + +from avocado.utils import cloudinit +from avocado.utils import network +from avocado.utils import vmimage +from avocado.utils import datadrainer +from avocado.utils.path import find_command + +class ReplayLinux(Test): + """ + Boots a Linux system, checking for a successful initialization + """ + + timeout =3D 1800 + chksum =3D None + hdd =3D 'ide-hd' + cd =3D 'ide-cd' + bus =3D '' + + def setUp(self): + super(ReplayLinux, self).setUp() + self.prepare_boot() + self.prepare_cloudinit() + + def vm_add_disk(self, vm, path, id, device): + bus_string =3D '' + if self.bus !=3D '': + bus_string =3D ',bus=3D%s.%d' % (self.bus, id,) + vm.add_args('-drive', 'file=3D%s,snapshot,id=3Ddisk%s,if=3Dnone' %= (path, id)) + vm.add_args('-drive', 'driver=3Dblkreplay,id=3Ddisk%s-rr,if=3Dnone= ,image=3Ddisk%s' % (id, id)) + vm.add_args('-device', '%s,drive=3Ddisk%s-rr%s' % (device, id, bus= _string)) + + def prepare_boot(self): + self.log.debug('Looking for and selecting a qemu-img binary to be ' + 'used to create the bootable snapshot image') + # If qemu-img has been built, use it, otherwise the system wide one + # will be used. If none is available, the test will cancel. + qemu_img =3D os.path.join(BUILD_DIR, 'qemu-img') + if not os.path.exists(qemu_img): + qemu_img =3D find_command('qemu-img', False) + if qemu_img is False: + self.cancel('Could not find "qemu-img", which is required to ' + 'create the bootable image') + vmimage.QEMU_IMG =3D qemu_img + + self.log.info('Downloading/preparing boot image') + # Fedora 31 only provides ppc64le images + image_arch =3D self.arch + if image_arch =3D=3D 'ppc64': + image_arch =3D 'ppc64le' + try: + self.boot =3D vmimage.get( + 'fedora', arch=3Dimage_arch, version=3D'31', + checksum=3Dself.chksum, + algorithm=3D'sha256', + cache_dir=3Dself.cache_dirs[0], + snapshot_dir=3Dself.workdir) + except: + self.cancel('Failed to download/prepare boot image') + + def prepare_cloudinit(self): + self.log.info('Preparing cloudinit image') + try: + self.cloudinit_iso =3D os.path.join(self.workdir, 'cloudinit.i= so') + self.phone_home_port =3D network.find_free_port() + cloudinit.iso(self.cloudinit_iso, self.name, + username=3D'root', + password=3D'password', + # QEMU's hard coded usermode router address + phone_home_host=3D'10.0.2.2', + phone_home_port=3Dself.phone_home_port) + except Exception: + self.cancel('Failed to prepared cloudinit image') + + def launch_and_wait(self, record, args, shift): + vm =3D self.get_vm() + vm.add_args('-smp', '1') + vm.add_args('-m', '1024') + vm.add_args('-object', 'filter-replay,id=3Dreplay,netdev=3Dhub0por= t0') + vm.add_args(*args) + self.vm_add_disk(vm, self.boot.path, 0, self.hdd) + self.vm_add_disk(vm, self.cloudinit_iso, 1, self.cd) + if record: + mode =3D 'record' + else: + mode =3D 'replay' + vm.add_args('-icount', 'shift=3D%s,rr=3D%s,rrfile=3D%s' % + (shift, mode, os.path.join(self.workdir, 'replay.bin')= )) + + vm.set_console() + vm.launch() + console_drainer =3D datadrainer.LineLogger(vm.console_socket.filen= o(), + logger=3Dself.log.getChil= d('console'), + stop_check=3D(lambda : no= t vm.is_running())) + console_drainer.start() + if record: + self.log.info('VM launched, waiting for boot confirmation from= guest') + cloudinit.wait_for_phone_home(('0.0.0.0', self.phone_home_port= ), self.name) + vm.shutdown() + else: + self.log.info('VM launched, waiting the recorded execution to = be replayed') + vm.wait() + + def run_rr(self, args=3D(), shift=3D7): + self.launch_and_wait(True, args, shift) + self.launch_and_wait(False, args, shift) + +class ReplayLinuxX8664(ReplayLinux): + """ + :avocado: tags=3Darch:x86_64 + """ + bus =3D 'ide' + + chksum =3D 'e3c1b309d9203604922d6e255c2c5d098a309c2d46215d8fc026954f3c= 5c27a0' + + def test_pc_i440fx(self): + """ + :avocado: tags=3Dmachine:pc + :avocado: tags=3Daccel:tcg + """ + self.run_rr(shift=3D1) + + def test_pc_q35(self): + """ + :avocado: tags=3Dmachine:q35 + :avocado: tags=3Daccel:tcg + """ + self.run_rr(shift=3D3)