From nobody Mon Feb 9 17:23:32 2026 Delivered-To: importer@patchew.org Received-SPF: pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; envelope-from=qemu-devel-bounces+importer=patchew.org@nongnu.org; helo=lists.gnu.org; Authentication-Results: mx.zohomail.com; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; dmarc=fail(p=none dis=none) header.from=virtuozzo.com ARC-Seal: i=1; a=rsa-sha256; t=1582874426; cv=none; d=zohomail.com; s=zohoarc; b=ZRdWPeIVgVPdYv0vgek8sk3A9RIeI9oOFCeM7j6r34ifHQNsteECUqXCq4x0XSeGQ3x13Q4IKr/S069yURjN7DUPqnWarvqycOwfM+qNn7jacG1ID8GzAdNekahjInsMFjcBSfT5MFywDD/keqRX4UEt2cJtTfe2NYIcpS2h8io= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1582874426; h=Content-Transfer-Encoding:Cc:Date:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Archive:List-Help:List-Unsubscribe:MIME-Version:Message-ID:References:Sender:Subject:To; bh=aqsOuPCCw9ePUcvfVBqDls0A9aa+YyZlCgX3lgN+blo=; b=oDYmi0coJf2AlqXxYftVlcvOpwgDdFkSlAbFpAUEGFzbZvoKxxkapf/lhWb2hv2heTa+Vnz5v88eA7a+7ZWnduQaLFmyF/d4f/qBxJmE8SogNFi+2lf97FY//g/MyzDymbAX26I7NTlX7Nwo4+z1iaiDrZJHN/gJ4rQ6bGzbDpA= ARC-Authentication-Results: i=1; mx.zohomail.com; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; dmarc=fail header.from= (p=none dis=none) header.from= Return-Path: Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) by mx.zohomail.com with SMTPS id 1582874426868374.60908900776303; Thu, 27 Feb 2020 23:20:26 -0800 (PST) Received: from localhost ([::1]:42644 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1j7Zwf-0004Fh-2p for importer@patchew.org; Fri, 28 Feb 2020 02:20:25 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:33399) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1j7Zvm-0002Zg-8x for qemu-devel@nongnu.org; Fri, 28 Feb 2020 02:19:31 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1j7Zvk-000616-Vc for qemu-devel@nongnu.org; Fri, 28 Feb 2020 02:19:30 -0500 Received: from relay.sw.ru ([185.231.240.75]:51944) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1j7Zvk-00060b-OE; Fri, 28 Feb 2020 02:19:28 -0500 Received: from vovaso.qa.sw.ru ([10.94.3.0] helo=kvm.qa.sw.ru) by relay.sw.ru with esmtp (Exim 4.92.3) (envelope-from ) id 1j7Zve-0002hc-DB; Fri, 28 Feb 2020 10:19:22 +0300 From: Vladimir Sementsov-Ogievskiy To: qemu-devel@nongnu.org Subject: [PATCH v3 2/4] scripts/simplebench: add qemu/bench_block_job.py Date: Fri, 28 Feb 2020 10:19:12 +0300 Message-Id: <20200228071914.11746-3-vsementsov@virtuozzo.com> X-Mailer: git-send-email 2.21.0 In-Reply-To: <20200228071914.11746-1-vsementsov@virtuozzo.com> References: <20200228071914.11746-1-vsementsov@virtuozzo.com> MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: GNU/Linux 3.x [fuzzy] X-Received-From: 185.231.240.75 X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: kwolf@redhat.com, vsementsov@virtuozzo.com, ehabkost@redhat.com, qemu-block@nongnu.org, stefanha@gmail.com, mreitz@redhat.com, crosa@redhat.com, den@openvz.org, jsnow@redhat.com Errors-To: qemu-devel-bounces+importer=patchew.org@nongnu.org Sender: "Qemu-devel" Content-Type: text/plain; charset="utf-8" Add block-job benchmarking helper functions. Signed-off-by: Vladimir Sementsov-Ogievskiy Reviewed-by: Aleksandar Markovic --- scripts/simplebench/bench_block_job.py | 119 +++++++++++++++++++++++++ 1 file changed, 119 insertions(+) create mode 100755 scripts/simplebench/bench_block_job.py diff --git a/scripts/simplebench/bench_block_job.py b/scripts/simplebench/b= ench_block_job.py new file mode 100755 index 0000000000..9808d696cf --- /dev/null +++ b/scripts/simplebench/bench_block_job.py @@ -0,0 +1,119 @@ +#!/usr/bin/env python +# +# Benchmark block jobs +# +# Copyright (c) 2019 Virtuozzo International GmbH. +# +# This program is free software; you can redistribute it and/or modify +# it under the terms of the GNU General Public License as published by +# the Free Software Foundation; either version 2 of the License, or +# (at your option) any later version. +# +# This program is distributed in the hope that it will be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU General Public License for more details. +# +# You should have received a copy of the GNU General Public License +# along with this program. If not, see . +# + + +import sys +import os +import socket +import json + +sys.path.append(os.path.join(os.path.dirname(__file__), '..', '..', 'pytho= n')) +from qemu.machine import QEMUMachine +from qemu.qmp import QMPConnectError + + +def bench_block_job(cmd, cmd_args, qemu_args): + """Benchmark block-job + + cmd -- qmp command to run block-job (like blockdev-backup) + cmd_args -- dict of qmp command arguments + qemu_args -- list of Qemu command line arguments, including path to Qe= mu + binary + + Returns {'seconds': int} on success and {'error': str} on failure, dic= t may + contain addional 'vm-log' field. Return value is compatible with + simplebench lib. + """ + + vm =3D QEMUMachine(qemu_args[0], args=3Dqemu_args[1:]) + + try: + vm.launch() + except OSError as e: + return {'error': 'popen failed: ' + str(e)} + except (QMPConnectError, socket.timeout): + return {'error': 'qemu failed: ' + str(vm.get_log())} + + try: + res =3D vm.qmp(cmd, **cmd_args) + if res !=3D {'return': {}}: + vm.shutdown() + return {'error': '"{}" command failed: {}'.format(cmd, str(res= ))} + + e =3D vm.event_wait('JOB_STATUS_CHANGE') + assert e['data']['status'] =3D=3D 'created' + start_ms =3D e['timestamp']['seconds'] * 1000000 + \ + e['timestamp']['microseconds'] + + e =3D vm.events_wait((('BLOCK_JOB_READY', None), + ('BLOCK_JOB_COMPLETED', None), + ('BLOCK_JOB_FAILED', None)), timeout=3DTrue) + if e['event'] not in ('BLOCK_JOB_READY', 'BLOCK_JOB_COMPLETED'): + vm.shutdown() + return {'error': 'block-job failed: ' + str(e), + 'vm-log': vm.get_log()} + end_ms =3D e['timestamp']['seconds'] * 1000000 + \ + e['timestamp']['microseconds'] + finally: + vm.shutdown() + + return {'seconds': (end_ms - start_ms) / 1000000.0} + + +# Bench backup or mirror +def bench_block_copy(qemu_binary, cmd, source, target): + """Helper to run bench_block_job() for mirror or backup""" + assert cmd in ('blockdev-backup', 'blockdev-mirror') + + source['node-name'] =3D 'source' + target['node-name'] =3D 'target' + + return bench_block_job(cmd, + {'job-id': 'job0', 'device': 'source', + 'target': 'target', 'sync': 'full'}, + [qemu_binary, + '-blockdev', json.dumps(source), + '-blockdev', json.dumps(target)]) + + +def drv_file(filename): + return {'driver': 'file', 'filename': filename, + 'cache': {'direct': True}, 'aio': 'native'} + + +def drv_nbd(host, port): + return {'driver': 'nbd', + 'server': {'type': 'inet', 'host': host, 'port': port}} + + +if __name__ =3D=3D '__main__': + import sys + + if len(sys.argv) < 4: + print('USAGE: {} ' + ' ' + ''.format(sys.argv[0])) + exit(1) + + res =3D bench_block_job(sys.argv[1], json.loads(sys.argv[2]), sys.argv= [3:]) + if 'seconds' in res: + print('{:.2f}'.format(res['seconds'])) + else: + print(res) --=20 2.21.0