From nobody Fri May 3 08:38:55 2024 Delivered-To: importer@patchew.org Received-SPF: pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; envelope-from=qemu-devel-bounces+importer=patchew.org@nongnu.org; helo=lists.gnu.org; Authentication-Results: mx.zohomail.com; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; dmarc=fail(p=none dis=none) header.from=virtuozzo.com ARC-Seal: i=1; a=rsa-sha256; t=1574783683; cv=none; d=zohomail.com; s=zohoarc; b=nT4fI6rr39c+mjfpY4esUJgvysqTrtvQCupYgN+IlBNiQwHFH7Ql/nD3qmvCThCkXNiQqYCuigKD4utIqmCnUfB1MKrd9B7FKXPXkJhMZe9w1lnFYf0MjJHE9bLw9MwkQUI0bTTKAzDmQrzTNZDDxPCARlgyox90I2VF95L9Moo= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1574783683; h=Cc:Date:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Archive:List-Help:List-Unsubscribe:Message-ID:References:Sender:Subject:To; bh=uYigWB07OQadgcWPTS/VYtmR+Mlr0b/KqaaXUGGDHgo=; b=FqfwRhpNHRfaQzOhmeEaVBfFyV0F3RFymZ5nSX1qnuLBdWpsXHhr3iIyoVPzlXK+lHJ6+X6Tp9XP+hRGay8p6PSZeXm5PqEvejQS52s7hv3oypLB2nCLcHTRundSTsgRbTJq7KVJFf9rFrRyJdl5IWElYHvlRZO5dG8T8ytupNU= ARC-Authentication-Results: i=1; mx.zohomail.com; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; dmarc=fail header.from= (p=none dis=none) header.from= Return-Path: Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) by mx.zohomail.com with SMTPS id 1574783683954726.2732293145197; Tue, 26 Nov 2019 07:54:43 -0800 (PST) Received: from localhost ([::1]:56528 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1iZdAo-0000zK-SQ for importer@patchew.org; Tue, 26 Nov 2019 10:54:42 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:60069) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1iZd5G-0003FV-LB for qemu-devel@nongnu.org; Tue, 26 Nov 2019 10:49:00 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1iZd5F-0002eV-12 for qemu-devel@nongnu.org; Tue, 26 Nov 2019 10:48:58 -0500 Received: from relay.sw.ru ([185.231.240.75]:52184) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1iZd5E-0002c3-PX; Tue, 26 Nov 2019 10:48:56 -0500 Received: from vovaso.qa.sw.ru ([10.94.3.0] helo=kvm.qa.sw.ru) by relay.sw.ru with esmtp (Exim 4.92.3) (envelope-from ) id 1iZd57-00069i-K4; Tue, 26 Nov 2019 18:48:49 +0300 From: Vladimir Sementsov-Ogievskiy To: qemu-devel@nongnu.org, qemu-block@nongnu.org Subject: [PATCH for-5.0 v2 1/3] python: add simplebench.py Date: Tue, 26 Nov 2019 18:48:46 +0300 Message-Id: <20191126154848.193407-2-vsementsov@virtuozzo.com> X-Mailer: git-send-email 2.18.0 In-Reply-To: <20191126154848.193407-1-vsementsov@virtuozzo.com> References: <20191126154848.193407-1-vsementsov@virtuozzo.com> X-detected-operating-system: by eggs.gnu.org: GNU/Linux 3.x [fuzzy] X-Received-From: 185.231.240.75 X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: kwolf@redhat.com, vsementsov@virtuozzo.com, ehabkost@redhat.com, stefanha@gmail.com, mreitz@redhat.com, crosa@redhat.com, den@openvz.org, jsnow@redhat.com Errors-To: qemu-devel-bounces+importer=patchew.org@nongnu.org Sender: "Qemu-devel" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Add simple benchmark table creator. Signed-off-by: Vladimir Sementsov-Ogievskiy --- python/simplebench.py | 128 ++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 128 insertions(+) create mode 100644 python/simplebench.py diff --git a/python/simplebench.py b/python/simplebench.py new file mode 100644 index 0000000000..59e7314ff6 --- /dev/null +++ b/python/simplebench.py @@ -0,0 +1,128 @@ +#!/usr/bin/env python +# +# Simple benchmarking framework +# +# Copyright (c) 2019 Virtuozzo International GmbH. +# +# This program is free software; you can redistribute it and/or modify +# it under the terms of the GNU General Public License as published by +# the Free Software Foundation; either version 2 of the License, or +# (at your option) any later version. +# +# This program is distributed in the hope that it will be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU General Public License for more details. +# +# You should have received a copy of the GNU General Public License +# along with this program. If not, see . +# + + +def bench_one(test_func, test_env, test_case, count=3D5, initial_run=3DTru= e): + """Benchmark one test-case + + test_func -- benchmarking function with prototype + test_func(env, case), which takes test_env and test_case + arguments and returns {'seconds': int} (which is benchm= ark + result) on success and {'error': str} on error. Returned + dict may contain any other additional fields. + test_env -- test environment - opaque first argument for test_func + test_case -- test case - opaque second argument for test_func + count -- how many times to call test_func, to calculate average + initial_run -- do initial run of test_func, which don't get into result + + Returns dict with the following fields: + 'runs': list of test_func results + 'average': average seconds per run (exists only if at least one r= un + succeeded) + 'delta': maximum delta between test_func result and the average + (exists only if at least one run succeeded) + 'n-failed': number of failed runs (exists only if at least one run + failed) + """ + if initial_run: + print(' #initial run:') + print(' ', test_func(test_env, test_case)) + + runs =3D [] + for i in range(count): + print(' #run {}'.format(i+1)) + res =3D test_func(test_env, test_case) + print(' ', res) + runs.append(res) + + result =3D {'runs': runs} + + successed =3D [r for r in runs if ('seconds' in r)] + if successed: + avg =3D sum(r['seconds'] for r in successed) / len(successed) + result['average'] =3D avg + result['delta'] =3D max(abs(r['seconds'] - avg) for r in successed) + + if len(successed) < count: + result['n-failed'] =3D count - len(successed) + + return result + + +def ascii_one(result): + """Return ASCII representation of bench_one() returned dict.""" + if 'average' in result: + s =3D '{:.2f} +- {:.2f}'.format(result['average'], result['delta']) + if 'n-failed' in result: + s +=3D '\n({} failed)'.format(result['n-failed']) + return s + else: + return 'FAILED' + + +def bench(test_func, test_envs, test_cases, *args, **vargs): + """Fill benchmark table + + test_func -- benchmarking function, see bench_one for description + test_envs -- list of test environments, see bench_one + test_cases -- list of test cases, see bench_one + args, vargs -- additional arguments for bench_one + + Returns dict with the following fields: + 'envs': test_envs + 'cases': test_cases + 'tab': filled 2D array, where cell [i][j] is bench_one result for + test_cases[i] for test_envs[j] (i.e., rows are test cases= and + columns are test environments) + """ + tab =3D {} + results =3D { + 'envs': test_envs, + 'cases': test_cases, + 'tab': tab + } + n =3D 1 + n_tests =3D len(test_envs) * len(test_cases) + for env in test_envs: + for case in test_cases: + print('Testing {}/{}: {} :: {}'.format(n, n_tests, + env['id'], case['id'])) + if case['id'] not in tab: + tab[case['id']] =3D {} + tab[case['id']][env['id']] =3D bench_one(test_func, env, case, + *args, **vargs) + n +=3D 1 + + print('Done') + return results + + +def ascii(results): + """Return ASCII representation of bench() returned dict.""" + from tabulate import tabulate + + tab =3D [[""] + [c['id'] for c in results['envs']]] + for case in results['cases']: + row =3D [case['id']] + for env in results['envs']: + row.append(ascii_one(results['tab'][case['id']][env['id']])) + tab.append(row) + + return tabulate(tab) --=20 2.18.0 From nobody Fri May 3 08:38:55 2024 Delivered-To: importer@patchew.org Received-SPF: pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; envelope-from=qemu-devel-bounces+importer=patchew.org@nongnu.org; helo=lists.gnu.org; Authentication-Results: mx.zohomail.com; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; dmarc=fail(p=none dis=none) header.from=virtuozzo.com ARC-Seal: i=1; a=rsa-sha256; t=1574783503; cv=none; d=zohomail.com; s=zohoarc; b=jQVmiMmZGYKi/CRpA+xHwQM61q9noi0FMr8iOw4qxwxXv1ckBITnKwUDkHecgm/tmK9pvsJqm3JdyefuaBYMvDiNanM7FksHaxoQWD7o8lPGNbT2hRd1Sb/ElXOHfJuDLtXQF1gXGYuMJZKvpod9CdcX+IXfRMCWlIfbuuJmrCg= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1574783503; h=Cc:Date:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Archive:List-Help:List-Unsubscribe:Message-ID:References:Sender:Subject:To; bh=ziz3a9ywc4Cekr+EyO9uBh8ceS8n04FYwpxg/WJRhzg=; b=emqR0v/2brkMtOZk1tjisJmtx0vnBbKqVUvcnvcslup6KMQ+w1lnrYCy2K+xXEQxjxHlr1iG+tMbL3TU8L432ohe6yFrlmBIalF7Xts+buK4ihkQu+/iAaIvu8gFKIq6k0FENcs5Ksm0+VqTR2ztWghsjrd8ZPAWHrekfJ2Zh08= ARC-Authentication-Results: i=1; mx.zohomail.com; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; dmarc=fail header.from= (p=none dis=none) header.from= Return-Path: Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) by mx.zohomail.com with SMTPS id 1574783503364806.2322222896887; Tue, 26 Nov 2019 07:51:43 -0800 (PST) Received: from localhost ([::1]:56474 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1iZd7t-00057k-R1 for importer@patchew.org; Tue, 26 Nov 2019 10:51:41 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:60071) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1iZd5G-0003Fj-NX for qemu-devel@nongnu.org; Tue, 26 Nov 2019 10:49:00 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1iZd5E-0002e1-TA for qemu-devel@nongnu.org; Tue, 26 Nov 2019 10:48:58 -0500 Received: from relay.sw.ru ([185.231.240.75]:52186) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1iZd5E-0002c4-LW; Tue, 26 Nov 2019 10:48:56 -0500 Received: from vovaso.qa.sw.ru ([10.94.3.0] helo=kvm.qa.sw.ru) by relay.sw.ru with esmtp (Exim 4.92.3) (envelope-from ) id 1iZd57-00069i-Py; Tue, 26 Nov 2019 18:48:49 +0300 From: Vladimir Sementsov-Ogievskiy To: qemu-devel@nongnu.org, qemu-block@nongnu.org Subject: [PATCH for-5.0 v2 2/3] python: add qemu/bench_block_job.py Date: Tue, 26 Nov 2019 18:48:47 +0300 Message-Id: <20191126154848.193407-3-vsementsov@virtuozzo.com> X-Mailer: git-send-email 2.18.0 In-Reply-To: <20191126154848.193407-1-vsementsov@virtuozzo.com> References: <20191126154848.193407-1-vsementsov@virtuozzo.com> X-detected-operating-system: by eggs.gnu.org: GNU/Linux 3.x [fuzzy] X-Received-From: 185.231.240.75 X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: kwolf@redhat.com, vsementsov@virtuozzo.com, ehabkost@redhat.com, stefanha@gmail.com, mreitz@redhat.com, crosa@redhat.com, den@openvz.org, jsnow@redhat.com Errors-To: qemu-devel-bounces+importer=patchew.org@nongnu.org Sender: "Qemu-devel" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Add block-job benchmarking helper functions. Signed-off-by: Vladimir Sementsov-Ogievskiy --- python/qemu/bench_block_job.py | 115 +++++++++++++++++++++++++++++++++ 1 file changed, 115 insertions(+) create mode 100755 python/qemu/bench_block_job.py diff --git a/python/qemu/bench_block_job.py b/python/qemu/bench_block_job.py new file mode 100755 index 0000000000..93f3956158 --- /dev/null +++ b/python/qemu/bench_block_job.py @@ -0,0 +1,115 @@ +#!/usr/bin/env python +# +# Benchmark block jobs +# +# Copyright (c) 2019 Virtuozzo International GmbH. +# +# This program is free software; you can redistribute it and/or modify +# it under the terms of the GNU General Public License as published by +# the Free Software Foundation; either version 2 of the License, or +# (at your option) any later version. +# +# This program is distributed in the hope that it will be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU General Public License for more details. +# +# You should have received a copy of the GNU General Public License +# along with this program. If not, see . +# + + +import socket +import json +from .machine import QEMUMachine +from .qmp import QMPConnectError + + +def bench_block_job(cmd, cmd_args, qemu_args): + """Benchmark block-job + + cmd -- qmp command to run block-job (like blockdev-backup) + cmd_args -- dict of qmp command arguments + qemu_args -- list of Qemu command line arguments, including path to Qe= mu + binary + + Returns {'seconds': int} on success and {'error': str} on failure, dic= t may + contain addional 'vm-log' field. Return value is compatible with + simplebench lib. + """ + + vm =3D QEMUMachine(qemu_args[0], args=3Dqemu_args[1:]) + + try: + vm.launch() + except OSError as e: + return {'error': 'popen failed: ' + str(e)} + except (QMPConnectError, socket.timeout): + return {'error': 'qemu failed: ' + str(vm.get_log())} + + try: + res =3D vm.qmp(cmd, **cmd_args) + if res !=3D {'return': {}}: + vm.shutdown() + return {'error': '"{}" command failed: {}'.format(cmd, str(res= ))} + + e =3D vm.event_wait('JOB_STATUS_CHANGE') + assert e['data']['status'] =3D=3D 'created' + start_ms =3D e['timestamp']['seconds'] * 1000000 + \ + e['timestamp']['microseconds'] + + e =3D vm.events_wait((('BLOCK_JOB_READY', None), + ('BLOCK_JOB_COMPLETED', None), + ('BLOCK_JOB_FAILED', None)), timeout=3DTrue) + if e['event'] not in ('BLOCK_JOB_READY', 'BLOCK_JOB_COMPLETED'): + vm.shutdown() + return {'error': 'block-job failed: ' + str(e), + 'vm-log': vm.get_log()} + end_ms =3D e['timestamp']['seconds'] * 1000000 + \ + e['timestamp']['microseconds'] + finally: + vm.shutdown() + + return {'seconds': (end_ms - start_ms) / 1000000.0} + + +# Bench backup or mirror +def bench_block_copy(qemu_binary, cmd, source, target): + """Helper to run bench_block_job() for mirror or backup""" + assert cmd in ('blockdev-backup', 'blockdev-mirror') + + source['node-name'] =3D 'source' + target['node-name'] =3D 'target' + + return bench_block_job(cmd, + {'job-id': 'job0', 'device': 'source', + 'target': 'target', 'sync': 'full'}, + [qemu_binary, + '-blockdev', json.dumps(source), + '-blockdev', json.dumps(target)]) + + +def drv_file(filename): + return {'driver': 'file', 'filename': filename, + 'cache': {'direct': True}, 'aio': 'native'} + + +def drv_nbd(host, port): + return {'driver': 'nbd', + 'server': {'type': 'inet', 'host': host, 'port': port}} + + +if __name__ =3D=3D '__main__': + import sys + + if len(sys.argv) < 4: + print('USAGE: {} ' + ' ' + ''.format(sys.argv[0])) + exit(1) + + res =3D bench_block_job(sys.argv[1], json.loads(sys.argv[2]), sys.argv= [3:]) + if 'seconds' in res: + print('{:.2f}'.format(res['seconds'])) + else: + print(res) --=20 2.18.0 From nobody Fri May 3 08:38:55 2024 Delivered-To: importer@patchew.org Received-SPF: pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; envelope-from=qemu-devel-bounces+importer=patchew.org@nongnu.org; helo=lists.gnu.org; Authentication-Results: mx.zohomail.com; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; dmarc=fail(p=none dis=none) header.from=virtuozzo.com ARC-Seal: i=1; a=rsa-sha256; t=1574783600; cv=none; d=zohomail.com; s=zohoarc; b=ecy7gGYVtafnsqEXC18SQIKYJSiG02hTcWiU1oh/NTF2mSt6Ju4kkHGfuK1EwSvDA1C6a3Gd6FcpbAcXglbbtRZs8zEWirS5usHCDFx2ViTUrHbvCBw6rwNyByp7evrhbCEQf7uU+9i+ADWW1cMZKq1r5oPAV0zKzfaE1bmlQf4= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1574783600; h=Cc:Date:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Archive:List-Help:List-Unsubscribe:Message-ID:References:Sender:Subject:To; bh=5iQfSCUkkPi4grnlQfN/aFJQrbSQlVbQ+wMKkyAmwUc=; b=hZW7Frd9xBltTR1+Tknkh327pSuCy5I/nXEi9g5BAW8x8GTqfiIZTnr4UHQNoJICC8RbZS71mKrNwBmNbTNki8ZemNxGxkFQKXeaQERXdDdbi+6WfejQQBALyVGz6t0jXimTU+UQIOIzDb8u6B0Wlv6ELXLUdW5MuY3slKX1F1k= ARC-Authentication-Results: i=1; mx.zohomail.com; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; dmarc=fail header.from= (p=none dis=none) header.from= Return-Path: Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) by mx.zohomail.com with SMTPS id 1574783600906822.6530390739437; Tue, 26 Nov 2019 07:53:20 -0800 (PST) Received: from localhost ([::1]:56514 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1iZd9T-0007cq-7x for importer@patchew.org; Tue, 26 Nov 2019 10:53:19 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:60064) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1iZd5G-0003FM-E1 for qemu-devel@nongnu.org; Tue, 26 Nov 2019 10:48:59 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1iZd5F-0002eP-0Q for qemu-devel@nongnu.org; Tue, 26 Nov 2019 10:48:58 -0500 Received: from relay.sw.ru ([185.231.240.75]:52194) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1iZd5E-0002c2-Oo; Tue, 26 Nov 2019 10:48:56 -0500 Received: from vovaso.qa.sw.ru ([10.94.3.0] helo=kvm.qa.sw.ru) by relay.sw.ru with esmtp (Exim 4.92.3) (envelope-from ) id 1iZd57-00069i-Sb; Tue, 26 Nov 2019 18:48:49 +0300 From: Vladimir Sementsov-Ogievskiy To: qemu-devel@nongnu.org, qemu-block@nongnu.org Subject: [PATCH for-5.0 v2 3/3] python: add example usage of simplebench Date: Tue, 26 Nov 2019 18:48:48 +0300 Message-Id: <20191126154848.193407-4-vsementsov@virtuozzo.com> X-Mailer: git-send-email 2.18.0 In-Reply-To: <20191126154848.193407-1-vsementsov@virtuozzo.com> References: <20191126154848.193407-1-vsementsov@virtuozzo.com> X-detected-operating-system: by eggs.gnu.org: GNU/Linux 3.x [fuzzy] X-Received-From: 185.231.240.75 X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: kwolf@redhat.com, vsementsov@virtuozzo.com, ehabkost@redhat.com, stefanha@gmail.com, mreitz@redhat.com, crosa@redhat.com, den@openvz.org, jsnow@redhat.com Errors-To: qemu-devel-bounces+importer=patchew.org@nongnu.org Sender: "Qemu-devel" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" This example may be used as a template for custom benchmark. It illustrates three things to prepare: - define bench_func - define test environments (columns) - define test cases (rows) And final call of simplebench API. Signed-off-by: Vladimir Sementsov-Ogievskiy --- python/bench-example.py | 80 +++++++++++++++++++++++++++++++++++++++++ 1 file changed, 80 insertions(+) create mode 100644 python/bench-example.py diff --git a/python/bench-example.py b/python/bench-example.py new file mode 100644 index 0000000000..4ccd4fc3dd --- /dev/null +++ b/python/bench-example.py @@ -0,0 +1,80 @@ +#!/usr/bin/env python3 +# +# Benchmark example +# +# Copyright (c) 2019 Virtuozzo International GmbH. +# +# This program is free software; you can redistribute it and/or modify +# it under the terms of the GNU General Public License as published by +# the Free Software Foundation; either version 2 of the License, or +# (at your option) any later version. +# +# This program is distributed in the hope that it will be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU General Public License for more details. +# +# You should have received a copy of the GNU General Public License +# along with this program. If not, see . +# + +import simplebench +from qemu.bench_block_job import bench_block_copy, drv_file, drv_nbd + + +def bench_func(env, case): + """ Handle one "cell" of benchmarking table. """ + return bench_block_copy(env['qemu_binary'], env['cmd'], + case['source'], case['target']) + + +# You may set the following five variables to correct values, to turn this +# example to real benchmark. +ssd_source =3D '/path-to-raw-source-image-at-ssd' +ssd_target =3D '/path-to-raw-target-image-at-ssd' +hdd_target =3D '/path-to-raw-source-image-at-hdd' +nbd_ip =3D 'nbd-ip-addr' +nbd_port =3D 'nbd-port-number' + +# Test-cases are "rows" in benchmark resulting table, 'id' is a caption for +# the row, other fields are handled by bench_func. +test_cases =3D [ + { + 'id': 'ssd -> ssd', + 'source': drv_file(ssd_source), + 'target': drv_file(ssd_target) + }, + { + 'id': 'ssd -> hdd', + 'source': drv_file(ssd_source), + 'target': drv_file(hdd_target) + }, + { + 'id': 'ssd -> nbd', + 'source': drv_file(ssd_source), + 'target': drv_nbd(nbd_ip, nbd_port) + }, +] + +# Test-envs are "columns" in benchmark resulting table, 'id is a caption f= or +# the column, other fields are handled by bench_func. +test_envs =3D [ + { + 'id': 'backup-1', + 'cmd': 'blockdev-backup', + 'qemu_binary': '/path-to-qemu-binary-1' + }, + { + 'id': 'backup-2', + 'cmd': 'blockdev-backup', + 'qemu_binary': '/path-to-qemu-binary-2' + }, + { + 'id': 'mirror', + 'cmd': 'blockdev-mirror', + 'qemu_binary': '/path-to-qemu-binary-1' + } +] + +result =3D simplebench.bench(bench_func, test_envs, test_cases, count=3D3) +print(simplebench.ascii(result)) --=20 2.18.0