From nobody Sat May 18 07:48:37 2024 Delivered-To: importer@patchew.org Authentication-Results: mx.zohomail.com; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org ARC-Seal: i=1; a=rsa-sha256; t=1620536544; cv=none; d=zohomail.com; s=zohoarc; b=FYq+xtYOKlQUm5Se4vOcEQC1vqU1mlFe5LqizNhRQ4kwUGPmU3oO+jH/MgjqufrnQGL5BMthA+XoDb/bPmEib6fNF8b87T4r+CnPLl4ZJSTNeCmvNYCPJoUk5vTHsZ936IqxTZ2oJurjAfTPBpj+5/VKiO5IqbzEul6Utz9jd2Q= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1620536544; h=Content-Type:Content-Transfer-Encoding:Cc:Date:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Archive:List-Help:List-Unsubscribe:MIME-Version:Message-ID:References:Sender:Subject:To; bh=lG86g0g0r5x6AibGK1b4/VvivNjfVCWFIxV2k1xVJ5E=; b=Me4rKu9G+KGzgQDNNO837NW100D0319CjN+Duo7jlVOcJeiS6kibjPLBYZqwAxDM01gySBAAPeV4k8oEAXxPMQoeyykMIC1fUHdNSyut7sXGE5jWtB8r3GajnHCWdKkUiiFhFLhPqTUP+Y4ipqUeMPTinzLgFtJkqw7SEOXlIB8= ARC-Authentication-Results: i=1; mx.zohomail.com; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org Return-Path: Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) by mx.zohomail.com with SMTPS id 1620536543837910.7050030441908; Sat, 8 May 2021 22:02:23 -0700 (PDT) Received: from localhost ([::1]:43766 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1lfbaA-00026J-Ne for importer@patchew.org; Sun, 09 May 2021 01:02:22 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:46542) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lfbY1-0000cC-MQ for qemu-devel@nongnu.org; Sun, 09 May 2021 01:00:10 -0400 Received: from prt-mail.chinatelecom.cn ([42.123.76.220]:40955 helo=chinatelecom.cn) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1lfbXu-0003j0-Mq for qemu-devel@nongnu.org; Sun, 09 May 2021 01:00:09 -0400 Received: from clientip-125.69.42.176?logid-b40496a661684a608bc29feb678708b8 (unknown [172.18.0.48]) by chinatelecom.cn (HERMES) with SMTP id 35BA0280081; Sun, 9 May 2021 12:59:59 +0800 (CST) Received: from ([172.18.0.48]) by app0024 with ESMTP id b40496a661684a608bc29feb678708b8 for qemu-devel@nongnu.org; Sun May 9 12:59:57 2021 HMM_SOURCE_IP: 172.18.0.48:33322.2129897197 HMM_ATTACHE_NUM: 0000 HMM_SOURCE_TYPE: SMTP X-189-SAVE-TO-SEND: +huangy81@chinatelecom.cn X-Transaction-ID: b40496a661684a608bc29feb678708b8 X-filter-score: filter<0> X-Real-From: huangy81@chinatelecom.cn X-Receive-IP: 172.18.0.48 X-MEDUSA-Status: 0 From: huangy81@chinatelecom.cn To: qemu-devel Subject: [PATCH v2] migration/dirtyrate: make sample page count configurable Date: Sun, 9 May 2021 12:59:39 +0800 Message-Id: <255a27d0f05053d56ae9e5920e815ab9b2bfdeee.1620536022.git.huangy81@chinatelecom.cn> X-Mailer: git-send-email 1.8.3.1 In-Reply-To: References: MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Received-SPF: pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; envelope-from=qemu-devel-bounces+importer=patchew.org@nongnu.org; helo=lists.gnu.org; Received-SPF: pass client-ip=42.123.76.220; envelope-from=huangy81@chinatelecom.cn; helo=chinatelecom.cn X-Spam_score_int: -18 X-Spam_score: -1.9 X-Spam_bar: - X-Spam_report: (-1.9 / 5.0 requ) BAYES_00=-1.9, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: =?UTF-8?q?Hyman=20Huang=28=E9=BB=84=E5=8B=87=29?= , "Dr. David Alan Gilbert" , Juan Quintela Errors-To: qemu-devel-bounces+importer=patchew.org@nongnu.org Sender: "Qemu-devel" From: Hyman Huang(=E9=BB=84=E5=8B=87) introduce optional sample-pages argument in calc-dirty-rate, making sample page count per GB configurable so that more accurate dirtyrate can be calculated. Signed-off-by: Hyman Huang(=E9=BB=84=E5=8B=87) --- migration/dirtyrate.c | 31 ++++++++++++++++--- migration/dirtyrate.h | 8 ++++- qapi/migration.json | 85 ++++++++++++++++++++++++++++-------------------= ---- 3 files changed, 80 insertions(+), 44 deletions(-) diff --git a/migration/dirtyrate.c b/migration/dirtyrate.c index ccb9814..2ee3890 100644 --- a/migration/dirtyrate.c +++ b/migration/dirtyrate.c @@ -48,6 +48,12 @@ static bool is_sample_period_valid(int64_t sec) return true; } =20 +static bool is_sample_pages_valid(int64_t pages) +{ + return pages >=3D MIN_SAMPLE_PAGE_COUNT && + pages <=3D MAX_SAMPLE_PAGE_COUNT; +} + static int dirtyrate_set_state(int *state, int old_state, int new_state) { assert(new_state < DIRTY_RATE_STATUS__MAX); @@ -72,13 +78,15 @@ static struct DirtyRateInfo *query_dirty_rate_info(void) info->status =3D CalculatingState; info->start_time =3D DirtyStat.start_time; info->calc_time =3D DirtyStat.calc_time; + info->sample_pages =3D DirtyStat.sample_pages; =20 trace_query_dirty_rate_info(DirtyRateStatus_str(CalculatingState)); =20 return info; } =20 -static void init_dirtyrate_stat(int64_t start_time, int64_t calc_time) +static void init_dirtyrate_stat(int64_t start_time, int64_t calc_time, + uint64_t sample_pages) { DirtyStat.total_dirty_samples =3D 0; DirtyStat.total_sample_count =3D 0; @@ -86,6 +94,7 @@ static void init_dirtyrate_stat(int64_t start_time, int64= _t calc_time) DirtyStat.dirty_rate =3D -1; DirtyStat.start_time =3D start_time; DirtyStat.calc_time =3D calc_time; + DirtyStat.sample_pages =3D sample_pages; } =20 static void update_dirtyrate_stat(struct RamblockDirtyInfo *info) @@ -361,6 +370,7 @@ void *get_dirtyrate_thread(void *arg) int ret; int64_t start_time; int64_t calc_time; + uint64_t sample_pages; =20 ret =3D dirtyrate_set_state(&CalculatingState, DIRTY_RATE_STATUS_UNSTA= RTED, DIRTY_RATE_STATUS_MEASURING); @@ -371,7 +381,8 @@ void *get_dirtyrate_thread(void *arg) =20 start_time =3D qemu_clock_get_ms(QEMU_CLOCK_REALTIME) / 1000; calc_time =3D config.sample_period_seconds; - init_dirtyrate_stat(start_time, calc_time); + sample_pages =3D config.sample_pages_per_gigabytes; + init_dirtyrate_stat(start_time, calc_time, sample_pages); =20 calculate_dirtyrate(config); =20 @@ -383,7 +394,8 @@ void *get_dirtyrate_thread(void *arg) return NULL; } =20 -void qmp_calc_dirty_rate(int64_t calc_time, Error **errp) +void qmp_calc_dirty_rate(int64_t calc_time, bool has_sample_pages, + int64_t sample_pages, Error **errp) { static struct DirtyRateConfig config; QemuThread thread; @@ -404,6 +416,17 @@ void qmp_calc_dirty_rate(int64_t calc_time, Error **er= rp) return; } =20 + if (has_sample_pages) { + if (!is_sample_pages_valid(sample_pages)) { + error_setg(errp, "sample-pages is out of range[%d, %d].", + MIN_SAMPLE_PAGE_COUNT, + MAX_SAMPLE_PAGE_COUNT); + return; + } + } else { + sample_pages =3D DIRTYRATE_DEFAULT_SAMPLE_PAGES; + } + /* * Init calculation state as unstarted. */ @@ -415,7 +438,7 @@ void qmp_calc_dirty_rate(int64_t calc_time, Error **err= p) } =20 config.sample_period_seconds =3D calc_time; - config.sample_pages_per_gigabytes =3D DIRTYRATE_DEFAULT_SAMPLE_PAGES; + config.sample_pages_per_gigabytes =3D sample_pages; qemu_thread_create(&thread, "get_dirtyrate", get_dirtyrate_thread, (void *)&config, QEMU_THREAD_DETACHED); } diff --git a/migration/dirtyrate.h b/migration/dirtyrate.h index 6ec4295..e1fd290 100644 --- a/migration/dirtyrate.h +++ b/migration/dirtyrate.h @@ -15,7 +15,6 @@ =20 /* * Sample 512 pages per GB as default. - * TODO: Make it configurable. */ #define DIRTYRATE_DEFAULT_SAMPLE_PAGES 512 =20 @@ -35,6 +34,12 @@ #define MIN_FETCH_DIRTYRATE_TIME_SEC 1 #define MAX_FETCH_DIRTYRATE_TIME_SEC 60 =20 +/* + * Take 1/16 pages in 1G as the maxmum sample page count + */ +#define MIN_SAMPLE_PAGE_COUNT 128 +#define MAX_SAMPLE_PAGE_COUNT 16384 + struct DirtyRateConfig { uint64_t sample_pages_per_gigabytes; /* sample pages per GB */ int64_t sample_period_seconds; /* time duration between two sampling */ @@ -63,6 +68,7 @@ struct DirtyRateStat { int64_t dirty_rate; /* dirty rate in MB/s */ int64_t start_time; /* calculation start time in units of second */ int64_t calc_time; /* time duration of two sampling in units of second= */ + uint64_t sample_pages; /* sample pages per GB */ }; =20 void *get_dirtyrate_thread(void *arg); diff --git a/qapi/migration.json b/qapi/migration.json index 0b17cce..b8f0bb5 100644 --- a/qapi/migration.json +++ b/qapi/migration.json @@ -1732,45 +1732,6 @@ 'data': [ 'unstarted', 'measuring', 'measured'] } =20 ## -# @DirtyRateInfo: -# -# Information about current dirty page rate of vm. -# -# @dirty-rate: an estimate of the dirty page rate of the VM in units of -# MB/s, present only when estimating the rate has completed. -# -# @status: status containing dirtyrate query status includes -# 'unstarted' or 'measuring' or 'measured' -# -# @start-time: start time in units of second for calculation -# -# @calc-time: time in units of second for sample dirty pages -# -# Since: 5.2 -# -## -{ 'struct': 'DirtyRateInfo', - 'data': {'*dirty-rate': 'int64', - 'status': 'DirtyRateStatus', - 'start-time': 'int64', - 'calc-time': 'int64'} } - -## -# @calc-dirty-rate: -# -# start calculating dirty page rate for vm -# -# @calc-time: time in units of second for sample dirty pages -# -# Since: 5.2 -# -# Example: -# {"command": "calc-dirty-rate", "data": {"calc-time": 1} } -# -## -{ 'command': 'calc-dirty-rate', 'data': {'calc-time': 'int64'} } - -## # @query-dirty-rate: # # query dirty page rate in units of MB/s for vm @@ -1951,3 +1912,49 @@ 'data': { 'job-id': 'str', 'tag': 'str', 'devices': ['str'] } } + +## +# @DirtyRateInfo: +# +# Information about current dirty page rate of vm. +# +# @dirty-rate: an estimate of the dirty page rate of the VM in units of +# MB/s, present only when estimating the rate has completed. +# +# @status: status containing dirtyrate query status includes +# 'unstarted' or 'measuring' or 'measured' +# +# @start-time: start time in units of second for calculation +# +# @calc-time: time in units of second for sample dirty pages +# +# @sample-pages: page count per GB for sample dirty pages +# the default value is 512 +# +# Since: 6.1 +# +## +{ 'struct': 'DirtyRateInfo', + 'data': {'*dirty-rate': 'int64', + 'status': 'DirtyRateStatus', + 'start-time': 'int64', + 'calc-time': 'int64', + 'sample-pages': 'uint64'} } + +## +# @calc-dirty-rate: +# +# start calculating dirty page rate for vm +# +# @calc-time: time in units of second for sample dirty pages +# +# @sample-pages: page count per GB for sample dirty pages +# the default value is 512 +# +# Since: 6.1 +# +# Example: +# {"command": "calc-dirty-rate", "data": {"calc-time": 1, 'sample-pages'= : 512} } +# +## +{ 'command': 'calc-dirty-rate', 'data': {'calc-time': 'int64', '*sample-pa= ges': 'int'} } --=20 1.8.3.1