From nobody Tue Nov 11 15:56:11 2025 Delivered-To: importer@patchew.org Received-SPF: pass (zoho.com: domain of gnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; envelope-from=qemu-devel-bounces+importer=patchew.org@nongnu.org; helo=lists.gnu.org; Authentication-Results: mx.zohomail.com; spf=pass (zoho.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; dmarc=fail(p=none dis=none) header.from=redhat.com ARC-Seal: i=1; a=rsa-sha256; t=1564411992; cv=none; d=zoho.com; s=zohoarc; b=JdswYKdEm580YpZHZs7X/X/rLuzDuq2yoXhQdZZgymFYBaoaV4/WHBDz+KTBxKJN+w4RXSEdjmUsuHcyRQcbW/zC5YJ4HNflikyn0fSYqMAnngdxaxZQ74EGeJUueyq/N+1uo9dl1BaOBX1QzoJqOhLzEtpTHiH012QrWv5dQZM= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zoho.com; s=zohoarc; t=1564411992; h=Cc:Date:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Archive:List-Help:List-Unsubscribe:Message-ID:References:Sender:Subject:To:ARC-Authentication-Results; bh=c/m1sDgNc3HC/8V4Fux9Xv9u8Gxk8vBiyFZlgQO2OY0=; b=i8xTs4H1Bx4Rzviy96WYl/b9l9Yvc5oQOWLVXzs/jm2c+gnoNQAfouJ6WtA052AtqLjBTNqULu+9HgPWNR9SksXrdd718AzKHFxiT7Wt4Kz5JVF5JKNeYRJbrGABjzwq96WjPEGY0Ijs5IeAcWM4JOmK/vtrdcD1Ps0DN/GF7i4= ARC-Authentication-Results: i=1; mx.zoho.com; spf=pass (zoho.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; dmarc=fail header.from= (p=none dis=none) header.from= Return-Path: Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) by mx.zohomail.com with SMTPS id 1564411992946913.6278675424028; Mon, 29 Jul 2019 07:53:12 -0700 (PDT) Received: from localhost ([::1]:52802 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.86_2) (envelope-from ) id 1hs71T-0000MU-SF for importer@patchew.org; Mon, 29 Jul 2019 10:53:11 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:36390) by lists.gnu.org with esmtp (Exim 4.86_2) (envelope-from ) id 1hs70w-0007yu-7s for qemu-devel@nongnu.org; Mon, 29 Jul 2019 10:52:39 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1hs70v-0000Si-9w for qemu-devel@nongnu.org; Mon, 29 Jul 2019 10:52:38 -0400 Received: from mx1.redhat.com ([209.132.183.28]:60604) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1hs70v-0000SP-5A; Mon, 29 Jul 2019 10:52:37 -0400 Received: from smtp.corp.redhat.com (int-mx04.intmail.prod.int.phx2.redhat.com [10.5.11.14]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.redhat.com (Postfix) with ESMTPS id 7EBFB308427D; Mon, 29 Jul 2019 14:52:36 +0000 (UTC) Received: from dell-r430-03.lab.eng.brq.redhat.com (dell-r430-03.lab.eng.brq.redhat.com [10.37.153.18]) by smtp.corp.redhat.com (Postfix) with ESMTP id 85F835D9C8; Mon, 29 Jul 2019 14:52:35 +0000 (UTC) From: Igor Mammedov To: qemu-devel@nongnu.org Date: Mon, 29 Jul 2019 10:52:28 -0400 Message-Id: <20190729145229.4333-2-imammedo@redhat.com> In-Reply-To: <20190729145229.4333-1-imammedo@redhat.com> References: <20190729145229.4333-1-imammedo@redhat.com> X-Scanned-By: MIMEDefang 2.79 on 10.5.11.14 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.5.110.40]); Mon, 29 Jul 2019 14:52:36 +0000 (UTC) X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 209.132.183.28 Subject: [Qemu-devel] [PATCH RFC 1/2] memory: make MemoryRegion alias migratable X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: pbonzini@redhat.com, qemu-s390x@nongnu.org, dgilbert@redhat.com Errors-To: qemu-devel-bounces+importer=patchew.org@nongnu.org Sender: "Qemu-devel" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" use qemu_ram_alloc_from_ptr() to create aliased RAMBlock to the part of original memory region. Signed-off-by: Igor Mammedov --- exec.c | 7 ++++--- memory.c | 5 +++++ 2 files changed, 9 insertions(+), 3 deletions(-) diff --git a/exec.c b/exec.c index 3e78de3b8f..daef0cd54f 100644 --- a/exec.c +++ b/exec.c @@ -2313,7 +2313,7 @@ static void ram_block_add(RAMBlock *new_block, Error = **errp, bool shared) new_block->used_length, DIRTY_CLIENTS_ALL); =20 - if (new_block->host) { + if (new_block->host && !new_block->mr->alias) { qemu_ram_setup_dump(new_block->host, new_block->max_length); qemu_madvise(new_block->host, new_block->max_length, QEMU_MADV_HUG= EPAGE); /* MADV_DONTFORK is also needed by KVM in absence of synchronous M= MU */ @@ -2671,7 +2671,8 @@ RAMBlock *qemu_ram_block_from_host(void *ptr, bool ro= und_offset, =20 rcu_read_lock(); block =3D atomic_rcu_read(&ram_list.mru_block); - if (block && block->host && host - block->host < block->max_length) { + if (block && !block->mr->alias && block->host && + host - block->host < block->max_length) { goto found; } =20 @@ -2680,7 +2681,7 @@ RAMBlock *qemu_ram_block_from_host(void *ptr, bool ro= und_offset, if (block->host =3D=3D NULL) { continue; } - if (host - block->host < block->max_length) { + if (!block->mr->alias && host - block->host < block->max_length) { goto found; } } diff --git a/memory.c b/memory.c index 5d8c9a9234..d710c17a26 100644 --- a/memory.c +++ b/memory.c @@ -1678,6 +1678,11 @@ void memory_region_init_alias(MemoryRegion *mr, memory_region_init(mr, owner, name, size); mr->alias =3D orig; mr->alias_offset =3D offset; + if (orig->ram_block && size) { + mr->ram_block =3D qemu_ram_alloc_from_ptr(size, + orig->ram_block->host + of= fset, + mr, &error_fatal); + } } =20 void memory_region_init_rom_nomigrate(MemoryRegion *mr, --=20 2.18.1 From nobody Tue Nov 11 15:56:11 2025 Delivered-To: importer@patchew.org Received-SPF: pass (zoho.com: domain of gnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; envelope-from=qemu-devel-bounces+importer=patchew.org@nongnu.org; helo=lists.gnu.org; Authentication-Results: mx.zohomail.com; spf=pass (zoho.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; dmarc=fail(p=none dis=none) header.from=redhat.com ARC-Seal: i=1; a=rsa-sha256; t=1564411995; cv=none; d=zoho.com; s=zohoarc; b=gSq2xz3vFqi1+P1S8dp2VjxNAhyNhArCTWZg2QKebv/y4MZkWhbiqhIaRkI01XJQiXbyzqS+z6LyYM56fKoMDSTOIsYFdb7LjUHM1wG83hiw9d5T7lzJvA74q0DQ8rghUYl19eVZ+7fTY22R0Mh0NyB9onLQAqM6wM7/ywtYkLc= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zoho.com; s=zohoarc; t=1564411995; h=Cc:Date:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Archive:List-Help:List-Unsubscribe:Message-ID:References:Sender:Subject:To:ARC-Authentication-Results; bh=5UjI3jP6Qy4ztSHh+yMwKgLXoBGltUTbMnMAMtQukw0=; b=OCJWfceTrkicicWv2u0SWEROvCYi0XMNppnRoYSeF0WdPxstubzyqaq42OKsREUw5OSuiAj3doSpU22B33hE4L/dBw1w4/xS+B80YDzV2qEuE/JiwPFb41W82tCZ7V0Fiiuw2OIlBkxlQlEko/kTxElmb8J0HOFe4Ex0nkKWXbs= ARC-Authentication-Results: i=1; mx.zoho.com; spf=pass (zoho.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; dmarc=fail header.from= (p=none dis=none) header.from= Return-Path: Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) by mx.zohomail.com with SMTPS id 1564411995304459.14598627785165; Mon, 29 Jul 2019 07:53:15 -0700 (PDT) Received: from localhost ([::1]:52804 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.86_2) (envelope-from ) id 1hs71W-0000SE-D7 for importer@patchew.org; Mon, 29 Jul 2019 10:53:14 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:36412) by lists.gnu.org with esmtp (Exim 4.86_2) (envelope-from ) id 1hs70x-0007z7-LN for qemu-devel@nongnu.org; Mon, 29 Jul 2019 10:52:40 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1hs70w-0000TQ-KR for qemu-devel@nongnu.org; Mon, 29 Jul 2019 10:52:39 -0400 Received: from mx1.redhat.com ([209.132.183.28]:34478) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1hs70w-0000Sw-DR; Mon, 29 Jul 2019 10:52:38 -0400 Received: from smtp.corp.redhat.com (int-mx04.intmail.prod.int.phx2.redhat.com [10.5.11.14]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.redhat.com (Postfix) with ESMTPS id B990E307CDFC; Mon, 29 Jul 2019 14:52:37 +0000 (UTC) Received: from dell-r430-03.lab.eng.brq.redhat.com (dell-r430-03.lab.eng.brq.redhat.com [10.37.153.18]) by smtp.corp.redhat.com (Postfix) with ESMTP id C2F145D9C8; Mon, 29 Jul 2019 14:52:36 +0000 (UTC) From: Igor Mammedov To: qemu-devel@nongnu.org Date: Mon, 29 Jul 2019 10:52:29 -0400 Message-Id: <20190729145229.4333-3-imammedo@redhat.com> In-Reply-To: <20190729145229.4333-1-imammedo@redhat.com> References: <20190729145229.4333-1-imammedo@redhat.com> X-Scanned-By: MIMEDefang 2.79 on 10.5.11.14 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.5.110.49]); Mon, 29 Jul 2019 14:52:37 +0000 (UTC) X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 209.132.183.28 Subject: [Qemu-devel] [PATCH RFC 2/2] s390: do not call memory_region_allocate_system_memory() multiple times X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: pbonzini@redhat.com, qemu-s390x@nongnu.org, dgilbert@redhat.com Errors-To: qemu-devel-bounces+importer=patchew.org@nongnu.org Sender: "Qemu-devel" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" s390 was trying to solve limited KVM memslot size issue by abusing memory_region_allocate_system_memory(), which breaks API contract where the function might be called only once. s390 should have used memory aliases to fragment inital memory into smaller chunks to satisfy KVM's memslot limitation. But its a bit late now, since allocated pieces are transfered in migration stream separately, so it's not possible to just replace broken layout with correct one. To workaround previous patch made MemoryRegion alases migratable and this patch switches to use them to split big initial RAM chunk into smaller pieces up to KVM_SLOT_MAX_BYTES each and registers aliases for migration. That should keep migration and guest ABI (RAM mapping) compatible with previous QEMU versions. Signed-off-by: Igor Mammedov --- I don't have access to a suitable system to test it, so I've simulated it with smaller chunks on x84 host. Ping-pong migration between old and new QEMU worked fine. KVM part should be fine as memslots using mapped MemoryRegions (in this case it would be aliases) as far as I know but is someone could test it on big enough host it would be nice. --- hw/s390x/s390-virtio-ccw.c | 20 +++++++++++++++----- 1 file changed, 15 insertions(+), 5 deletions(-) diff --git a/hw/s390x/s390-virtio-ccw.c b/hw/s390x/s390-virtio-ccw.c index 5b6a9a4e55..77910419e6 100644 --- a/hw/s390x/s390-virtio-ccw.c +++ b/hw/s390x/s390-virtio-ccw.c @@ -163,21 +163,31 @@ static void virtio_ccw_register_hcalls(void) static void s390_memory_init(ram_addr_t mem_size) { MemoryRegion *sysmem =3D get_system_memory(); + MemoryRegion *ram =3D g_new(MemoryRegion, 1); ram_addr_t chunk, offset =3D 0; unsigned int number =3D 0; Error *local_err =3D NULL; gchar *name; =20 /* allocate RAM for core */ + memory_region_allocate_system_memory(ram, NULL, "s390.whole.ram", mem_= size); + /* + * memory_region_allocate_system_memory() registers allocated RAM for + * migration, however for compat reasons the RAM should be passed over + * as RAMBlocks of the size upto KVM_SLOT_MAX_BYTES. So unregister just + * allocated RAM so it won't be migrated directly. Aliases will take c= are + * of segmenting RAM into legacy chunks that migration and KVM compati= ble. + */ + vmstate_unregister_ram(ram, NULL); name =3D g_strdup_printf("s390.ram"); while (mem_size) { - MemoryRegion *ram =3D g_new(MemoryRegion, 1); - uint64_t size =3D mem_size; + MemoryRegion *alias =3D g_new(MemoryRegion, 1); =20 /* KVM does not allow memslots >=3D 8 TB */ - chunk =3D MIN(size, KVM_SLOT_MAX_BYTES); - memory_region_allocate_system_memory(ram, NULL, name, chunk); - memory_region_add_subregion(sysmem, offset, ram); + chunk =3D MIN(mem_size, KVM_SLOT_MAX_BYTES); + memory_region_init_alias(alias, NULL, name, ram, offset, chunk); + vmstate_register_ram_global(alias); + memory_region_add_subregion(sysmem, offset, alias); mem_size -=3D chunk; offset +=3D chunk; g_free(name); --=20 2.18.1