From nobody Fri May 3 06:58:58 2024 Delivered-To: importer@patchew.org Received-SPF: pass (zoho.com: domain of gnu.org designates 208.118.235.17 as permitted sender) client-ip=208.118.235.17; envelope-from=qemu-devel-bounces+importer=patchew.org@nongnu.org; helo=lists.gnu.org; Authentication-Results: mx.zohomail.com; spf=pass (zoho.com: domain of gnu.org designates 208.118.235.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org Return-Path: Received: from lists.gnu.org (208.118.235.17 [208.118.235.17]) by mx.zohomail.com with SMTPS id 150832545788728.296136866895267; Wed, 18 Oct 2017 04:17:37 -0700 (PDT) Received: from localhost ([::1]:43860 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1e4mLg-0006OD-2S for importer@patchew.org; Wed, 18 Oct 2017 07:17:20 -0400 Received: from eggs.gnu.org ([2001:4830:134:3::10]:36103) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1e4mKn-00065g-Dy for qemu-devel@nongnu.org; Wed, 18 Oct 2017 07:16:26 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1e4mKk-0003vZ-4e for qemu-devel@nongnu.org; Wed, 18 Oct 2017 07:16:25 -0400 Received: from mx1.redhat.com ([209.132.183.28]:59700) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1e4mKj-0003uu-S4 for qemu-devel@nongnu.org; Wed, 18 Oct 2017 07:16:22 -0400 Received: from smtp.corp.redhat.com (int-mx01.intmail.prod.int.phx2.redhat.com [10.5.11.11]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.redhat.com (Postfix) with ESMTPS id F096B883BA for ; Wed, 18 Oct 2017 11:16:20 +0000 (UTC) Received: from localhost.localdomain (unknown [10.35.206.32]) by smtp.corp.redhat.com (Postfix) with ESMTP id A68957EA5F; Wed, 18 Oct 2017 11:16:13 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mx1.redhat.com F096B883BA Authentication-Results: ext-mx02.extmail.prod.ext.phx2.redhat.com; dmarc=none (p=none dis=none) header.from=redhat.com Authentication-Results: ext-mx02.extmail.prod.ext.phx2.redhat.com; spf=fail smtp.mailfrom=marcel@redhat.com From: Marcel Apfelbaum To: qemu-devel@nongnu.org Date: Wed, 18 Oct 2017 14:16:12 +0300 Message-Id: <20171018111612.112912-1-marcel@redhat.com> X-Scanned-By: MIMEDefang 2.79 on 10.5.11.11 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.5.110.26]); Wed, 18 Oct 2017 11:16:21 +0000 (UTC) X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] [fuzzy] X-Received-From: 209.132.183.28 Subject: [Qemu-devel] [PATCH V2] hw/pci-host: Fix x86 Host Bridges 64bit PCI hole X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: ehabkost@redhat.com, mst@redhat.com, imammedo@redhat.com, marcel@redhat.com, pbonzini@redhat.com, lersek@redhat.com Errors-To: qemu-devel-bounces+importer=patchew.org@nongnu.org Sender: "Qemu-devel" X-ZohoMail: RSF_0 Z_629925259 SPT_0 Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Currently there is no MMIO range over 4G reserved for PCI hotplug. Since the 32bit PCI hole depends on the number of cold-plugged PCI devices and other factors, it is very possible is too small to hotplug PCI devices with large BARs. Fix it by reserving all the address space after RAM (and the reserved space for RAM hotplug), but no more than 40bits. The later seems to be QEMU's magic number for the Guest physical CPU addressable bits and is safe with respect to migration. Note this is a regression since prev QEMU versions had some range reserved for 64bit PCI hotplug. Signed-off-by: Marcel Apfelbaum Reviewed-by: Igor Mammedov --- V1 -> V2: Addressed Igor's comments: - aligned the hole64 start to 1Gb (I think all the computations took care of it already, but it can't hurt) - Init compat props to "off" instead of "false" Thanks, Marcel hw/i386/pc.c | 22 ++++++++++++++++++++++ hw/pci-host/piix.c | 10 ++++++++++ hw/pci-host/q35.c | 9 +++++++++ include/hw/i386/pc.h | 10 ++++++++++ include/hw/pci-host/q35.h | 1 + 5 files changed, 52 insertions(+) diff --git a/hw/i386/pc.c b/hw/i386/pc.c index 05985d4927..d11eeacead 100644 --- a/hw/i386/pc.c +++ b/hw/i386/pc.c @@ -1448,6 +1448,28 @@ void pc_memory_init(PCMachineState *pcms, pcms->ioapic_as =3D &address_space_memory; } =20 +uint64_t pc_pci_hole64_start(void) +{ + PCMachineState *pcms =3D PC_MACHINE(qdev_get_machine()); + PCMachineClass *pcmc =3D PC_MACHINE_GET_CLASS(pcms); + uint64_t hole64_start =3D 0; + + if (pcmc->has_reserved_memory && pcms->hotplug_memory.base) { + hole64_start =3D pcms->hotplug_memory.base; + if (!pcmc->broken_reserved_end) { + hole64_start +=3D memory_region_size(&pcms->hotplug_memory.mr); + } + } else { + hole64_start =3D 0x100000000ULL + pcms->above_4g_mem_size; + } + + if (hole64_start > PCI_HOST_PCI_HOLE64_END) { + hole64_start =3D PCI_HOST_PCI_HOLE64_END; + } + + return ROUND_UP(hole64_start, 1ULL << 30); +} + qemu_irq pc_allocate_cpu_irq(void) { return qemu_allocate_irq(pic_irq_request, NULL, 0); diff --git a/hw/pci-host/piix.c b/hw/pci-host/piix.c index dec345fd24..317a232972 100644 --- a/hw/pci-host/piix.c +++ b/hw/pci-host/piix.c @@ -50,6 +50,7 @@ typedef struct I440FXState { PCIHostState parent_obj; Range pci_hole; uint64_t pci_hole64_size; + bool pci_hole64_fix; uint32_t short_root_bus; } I440FXState; =20 @@ -243,11 +244,15 @@ static void i440fx_pcihost_get_pci_hole64_start(Objec= t *obj, Visitor *v, void *opaque, Error **errp) { PCIHostState *h =3D PCI_HOST_BRIDGE(obj); + I440FXState *s =3D I440FX_PCI_HOST_BRIDGE(obj); Range w64; uint64_t value; =20 pci_bus_get_w64_range(h->bus, &w64); value =3D range_is_empty(&w64) ? 0 : range_lob(&w64); + if (!value && s->pci_hole64_fix) { + value =3D pc_pci_hole64_start(); + } visit_type_uint64(v, name, &value, errp); } =20 @@ -256,11 +261,15 @@ static void i440fx_pcihost_get_pci_hole64_end(Object = *obj, Visitor *v, Error **errp) { PCIHostState *h =3D PCI_HOST_BRIDGE(obj); + I440FXState *s =3D I440FX_PCI_HOST_BRIDGE(obj); Range w64; uint64_t value; =20 pci_bus_get_w64_range(h->bus, &w64); value =3D range_is_empty(&w64) ? 0 : range_upb(&w64) + 1; + if (s->pci_hole64_fix && value < PCI_HOST_PCI_HOLE64_END) { + value =3D PCI_HOST_PCI_HOLE64_END; + } visit_type_uint64(v, name, &value, errp); } =20 @@ -857,6 +866,7 @@ static Property i440fx_props[] =3D { DEFINE_PROP_SIZE(PCI_HOST_PROP_PCI_HOLE64_SIZE, I440FXState, pci_hole64_size, DEFAULT_PCI_HOLE64_SIZE), DEFINE_PROP_UINT32("short_root_bus", I440FXState, short_root_bus, 0), + DEFINE_PROP_BOOL("x-pci-hole64-fix", I440FXState, pci_hole64_fix, true= ), DEFINE_PROP_END_OF_LIST(), }; =20 diff --git a/hw/pci-host/q35.c b/hw/pci-host/q35.c index 1ff648e80c..641213f177 100644 --- a/hw/pci-host/q35.c +++ b/hw/pci-host/q35.c @@ -104,11 +104,15 @@ static void q35_host_get_pci_hole64_start(Object *obj= , Visitor *v, Error **errp) { PCIHostState *h =3D PCI_HOST_BRIDGE(obj); + Q35PCIHost *s =3D Q35_HOST_DEVICE(obj); Range w64; uint64_t value; =20 pci_bus_get_w64_range(h->bus, &w64); value =3D range_is_empty(&w64) ? 0 : range_lob(&w64); + if (!value && s->pci_hole64_fix) { + value =3D pc_pci_hole64_start(); + } visit_type_uint64(v, name, &value, errp); } =20 @@ -117,11 +121,15 @@ static void q35_host_get_pci_hole64_end(Object *obj, = Visitor *v, Error **errp) { PCIHostState *h =3D PCI_HOST_BRIDGE(obj); + Q35PCIHost *s =3D Q35_HOST_DEVICE(obj); Range w64; uint64_t value; =20 pci_bus_get_w64_range(h->bus, &w64); value =3D range_is_empty(&w64) ? 0 : range_upb(&w64) + 1; + if (s->pci_hole64_fix && value < PCI_HOST_PCI_HOLE64_END) { + value =3D PCI_HOST_PCI_HOLE64_END; + } visit_type_uint64(v, name, &value, errp); } =20 @@ -143,6 +151,7 @@ static Property q35_host_props[] =3D { mch.below_4g_mem_size, 0), DEFINE_PROP_SIZE(PCI_HOST_ABOVE_4G_MEM_SIZE, Q35PCIHost, mch.above_4g_mem_size, 0), + DEFINE_PROP_BOOL("x-pci-hole64-fix", Q35PCIHost, pci_hole64_fix, true), DEFINE_PROP_END_OF_LIST(), }; =20 diff --git a/include/hw/i386/pc.h b/include/hw/i386/pc.h index 087d184ef5..82ea8f67f4 100644 --- a/include/hw/i386/pc.h +++ b/include/hw/i386/pc.h @@ -239,6 +239,7 @@ void pc_guest_info_init(PCMachineState *pcms); #define PCI_HOST_BELOW_4G_MEM_SIZE "below-4g-mem-size" #define PCI_HOST_ABOVE_4G_MEM_SIZE "above-4g-mem-size" #define DEFAULT_PCI_HOLE64_SIZE (~0x0ULL) +#define PCI_HOST_PCI_HOLE64_END (0x1ULL << 40) =20 =20 void pc_pci_as_mapping_init(Object *owner, MemoryRegion *system_memory, @@ -249,6 +250,7 @@ void pc_memory_init(PCMachineState *pcms, MemoryRegion *system_memory, MemoryRegion *rom_memory, MemoryRegion **ram_memory); +uint64_t pc_pci_hole64_start(void); qemu_irq pc_allocate_cpu_irq(void); DeviceState *pc_vga_init(ISABus *isa_bus, PCIBus *pci_bus); void pc_basic_device_init(ISABus *isa_bus, qemu_irq *gsi, @@ -375,6 +377,14 @@ bool e820_get_entry(int, uint32_t, uint64_t *, uint64_= t *); .driver =3D TYPE_X86_CPU,\ .property =3D "x-hv-max-vps",\ .value =3D "0x40",\ + },{\ + .driver =3D "i440FX-pcihost",\ + .property =3D "x-pci-hole64-fix",\ + .value =3D "off",\ + },{\ + .driver =3D "q35-pcihost",\ + .property =3D "x-pci-hole64-fix",\ + .value =3D "off",\ }, =20 #define PC_COMPAT_2_9 \ diff --git a/include/hw/pci-host/q35.h b/include/hw/pci-host/q35.h index 58983c00b3..8f4ddde393 100644 --- a/include/hw/pci-host/q35.h +++ b/include/hw/pci-host/q35.h @@ -68,6 +68,7 @@ typedef struct Q35PCIHost { PCIExpressHost parent_obj; /*< public >*/ =20 + bool pci_hole64_fix; MCHPCIState mch; } Q35PCIHost; =20 --=20 2.13.5