From nobody Wed May 8 11:31:14 2024 Delivered-To: importer@patchew.org Authentication-Results: mx.zohomail.com; dkim=pass; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; dmarc=pass(p=none dis=none) header.from=redhat.com ARC-Seal: i=1; a=rsa-sha256; t=1633424147; cv=none; d=zohomail.com; s=zohoarc; b=d7D+u5UNwqm1x+4AhGdymE3nIr7QVMgB8zsn9QC+F3PfT+BLkRvwmMFzA+9Js7O7PIF6bNMQdmE9qJ2by8HWFjZJGhX2mTpxGIgbgSzpzGVURL89kz06NNhkdkVNMeOlyAVvWoQkGOYtrggwoM7rqn6P+X/pP34I5SuxObzqBuI= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1633424147; h=Content-Type:Content-Transfer-Encoding:Cc:Date:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Archive:List-Help:List-Unsubscribe:MIME-Version:Message-ID:References:Sender:Subject:To; bh=wFF9WCg6eW0t4jCJokyRdtkGwM3wwBPBTh6l2Ycdux4=; b=KkMNeOV5X4bcjPUwIjheMIMFhWo4kTYpOy75/joyJ3EbqFHelKNZ2yMePJTr5soM89nY33NYsneosIIS2u/8Izwdw6Vqg6PbgtGPeccPVfr89ChRPVDPFrvf4BWt8UJIOkp3AuudqwrSNdqUgVXDAyPJFvXbwiK5E/jetqPLL/g= ARC-Authentication-Results: i=1; mx.zohomail.com; dkim=pass; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; dmarc=pass header.from= (p=none dis=none) Return-Path: Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) by mx.zohomail.com with SMTPS id 1633424147301260.9425434767521; Tue, 5 Oct 2021 01:55:47 -0700 (PDT) Received: from localhost ([::1]:40056 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1mXgEk-0001aT-9I for importer@patchew.org; Tue, 05 Oct 2021 04:55:46 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:57226) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mXgCa-0007gg-Uh for qemu-devel@nongnu.org; Tue, 05 Oct 2021 04:53:33 -0400 Received: from us-smtp-delivery-124.mimecast.com ([170.10.129.124]:40267) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mXgCZ-0007RW-Bf for qemu-devel@nongnu.org; Tue, 05 Oct 2021 04:53:32 -0400 Received: from mimecast-mx01.redhat.com (mimecast-mx01.redhat.com [209.132.183.4]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-21--pgYKao-MjKl9aBW7g73AA-1; Tue, 05 Oct 2021 04:53:28 -0400 Received: from smtp.corp.redhat.com (int-mx03.intmail.prod.int.phx2.redhat.com [10.5.11.13]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx01.redhat.com (Postfix) with ESMTPS id 5C4081006AA3; Tue, 5 Oct 2021 08:53:27 +0000 (UTC) Received: from laptop.redhat.com (unknown [10.39.192.236]) by smtp.corp.redhat.com (Postfix) with ESMTP id 7169F60843; Tue, 5 Oct 2021 08:53:24 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1633424009; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=wFF9WCg6eW0t4jCJokyRdtkGwM3wwBPBTh6l2Ycdux4=; b=QqjQLaY4JQ2ggqDJ7CJc/kGhi7V3jq5MeMQokds0Kl0/X2ye+Sg0bEMMs+SzYJ0uofn/tp FllXfw+kAYVDTRhSJxKdTfZH7fOedRW9KG8A7ww1z2cO4vQiHN4xXy7JFQLrPSTv5rPyqg nfGy9IlZ9r0gFuK4Hv+nzMMOnqxCInY= X-MC-Unique: -pgYKao-MjKl9aBW7g73AA-1 From: Eric Auger To: eric.auger.pro@gmail.com, eric.auger@redhat.com, imammedo@redhat.com, philmd@redhat.com, peter.maydell@linaro.org, shannon.zhaosl@gmail.com, shameerali.kolothum.thodi@huawei.com, ardb@kernel.org, jean-philippe@linaro.org, qemu-arm@nongnu.org, qemu-devel@nongnu.org, drjones@redhat.com Subject: [RFC v2 1/2] hw/pci-host/gpex: Allow to generate preserve boot config DSM #5 Date: Tue, 5 Oct 2021 10:53:12 +0200 Message-Id: <20211005085313.493858-2-eric.auger@redhat.com> In-Reply-To: <20211005085313.493858-1-eric.auger@redhat.com> References: <20211005085313.493858-1-eric.auger@redhat.com> MIME-Version: 1.0 X-Scanned-By: MIMEDefang 2.79 on 10.5.11.13 Authentication-Results: relay.mimecast.com; auth=pass smtp.auth=CUSA124A263 smtp.mailfrom=eric.auger@redhat.com X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Transfer-Encoding: quoted-printable Received-SPF: pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; envelope-from=qemu-devel-bounces+importer=patchew.org@nongnu.org; helo=lists.gnu.org; Received-SPF: pass client-ip=170.10.129.124; envelope-from=eric.auger@redhat.com; helo=us-smtp-delivery-124.mimecast.com X-Spam_score_int: -28 X-Spam_score: -2.9 X-Spam_bar: -- X-Spam_report: (-2.9 / 5.0 requ) BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.066, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H4=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: gshan@redhat.com Errors-To: qemu-devel-bounces+importer=patchew.org@nongnu.org Sender: "Qemu-devel" X-ZohoMail-DKIM: pass (identity @redhat.com) X-ZM-MESSAGEID: 1633424149390100001 Content-Type: text/plain; charset="utf-8" Add a 'preserve_config' field in struct GPEXConfig and if set generate the DSM #5 for preserving PCI boot configurations. The DSM presence is needed to expose RMRs. At the moment the DSM generation is not yet enabled. Signed-off-by: Eric Auger --- include/hw/pci-host/gpex.h | 1 + hw/pci-host/gpex-acpi.c | 12 ++++++++++++ 2 files changed, 13 insertions(+) diff --git a/include/hw/pci-host/gpex.h b/include/hw/pci-host/gpex.h index fcf8b63820..3f8f8ec38d 100644 --- a/include/hw/pci-host/gpex.h +++ b/include/hw/pci-host/gpex.h @@ -64,6 +64,7 @@ struct GPEXConfig { MemMapEntry pio; int irq; PCIBus *bus; + bool preserve_config; }; =20 int gpex_set_irq_num(GPEXHost *s, int index, int gsi); diff --git a/hw/pci-host/gpex-acpi.c b/hw/pci-host/gpex-acpi.c index e7e162a00a..7dab259379 100644 --- a/hw/pci-host/gpex-acpi.c +++ b/hw/pci-host/gpex-acpi.c @@ -164,6 +164,12 @@ void acpi_dsdt_add_gpex(Aml *scope, struct GPEXConfig = *cfg) aml_append(dev, aml_name_decl("_PXM", aml_int(numa_node))); } =20 + if (cfg->preserve_config) { + method =3D aml_method("_DSM", 5, AML_SERIALIZED); + aml_append(method, aml_return(aml_int(0))); + aml_append(dev, method); + } + acpi_dsdt_add_pci_route_table(dev, cfg->irq); =20 /* @@ -191,6 +197,12 @@ void acpi_dsdt_add_gpex(Aml *scope, struct GPEXConfig = *cfg) aml_append(dev, aml_name_decl("_STR", aml_unicode("PCIe 0 Device"))); aml_append(dev, aml_name_decl("_CCA", aml_int(1))); =20 + if (cfg->preserve_config) { + method =3D aml_method("_DSM", 5, AML_SERIALIZED); + aml_append(method, aml_return(aml_int(0))); + aml_append(dev, method); + } + acpi_dsdt_add_pci_route_table(dev, cfg->irq); =20 method =3D aml_method("_CBA", 0, AML_NOTSERIALIZED); --=20 2.26.3 From nobody Wed May 8 11:31:14 2024 Delivered-To: importer@patchew.org Authentication-Results: mx.zohomail.com; dkim=pass; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; dmarc=pass(p=none dis=none) header.from=redhat.com ARC-Seal: i=1; a=rsa-sha256; t=1633424763; cv=none; d=zohomail.com; s=zohoarc; b=hKuWsoinpTdcW3+1A3fLLQuhU2s595KgpEg0DzxutpUKST/qFjzWuM5/aw2XzB2XHH6xzcHwxY/gRE13ZtobIve3d0lTtBcY8QuN7V3NWbGa2VxCIfr5hSTOLlNhNGBaB8wXcQ2W6d3O4GAnj/2x98kDWZT1Yn6GSk0I6Bncs68= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1633424763; h=Content-Type:Content-Transfer-Encoding:Cc:Date:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Archive:List-Help:List-Unsubscribe:MIME-Version:Message-ID:References:Sender:Subject:To; bh=Zo/avjgEO+kgqlLXIvhQvoMzovaLg8TIkxTOLsrCIy0=; b=X/vgf48SIQXoOAE7D7WT4UZ7nRFsybeFCcM/5fFoNESb7NwmAVa0VjO8wtDZPjoLnUgJqP78Hqg5jr3PQcXBGAKcc/xOa6swSpeXvUaai5MeSWAzvx3Y9WDE6w4Z3QFE78RhU8WGPgiToKBnPsXBWiWpVkSbMAoWwvdT9H/SY3o= ARC-Authentication-Results: i=1; mx.zohomail.com; dkim=pass; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; dmarc=pass header.from= (p=none dis=none) Return-Path: Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) by mx.zohomail.com with SMTPS id 1633424763990499.3789934128595; Tue, 5 Oct 2021 02:06:03 -0700 (PDT) Received: from localhost ([::1]:56956 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1mXgOg-0004ro-HB for importer@patchew.org; Tue, 05 Oct 2021 05:06:02 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:57272) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mXgCh-0007mw-0d for qemu-devel@nongnu.org; Tue, 05 Oct 2021 04:53:39 -0400 Received: from us-smtp-delivery-124.mimecast.com ([216.205.24.124]:25441) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mXgCc-0007Vg-J5 for qemu-devel@nongnu.org; Tue, 05 Oct 2021 04:53:37 -0400 Received: from mimecast-mx01.redhat.com (mimecast-mx01.redhat.com [209.132.183.4]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-391-aFJnMD9eO1yd3WCkASznIg-1; Tue, 05 Oct 2021 04:53:33 -0400 Received: from smtp.corp.redhat.com (int-mx03.intmail.prod.int.phx2.redhat.com [10.5.11.13]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx01.redhat.com (Postfix) with ESMTPS id 6C9FF19057A0; Tue, 5 Oct 2021 08:53:31 +0000 (UTC) Received: from laptop.redhat.com (unknown [10.39.192.236]) by smtp.corp.redhat.com (Postfix) with ESMTP id B632460843; Tue, 5 Oct 2021 08:53:27 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1633424013; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Zo/avjgEO+kgqlLXIvhQvoMzovaLg8TIkxTOLsrCIy0=; b=Xhl3cuspfMenp4s+iYbX+7ScUqr2WDKh24y/7WHUqVp1+7eEgJgCtbImGyImSLtqvMht9p fGdj1GJbMyONbnkYUEo1BJ0dylYVnm6Eay27jHFo1/6uuoY4S8CawTTutuTjgCGMWC/oO8 JjQZfdOwfaf3fyOFqK5jKSUsegzrEbI= X-MC-Unique: aFJnMD9eO1yd3WCkASznIg-1 From: Eric Auger To: eric.auger.pro@gmail.com, eric.auger@redhat.com, imammedo@redhat.com, philmd@redhat.com, peter.maydell@linaro.org, shannon.zhaosl@gmail.com, shameerali.kolothum.thodi@huawei.com, ardb@kernel.org, jean-philippe@linaro.org, qemu-arm@nongnu.org, qemu-devel@nongnu.org, drjones@redhat.com Subject: [RFC v2 2/2] hw/arm/virt-acpi-build: Add IORT RMR regions to handle MSI nested binding Date: Tue, 5 Oct 2021 10:53:13 +0200 Message-Id: <20211005085313.493858-3-eric.auger@redhat.com> In-Reply-To: <20211005085313.493858-1-eric.auger@redhat.com> References: <20211005085313.493858-1-eric.auger@redhat.com> MIME-Version: 1.0 X-Scanned-By: MIMEDefang 2.79 on 10.5.11.13 Authentication-Results: relay.mimecast.com; auth=pass smtp.auth=CUSA124A263 smtp.mailfrom=eric.auger@redhat.com X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Transfer-Encoding: quoted-printable Received-SPF: pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; envelope-from=qemu-devel-bounces+importer=patchew.org@nongnu.org; helo=lists.gnu.org; Received-SPF: pass client-ip=216.205.24.124; envelope-from=eric.auger@redhat.com; helo=us-smtp-delivery-124.mimecast.com X-Spam_score_int: -28 X-Spam_score: -2.9 X-Spam_bar: -- X-Spam_report: (-2.9 / 5.0 requ) BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.066, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=unavailable autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: gshan@redhat.com Errors-To: qemu-devel-bounces+importer=patchew.org@nongnu.org Sender: "Qemu-devel" X-ZohoMail-DKIM: pass (identity @redhat.com) X-ZM-MESSAGEID: 1633424765964100001 Content-Type: text/plain; charset="utf-8" To handle SMMUv3 nested stage support it is practical to expose the guest with reserved memory regions (RMRs) covering the IOVAs used by the host kernel to map physical MSI doorbells. Those IOVAs belong to [0x8000000, 0x8100000] matching MSI_IOVA_BASE and MSI_IOVA_LENGTH definitions in kernel arm-smmu-v3 driver. This is the window used to allocate IOVAs matching physical MSI doorbells. With those RMRs, the guest is forced to use a flat mapping for this range. Hence the assigned device is programmed with one IOVA from this range. Stage 1, owned by the guest has a flat mapping for this IOVA. Stage2, owned by the VMM then enforces a mapping from this IOVA to the physical MSI doorbell. At IORT table level, due to the single mapping flag being set on the ID mapping, 256 IORT RMR nodes need to be created per bus. This looks awkward from a specification and implementation point of view. This may also produce a warning at execution time: qemu-system-aarch64: warning: ACPI table size 114709 exceeds 65536 bytes, migration may not work (here with 5 pcie root ports, ie. 256 * 6 =3D 1536 RMR nodes!). The creation of those RMR nodes only is relevant if nested stage SMMU is in use, along with VFIO. As VFIO devices can be hotplugged, all RMRs need to be created in advance. Hence the patch introduces a new arm virt "nested-smmuv3" iommu type. ARM DEN 0049E.b IORT specification also mandates that when RMRs are present, the OS must preserve PCIe configuration performed by the boot FW. So along with the RMR IORT nodes, a _DSM function #5, as defined by PCI FIRMWARE SPECIFICATION EVISION 3.3, chapter 4.6.5 is added to PCIe host bridge and PCIe expander bridge objects. Signed-off-by: Eric Auger Suggested-by: Jean-Philippe Brucker --- v1 -> v2: - add DSM #5 - use identifier increment Instead of introducing a new IOMMU type, we could introduce an array of qdev_prop_reserved_region(s). Guest can parse the IORT RMR nodes with Shammer's series: [PATCH v7 0/9] ACPI/IORT: Support for IORT RMR node The patch applies on Igor's v4 series [1]+ IORT E.b upgrade [2] [1] [PATCH v4 00/35] acpi: refactor error prone build_header() and packed structures usage in ACPI tables [2] [PATCH 0/3] hw/arm/virt_acpi_build: Upgrate the IORT table up to revision E.b --- include/hw/arm/virt.h | 7 ++++ hw/arm/virt-acpi-build.c | 84 ++++++++++++++++++++++++++++++++++------ hw/arm/virt.c | 7 +++- 3 files changed, 85 insertions(+), 13 deletions(-) diff --git a/include/hw/arm/virt.h b/include/hw/arm/virt.h index b461b8d261..f2f8aee219 100644 --- a/include/hw/arm/virt.h +++ b/include/hw/arm/virt.h @@ -99,6 +99,7 @@ enum { typedef enum VirtIOMMUType { VIRT_IOMMU_NONE, VIRT_IOMMU_SMMUV3, + VIRT_IOMMU_NESTED_SMMUV3, VIRT_IOMMU_VIRTIO, } VirtIOMMUType; =20 @@ -190,4 +191,10 @@ static inline int virt_gicv3_redist_region_count(VirtM= achineState *vms) return MACHINE(vms)->smp.cpus > redist0_capacity ? 2 : 1; } =20 +static inline bool virt_has_smmuv3(const VirtMachineState *vms) +{ + return vms->iommu =3D=3D VIRT_IOMMU_SMMUV3 || + vms->iommu =3D=3D VIRT_IOMMU_NESTED_SMMUV3; +} + #endif /* QEMU_ARM_VIRT_H */ diff --git a/hw/arm/virt-acpi-build.c b/hw/arm/virt-acpi-build.c index 789bac3134..7260e47c83 100644 --- a/hw/arm/virt-acpi-build.c +++ b/hw/arm/virt-acpi-build.c @@ -169,6 +169,14 @@ static void acpi_dsdt_add_pci(Aml *scope, const MemMap= Entry *memmap, .bus =3D vms->bus, }; =20 + /* + * Nested SMMU requires RMRs for MSI 1-1 mapping, which + * require _DSM for PreservingPCI Boot Configurations + */ + if (vms->iommu =3D=3D VIRT_IOMMU_NESTED_SMMUV3) { + cfg.preserve_config =3D true; + } + if (use_highmem) { cfg.mmio64 =3D memmap[VIRT_HIGH_PCIE_MMIO]; } @@ -245,16 +253,16 @@ static void acpi_dsdt_add_tpm(Aml *scope, VirtMachine= State *vms) #define ROOT_COMPLEX_ENTRY_SIZE 36 #define IORT_NODE_OFFSET 48 =20 -static void build_iort_id_mapping(GArray *table_data, uint32_t input_base, - uint32_t id_count, uint32_t out_ref) +static void +build_iort_id_mapping(GArray *table_data, uint32_t input_base, + uint32_t id_count, uint32_t out_ref, uint32_t flags) { /* Table 4 ID mapping format */ build_append_int_noprefix(table_data, input_base, 4); /* Input base */ build_append_int_noprefix(table_data, id_count, 4); /* Number of IDs */ build_append_int_noprefix(table_data, input_base, 4); /* Output base */ build_append_int_noprefix(table_data, out_ref, 4); /* Output Reference= */ - /* Flags */ - build_append_int_noprefix(table_data, 0 /* Single mapping */, 4); + build_append_int_noprefix(table_data, flags, 4); /* Flags */ } =20 struct AcpiIortIdMapping { @@ -296,6 +304,50 @@ static int iort_idmap_compare(gconstpointer a, gconstp= ointer b) return idmap_a->input_base - idmap_b->input_base; } =20 +static void +build_iort_rmr_nodes(GArray *table_data, GArray *smmu_idmaps, int smmu_off= set, uint32_t *id) { + AcpiIortIdMapping *range; + int i, j; + + for (i =3D 0; i < smmu_idmaps->len; i++) { + range =3D &g_array_index(smmu_idmaps, AcpiIortIdMapping, i); + for (j =3D 0; j < range->id_count; j++) { + int bdf =3D range->input_base + j; + + /* Table 18 Reserved Memory Range Node */ + + build_append_int_noprefix(table_data, 6 /* RMR */, 1); /* Type= */ + /* Length */ + build_append_int_noprefix(table_data, 28 + ID_MAPPING_ENTRY_SI= ZE + 20, 2); + build_append_int_noprefix(table_data, 1, 1); /* Revision */ + build_append_int_noprefix(table_data, *id, 4); /* Identifier */ + /* Number of ID mappings */ + build_append_int_noprefix(table_data, 1, 4); + /* Reference to ID Array */ + build_append_int_noprefix(table_data, 28, 4); + + /* RMR specific data */ + + /* Flags */ + build_append_int_noprefix(table_data, 0 /* Disallow remapping = */, 4); + /* Number of Memory Range Descriptors */ + build_append_int_noprefix(table_data, 1 , 4); + /* Reference to Memory Range Descriptors */ + build_append_int_noprefix(table_data, 28 + ID_MAPPING_ENTRY_SI= ZE, 4); + build_iort_id_mapping(table_data, bdf, 1, smmu_offset, 1); + + /* Table 19 Memory Range Descriptor */ + + /* Physical Range offset */ + build_append_int_noprefix(table_data, 0x8000000, 8); + /* Physical Range length */ + build_append_int_noprefix(table_data, 0x100000, 8); + build_append_int_noprefix(table_data, 0, 4); /* Reserved */ + *id +=3D 1; + } + } +} + /* * Input Output Remapping Table (IORT) * Conforms to "IO Remapping Table System Software on ARM Platforms", @@ -317,12 +369,14 @@ build_iort(GArray *table_data, BIOSLinker *linker, Vi= rtMachineState *vms) /* Table 2 The IORT */ acpi_table_begin(&table, table_data); =20 - if (vms->iommu =3D=3D VIRT_IOMMU_SMMUV3) { + if (virt_has_smmuv3(vms)) { AcpiIortIdMapping next_range =3D {0}; =20 object_child_foreach_recursive(object_get_root(), iort_host_bridges, smmu_idmaps); =20 + nb_nodes =3D 3; /* RC, ITS, SMMUv3 */ + /* Sort the smmu idmap by input_base */ g_array_sort(smmu_idmaps, iort_idmap_compare); =20 @@ -339,6 +393,9 @@ build_iort(GArray *table_data, BIOSLinker *linker, Virt= MachineState *vms) } =20 next_range.input_base =3D idmap->input_base + idmap->id_count; + if (vms->iommu =3D=3D VIRT_IOMMU_NESTED_SMMUV3) { + nb_nodes +=3D idmap->id_count; + } } =20 /* Append the last RC -> ITS ID mapping */ @@ -347,7 +404,6 @@ build_iort(GArray *table_data, BIOSLinker *linker, Virt= MachineState *vms) g_array_append_val(its_idmaps, next_range); } =20 - nb_nodes =3D 3; /* RC, ITS, SMMUv3 */ rc_mapping_count =3D smmu_idmaps->len + its_idmaps->len; } else { nb_nodes =3D 2; /* RC, ITS */ @@ -372,7 +428,7 @@ build_iort(GArray *table_data, BIOSLinker *linker, Virt= MachineState *vms) /* GIC ITS Identifier Array */ build_append_int_noprefix(table_data, 0 /* MADT translation_id */, 4); =20 - if (vms->iommu =3D=3D VIRT_IOMMU_SMMUV3) { + if (virt_has_smmuv3(vms)) { int irq =3D vms->irqmap[VIRT_SMMU] + ARM_SPI_BASE; =20 smmu_offset =3D table_data->len - table.table_offset; @@ -402,7 +458,7 @@ build_iort(GArray *table_data, BIOSLinker *linker, Virt= MachineState *vms) build_append_int_noprefix(table_data, 0, 4); =20 /* output IORT node is the ITS group node (the first node) */ - build_iort_id_mapping(table_data, 0, 0xFFFF, IORT_NODE_OFFSET); + build_iort_id_mapping(table_data, 0, 0xFFFF, IORT_NODE_OFFSET, 0); } =20 /* Table 17 Root Complex Node */ @@ -435,7 +491,7 @@ build_iort(GArray *table_data, BIOSLinker *linker, Virt= MachineState *vms) build_append_int_noprefix(table_data, 0, 3); /* Reserved */ =20 /* Output Reference */ - if (vms->iommu =3D=3D VIRT_IOMMU_SMMUV3) { + if (virt_has_smmuv3(vms)) { AcpiIortIdMapping *range; =20 /* translated RIDs connect to SMMUv3 node: RC -> SMMUv3 -> ITS */ @@ -443,7 +499,7 @@ build_iort(GArray *table_data, BIOSLinker *linker, Virt= MachineState *vms) range =3D &g_array_index(smmu_idmaps, AcpiIortIdMapping, i); /* output IORT node is the smmuv3 node */ build_iort_id_mapping(table_data, range->input_base, - range->id_count, smmu_offset); + range->id_count, smmu_offset, 0); } =20 /* bypassed RIDs connect to ITS group node directly: RC -> ITS */ @@ -451,11 +507,15 @@ build_iort(GArray *table_data, BIOSLinker *linker, Vi= rtMachineState *vms) range =3D &g_array_index(its_idmaps, AcpiIortIdMapping, i); /* output IORT node is the ITS group node (the first node) */ build_iort_id_mapping(table_data, range->input_base, - range->id_count, iort_node_offset); + range->id_count, iort_node_offset, 0); } } else { /* output IORT node is the ITS group node (the first node) */ - build_iort_id_mapping(table_data, 0, 0xFFFF, IORT_NODE_OFFSET); + build_iort_id_mapping(table_data, 0, 0xFFFF, IORT_NODE_OFFSET, 0); + } + + if (vms->iommu =3D=3D VIRT_IOMMU_NESTED_SMMUV3) { + build_iort_rmr_nodes(table_data, smmu_idmaps, smmu_offset, &id); } =20 acpi_table_end(linker, &table); diff --git a/hw/arm/virt.c b/hw/arm/virt.c index 1d59f0e59f..f538611f4e 100644 --- a/hw/arm/virt.c +++ b/hw/arm/virt.c @@ -1251,7 +1251,7 @@ static void create_smmu(const VirtMachineState *vms, DeviceState *dev; MachineState *ms =3D MACHINE(vms); =20 - if (vms->iommu !=3D VIRT_IOMMU_SMMUV3 || !vms->iommu_phandle) { + if (!virt_has_smmuv3(vms) || !vms->iommu_phandle) { return; } =20 @@ -1441,6 +1441,7 @@ static void create_pcie(VirtMachineState *vms) =20 switch (vms->iommu) { case VIRT_IOMMU_SMMUV3: + case VIRT_IOMMU_NESTED_SMMUV3: create_smmu(vms, vms->bus); qemu_fdt_setprop_cells(ms->fdt, nodename, "iommu-map", 0x0, vms->iommu_phandle, 0x0, 0x10000); @@ -2314,6 +2315,8 @@ static char *virt_get_iommu(Object *obj, Error **errp) return g_strdup("none"); case VIRT_IOMMU_SMMUV3: return g_strdup("smmuv3"); + case VIRT_IOMMU_NESTED_SMMUV3: + return g_strdup("nested-smmuv3"); default: g_assert_not_reached(); } @@ -2325,6 +2328,8 @@ static void virt_set_iommu(Object *obj, const char *v= alue, Error **errp) =20 if (!strcmp(value, "smmuv3")) { vms->iommu =3D VIRT_IOMMU_SMMUV3; + } else if (!strcmp(value, "nested-smmuv3")) { + vms->iommu =3D VIRT_IOMMU_NESTED_SMMUV3; } else if (!strcmp(value, "none")) { vms->iommu =3D VIRT_IOMMU_NONE; } else { --=20 2.26.3