From nobody Tue Dec 2 01:30:21 2025 Received: from CY7PR03CU001.outbound.protection.outlook.com (mail-westcentralusazon11010010.outbound.protection.outlook.com [40.93.198.10]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 4F18B332EA3; Fri, 21 Nov 2025 14:12:12 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=fail smtp.client-ip=40.93.198.10 ARC-Seal: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1763734335; cv=fail; b=rfZCs+lYtBXV00Y1+cN0OfG5II/aA/OiGIU3TkZi6xz5tPGOGw42XBgXXrmeu/wR+dafKFYQ+qi0pGBd0gojFyrxRVUVH0wpqO3D8YtDsbMAQmEbV67Jx1hgvv8EFMlM/2Cyvzigm4MNj2ZwFTP5njrGA0S3PtyzYPwadYn2uU8= ARC-Message-Signature: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1763734335; c=relaxed/simple; bh=g6AMwCLfc5a7zci494G1NRGy9JIzS0WNKYLoOLKUp1Q=; h=From:To:CC:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version:Content-Type; b=DuSQ7/zhUQeWpD6wJ7wTyjxIOiY8gP0ui91WUUa2vVbvfX2F+lXOkwJC9ryodkrR1SxjFLlVv1+jXuxxPGOD/MPe9QaAh0PKXkK/3HIwGgFP4LBAn1VoZT33vuAHoH8fqZH2DQdE0CqpTWinxAKGt8rerUGtfstODCocYurQAa8= ARC-Authentication-Results: i=2; smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=nvidia.com; spf=fail smtp.mailfrom=nvidia.com; dkim=pass (2048-bit key) header.d=Nvidia.com header.i=@Nvidia.com header.b=YXbj2CTT; arc=fail smtp.client-ip=40.93.198.10 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=nvidia.com Authentication-Results: smtp.subspace.kernel.org; spf=fail smtp.mailfrom=nvidia.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=Nvidia.com header.i=@Nvidia.com header.b="YXbj2CTT" ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=ahhkXkHwbIyerOZ1gwHbeb7DOcTK93Ow8/gX1GTZCUfG3V8JW5SJX+HMTN7oRNwUNBfLf9791KuxrQZ92itBDh9fXq/7qmDzqZGXBW/ifNYvCD01GdZ8Y8Ko4U+jtM3xz0w33QvNdMgPz+XcvS9qOhFq5BnLXjiji3sK479H71cq63K6HZxQ2rvJ2fOVF0LK0AUJOua0/1VYM6ciNEhzdHNtQgzh2JltJBSG7XZKC3HxMk4raNOzbDHHOG1k4zaXwNIcv+BQ/SPuOQfMRHpgxadIgpTwaDgaQ/zkCd5UrYds5uwvpTExcAgvk7zMfq+eFW9xr2NvB/ZfheDfQokq2Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=UX+yDiEszkqqKiQpnoloD7v6MJNEffQxbLbhM6vRI/U=; b=WVAy36Jd3LJ6cQ9+l+dYTCIVN7Gwpk6XdpZNnRLX5gH1m9fNGC9ox26sZ7D8YCjUlWrrV6XEdRBy5vSq8rcSWJYF8G7VwTPs4qufHKEyfqzQ2tCH02xdVoo+vnKmuJSWScyesiCFPKtbbu/h4JWtVJiyr+Y5MSP1v9iMN1jTRP6SI7sNl+UMLZ2K4CXL4gyJp5TygCCJ3OAZ+UVJDWNnegXmXSg3lGSsNoG8GLm7cpbMG5GsBei/TfpZfUKJcOHldhNQ7pnmfHjXgvFlf2rYc73R6HJnWnGrMe9CYJevTVmo9eoxlUwmGjZTVzKX2K4lRfY3WZ3Z06Xpa7boWygXGw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 216.228.117.160) smtp.rcpttodomain=vger.kernel.org smtp.mailfrom=nvidia.com; dmarc=pass (p=reject sp=reject pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none (0) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=UX+yDiEszkqqKiQpnoloD7v6MJNEffQxbLbhM6vRI/U=; b=YXbj2CTTIbdYDKaskgVyMxYdWqNhpg7jqULKI0udKKlhw3c3WIEXHHdi36JmomzDvi9P9tG4ttP1ICdnDugDN6+lKZOYlAJHtD3bB8Ak5fQ8n9QSzhaj35xGHXhL3PirJn5RFNs/8Faebwg4DjHUocYPR3BmkZauj9BpC5TD0NUH3gO+V5S+e1hr+tOycT0BdP+k+fipe+QEAZnp5XlFuyhazETJewIPwMPK+i2aiwCjc6zTc8zzBJLxHj0E9mDiKc/6n6v1V8H0FoCs1wrVvtISfT8rnxJK/jzBSvuNUwyGy55HeBD9Zg1e5182fNzWvcsEGEAn2pt5ekmEK+O0Aw== Received: from SJ0PR13CA0009.namprd13.prod.outlook.com (2603:10b6:a03:2c0::14) by BL3PR12MB6620.namprd12.prod.outlook.com (2603:10b6:208:38f::21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.9343.14; Fri, 21 Nov 2025 14:12:07 +0000 Received: from SJ5PEPF000001C8.namprd05.prod.outlook.com (2603:10b6:a03:2c0:cafe::bb) by SJ0PR13CA0009.outlook.office365.com (2603:10b6:a03:2c0::14) with Microsoft SMTP Server (version=TLS1_3, cipher=TLS_AES_256_GCM_SHA384) id 15.20.9343.10 via Frontend Transport; Fri, 21 Nov 2025 14:12:07 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 216.228.117.160) smtp.mailfrom=nvidia.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 216.228.117.160 as permitted sender) receiver=protection.outlook.com; client-ip=216.228.117.160; helo=mail.nvidia.com; pr=C Received: from mail.nvidia.com (216.228.117.160) by SJ5PEPF000001C8.mail.protection.outlook.com (10.167.242.36) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.9343.9 via Frontend Transport; Fri, 21 Nov 2025 14:12:07 +0000 Received: from rnnvmail202.nvidia.com (10.129.68.7) by mail.nvidia.com (10.129.200.66) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.2562.20; Fri, 21 Nov 2025 06:11:43 -0800 Received: from rnnvmail204.nvidia.com (10.129.68.6) by rnnvmail202.nvidia.com (10.129.68.7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.2562.20; Fri, 21 Nov 2025 06:11:42 -0800 Received: from gb-nvl-073-compute01.l16.internal032k18.bmc032b17.internal032f11.internal032huang.bmc032l04.bmc (10.127.8.11) by mail.nvidia.com (10.129.68.6) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.2562.20 via Frontend Transport; Fri, 21 Nov 2025 06:11:42 -0800 From: To: , , , , , , , , CC: , , , , , , , , , , , , , , , , Subject: [PATCH v3 1/7] vfio/nvgrace-gpu: Use faults to map device memory Date: Fri, 21 Nov 2025 14:11:35 +0000 Message-ID: <20251121141141.3175-2-ankita@nvidia.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20251121141141.3175-1-ankita@nvidia.com> References: <20251121141141.3175-1-ankita@nvidia.com> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable X-NV-OnPremToCloud: ExternallySecured X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: SJ5PEPF000001C8:EE_|BL3PR12MB6620:EE_ X-MS-Office365-Filtering-Correlation-Id: d2a95c01-1388-4205-f362-08de2907f454 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|7416014|376014|82310400026|36860700013|1800799024; X-Microsoft-Antispam-Message-Info: =?us-ascii?Q?6Z8bTYFqmOhUN81p3vPiNwTreZaIEl3MYSzL7CQJzpveQzJdayFpgfKw3DJM?= =?us-ascii?Q?pPqz1MDc+0xstqScPqjVCx7E+WDkuZVeL5AY29XuWQvXXruZtYZFFlNxICUP?= =?us-ascii?Q?WGrfdpsDTbJyVQojqeuP5omIF8QbS9NK8VXvyQ8ymHVMx2cHpoul2KtUODaL?= =?us-ascii?Q?4lJSQqA5PC5P2DDknIo4oWhgoAH57YVkxEvMGSHHpRPgf+2KBqHy3vybWgdZ?= =?us-ascii?Q?0rTHJKsJZ//1CjSLauYoX9Zo/5jqTYFvLNovmWf3i7VZN4EjeXvyZKOwfv/D?= =?us-ascii?Q?mx6ILVZbxfm4Ck6NUaVLMdbBG2O06e11wonON4GQFQunGfdYKEE/ot/rU9Bn?= =?us-ascii?Q?m+RrXphX7fptGPrb3jh4cNs3m9+t0GdCRo2Jqav6ir24kscWsBDlTbUNHeBE?= =?us-ascii?Q?v8lTpfzxnc2xcJkUI1OqVXNduki5WkkHilOlWuWIKHWbrKjteEKOOQc3/tMV?= =?us-ascii?Q?l4IRU/WuT1hmydIs7AMayn8IaUnoBXEsI24g3hCV14sdmNp7prcyDkPZCoNi?= =?us-ascii?Q?bKXL+MUmlYhb1Sf++PwF0P04X+6rn4u6WQIbs7sXu3TrFXAG1UjOgAu48GuD?= =?us-ascii?Q?myEG65XgM3rnxDRz8Gn0iG1H5ZPqbipBecvwEYAPx+Pvr2mhlKV25RGrMlMJ?= =?us-ascii?Q?s2+g2+9E3jTg/crbChSSdloA/YXCFWQ12pXioUgoXhFUzEbKamSx7NbzfQ5b?= =?us-ascii?Q?y7nZbdOhbOSUhN5q+/IlT6DbkCQJAr4UUoL/ceE6cA/VQAR6gA+CR/e7GTZ/?= =?us-ascii?Q?OaDKCX1PxfUbytYVdLorr8kKsclsY7pnhJXd/ssPmv8mSmsomO7lJXV6Pn9D?= =?us-ascii?Q?ZNUfkXM6RTTegnJGNf8Kxna2HrO//U9WO4LYPo5PFv7oHg3MBefs0z/IYE+b?= =?us-ascii?Q?W8dj/wD0aMCakf+hLNn8BRHrPcF80oVVoUcmIB834G3PYWSIaAuaXCiM3A86?= =?us-ascii?Q?7AYlJCQMwZ7Jug2H+SPd5vsxvLpXYEDMMn7prrsbfoJEA9sQ+AEWNgsgUD/J?= =?us-ascii?Q?cBJu2Q3J0yM0ccoHs8LT+p1Y4HOp5D2Wk5ZRXBo5pjDmzXcoHxv7UqOloxFg?= =?us-ascii?Q?YdaFAV16oJzwhy/oDclXcv/tI2jeKffivuQLOk0sTBN3LqjyfMMDvVujqhKZ?= =?us-ascii?Q?DJDOms8E3f47BHqJ1+TCv/1J9bDHo7L2oYNoSzT5Ykl8jyyOmasY3+Fk0GTk?= =?us-ascii?Q?JCpJox7em6YHy02eFqbX/xQ4cDkpQMxE4tlWCYzOcjmyf6ielavfeJt7Tpf6?= =?us-ascii?Q?fEq8IrxKFByrX0V+LQ1EJurk4SxJ8d/dV7ILjMle2rWIgF/T+I/mplpqR+QT?= =?us-ascii?Q?y0tctGL6Df52h710p6xYO0VMrjX0E7fPrbZH3DrcZl2jOUt6eFCXX/7Zl+To?= =?us-ascii?Q?q6BfIUtE+5PEXvu7cNJBQL+5+HEgnyBVcY5T4QRmqVVS4oGjxt0eehgg3QIG?= =?us-ascii?Q?Go2vexYZ1eMGiUrNXtg11El1wVHjPxHPFHiakkMBdg/w82vPk/MrQ65R6Uzs?= =?us-ascii?Q?zVwGbHomSxXOmei8qK84fPq77UYTHue0JME3UHRP3WUSnX9TtZfMaaH2UsV9?= =?us-ascii?Q?KCIKL5rJ7KP6mY9B+sM=3D?= X-Forefront-Antispam-Report: CIP:216.228.117.160;CTRY:US;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:mail.nvidia.com;PTR:dc6edge1.nvidia.com;CAT:NONE;SFS:(13230040)(7416014)(376014)(82310400026)(36860700013)(1800799024);DIR:OUT;SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 21 Nov 2025 14:12:07.2561 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: d2a95c01-1388-4205-f362-08de2907f454 X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a;Ip=[216.228.117.160];Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: SJ5PEPF000001C8.namprd05.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL3PR12MB6620 Content-Type: text/plain; charset="utf-8" From: Ankit Agrawal To make use of the huge pfnmap support and to support zap/remap sequence, fault/huge_fault ops based mapping mechanism needs to be implemented. Currently nvgrace-gpu module relies on remap_pfn_range to do the mapping during VM bootup. Replace it to instead rely on fault and use vmf_insert_pfn to setup the mapping. Signed-off-by: Ankit Agrawal --- drivers/vfio/pci/nvgrace-gpu/main.c | 50 ++++++++++++++++++----------- 1 file changed, 31 insertions(+), 19 deletions(-) diff --git a/drivers/vfio/pci/nvgrace-gpu/main.c b/drivers/vfio/pci/nvgrace= -gpu/main.c index e346392b72f6..ecfecd0916c9 100644 --- a/drivers/vfio/pci/nvgrace-gpu/main.c +++ b/drivers/vfio/pci/nvgrace-gpu/main.c @@ -130,6 +130,33 @@ static void nvgrace_gpu_close_device(struct vfio_devic= e *core_vdev) vfio_pci_core_close_device(core_vdev); } =20 +static vm_fault_t nvgrace_gpu_vfio_pci_fault(struct vm_fault *vmf) +{ + struct vm_area_struct *vma =3D vmf->vma; + struct nvgrace_gpu_pci_core_device *nvdev =3D vma->vm_private_data; + int index =3D vma->vm_pgoff >> (VFIO_PCI_OFFSET_SHIFT - PAGE_SHIFT); + vm_fault_t ret =3D VM_FAULT_SIGBUS; + struct mem_region *memregion; + unsigned long pgoff, pfn; + + memregion =3D nvgrace_gpu_memregion(index, nvdev); + if (!memregion) + return ret; + + pgoff =3D (vmf->address - vma->vm_start) >> PAGE_SHIFT; + pfn =3D PHYS_PFN(memregion->memphys) + pgoff; + + down_read(&nvdev->core_device.memory_lock); + ret =3D vmf_insert_pfn(vmf->vma, vmf->address, pfn); + up_read(&nvdev->core_device.memory_lock); + + return ret; +} + +static const struct vm_operations_struct nvgrace_gpu_vfio_pci_mmap_ops =3D= { + .fault =3D nvgrace_gpu_vfio_pci_fault, +}; + static int nvgrace_gpu_mmap(struct vfio_device *core_vdev, struct vm_area_struct *vma) { @@ -137,10 +164,8 @@ static int nvgrace_gpu_mmap(struct vfio_device *core_v= dev, container_of(core_vdev, struct nvgrace_gpu_pci_core_device, core_device.vdev); struct mem_region *memregion; - unsigned long start_pfn; u64 req_len, pgoff, end; unsigned int index; - int ret =3D 0; =20 index =3D vma->vm_pgoff >> (VFIO_PCI_OFFSET_SHIFT - PAGE_SHIFT); =20 @@ -157,7 +182,6 @@ static int nvgrace_gpu_mmap(struct vfio_device *core_vd= ev, ((1U << (VFIO_PCI_OFFSET_SHIFT - PAGE_SHIFT)) - 1); =20 if (check_sub_overflow(vma->vm_end, vma->vm_start, &req_len) || - check_add_overflow(PHYS_PFN(memregion->memphys), pgoff, &start_pfn) || check_add_overflow(PFN_PHYS(pgoff), req_len, &end)) return -EOVERFLOW; =20 @@ -168,6 +192,8 @@ static int nvgrace_gpu_mmap(struct vfio_device *core_vd= ev, if (end > memregion->memlength) return -EINVAL; =20 + vm_flags_set(vma, VM_IO | VM_PFNMAP | VM_DONTEXPAND | VM_DONTDUMP); + /* * The carved out region of the device memory needs the NORMAL_NC * property. Communicate as such to the hypervisor. @@ -184,23 +210,9 @@ static int nvgrace_gpu_mmap(struct vfio_device *core_v= dev, vma->vm_page_prot =3D pgprot_writecombine(vma->vm_page_prot); } =20 - /* - * Perform a PFN map to the memory and back the device BAR by the - * GPU memory. - * - * The available GPU memory size may not be power-of-2 aligned. The - * remainder is only backed by vfio_device_ops read/write handlers. - * - * During device reset, the GPU is safely disconnected to the CPU - * and access to the BAR will be immediately returned preventing - * machine check. - */ - ret =3D remap_pfn_range(vma, vma->vm_start, start_pfn, - req_len, vma->vm_page_prot); - if (ret) - return ret; =20 - vma->vm_pgoff =3D start_pfn; + vma->vm_ops =3D &nvgrace_gpu_vfio_pci_mmap_ops; + vma->vm_private_data =3D nvdev; =20 return 0; } --=20 2.34.1 From nobody Tue Dec 2 01:30:21 2025 Received: from CH5PR02CU005.outbound.protection.outlook.com (mail-northcentralusazon11012012.outbound.protection.outlook.com [40.107.200.12]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id CD8672F8BCB; Fri, 21 Nov 2025 14:12:10 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=fail smtp.client-ip=40.107.200.12 ARC-Seal: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1763734332; cv=fail; b=pcFRDclL2jQn/5Fef4q0nMnbkUY3WdBl0MU91bMkQ5zpcSMrn0kURCKSpoFG+4+YDgxI2OYqVWn/GhWFfbU7VVTPA11P2fWaNNvuk2By2+4ZYRIMN7m4p/1ZEBBVKLTl248EHJn5AxAVbEemSaM6PVYYqzOBEGFPD91VBxDZtAU= ARC-Message-Signature: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1763734332; c=relaxed/simple; bh=s4HOoPpw+F+uz/UUWetkyfr/GLjgmA2Hy6U7sCP17qM=; h=From:To:CC:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version:Content-Type; b=h4jj8nsLN+wt5svtVYOGxTlSMZuS1R+RGArPhsQnXoI3gfBzdaRufY5/jrn9HI3KmYjn311wFRPrLn2x6PxohgxzO8FxVoJSRVKGy5pehn1D/Wv+TQHVv2374w/03o3+FIKpg3iWJvBznDn7csSBFdRZXOjlmfXh6DQO/nTJah4= ARC-Authentication-Results: i=2; smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=nvidia.com; spf=fail smtp.mailfrom=nvidia.com; dkim=pass (2048-bit key) header.d=Nvidia.com header.i=@Nvidia.com header.b=OuCXrxaM; arc=fail smtp.client-ip=40.107.200.12 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=nvidia.com Authentication-Results: smtp.subspace.kernel.org; spf=fail smtp.mailfrom=nvidia.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=Nvidia.com header.i=@Nvidia.com header.b="OuCXrxaM" ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=DcgasWrpTdNJN2C00dyEigh5W6zs5z4olvR9fHMytfoLu52Z/j87r5mO6DIVZCvv36dfwFJrMKXAPlP/gA+sCWGj1HT6RxJeBDoCr99MWSyPHIAzbWPG8rD30nVdg//tWsfw9XG2+k5IGuUg79i7gLxD/JyshEepWRpEcMhytQzki6b8az7wTKnePHmVvmGtN0caxbLoVHmJ8TsH94JlzhsItHvSjot0p6sXPXSMOuIe4VbFRG47hOx5DRe79xJDBVd4mThqEnCXbi+zEupnRxfZm64UromZg5sIeI/XeTQmOQY6OIPsA2mZPNxTDHpjCuTNUijz5ap/bWHDn+YyDA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=r+jXZfFaj/mBZfU6QapQukJMNEemAubukfYwvP8TYRI=; b=kumw95BCSx5SS5Ja6Jp/K+HnHkKh2h4ARVl/tniSZo9EpxgHCfOP/nLykeWj381Qt9CWte5ZrWX/DhLOKr1LeZV8abQmpv9SAevITVRkd5O/YgLwGYrDj8YdNG/nGTaEkt2XSNA2aHvL317L6F6x0AjuN3JrMfd21Qlf4iDQIFe4KYn6UwLqEOGUuLjHv7uOqQg8q01YM8iUJDckvk0vak9UL7NQL7qPrCrojZefVoOkMAzrugthq4tgv64neZp9Xjzq+OfbVvMjMcvoD3h0oLFFVCEfz6jEoS3WKYb0pyMGfllGvwDOTjkVi6dYqvmeDC3hW4H+f2IxxcFKASCOHQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 216.228.117.161) smtp.rcpttodomain=vger.kernel.org smtp.mailfrom=nvidia.com; dmarc=pass (p=reject sp=reject pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none (0) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=r+jXZfFaj/mBZfU6QapQukJMNEemAubukfYwvP8TYRI=; b=OuCXrxaM+gRhsbdTbtL8urbt6hZejCQzjHsBnyS58woxHNB9UcFD4b+t+lRofNJSKPnV5L5ZxF68BBRJBDVPCCaZZRP+na4HfRwbdJSWWs8GEc7oZ0rZIlDtOgnakfCoNLS/1v+YG+A6ptTlQpIHTAopOUhIQ2PNUruvk3erdNODOFHvVswgVp92T/zusoSqIHDTFBceU2QJno5mhSRUqabMdcoC7P5wjzBndpC4yU27k8gSlpg7fVp/fR7n4PdNPH8Knvvfit6VsRabgVR8jCOysQYn56gJivACqGvbIfocnJ8YBHqwQVCOJ6hQTeExTtWl5wUJco8EniQrvcEUDw== Received: from CH2PR14CA0033.namprd14.prod.outlook.com (2603:10b6:610:56::13) by BY5PR12MB4068.namprd12.prod.outlook.com (2603:10b6:a03:203::12) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.9343.14; Fri, 21 Nov 2025 14:12:05 +0000 Received: from CH1PEPF0000AD74.namprd04.prod.outlook.com (2603:10b6:610:56:cafe::3e) by CH2PR14CA0033.outlook.office365.com (2603:10b6:610:56::13) with Microsoft SMTP Server (version=TLS1_3, cipher=TLS_AES_256_GCM_SHA384) id 15.20.9343.14 via Frontend Transport; Fri, 21 Nov 2025 14:12:03 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 216.228.117.161) smtp.mailfrom=nvidia.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 216.228.117.161 as permitted sender) receiver=protection.outlook.com; client-ip=216.228.117.161; helo=mail.nvidia.com; pr=C Received: from mail.nvidia.com (216.228.117.161) by CH1PEPF0000AD74.mail.protection.outlook.com (10.167.244.52) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.9343.9 via Frontend Transport; Fri, 21 Nov 2025 14:12:04 +0000 Received: from rnnvmail202.nvidia.com (10.129.68.7) by mail.nvidia.com (10.129.200.67) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.2562.20; Fri, 21 Nov 2025 06:11:43 -0800 Received: from rnnvmail204.nvidia.com (10.129.68.6) by rnnvmail202.nvidia.com (10.129.68.7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.2562.20; Fri, 21 Nov 2025 06:11:43 -0800 Received: from gb-nvl-073-compute01.l16.internal032k18.bmc032b17.internal032f11.internal032huang.bmc032l04.bmc (10.127.8.11) by mail.nvidia.com (10.129.68.6) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.2562.20 via Frontend Transport; Fri, 21 Nov 2025 06:11:43 -0800 From: To: , , , , , , , , CC: , , , , , , , , , , , , , , , , Subject: [PATCH v3 2/7] vfio: export function to map the VMA Date: Fri, 21 Nov 2025 14:11:36 +0000 Message-ID: <20251121141141.3175-3-ankita@nvidia.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20251121141141.3175-1-ankita@nvidia.com> References: <20251121141141.3175-1-ankita@nvidia.com> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable X-NV-OnPremToCloud: ExternallySecured X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: CH1PEPF0000AD74:EE_|BY5PR12MB4068:EE_ X-MS-Office365-Filtering-Correlation-Id: 5d793952-b35f-4e0f-f520-08de2907f2fb X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|36860700013|1800799024|376014|7416014|82310400026; X-Microsoft-Antispam-Message-Info: =?us-ascii?Q?zqxXi9G4zT1SA/MIXiJOHuYtlEc2vznUE6AjAMn7PPOfTvNK76+beXrqGenu?= =?us-ascii?Q?te3C94OpTbLUELBOwNfHNs+siLXLGH3xDmX+ylV+J3eiOIUNMZes02P1KTw/?= =?us-ascii?Q?JmwoSeIqTikMHzn2vn2oGjkbjVZQJAg8UtqtLCqGar94Od7vBaCzr7FU21cB?= =?us-ascii?Q?CXq72LzC2RX/tS+CAxGjLcy454ckYHk5ka+IPpSgi3WgmXSX2YLyHy+CBbYA?= =?us-ascii?Q?+nlDLFRI+HnJTPZejX8OU5jrIs3IndjfvBch9WdaHlDVymQDaRhfU+/ftPZP?= =?us-ascii?Q?a7E/Hax3h7r001iwmq32digeGW2pzwJOwruaDteW3LNqcPVu5VifiidRZUh2?= =?us-ascii?Q?PtB1LJ+7C8yX2epu9Rw8jub1nMMW0090xz08VVkhHPbH2F9j2QGxzS5QjEYe?= =?us-ascii?Q?y1Yh7evrpaFhP1wd/F3TYvhGlW02BIU/O4JbNYn40btiV2bkHLedqmeLnK75?= =?us-ascii?Q?WiCNeG33xCLB1G74yYGTzpMY9VA/gIz83My/iUbiwTuzkyl7gbpkSfmpPA6H?= =?us-ascii?Q?gqn1sFM9GnMBSHDCPTh1e3X8k86wKamCHlYT5Ms7sjbaKjoy2177ilaDtbSK?= =?us-ascii?Q?W5UFdc7jw24uWd5CasejXxyTR4bBRJbIKqAGC95a9AXRDQJGH69aCOgzT0Yy?= =?us-ascii?Q?5TDS4LYtBEW21zshVWgImpzbvlBBXyKfwdSZMFGq9iySzk89K6ITideP4xvC?= =?us-ascii?Q?cscRkpnNwZyJwtbW6VzQ2C4KdXKTQgqlRLWPO++07kkJdyxM6V9yGb69M98z?= =?us-ascii?Q?Nk5f2manwJssibq80L9NHej0JQHws7OaQ7t9JN8I16tLntnejZORsz6LJmMB?= =?us-ascii?Q?zSRQR50vvDMnRvWO+dUHp8Ny2lUqyvAospuDYEeex/BWkkUM/doScYsEHRvt?= =?us-ascii?Q?DSnlsNsMslObLfoVGUuu58DoNZlkjFaqu3Szu22TUKcO3wFAY7wKJrrTAIc3?= =?us-ascii?Q?oJnFMZfKf+zHGn4/SF2ffXqyS5Ztt2MIc6neIOGbtzquJ4ybBKNd4hx6PvEb?= =?us-ascii?Q?/75PhBxOnTiqGmR4bR84oTnZ7x0NSKMhYdNAmSMBIDPcl/CZFc/lCKmX/Wgx?= =?us-ascii?Q?IGOFS2vJlEFSpaz4sTaVwMnpUIZo1uZiTwOEphIjIt7vhGmComZchkkOYF3h?= =?us-ascii?Q?tu1nrNRqHNNyydu53lw6lCI9nP+dkNaeV+u/74tJ1tCubkGKiWizu8yn+sCJ?= =?us-ascii?Q?EZHrqZIGdQOi5hbTE3efWRMKlm0bg7FGQRWCxmRv1WL8P8PRD34lzE4KX1bW?= =?us-ascii?Q?TuMe2I3tgHygenx5is898DK24dN5GOGZCo21VZBqdkn6eSf7bQKD15cwJ5WP?= =?us-ascii?Q?5KlFvKLB9RgW33vi0BZf3vNVBI2hgwdI6FX/4Hk8KGSe/mcANR3iZD+dAgQQ?= =?us-ascii?Q?IU1zcMEvKabW8+vKV1BJmesgDR3jWIzhiVIa74Pd+X6W5AS76rmbuLtIjA9+?= =?us-ascii?Q?ZW+0blnVX8VVQSP6yPhHHObfzkl4l6neztdoQv6dLWaqmbyA0j1T+mq6Kfqc?= =?us-ascii?Q?D+avYg7gAzHq5MYjm4QxjrPB/rIFw/ilLD82aqwpuNDw+pfmEgA8k5qcCB1L?= =?us-ascii?Q?76NEMSrjPOWmd6gqIDM=3D?= X-Forefront-Antispam-Report: CIP:216.228.117.161;CTRY:US;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:mail.nvidia.com;PTR:dc6edge2.nvidia.com;CAT:NONE;SFS:(13230040)(36860700013)(1800799024)(376014)(7416014)(82310400026);DIR:OUT;SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 21 Nov 2025 14:12:04.9939 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 5d793952-b35f-4e0f-f520-08de2907f2fb X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a;Ip=[216.228.117.161];Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: CH1PEPF0000AD74.namprd04.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: BY5PR12MB4068 Content-Type: text/plain; charset="utf-8" From: Ankit Agrawal Take out the implementation to map the VMA to the PTE/PMD/PUD as a separate function. Export the function to be used by nvgrace-gpu module. Signed-off-by: Ankit Agrawal --- drivers/vfio/pci/vfio_pci_core.c | 46 ++++++++++++++++++++------------ include/linux/vfio_pci_core.h | 2 ++ 2 files changed, 31 insertions(+), 17 deletions(-) diff --git a/drivers/vfio/pci/vfio_pci_core.c b/drivers/vfio/pci/vfio_pci_c= ore.c index 7dcf5439dedc..29dcf78905a6 100644 --- a/drivers/vfio/pci/vfio_pci_core.c +++ b/drivers/vfio/pci/vfio_pci_core.c @@ -1640,6 +1640,34 @@ static unsigned long vma_to_pfn(struct vm_area_struc= t *vma) return (pci_resource_start(vdev->pdev, index) >> PAGE_SHIFT) + pgoff; } =20 +vm_fault_t vfio_pci_map_pfn(struct vm_fault *vmf, + unsigned long pfn, + unsigned int order) +{ + vm_fault_t ret; + + switch (order) { + case 0: + ret =3D vmf_insert_pfn(vmf->vma, vmf->address, pfn); + break; +#ifdef CONFIG_ARCH_SUPPORTS_PMD_PFNMAP + case PMD_ORDER: + ret =3D vmf_insert_pfn_pmd(vmf, pfn, false); + break; +#endif +#ifdef CONFIG_ARCH_SUPPORTS_PUD_PFNMAP + case PUD_ORDER: + ret =3D vmf_insert_pfn_pud(vmf, pfn, false); + break; +#endif + default: + ret =3D VM_FAULT_FALLBACK; + } + + return ret; +} +EXPORT_SYMBOL_GPL(vfio_pci_map_pfn); + static vm_fault_t vfio_pci_mmap_huge_fault(struct vm_fault *vmf, unsigned int order) { @@ -1662,23 +1690,7 @@ static vm_fault_t vfio_pci_mmap_huge_fault(struct vm= _fault *vmf, if (vdev->pm_runtime_engaged || !__vfio_pci_memory_enabled(vdev)) goto out_unlock; =20 - switch (order) { - case 0: - ret =3D vmf_insert_pfn(vma, vmf->address, pfn); - break; -#ifdef CONFIG_ARCH_SUPPORTS_PMD_PFNMAP - case PMD_ORDER: - ret =3D vmf_insert_pfn_pmd(vmf, pfn, false); - break; -#endif -#ifdef CONFIG_ARCH_SUPPORTS_PUD_PFNMAP - case PUD_ORDER: - ret =3D vmf_insert_pfn_pud(vmf, pfn, false); - break; -#endif - default: - ret =3D VM_FAULT_FALLBACK; - } + ret =3D vfio_pci_map_pfn(vmf, pfn, order); =20 out_unlock: up_read(&vdev->memory_lock); diff --git a/include/linux/vfio_pci_core.h b/include/linux/vfio_pci_core.h index f541044e42a2..058acded858b 100644 --- a/include/linux/vfio_pci_core.h +++ b/include/linux/vfio_pci_core.h @@ -119,6 +119,8 @@ ssize_t vfio_pci_core_read(struct vfio_device *core_vde= v, char __user *buf, size_t count, loff_t *ppos); ssize_t vfio_pci_core_write(struct vfio_device *core_vdev, const char __us= er *buf, size_t count, loff_t *ppos); +vm_fault_t vfio_pci_map_pfn(struct vm_fault *vmf, unsigned long pfn, + unsigned int order); int vfio_pci_core_mmap(struct vfio_device *core_vdev, struct vm_area_struc= t *vma); void vfio_pci_core_request(struct vfio_device *core_vdev, unsigned int cou= nt); int vfio_pci_core_match(struct vfio_device *core_vdev, char *buf); --=20 2.34.1 From nobody Tue Dec 2 01:30:21 2025 Received: from SJ2PR03CU001.outbound.protection.outlook.com (mail-westusazon11012047.outbound.protection.outlook.com [52.101.43.47]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 8291733508F; Fri, 21 Nov 2025 14:12:13 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=fail smtp.client-ip=52.101.43.47 ARC-Seal: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1763734335; cv=fail; b=snjLohfUSRNHGlvrzVXn9RwyC1anrF79UXdDRgdvHx1wvydm1ic2r5RitAJzzG2pkQDklRt5sTtc437C/zqKnsUTwchh4FAbOqLbvwNJAmG5ZMoK3gRaTAaLUD/k0CjcbkVxb0bGFl7rNxDdVTgUa5n6rlQf5XopB/5ThYAacG0= ARC-Message-Signature: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1763734335; c=relaxed/simple; bh=QhXm5e1k0/7NMoIh8aIZ1M4rtYPvrqtcA/swbOqqQMQ=; h=From:To:CC:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version:Content-Type; b=ZvFO7D7rRkT1HxpgWC7SeNnzF1C9np1Ry+uPa6dzzBPGdjwp0mZAV2sG/9Zh/xtxBlZSLN5+nQz2CHLIwU60c7dEymiFuUBuseknAHQOThNvI3HbDU39ijL3h05GtyGmnhaBtsEuxJbSY8TegrgJqbblTiZtquwicvYyxcKiTu0= ARC-Authentication-Results: i=2; smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=nvidia.com; spf=fail smtp.mailfrom=nvidia.com; dkim=pass (2048-bit key) header.d=Nvidia.com header.i=@Nvidia.com header.b=oo8qWLjp; arc=fail smtp.client-ip=52.101.43.47 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=nvidia.com Authentication-Results: smtp.subspace.kernel.org; spf=fail smtp.mailfrom=nvidia.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=Nvidia.com header.i=@Nvidia.com header.b="oo8qWLjp" ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=IF0re8WMBS9yD0bzEL9kM7D8ZWvbYVbqaIMBc/br0oXcEIwyleZEai76WAOJ2lDC3ciiJMX2Ya5j41umfYg8XVCV0gprbPs6MoVpd9mPf3h/OckalpLUOW7Oeq7snj/9zTRtzV72npNrSyK1gDmYr2648cIJmmuWqI9UlPFeUHeAErcXqNNjxJyK96HxSaR9mE9Jvc3KVboyB5vZwc0RskiV2Nrg9WZD8yRuDCbMVAfP0F2RO+Bk7J+VEMAAIdilL7n9Z5eCa9o41zFIr424Nr9w4WcgFlw1as3/5nM4eLnzBiqlU88CLMOW6bs56ElDgngI/fHsY0eaVPZBTullTg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=TDOu9Iq34WkH/5oFljARSAIrj2XxcNmUFrm+hF03KSQ=; b=Tv8duNruVuqFXTcSnGDFIg5NoTdwDZ9vBFHDYS8Ytx6LoT8bFJ0RJjHZY+oLtC4oyhYecUpwuTRzPO8YXzwahLtThvcHkoYlAPFAE6Qu/dLIWxx0eofz9VurkbL9dUEgu3zMLDbBTawbrZ8hGk5oRRCxUNcTDQiZ6aqD1E2/tCFrZAnLyOrsBrukBTAwL4lPMVIkomBETjP+JnJ0nA3rtsSvWk80afUabelaBfQbRbCA+n654yukuaumgFWzWNTpnq3FDKocYfLVSmDp4AC0vHaJA5q+vZUC3KTjYmmwc1txxK3MO6zL7EY/486XGgY/hZIvkpgXpUR79GZLDhoKXQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 216.228.117.160) smtp.rcpttodomain=vger.kernel.org smtp.mailfrom=nvidia.com; dmarc=pass (p=reject sp=reject pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none (0) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=TDOu9Iq34WkH/5oFljARSAIrj2XxcNmUFrm+hF03KSQ=; b=oo8qWLjpoAoC7bGNNU60WBZmGESpUUNjHJtUKrsKDBo5Iy71WId+DsFcxI8WvJ68rhCDFmJGmvuHA/IbVyBcL6XQLVJIGtLtXt9pyo3cbmmc1ydDrhzwoXFBOeNrI+IpCsQUmiVmZWy7d+RIPgqWCPQLretVEY4hnkg2gKY80gBYxejfotbOxUo24pth4ZX7U4E7s5HWr/ZvGiFuisMkIHdJgDuIR8ilNjyvLwmLbUN/OKVyPG70yWBWZnKOVu/XWOa8TSoiYc0Q1UMfoWMZyKKBrx5FJ1xEbtreTuV8jGlKpR40YcUKWPfLdNiF/GAobHp5klCTCTLTJuySmn+WWw== Received: from MW4PR04CA0248.namprd04.prod.outlook.com (2603:10b6:303:88::13) by MW4PR12MB6975.namprd12.prod.outlook.com (2603:10b6:303:20a::9) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.9320.16; Fri, 21 Nov 2025 14:12:09 +0000 Received: from SJ5PEPF000001CD.namprd05.prod.outlook.com (2603:10b6:303:88:cafe::28) by MW4PR04CA0248.outlook.office365.com (2603:10b6:303:88::13) with Microsoft SMTP Server (version=TLS1_3, cipher=TLS_AES_256_GCM_SHA384) id 15.20.9343.12 via Frontend Transport; Fri, 21 Nov 2025 14:12:00 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 216.228.117.160) smtp.mailfrom=nvidia.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 216.228.117.160 as permitted sender) receiver=protection.outlook.com; client-ip=216.228.117.160; helo=mail.nvidia.com; pr=C Received: from mail.nvidia.com (216.228.117.160) by SJ5PEPF000001CD.mail.protection.outlook.com (10.167.242.42) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.9343.9 via Frontend Transport; Fri, 21 Nov 2025 14:12:08 +0000 Received: from rnnvmail202.nvidia.com (10.129.68.7) by mail.nvidia.com (10.129.200.66) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.2562.20; Fri, 21 Nov 2025 06:11:44 -0800 Received: from rnnvmail204.nvidia.com (10.129.68.6) by rnnvmail202.nvidia.com (10.129.68.7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.2562.20; Fri, 21 Nov 2025 06:11:43 -0800 Received: from gb-nvl-073-compute01.l16.internal032k18.bmc032b17.internal032f11.internal032huang.bmc032l04.bmc (10.127.8.11) by mail.nvidia.com (10.129.68.6) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.2562.20 via Frontend Transport; Fri, 21 Nov 2025 06:11:43 -0800 From: To: , , , , , , , , CC: , , , , , , , , , , , , , , , , Subject: [PATCH v3 3/7] vfio/nvgrace-gpu: Add support for huge pfnmap Date: Fri, 21 Nov 2025 14:11:37 +0000 Message-ID: <20251121141141.3175-4-ankita@nvidia.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20251121141141.3175-1-ankita@nvidia.com> References: <20251121141141.3175-1-ankita@nvidia.com> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable X-NV-OnPremToCloud: ExternallySecured X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: SJ5PEPF000001CD:EE_|MW4PR12MB6975:EE_ X-MS-Office365-Filtering-Correlation-Id: 861b8e3a-6901-4de4-f3ed-08de2907f534 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|7416014|376014|1800799024|36860700013|82310400026; X-Microsoft-Antispam-Message-Info: =?us-ascii?Q?+d/FtsPtZ28pXzrgiA+NgLeUfo+n3uOkmV1E59aFqjS6nYGZHfIOd3O9j7ai?= =?us-ascii?Q?6hRZoIgHGYBB1VALXnuzbAbxvC3xQkcdqFi+etA3laUoLqfRN4Qg6YqzIob4?= =?us-ascii?Q?19BzSkgegfq0EsM5l/iLDR7w+nvJ7oH6L1xIYuXPbfsKaMjuy9MymlCktO6C?= =?us-ascii?Q?hkTmaVMKWKX6YK+VhOiOa29qf28/jy6TG++b7zj9xDWaoUDZUMwCCLEGbD4H?= =?us-ascii?Q?oeMqZ2y3vv6FijWZzu7EUcIOBwtXP7MywbgfiYKgpIIXm7C3AKg3+706wmRh?= =?us-ascii?Q?zu/TLCdrL5VQSWoS41Q+PCdBXpmmLHQZbbBKpHNXBCCvFoN8ZwukyhCy08l4?= =?us-ascii?Q?EqsFOepfoh+fKtOENxSliWBd+sC1OZjbVVB9x20RaEYjpxqxlo6IJJ3GcpLU?= =?us-ascii?Q?S8YGHglyh05SpPXhlDdDZ15WpF1KgJOxML2CFQKYz0XTo0YQqcjvLPIKoql/?= =?us-ascii?Q?oCVtE6aZV1Tylg5DpxzWwntC7phR6wW4toD8GuxJlUt8U4NDOzxA5k9vDDVr?= =?us-ascii?Q?gvH3dGwVTXSASdMpxBCZChjCwUPemwF8cRcAgpH74O8b+ckMSByjYNPcqvBL?= =?us-ascii?Q?Yyyt8+IjKK7pUj3YPJrFELo3LBvKc0tQ/ZV9pAYoueeDQQIAF82t33pf78gF?= =?us-ascii?Q?x+EHFEFU3187l+ossHezhtOxXraAIPujFYjxnphHVAPp7/MxU6PgvtSusGh8?= =?us-ascii?Q?jb929bHV8lpno5S37Zmx/dAwgv3ioTG6PXqXd4ajQYxw1J5toR3EMMrlEkEo?= =?us-ascii?Q?TF2oblkF8riMrHAKmbIs1SQoI3IpxR/OwvikOKwhI6yXZIA9N/pNs3mNmSfe?= =?us-ascii?Q?2n38Hiu0xzKXJi0x9VWLDR7Oo3C/6gNI34jhvz7NYLJa+t2o2tHMfSQWFjlp?= =?us-ascii?Q?zHaA4kLSrbf+FGHy3/fKxudqWoWb7MW2Tga5a1yHgbqg3dD8KPlXJdSAAX9V?= =?us-ascii?Q?5DFIbyk6deQGKNpmhHMXgFDM53S32UaX+ybRHcuYOfe3BcBcIia7e5AQR0p4?= =?us-ascii?Q?vi++s1YST/SO28XdD3EEIBMEn/zfQ2U5HLn4t51xkjApDDw5ZXLsJ4b4p+Au?= =?us-ascii?Q?YnYuzxv6Yi6zsS3Tj9U/3VE+oInObvr3wuWjLLQCQDBQ2t7l/oUH5NqdRN6C?= =?us-ascii?Q?AxdwxCdvPKTKW7Lel8hpJRl6RZ9jdsLlMbWk9FivEXjho/nPbWoNdZSRIEPn?= =?us-ascii?Q?7hzfapnLcMLvB07DWlpGoK5IzVqA+08a+T0cHrqAhCib03mjv5LYBBnY1WTg?= =?us-ascii?Q?KlvFYzNe+OaqVAkDSad6SlnXYo1hIeeKQlzHWecWR3xFjHqak0xE1wyHu3Fj?= =?us-ascii?Q?hyMPwfpvtETfT5wGa5EQtgoE7NX7kD0iblvQtLvHwOTGMlWMkWgncpVDKSOo?= =?us-ascii?Q?roceW7Aax6+dl24UEsBAJOPgLB+Qz/8JvaZ+8AC9708GB4O/FFRLSDgPVRhm?= =?us-ascii?Q?BNhdlqddKaFMIH3KjrlPH4ZU7Juc1f3oFt1a/7vwupN37lnuOpyZ+/sgiPp9?= =?us-ascii?Q?/s1JjgVw+RS/4W12ZPzu4Qk123pY54vXRSk2ZcewaMd3TXBkTrtNCDs8HqeE?= =?us-ascii?Q?TeHX2h1VUAZia1aw/y4=3D?= X-Forefront-Antispam-Report: CIP:216.228.117.160;CTRY:US;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:mail.nvidia.com;PTR:dc6edge1.nvidia.com;CAT:NONE;SFS:(13230040)(7416014)(376014)(1800799024)(36860700013)(82310400026);DIR:OUT;SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 21 Nov 2025 14:12:08.7232 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 861b8e3a-6901-4de4-f3ed-08de2907f534 X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a;Ip=[216.228.117.160];Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: SJ5PEPF000001CD.namprd05.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW4PR12MB6975 Content-Type: text/plain; charset="utf-8" From: Ankit Agrawal NVIDIA's Grace based systems have large device memory. The device memory is mapped as VM_PFNMAP in the VMM VMA. The nvgrace-gpu module could make use of the huge PFNMAP support added in mm [1]. To achieve this, nvgrace-gpu module is updated to implement huge_fault ops. The implementation establishes mapping according to the order request. Note that if the PFN or the VMA address is unaligned to the order, the mapping fallbacks to the PTE level. Link: https://lore.kernel.org/all/20240826204353.2228736-1-peterx@redhat.co= m/ [1] cc: Alex Williamson cc: Jason Gunthorpe cc: Vikram Sethi Signed-off-by: Ankit Agrawal --- drivers/vfio/pci/nvgrace-gpu/main.c | 44 +++++++++++++++++++++++------ 1 file changed, 35 insertions(+), 9 deletions(-) diff --git a/drivers/vfio/pci/nvgrace-gpu/main.c b/drivers/vfio/pci/nvgrace= -gpu/main.c index ecfecd0916c9..3883a9de170f 100644 --- a/drivers/vfio/pci/nvgrace-gpu/main.c +++ b/drivers/vfio/pci/nvgrace-gpu/main.c @@ -130,33 +130,59 @@ static void nvgrace_gpu_close_device(struct vfio_devi= ce *core_vdev) vfio_pci_core_close_device(core_vdev); } =20 -static vm_fault_t nvgrace_gpu_vfio_pci_fault(struct vm_fault *vmf) +static vm_fault_t nvgrace_gpu_vfio_pci_huge_fault(struct vm_fault *vmf, + unsigned int order) { struct vm_area_struct *vma =3D vmf->vma; struct nvgrace_gpu_pci_core_device *nvdev =3D vma->vm_private_data; int index =3D vma->vm_pgoff >> (VFIO_PCI_OFFSET_SHIFT - PAGE_SHIFT); vm_fault_t ret =3D VM_FAULT_SIGBUS; struct mem_region *memregion; - unsigned long pgoff, pfn; + unsigned long pgoff, pfn, addr; =20 memregion =3D nvgrace_gpu_memregion(index, nvdev); if (!memregion) return ret; =20 - pgoff =3D (vmf->address - vma->vm_start) >> PAGE_SHIFT; + addr =3D vmf->address & ~((PAGE_SIZE << order) - 1); + pgoff =3D (addr - vma->vm_start) >> PAGE_SHIFT; pfn =3D PHYS_PFN(memregion->memphys) + pgoff; =20 + if (order && (addr < vma->vm_start || + addr + (PAGE_SIZE << order) > vma->vm_end || + pfn & ((1 << order) - 1))) + return VM_FAULT_FALLBACK; + down_read(&nvdev->core_device.memory_lock); - ret =3D vmf_insert_pfn(vmf->vma, vmf->address, pfn); + ret =3D vfio_pci_map_pfn(vmf, pfn, order); up_read(&nvdev->core_device.memory_lock); =20 return ret; } =20 +static vm_fault_t nvgrace_gpu_vfio_pci_fault(struct vm_fault *vmf) +{ + return nvgrace_gpu_vfio_pci_huge_fault(vmf, 0); +} + static const struct vm_operations_struct nvgrace_gpu_vfio_pci_mmap_ops =3D= { .fault =3D nvgrace_gpu_vfio_pci_fault, +#ifdef CONFIG_ARCH_SUPPORTS_HUGE_PFNMAP + .huge_fault =3D nvgrace_gpu_vfio_pci_huge_fault, +#endif }; =20 +static size_t nvgrace_gpu_aligned_devmem_size(size_t memlength) +{ +#ifdef CONFIG_ARCH_SUPPORTS_PMD_PFNMAP + return ALIGN(memlength, PMD_SIZE); +#endif +#ifdef CONFIG_ARCH_SUPPORTS_PUD_PFNMAP + return ALIGN(memlength, PUD_SIZE); +#endif + return memlength; +} + static int nvgrace_gpu_mmap(struct vfio_device *core_vdev, struct vm_area_struct *vma) { @@ -186,10 +212,10 @@ static int nvgrace_gpu_mmap(struct vfio_device *core_= vdev, return -EOVERFLOW; =20 /* - * Check that the mapping request does not go beyond available device - * memory size + * Check that the mapping request does not go beyond the exposed + * device memory size. */ - if (end > memregion->memlength) + if (end > nvgrace_gpu_aligned_devmem_size(memregion->memlength)) return -EINVAL; =20 vm_flags_set(vma, VM_IO | VM_PFNMAP | VM_DONTEXPAND | VM_DONTDUMP); @@ -210,7 +236,6 @@ static int nvgrace_gpu_mmap(struct vfio_device *core_vd= ev, vma->vm_page_prot =3D pgprot_writecombine(vma->vm_page_prot); } =20 - vma->vm_ops =3D &nvgrace_gpu_vfio_pci_mmap_ops; vma->vm_private_data =3D nvdev; =20 @@ -260,7 +285,8 @@ nvgrace_gpu_ioctl_get_region_info(struct vfio_device *c= ore_vdev, =20 sparse->nr_areas =3D 1; sparse->areas[0].offset =3D 0; - sparse->areas[0].size =3D memregion->memlength; + sparse->areas[0].size =3D + nvgrace_gpu_aligned_devmem_size(memregion->memlength); sparse->header.id =3D VFIO_REGION_INFO_CAP_SPARSE_MMAP; sparse->header.version =3D 1; =20 --=20 2.34.1 From nobody Tue Dec 2 01:30:21 2025 Received: from BYAPR05CU005.outbound.protection.outlook.com (mail-westusazon11010022.outbound.protection.outlook.com [52.101.85.22]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id BFA112F657E; Fri, 21 Nov 2025 14:12:10 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=fail smtp.client-ip=52.101.85.22 ARC-Seal: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1763734332; cv=fail; b=X60uN4T5/F4DXfsYJJ+zzj6ITvtyj0ntPMnoxStPe1EhIBlmzyEMvwkCTJDQzMcO9GxHeyOrGFEc+O3gwuBHAZ6n6Ja6EB+zifhSGnvDMjDHeW9cNsRNKtb5rbiC0qwjfvIHSj7YFB3XvzwtN9vw/e5VEuh8kV4fFi3pQ7awFKE= ARC-Message-Signature: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1763734332; c=relaxed/simple; bh=N7+zYOdrJZ7FIL476RpLrz5wXoXB6jWLw/EraOMqSBU=; h=From:To:CC:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version:Content-Type; b=DPDow1/rgKEhHtUPrISSnMIooAUf5f6Woir+Hf8tucHlH2yFBICc64PzL+5nJr39ePRhLV+MgIJoFmGrPSUVxnybnfQ3hw8i588MJlYjNcGIwPoDfIvRpA/WZ0oQFCIOd+nJMYkffLXhmumErj8tVssAMs4f6deZwMUWpAsgkUM= ARC-Authentication-Results: i=2; smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=nvidia.com; spf=fail smtp.mailfrom=nvidia.com; dkim=pass (2048-bit key) header.d=Nvidia.com header.i=@Nvidia.com header.b=m4/zdXwD; arc=fail smtp.client-ip=52.101.85.22 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=nvidia.com Authentication-Results: smtp.subspace.kernel.org; spf=fail smtp.mailfrom=nvidia.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=Nvidia.com header.i=@Nvidia.com header.b="m4/zdXwD" ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=OQuhiDPnRrNqZMhzu+aN1DaID4zsjbNDolYRocRlnCCDafp1/7/+C+maWwaimwVH3IjJEJsfTj4zk2sZGQThLKGQqEX6PEmXtzmdajI9lC5H5zBU3xnn5MrlNu0eAhPziojy7cL/mWdS4rPmevHT+Nv/CWCcxhikXaQZK7n1HfCVdGKbjLf9GB70QCVUthI1WAAKfBxVDYQ0DVTX2FSGAad5eOBMPvjzoGRXJppSAv6Jkw51VNNykJth8uoIyPMDtXT6UDx15ooj45vn4Ec13TuKittA22KPhb0cKDXtjbyVQd067UbSsfWfKaeE6RfvFlAXpgw1PLFKy5i0nCuktQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=1gIwnXlwC5nA45FDLzSeoV2hjFrKoOSTsb3afesgyis=; b=K4Rkh3WIaRQKP/AaL7V4ptLp1BqOwlaArOHRtqdBxPrkhPETiQHT1qJnZsG0CvHKSmeHoNRBWYckJS+1rrVo1Nn9Wf8DK3F/1n1+smh9yWZQIAyNf3Rhdo6snG0XAIiPoHTzc+GZPz4iNaJeUpybQ67RC6hrKn61Z7O5kjPc0V87F13AMe6uN79sBgBaPfSvjeNGREnmwDtCyktp10jdCzTt5nimpR6+hZh4X/vd1/zEE+e1wtq4z/cYY+RFVa0LPHzYl/GlPEFlbPksxcu6s+6VGBQjfkN7Gk7rz81ZYmCnVWEAxsEWqaiurgknicTlcFOSUId4YLeD5y0whJ8Dlw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 216.228.117.161) smtp.rcpttodomain=vger.kernel.org smtp.mailfrom=nvidia.com; dmarc=pass (p=reject sp=reject pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none (0) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=1gIwnXlwC5nA45FDLzSeoV2hjFrKoOSTsb3afesgyis=; b=m4/zdXwDU1KtaSccG2rVAqSd5ShwunYHOOHpGiK36aREygWmKLTKg8NQCTksSyRpkPT5OCPjgYbeaQSBfXmJOvr2rOWccj3AJCNqRBNSpBDtGuUKzPEF0FrrzTZMBNFxKPmhvtY6ufXqfsE/uTuxZUIMw7vlPzqV8rP/8ihmDaXw69DcWpUoJSDVwojOzHw4/56gbetSbnVW6V5Ff2EnTZI5UWzooLtvtfXwb1/vfSzuwiY3RRebQQUp4gurxvhwvcXOKitjkNDc85QwZ1FH90QPDPZmya2u0OxHdzU5+jX7jA7lyJa/6rPcP+Mp3BzmxE6fr00/3UV7CP81cMWylw== Received: from CH0PR04CA0115.namprd04.prod.outlook.com (2603:10b6:610:75::30) by DS7PR12MB5983.namprd12.prod.outlook.com (2603:10b6:8:7e::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.9343.11; Fri, 21 Nov 2025 14:12:06 +0000 Received: from CH1PEPF0000AD78.namprd04.prod.outlook.com (2603:10b6:610:75:cafe::3b) by CH0PR04CA0115.outlook.office365.com (2603:10b6:610:75::30) with Microsoft SMTP Server (version=TLS1_3, cipher=TLS_AES_256_GCM_SHA384) id 15.20.9343.14 via Frontend Transport; Fri, 21 Nov 2025 14:11:56 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 216.228.117.161) smtp.mailfrom=nvidia.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 216.228.117.161 as permitted sender) receiver=protection.outlook.com; client-ip=216.228.117.161; helo=mail.nvidia.com; pr=C Received: from mail.nvidia.com (216.228.117.161) by CH1PEPF0000AD78.mail.protection.outlook.com (10.167.244.56) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.9343.9 via Frontend Transport; Fri, 21 Nov 2025 14:12:05 +0000 Received: from rnnvmail202.nvidia.com (10.129.68.7) by mail.nvidia.com (10.129.200.67) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.2562.20; Fri, 21 Nov 2025 06:11:44 -0800 Received: from rnnvmail204.nvidia.com (10.129.68.6) by rnnvmail202.nvidia.com (10.129.68.7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.2562.20; Fri, 21 Nov 2025 06:11:44 -0800 Received: from gb-nvl-073-compute01.l16.internal032k18.bmc032b17.internal032f11.internal032huang.bmc032l04.bmc (10.127.8.11) by mail.nvidia.com (10.129.68.6) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.2562.20 via Frontend Transport; Fri, 21 Nov 2025 06:11:44 -0800 From: To: , , , , , , , , CC: , , , , , , , , , , , , , , , , Subject: [PATCH v3 4/7] vfio: export vfio_find_cap_start Date: Fri, 21 Nov 2025 14:11:38 +0000 Message-ID: <20251121141141.3175-5-ankita@nvidia.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20251121141141.3175-1-ankita@nvidia.com> References: <20251121141141.3175-1-ankita@nvidia.com> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable X-NV-OnPremToCloud: ExternallySecured X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: CH1PEPF0000AD78:EE_|DS7PR12MB5983:EE_ X-MS-Office365-Filtering-Correlation-Id: 1435c759-d269-437c-97c8-08de2907f395 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|7416014|36860700013|376014|82310400026|1800799024; X-Microsoft-Antispam-Message-Info: =?us-ascii?Q?f59TzNrzQSMITXec/kID0T30nwcxs7B6po82jziu4BHd3SWZJGLbbrrTT66m?= =?us-ascii?Q?EDS7TQMt8iz186LcO6cu7YnTQa4JohJfY0aYbDxD/D5CM7Akfwh3DuqpDGvE?= =?us-ascii?Q?mXsMGV70QcoWLhWC0S2hbaAyJdpuxAsEwlr5oE5R0qfYhsDnZFMMdkNvPv+z?= =?us-ascii?Q?fMKjkKLYdejI9RteqVO/iSXmDUFTNaV6U5mUZcE6//p0BX0vwkbmHzaM+zRg?= =?us-ascii?Q?TqjrYqb9C+epQl3wovYnvHNa6Zh+1nL+sxVAHv26GxF3tD2NepkW01tHvh0M?= =?us-ascii?Q?Bufe0xfs7e7bYD8sQANZRmZrPfU3aI0RNdSuJHqTUWoetVIymZFP1AM+sCqU?= =?us-ascii?Q?x9NUvBlUsgpx7f3ASMx8VPJgWbjPXt5rxbinjrWxjfpbwnk35df6zyVVjY3Z?= =?us-ascii?Q?uPUOX6Fp7/4sXd0sWyxBQttOM2R6KhZ4dnI+cWmaNE0Mx9sE7iR//gLKcU1z?= =?us-ascii?Q?IIzkYV4vtAVf7qhqxcrt7GpmWpWJtZ3WRCByUR8VTTatmpafZI8JHREiwTSN?= =?us-ascii?Q?bFVQjnuwAtUE9T53a37sppBQVwlfiIEUwZ+xp2e1+t6+Vl1OhYE1ycofyUB4?= =?us-ascii?Q?IWrYFJeNGBuMrBLEiaxSzg5saunaANhrQR/LUZsHPVENJX02fJEorD1TynOZ?= =?us-ascii?Q?/fjrlAzvcGuyRgBlNPcnP7HuArsnvM4dc1QEJOB6IoZbOPw1OUlp9EJtvUHh?= =?us-ascii?Q?y6Z27PmrtWURpQwWET+IUcior2omDMZwy+7HAwMK9/s4g917QFqmyA9mybUi?= =?us-ascii?Q?IfZ7a01c0AVgNM8Xi2ZqQST2XW3NODcWyy1WK5luwgkG4u8+fe+J3SuWWcjG?= =?us-ascii?Q?9DfQ65d5nuOPGKluzbWksoK6bXIVey9u4wpzLRxVEauxw22xENs92YfSssCp?= =?us-ascii?Q?VYUKBF3HjvjkUYMhhx5ggk2xhMoB+d8EIoTVE9Q+05VBjG27Ep8jXZeo7Qsj?= =?us-ascii?Q?fgRh3JjH/8Uzq2IwjjGtie2wml8nmCrk5DnD6iWz2JaCOrE4dO1ZPMlZdomx?= =?us-ascii?Q?+2jLnx1hRoT0RXLM+WFKb8IgZEYiMuCqBOtsSaYZDnDzlN/B4eT6wuam0GHx?= =?us-ascii?Q?Cwi/1Xyim0gZUF/Ng0Sg3qiIBlqMQwpIEpMXp85/qvGxZmc8VqGbuS8IbeBn?= =?us-ascii?Q?mcNJNyEhUBZq3lxonODBalkd7lAJV6h4TEkZoWCN3K7iaOZnDnuXst8qB4d/?= =?us-ascii?Q?Uy0813gigab8AQXFE6In52QE9aj6yY9leW+jYwRXB5ZG2KEV7uMeceXXKzVq?= =?us-ascii?Q?NlvdntSFuYWmZDTJec2PY84PlK1fqtGHAWFmGv5ISF3rXRmxVbE2DItKwGL2?= =?us-ascii?Q?WDr5WcA7LTGCIJjVup+1MOqTI3U1SHS71oSDvaCCHUnBAfLd4cvgSn+0AmN7?= =?us-ascii?Q?+K4BYSfFlhfZ8c8TOmDwlBqkLzZ6HNtHQW70eUXQH6zmxX951adWtfjt9v3H?= =?us-ascii?Q?Ze0YstSaHdNQAeXGeEqdaVUWe9gZRSSSDAibmtl85BZlfqocNB2nkZzSvtBR?= =?us-ascii?Q?MRo583w077g+j7T3Xo+fJuio+Il7FVxH5UzcTPdslDdMbWMx29NQi74iG+qK?= =?us-ascii?Q?QuGLhNh3iFpeyNA6Qm4=3D?= X-Forefront-Antispam-Report: CIP:216.228.117.161;CTRY:US;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:mail.nvidia.com;PTR:dc6edge2.nvidia.com;CAT:NONE;SFS:(13230040)(7416014)(36860700013)(376014)(82310400026)(1800799024);DIR:OUT;SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 21 Nov 2025 14:12:05.9553 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 1435c759-d269-437c-97c8-08de2907f395 X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a;Ip=[216.228.117.161];Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: CH1PEPF0000AD78.namprd04.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: DS7PR12MB5983 Content-Type: text/plain; charset="utf-8" From: Ankit Agrawal Export vfio_find_cap_start to be used by the nvgrace-gpu module. This would be used to determine GPU FLR requests. Signed-off-by: Ankit Agrawal --- drivers/vfio/pci/vfio_pci_config.c | 3 ++- include/linux/vfio_pci_core.h | 1 + 2 files changed, 3 insertions(+), 1 deletion(-) diff --git a/drivers/vfio/pci/vfio_pci_config.c b/drivers/vfio/pci/vfio_pci= _config.c index 333fd149c21a..50390189b586 100644 --- a/drivers/vfio/pci/vfio_pci_config.c +++ b/drivers/vfio/pci/vfio_pci_config.c @@ -1114,7 +1114,7 @@ int __init vfio_pci_init_perm_bits(void) return ret; } =20 -static int vfio_find_cap_start(struct vfio_pci_core_device *vdev, int pos) +int vfio_find_cap_start(struct vfio_pci_core_device *vdev, int pos) { u8 cap; int base =3D (pos >=3D PCI_CFG_SPACE_SIZE) ? PCI_CFG_SPACE_SIZE : @@ -1130,6 +1130,7 @@ static int vfio_find_cap_start(struct vfio_pci_core_d= evice *vdev, int pos) =20 return pos; } +EXPORT_SYMBOL_GPL(vfio_find_cap_start); =20 static int vfio_msi_config_read(struct vfio_pci_core_device *vdev, int pos, int count, struct perm_bits *perm, diff --git a/include/linux/vfio_pci_core.h b/include/linux/vfio_pci_core.h index 058acded858b..a097a66485b4 100644 --- a/include/linux/vfio_pci_core.h +++ b/include/linux/vfio_pci_core.h @@ -132,6 +132,7 @@ void vfio_pci_core_finish_enable(struct vfio_pci_core_d= evice *vdev); int vfio_pci_core_setup_barmap(struct vfio_pci_core_device *vdev, int bar); pci_ers_result_t vfio_pci_core_aer_err_detected(struct pci_dev *pdev, pci_channel_state_t state); +int vfio_find_cap_start(struct vfio_pci_core_device *vdev, int pos); ssize_t vfio_pci_core_do_io_rw(struct vfio_pci_core_device *vdev, bool tes= t_mem, void __iomem *io, char __user *buf, loff_t off, size_t count, size_t x_start, --=20 2.34.1 From nobody Tue Dec 2 01:30:21 2025 Received: from CH4PR04CU002.outbound.protection.outlook.com (mail-northcentralusazon11013020.outbound.protection.outlook.com [40.107.201.20]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id A6F19346A1D; Fri, 21 Nov 2025 14:12:15 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=fail smtp.client-ip=40.107.201.20 ARC-Seal: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1763734337; cv=fail; b=N3ytuBhOY/ZxPrGJ/YlKPp8Gfj2SpAXfplQNhujleayCswbze5W3KBxVHlorhXWxg9Wo9VE5tETJr5jVR70ldaKk2/MKoI8InzaQTF2E/vzMlxSS0m9+ZC1tlZO0s6KT0xmDFJciiUu+rhbkFdgfSMqpODTDKOlIUcp9EUFydNo= ARC-Message-Signature: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1763734337; c=relaxed/simple; bh=NaAJlxM3M06vyDgnmJymJnSmeWIlipt8GYfR3DpAnNU=; h=From:To:CC:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version:Content-Type; b=hp3syWqw0TnA4wWDndGVW+J0gNhuRBMfpa79wj9Ha8N2dDkyvEvV5pKlfwsb99j6RZdZR0vv/Flc3IO4I29kYPjQql3xsgFzc1uAB3ziJlRKxbx5cdd/rSebPvFRQBP0q9d9z0agSdpNHXGOQ2xsBbMlx6OcSWoMNBAimdjodvA= ARC-Authentication-Results: i=2; smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=nvidia.com; spf=fail smtp.mailfrom=nvidia.com; dkim=pass (2048-bit key) header.d=Nvidia.com header.i=@Nvidia.com header.b=QzDsSZln; arc=fail smtp.client-ip=40.107.201.20 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=nvidia.com Authentication-Results: smtp.subspace.kernel.org; spf=fail smtp.mailfrom=nvidia.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=Nvidia.com header.i=@Nvidia.com header.b="QzDsSZln" ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=jEFr2DdlzLd1ZHUpeDIMpR1+uwZYvrTpJHTB/b1RpxOwn4KegkcLgYE5sjXoE8PhNkNja+LoTTKON1+vG/HvKv4iJVjm2U0qtoATx5Z5AmMnfCx+97l6Mex6U+JwjnSfskcMMSElr/APcX0RspniZCqS5o8fHrelLorC0yp8jUlHKjmWjV7DkeYPXn1SDPB4AKOl1rd1vogWWO9KCt/jQm/NjD0KARrxgGt0Lj9ZeOwsLlqKKGiVIe5cte9kNkVmfDP6Hts+eomhMGWwuvviet3k1Rwyphky1glLKQOI8O8GnKz+g9y6TFLhIVuEbW6jw/QXprjnMnij3Dief4LWIQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=oHfgp8s0wBeYJuyEtHx3U2tjJr9f5+2J/TFzMrHqNqk=; b=Kk+2KtRXLk5QUHjctT/qm/6wPgTfDiR0LMuvY2sixnmB1DETlxrjIBO4BpNg+ZUaOZpPhZVGckCL66SFyhvMIDa4DBTzivCvxAXXjqohTavSUrZxNQkvWpd4kAtNPyy3EfYxdkbbqyc+30Kb8weic2xTId4AUZ9h4zkvAMjZsh9zq7f0Cf/U9wbc3o0c79sZDev9c6wJYmCAMToxXMay7fhCZ3I5Lzt3WBVYo51XmKusdwEoMLldHN47pM0Iv1n5Ng1nMu40hoy7H1fqVC+klAAeAdQwfPBPcycV2p3qrP2tz0k/m/OiBhaWr6Y55tRuD+80aTR/uQVAf0ced/hD+g== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 216.228.117.160) smtp.rcpttodomain=vger.kernel.org smtp.mailfrom=nvidia.com; dmarc=pass (p=reject sp=reject pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none (0) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=oHfgp8s0wBeYJuyEtHx3U2tjJr9f5+2J/TFzMrHqNqk=; b=QzDsSZlnLV0A/YWgtJNgIVM75JScYMMVDMEvWDWcL+UfIRslgs49O8f2LCCVs+1dumg6uAyqMoIpVLBQoneew5d6/9xKILdAqrZk/GP50Tk0x5QyUU6Ps9ljljPtc1K8JSFJ4j/TFgQKlhf8tgHry6XhHZ035VQ98Z6RKLaL2ENC8hzgRexMGucWuD50M3aU48hydBHqcYK4LvW5c0bAkr/UyrpYrc5mz3uihh4kKeTjE6zH2z2Qk5RDlJUc9u6mRdyahartCqslLZuNg3FulbEjP/yn3AlMMH99Nyl4PDj/Mwru4gP/2FCry5yZaxogwo0VrORbglftWNUQ29GPWQ== Received: from MW4PR04CA0241.namprd04.prod.outlook.com (2603:10b6:303:88::6) by MN0PR12MB5980.namprd12.prod.outlook.com (2603:10b6:208:37f::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.9343.11; Fri, 21 Nov 2025 14:12:11 +0000 Received: from SJ5PEPF000001CD.namprd05.prod.outlook.com (2603:10b6:303:88:cafe::b) by MW4PR04CA0241.outlook.office365.com (2603:10b6:303:88::6) with Microsoft SMTP Server (version=TLS1_3, cipher=TLS_AES_256_GCM_SHA384) id 15.20.9343.11 via Frontend Transport; Fri, 21 Nov 2025 14:12:10 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 216.228.117.160) smtp.mailfrom=nvidia.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 216.228.117.160 as permitted sender) receiver=protection.outlook.com; client-ip=216.228.117.160; helo=mail.nvidia.com; pr=C Received: from mail.nvidia.com (216.228.117.160) by SJ5PEPF000001CD.mail.protection.outlook.com (10.167.242.42) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.9343.9 via Frontend Transport; Fri, 21 Nov 2025 14:12:10 +0000 Received: from rnnvmail202.nvidia.com (10.129.68.7) by mail.nvidia.com (10.129.200.66) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.2562.20; Fri, 21 Nov 2025 06:11:46 -0800 Received: from rnnvmail204.nvidia.com (10.129.68.6) by rnnvmail202.nvidia.com (10.129.68.7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.2562.20; Fri, 21 Nov 2025 06:11:44 -0800 Received: from gb-nvl-073-compute01.l16.internal032k18.bmc032b17.internal032f11.internal032huang.bmc032l04.bmc (10.127.8.11) by mail.nvidia.com (10.129.68.6) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.2562.20 via Frontend Transport; Fri, 21 Nov 2025 06:11:44 -0800 From: To: , , , , , , , , CC: , , , , , , , , , , , , , , , , Subject: [PATCH v3 5/7] vfio: move barmap to a separate function and export Date: Fri, 21 Nov 2025 14:11:39 +0000 Message-ID: <20251121141141.3175-6-ankita@nvidia.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20251121141141.3175-1-ankita@nvidia.com> References: <20251121141141.3175-1-ankita@nvidia.com> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable X-NV-OnPremToCloud: ExternallySecured X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: SJ5PEPF000001CD:EE_|MN0PR12MB5980:EE_ X-MS-Office365-Filtering-Correlation-Id: b432aad7-4ce3-48f7-bd6f-08de2907f61a X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|7416014|376014|82310400026|1800799024|36860700013; X-Microsoft-Antispam-Message-Info: =?us-ascii?Q?F1QNwf/mApbTDnxAdoLlcg3FeB8W5PhxC8C91exfTnGhZEcEjFJ82hIOt1BZ?= =?us-ascii?Q?TAbAJdG6YbedHNlF8mrK6RnYzvG8MEp/0dli2mULYD/sFH+07RVjNu5GAD9L?= =?us-ascii?Q?cY/MNXHlUzkqjtrVv2XC4OxPhlCIYvCdVVL2rtRJJx1HIug8qEAXRpCH5Nnw?= =?us-ascii?Q?i3SQKT90KqVDVeKJ+e4zvhTSZTYCJz+5tiVBVcXjarAwdiGwhGxjKwUzaTSU?= =?us-ascii?Q?sjNJyyMwM27Cnuu6TgXAfc72dQw5QlJ7QtxSCu+Ucl637As4dNlRkYB/J78X?= =?us-ascii?Q?+pRrsBk3Dgq4SzYQKIF1w+bBKZYwzWbFoJcv4z2Ty6kUipjANuJu3C0QVK0v?= =?us-ascii?Q?nEb7jMjzc1STSEqF496wPBu/5bNUZvLMV4TP0wP/P0IAYcsRGZa9g4TIymTH?= =?us-ascii?Q?NJEea0NhiLx+h3Hv9E2z2nlCjqogXlnWTNY+1gvP62v2lTeL6sI6+xYk8shZ?= =?us-ascii?Q?NkYzsUq7g8nc55rpXcAIPpmMSHZu+VxBtg29u+34lnxJ30UNNFkVSxGVjQO4?= =?us-ascii?Q?CADQxvYPux5DEVS5qqLL3v2xcxFR2Y121W5DKdnbHHk2xzBfAu6u60LmObRi?= =?us-ascii?Q?SVEYMDD9EXPfOj4ZrPni/ErskyeDIMzM+DbWzBl6dE1lehm2J6wf1qKAMj3W?= =?us-ascii?Q?9f0nRTgvirE6thFGwPbGmr7pAgaMzLRwDENFwwUrZWY2TenYfDSvwM2q/zi4?= =?us-ascii?Q?ES2gHKBEtqTisVhMiFaj5T2B0XzrbtM2+X+Vk1YFT2tUOWSCZi8qDO6cjI4w?= =?us-ascii?Q?T+YeWSm5SASuaH0H7SS6+wzDkUmrqK7Z1JgXgfKWVpuqp3krz4ZYypHjOsjC?= =?us-ascii?Q?ZcDaZybja7udSGHH0Ldyw+LjwBhyNlBDXKZqoeYAdO5D9Bs5KIuXYex2btov?= =?us-ascii?Q?3WuF/OLpo8hpAl577XHQEblH/s2Uy/UmyeivhZzc+boBbMpnyREbdZeHjgaZ?= =?us-ascii?Q?bnKifGvz/rytwSSpIVVzwlMDT6pyaGzH01Bh6282yOniPVf/QYVk8NmiALy1?= =?us-ascii?Q?Y0PGbsl4ixQ3nivXEKfuaG2tymwZN/v5nBehfLKaL6ARVgRdh3cYz938CsoF?= =?us-ascii?Q?LpXdfXOX24aKBnRjmYfyoaJJ5baqxAZMNnAGYlJ+vuPpl6MxYhLUwZSNmW7Z?= =?us-ascii?Q?GSHZQehj+8MPpGrDipM+21tLN/qLZ+CoC9krRxz2lV2ipeZ/314qT+1CJnjD?= =?us-ascii?Q?McCHLLYkPBsB4qWaJNNDLEAyxHFwT0bb+6pqA/jJxKNe8dUuIXeSSZKgH2HQ?= =?us-ascii?Q?Suw4zCT2ex7GAkOieDvkQN9CMyM5nWbw/tSgDJg56+8y9+r/7CvAgvTfTEbe?= =?us-ascii?Q?8VSyKa1evPkhbI6b2LDOpyVltg+JlOzMIHPv8oFYkRpRc849cvpdL+cly4Bf?= =?us-ascii?Q?R21Yqmyfl2j9gV+3lwwL/QcSuVSWmGZHl8y0r4GXZRjfdYmqYtVmzDj63Kq+?= =?us-ascii?Q?dSlr3jAl4wCJjN3Y+gRNXoEI+LITRAXXXluoqeL2kOKvorULFOZSA2Qef9Fx?= =?us-ascii?Q?OfBUzQnamZByNi4y/UNQ3KdMR/5RUwzloZFKaJ0nXv/C/6rOFOjlXNmA6nUE?= =?us-ascii?Q?Rhu70Oq/6CwzGDgSveA=3D?= X-Forefront-Antispam-Report: CIP:216.228.117.160;CTRY:US;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:mail.nvidia.com;PTR:dc6edge1.nvidia.com;CAT:NONE;SFS:(13230040)(7416014)(376014)(82310400026)(1800799024)(36860700013);DIR:OUT;SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 21 Nov 2025 14:12:10.2311 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: b432aad7-4ce3-48f7-bd6f-08de2907f61a X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a;Ip=[216.228.117.160];Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: SJ5PEPF000001CD.namprd05.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN0PR12MB5980 Content-Type: text/plain; charset="utf-8" From: Ankit Agrawal Move the code to map the BAR to a separate function. This would be reused by the nvgrace-gpu module. Signed-off-by: Ankit Agrawal --- drivers/vfio/pci/vfio_pci_core.c | 38 ++++++++++++++++++++++---------- include/linux/vfio_pci_core.h | 1 + 2 files changed, 27 insertions(+), 12 deletions(-) diff --git a/drivers/vfio/pci/vfio_pci_core.c b/drivers/vfio/pci/vfio_pci_c= ore.c index 29dcf78905a6..d1ff1c0aa727 100644 --- a/drivers/vfio/pci/vfio_pci_core.c +++ b/drivers/vfio/pci/vfio_pci_core.c @@ -1717,6 +1717,29 @@ static const struct vm_operations_struct vfio_pci_mm= ap_ops =3D { #endif }; =20 +int vfio_pci_core_barmap(struct vfio_pci_core_device *vdev, unsigned int i= ndex) +{ + struct pci_dev *pdev =3D vdev->pdev; + int ret; + + if (vdev->barmap[index]) + return 0; + + ret =3D pci_request_selected_regions(pdev, + 1 << index, "vfio-pci"); + if (ret) + return ret; + + vdev->barmap[index] =3D pci_iomap(pdev, index, 0); + if (!vdev->barmap[index]) { + pci_release_selected_regions(pdev, 1 << index); + return -ENOMEM; + } + + return 0; +} +EXPORT_SYMBOL_GPL(vfio_pci_core_barmap); + int vfio_pci_core_mmap(struct vfio_device *core_vdev, struct vm_area_struc= t *vma) { struct vfio_pci_core_device *vdev =3D @@ -1761,18 +1784,9 @@ int vfio_pci_core_mmap(struct vfio_device *core_vdev= , struct vm_area_struct *vma * Even though we don't make use of the barmap for the mmap, * we need to request the region and the barmap tracks that. */ - if (!vdev->barmap[index]) { - ret =3D pci_request_selected_regions(pdev, - 1 << index, "vfio-pci"); - if (ret) - return ret; - - vdev->barmap[index] =3D pci_iomap(pdev, index, 0); - if (!vdev->barmap[index]) { - pci_release_selected_regions(pdev, 1 << index); - return -ENOMEM; - } - } + ret =3D vfio_pci_core_barmap(vdev, index); + if (ret) + return ret; =20 vma->vm_private_data =3D vdev; vma->vm_page_prot =3D pgprot_noncached(vma->vm_page_prot); diff --git a/include/linux/vfio_pci_core.h b/include/linux/vfio_pci_core.h index a097a66485b4..75f04d613e0c 100644 --- a/include/linux/vfio_pci_core.h +++ b/include/linux/vfio_pci_core.h @@ -121,6 +121,7 @@ ssize_t vfio_pci_core_write(struct vfio_device *core_vd= ev, const char __user *bu size_t count, loff_t *ppos); vm_fault_t vfio_pci_map_pfn(struct vm_fault *vmf, unsigned long pfn, unsigned int order); +int vfio_pci_core_barmap(struct vfio_pci_core_device *vdev, unsigned int i= ndex); int vfio_pci_core_mmap(struct vfio_device *core_vdev, struct vm_area_struc= t *vma); void vfio_pci_core_request(struct vfio_device *core_vdev, unsigned int cou= nt); int vfio_pci_core_match(struct vfio_device *core_vdev, char *buf); --=20 2.34.1 From nobody Tue Dec 2 01:30:21 2025 Received: from CH5PR02CU005.outbound.protection.outlook.com (mail-northcentralusazon11012070.outbound.protection.outlook.com [40.107.200.70]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id AC8CA337B90; Fri, 21 Nov 2025 14:12:13 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=fail smtp.client-ip=40.107.200.70 ARC-Seal: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1763734335; cv=fail; b=TSjGcLHdPdYKZxnuZwDxRGwNi0sA6wbtXxYNuuVPbpqrcnlSlmefszS34PNsOh4bZZBlWUWoYJlU7s/a0r2GAMCh8SVSlITfivHk7HUi1r5cPi1RtdwjRt7aO8t3MyMufFuZTdAdUc7KZY61y6/o56IR5S5ZK08+0pwAcI0PqVc= ARC-Message-Signature: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1763734335; c=relaxed/simple; bh=VyLM6liVDQC9hlNtzFGPHAIgjHrZHTpyKsBlehu8CTc=; h=From:To:CC:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version:Content-Type; b=COMGrKgchPm6eyzvY/2YV+dw90CEZzSNX6AdA6bWl6m8zyOkmQIcQtXlRFKdZf/VStrnuInNFykIK+3VJjDMDE1CueT7xfWXm6rPfekJ7a8jwvbxErhcDd+CVarwJ9Y9ksfMryml3a5X7k7AaWSKIr+vRG0bTsFFbW2fwiL6gIU= ARC-Authentication-Results: i=2; smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=nvidia.com; spf=fail smtp.mailfrom=nvidia.com; dkim=pass (2048-bit key) header.d=Nvidia.com header.i=@Nvidia.com header.b=bsmzT3Ai; arc=fail smtp.client-ip=40.107.200.70 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=nvidia.com Authentication-Results: smtp.subspace.kernel.org; spf=fail smtp.mailfrom=nvidia.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=Nvidia.com header.i=@Nvidia.com header.b="bsmzT3Ai" ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=N+Wh3zeZnmQugmEZfkul8fuc9o7VnKHHi/9ZggdnbaX0U4MPed0/RygcuXBANjXdt7vqwIijwPTd7kEFvu8UclnLU6miEWXEvwVZ72MA+2yo/h6Up/J+1AvyjoFiukrQACsNGjDuxHx8e6HqjuSGHklHEfIH3Drb9qqltMdHaf5eLX6wyGU1oENXaevY8asIOai6hnVPg36pp76aj0oLEm+ybCiID+P6cEWcDqb1fOq1w9YBtlJ+YdiCBwuZuK1JJQQsxwxR2JZflFQuOKFVntcNF+PegFY4jKJEBIqJ0edOU2OEqsRnOOutWozfrU/qAhsS+1UEz8X1nF+t9auYlQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=5tpAxSuayLF9nR1BoJltoWgKnaT5kvM4z8pn3GvDtJc=; b=aTSEwidzLe0+gTABiGnS0qnU3ECzFDEsxbhzTUxhuyDiBDnfM0honsc1YoMBYCvWSw9tyNSk8C/f5SVD4vX62kgq7Rcmp9kaHw8dTelK0GIhOE/Rrxqkv6iTWH5NPqH8Cub1j6TjoaUEUl3wRCEaSAWSIWDV6WtsmguKJxgcHFJTxCTc3XhkyZa4wWCdJ1+5iPMGX/AA8a9AUQ/6DnHv/D02Xu2NNKHiTyN9ph2+EUEI43jFKnVKxhOGv4bCT/ivybCCoZXcI0l7E1sWmY/NL7c6/ysPWt0XrUiZArWJOwuk4jDwyf/sl7NHj5YkWAEoxAEeZtf1+pIG5uoRWbLnoQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 216.228.117.161) smtp.rcpttodomain=vger.kernel.org smtp.mailfrom=nvidia.com; dmarc=pass (p=reject sp=reject pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none (0) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=5tpAxSuayLF9nR1BoJltoWgKnaT5kvM4z8pn3GvDtJc=; b=bsmzT3AideQWHIxP2PJk/cWfHEwTQ5uhIXeOtEnJBkspTmHdSnFYbwIwb5gR2c9+AIFG5sDGXGVWiN8917hnPegDZvV62eFM2NCqmglA5JxNL9f4oGBQjiZW062hCGpHdDnjyzUy6nrcNWeQww4lgSfxo1sBjdqDRHoKoDh9KzIRVe6ElvndLRp5CleVABlpzrrApm6+BU1exwDPL/q9jOB7lQ1q3T6XxVEepVVfYtRW5MxhnshCqZG0z807KTo4AiiywZrMY+nA80VBYp7xr8To7sgVN5AQtj8l0b4v9f8J5el/TFaDaKKjz4/bYb9IqA4fFVw6SljETr9KZgeOWA== Received: from CH2PR14CA0056.namprd14.prod.outlook.com (2603:10b6:610:56::36) by DS4PR12MB9820.namprd12.prod.outlook.com (2603:10b6:8:2a7::15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.9343.12; Fri, 21 Nov 2025 14:12:07 +0000 Received: from CH1PEPF0000AD74.namprd04.prod.outlook.com (2603:10b6:610:56:cafe::fb) by CH2PR14CA0056.outlook.office365.com (2603:10b6:610:56::36) with Microsoft SMTP Server (version=TLS1_3, cipher=TLS_AES_256_GCM_SHA384) id 15.20.9343.14 via Frontend Transport; Fri, 21 Nov 2025 14:11:56 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 216.228.117.161) smtp.mailfrom=nvidia.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 216.228.117.161 as permitted sender) receiver=protection.outlook.com; client-ip=216.228.117.161; helo=mail.nvidia.com; pr=C Received: from mail.nvidia.com (216.228.117.161) by CH1PEPF0000AD74.mail.protection.outlook.com (10.167.244.52) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.9343.9 via Frontend Transport; Fri, 21 Nov 2025 14:12:06 +0000 Received: from rnnvmail204.nvidia.com (10.129.68.6) by mail.nvidia.com (10.129.200.67) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.2562.20; Fri, 21 Nov 2025 06:11:46 -0800 Received: from rnnvmail204.nvidia.com (10.129.68.6) by rnnvmail204.nvidia.com (10.129.68.6) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.2562.20; Fri, 21 Nov 2025 06:11:45 -0800 Received: from gb-nvl-073-compute01.l16.internal032k18.bmc032b17.internal032f11.internal032huang.bmc032l04.bmc (10.127.8.11) by mail.nvidia.com (10.129.68.6) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.2562.20 via Frontend Transport; Fri, 21 Nov 2025 06:11:45 -0800 From: To: , , , , , , , , CC: , , , , , , , , , , , , , , , , Subject: [PATCH v3 6/7] vfio/nvgrace-gpu: split the code to wait for GPU ready Date: Fri, 21 Nov 2025 14:11:40 +0000 Message-ID: <20251121141141.3175-7-ankita@nvidia.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20251121141141.3175-1-ankita@nvidia.com> References: <20251121141141.3175-1-ankita@nvidia.com> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable X-NV-OnPremToCloud: ExternallySecured X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: CH1PEPF0000AD74:EE_|DS4PR12MB9820:EE_ X-MS-Office365-Filtering-Correlation-Id: 66335f01-cfed-4bd8-6938-08de2907f3c2 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|36860700013|1800799024|82310400026|7416014|376014; X-Microsoft-Antispam-Message-Info: =?us-ascii?Q?yNVIP9YUNbXR8HTkzlgOfLxV7sqeC/5Xqq7i5TZRlXunR93ka5pbMEshVnFQ?= =?us-ascii?Q?uOv46wNUAkzF6ulRIqDqRNEUMW2BddOiSZojlBklLWCQShqXz5ZLIqpk63sm?= =?us-ascii?Q?A2N97rC9v2UXe5Zc/4aRhmmR0fwW2/JQt24otKJ4xLX4zIJlU30QSC6+WYY4?= =?us-ascii?Q?seR2+/7LLssBw2oLoXXWcTzBVeq0hamnFUZdm3KwedvGIsQ5ZfCnbx4M574M?= =?us-ascii?Q?NIFlWBPIPA4kHndWL71FY9yIbqU2s6gzpOhUVmxSb4A7h3eTsQs3al/BMyyE?= =?us-ascii?Q?JTbyqP3F6qC7qLr5y0gKiqLSrYqi7ke3L6C4DJh5DO+LSjP8B3Ua1Dj7pFVV?= =?us-ascii?Q?7X4/y4kfGHBymqWNR43uBRmoc8DE2NLYEYF4EjdF9x7HH817D+3bZw5wdt3T?= =?us-ascii?Q?ocL1geVZ5QjH+4y6hgX/9xhYEEjTM2WvFIQAke4fZzV7dJETH8EIbFmiS3lh?= =?us-ascii?Q?LVS2BfhLK/txkBV54Z7sfO4Gc86Df55kBCGbI93xwLhcStQ9NW1cyzaJWGZn?= =?us-ascii?Q?5+zMfUp6DK+vgYDWaFDpfDzsbsMkJ22XIYDOkwsRl9433qjEgHVyunCiqYXc?= =?us-ascii?Q?B9mHenw5eDJA/4iokAkwiQXTbuLE2xoQvLbZ2EXLAYwptJP29PLJxDFO9QGd?= =?us-ascii?Q?0oQIMDPSGJbMsiB6mxH9avUBC8FmREg0rEky2nsFd+K1a3HLLoOxS1uBS6uf?= =?us-ascii?Q?y9bvgKuRg8FREMNRHY4D1XTYQAsELlkyb5JPdd0v0thekn9lBSmucPTcsTVK?= =?us-ascii?Q?bWP+KIf20n4iFTjFo3eytY+fLWKX8ZI0ZatTFsghLjWEuNPk0EP0bgfE3/sd?= =?us-ascii?Q?1QRod4Jm0Tcp9eqNpL0T65P8pvfkHEuZgKevr4SdghOHGk/E6Wj/53w4S4vT?= =?us-ascii?Q?8aF7AXAp7RatAqePwyFHhI4YGWnvgQ6cc+r5809ZIt7tPv246cftE6hQIxkl?= =?us-ascii?Q?syA2StqluGbytjaEXK9q2c9oEb8MLo3BcTyDJVU7WFnWyJh3ij/kH2yh3Xyc?= =?us-ascii?Q?IInx2RgjwR1pZGD5a8jrEVjk20vN/o1p841CB2xTwUthYvS8D2FFA10eMJQK?= =?us-ascii?Q?ukA13L7BdAE1swhtBF5WraXRx2yBxYKDf6uGFxhfCBMdY9M0ZBXASgnsmzMg?= =?us-ascii?Q?jE6791pqLUOp87YRmfdwI/UHPt2ffjsGgveUfatDSZK3tR3GnZQN6aRAte16?= =?us-ascii?Q?ETIeDmAFeoKZa3y6TFEn4DyEVRsb5GE8LcHd05tVRLYW3kyi2fLPoFdJ1q2K?= =?us-ascii?Q?dKMUchDteu65R+dDrEc0Uli0ZKh9FJqjOIhJC570K0gR2dEIa9ZB6MsO9T+S?= =?us-ascii?Q?hn2WRESnRN3ThIdKmRvzdizT+tFqJc3/QUmL4o7yZ37SICl89lNIEpi50ylM?= =?us-ascii?Q?qIhopS2mn5H3j9BXwMu150OddDEzx5Bx/HsDZTcN9qVSDTpkRwyYIt8vL5kW?= =?us-ascii?Q?ON53PL+hQWJ7P6Gdta4OXeyIctMpcOhTrdz4vMz47Tv9NafyFcVDFXS8VIR7?= =?us-ascii?Q?oYn0Rh4TpNAcMDbw2nV5djU1GD+QeqyOskR6JZgt9iI01VXAhOpx6IR8SXoA?= =?us-ascii?Q?9pjybJBYJIIvgaHkEtQ=3D?= X-Forefront-Antispam-Report: CIP:216.228.117.161;CTRY:US;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:mail.nvidia.com;PTR:dc6edge2.nvidia.com;CAT:NONE;SFS:(13230040)(36860700013)(1800799024)(82310400026)(7416014)(376014);DIR:OUT;SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 21 Nov 2025 14:12:06.2639 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 66335f01-cfed-4bd8-6938-08de2907f3c2 X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a;Ip=[216.228.117.161];Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: CH1PEPF0000AD74.namprd04.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: DS4PR12MB9820 Content-Type: text/plain; charset="utf-8" From: Ankit Agrawal Split the function that check for the GPU device being ready on the probe. Move the code to wait for the GPU to be ready through BAR0 register reads to a separate function. This would help reuse the code. Signed-off-by: Ankit Agrawal --- drivers/vfio/pci/nvgrace-gpu/main.c | 33 ++++++++++++++++++----------- 1 file changed, 21 insertions(+), 12 deletions(-) diff --git a/drivers/vfio/pci/nvgrace-gpu/main.c b/drivers/vfio/pci/nvgrace= -gpu/main.c index 3883a9de170f..7618c3f515cc 100644 --- a/drivers/vfio/pci/nvgrace-gpu/main.c +++ b/drivers/vfio/pci/nvgrace-gpu/main.c @@ -130,6 +130,24 @@ static void nvgrace_gpu_close_device(struct vfio_devic= e *core_vdev) vfio_pci_core_close_device(core_vdev); } =20 +static int nvgrace_gpu_wait_device_ready(void __iomem *io) +{ + unsigned long timeout =3D jiffies + msecs_to_jiffies(POLL_TIMEOUT_MS); + int ret =3D -ETIME; + + do { + if ((ioread32(io + C2C_LINK_BAR0_OFFSET) =3D=3D STATUS_READY) && + (ioread32(io + HBM_TRAINING_BAR0_OFFSET) =3D=3D STATUS_READY)) { + ret =3D 0; + goto ready_check_exit; + } + msleep(POLL_QUANTUM_MS); + } while (!time_after(jiffies, timeout)); + +ready_check_exit: + return ret; +} + static vm_fault_t nvgrace_gpu_vfio_pci_huge_fault(struct vm_fault *vmf, unsigned int order) { @@ -931,9 +949,8 @@ static bool nvgrace_gpu_has_mig_hw_bug(struct pci_dev *= pdev) * Ensure that the BAR0 region is enabled before accessing the * registers. */ -static int nvgrace_gpu_wait_device_ready(struct pci_dev *pdev) +static int nvgrace_gpu_check_device_ready(struct pci_dev *pdev) { - unsigned long timeout =3D jiffies + msecs_to_jiffies(POLL_TIMEOUT_MS); void __iomem *io; int ret =3D -ETIME; =20 @@ -951,16 +968,8 @@ static int nvgrace_gpu_wait_device_ready(struct pci_de= v *pdev) goto iomap_exit; } =20 - do { - if ((ioread32(io + C2C_LINK_BAR0_OFFSET) =3D=3D STATUS_READY) && - (ioread32(io + HBM_TRAINING_BAR0_OFFSET) =3D=3D STATUS_READY)) { - ret =3D 0; - goto reg_check_exit; - } - msleep(POLL_QUANTUM_MS); - } while (!time_after(jiffies, timeout)); + ret =3D nvgrace_gpu_wait_device_ready(io); =20 -reg_check_exit: pci_iounmap(pdev, io); iomap_exit: pci_release_selected_regions(pdev, 1 << 0); @@ -977,7 +986,7 @@ static int nvgrace_gpu_probe(struct pci_dev *pdev, u64 memphys, memlength; int ret; =20 - ret =3D nvgrace_gpu_wait_device_ready(pdev); + ret =3D nvgrace_gpu_check_device_ready(pdev); if (ret) return ret; =20 --=20 2.34.1 From nobody Tue Dec 2 01:30:21 2025 Received: from BL0PR03CU003.outbound.protection.outlook.com (mail-eastusazon11012003.outbound.protection.outlook.com [52.101.53.3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id F405C34D4D5; Fri, 21 Nov 2025 14:12:17 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=fail smtp.client-ip=52.101.53.3 ARC-Seal: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1763734340; cv=fail; b=Ot3hHh6+TY1uyrUKZ69xLVoojC3eM8YIIMoP8BnoiezdD0VQLC2RekWqKo8cMyOv9MjydHTiFn1rJJvpj7LuzCUj8g/7TS4ZOSO7m4I9kIzqO3dtZmq8OG00FAqh+DfNtdhL/8VNfqUC8Wo+zQuXPCefXpTNiv0BBhnQjotgkh0= ARC-Message-Signature: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1763734340; c=relaxed/simple; bh=+jTpMIgt/o/VLQmn064apmAho30fcKrJm6mlQ0TQlR4=; h=From:To:CC:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version:Content-Type; b=EqcBk5/d1wU8JWpiDu/FsgHnawHjPBsxQzl35ijJ4j3bachvuCqEkZaIohoNE5KY2tMxbxQxG360v+VNw9GGGQsLinD4QGjXDV5HGhU2ZQZXUUFPbInTrOD83h+tZE7hrXk4P+czWWv2LZxx0JcR/BDFwXA2l/mLKs0IKuNGhFI= ARC-Authentication-Results: i=2; smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=nvidia.com; spf=fail smtp.mailfrom=nvidia.com; dkim=pass (2048-bit key) header.d=Nvidia.com header.i=@Nvidia.com header.b=bSwS/nH7; arc=fail smtp.client-ip=52.101.53.3 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=nvidia.com Authentication-Results: smtp.subspace.kernel.org; spf=fail smtp.mailfrom=nvidia.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=Nvidia.com header.i=@Nvidia.com header.b="bSwS/nH7" ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=U5u1u/STX2jVFWPZQstsGAofKuhn1IXUEDQtQW4rkPOKhKgtN1068s47P+9WXQEQ4iinNdc/IiVoyHShHx62xvO5VHCgC6mafdjubIrwnCU2rNMJ7GBjIu3vdxXw0rkkfLeAzKUvLY7gal93JWw4O6173cgIFaQZjaBtinE4Ivy2mSaelwqZjb+sUUjI3VA2YTbYp1cY0+s+GfrL9/hopY/Ftw73+eF+KVmd1gLGDbC3EV03v8T3yds+LTN6/WQ9tbDnx3DlLab9ZzZja/1CY5gVovyHgwZ/Wjl5s2VlY8+Rq8AD/8E7Lx2o5WVyZPIn83sSw8HCRrCfri8HlQVFHQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=5OHVbDSbhctNNhP/AyRR5gYIO+DTSZ24gnHD8HWm7xw=; b=Z/uCMXyOin4LdP8QWvLzrkLsXF1I1yomyWj7aKwLIuwgOeV0D6602+uPayls0UFRFJWa9tB9+RQs1kvWZoPnjxENKznGHVJw21jFmJCQwUnagpzlmsUnhA/uhIoPrl5J8jJq3rlCMo3NaWHxOLBWq8oA5F3wJZxjshI/b8U/bsIzrm69bLZpImsbvM161DNWPrQEgdHzcYQtRKZGsolHT8vaVM53CfCbBGAbJ3UfkpNQqIDiHFJ6b9YjP1lMfxyj+KF0BsdEaVEBrmRb3HqDG7+9uqt+f4nzyOO4G/UWyH0CB4+u2FEv5hpYqN0kw2+VdNKpvLiVHZllaBOAtbX5bw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 216.228.117.160) smtp.rcpttodomain=vger.kernel.org smtp.mailfrom=nvidia.com; dmarc=pass (p=reject sp=reject pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none (0) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=5OHVbDSbhctNNhP/AyRR5gYIO+DTSZ24gnHD8HWm7xw=; b=bSwS/nH7CJH0+XEGPqEmIjjP/hepoX4/WYDtKag+GC1y61KCyPDGaEfRLpdkbhQqFYrTgNxlxf4MR9N01sfdl94ze4b7Tm3CezHFqmjR0HaqzPPFEYYsX/V37+cb94Y24YtgJFGxT23P8HnxADwtFg/jYqlVw8fjZCDe4NIJKbM/jGO3V5Xx40OyFrRjzWGlaeH+XS1GLmFJ2NH3ZN74htYWycEQpiOPIi6fePC0RaBJe4jLqvdwCgJ6Mdjrs8xatyVkLLbi0uZbonFeT+jzZDUZiMjVBoP2xL65VNWvprGHsPQU25IAHU/V196xEGJnvPcYoEyfX/OtjJyaDph2LQ== Received: from SJ0PR03CA0243.namprd03.prod.outlook.com (2603:10b6:a03:3a0::8) by MN2PR12MB4408.namprd12.prod.outlook.com (2603:10b6:208:26c::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.9343.11; Fri, 21 Nov 2025 14:12:11 +0000 Received: from SJ5PEPF000001CB.namprd05.prod.outlook.com (2603:10b6:a03:3a0:cafe::de) by SJ0PR03CA0243.outlook.office365.com (2603:10b6:a03:3a0::8) with Microsoft SMTP Server (version=TLS1_3, cipher=TLS_AES_256_GCM_SHA384) id 15.20.9343.14 via Frontend Transport; Fri, 21 Nov 2025 14:12:02 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 216.228.117.160) smtp.mailfrom=nvidia.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 216.228.117.160 as permitted sender) receiver=protection.outlook.com; client-ip=216.228.117.160; helo=mail.nvidia.com; pr=C Received: from mail.nvidia.com (216.228.117.160) by SJ5PEPF000001CB.mail.protection.outlook.com (10.167.242.40) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.9343.9 via Frontend Transport; Fri, 21 Nov 2025 14:12:10 +0000 Received: from rnnvmail204.nvidia.com (10.129.68.6) by mail.nvidia.com (10.129.200.66) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.2562.20; Fri, 21 Nov 2025 06:11:46 -0800 Received: from rnnvmail204.nvidia.com (10.129.68.6) by rnnvmail204.nvidia.com (10.129.68.6) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.2562.20; Fri, 21 Nov 2025 06:11:46 -0800 Received: from gb-nvl-073-compute01.l16.internal032k18.bmc032b17.internal032f11.internal032huang.bmc032l04.bmc (10.127.8.11) by mail.nvidia.com (10.129.68.6) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.2562.20 via Frontend Transport; Fri, 21 Nov 2025 06:11:45 -0800 From: To: , , , , , , , , CC: , , , , , , , , , , , , , , , , Subject: [PATCH v3 7/7] vfio/nvgrace-gpu: wait for the GPU mem to be ready Date: Fri, 21 Nov 2025 14:11:41 +0000 Message-ID: <20251121141141.3175-8-ankita@nvidia.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20251121141141.3175-1-ankita@nvidia.com> References: <20251121141141.3175-1-ankita@nvidia.com> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable X-NV-OnPremToCloud: ExternallySecured X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: SJ5PEPF000001CB:EE_|MN2PR12MB4408:EE_ X-MS-Office365-Filtering-Correlation-Id: fe1aed87-26b4-4dc2-6048-08de2907f67f X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|36860700013|82310400026|1800799024|376014|7416014; X-Microsoft-Antispam-Message-Info: =?us-ascii?Q?UClqwqaCAFkrrObFheJr63ifJm43hC6Kq1tfKiA3t104rmOiwPaL3++EV4xM?= =?us-ascii?Q?Z4lDwAHvjn4fMziT48VAyfjczYSNXnZIqbkkx23+4fGZ9oZPCqxdLeoOMClJ?= =?us-ascii?Q?tgDHDvCWDeJHJSlltVeXXvf5eMi2Cn8LuPNadPzm/yqs2ZNBjCtBHk/9Gw7t?= =?us-ascii?Q?QzHtQjD7/j1VK91IWciNRUNTpUifV3bT0eC0jtA/aXp08LQEu122MDBSgM5Y?= =?us-ascii?Q?aBJSlU2Olq90hIhj42KaUwz3DTyn6He9zPj0Pp5IY0skYpgPGKP0f3lcbjTG?= =?us-ascii?Q?2utml5CUL6U0Q9UyD6Od3uAmXw4tOZOtPBytsCCLJ26InYBxs1tvFT4GFu9u?= =?us-ascii?Q?JmqccT4DEoJhlxF9/fqffwwPoLlA6ka9laaEJzg+0O0tVlq6xVmx7nFzVB7t?= =?us-ascii?Q?zZa/caPxBuxgaxjgedXn4l6PKoiaUrjEIs0GktwmcfvRPkEAG7KIMxu+y6Z6?= =?us-ascii?Q?Die17DJDsXJsJrl4THkoZycxYcRRFYydZxDgRMIgSEcpfvWpgUl+v8ReQluo?= =?us-ascii?Q?Pd+rklCdBB6ILOmftLag/JT/aoFOCwnD4VpkwrobP0BNu/89fvKIUalHdC8t?= =?us-ascii?Q?kvuxd+0XWe59JQz1sSomuXl3VgUc729Q7rbZxrZ/TlMOWSQ3jYMt3gI8qAVs?= =?us-ascii?Q?TlqyWXlTQiTnsmoyO612N0GwCd6/6hzzjXmPjxjhjt8JfSbeDff8uiFPsgDf?= =?us-ascii?Q?xuZoci5A1xWkycxtNfQSemVXedtl9zWfQx7hnxjRM8qRs1trEFgxNLEZhE2K?= =?us-ascii?Q?+oDhqE6JYG42bgpNaUa2HgjDq7sjXK6IZl1+j2ewAgV6orKtRlxQLto3EmCw?= =?us-ascii?Q?wwpvDzR8R5VGRxsTjFRJLZzr14IQ8q2kAWbO5HbTN/+eEQoMyYDr5lruJEY8?= =?us-ascii?Q?u2AE33YLoHaNuhHqmkOpdaqCQFpbkX5r3km6Q7AFUyYnMgWKvp+ieZWn6eeD?= =?us-ascii?Q?kLIUG/4DQX3bapebJTI9gH8LjoNxgNV3mHjFv2TuulLQCgohTxhntn5GtGUU?= =?us-ascii?Q?lGtnemICzxfGqybWnpBl8F2oWCzryYN7bq5AOaHUGxuDwL9A2HKnXellbish?= =?us-ascii?Q?kmcqPhrGCmF88/skzpffw+zochZuMr/kVeyE4FZpGbU8sJeYgNYRqqwpZVs/?= =?us-ascii?Q?VWZLUkAjpfl2IwAOV7SvBfuxk4Ei8ByorSyr/nZO+NhI5cB1YtGaZVDDp2+5?= =?us-ascii?Q?XPdR9FMX2RATKmF8vqNG1sZ3VQWDtZX2Em+FVvTTd9zB2Wokb5HjZqiaBe+I?= =?us-ascii?Q?Rz6h+XSI71nfATxgTd/2mIIqAL1Eig7t0L4SCjj5aDf4eia0DN0f7EZDRWCU?= =?us-ascii?Q?031mNl9dS4c2cYuH5iTugXO59bHV4/DgEH37nA0gwTqS5k/TTaOFn1K/m2Ok?= =?us-ascii?Q?DvIl7/yxRbbl2oQI9sKgDMUexgkDlv7vHKQg8nbq14S30p4A2cv6HB5C1ZFo?= =?us-ascii?Q?lSwK5SWl9j6U4pEAKfWSNbbTgeEF/+oAV9SKRzq1D6HWeEENIto6WAVTkbV7?= =?us-ascii?Q?aNXtu61RFDeLyaDk94hXfPiDxqt2H9zI66pQ45Esv29Gy3GhTo3DCam6KqQf?= =?us-ascii?Q?zp8J9vDmZ0KUc7AKEr8=3D?= X-Forefront-Antispam-Report: CIP:216.228.117.160;CTRY:US;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:mail.nvidia.com;PTR:dc6edge1.nvidia.com;CAT:NONE;SFS:(13230040)(36860700013)(82310400026)(1800799024)(376014)(7416014);DIR:OUT;SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 21 Nov 2025 14:12:10.9226 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: fe1aed87-26b4-4dc2-6048-08de2907f67f X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a;Ip=[216.228.117.160];Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: SJ5PEPF000001CB.namprd05.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN2PR12MB4408 Content-Type: text/plain; charset="utf-8" From: Ankit Agrawal Speculative prefetches from CPU to GPU memory until the GPU is ready after reset can cause harmless corrected RAS events to be logged on Grace systems. It is thus preferred that the mapping not be re-established until the GPU is ready post reset. The GPU readiness can be checked through BAR0 registers similar to the checking at the time of device probe. It can take several seconds for the GPU to be ready. So it is desirable that the time overlaps as much of the VM startup as possible to reduce impact on the VM bootup time. The GPU readiness state is thus checked on the first fault/huge_fault request which amortizes the GPU readiness time. The first fault is checked using a flag. The flag is unset on every GPU reset request. Intercept the following calls to the GPU reset, unset gpu_mem_mapped. Then use it to determine whether to wait before mapping. 1. VFIO_DEVICE_RESET ioctl call 2. FLR through config space. cc: Alex Williamson cc: Jason Gunthorpe cc: Vikram Sethi Signed-off-by: Ankit Agrawal --- drivers/vfio/pci/nvgrace-gpu/main.c | 64 ++++++++++++++++++++++++++++- 1 file changed, 63 insertions(+), 1 deletion(-) diff --git a/drivers/vfio/pci/nvgrace-gpu/main.c b/drivers/vfio/pci/nvgrace= -gpu/main.c index 7618c3f515cc..23e3278aba25 100644 --- a/drivers/vfio/pci/nvgrace-gpu/main.c +++ b/drivers/vfio/pci/nvgrace-gpu/main.c @@ -58,6 +58,8 @@ struct nvgrace_gpu_pci_core_device { /* Lock to control device memory kernel mapping */ struct mutex remap_lock; bool has_mig_hw_bug; + /* Any GPU memory mapped to the VMA */ + bool gpu_mem_mapped; }; =20 static void nvgrace_gpu_init_fake_bar_emu_regs(struct vfio_device *core_vd= ev) @@ -102,9 +104,15 @@ static int nvgrace_gpu_open_device(struct vfio_device = *core_vdev) mutex_init(&nvdev->remap_lock); } =20 + nvdev->gpu_mem_mapped =3D false; + vfio_pci_core_finish_enable(vdev); =20 - return 0; + /* + * The GPU readiness is determined through BAR0 register reads. + * Make sure the BAR0 is mapped before any such check occur. + */ + return vfio_pci_core_barmap(vdev, 0); } =20 static void nvgrace_gpu_close_device(struct vfio_device *core_vdev) @@ -158,6 +166,21 @@ static vm_fault_t nvgrace_gpu_vfio_pci_huge_fault(stru= ct vm_fault *vmf, struct mem_region *memregion; unsigned long pgoff, pfn, addr; =20 + /* + * If the GPU memory is accessed by the CPU while the GPU is + * not ready after reset, it can cause harmless corrected RAS + * events to be logged. Make sure the GPU is ready before + * establishing the mappings. + */ + if (!nvdev->gpu_mem_mapped) { + struct vfio_pci_core_device *vdev =3D &nvdev->core_device; + + if (nvgrace_gpu_wait_device_ready(vdev->barmap[0])) + return VM_FAULT_SIGBUS; + + nvdev->gpu_mem_mapped =3D true; + } + memregion =3D nvgrace_gpu_memregion(index, nvdev); if (!memregion) return ret; @@ -354,7 +377,17 @@ static long nvgrace_gpu_ioctl(struct vfio_device *core= _vdev, case VFIO_DEVICE_IOEVENTFD: return -ENOTTY; case VFIO_DEVICE_RESET: + struct nvgrace_gpu_pci_core_device *nvdev =3D + container_of(core_vdev, struct nvgrace_gpu_pci_core_device, + core_device.vdev); nvgrace_gpu_init_fake_bar_emu_regs(core_vdev); + + /* + * GPU memory is exposed as device BAR2 (region 4,5). + * This would be zapped during GPU reset. Unset + * nvdev->gpu_mem_mapped to reflect just that. + */ + nvdev->gpu_mem_mapped =3D false; fallthrough; default: return vfio_pci_core_ioctl(core_vdev, cmd, arg); @@ -439,11 +472,14 @@ nvgrace_gpu_write_config_emu(struct vfio_device *core= _vdev, struct nvgrace_gpu_pci_core_device *nvdev =3D container_of(core_vdev, struct nvgrace_gpu_pci_core_device, core_device.vdev); + struct vfio_pci_core_device *vdev =3D + container_of(core_vdev, struct vfio_pci_core_device, vdev); u64 pos =3D *ppos & VFIO_PCI_OFFSET_MASK; struct mem_region *memregion =3D NULL; size_t register_offset; loff_t copy_offset; size_t copy_count; + int cap_start =3D vfio_find_cap_start(vdev, pos); =20 if (vfio_pci_core_range_intersect_range(pos, count, PCI_BASE_ADDRESS_2, sizeof(u64), ©_offset, @@ -462,6 +498,23 @@ nvgrace_gpu_write_config_emu(struct vfio_device *core_= vdev, return copy_count; } =20 + if (vfio_pci_core_range_intersect_range(pos, count, cap_start + PCI_EXP_D= EVCTL, + sizeof(u16), ©_offset, + ©_count, ®ister_offset)) { + __le16 val16; + + if (copy_from_user((void *)&val16, buf, copy_count)) + return -EFAULT; + + /* + * GPU memory is exposed as device BAR2 (region 4,5). + * This would be zapped during GPU reset. Unset + * nvdev->gpu_mem_mapped to reflect just that. + */ + if (val16 & cpu_to_le16(PCI_EXP_DEVCTL_BCR_FLR)) + nvdev->gpu_mem_mapped =3D false; + } + return vfio_pci_core_write(core_vdev, buf, count, ppos); } =20 @@ -478,9 +531,18 @@ static int nvgrace_gpu_map_device_mem(int index, struct nvgrace_gpu_pci_core_device *nvdev) { + struct vfio_pci_core_device *vdev =3D &nvdev->core_device; struct mem_region *memregion; int ret =3D 0; =20 + if (!nvdev->gpu_mem_mapped) { + ret =3D nvgrace_gpu_wait_device_ready(vdev->barmap[0]); + if (ret) + return ret; + + nvdev->gpu_mem_mapped =3D true; + } + memregion =3D nvgrace_gpu_memregion(index, nvdev); if (!memregion) return -EINVAL; --=20 2.34.1