From nobody Thu Apr 2 16:35:48 2026 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id 6B247C6FA86 for ; Thu, 22 Sep 2022 09:53:21 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S231179AbiIVJxT (ORCPT ); Thu, 22 Sep 2022 05:53:19 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:48416 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S231158AbiIVJxK (ORCPT ); Thu, 22 Sep 2022 05:53:10 -0400 Received: from mx0a-001b2d01.pphosted.com (mx0a-001b2d01.pphosted.com [148.163.156.1]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id B0783D5751; Thu, 22 Sep 2022 02:53:08 -0700 (PDT) Received: from pps.filterd (m0098404.ppops.net [127.0.0.1]) by mx0a-001b2d01.pphosted.com (8.17.1.5/8.17.1.5) with ESMTP id 28M9pFZA030921; Thu, 22 Sep 2022 09:52:47 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ibm.com; h=from : to : cc : subject : date : message-id : in-reply-to : references : mime-version : content-transfer-encoding; s=pp1; bh=V/AKv34B1wYd1USNyD5bC30pUdajk7W8PfV5PBos2Gw=; b=oOfTuR8CN5UceRA2EWa87vP1k42rIZpq9xkxjcj42g/in1XcPIq5fwkhpmluTSoj2mup wvobg4GZnClLmKa5+ceGlDAi/8cTEfKbkbIVZks00OT+rHfVQid4ekveENr9eFUgbuGu 0BrHV634xsEA9F2MwZ+QDqIPMmXnO3Te2Xh33D4VGNWEjc7EVsr7SmtN7YgHLmrIRvIT x5oR6tAanL+L68kQmr+gxvBQLm8P5Z8RDITC1yNA65d4ewM+LGITHNPqxHLeHJTuezGL m7NZEtuPcBDcF4Y3+9Pt35mdexYQFi3RjUE1DXDritMCd9qZF0XEIzrRU+2+hAlc9/he vA== Received: from ppma03ams.nl.ibm.com (62.31.33a9.ip4.static.sl-reverse.com [169.51.49.98]) by mx0a-001b2d01.pphosted.com (PPS) with ESMTPS id 3jrnek80v0-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 22 Sep 2022 09:52:46 +0000 Received: from pps.filterd (ppma03ams.nl.ibm.com [127.0.0.1]) by ppma03ams.nl.ibm.com (8.16.1.2/8.16.1.2) with SMTP id 28M9pKFi024355; Thu, 22 Sep 2022 09:52:44 GMT Received: from b06avi18878370.portsmouth.uk.ibm.com (b06avi18878370.portsmouth.uk.ibm.com [9.149.26.194]) by ppma03ams.nl.ibm.com with ESMTP id 3jn5v96eyc-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 22 Sep 2022 09:52:44 +0000 Received: from d06av22.portsmouth.uk.ibm.com (d06av22.portsmouth.uk.ibm.com [9.149.105.58]) by b06avi18878370.portsmouth.uk.ibm.com (8.14.9/8.14.9/NCO v10.0) with ESMTP id 28M9r73741746796 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Thu, 22 Sep 2022 09:53:07 GMT Received: from d06av22.portsmouth.uk.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id 214554C044; Thu, 22 Sep 2022 09:52:41 +0000 (GMT) Received: from d06av22.portsmouth.uk.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id A24274C046; Thu, 22 Sep 2022 09:52:40 +0000 (GMT) Received: from tuxmaker.boeblingen.de.ibm.com (unknown [9.152.85.9]) by d06av22.portsmouth.uk.ibm.com (Postfix) with ESMTP; Thu, 22 Sep 2022 09:52:40 +0000 (GMT) From: Niklas Schnelle To: Matthew Rosato , Pierre Morel , iommu@lists.linux.dev Cc: linux-s390@vger.kernel.org, borntraeger@linux.ibm.com, hca@linux.ibm.com, gor@linux.ibm.com, gerald.schaefer@linux.ibm.com, agordeev@linux.ibm.com, svens@linux.ibm.com, joro@8bytes.org, will@kernel.org, robin.murphy@arm.com, jgg@nvidia.com, linux-kernel@vger.kernel.org Subject: [PATCH v2 1/3] iommu/s390: Fix duplicate domain attachments Date: Thu, 22 Sep 2022 11:52:37 +0200 Message-Id: <20220922095239.2115309-2-schnelle@linux.ibm.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20220922095239.2115309-1-schnelle@linux.ibm.com> References: <20220922095239.2115309-1-schnelle@linux.ibm.com> MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable X-TM-AS-GCONF: 00 X-Proofpoint-ORIG-GUID: Iy3L1H_JV98y_a8kMtHrwj-ktAvEgCMF X-Proofpoint-GUID: Iy3L1H_JV98y_a8kMtHrwj-ktAvEgCMF X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.205,Aquarius:18.0.895,Hydra:6.0.528,FMLib:17.11.122.1 definitions=2022-09-22_06,2022-09-20_02,2022-06-22_01 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 impostorscore=0 priorityscore=1501 clxscore=1015 adultscore=0 spamscore=0 phishscore=0 bulkscore=0 suspectscore=0 mlxlogscore=989 malwarescore=0 lowpriorityscore=0 mlxscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2209130000 definitions=main-2209220063 Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Type: text/plain; charset="utf-8" Since commit fa7e9ecc5e1c ("iommu/s390: Tolerate repeat attach_dev calls") we can end up with duplicates in the list of devices attached to a domain. This is inefficient and confusing since only one domain can actually be in control of the IOMMU translations for a device. Fix this by detaching the device from the previous domain, if any, on attach. Add a WARN_ON() in case we still have attached devices on freeing the domain. Fixes: fa7e9ecc5e1c ("iommu/s390: Tolerate repeat attach_dev calls") Signed-off-by: Niklas Schnelle --- Changes since v1: - WARN_ON() non-empty list in s390_domain_free() - Drop the found flag and instead WARN_ON() if we're detaching from a domain that isn't the active domain for the device drivers/iommu/s390-iommu.c | 81 ++++++++++++++++++++++---------------- 1 file changed, 46 insertions(+), 35 deletions(-) diff --git a/drivers/iommu/s390-iommu.c b/drivers/iommu/s390-iommu.c index c898bcbbce11..187d2c7ba9ff 100644 --- a/drivers/iommu/s390-iommu.c +++ b/drivers/iommu/s390-iommu.c @@ -78,19 +78,48 @@ static struct iommu_domain *s390_domain_alloc(unsigned = domain_type) static void s390_domain_free(struct iommu_domain *domain) { struct s390_domain *s390_domain =3D to_s390_domain(domain); + unsigned long flags; =20 + spin_lock_irqsave(&s390_domain->list_lock, flags); + WARN_ON(!list_empty(&s390_domain->devices)); + spin_unlock_irqrestore(&s390_domain->list_lock, flags); dma_cleanup_tables(s390_domain->dma_table); kfree(s390_domain); } =20 +static int __s390_iommu_detach_device(struct s390_domain *s390_domain, + struct zpci_dev *zdev) +{ + struct s390_domain_device *domain_device, *tmp; + unsigned long flags; + + WARN_ON(zdev->s390_domain !=3D s390_domain); + spin_lock_irqsave(&s390_domain->list_lock, flags); + list_for_each_entry_safe(domain_device, tmp, &s390_domain->devices, + list) { + if (domain_device->zdev =3D=3D zdev) { + list_del(&domain_device->list); + kfree(domain_device); + break; + } + } + spin_unlock_irqrestore(&s390_domain->list_lock, flags); + + zpci_unregister_ioat(zdev, 0); + zdev->s390_domain =3D NULL; + zdev->dma_table =3D NULL; + return 0; +} + static int s390_iommu_attach_device(struct iommu_domain *domain, struct device *dev) { struct s390_domain *s390_domain =3D to_s390_domain(domain); struct zpci_dev *zdev =3D to_zpci_dev(dev); struct s390_domain_device *domain_device; + struct s390_domain *prev_domain =3D NULL; unsigned long flags; - int cc, rc; + int cc, rc =3D 0; =20 if (!zdev) return -ENODEV; @@ -99,16 +128,15 @@ static int s390_iommu_attach_device(struct iommu_domai= n *domain, if (!domain_device) return -ENOMEM; =20 - if (zdev->dma_table && !zdev->s390_domain) { - cc =3D zpci_dma_exit_device(zdev); - if (cc) { + if (zdev->s390_domain) { + prev_domain =3D zdev->s390_domain; + rc =3D __s390_iommu_detach_device(zdev->s390_domain, zdev); + } else if (zdev->dma_table) { + if (zpci_dma_exit_device(zdev)) rc =3D -EIO; - goto out_free; - } } - - if (zdev->s390_domain) - zpci_unregister_ioat(zdev, 0); + if (rc) + goto out_free; =20 zdev->dma_table =3D s390_domain->dma_table; cc =3D zpci_register_ioat(zdev, 0, zdev->start_dma, zdev->end_dma, @@ -129,7 +157,7 @@ static int s390_iommu_attach_device(struct iommu_domain= *domain, domain->geometry.aperture_end !=3D zdev->end_dma) { rc =3D -EINVAL; spin_unlock_irqrestore(&s390_domain->list_lock, flags); - goto out_restore; + goto out_unregister_restore; } domain_device->zdev =3D zdev; zdev->s390_domain =3D s390_domain; @@ -138,14 +166,15 @@ static int s390_iommu_attach_device(struct iommu_doma= in *domain, =20 return 0; =20 +out_unregister_restore: + zpci_unregister_ioat(zdev, 0); out_restore: - if (!zdev->s390_domain) { + zdev->dma_table =3D NULL; + if (prev_domain) + s390_iommu_attach_device(&prev_domain->domain, + dev); + else zpci_dma_init_device(zdev); - } else { - zdev->dma_table =3D zdev->s390_domain->dma_table; - zpci_register_ioat(zdev, 0, zdev->start_dma, zdev->end_dma, - virt_to_phys(zdev->dma_table)); - } out_free: kfree(domain_device); =20 @@ -157,30 +186,12 @@ static void s390_iommu_detach_device(struct iommu_dom= ain *domain, { struct s390_domain *s390_domain =3D to_s390_domain(domain); struct zpci_dev *zdev =3D to_zpci_dev(dev); - struct s390_domain_device *domain_device, *tmp; - unsigned long flags; - int found =3D 0; =20 if (!zdev) return; =20 - spin_lock_irqsave(&s390_domain->list_lock, flags); - list_for_each_entry_safe(domain_device, tmp, &s390_domain->devices, - list) { - if (domain_device->zdev =3D=3D zdev) { - list_del(&domain_device->list); - kfree(domain_device); - found =3D 1; - break; - } - } - spin_unlock_irqrestore(&s390_domain->list_lock, flags); - - if (found && (zdev->s390_domain =3D=3D s390_domain)) { - zdev->s390_domain =3D NULL; - zpci_unregister_ioat(zdev, 0); + if (!__s390_iommu_detach_device(s390_domain, zdev)) zpci_dma_init_device(zdev); - } } =20 static struct iommu_device *s390_iommu_probe_device(struct device *dev) --=20 2.34.1 From nobody Thu Apr 2 16:35:48 2026 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id 0327BC6FA91 for ; Thu, 22 Sep 2022 09:53:18 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S231181AbiIVJxQ (ORCPT ); Thu, 22 Sep 2022 05:53:16 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:48404 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S230461AbiIVJxJ (ORCPT ); Thu, 22 Sep 2022 05:53:09 -0400 Received: from mx0a-001b2d01.pphosted.com (mx0a-001b2d01.pphosted.com [148.163.156.1]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id AFC41D574E; Thu, 22 Sep 2022 02:53:08 -0700 (PDT) Received: from pps.filterd (m0187473.ppops.net [127.0.0.1]) by mx0a-001b2d01.pphosted.com (8.17.1.5/8.17.1.5) with ESMTP id 28M9K6FQ034983; Thu, 22 Sep 2022 09:52:47 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ibm.com; h=from : to : cc : subject : date : message-id : in-reply-to : references : mime-version : content-transfer-encoding; s=pp1; bh=O/FkUZcZHdTSV6fffQohW6KGZk2P6o8hiSx1qoKA0TI=; b=DDJcpfZ07SozZ0RlTaHGOCsiV6lnzGaH3p//0w2GP4fgmb4L2ka46LW59Vw52FYbqxRM SvwCQc8yZ7ogVl6GdQZM6TUPUT///Ple8XVBMWiq4S18Yf1VTEgQ7pt/6E3NzFPCCOOL FP35oh9UMjqrVazLH9pvovlq0Q/X3J1BSatdUJ+H0Rv0ZOAByrK7WVN84E64iHQBugEh LOmgPxkGrPuO953M9gHQ5oC1xFPxGLe2/FOAGPDCFZhyH4wLxfuNfALjesD1lAWboup+ lSKnG/xIipHBcc6uZvtu4/SymdBKuzv6fbBKHxdlSQzwE9wJ519QX/H8kdlT8w++K0O5 WA== Received: from ppma05fra.de.ibm.com (6c.4a.5195.ip4.static.sl-reverse.com [149.81.74.108]) by mx0a-001b2d01.pphosted.com (PPS) with ESMTPS id 3jrn00h3v5-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 22 Sep 2022 09:52:47 +0000 Received: from pps.filterd (ppma05fra.de.ibm.com [127.0.0.1]) by ppma05fra.de.ibm.com (8.16.1.2/8.16.1.2) with SMTP id 28M9qi2L030696; Thu, 22 Sep 2022 09:52:44 GMT Received: from b06avi18878370.portsmouth.uk.ibm.com (b06avi18878370.portsmouth.uk.ibm.com [9.149.26.194]) by ppma05fra.de.ibm.com with ESMTP id 3jn5v8vt1q-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 22 Sep 2022 09:52:44 +0000 Received: from d06av22.portsmouth.uk.ibm.com (d06av22.portsmouth.uk.ibm.com [9.149.105.58]) by b06avi18878370.portsmouth.uk.ibm.com (8.14.9/8.14.9/NCO v10.0) with ESMTP id 28M9r8AB41156992 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Thu, 22 Sep 2022 09:53:08 GMT Received: from d06av22.portsmouth.uk.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id A8BAE4C040; Thu, 22 Sep 2022 09:52:41 +0000 (GMT) Received: from d06av22.portsmouth.uk.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id 2D7184C04A; Thu, 22 Sep 2022 09:52:41 +0000 (GMT) Received: from tuxmaker.boeblingen.de.ibm.com (unknown [9.152.85.9]) by d06av22.portsmouth.uk.ibm.com (Postfix) with ESMTP; Thu, 22 Sep 2022 09:52:41 +0000 (GMT) From: Niklas Schnelle To: Matthew Rosato , Pierre Morel , iommu@lists.linux.dev Cc: linux-s390@vger.kernel.org, borntraeger@linux.ibm.com, hca@linux.ibm.com, gor@linux.ibm.com, gerald.schaefer@linux.ibm.com, agordeev@linux.ibm.com, svens@linux.ibm.com, joro@8bytes.org, will@kernel.org, robin.murphy@arm.com, jgg@nvidia.com, linux-kernel@vger.kernel.org Subject: [PATCH v2 2/3] s390/pci: remove unused bus_next field from struct zpci_dev Date: Thu, 22 Sep 2022 11:52:38 +0200 Message-Id: <20220922095239.2115309-3-schnelle@linux.ibm.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20220922095239.2115309-1-schnelle@linux.ibm.com> References: <20220922095239.2115309-1-schnelle@linux.ibm.com> MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable X-TM-AS-GCONF: 00 X-Proofpoint-GUID: GokoN3rgH74zRpNEbckQtC9DPloQddAl X-Proofpoint-ORIG-GUID: GokoN3rgH74zRpNEbckQtC9DPloQddAl X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.205,Aquarius:18.0.895,Hydra:6.0.528,FMLib:17.11.122.1 definitions=2022-09-22_06,2022-09-20_02,2022-06-22_01 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 priorityscore=1501 mlxscore=0 impostorscore=0 malwarescore=0 phishscore=0 spamscore=0 suspectscore=0 lowpriorityscore=0 mlxlogscore=921 clxscore=1015 adultscore=0 bulkscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2209130000 definitions=main-2209220063 Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Type: text/plain; charset="utf-8" This field was added in commit 44510d6fa0c0 ("s390/pci: Handling multifunctions") but is an unused remnant of an earlier version where the devices on the virtual bus were connected in a linked list instead of a fixed 256 entry array of pointers. It is also not used for the list of busses as that is threaded through struct zpci_bus not through struct zpci_dev. Signed-off-by: Niklas Schnelle Reviewed-by: Pierre Morel --- arch/s390/include/asm/pci.h | 1 - 1 file changed, 1 deletion(-) diff --git a/arch/s390/include/asm/pci.h b/arch/s390/include/asm/pci.h index 7b4cdadbc023..108e732d7b14 100644 --- a/arch/s390/include/asm/pci.h +++ b/arch/s390/include/asm/pci.h @@ -117,7 +117,6 @@ struct zpci_bus { struct zpci_dev { struct zpci_bus *zbus; struct list_head entry; /* list of all zpci_devices, needed for hotplug,= etc. */ - struct list_head bus_next; struct kref kref; struct hotplug_slot hotplug_slot; =20 --=20 2.34.1 From nobody Thu Apr 2 16:35:48 2026 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id 632E5C6FA86 for ; Thu, 22 Sep 2022 09:53:24 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S231207AbiIVJxX (ORCPT ); Thu, 22 Sep 2022 05:53:23 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:48440 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229736AbiIVJxL (ORCPT ); Thu, 22 Sep 2022 05:53:11 -0400 Received: from mx0a-001b2d01.pphosted.com (mx0a-001b2d01.pphosted.com [148.163.156.1]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 572C2D4AB5; Thu, 22 Sep 2022 02:53:10 -0700 (PDT) Received: from pps.filterd (m0098409.ppops.net [127.0.0.1]) by mx0a-001b2d01.pphosted.com (8.17.1.5/8.17.1.5) with ESMTP id 28M9l6rl004094; Thu, 22 Sep 2022 09:52:48 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ibm.com; h=from : to : cc : subject : date : message-id : in-reply-to : references : mime-version : content-transfer-encoding; s=pp1; bh=iFPzyc+1zpfNBkQxlnUTKpOGKxYzWSgrTkAMFIFkP0M=; b=kXqoF+ylTtQKHUmiyTSfAD7BhHLNRXiHH74SETVPYLzop7Horzkku9llDA1Vvg6Ajo79 c34nTb+j7yX+k9jidex3lTUWBKi/aqG95raZXuQfltZ96g4soBGadq/386RdD6cdcZR3 pBi9kUIXfXU4CclFTIZ9y0v3IzROp8a/W8FauhA7vQb+A8X81qOOv3hpjx/Iy1gnEy6O d/3xn7QZR5YnoB22GO81MfNfFWa1FkL/AZP+tLaVNKq+2ecH49cerzYQgv84DcY0yDMR 1JoyWfa4tUL/eUg+Ei/jpXrsPbdp1xzuXTK2GlHqoZN7dpm7CgHPsjMjnPNvmy+P2zdD sA== Received: from ppma04fra.de.ibm.com (6a.4a.5195.ip4.static.sl-reverse.com [149.81.74.106]) by mx0a-001b2d01.pphosted.com (PPS) with ESMTPS id 3jrk3t4ejr-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 22 Sep 2022 09:52:47 +0000 Received: from pps.filterd (ppma04fra.de.ibm.com [127.0.0.1]) by ppma04fra.de.ibm.com (8.16.1.2/8.16.1.2) with SMTP id 28M9pICB031345; Thu, 22 Sep 2022 09:52:45 GMT Received: from b06avi18626390.portsmouth.uk.ibm.com (b06avi18626390.portsmouth.uk.ibm.com [9.149.26.192]) by ppma04fra.de.ibm.com with ESMTP id 3jn5v94u0b-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 22 Sep 2022 09:52:45 +0000 Received: from d06av22.portsmouth.uk.ibm.com (d06av22.portsmouth.uk.ibm.com [9.149.105.58]) by b06avi18626390.portsmouth.uk.ibm.com (8.14.9/8.14.9/NCO v10.0) with ESMTP id 28M9mdx733620342 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Thu, 22 Sep 2022 09:48:39 GMT Received: from d06av22.portsmouth.uk.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id 311C44C04E; Thu, 22 Sep 2022 09:52:42 +0000 (GMT) Received: from d06av22.portsmouth.uk.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id B50D44C044; Thu, 22 Sep 2022 09:52:41 +0000 (GMT) Received: from tuxmaker.boeblingen.de.ibm.com (unknown [9.152.85.9]) by d06av22.portsmouth.uk.ibm.com (Postfix) with ESMTP; Thu, 22 Sep 2022 09:52:41 +0000 (GMT) From: Niklas Schnelle To: Matthew Rosato , Pierre Morel , iommu@lists.linux.dev Cc: linux-s390@vger.kernel.org, borntraeger@linux.ibm.com, hca@linux.ibm.com, gor@linux.ibm.com, gerald.schaefer@linux.ibm.com, agordeev@linux.ibm.com, svens@linux.ibm.com, joro@8bytes.org, will@kernel.org, robin.murphy@arm.com, jgg@nvidia.com, linux-kernel@vger.kernel.org Subject: [PATCH v2 3/3] iommu/s390: Get rid of s390_domain_device Date: Thu, 22 Sep 2022 11:52:39 +0200 Message-Id: <20220922095239.2115309-4-schnelle@linux.ibm.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20220922095239.2115309-1-schnelle@linux.ibm.com> References: <20220922095239.2115309-1-schnelle@linux.ibm.com> MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable X-TM-AS-GCONF: 00 X-Proofpoint-ORIG-GUID: zVi65bFWdXyqlcOAKOFoh6E3zjfsOLzU X-Proofpoint-GUID: zVi65bFWdXyqlcOAKOFoh6E3zjfsOLzU X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.205,Aquarius:18.0.895,Hydra:6.0.528,FMLib:17.11.122.1 definitions=2022-09-22_06,2022-09-20_02,2022-06-22_01 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 malwarescore=0 bulkscore=0 mlxscore=0 adultscore=0 phishscore=0 clxscore=1015 lowpriorityscore=0 impostorscore=0 mlxlogscore=999 spamscore=0 priorityscore=1501 suspectscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2209130000 definitions=main-2209220063 Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Content-Type: text/plain; charset="utf-8" When an s390_domain is freed without previously detaching all devices the corresponding s390_domain_device is leaked. Instead of fixing this leak by freeing the s390_domain_devices in s390_domain_free() do one better and just get rid of s390_domain_device entirely by threading the domain's device list through struct zpci_dev. This also gets rid of a level of indirection during operations but also the allocation of the s390_domain_device during attach thus making it more reliable under memory pressure. Signed-off-by: Niklas Schnelle --- Changes since v1: - No need to iterate the devices list on detach just delete with the zpci_dev handle we have (Jason) - Don't remove list entries on s390_domain_free() instead warn on non-empty list as part of patch 1 arch/s390/include/asm/pci.h | 1 + drivers/iommu/s390-iommu.c | 33 ++++++--------------------------- 2 files changed, 7 insertions(+), 27 deletions(-) diff --git a/arch/s390/include/asm/pci.h b/arch/s390/include/asm/pci.h index 108e732d7b14..15f8714ca9b7 100644 --- a/arch/s390/include/asm/pci.h +++ b/arch/s390/include/asm/pci.h @@ -117,6 +117,7 @@ struct zpci_bus { struct zpci_dev { struct zpci_bus *zbus; struct list_head entry; /* list of all zpci_devices, needed for hotplug,= etc. */ + struct list_head iommu_list; struct kref kref; struct hotplug_slot hotplug_slot; =20 diff --git a/drivers/iommu/s390-iommu.c b/drivers/iommu/s390-iommu.c index 187d2c7ba9ff..e58b5d089418 100644 --- a/drivers/iommu/s390-iommu.c +++ b/drivers/iommu/s390-iommu.c @@ -29,11 +29,6 @@ struct s390_domain { spinlock_t list_lock; }; =20 -struct s390_domain_device { - struct list_head list; - struct zpci_dev *zdev; -}; - static struct s390_domain *to_s390_domain(struct iommu_domain *dom) { return container_of(dom, struct s390_domain, domain); @@ -90,19 +85,11 @@ static void s390_domain_free(struct iommu_domain *domai= n) static int __s390_iommu_detach_device(struct s390_domain *s390_domain, struct zpci_dev *zdev) { - struct s390_domain_device *domain_device, *tmp; unsigned long flags; =20 WARN_ON(zdev->s390_domain !=3D s390_domain); spin_lock_irqsave(&s390_domain->list_lock, flags); - list_for_each_entry_safe(domain_device, tmp, &s390_domain->devices, - list) { - if (domain_device->zdev =3D=3D zdev) { - list_del(&domain_device->list); - kfree(domain_device); - break; - } - } + list_del_init(&zdev->iommu_list); spin_unlock_irqrestore(&s390_domain->list_lock, flags); =20 zpci_unregister_ioat(zdev, 0); @@ -116,7 +103,6 @@ static int s390_iommu_attach_device(struct iommu_domain= *domain, { struct s390_domain *s390_domain =3D to_s390_domain(domain); struct zpci_dev *zdev =3D to_zpci_dev(dev); - struct s390_domain_device *domain_device; struct s390_domain *prev_domain =3D NULL; unsigned long flags; int cc, rc =3D 0; @@ -124,10 +110,6 @@ static int s390_iommu_attach_device(struct iommu_domai= n *domain, if (!zdev) return -ENODEV; =20 - domain_device =3D kzalloc(sizeof(*domain_device), GFP_KERNEL); - if (!domain_device) - return -ENOMEM; - if (zdev->s390_domain) { prev_domain =3D zdev->s390_domain; rc =3D __s390_iommu_detach_device(zdev->s390_domain, zdev); @@ -136,7 +118,7 @@ static int s390_iommu_attach_device(struct iommu_domain= *domain, rc =3D -EIO; } if (rc) - goto out_free; + return rc; =20 zdev->dma_table =3D s390_domain->dma_table; cc =3D zpci_register_ioat(zdev, 0, zdev->start_dma, zdev->end_dma, @@ -159,9 +141,8 @@ static int s390_iommu_attach_device(struct iommu_domain= *domain, spin_unlock_irqrestore(&s390_domain->list_lock, flags); goto out_unregister_restore; } - domain_device->zdev =3D zdev; zdev->s390_domain =3D s390_domain; - list_add(&domain_device->list, &s390_domain->devices); + list_add(&zdev->iommu_list, &s390_domain->devices); spin_unlock_irqrestore(&s390_domain->list_lock, flags); =20 return 0; @@ -175,8 +156,6 @@ static int s390_iommu_attach_device(struct iommu_domain= *domain, dev); else zpci_dma_init_device(zdev); -out_free: - kfree(domain_device); =20 return rc; } @@ -228,10 +207,10 @@ static int s390_iommu_update_trans(struct s390_domain= *s390_domain, phys_addr_t pa, dma_addr_t dma_addr, size_t size, int flags) { - struct s390_domain_device *domain_device; phys_addr_t page_addr =3D pa & PAGE_MASK; dma_addr_t start_dma_addr =3D dma_addr; unsigned long irq_flags, nr_pages, i; + struct zpci_dev *zdev; unsigned long *entry; int rc =3D 0; =20 @@ -256,8 +235,8 @@ static int s390_iommu_update_trans(struct s390_domain *= s390_domain, } =20 spin_lock(&s390_domain->list_lock); - list_for_each_entry(domain_device, &s390_domain->devices, list) { - rc =3D zpci_refresh_trans((u64) domain_device->zdev->fh << 32, + list_for_each_entry(zdev, &s390_domain->devices, iommu_list) { + rc =3D zpci_refresh_trans((u64)zdev->fh << 32, start_dma_addr, nr_pages * PAGE_SIZE); if (rc) break; --=20 2.34.1