From nobody Mon Feb 9 23:15:33 2026 Received: from mail-pl1-f173.google.com (mail-pl1-f173.google.com [209.85.214.173]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 9CBA02C1581 for ; Fri, 19 Dec 2025 05:37:35 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.214.173 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1766122658; cv=none; b=JT9X7u6MtASfATYe9Wfdk2leMiOb7Ow6Z3LEH6CAlTV5DtCSLtpEy09BpJslB95kKg9aEgbp8+YZqJ/L8V2X1fp4vl1mkAxSF4MKfFNtL6yW1ndTsJuAsd30vwfPWdjLYABEnN+39s6GcMzpQyEB0nXJCrniC3pR9jGvHlcTmm4= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1766122658; c=relaxed/simple; bh=VRHBseV8q+/R/B0v4LxS/if/aoC+7Nb6x15H0rpCpJo=; h=From:To:Cc:Subject:Date:Message-Id:In-Reply-To:References: MIME-Version; b=JH2RrEaPyUIqJV3O/WPUvSd11+Ny7uEgbKRHpPLqfq/ZlCJaUpfy5k2OparC0I/d+4nGmT7JauBBbE3pO+ieaKmsGA7f8bFN4vhhRiY9rzHt1Iacjgh6PGJebx4CcvFR14eVLBAZ1oQP5jiFvnhMEgBfslywaVwqoHmAaQrI78Q= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=gmail.com; spf=pass smtp.mailfrom=gmail.com; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b=aNG46r7O; arc=none smtp.client-ip=209.85.214.173 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=gmail.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=gmail.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="aNG46r7O" Received: by mail-pl1-f173.google.com with SMTP id d9443c01a7336-2a12ebe4b74so21353965ad.0 for ; Thu, 18 Dec 2025 21:37:35 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1766122655; x=1766727455; darn=vger.kernel.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=nVc7S6MGRFGsCbCRv42PvmwxMMf3ng26LOmJbRXLMRA=; b=aNG46r7O6E7A0ocEpk0rYAz/I9q82GOGQw6LAY1nQ6ayc9CcGmz+3aueA+NJDxwXQR 5eQVcVBd6AoIgKkatZfsVfWwz3/BZclFQ3An2WNsGR2ipDtkwKunmbrzBdkrWqQemA+h paz8SKfHEEQ7CoH/e1zjUo9g8ZQe561VucCDAI813c/nfeeIsSQrytO19kk0mxneZDUJ mDOqE2Rv5nesfJrgnZTxkQrOQIHxFNF3aV9bK/ktfBRqhTKIhTVhTbjxwavCKkn3i+ZO U727h+0kKL503cW1kWnaa73C+PvNB27v3YLCIRbMPjgV6O9FWSboRj3x4eQC/edku8E6 a3MA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1766122655; x=1766727455; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-gg:x-gm-message-state:from :to:cc:subject:date:message-id:reply-to; bh=nVc7S6MGRFGsCbCRv42PvmwxMMf3ng26LOmJbRXLMRA=; b=T9jXz8rFgXrgffyq4+8k3sDQRbmz3VKRYsihuBUQSSIvfLckE5I0bdrkmINWXLhIym ZOA25YwGB9rw5MnaEA6jB2UkHCMui5m45mLGqKvTeNY0d5vJGeMmo6Ko8/vJ+weOmM9x s2AjrYtgnZIhtvL7jHb/73OZT/LhUyV1uOmtECJsx80j4JWOychDHKn7LpZEl4XYIqiS 2XskdIftlmuUHi7/yfy2Nq8TmsD1C2xhati1Hfd+Q9Sj1gPfCve/ZDi6zhP/Twi7uNis un5LWS5eP5ztqotPLTPM7IELQ3Q/699xGPmyECpZW7L9m9mQhYLKtGmqkEu0IAqvsBS8 Sdag== X-Forwarded-Encrypted: i=1; AJvYcCXgiCseI9i4yT5dZArDNiRhpoZWqHXp6/uvet9l7U5BwyH91H6cFbqzXeISN2SLMtQiLu1GB6XZk7Xlbo8=@vger.kernel.org X-Gm-Message-State: AOJu0Yz7fr7G4SFvEJ9jovt5LG5C2HSduS84K2OIDAOdTaQ25AyplOQ8 0nmT8qn1T1gDUzrsaxpe1sNIydDuurvBQ8EbUZisiLu7M+3CMGgBvnry X-Gm-Gg: AY/fxX7l2weWe4Nsw+MZhy0yrt+Rsj5M+AhDrME8+/KLT2745cl2YJQPDd7fErunmX5 O1rkP6fD2Yr57SFQVs1Owc2jkccxjP17AS4BT52qB+DfkgisxK08TkL9z9KMllm/lOJ4MTePOUT 6bS6HaYUx17qcEBuqyW+B0z8w24HXbPeX+55iKjaN33YI225/Fqlct7zLaIlaVaqYg47bpv7NyB xN6dq7soU9ZQmTb/hNeAPreaoV1mA65OAr37lJWD2yoUEDEgNxvURwlCcd1vf5S64WuAlY8weuS oV/6FCtvwRGGTyMFYOJeqlShEHtk8zaogS99R/lem7VU9DXbyrjfXLZbwrY5/2l966jarb110i3 41Hb0ACxLGbWOkWRkYM+pgI7a3u9ZtTUAxnNS8VIwnapcjmWJGjnCIp7oKU+q5OAYIw+e9j46kV WRJkxzHbyI735sEuu5j9E= X-Google-Smtp-Source: AGHT+IEgIXUAtoilrAdOFUVheL04wY8Hn1GTTg9fp3Bh9Uns3qP+YxFWsnf+ZhkJ6ZTgBwxYZdARhA== X-Received: by 2002:a17:903:37d0:b0:295:8da5:c634 with SMTP id d9443c01a7336-2a2f2206b52mr14068935ad.9.1766122654548; Thu, 18 Dec 2025 21:37:34 -0800 (PST) Received: from Barrys-MBP.hub ([47.72.129.29]) by smtp.gmail.com with ESMTPSA id d9443c01a7336-2a2f3d4d895sm9930215ad.54.2025.12.18.21.37.28 (version=TLS1_3 cipher=TLS_CHACHA20_POLY1305_SHA256 bits=256/256); Thu, 18 Dec 2025 21:37:34 -0800 (PST) From: Barry Song <21cnbao@gmail.com> To: catalin.marinas@arm.com, m.szyprowski@samsung.com, robin.murphy@arm.com, will@kernel.org Cc: ada.coupriediaz@arm.com, anshuman.khandual@arm.com, ardb@kernel.org, iommu@lists.linux.dev, linux-arm-kernel@lists.infradead.org, linux-kernel@vger.kernel.org, maz@kernel.org, ryan.roberts@arm.com, surenb@google.com, v-songbaohua@oppo.com, zhengtangquan@oppo.com Subject: [PATCH 4/6] arm64: Provide arch_sync_dma_ batched helpers Date: Fri, 19 Dec 2025 13:36:56 +0800 Message-Id: <20251219053658.84978-5-21cnbao@gmail.com> X-Mailer: git-send-email 2.39.3 (Apple Git-146) In-Reply-To: <20251219053658.84978-1-21cnbao@gmail.com> References: <20251219053658.84978-1-21cnbao@gmail.com> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="utf-8" From: Barry Song arch_sync_dma_for_device_batch_add() and arch_sync_dma_for_cpu_batch_add() batch DMA sync operations, while arch_sync_dma_batch_flush() waits for their completion as a group. On architectures that do not support batching, arch_sync_dma_for_device_batch_add() and arch_sync_dma_for_cpu_batch_add() fall back to the non-batched implementations, and arch_sync_dma_batch_flush() is a no-op. Cc: Catalin Marinas Cc: Will Deacon Cc: Marek Szyprowski Cc: Robin Murphy Cc: Ada Couprie Diaz Cc: Ard Biesheuvel Cc: Marc Zyngier Cc: Anshuman Khandual Cc: Ryan Roberts Cc: Suren Baghdasaryan Cc: Tangquan Zheng Signed-off-by: Barry Song --- arch/arm64/Kconfig | 1 + arch/arm64/mm/dma-mapping.c | 24 ++++++++++++++++++++++++ include/linux/dma-map-ops.h | 22 ++++++++++++++++++++++ kernel/dma/Kconfig | 3 +++ 4 files changed, 50 insertions(+) diff --git a/arch/arm64/Kconfig b/arch/arm64/Kconfig index 93173f0a09c7..c8adbf21b7bf 100644 --- a/arch/arm64/Kconfig +++ b/arch/arm64/Kconfig @@ -112,6 +112,7 @@ config ARM64 select ARCH_SUPPORTS_SCHED_CLUSTER select ARCH_SUPPORTS_SCHED_MC select ARCH_WANT_BATCHED_UNMAP_TLB_FLUSH + select ARCH_WANT_BATCHED_DMA_SYNC select ARCH_WANT_COMPAT_IPC_PARSE_VERSION if COMPAT select ARCH_WANT_DEFAULT_BPF_JIT select ARCH_WANT_DEFAULT_TOPDOWN_MMAP_LAYOUT diff --git a/arch/arm64/mm/dma-mapping.c b/arch/arm64/mm/dma-mapping.c index b2b5792b2caa..9ac1ddd1bb9c 100644 --- a/arch/arm64/mm/dma-mapping.c +++ b/arch/arm64/mm/dma-mapping.c @@ -31,6 +31,30 @@ void arch_sync_dma_for_cpu(phys_addr_t paddr, size_t siz= e, dcache_inval_poc(start, start + size); } =20 +void arch_sync_dma_for_device_batch_add(phys_addr_t paddr, size_t size, + enum dma_data_direction dir) +{ + unsigned long start =3D (unsigned long)phys_to_virt(paddr); + + dcache_clean_poc_nosync(start, start + size); +} + +void arch_sync_dma_for_cpu_batch_add(phys_addr_t paddr, size_t size, + enum dma_data_direction dir) +{ + unsigned long start =3D (unsigned long)phys_to_virt(paddr); + + if (dir =3D=3D DMA_TO_DEVICE) + return; + + dcache_inval_poc_nosync(start, start + size); +} + +void arch_sync_dma_batch_flush(void) +{ + dsb(sy); +} + void arch_dma_prep_coherent(struct page *page, size_t size) { unsigned long start =3D (unsigned long)page_address(page); diff --git a/include/linux/dma-map-ops.h b/include/linux/dma-map-ops.h index 4809204c674c..5ee92c410e3c 100644 --- a/include/linux/dma-map-ops.h +++ b/include/linux/dma-map-ops.h @@ -361,6 +361,28 @@ static inline void arch_sync_dma_for_cpu(phys_addr_t p= addr, size_t size, } #endif /* ARCH_HAS_SYNC_DMA_FOR_CPU */ =20 +#ifdef CONFIG_ARCH_WANT_BATCHED_DMA_SYNC +void arch_sync_dma_for_device_batch_add(phys_addr_t paddr, size_t size, + enum dma_data_direction dir); +void arch_sync_dma_for_cpu_batch_add(phys_addr_t paddr, size_t size, + enum dma_data_direction dir); +void arch_sync_dma_batch_flush(void); +#else +static inline void arch_sync_dma_for_device_batch_add(phys_addr_t paddr, s= ize_t size, + enum dma_data_direction dir) +{ + arch_sync_dma_for_device(paddr, size, dir); +} +static inline void arch_sync_dma_for_cpu_batch_add(phys_addr_t paddr, size= _t size, + enum dma_data_direction dir) +{ + arch_sync_dma_for_cpu(paddr, size, dir); +} +static inline void arch_sync_dma_batch_flush(void) +{ +} +#endif + #ifdef CONFIG_ARCH_HAS_SYNC_DMA_FOR_CPU_ALL void arch_sync_dma_for_cpu_all(void); #else diff --git a/kernel/dma/Kconfig b/kernel/dma/Kconfig index 31cfdb6b4bc3..2785099b2fa0 100644 --- a/kernel/dma/Kconfig +++ b/kernel/dma/Kconfig @@ -78,6 +78,9 @@ config ARCH_HAS_DMA_PREP_COHERENT config ARCH_HAS_FORCE_DMA_UNENCRYPTED bool =20 +config ARCH_WANT_BATCHED_DMA_SYNC + bool + # # Select this option if the architecture assumes DMA devices are coherent # by default. --=20 2.39.3 (Apple Git-146)