From nobody Sun Oct 5 17:59:50 2025 Received: from mail-wm1-f49.google.com (mail-wm1-f49.google.com [209.85.128.49]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 620582DE6E3 for ; Wed, 30 Jul 2025 17:20:02 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.128.49 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1753896004; cv=none; b=eFB5tL2m3Znf2nTtgL0iQCm8ehxu4c+32Ai7SJfVcMkYLihumEtXe0hD3176ie9/FxLzAidTYCsGKyexU0fRltvc0PKJFzS2JfSrtTsZFZVd/exUMZmjpNLLXnZSy+rRmxYH1g83gZfEcBcTpZCriDRzzQlGSN3eZ0MJM8RR9AA= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1753896004; c=relaxed/simple; bh=5MtdqOrWp9XL+/7P8KF0tm7XQYdo1i1gdInDgtxB8uM=; h=From:To:Cc:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version; b=pMgLAc1X5OFmtKk1v4zVvL5964aIwKTOQht0iqeXwUX37S4y1BY1axdACMKQxJE4+Ozhhm5V6uQ8a+1uyMnJxLMjWrrkMBp963I1nP6LS2QZBrWXGkm/il8XdJL2uI1TDTbb9Qs5ULvVmOJOG2D8qylLXngTeMXAtE8F8u6m7K8= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=gmail.com; spf=pass smtp.mailfrom=gmail.com; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b=KVXGYb6h; arc=none smtp.client-ip=209.85.128.49 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=gmail.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=gmail.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="KVXGYb6h" Received: by mail-wm1-f49.google.com with SMTP id 5b1f17b1804b1-4563cfac19cso407055e9.2 for ; Wed, 30 Jul 2025 10:20:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1753896001; x=1754500801; darn=vger.kernel.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=BQ2a6DHl3z5np980mAJ2X98cngKs2SsQ+pYCL8WCFTA=; b=KVXGYb6hHi5K+PK6Eg6D4nwFiJLaPll75wmAm3zXb/+b+cPH45e/Y8xBWRLrMMXE6D vGkEus0QB9wlG5Jge4kgGnQbYtY1aeSDq/A0OduUtSnCQjJYKppwZ27nGWdytvTFYi1v /MWGbQsoyMyz92wbieZMM85Z0nQUXC2NZ5gIM1+G04Oge4lgRXvGtTwcLOeP5hUv1rpr b4196ytvFfsSZI8inVJ3VuOwxeCvLcfuEOY0CtKOUo4itFZa2RlCHiLeEyIzxjwaujSv QZfzPl21ID52niwrueHb+TgK07IP8ho3x7aMFsegR05A6ijlAW5h5/hdoA5HmNEX58Br aDRw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1753896001; x=1754500801; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=BQ2a6DHl3z5np980mAJ2X98cngKs2SsQ+pYCL8WCFTA=; b=TNyQW9noRTzZ3NtaTGvLksLUQ8rl7uKIuuHIOptJI2wiaYYIW4W7iQ8bgBpkoRv5AR 4gI+BFUVBin/KMUR83geVO2V+Z1lig27z5ozp/sHvFQAdyygQMmS16Y9hGUvwARuuZVX 6SQCg4+vDORnc8oFVt7MMebX/KpKQHx8YeVDkPNLy1YHGUE2beFnB2VoAKjLDrJ3AhIP 8snATH1p9VpGbAZPiRT8vhV73uIYF868Vz0VcCBJsLIOo+PYoucNLMa1XuXE6ggv5iq6 d3I6A5bGVYUG7Zoc7P2XXE8b5Yhe8RdYE33kH21osArWM5+ksKFRj0hyOarSaLx7PfEI N8Tg== X-Forwarded-Encrypted: i=1; AJvYcCV7akl/4Qk6jHtWMX1hDOU8su+8mrYBwi312bDDSCmUQ7Sz5WRxH9Tu7cuDOmTz7WOLxGgCyRUhPsA5SiE=@vger.kernel.org X-Gm-Message-State: AOJu0YyQSTrFlR6gkbYWDW5mcS3qvNRKAKEXJYbNAHm0EOO629YFBHF0 I2IH/nG3Y32cSUHfqWQ0RnQTBub5tbOYCsIm1TeWqXHCjKITE05G3WfO X-Gm-Gg: ASbGncs+qMkvVE4bwTOS2uUYvz5qtCO2GQdAdw0mU3iFt1TgkrmmUDuQ5cNOjj8UMeW CXMNzlE+S7t5sup7Ds1pwwvYS6TqtjqHTkY4Cx8gatI1sZ+wVcjM5Mpc9CJQ/3SbfYVDRWDfXVP sWyzDuT2NLi9yh5lfuxsdm4Aq/oswNhL38LYTFbe6Z8J2wTDORueJanvHfvK+6fjIclsqsc9Zp0 gGcmEyRkhuhDTN5k9oqZVJPB9vtPi3HTwzMKfK2mhMcnGhkKaSSJDxY3Y91YfAgK3WH/LG8RI0F hn+lsr7CMnIA7XLqJW20iOu32S0oQLowWabTTWJJ7UrVYpm6wfLjGy2+MRjEXxIE/sw7CkoaCAN WzvwHxar3n/0tWVc= X-Google-Smtp-Source: AGHT+IEHjDXRiZsxpAsVevWpg7SdTkCsFSlZa/tie3LLi8D0AnSzcwlEavp7Qck5/rRCdYnNe8zb1w== X-Received: by 2002:a05:600c:8119:b0:456:1c44:441f with SMTP id 5b1f17b1804b1-45892be164dmr40383595e9.31.1753896000435; Wed, 30 Jul 2025 10:20:00 -0700 (PDT) Received: from localhost ([2a03:2880:31ff:40::]) by smtp.gmail.com with ESMTPSA id 5b1f17b1804b1-458953cfcadsm37360005e9.18.2025.07.30.10.19.59 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 30 Jul 2025 10:20:00 -0700 (PDT) From: Yueyang Pan To: SeongJae Park , Andrew Morton , Usama Arif Cc: damon@lists.linux.dev, linux-mm@kvack.org, linux-kernel@vger.kernel.org Subject: [PATCH v2 1/2] mm/damon: Move has filter to ops-common Date: Wed, 30 Jul 2025 10:19:55 -0700 Message-ID: <06734aa15198e542f9defbc1d29fc0731671c3d8.1753895066.git.pyyjason@gmail.com> X-Mailer: git-send-email 2.47.3 In-Reply-To: References: Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="utf-8" This patch moves damon_pa_scheme_has_filter to ops-common. renaming to damon_scheme_has_filter. Doing so allows us to reuse its logic in the vaddr version of DAMOS_STAT Signed-off-by: Yueyang Pan --- mm/damon/ops-common.c | 9 +++++++++ mm/damon/ops-common.h | 2 ++ mm/damon/paddr.c | 11 +---------- 3 files changed, 12 insertions(+), 10 deletions(-) diff --git a/mm/damon/ops-common.c b/mm/damon/ops-common.c index 99321ff5cb92..3ebfa356ca46 100644 --- a/mm/damon/ops-common.c +++ b/mm/damon/ops-common.c @@ -412,3 +412,12 @@ unsigned long damon_migrate_pages(struct list_head *fo= lio_list, int target_nid) =20 return nr_migrated; } + +bool damon_scheme_has_filter(struct damos *s) +{ + struct damos_filter *f; + + damos_for_each_ops_filter(f, s) + return true; + return false; +} diff --git a/mm/damon/ops-common.h b/mm/damon/ops-common.h index 61ad54aaf256..8d5c5c7631ac 100644 --- a/mm/damon/ops-common.h +++ b/mm/damon/ops-common.h @@ -21,3 +21,5 @@ int damon_hot_score(struct damon_ctx *c, struct damon_reg= ion *r, =20 bool damos_folio_filter_match(struct damos_filter *filter, struct folio *f= olio); unsigned long damon_migrate_pages(struct list_head *folio_list, int target= _nid); + +bool damon_scheme_has_filter(struct damos *s); diff --git a/mm/damon/paddr.c b/mm/damon/paddr.c index 53a55c5114fb..daeceed981a0 100644 --- a/mm/damon/paddr.c +++ b/mm/damon/paddr.c @@ -262,22 +262,13 @@ static unsigned long damon_pa_migrate(struct damon_re= gion *r, struct damos *s, return applied * PAGE_SIZE; } =20 -static bool damon_pa_scheme_has_filter(struct damos *s) -{ - struct damos_filter *f; - - damos_for_each_ops_filter(f, s) - return true; - return false; -} - static unsigned long damon_pa_stat(struct damon_region *r, struct damos *s, unsigned long *sz_filter_passed) { unsigned long addr; struct folio *folio; =20 - if (!damon_pa_scheme_has_filter(s)) + if (!damon_scheme_has_filter(s)) return 0; =20 addr =3D r->ar.start; --=20 2.47.3 From nobody Sun Oct 5 17:59:50 2025 Received: from mail-wr1-f45.google.com (mail-wr1-f45.google.com [209.85.221.45]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 961022DC34F for ; Wed, 30 Jul 2025 17:20:03 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.221.45 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1753896006; cv=none; b=nAMHFbcad8wtYq+iwHYE8S+7S86dFCOxwMp6d49IDx60szXhM/cpmtVU5KP+e3r0rbKpj+XIH7mSalC9Q4ZrJBF+kF0gwbI4NJoYjAh/SYpD4Hj+BAseTlWbkrQqvhmXM+QzxL9vPYmhb+JserxjJNCXSSG85eG6xXw36svCH7Y= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1753896006; c=relaxed/simple; bh=GdobNqCOO20Whsgzozafpby6KJFetdejZjlrCnc5zdo=; h=From:To:Cc:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version; b=fOfMZyqupF13A6YpFR/MNmDstq7y/DOrd34tLA/bi0LIfUsx94avX2nKoFPSwW79gEezG/Ybc6KuRYuwUDtYAZaPeM4nqNo1j2uHI0l2wfNsYgwbymIPrLoBeYSXmNkbBKZZjquOMS82tlGWNuNdoF3ntyQFVwx9YQvSocyBxis= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=gmail.com; spf=pass smtp.mailfrom=gmail.com; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b=WEmL3cF6; arc=none smtp.client-ip=209.85.221.45 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=gmail.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=gmail.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="WEmL3cF6" Received: by mail-wr1-f45.google.com with SMTP id ffacd0b85a97d-3b783ea502eso986475f8f.1 for ; Wed, 30 Jul 2025 10:20:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1753896002; x=1754500802; darn=vger.kernel.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=m56piLiCUsf4x2+WWsFp57PljOix1hfz8SW0ckD+2q4=; b=WEmL3cF6IyFyUS9XD2q5QiYuzw9W8/ltoiQkI4fByXZy/Q91CYkrYveAY/o7twQVxw KLN9bZVKaLdqdzJTsef6fIbjkZ/ocLHg0b5mkZS3brW9G8OHaN2yqmPxJuqJFQMA/MQ6 t1XPhFtdkkXMcvA4eFpvlIdrx9rB+6pLAPh9zmUeHkRBHzilze2qOOBrhdPIQAlXunoR 6rvrHXMZ67BZG3LXq+8F3BO3RDJv1Vg0QJWHEcgxCskVS95aC+w2X02hbKGV7miZOxqR S1iYf4QiEJ1Trj5G1U3zsh+Mu74FtFwykEKaiE7DNHxPnKOys6hraWpAe5vpdCCSyNqI 2r5Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1753896002; x=1754500802; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=m56piLiCUsf4x2+WWsFp57PljOix1hfz8SW0ckD+2q4=; b=GVfvBYzu4mkPH2EQI2mn3xNcloeIFeUJ98NwGG6E6s+vo4xbjFW+J5PLENdb/WQNKm R3dftE699f7aq832rGaeuwFxSgEAZ/HmJe3G3fdEyXxXMgHgSvR/WC+9C8tdTrRlPlwG isOB8+IxvDfyWgVO/+RuA9pYP2WH9Cq+bE65sJ6BTUxOEojsMTWfjF3BIAW8lTd9KLVB N0+k2QyPerHVfxoOJPtt0e0fH/j5I04LqXiA4eXfQmOwvErWRFh+JEq1LlZVViSZB7JQ 7j6U2Av0W2lV+o5ft3VoHFJDqzG1T7EonpvW9n1ezAsPwhBk+eKLQD13iu028csJnk9p gvyg== X-Forwarded-Encrypted: i=1; AJvYcCUPL+/iM3Qwg01e7wy0PtVMtCf2qe97vFkdbUkE3uNT2PHjRljDY/jquoiuC+xwnM7W7HKn2oxEcnxZfrY=@vger.kernel.org X-Gm-Message-State: AOJu0YxS0QHhzPhBMC1ih8voMadN5w6cuAzFe4q7MKimxW7g7u/DebVH w3m7NHkTUIgeqKFwoBks33fZSnx6pKiMUsE5znWPXOvMVQO9hQc+X9G6 X-Gm-Gg: ASbGncvtnfrMqlLZ9SvfzrIBmAF9g8IyOpbdGgM2/tBTR2AaxAHEB0vCoV4I7Ta3W2/ mOawCEp/uUFhFPTRK8EeXjtwWEjXO8JXNsARxY+a/J7QLGmB2V/Y1wD7Cshyeyk9zM4bgrZEmm4 HhcjTEnDi6iq5sbG+Xwh3L70kebyGCOVamRKZyOiG9m5iFjRRBxh0X2T7nO3mdHiFCQZE7KZwoW q/x5Yl7jl12eBYmqZrNRGntQu2dtTt+OI0Sqw1cGaLHbXV8JrWSLqFPLN/XUBDp9pksN1WcR1G/ vhmOLLdjzo5KW0ItIM3sEGxbNXFaAgdFZpKcnGVQPP6NbinBdXqOC6zNiMp1JICZFFH9ajZ78kR hGASHo+eNCPyEjjg= X-Google-Smtp-Source: AGHT+IGCdHpb01HVcfRvMatDM7O3m0xWJobij7p29QqoVPfMGp10ngvKQXKEPQiuMocwu72i1Rx6hw== X-Received: by 2002:a05:6000:2311:b0:3a5:8934:4959 with SMTP id ffacd0b85a97d-3b78e72803dmr7193414f8f.27.1753896001745; Wed, 30 Jul 2025 10:20:01 -0700 (PDT) Received: from localhost ([2a03:2880:31ff:74::]) by smtp.gmail.com with ESMTPSA id 5b1f17b1804b1-45895377ae2sm33277545e9.12.2025.07.30.10.20.01 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 30 Jul 2025 10:20:01 -0700 (PDT) From: Yueyang Pan To: SeongJae Park , Andrew Morton , Usama Arif Cc: damon@lists.linux.dev, linux-mm@kvack.org, linux-kernel@vger.kernel.org Subject: [PATCH v2 2/2] mm/damon: Add damos_stat support for vaddr Date: Wed, 30 Jul 2025 10:19:56 -0700 Message-ID: X-Mailer: git-send-email 2.47.3 In-Reply-To: References: Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="utf-8" This patch adds support for damos_stat in virtual address space. It leverages the walk_page_range to walk the page table and gets the folio from page table. The last folio scanned is stored in damos->last_applied to prevent double counting. Signed-off-by: Yueyang Pan --- mm/damon/vaddr.c | 105 ++++++++++++++++++++++++++++++++++++++++++++++- 1 file changed, 104 insertions(+), 1 deletion(-) diff --git a/mm/damon/vaddr.c b/mm/damon/vaddr.c index 87e825349bdf..6ed919e817e2 100644 --- a/mm/damon/vaddr.c +++ b/mm/damon/vaddr.c @@ -890,6 +890,109 @@ static unsigned long damos_va_migrate(struct damon_ta= rget *target, return applied * PAGE_SIZE; } =20 +struct damos_va_stat_private { + struct damos *scheme; + unsigned long *sz_filter_passed; +}; + +static inline bool damon_va_invalid_damos_folio(struct folio *folio, struc= t damos *s) +{ + return !folio || folio =3D=3D s->last_applied; +} + +static int damos_va_stat_pmd_entry(pmd_t *pmd, unsigned long addr, + unsigned long next, struct mm_walk *walk) +{ + struct damos_va_stat_private *priv =3D walk->private; + struct damos *s =3D priv->scheme; + unsigned long *sz_filter_passed =3D priv->sz_filter_passed; + struct vm_area_struct *vma =3D walk->vma; + struct folio *folio; + spinlock_t *ptl; + pte_t *start_pte, *pte, ptent; + int nr; + +#ifdef CONFIG_TRANSPARENT_HUGEPAGE + if (pmd_trans_huge(*pmd)) { + pmd_t pmde; + + ptl =3D pmd_trans_huge_lock(pmd, vma); + if (!ptl) + return 0; + pmde =3D pmdp_get(pmd); + if (!pmd_present(pmde)) + goto huge_unlock; + + folio =3D vm_normal_folio_pmd(vma, addr, pmde); + + if (damon_va_invalid_damos_folio(folio, s)) + goto huge_unlock; + + if (!damos_va_filter_out(s, folio, vma, addr, NULL, pmd)) + *sz_filter_passed +=3D folio_size(folio); + s->last_applied =3D folio; + +huge_unlock: + spin_unlock(ptl); + return 0; + } +#endif + start_pte =3D pte =3D pte_offset_map_lock(vma->vm_mm, pmd, addr, &ptl); + if (!start_pte) + return 0; + + for (; addr < next; pte +=3D nr, addr +=3D nr * PAGE_SIZE) { + nr =3D 1; + ptent =3D ptep_get(pte); + + if (pte_none(ptent) || !pte_present(ptent)) + continue; + + folio =3D vm_normal_folio(vma, addr, ptent); + + if (damon_va_invalid_damos_folio(folio, s)) + continue; + + if (!damos_va_filter_out(s, folio, vma, addr, pte, NULL)) + *sz_filter_passed +=3D folio_size(folio); + nr =3D folio_nr_pages(folio); + s->last_applied =3D folio; + } + + pte_unmap_unlock(start_pte, ptl); + + return 0; +} + +static unsigned long damos_va_stat(struct damon_target *target, + struct damon_region *r, struct damos *s, + unsigned long *sz_filter_passed) +{ + + struct damos_va_stat_private priv; + struct mm_struct *mm; + struct mm_walk_ops walk_ops =3D { + .pmd_entry =3D damos_va_stat_pmd_entry, + .walk_lock =3D PGWALK_RDLOCK, + }; + + priv.scheme =3D s; + priv.sz_filter_passed =3D sz_filter_passed; + + if (!damon_scheme_has_filter(s)) + return 0; + + mm =3D damon_get_mm(target); + if (!mm) + return 0; + + mmap_read_lock(mm); + walk_page_range(mm, r->ar.start, r->ar.end, &walk_ops, &priv); + mmap_read_unlock(mm); + mmput(mm); + return 0; +} + static unsigned long damon_va_apply_scheme(struct damon_ctx *ctx, struct damon_target *t, struct damon_region *r, struct damos *scheme, unsigned long *sz_filter_passed) @@ -916,7 +1019,7 @@ static unsigned long damon_va_apply_scheme(struct damo= n_ctx *ctx, case DAMOS_MIGRATE_COLD: return damos_va_migrate(t, r, scheme, sz_filter_passed); case DAMOS_STAT: - return 0; + return damos_va_stat(t, r, scheme, sz_filter_passed); default: /* * DAMOS actions that are not yet supported by 'vaddr'. --=20 2.47.3