From nobody Sat Jul 25 18:07:46 2026 Received: from out30-112.freemail.mail.aliyun.com (out30-112.freemail.mail.aliyun.com [115.124.30.112]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 4487A25B088 for ; Wed, 15 Jul 2026 06:33:34 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=115.124.30.112 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1784097217; cv=none; b=YEk5+a6soLa35xpaSyZjbufI32kk7AYuxr/MPxF+iEbhfYuuIheK3KjRPz2mz9VfNXiJsI8LAl3iWhZGEQtoVDGQk6SuUgs2Ewu4jKblXPtqvYz7PCH3w+oQ4jWRDavRLdEwZGqTKbxNGxfPehSeBo7jcDLy/vCMBZ+uIbykhYI= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1784097217; c=relaxed/simple; bh=zhXSwS6EfGe7uqmN8oMX7JEFCFNTm79BiMMnHrj4Ul4=; h=From:To:Cc:Subject:Date:Message-ID:MIME-Version; b=mVmmhHY4Vy8bSbF2iWED42zzm/MlW8tfFUmxhDRQ2xJkm9Ml+yUt5FSaMJTsQ1KZzdkF4IFoephUNUDDnnvHNKe915Nag4M75nZ7yIy7YkYsbebFSR+6rdrwBLdm7sIEH+kWuwGPRhXUoikNp/lUcKwlajsHP49fEtz0K+N0huw= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linux.alibaba.com; spf=pass smtp.mailfrom=linux.alibaba.com; dkim=pass (1024-bit key) header.d=linux.alibaba.com header.i=@linux.alibaba.com header.b=v0lJaT6K; arc=none smtp.client-ip=115.124.30.112 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linux.alibaba.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=linux.alibaba.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=linux.alibaba.com header.i=@linux.alibaba.com header.b="v0lJaT6K" DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linux.alibaba.com; s=default; t=1784097205; h=From:To:Subject:Date:Message-ID:MIME-Version; bh=GwUARoDReJNHtIU6s61R1/sTFQW971jIk/WcoR5mrPM=; b=v0lJaT6KoylfBlwnyQ7nkq1SovpiVuKd3pPwmHDzXEwOl8tJOfTB9Z4+F7o8eGzCXhBDzq5gtbi9Dmw721O/2NNi5eMG5CjiZATjHQ+3Tsj1tLugZUmh+sLajigr++/0KiRLwP/PtzIj546mMBQZpDYYpQVfvFLD2oLw4FR/eec= X-Alimail-AntiSpam: AC=PASS;BC=-1|-1;BR=01201311R201e4;CH=green;DM=||false|;DS=||;FP=0|-1|-1|-1|0|-1|-1|-1;HT=maildocker-contentspam033037033178;MF=baolin.wang@linux.alibaba.com;NM=1;PH=DS;RN=14;SR=0;TI=SMTPD_---0X783.5y_1784097204; Received: from localhost(mailfrom:baolin.wang@linux.alibaba.com fp:SMTPD_---0X783.5y_1784097204 cluster:ay36) by smtp.aliyun-inc.com; Wed, 15 Jul 2026 14:33:24 +0800 From: Baolin Wang To: akpm@linux-foundation.org Cc: kasong@tencent.com, qi.zheng@linux.dev, shakeel.butt@linux.dev, baohua@kernel.org, axelrasmussen@google.com, yuanchu@google.com, weixugc@google.com, david@kernel.org, mhocko@kernel.org, ljs@kernel.org, baolin.wang@linux.alibaba.com, linux-mm@kvack.org, linux-kernel@vger.kernel.org Subject: [PATCH] mm: mglru: promote mapped executable folios after first usage Date: Wed, 15 Jul 2026 14:33:03 +0800 Message-ID: <4b921ed528c483e13c9e22d1ae44ba58b4a15b0b.1784096432.git.baolin.wang@linux.alibaba.com> X-Mailer: git-send-email 2.43.5 Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="utf-8" Classical LRU protects mapped executable file folios through commit 8cab4754d24a0 ("vmscan: make mapped executable pages the first class citizen") and commit c909e99364c8 ("vmscan: activate executable pages after first usage"), giving executable code a better chance to stay in memory, avoiding IO thrashing and improving workload performance. However, MGLRU's protection of mapped executable file folios is less reliable. Although shrink_folio_list() checks references, the access flag of mapped executable file folios may have already been checked and cleared by lru_gen_look_around() or walk_mm(). Additionally, folio_update_gen() only sets the 'PG_referenced' flag for mapped executable file folios, which causes shrink_folio_list() to ignore the first usage of these mapped executable file folios and reclaim them. Follow the classical LRU's logic, promoting mapped executable file folios after their first usage in folio_update_gen(), giving executable code a better chance to stay in memory. On my 32-core Arm machine, with the memcg limit set to 2G, running 'make -j32' to build kernel showed some improvement in sys time. base patched 9248.543s 7861.579s Signed-off-by: Baolin Wang --- mm/vmscan.c | 25 +++++++++++++++---------- 1 file changed, 15 insertions(+), 10 deletions(-) diff --git a/mm/vmscan.c b/mm/vmscan.c index 986dde8e7429..429857852bdb 100644 --- a/mm/vmscan.c +++ b/mm/vmscan.c @@ -3188,7 +3188,7 @@ static bool positive_ctrl_err(struct ctrl_pos *sp, st= ruct ctrl_pos *pv) *************************************************************************= *****/ =20 /* promote pages accessed through page tables */ -static int folio_update_gen(struct folio *folio, int gen) +static int folio_update_gen(struct vm_area_struct *vma, struct folio *foli= o, int gen) { unsigned long new_flags, old_flags =3D READ_ONCE(folio->flags.f); =20 @@ -3196,10 +3196,15 @@ static int folio_update_gen(struct folio *folio, in= t gen) =20 /* see the comment on LRU_REFS_FLAGS */ if (!folio_test_referenced(folio) && !folio_test_workingset(folio)) { + /* Activate file-backed executable folios after first usage. */ + if (vma_test(vma, VMA_EXEC_BIT) && folio_is_file_lru(folio)) + goto promote; + set_mask_bits(&folio->flags.f, LRU_REFS_MASK, BIT(PG_referenced)); return -1; } =20 +promote: do { /* lru_gen_del_folio() has isolated this page? */ if (!(old_flags & LRU_GEN_MASK)) @@ -3428,8 +3433,8 @@ static bool suitable_to_scan(int total, int young) return young * n >=3D total; } =20 -static void walk_update_folio(struct lru_gen_mm_walk *walk, struct folio *= folio, - int new_gen, bool dirty) +static void walk_update_folio(struct lru_gen_mm_walk *walk, struct vm_area= _struct *vma, + struct folio *folio, int new_gen, bool dirty) { int old_gen; =20 @@ -3442,7 +3447,7 @@ static void walk_update_folio(struct lru_gen_mm_walk = *walk, struct folio *folio, folio_mark_dirty(folio); =20 if (walk) { - old_gen =3D folio_update_gen(folio, new_gen); + old_gen =3D folio_update_gen(vma, folio, new_gen); if (old_gen >=3D 0 && old_gen !=3D new_gen) update_batch_size(walk, folio, old_gen, new_gen); } else if (lru_gen_set_refs(folio)) { @@ -3518,7 +3523,7 @@ static bool walk_pte_range(pmd_t *pmd, unsigned long = start, unsigned long end, continue; =20 if (last !=3D folio) { - walk_update_folio(walk, last, gen, dirty); + walk_update_folio(walk, args->vma, last, gen, dirty); =20 last =3D folio; dirty =3D false; @@ -3531,7 +3536,7 @@ static bool walk_pte_range(pmd_t *pmd, unsigned long = start, unsigned long end, walk->mm_stats[MM_LEAF_YOUNG] +=3D nr; } =20 - walk_update_folio(walk, last, gen, dirty); + walk_update_folio(walk, args->vma, last, gen, dirty); last =3D NULL; =20 if (i < PTRS_PER_PTE && get_next_vma(PMD_MASK, PAGE_SIZE, args, &start, &= end)) @@ -3609,7 +3614,7 @@ static void walk_pmd_range_locked(pud_t *pud, unsigne= d long addr, struct vm_area goto next; =20 if (last !=3D folio) { - walk_update_folio(walk, last, gen, dirty); + walk_update_folio(walk, vma, last, gen, dirty); =20 last =3D folio; dirty =3D false; @@ -3623,7 +3628,7 @@ static void walk_pmd_range_locked(pud_t *pud, unsigne= d long addr, struct vm_area i =3D i > MIN_LRU_BATCH ? 0 : find_next_bit(bitmap, MIN_LRU_BATCH, i) + = 1; } while (i <=3D MIN_LRU_BATCH); =20 - walk_update_folio(walk, last, gen, dirty); + walk_update_folio(walk, vma, last, gen, dirty); =20 lazy_mmu_mode_disable(); spin_unlock(ptl); @@ -4258,7 +4263,7 @@ bool lru_gen_look_around(struct page_vma_mapped_walk = *pvmw, unsigned int nr) continue; =20 if (last !=3D folio) { - walk_update_folio(walk, last, gen, dirty); + walk_update_folio(walk, vma, last, gen, dirty); =20 last =3D folio; dirty =3D false; @@ -4270,7 +4275,7 @@ bool lru_gen_look_around(struct page_vma_mapped_walk = *pvmw, unsigned int nr) young +=3D nr; } =20 - walk_update_folio(walk, last, gen, dirty); + walk_update_folio(walk, vma, last, gen, dirty); =20 lazy_mmu_mode_disable(); =20 --=20 2.47.3