[PATCH 00/12] add shmem mTHP collapse support

Baolin Wang posted 12 patches 6 days, 20 hours ago
There is a newer version of this series
Documentation/admin-guide/mm/transhuge.rst |   4 +-
include/linux/huge_mm.h                    |   8 -
include/linux/shmem_fs.h                   |   4 +-
mm/collapse.h                              |   3 +-
mm/khugepaged.c                            | 220 +++++++++++++--------
mm/madvise.c                               |   8 +-
mm/shmem.c                                 |  22 +--
tools/testing/selftests/mm/khugepaged.c    |   7 +-
tools/testing/selftests/mm/run_vmtests.sh  |   2 +
9 files changed, 168 insertions(+), 110 deletions(-)
[PATCH 00/12] add shmem mTHP collapse support
Posted by Baolin Wang 6 days, 20 hours ago
Based on mm-unstable branch.

This patchset is split from the previous shmem mTHP collapse patchset [1],
as the anon mTHP collapse selftests [2] have already been merged.

This is a follow-up patchset for mTHP collapse to support shmem mTHP collapse,
which is based on Nico's patchset[3].

The shmem mTHP collapse strategy follows the anonymous mTHP collapse approach:
track present pages via a bitmap while scanning PMD ranges for collapse candidates,
then use the bitmap after the scan completes to determine the most efficient
mTHP order to collapse to. Built on the basic framework added for anonymous
mTHP collapse, the shmem mTHP collapse implementation is straightforward
(Thanks for Nico's work).

Note: I have not yet enabled large order collapse for file folios (file folios
currently only support PMD-sized large folio collapse). Although file large order
collapse would be more straightforward to implement after shmem mTHP collapse
support is added (requiring some changes to file_thp_enabled()), I think this
still need some discussion on whether it is necessary to support other large
orders collapse for file folios.

Patch 1-4: some cleanups.
Patch 5-8: preparation patches.
Patch 9-11: shmem mTHP collapse support.
Patch 12: add selftests.

Comments are welcome. Thanks.

Changes from RFC v2:
 - Rebase on the new mm-unstable branch.
 - Add some cleanup patches.
 - Drop anon mTHP collapse selftests patches as they have been merged.
 - Record swap entries when calling mthp_collapse() for shmem (per Lance).
 - Return SCAN_PTE_MAPPED_HUGEPAGE if page cache already holds a PMD-sized folio (per Lance).
 - Allow collapse order 1 folios for shmem (per Lance).

Changes from RFC v1:
https://lore.kernel.org/all/cover.1755677674.git.baolin.wang@linux.alibaba.com/
 - Rebase on the new code, and update to use the new functions.
 - Add more test cases.

[1] https://lore.kernel.org/all/cover.1781083630.git.baolin.wang@linux.alibaba.com/
[2] https://lore.kernel.org/all/cover.1785985999.git.baolin.wang@linux.alibaba.com/
[3] https://lore.kernel.org/all/20260605161422.213817-1-npache@redhat.com/

Baolin Wang (12):
  mm: khugepaged: remove outdated comments and check for shmem
  mm: khugepaged: drop the hugepage_madvise()
  mm: shmem: don't expose 'deny' and 'force' via the kernel command line
  mm: khugepaged: move cc->scan_file and cc->scan_pgoff assignment into
    collapse_scan_file()
  mm: khugepaged: add max_ptes_none check in collapse_file()
  mm: khugepaged: generalize collapse_file() for shmem mTHP support
  mm: khugepaged: add an order check for PMD-sized THP statistics
  mm: khugepaged: add a helper to get the minimal collapse order
  mm: khugepaged: add shmem mTHP collapse support
  mm: shmem: run khugepaged for all shmem mTHP orders
  mm: khugepaged: allow khugepaged to check all shmem mTHP-sized orders
  selftests: mm: add shmem mTHP collapse test cases

 Documentation/admin-guide/mm/transhuge.rst |   4 +-
 include/linux/huge_mm.h                    |   8 -
 include/linux/shmem_fs.h                   |   4 +-
 mm/collapse.h                              |   3 +-
 mm/khugepaged.c                            | 220 +++++++++++++--------
 mm/madvise.c                               |   8 +-
 mm/shmem.c                                 |  22 +--
 tools/testing/selftests/mm/khugepaged.c    |   7 +-
 tools/testing/selftests/mm/run_vmtests.sh  |   2 +
 9 files changed, 168 insertions(+), 110 deletions(-)

-- 
2.47.3