From nobody Sun Feb 8 06:22:37 2026 Delivered-To: importer@patchew.org Received-SPF: pass (zohomail.com: domain of lists.xenproject.org designates 192.237.175.120 as permitted sender) client-ip=192.237.175.120; envelope-from=xen-devel-bounces@lists.xenproject.org; helo=lists.xenproject.org; Authentication-Results: mx.zohomail.com; dkim=pass; spf=pass (zohomail.com: domain of lists.xenproject.org designates 192.237.175.120 as permitted sender) smtp.mailfrom=xen-devel-bounces@lists.xenproject.org; dmarc=pass(p=quarantine dis=none) header.from=suse.com ARC-Seal: i=1; a=rsa-sha256; t=1712656065; cv=none; d=zohomail.com; s=zohoarc; b=CuhhK9dIRKpc5GOHzL7xBm1wt2M1lioa+prX1fpEdSpIP3eg1A1tgzv1b1YypinQ9dswwrswMf7nyo3exavuBmcImzk0+BjqO34X1+hmXym+GiiaE+ePPQgmx5y3Prt24QpLFIq3Q2wEfadxjH60EsrTaUBtbpG/bJX9K749yo0= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1712656065; h=Content-Transfer-Encoding:Cc:Cc:Date:Date:From:From:List-Subscribe:List-Post:List-Id:List-Help:List-Unsubscribe:MIME-Version:Message-ID:Sender:Subject:Subject:To:To:Message-Id:Reply-To; bh=cEE8Wkn6d/y/YCLZKnivxV/RHoBHYd8a0gnOUebWuHI=; b=h2J+cIExFFWVfSiGLiv7bO2bojdwLHX2kxgMNZIf1OwB3VPkB7cUExkA4yeo1dL6N7wV6nja/W9dvsej1wjllwSfVftyloJGxOzXloXv39DvtM587fO4l3vYYw7YXKDFkVac87sctuAHAyc41HsbxQSltzgIUFJnAoz7C1J3eyY= ARC-Authentication-Results: i=1; mx.zohomail.com; dkim=pass; spf=pass (zohomail.com: domain of lists.xenproject.org designates 192.237.175.120 as permitted sender) smtp.mailfrom=xen-devel-bounces@lists.xenproject.org; dmarc=pass header.from= (p=quarantine dis=none) Return-Path: Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) by mx.zohomail.com with SMTPS id 1712656065117227.4281490388396; Tue, 9 Apr 2024 02:47:45 -0700 (PDT) Received: from list by lists.xenproject.org with outflank-mailman.702211.1097080 (Exim 4.92) (envelope-from ) id 1ru84Z-0000La-43; Tue, 09 Apr 2024 09:47:23 +0000 Received: by outflank-mailman (output) from mailman id 702211.1097080; Tue, 09 Apr 2024 09:47:23 +0000 Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1ru84Z-0000LT-1K; Tue, 09 Apr 2024 09:47:23 +0000 Received: by outflank-mailman (input) for mailman id 702211; Tue, 09 Apr 2024 09:47:22 +0000 Received: from se1-gles-sth1-in.inumbo.com ([159.253.27.254] helo=se1-gles-sth1.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1ru84Y-0000LN-G5 for xen-devel@lists.xenproject.org; Tue, 09 Apr 2024 09:47:22 +0000 Received: from smtp-out1.suse.de (smtp-out1.suse.de [2a07:de40:b251:101:10:150:64:1]) by se1-gles-sth1.inumbo.com (Halon) with ESMTPS id 28ba7a75-f656-11ee-b907-491648fe20b8; Tue, 09 Apr 2024 11:47:21 +0200 (CEST) Received: from imap2.dmz-prg2.suse.org (imap2.dmz-prg2.suse.org [10.150.64.98]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by smtp-out1.suse.de (Postfix) with ESMTPS id 0909233904; Tue, 9 Apr 2024 09:47:17 +0000 (UTC) Received: from imap2.dmz-prg2.suse.org (localhost [127.0.0.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by imap2.dmz-prg2.suse.org (Postfix) with ESMTPS id A2F511332F; Tue, 9 Apr 2024 09:47:16 +0000 (UTC) Received: from dovecot-director2.suse.de ([2a07:de40:b281:106:10:150:64:167]) by imap2.dmz-prg2.suse.org with ESMTPSA id 0XM5JqQOFWZASgAAn2gu4w (envelope-from ); Tue, 09 Apr 2024 09:47:16 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" X-Inumbo-ID: 28ba7a75-f656-11ee-b907-491648fe20b8 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.com; s=susede1; t=1712656040; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version: content-transfer-encoding:content-transfer-encoding; bh=cEE8Wkn6d/y/YCLZKnivxV/RHoBHYd8a0gnOUebWuHI=; b=QPIsBPKXFZQh4+vLDEzgsnt0bg3YwEGyDRlmiwKIi4lKPWao9NQZRxJwCvyIKmVZj87H5d e9JmVvhPyixj49BBxhRrWJ7XdSsk6dejLV3tZpzaKk3sCVZwgb132fGAthHr0MLbmlTek6 xiWX1K9ko21Q7zNv+XBqvuMiiAoYiak= Authentication-Results: smtp-out1.suse.de; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.com; s=susede1; t=1712656037; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version: content-transfer-encoding:content-transfer-encoding; bh=cEE8Wkn6d/y/YCLZKnivxV/RHoBHYd8a0gnOUebWuHI=; b=XQCW9dDhAKoIQB09DrYFhr2OwWLpOb3l1/9HziRBilLuIN+Zhn1eVM7/5v7y/fmBJcGULR /3rpmrNegO5XOQgiFiPECw0sXaSDA4wbUSrXTrBtU8VexfLw8SVOaEY8a/U/hwbKv/TJbD bmhEots0E6NDYp1ZAqEULxHfNQrXMKk= From: Juergen Gross To: linux-kernel@vger.kernel.org, x86@kernel.org Cc: Juergen Gross , xen-devel@lists.xenproject.org, Thomas Gleixner , Ingo Molnar , Borislav Petkov , Dave Hansen , "H. Peter Anvin" , Andy Lutomirski , Peter Zijlstra , Jason Andryuk Subject: [PATCH] x86/pat: fix W^X violation false-positives when running as Xen PV guest Date: Tue, 9 Apr 2024 11:47:12 +0200 Message-Id: <20240409094712.21285-1-jgross@suse.com> X-Mailer: git-send-email 2.35.3 MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable X-Spam-Flag: NO X-Spam-Score: -2.80 X-Spam-Level: X-Spamd-Result: default: False [-2.80 / 50.00]; BAYES_HAM(-3.00)[100.00%]; MID_CONTAINS_FROM(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; R_MISSING_CHARSET(0.50)[]; NEURAL_HAM_SHORT(-0.20)[-1.000]; MIME_GOOD(-0.10)[text/plain]; TO_MATCH_ENVRCPT_ALL(0.00)[]; ARC_NA(0.00)[]; FUZZY_BLOCKED(0.00)[rspamd.com]; RCPT_COUNT_TWELVE(0.00)[12]; MIME_TRACE(0.00)[0:+]; DKIM_SIGNED(0.00)[suse.com:s=susede1]; FREEMAIL_CC(0.00)[suse.com,lists.xenproject.org,linutronix.de,redhat.com,alien8.de,linux.intel.com,zytor.com,kernel.org,infradead.org,gmail.com]; RCVD_TLS_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; RCVD_VIA_SMTP_AUTH(0.00)[]; DBL_BLOCKED_OPENRESOLVER(0.00)[suse.com:email]; FREEMAIL_ENVRCPT(0.00)[gmail.com] X-ZohoMail-DKIM: pass (identity @suse.com) (identity @suse.com) X-ZM-MESSAGEID: 1712656066793100001 Content-Type: text/plain; charset="utf-8" When running as Xen PV guest in some cases W^X violation WARN()s have been observed. Those WARN()s are produced by verify_rwx(), which looks into the PTE to verify that writable kernel pages have the NX bit set in order to avoid code modifications of the kernel by rogue code. As the NX bits of all levels of translation entries are or-ed and the RW bits of all levels are and-ed, looking just into the PTE isn't enough for the decision that a writable page is executable, too. When running as a Xen PV guest, kernel initialization will set the NX bit in PMD entries of the initial page tables covering the .data segment. When finding the PTE to have set the RW bit but no NX bit, higher level entries must be looked at. Only when all levels have the RW bit set and no NX bit set, the W^X violation should be flagged. Additionally show_fault_oops() has a similar problem: it will issue the "kernel tried to execute NX-protected page" message only if it finds the NX bit set in the leaf translation entry, while any NX bit in non-leaf entries are being ignored for issuing the message. Modify lookup_address_in_pgd() to return the effective NX and RW bit values of the non-leaf translation entries and evaluate those as well in verify_rwx() and show_fault_oops(). Fixes: 652c5bf380ad ("x86/mm: Refuse W^X violations") Reported-by: Jason Andryuk Signed-off-by: Juergen Gross --- arch/x86/include/asm/pgtable_types.h | 2 +- arch/x86/kernel/sev.c | 3 +- arch/x86/mm/fault.c | 7 ++-- arch/x86/mm/pat/set_memory.c | 56 +++++++++++++++++++++------- arch/x86/virt/svm/sev.c | 3 +- 5 files changed, 52 insertions(+), 19 deletions(-) diff --git a/arch/x86/include/asm/pgtable_types.h b/arch/x86/include/asm/pg= table_types.h index 0b748ee16b3d..91ab538d3872 100644 --- a/arch/x86/include/asm/pgtable_types.h +++ b/arch/x86/include/asm/pgtable_types.h @@ -565,7 +565,7 @@ static inline void update_page_count(int level, unsigne= d long pages) { } */ extern pte_t *lookup_address(unsigned long address, unsigned int *level); extern pte_t *lookup_address_in_pgd(pgd_t *pgd, unsigned long address, - unsigned int *level); + unsigned int *level, bool *nx, bool *rw); extern pmd_t *lookup_pmd_address(unsigned long address); extern phys_addr_t slow_virt_to_phys(void *__address); extern int __init kernel_map_pages_in_pgd(pgd_t *pgd, u64 pfn, diff --git a/arch/x86/kernel/sev.c b/arch/x86/kernel/sev.c index 38ad066179d8..adba581e999d 100644 --- a/arch/x86/kernel/sev.c +++ b/arch/x86/kernel/sev.c @@ -516,12 +516,13 @@ static enum es_result vc_slow_virt_to_phys(struct ghc= b *ghcb, struct es_em_ctxt unsigned long va =3D (unsigned long)vaddr; unsigned int level; phys_addr_t pa; + bool nx, rw; pgd_t *pgd; pte_t *pte; =20 pgd =3D __va(read_cr3_pa()); pgd =3D &pgd[pgd_index(va)]; - pte =3D lookup_address_in_pgd(pgd, va, &level); + pte =3D lookup_address_in_pgd(pgd, va, &level, &nx, &rw); if (!pte) { ctxt->fi.vector =3D X86_TRAP_PF; ctxt->fi.cr2 =3D vaddr; diff --git a/arch/x86/mm/fault.c b/arch/x86/mm/fault.c index 622d12ec7f08..eb8e897a5653 100644 --- a/arch/x86/mm/fault.c +++ b/arch/x86/mm/fault.c @@ -514,18 +514,19 @@ show_fault_oops(struct pt_regs *regs, unsigned long e= rror_code, unsigned long ad =20 if (error_code & X86_PF_INSTR) { unsigned int level; + bool nx, rw; pgd_t *pgd; pte_t *pte; =20 pgd =3D __va(read_cr3_pa()); pgd +=3D pgd_index(address); =20 - pte =3D lookup_address_in_pgd(pgd, address, &level); + pte =3D lookup_address_in_pgd(pgd, address, &level, &nx, &rw); =20 - if (pte && pte_present(*pte) && !pte_exec(*pte)) + if (pte && pte_present(*pte) && (!pte_exec(*pte) || nx)) pr_crit("kernel tried to execute NX-protected page - exploit attempt? (= uid: %d)\n", from_kuid(&init_user_ns, current_uid())); - if (pte && pte_present(*pte) && pte_exec(*pte) && + if (pte && pte_present(*pte) && pte_exec(*pte) && !nx && (pgd_flags(*pgd) & _PAGE_USER) && (__read_cr4() & X86_CR4_SMEP)) pr_crit("unable to execute userspace code (SMEP?) (uid: %d)\n", diff --git a/arch/x86/mm/pat/set_memory.c b/arch/x86/mm/pat/set_memory.c index 80c9037ffadf..baa4dc4748e9 100644 --- a/arch/x86/mm/pat/set_memory.c +++ b/arch/x86/mm/pat/set_memory.c @@ -619,7 +619,8 @@ static inline pgprot_t static_protections(pgprot_t prot= , unsigned long start, * Validate strict W^X semantics. */ static inline pgprot_t verify_rwx(pgprot_t old, pgprot_t new, unsigned lon= g start, - unsigned long pfn, unsigned long npg) + unsigned long pfn, unsigned long npg, + bool nx, bool rw) { unsigned long end; =20 @@ -641,6 +642,10 @@ static inline pgprot_t verify_rwx(pgprot_t old, pgprot= _t new, unsigned long star if ((pgprot_val(new) & (_PAGE_RW | _PAGE_NX)) !=3D _PAGE_RW) return new; =20 + /* Non-leaf translation entries can disable writing or execution. */ + if (!rw || nx) + return new; + end =3D start + npg * PAGE_SIZE - 1; WARN_ONCE(1, "CPA detected W^X violation: %016llx -> %016llx range: 0x%01= 6lx - 0x%016lx PFN %lx\n", (unsigned long long)pgprot_val(old), @@ -660,17 +665,22 @@ static inline pgprot_t verify_rwx(pgprot_t old, pgpro= t_t new, unsigned long star * Return a pointer to the entry and the level of the mapping. */ pte_t *lookup_address_in_pgd(pgd_t *pgd, unsigned long address, - unsigned int *level) + unsigned int *level, bool *nx, bool *rw) { p4d_t *p4d; pud_t *pud; pmd_t *pmd; =20 *level =3D PG_LEVEL_NONE; + *nx =3D false; + *rw =3D true; =20 if (pgd_none(*pgd)) return NULL; =20 + *nx |=3D pgd_flags(*pgd) & _PAGE_NX; + *rw &=3D pgd_flags(*pgd) & _PAGE_RW; + p4d =3D p4d_offset(pgd, address); if (p4d_none(*p4d)) return NULL; @@ -679,6 +689,9 @@ pte_t *lookup_address_in_pgd(pgd_t *pgd, unsigned long = address, if (p4d_leaf(*p4d) || !p4d_present(*p4d)) return (pte_t *)p4d; =20 + *nx |=3D p4d_flags(*p4d) & _PAGE_NX; + *rw &=3D p4d_flags(*p4d) & _PAGE_RW; + pud =3D pud_offset(p4d, address); if (pud_none(*pud)) return NULL; @@ -687,6 +700,9 @@ pte_t *lookup_address_in_pgd(pgd_t *pgd, unsigned long = address, if (pud_leaf(*pud) || !pud_present(*pud)) return (pte_t *)pud; =20 + *nx |=3D pud_flags(*pud) & _PAGE_NX; + *rw &=3D pud_flags(*pud) & _PAGE_RW; + pmd =3D pmd_offset(pud, address); if (pmd_none(*pmd)) return NULL; @@ -695,6 +711,9 @@ pte_t *lookup_address_in_pgd(pgd_t *pgd, unsigned long = address, if (pmd_leaf(*pmd) || !pmd_present(*pmd)) return (pte_t *)pmd; =20 + *nx |=3D pmd_flags(*pmd) & _PAGE_NX; + *rw &=3D pmd_flags(*pmd) & _PAGE_RW; + *level =3D PG_LEVEL_4K; =20 return pte_offset_kernel(pmd, address); @@ -710,18 +729,24 @@ pte_t *lookup_address_in_pgd(pgd_t *pgd, unsigned lon= g address, */ pte_t *lookup_address(unsigned long address, unsigned int *level) { - return lookup_address_in_pgd(pgd_offset_k(address), address, level); + bool nx, rw; + + return lookup_address_in_pgd(pgd_offset_k(address), address, level, + &nx, &rw); } EXPORT_SYMBOL_GPL(lookup_address); =20 static pte_t *_lookup_address_cpa(struct cpa_data *cpa, unsigned long addr= ess, - unsigned int *level) + unsigned int *level, bool *nx, bool *rw) { - if (cpa->pgd) - return lookup_address_in_pgd(cpa->pgd + pgd_index(address), - address, level); + pgd_t *pgd; + + if (!cpa->pgd) + pgd =3D pgd_offset_k(address); + else + pgd =3D cpa->pgd + pgd_index(address); =20 - return lookup_address(address, level); + return lookup_address_in_pgd(pgd, address, level, nx, rw); } =20 /* @@ -849,12 +874,13 @@ static int __should_split_large_page(pte_t *kpte, uns= igned long address, pgprot_t old_prot, new_prot, req_prot, chk_prot; pte_t new_pte, *tmp; enum pg_level level; + bool nx, rw; =20 /* * Check for races, another CPU might have split this page * up already: */ - tmp =3D _lookup_address_cpa(cpa, address, &level); + tmp =3D _lookup_address_cpa(cpa, address, &level, &nx, &rw); if (tmp !=3D kpte) return 1; =20 @@ -965,7 +991,8 @@ static int __should_split_large_page(pte_t *kpte, unsig= ned long address, new_prot =3D static_protections(req_prot, lpaddr, old_pfn, numpages, psize, CPA_DETECT); =20 - new_prot =3D verify_rwx(old_prot, new_prot, lpaddr, old_pfn, numpages); + new_prot =3D verify_rwx(old_prot, new_prot, lpaddr, old_pfn, numpages, + nx, rw); =20 /* * If there is a conflict, split the large page. @@ -1046,6 +1073,7 @@ __split_large_page(struct cpa_data *cpa, pte_t *kpte,= unsigned long address, pte_t *pbase =3D (pte_t *)page_address(base); unsigned int i, level; pgprot_t ref_prot; + bool nx, rw; pte_t *tmp; =20 spin_lock(&pgd_lock); @@ -1053,7 +1081,7 @@ __split_large_page(struct cpa_data *cpa, pte_t *kpte,= unsigned long address, * Check for races, another CPU might have split this page * up for us already: */ - tmp =3D _lookup_address_cpa(cpa, address, &level); + tmp =3D _lookup_address_cpa(cpa, address, &level, &nx, &rw); if (tmp !=3D kpte) { spin_unlock(&pgd_lock); return 1; @@ -1594,10 +1622,11 @@ static int __change_page_attr(struct cpa_data *cpa,= int primary) int do_split, err; unsigned int level; pte_t *kpte, old_pte; + bool nx, rw; =20 address =3D __cpa_addr(cpa, cpa->curpage); repeat: - kpte =3D _lookup_address_cpa(cpa, address, &level); + kpte =3D _lookup_address_cpa(cpa, address, &level, &nx, &rw); if (!kpte) return __cpa_process_fault(cpa, address, primary); =20 @@ -1619,7 +1648,8 @@ static int __change_page_attr(struct cpa_data *cpa, i= nt primary) new_prot =3D static_protections(new_prot, address, pfn, 1, 0, CPA_PROTECT); =20 - new_prot =3D verify_rwx(old_prot, new_prot, address, pfn, 1); + new_prot =3D verify_rwx(old_prot, new_prot, address, pfn, 1, + nx, rw); =20 new_prot =3D pgprot_clear_protnone_bits(new_prot); =20 diff --git a/arch/x86/virt/svm/sev.c b/arch/x86/virt/svm/sev.c index ab0e8448bb6e..3d73b44a64a7 100644 --- a/arch/x86/virt/svm/sev.c +++ b/arch/x86/virt/svm/sev.c @@ -338,12 +338,13 @@ void snp_dump_hva_rmpentry(unsigned long hva) { unsigned long paddr; unsigned int level; + bool nx, rw; pgd_t *pgd; pte_t *pte; =20 pgd =3D __va(read_cr3_pa()); pgd +=3D pgd_index(hva); - pte =3D lookup_address_in_pgd(pgd, hva, &level); + pte =3D lookup_address_in_pgd(pgd, hva, &level, &nx, &rw); =20 if (!pte) { pr_err("Can't dump RMP entry for HVA %lx: no PTE/PFN found\n", hva); --=20 2.35.3