From: Joerg Roedel <joerg.roedel@amd.com>
Hi,
Here is the updated patch-set implementing support for planes in KVM.
Planes is KVMs name for supporting various privilege separation
features of hardware (AMD SEV-SNP VMPLs, Intel TDX, ARM CCA Planes) or
software (Hyper-V VSM) in KVM.
The code posted here is based on prior work by Tom Lendacky, Roy
Hopkins[1] and Paolo Bonzini[2] as well as the numerous participants
of the KVM Planes BoF at KVM Forum 2024.
The user-space interface has slightly changed compared to the previous
patches posted by Paolo. The Documentation patch has the details.
The changes implement the base-support in KVM and X86 as well as the
parts required for AMD SEV-SNP VMPLs. The patches are based on
v7.1-rc7 and can be used to run an SEV-SNP VM with COCONUT-SVSM[3] in
VMPL0 with a Linux guest in VMPL2. An updated QEMU is needed as well,
the changes for that will be posted separately.
This changes depend on Melodys patches for supporting restricted
injection. As they are required to run COCONUT-SVSM, they are included
here for completeness.
KVM planes support as posted here has a number of known limitations:
- Using planes requires IRQ-Chip in split mode
- IRQFD not yet supported
- Memory attributes are not per-plane yet - this is required
for VSM
The patches are also in this git branch:
https://github.com/joergroedel/linux/tree/kvm-planes-v7.1
And can be used together with this QEMU tree:
https://github.com/joergroedel/qemu/tree/qemu-planes-linux-v7.1
Please review.
-Joerg
[1] https://lore.kernel.org/all/cover.1726506534.git.roy.hopkins@suse.com/
[2] https://lore.kernel.org/all/20250401161106.790710-1-pbonzini@redhat.com/
[3] https://github.com/coconut-svsm/svsm/
Joerg Roedel (37):
kvm: Introduce struct kvm_vcpu_common
kvm: Move vcpu accounting to struct kvm_vcpu_common
kvm: Add read accessors for kvm_vcpu scheduling state
kvm: Make kvm_running_vcpus point to struct kvm_vcpu_common
kvm: Move VCPU scheduling state to struct kvm_vcpu_common
kvm: Add accessors for kvm_vcpu->mutex
kvm: Move VCPU locking to struct kvm_vcpu_common
kvm: Move kvm_vcpu->rcuwait to struct kvm_vcpu_common
kvm: Introduce accessors for kvm_vcpu->mode
kvm: Move kvm_vcpu mode and requests field to struct kvm_vcpu_common
kvm: Introduce per-plane VCPU requests
kvm: Move kvm_vcpu pid members to struct kvm_vcpu_common
kvm: Move kvm_vcpu sigset members to struct kvm_vcpu_common
kvm: Move kvm_vcpu spinloop members to struct kvm_vcpu_common
kvm: Move kvm_vcpu->dirty_ring to struct kvm_vcpu_common
kvm: Introduce arch-specific plane state
kvm: Introduce arch-specific part of struct kvm_vcpu_common
kvm: Allocate struct kvm_plane in architecture code
KVM: Implement KVM_CREATE_VCPU ioctl for planes
kvm: Keep track of plane VCPUs in struct kvm_vcpu_common
kvm: Add VCPU plane-scheduling state and helpers
kvm: Add plane_level to kvm_kernel_irq_routing_entry
kvm: Pass plane_level to kvm_set_routing_entry()
kvm: Make KVM_SET_GSI_ROUTING per plane
kvm: x86: Handle IOAPIC EOIs per plane
kvm: x86: Move CPUID state to struct kvm_vcpu_arch_common
kvm: x86: Move cpu_caps to struct kvm_vcpu_arch_common
kvm: x86: Update state for all plane VCPUs after CPUID update
kvm: x86: Share MTRR state across planes
kvm: x86: Select a plane to run
kvm: x86: Make event injection VCPU requests per-plane
kvm: x86: Allow hardware backend to overwrite struct kvm_plane
allocation
kvm: x86: Make KVM_REQ_UPDATE_PROTECTED_GUEST_STATE per plane
kvm: x86: Share pio_data across planes
kvm: x86: Switch to plane0 if it has events
kvm: x86: Restrict KVM planes support to KVM_IRQCHIP_SPLIT
kvm: svm: Track vmsa_features per plane
Melody Wang (7):
x86/sev: Define the #HV doorbell page structure
KVM: SVM: Add support for the SEV-SNP #HV doorbell page NAE event
KVM: SVM: Inject #HV when Restricted Injection is active
KVM: SVM: Inject NMIs when Restricted Injection is active
KVM: SVM: Inject MCEs when Restricted Injection is active
KVM: SVM: Enable Restricted Injection for an SEV-SNP guest
KVM: SVM: Add support for the SEV-SNP #HV IPI NAE event
Paolo Bonzini (11):
Documentation: kvm: introduce "VM plane" concept
kvm: Introduce struct kvm_plane
kvm: Move vcpu_array to struct kvm_plane
kvm: Implement KVM_CAP_PLANES
kvm: Implement KVM_CREATE_PLANE ioctl
kvm: Add KVM_EXIT_PLANE_EVENT
kvm: Allocate struct kvm_run only for struct kvm_vcpu_common
kvm: Make KVM_SIGNAL_MSI per plane
kvm: x86: Make apic_map per plane
kvm: x86: Make local APIC code aware of planes
kvm: x86: Introduce max_planes x86-op
Tom Lendacky (5):
kvm: svm: Implement GET_AP_APIC_IDS NAE event
kvm: sev: Allow for VMPL level specification in AP create
kvm: svm: Invoke a specified VMPL level VMSA for the vCPU
kvm: svm: Implement max_planes x86 operation
kvm: svm: Advertise full multi-VMPL support to the SNP guest
Documentation/virt/kvm/api.rst | 102 +++-
arch/arm64/include/asm/kvm_host.h | 19 +-
arch/arm64/kvm/arch_timer.c | 3 +-
arch/arm64/kvm/arm.c | 37 +-
arch/arm64/kvm/inject_fault.c | 4 +-
arch/arm64/kvm/nested.c | 2 +-
arch/arm64/kvm/vgic/vgic-init.c | 3 +-
arch/arm64/kvm/vgic/vgic-irqfd.c | 7 +-
arch/loongarch/include/asm/kvm_host.h | 17 +
arch/loongarch/kvm/intc/pch_pic.c | 2 +-
arch/loongarch/kvm/irqfd.c | 5 +-
arch/loongarch/kvm/timer.c | 2 +-
arch/loongarch/kvm/vcpu.c | 16 +-
arch/loongarch/kvm/vm.c | 18 +
arch/mips/include/asm/kvm_host.h | 17 +
arch/mips/kvm/mips.c | 35 +-
arch/powerpc/include/asm/kvm_host.h | 17 +
arch/powerpc/kvm/book3s_pr.c | 2 +-
arch/powerpc/kvm/book3s_xics.c | 4 +-
arch/powerpc/kvm/book3s_xive.c | 4 +-
arch/powerpc/kvm/book3s_xive_native.c | 4 +-
arch/powerpc/kvm/booke.c | 2 +-
arch/powerpc/kvm/mpic.c | 6 +-
arch/powerpc/kvm/powerpc.c | 27 +-
arch/powerpc/kvm/trace.h | 2 +-
arch/riscv/include/asm/kvm_host.h | 17 +
arch/riscv/kvm/aia_device.c | 4 +-
arch/riscv/kvm/main.c | 18 +
arch/riscv/kvm/vcpu.c | 13 +-
arch/riscv/kvm/vm.c | 6 +-
arch/s390/include/asm/kvm_host.h | 17 +
arch/s390/kvm/interrupt.c | 11 +-
arch/s390/kvm/kvm-s390.c | 33 +-
arch/s390/kvm/pv.c | 2 +-
arch/x86/include/asm/cpufeatures.h | 1 +
arch/x86/include/asm/kvm-x86-ops.h | 4 +
arch/x86/include/asm/kvm_host.h | 96 ++--
arch/x86/include/asm/sev-common.h | 8 +
arch/x86/include/asm/svm.h | 42 ++
arch/x86/include/uapi/asm/svm.h | 9 +
arch/x86/kvm/cpuid.c | 70 ++-
arch/x86/kvm/cpuid.h | 31 +-
arch/x86/kvm/hyperv.c | 2 +-
arch/x86/kvm/i8254.c | 2 +-
arch/x86/kvm/ioapic.c | 8 +-
arch/x86/kvm/irq.c | 19 +-
arch/x86/kvm/lapic.c | 144 +++--
arch/x86/kvm/lapic.h | 14 +-
arch/x86/kvm/mmu/mmu.c | 4 +-
arch/x86/kvm/mtrr.c | 12 +-
arch/x86/kvm/smm.c | 2 +-
arch/x86/kvm/svm/sev.c | 644 ++++++++++++++++++++--
arch/x86/kvm/svm/svm.c | 85 ++-
arch/x86/kvm/svm/svm.h | 52 +-
arch/x86/kvm/trace.h | 2 +-
arch/x86/kvm/vmx/common.h | 2 +-
arch/x86/kvm/vmx/main.c | 16 +-
arch/x86/kvm/vmx/nested.h | 4 +-
arch/x86/kvm/vmx/posted_intr.c | 2 +-
arch/x86/kvm/vmx/vmx.c | 11 +-
arch/x86/kvm/vmx/x86_ops.h | 1 +
arch/x86/kvm/x86.c | 237 ++++++--
arch/x86/kvm/x86.h | 5 +
arch/x86/kvm/xen.c | 2 +-
arch/x86/kvm/xen.h | 2 +-
include/linux/kvm_host.h | 278 ++++++++--
include/linux/kvm_types.h | 2 +
include/uapi/linux/kvm.h | 18 +
virt/kvm/dirty_ring.c | 4 +-
virt/kvm/irqchip.c | 13 +-
virt/kvm/kvm_main.c | 764 +++++++++++++++++++-------
71 files changed, 2460 insertions(+), 630 deletions(-)
--
2.53.0