From nobody Tue Dec 2 02:32:16 2025 Received: from mail.loongson.cn (mail.loongson.cn [114.242.206.163]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 96CFB333751; Wed, 19 Nov 2025 09:04:06 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=114.242.206.163 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1763543050; cv=none; b=aV60fy8pUHiDCVuV4uQDuIDlqK79lm7h0PGrEP9AahsK6G5FqRjtFdX8wKGfgheWNYnieA3FXmpunE4PG4qU2L2EVTaHe68DPCLfM0RjTj6WlEaxmBuuFZNvX6wHF72W7ZVmbSkdg8ndg03TVwnjwIGv4f4KxhOPDEgTP0vI7Hc= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1763543050; c=relaxed/simple; bh=ZyG95oS4409+LtBm4sRQ4JZp4vNNXcKMPozPiHERYc4=; h=From:To:Cc:Subject:Date:Message-Id:MIME-Version; b=S+FX1zO0VipNEUFdCS7Xhc9FXTOa6BiYKxM39UukjE+0rxmmr4JjvbxygJkhyVb+5SncZsh4i1ukiU93uWOU6ln6YC1XzGXtpmMY741ZO3T3JeZNngLo2M7hzLCpUkVrKH9vDggZVem1rkD08N/3Of8F6KnSa98i7l+S3mqt4bo= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=none (p=none dis=none) header.from=loongson.cn; spf=pass smtp.mailfrom=loongson.cn; arc=none smtp.client-ip=114.242.206.163 Authentication-Results: smtp.subspace.kernel.org; dmarc=none (p=none dis=none) header.from=loongson.cn Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=loongson.cn Received: from loongson.cn (unknown [10.2.5.185]) by gateway (Coremail) with SMTP id _____8Cx5tD9hx1pOXglAA--.15283S3; Wed, 19 Nov 2025 17:03:57 +0800 (CST) Received: from localhost.localdomain (unknown [10.2.5.185]) by front1 (Coremail) with SMTP id qMiowJCxXMH8hx1pFUY4AQ--.37329S2; Wed, 19 Nov 2025 17:03:56 +0800 (CST) From: Song Gao To: maobibo@loongson.cn, chenhuacai@kernel.org Cc: kvm@vger.kernel.org, loongarch@lists.linux.dev, kernel@xen0n.name, linux-kernel@vger.kernel.org Subject: [PATCH] LoongArch: KVM: Add AVEC support irqchip in kernel Date: Wed, 19 Nov 2025 16:39:46 +0800 Message-Id: <20251119083946.1864543-1-gaosong@loongson.cn> X-Mailer: git-send-email 2.39.1 Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable X-CM-TRANSID: qMiowJCxXMH8hx1pFUY4AQ--.37329S2 X-CM-SenderInfo: 5jdr20tqj6z05rqj20fqof0/ X-Coremail-Antispam: 1Uk129KBjDUn29KB7ZKAUJUUUUU529EdanIXcx71UUUUU7KY7 ZEXasCq-sGcSsGvfJ3UbIjqfuFe4nvWSU5nxnvy29KBjDU0xBIdaVrnUUvcSsGvfC2Kfnx nUUI43ZEXa7xR_UUUUUUUUU== Content-Type: text/plain; charset="utf-8" Add a dintc device to set dintc msg base and msg size. implement deliver the msi to vcpu and inject irq to dest vcpu. add some macros for AVEC. Signed-off-by: Song Gao --- arch/loongarch/include/asm/irq.h | 7 ++ arch/loongarch/include/asm/kvm_dintc.h | 22 +++++ arch/loongarch/include/asm/kvm_host.h | 8 ++ arch/loongarch/include/uapi/asm/kvm.h | 4 + arch/loongarch/kvm/Makefile | 1 + arch/loongarch/kvm/intc/dintc.c | 115 +++++++++++++++++++++++++ arch/loongarch/kvm/interrupt.c | 1 + arch/loongarch/kvm/irqfd.c | 35 +++++++- arch/loongarch/kvm/main.c | 5 ++ arch/loongarch/kvm/vcpu.c | 51 +++++++++++ drivers/irqchip/irq-loongarch-avec.c | 5 +- include/uapi/linux/kvm.h | 2 + 12 files changed, 252 insertions(+), 4 deletions(-) create mode 100644 arch/loongarch/include/asm/kvm_dintc.h create mode 100644 arch/loongarch/kvm/intc/dintc.c diff --git a/arch/loongarch/include/asm/irq.h b/arch/loongarch/include/asm/= irq.h index 12bd15578c33..5ab8b91e9ae8 100644 --- a/arch/loongarch/include/asm/irq.h +++ b/arch/loongarch/include/asm/irq.h @@ -50,6 +50,13 @@ void spurious_interrupt(void); #define NR_LEGACY_VECTORS 16 #define IRQ_MATRIX_BITS NR_VECTORS =20 +#define AVEC_VIRQ_SHIFT 4 +#define AVEC_VIRQ_BIT 8 +#define AVEC_VIRQ_MASK GENMASK(AVEC_VIRQ_BIT - 1, 0) +#define AVEC_CPU_SHIFT 12 +#define AVEC_CPU_BIT 16 +#define AVEC_CPU_MASK GENMASK(AVEC_CPU_BIT - 1, 0) + #define arch_trigger_cpumask_backtrace arch_trigger_cpumask_backtrace void arch_trigger_cpumask_backtrace(const struct cpumask *mask, int exclud= e_cpu); =20 diff --git a/arch/loongarch/include/asm/kvm_dintc.h b/arch/loongarch/includ= e/asm/kvm_dintc.h new file mode 100644 index 000000000000..0ec301fbb638 --- /dev/null +++ b/arch/loongarch/include/asm/kvm_dintc.h @@ -0,0 +1,22 @@ +/* SPDX-License-Identifier: GPL-2.0 */ +/* + * Copyright (C) 2025 Loongson Technology Corporation Limited + */ + +#ifndef __ASM_KVM_DINTC_H +#define __ASM_KVM_DINTC_H + + +struct loongarch_dintc { + spinlock_t lock; + struct kvm *kvm; + uint64_t msg_addr_base; + uint64_t msg_addr_size; +}; + +struct dintc_state { + atomic64_t vector_map[4]; +}; + +int kvm_loongarch_register_dintc_device(void); +#endif diff --git a/arch/loongarch/include/asm/kvm_host.h b/arch/loongarch/include= /asm/kvm_host.h index 0cecbd038bb3..3806a71658c1 100644 --- a/arch/loongarch/include/asm/kvm_host.h +++ b/arch/loongarch/include/asm/kvm_host.h @@ -22,6 +22,7 @@ #include #include #include +#include #include =20 #define __KVM_HAVE_ARCH_INTC_INITIALIZED @@ -132,6 +133,7 @@ struct kvm_arch { struct loongarch_ipi *ipi; struct loongarch_eiointc *eiointc; struct loongarch_pch_pic *pch_pic; + struct loongarch_dintc *dintc; }; =20 #define CSR_MAX_NUMS 0x800 @@ -242,6 +244,7 @@ struct kvm_vcpu_arch { struct kvm_mp_state mp_state; /* ipi state */ struct ipi_state ipi_state; + struct dintc_state dintc_state; /* cpucfg */ u32 cpucfg[KVM_MAX_CPUCFG_REGS]; =20 @@ -253,6 +256,11 @@ struct kvm_vcpu_arch { } st; }; =20 +void loongarch_dintc_inject_irq(struct kvm_vcpu *vcpu); +int kvm_loongarch_deliver_msi_to_vcpu(struct kvm *kvm, + struct kvm_vcpu *vcpu, + u32 vector, int level); + static inline unsigned long readl_sw_gcsr(struct loongarch_csrs *csr, int = reg) { return csr->csrs[reg]; diff --git a/arch/loongarch/include/uapi/asm/kvm.h b/arch/loongarch/include= /uapi/asm/kvm.h index de6c3f18e40a..07da84f7002c 100644 --- a/arch/loongarch/include/uapi/asm/kvm.h +++ b/arch/loongarch/include/uapi/asm/kvm.h @@ -154,4 +154,8 @@ struct kvm_iocsr_entry { #define KVM_DEV_LOONGARCH_PCH_PIC_GRP_CTRL 0x40000006 #define KVM_DEV_LOONGARCH_PCH_PIC_CTRL_INIT 0 =20 +#define KVM_DEV_LOONGARCH_DINTC_CTRL 0x40000007 +#define KVM_DEV_LOONGARCH_DINTC_MSG_ADDR_BASE 0x0 +#define KVM_DEV_LOONGARCH_DINTC_MSG_ADDR_SIZE 0x1 + #endif /* __UAPI_ASM_LOONGARCH_KVM_H */ diff --git a/arch/loongarch/kvm/Makefile b/arch/loongarch/kvm/Makefile index cb41d9265662..fe984bf1cbdb 100644 --- a/arch/loongarch/kvm/Makefile +++ b/arch/loongarch/kvm/Makefile @@ -19,6 +19,7 @@ kvm-y +=3D vm.o kvm-y +=3D intc/ipi.o kvm-y +=3D intc/eiointc.o kvm-y +=3D intc/pch_pic.o +kvm-y +=3D intc/dintc.o kvm-y +=3D irqfd.o =20 CFLAGS_exit.o +=3D $(call cc-disable-warning, override-init) diff --git a/arch/loongarch/kvm/intc/dintc.c b/arch/loongarch/kvm/intc/dint= c.c new file mode 100644 index 000000000000..376c6e20ec04 --- /dev/null +++ b/arch/loongarch/kvm/intc/dintc.c @@ -0,0 +1,115 @@ +// SPDX-License-Identifier: GPL-2.0 +/* + * Copyright (C) 2025 Loongson Technology Corporation Limited + */ + +#include +#include +#include + +static int kvm_dintc_ctrl_access(struct kvm_device *dev, + struct kvm_device_attr *attr, + bool is_write) +{ + int addr =3D attr->attr; + void __user *data; + struct loongarch_dintc *s =3D dev->kvm->arch.dintc; + + data =3D (void __user *)attr->addr; + switch (addr) { + case KVM_DEV_LOONGARCH_DINTC_MSG_ADDR_BASE: + if (is_write) { + if (copy_from_user(&(s->msg_addr_base), data, sizeof(s->msg_addr_base))) + return -EFAULT; + } + break; + case KVM_DEV_LOONGARCH_DINTC_MSG_ADDR_SIZE: + if (is_write) { + if (copy_from_user(&(s->msg_addr_size), data, sizeof(s->msg_addr_size))) + return -EFAULT; + } + break; + default: + kvm_err("%s: unknown dintc register, addr =3D %d\n", __func__, addr); + return -EINVAL; + } + + return 0; +} + +static int kvm_dintc_get_attr(struct kvm_device *dev, + struct kvm_device_attr *attr) +{ + switch (attr->group) { + case KVM_DEV_LOONGARCH_DINTC_CTRL: + return kvm_dintc_ctrl_access(dev, attr, false); + default: + kvm_err("%s: unknown group (%d)\n", __func__, attr->group); + return -EINVAL; + } +} + +static int kvm_dintc_set_attr(struct kvm_device *dev, + struct kvm_device_attr *attr) +{ + switch (attr->group) { + case KVM_DEV_LOONGARCH_DINTC_CTRL: + return kvm_dintc_ctrl_access(dev, attr, true); + default: + kvm_err("%s: unknown group (%d)\n", __func__, attr->group); + return -EINVAL; + } +} + +static int kvm_dintc_create(struct kvm_device *dev, u32 type) +{ + struct kvm *kvm; + struct loongarch_dintc *s; + + if (!dev) { + kvm_err("%s: kvm_device ptr is invalid!\n", __func__); + return -EINVAL; + } + + kvm =3D dev->kvm; + if (kvm->arch.dintc) { + kvm_err("%s: LoongArch DINTC has already been created!\n", __func__); + return -EINVAL; + } + + s =3D kzalloc(sizeof(struct loongarch_dintc), GFP_KERNEL); + if (!s) + return -ENOMEM; + + spin_lock_init(&s->lock); + s->kvm =3D kvm; + + kvm->arch.dintc =3D s; + return 0; +} + +static void kvm_dintc_destroy(struct kvm_device *dev) +{ + struct kvm *kvm; + struct loongarch_dintc *dintc; + + if (!dev || !dev->kvm || !dev->kvm->arch.dintc) + return; + + kvm =3D dev->kvm; + dintc =3D kvm->arch.dintc; + kfree(dintc); +} + +static struct kvm_device_ops kvm_dintc_dev_ops =3D { + .name =3D "kvm-loongarch-dintc", + .create =3D kvm_dintc_create, + .destroy =3D kvm_dintc_destroy, + .set_attr =3D kvm_dintc_set_attr, + .get_attr =3D kvm_dintc_get_attr, +}; + +int kvm_loongarch_register_dintc_device(void) +{ + return kvm_register_device_ops(&kvm_dintc_dev_ops, KVM_DEV_TYPE_LOONGARCH= _DINTC); +} diff --git a/arch/loongarch/kvm/interrupt.c b/arch/loongarch/kvm/interrupt.c index a6d42d399a59..c74e7af3e772 100644 --- a/arch/loongarch/kvm/interrupt.c +++ b/arch/loongarch/kvm/interrupt.c @@ -33,6 +33,7 @@ static int kvm_irq_deliver(struct kvm_vcpu *vcpu, unsigne= d int priority) irq =3D priority_to_irq[priority]; =20 if (cpu_has_msgint && (priority =3D=3D INT_AVEC)) { + loongarch_dintc_inject_irq(vcpu); set_gcsr_estat(irq); return 1; } diff --git a/arch/loongarch/kvm/irqfd.c b/arch/loongarch/kvm/irqfd.c index 9a39627aecf0..a6f9342eaba1 100644 --- a/arch/loongarch/kvm/irqfd.c +++ b/arch/loongarch/kvm/irqfd.c @@ -2,7 +2,6 @@ /* * Copyright (C) 2024 Loongson Technology Corporation Limited */ - #include #include #include @@ -16,6 +15,27 @@ static int kvm_set_pic_irq(struct kvm_kernel_irq_routing= _entry *e, return 0; } =20 +static int kvm_dintc_set_msi_irq(struct kvm *kvm, u32 addr, int data, int = level) +{ + unsigned int virq, dest, cpu_bit; + struct kvm_vcpu *vcpu; + + cpu_bit =3D find_first_bit((unsigned long *)&(kvm->arch.dintc->msg_addr_b= ase), 64) + - AVEC_CPU_SHIFT; + cpu_bit =3D min(cpu_bit, AVEC_CPU_BIT); + + virq =3D (addr >> AVEC_VIRQ_SHIFT)&AVEC_VIRQ_MASK; + dest =3D (addr >> AVEC_CPU_SHIFT)&GENMASK(cpu_bit - 1, 0); + if (dest > KVM_MAX_VCPUS) + return -EINVAL; + vcpu =3D kvm_get_vcpu_by_id(kvm, dest); + + if (!vcpu) + return -EINVAL; + return kvm_loongarch_deliver_msi_to_vcpu(kvm, vcpu, virq, level); +} + + /* * kvm_set_msi: inject the MSI corresponding to the * MSI routing entry @@ -26,10 +46,21 @@ static int kvm_set_pic_irq(struct kvm_kernel_irq_routin= g_entry *e, int kvm_set_msi(struct kvm_kernel_irq_routing_entry *e, struct kvm *kvm, int irq_source_id, int level, bool line_status) { + u64 msg_addr; + if (!level) return -1; =20 - pch_msi_set_irq(kvm, e->msi.data, level); + msg_addr =3D (((u64)e->msi.address_hi) << 32) | e->msi.address_lo; + if (cpu_has_msgint && + msg_addr > kvm->arch.dintc->msg_addr_base && + msg_addr <=3D (kvm->arch.dintc->msg_addr_base + kvm->arch.dintc->msg_ad= dr_size)) { + return kvm_dintc_set_msi_irq(kvm, e->msi.address_lo, e->msi.data, level); + } else if (e->msi.address_lo =3D=3D 0) { + pch_msi_set_irq(kvm, e->msi.data, level); + } else { + return 0; + } =20 return 0; } diff --git a/arch/loongarch/kvm/main.c b/arch/loongarch/kvm/main.c index 80ea63d465b8..d18d9f4d485c 100644 --- a/arch/loongarch/kvm/main.c +++ b/arch/loongarch/kvm/main.c @@ -408,6 +408,11 @@ static int kvm_loongarch_env_init(void) =20 /* Register LoongArch PCH-PIC interrupt controller interface. */ ret =3D kvm_loongarch_register_pch_pic_device(); + if (ret) + return ret; + + /* Register LoongArch DINTC interrupt contrroller interface */ + ret =3D kvm_loongarch_register_dintc_device(); =20 return ret; } diff --git a/arch/loongarch/kvm/vcpu.c b/arch/loongarch/kvm/vcpu.c index 1e7590fc1b47..4f13161be107 100644 --- a/arch/loongarch/kvm/vcpu.c +++ b/arch/loongarch/kvm/vcpu.c @@ -13,6 +13,57 @@ #define CREATE_TRACE_POINTS #include "trace.h" =20 +void loongarch_dintc_inject_irq(struct kvm_vcpu *vcpu) +{ + struct dintc_state *ds =3D &vcpu->arch.dintc_state; + unsigned int i; + unsigned long temp[4], old; + + if (!ds) + return; + + for (i =3D 0; i < 4; i++) { + old =3D atomic64_read(&(ds->vector_map[i])); + if (old) + temp[i] =3D atomic64_xchg(&(ds->vector_map[i]), 0); + } + + if (temp[0]) { + old =3D kvm_read_hw_gcsr(LOONGARCH_CSR_ISR0); + kvm_write_hw_gcsr(LOONGARCH_CSR_ISR0, temp[0]|old); + } + if (temp[1]) { + old =3D kvm_read_hw_gcsr(LOONGARCH_CSR_ISR1); + kvm_write_hw_gcsr(LOONGARCH_CSR_ISR1, temp[1]|old); + } + if (temp[2]) { + old =3D kvm_read_hw_gcsr(LOONGARCH_CSR_ISR2); + kvm_write_hw_gcsr(LOONGARCH_CSR_ISR2, temp[2]|old); + } + if (temp[3]) { + old =3D kvm_read_hw_gcsr(LOONGARCH_CSR_ISR3); + kvm_write_hw_gcsr(LOONGARCH_CSR_ISR3, temp[3]|old); + } +} +int kvm_loongarch_deliver_msi_to_vcpu(struct kvm *kvm, + struct kvm_vcpu *vcpu, + u32 vector, int level) +{ + struct kvm_interrupt vcpu_irq; + struct dintc_state *ds; + + if (!vcpu || vector >=3D 256) + return -EINVAL; + ds =3D &vcpu->arch.dintc_state; + if (!ds) + return -ENODEV; + set_bit(vector, (unsigned long *)&ds->vector_map); + vcpu_irq.irq =3D level ? INT_AVEC : -INT_AVEC; + kvm_vcpu_ioctl_interrupt(vcpu, &vcpu_irq); + kvm_vcpu_kick(vcpu); + return 0; +} + const struct _kvm_stats_desc kvm_vcpu_stats_desc[] =3D { KVM_GENERIC_VCPU_STATS(), STATS_DESC_COUNTER(VCPU, int_exits), diff --git a/drivers/irqchip/irq-loongarch-avec.c b/drivers/irqchip/irq-loo= ngarch-avec.c index bf52dc8345f5..2f0f704cfebb 100644 --- a/drivers/irqchip/irq-loongarch-avec.c +++ b/drivers/irqchip/irq-loongarch-avec.c @@ -209,8 +209,9 @@ static void avecintc_compose_msi_msg(struct irq_data *d= , struct msi_msg *msg) struct avecintc_data *adata =3D irq_data_get_irq_chip_data(d); =20 msg->address_hi =3D 0x0; - msg->address_lo =3D (loongarch_avec.msi_base_addr | (adata->vec & 0xff) <= < 4) - | ((cpu_logical_map(adata->cpu & 0xffff)) << 12); + msg->address_lo =3D (loongarch_avec.msi_base_addr | + (adata->vec & AVEC_VIRQ_MASK) << AVEC_VIRQ_SHIFT) | + ((cpu_logical_map(adata->cpu & AVEC_CPU_MASK)) << AVEC_CPU_SHIFT); msg->data =3D 0x0; } =20 diff --git a/include/uapi/linux/kvm.h b/include/uapi/linux/kvm.h index 52f6000ab020..738dd8d626a4 100644 --- a/include/uapi/linux/kvm.h +++ b/include/uapi/linux/kvm.h @@ -1198,6 +1198,8 @@ enum kvm_device_type { #define KVM_DEV_TYPE_LOONGARCH_EIOINTC KVM_DEV_TYPE_LOONGARCH_EIOINTC KVM_DEV_TYPE_LOONGARCH_PCHPIC, #define KVM_DEV_TYPE_LOONGARCH_PCHPIC KVM_DEV_TYPE_LOONGARCH_PCHPIC + KVM_DEV_TYPE_LOONGARCH_DINTC, +#define KVM_DEV_TYPE_LOONGARCH_DINTC KVM_DEV_TYPE_LOONGARCH_DINTC =20 KVM_DEV_TYPE_MAX, =20 --=20 2.39.3