From nobody Sun Sep 28 00:33:55 2025 Delivered-To: importer@patchew.org Received-SPF: pass (zoho.com: domain of gnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; envelope-from=qemu-devel-bounces+importer=patchew.org@nongnu.org; helo=lists.gnu.org; Authentication-Results: mx.zohomail.com; dkim=fail; spf=pass (zoho.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; dmarc=fail(p=none dis=none) header.from=redhat.com ARC-Seal: i=1; a=rsa-sha256; t=1561084034; cv=none; d=zoho.com; s=zohoarc; b=e1f17Jfj8IOLBE25+efDHSe+i6B6jhucoSsjrW+0Z3nTyuGE4iWbD6mdT5rl/TFHof7VUPbrnq0iSJCP1nVc5UMkZ2XiMjn3DH4gB3ugqmwbesjq+soQBAqa56CrV7DhjgtpVogd+oxp1VooBCKqvJYY8HIXC3nw6W6CXwfdHCM= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zoho.com; s=zohoarc; t=1561084034; h=Cc:Date:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Archive:List-Help:List-Unsubscribe:Message-ID:References:Sender:Subject:To:ARC-Authentication-Results; bh=8h3u0eEi97Psvl502yKINhdDv7gW06KT7yE6zhn+bH4=; b=fiJYkkOUNNkZWGtZbjkemdWuNqti4I/ex9F8Cuiuw7N9CA6m1McMveY2y3alwZNMZK7HBP1IcuQxy5ct1aVmXEP9FwwaUrsP71xt9bixaTf2QF/2rozYtMYr9YE+/mQKqKTO63xdKWSfJLcZSDgS04Aw7e/H/ItjHl4qYf85aTQ= ARC-Authentication-Results: i=1; mx.zoho.com; dkim=fail; spf=pass (zoho.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; dmarc=fail header.from= (p=none dis=none) header.from= Return-Path: Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) by mx.zohomail.com with SMTPS id 1561084034069901.9869500562467; Thu, 20 Jun 2019 19:27:14 -0700 (PDT) Received: from localhost ([::1]:54258 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.86_2) (envelope-from ) id 1he9Gf-0003Vq-LL for importer@patchew.org; Thu, 20 Jun 2019 22:27:09 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:41395) by lists.gnu.org with esmtp (Exim 4.86_2) (envelope-from ) id 1he8a8-0006ic-3h for qemu-devel@nongnu.org; Thu, 20 Jun 2019 21:43:14 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1he8a2-0006cF-K1 for qemu-devel@nongnu.org; Thu, 20 Jun 2019 21:43:11 -0400 Received: from mail-wr1-x442.google.com ([2a00:1450:4864:20::442]:41738) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1he8a2-0006Oc-1E for qemu-devel@nongnu.org; Thu, 20 Jun 2019 21:43:06 -0400 Received: by mail-wr1-x442.google.com with SMTP id c2so4860752wrm.8 for ; Thu, 20 Jun 2019 18:42:54 -0700 (PDT) Received: from 640k.lan ([93.56.166.5]) by smtp.gmail.com with ESMTPSA id d1sm1123125wru.41.2019.06.20.18.42.52 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 20 Jun 2019 18:42:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:from:to:cc:subject:date:message-id:in-reply-to:references; bh=8h3u0eEi97Psvl502yKINhdDv7gW06KT7yE6zhn+bH4=; b=sNAefXkYmxgpdeL83dr5QiHg/EHLIJy0FWpXzdq46OfWps5fHu1RwHaBJi67ktsjDv k4RREa6uIaTn9/3F56fljz3Pf0veJadeqYQ8sDkS4ebMrESKJeLMMBiEkQv7zkvXfy6I b4q8jOP8fQKggqRbPHKmU3yXSS/WRKdTD4pWNMMIMgj/uzfbpivAYE/qH7V39XwkIKcl jbh8YbpO4/6BdxDUBXgJ/ZRy5gqT/gw9HAmush+elz9qHCStwI0gqWMfeEfJlt+JreEG RQuTr6yAQBcQrGmIrHdiawZOkWAFuC5lvvXo4P1sLUKI6q4Y9kbM6ptePP4s6XDbs4LD 46RA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:from:to:cc:subject:date:message-id :in-reply-to:references; bh=8h3u0eEi97Psvl502yKINhdDv7gW06KT7yE6zhn+bH4=; b=nXuRWR1DB7PnrxhST5Fg/H3DTNO8F3fPRqtPI7EWeQwTPGYz4pVIqN+G29lnQPpSNx coRcl5QI7ZbpIc79bnMMnoiOR7v5uSutiP1pXbtnEHW9f6ygmXQwLgVPzaOH04RQhN4u jjFBu0TOUkcPujh0os+MPtUXLSgK9NPQev5GHkPo/tVZWwbCXpl4nUTEIgZt/i5VoZzL PqwMGtSdPRJcF35wk//LBjHxo6dijrJAZC8p9LfYkhQVD/Hc4/AAN4Zc4NBz65xZxH3O h7uknAyNzy5Xdei1uOmDbxFUar8lI0fkTLBby/HIkgQNTzzWYjNB5H7FuYWnEkOtrq/6 vtTA== X-Gm-Message-State: APjAAAXPZ3GrKYETLt8m3Wu5FC/f7oMY9Vf7Oi+C4gBw/KGJy0aRE7eu GEPnQTv9m+yS6AXnNqu8/U3I/J1v X-Google-Smtp-Source: APXvYqy5rsl2PIk2JoOhU8Xg+Rk3CU6I16E0fGLQlUNVqoEVu5vepqAV4OkTexRf7FoPOktoOlV7TQ== X-Received: by 2002:adf:ff84:: with SMTP id j4mr15637385wrr.71.1561081373704; Thu, 20 Jun 2019 18:42:53 -0700 (PDT) From: Paolo Bonzini To: qemu-devel@nongnu.org Date: Fri, 21 Jun 2019 03:42:26 +0200 Message-Id: <1561081350-3723-22-git-send-email-pbonzini@redhat.com> X-Mailer: git-send-email 1.8.3.1 In-Reply-To: <1561081350-3723-1-git-send-email-pbonzini@redhat.com> References: <1561081350-3723-1-git-send-email-pbonzini@redhat.com> X-detected-operating-system: by eggs.gnu.org: Genre and OS details not recognized. X-Received-From: 2a00:1450:4864:20::442 Subject: [Qemu-devel] [PULL 21/25] target/i386: kvm: Add support for KVM_CAP_EXCEPTION_PAYLOAD X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Liran Alon Errors-To: qemu-devel-bounces+importer=patchew.org@nongnu.org Sender: "Qemu-devel" X-ZohoMail-DKIM: fail (Header signature does not verify) Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" From: Liran Alon Kernel commit c4f55198c7c2 ("kvm: x86: Introduce KVM_CAP_EXCEPTION_PAYLOAD") introduced a new KVM capability which allows userspace to correctly distinguish between pending and injected exceptions. This distinguish is important in case of nested virtualization scenarios because a L2 pending exception can still be intercepted by the L1 hypervisor while a L2 injected exception cannot. Furthermore, when an exception is attempted to be injected by QEMU, QEMU should specify the exception payload (CR2 in case of #PF or DR6 in case of #DB) instead of having the payload already delivered in the respective vCPU register. Because in case exception is injected to L2 guest and is intercepted by L1 hypervisor, then payload needs to be reported to L1 intercept (VMExit handler) while still preserving respective vCPU register unchanged. This commit adds support for QEMU to properly utilise this new KVM capability (KVM_CAP_EXCEPTION_PAYLOAD). Reviewed-by: Nikita Leshenko Signed-off-by: Liran Alon Message-Id: <20190619162140.133674-10-liran.alon@oracle.com> Signed-off-by: Paolo Bonzini --- target/i386/cpu.c | 6 ++- target/i386/cpu.h | 6 ++- target/i386/hvf/hvf.c | 10 +++-- target/i386/hvf/x86hvf.c | 4 +- target/i386/kvm.c | 101 +++++++++++++++++++++++++++++++++++++++----= ---- target/i386/machine.c | 84 ++++++++++++++++++++++++++++++++++++++- 6 files changed, 187 insertions(+), 24 deletions(-) diff --git a/target/i386/cpu.c b/target/i386/cpu.c index 61e44cb..da6eb67 100644 --- a/target/i386/cpu.c +++ b/target/i386/cpu.c @@ -4819,7 +4819,11 @@ static void x86_cpu_reset(CPUState *s) memset(env->mtrr_fixed, 0, sizeof(env->mtrr_fixed)); =20 env->interrupt_injected =3D -1; - env->exception_injected =3D -1; + env->exception_nr =3D -1; + env->exception_pending =3D 0; + env->exception_injected =3D 0; + env->exception_has_payload =3D false; + env->exception_payload =3D 0; env->nmi_injected =3D false; #if !defined(CONFIG_USER_ONLY) /* We hard-wire the BSP to the first CPU. */ diff --git a/target/i386/cpu.h b/target/i386/cpu.h index 16d898c..7e003b8 100644 --- a/target/i386/cpu.h +++ b/target/i386/cpu.h @@ -1348,10 +1348,14 @@ typedef struct CPUX86State { =20 /* For KVM */ uint32_t mp_state; - int32_t exception_injected; + int32_t exception_nr; int32_t interrupt_injected; uint8_t soft_interrupt; + uint8_t exception_pending; + uint8_t exception_injected; uint8_t has_error_code; + uint8_t exception_has_payload; + uint64_t exception_payload; uint32_t ins_len; uint32_t sipi_vector; bool tsc_valid; diff --git a/target/i386/hvf/hvf.c b/target/i386/hvf/hvf.c index 2751c81..dc4bb63 100644 --- a/target/i386/hvf/hvf.c +++ b/target/i386/hvf/hvf.c @@ -605,7 +605,9 @@ static void hvf_store_events(CPUState *cpu, uint32_t in= s_len, uint64_t idtvec_in X86CPU *x86_cpu =3D X86_CPU(cpu); CPUX86State *env =3D &x86_cpu->env; =20 - env->exception_injected =3D -1; + env->exception_nr =3D -1; + env->exception_pending =3D 0; + env->exception_injected =3D 0; env->interrupt_injected =3D -1; env->nmi_injected =3D false; if (idtvec_info & VMCS_IDT_VEC_VALID) { @@ -619,7 +621,8 @@ static void hvf_store_events(CPUState *cpu, uint32_t in= s_len, uint64_t idtvec_in break; case VMCS_IDT_VEC_HWEXCEPTION: case VMCS_IDT_VEC_SWEXCEPTION: - env->exception_injected =3D idtvec_info & VMCS_IDT_VEC_VECNUM; + env->exception_nr =3D idtvec_info & VMCS_IDT_VEC_VECNUM; + env->exception_injected =3D 1; break; case VMCS_IDT_VEC_PRIV_SWEXCEPTION: default: @@ -912,7 +915,8 @@ int hvf_vcpu_exec(CPUState *cpu) macvm_set_rip(cpu, rip + ins_len); break; case VMX_REASON_VMCALL: - env->exception_injected =3D EXCP0D_GPF; + env->exception_nr =3D EXCP0D_GPF; + env->exception_injected =3D 1; env->has_error_code =3D true; env->error_code =3D 0; break; diff --git a/target/i386/hvf/x86hvf.c b/target/i386/hvf/x86hvf.c index df8e946..e0ea02d 100644 --- a/target/i386/hvf/x86hvf.c +++ b/target/i386/hvf/x86hvf.c @@ -362,8 +362,8 @@ bool hvf_inject_interrupts(CPUState *cpu_state) if (env->interrupt_injected !=3D -1) { vector =3D env->interrupt_injected; intr_type =3D VMCS_INTR_T_SWINTR; - } else if (env->exception_injected !=3D -1) { - vector =3D env->exception_injected; + } else if (env->exception_nr !=3D -1) { + vector =3D env->exception_nr; if (vector =3D=3D EXCP03_INT3 || vector =3D=3D EXCP04_INTO) { intr_type =3D VMCS_INTR_T_SWEXCEPTION; } else { diff --git a/target/i386/kvm.c b/target/i386/kvm.c index e924663..ab812b5 100644 --- a/target/i386/kvm.c +++ b/target/i386/kvm.c @@ -104,6 +104,7 @@ static uint32_t num_architectural_pmu_fixed_counters; static int has_xsave; static int has_xcrs; static int has_pit_state2; +static int has_exception_payload; =20 static bool has_msr_mcg_ext_ctl; =20 @@ -584,15 +585,56 @@ void kvm_arch_on_sigbus_vcpu(CPUState *c, int code, v= oid *addr) /* Hope we are lucky for AO MCE */ } =20 +static void kvm_reset_exception(CPUX86State *env) +{ + env->exception_nr =3D -1; + env->exception_pending =3D 0; + env->exception_injected =3D 0; + env->exception_has_payload =3D false; + env->exception_payload =3D 0; +} + +static void kvm_queue_exception(CPUX86State *env, + int32_t exception_nr, + uint8_t exception_has_payload, + uint64_t exception_payload) +{ + assert(env->exception_nr =3D=3D -1); + assert(!env->exception_pending); + assert(!env->exception_injected); + assert(!env->exception_has_payload); + + env->exception_nr =3D exception_nr; + + if (has_exception_payload) { + env->exception_pending =3D 1; + + env->exception_has_payload =3D exception_has_payload; + env->exception_payload =3D exception_payload; + } else { + env->exception_injected =3D 1; + + if (exception_nr =3D=3D EXCP01_DB) { + assert(exception_has_payload); + env->dr[6] =3D exception_payload; + } else if (exception_nr =3D=3D EXCP0E_PAGE) { + assert(exception_has_payload); + env->cr[2] =3D exception_payload; + } else { + assert(!exception_has_payload); + } + } +} + static int kvm_inject_mce_oldstyle(X86CPU *cpu) { CPUX86State *env =3D &cpu->env; =20 - if (!kvm_has_vcpu_events() && env->exception_injected =3D=3D EXCP12_MC= HK) { + if (!kvm_has_vcpu_events() && env->exception_nr =3D=3D EXCP12_MCHK) { unsigned int bank, bank_num =3D env->mcg_cap & 0xff; struct kvm_x86_mce mce; =20 - env->exception_injected =3D -1; + kvm_reset_exception(env); =20 /* * There must be at least one bank in use if an MCE is pending. @@ -1943,6 +1985,16 @@ int kvm_arch_init(MachineState *ms, KVMState *s) =20 hv_vpindex_settable =3D kvm_check_extension(s, KVM_CAP_HYPERV_VP_INDEX= ); =20 + has_exception_payload =3D kvm_check_extension(s, KVM_CAP_EXCEPTION_PAY= LOAD); + if (has_exception_payload) { + ret =3D kvm_vm_enable_cap(s, KVM_CAP_EXCEPTION_PAYLOAD, 0, true); + if (ret < 0) { + error_report("kvm: Failed to enable exception payload cap: %s", + strerror(-ret)); + return ret; + } + } + ret =3D kvm_get_supported_msrs(s); if (ret < 0) { return ret; @@ -3253,8 +3305,16 @@ static int kvm_put_vcpu_events(X86CPU *cpu, int leve= l) return 0; } =20 - events.exception.injected =3D (env->exception_injected >=3D 0); - events.exception.nr =3D env->exception_injected; + events.flags =3D 0; + + if (has_exception_payload) { + events.flags |=3D KVM_VCPUEVENT_VALID_PAYLOAD; + events.exception.pending =3D env->exception_pending; + events.exception_has_payload =3D env->exception_has_payload; + events.exception_payload =3D env->exception_payload; + } + events.exception.nr =3D env->exception_nr; + events.exception.injected =3D env->exception_injected; events.exception.has_error_code =3D env->has_error_code; events.exception.error_code =3D env->error_code; =20 @@ -3267,7 +3327,6 @@ static int kvm_put_vcpu_events(X86CPU *cpu, int level) events.nmi.masked =3D !!(env->hflags2 & HF2_NMI_MASK); =20 events.sipi_vector =3D env->sipi_vector; - events.flags =3D 0; =20 if (has_msr_smbase) { events.smi.smm =3D !!(env->hflags & HF_SMM_MASK); @@ -3317,8 +3376,19 @@ static int kvm_get_vcpu_events(X86CPU *cpu) if (ret < 0) { return ret; } - env->exception_injected =3D - events.exception.injected ? events.exception.nr : -1; + + if (events.flags & KVM_VCPUEVENT_VALID_PAYLOAD) { + env->exception_pending =3D events.exception.pending; + env->exception_has_payload =3D events.exception_has_payload; + env->exception_payload =3D events.exception_payload; + } else { + env->exception_pending =3D 0; + env->exception_has_payload =3D false; + } + env->exception_injected =3D events.exception.injected; + env->exception_nr =3D + (env->exception_pending || env->exception_injected) ? + events.exception.nr : -1; env->has_error_code =3D events.exception.has_error_code; env->error_code =3D events.exception.error_code; =20 @@ -3370,12 +3440,12 @@ static int kvm_guest_debug_workarounds(X86CPU *cpu) unsigned long reinject_trap =3D 0; =20 if (!kvm_has_vcpu_events()) { - if (env->exception_injected =3D=3D EXCP01_DB) { + if (env->exception_nr =3D=3D EXCP01_DB) { reinject_trap =3D KVM_GUESTDBG_INJECT_DB; } else if (env->exception_injected =3D=3D EXCP03_INT3) { reinject_trap =3D KVM_GUESTDBG_INJECT_BP; } - env->exception_injected =3D -1; + kvm_reset_exception(env); } =20 /* @@ -3751,13 +3821,13 @@ int kvm_arch_process_async_events(CPUState *cs) =20 kvm_cpu_synchronize_state(cs); =20 - if (env->exception_injected =3D=3D EXCP08_DBLE) { + if (env->exception_nr =3D=3D EXCP08_DBLE) { /* this means triple fault */ qemu_system_reset_request(SHUTDOWN_CAUSE_GUEST_RESET); cs->exit_request =3D 1; return 0; } - env->exception_injected =3D EXCP12_MCHK; + kvm_queue_exception(env, EXCP12_MCHK, 0, 0); env->has_error_code =3D 0; =20 cs->halted =3D 0; @@ -3972,14 +4042,13 @@ static int kvm_handle_debug(X86CPU *cpu, } if (ret =3D=3D 0) { cpu_synchronize_state(cs); - assert(env->exception_injected =3D=3D -1); + assert(env->exception_nr =3D=3D -1); =20 /* pass to guest */ - env->exception_injected =3D arch_info->exception; + kvm_queue_exception(env, arch_info->exception, + arch_info->exception =3D=3D EXCP01_DB, + arch_info->dr6); env->has_error_code =3D 0; - if (arch_info->exception =3D=3D EXCP01_DB) { - env->dr[6] =3D arch_info->dr6; - } } =20 return ret; diff --git a/target/i386/machine.c b/target/i386/machine.c index a6afdf8..f66f342 100644 --- a/target/i386/machine.c +++ b/target/i386/machine.c @@ -240,6 +240,41 @@ static int cpu_pre_save(void *opaque) } #endif =20 + /* + * When vCPU is running L2 and exception is still pending, + * it can potentially be intercepted by L1 hypervisor. + * In contrast to an injected exception which cannot be + * intercepted anymore. + * + * Furthermore, when a L2 exception is intercepted by L1 + * hypervisor, it's exception payload (CR2/DR6 on #PF/#DB) + * should not be set yet in the respective vCPU register. + * Thus, in case an exception is pending, it is + * important to save the exception payload seperately. + * + * Therefore, if an exception is not in a pending state + * or vCPU is not in guest-mode, it is not important to + * distinguish between a pending and injected exception + * and we don't need to store seperately the exception payload. + * + * In order to preserve better backwards-compatabile migration, + * convert a pending exception to an injected exception in + * case it is not important to distingiush between them + * as described above. + */ + if (env->exception_pending && !(env->hflags & HF_GUEST_MASK)) { + env->exception_pending =3D 0; + env->exception_injected =3D 1; + + if (env->exception_has_payload) { + if (env->exception_nr =3D=3D EXCP01_DB) { + env->dr[6] =3D env->exception_payload; + } else if (env->exception_nr =3D=3D EXCP0E_PAGE) { + env->cr[2] =3D env->exception_payload; + } + } + } + return 0; } =20 @@ -297,6 +332,23 @@ static int cpu_post_load(void *opaque, int version_id) } #endif =20 + /* + * There are cases that we can get valid exception_nr with both + * exception_pending and exception_injected being cleared. + * This can happen in one of the following scenarios: + * 1) Source is older QEMU without KVM_CAP_EXCEPTION_PAYLOAD support. + * 2) Source is running on kernel without KVM_CAP_EXCEPTION_PAYLOAD su= pport. + * 3) "cpu/exception_info" subsection not sent because there is no exc= eption + * pending or guest wasn't running L2 (See comment in cpu_pre_save()= ). + * + * In those cases, we can just deduce that a valid exception_nr means + * we can treat the exception as already injected. + */ + if ((env->exception_nr !=3D -1) && + !env->exception_pending && !env->exception_injected) { + env->exception_injected =3D 1; + } + env->fpstt =3D (env->fpus_vmstate >> 11) & 7; env->fpus =3D env->fpus_vmstate & ~0x3800; env->fptag_vmstate ^=3D 0xff; @@ -342,6 +394,35 @@ static bool steal_time_msr_needed(void *opaque) return cpu->env.steal_time_msr !=3D 0; } =20 +static bool exception_info_needed(void *opaque) +{ + X86CPU *cpu =3D opaque; + CPUX86State *env =3D &cpu->env; + + /* + * It is important to save exception-info only in case + * we need to distingiush between a pending and injected + * exception. Which is only required in case there is a + * pending exception and vCPU is running L2. + * For more info, refer to comment in cpu_pre_save(). + */ + return (env->exception_pending && (env->hflags & HF_GUEST_MASK)); +} + +static const VMStateDescription vmstate_exception_info =3D { + .name =3D "cpu/exception_info", + .version_id =3D 1, + .minimum_version_id =3D 1, + .needed =3D exception_info_needed, + .fields =3D (VMStateField[]) { + VMSTATE_UINT8(env.exception_pending, X86CPU), + VMSTATE_UINT8(env.exception_injected, X86CPU), + VMSTATE_UINT8(env.exception_has_payload, X86CPU), + VMSTATE_UINT64(env.exception_payload, X86CPU), + VMSTATE_END_OF_LIST() + } +}; + static const VMStateDescription vmstate_steal_time_msr =3D { .name =3D "cpu/steal_time_msr", .version_id =3D 1, @@ -1251,7 +1332,7 @@ VMStateDescription vmstate_x86_cpu =3D { VMSTATE_INT32(env.interrupt_injected, X86CPU), VMSTATE_UINT32(env.mp_state, X86CPU), VMSTATE_UINT64(env.tsc, X86CPU), - VMSTATE_INT32(env.exception_injected, X86CPU), + VMSTATE_INT32(env.exception_nr, X86CPU), VMSTATE_UINT8(env.soft_interrupt, X86CPU), VMSTATE_UINT8(env.nmi_injected, X86CPU), VMSTATE_UINT8(env.nmi_pending, X86CPU), @@ -1275,6 +1356,7 @@ VMStateDescription vmstate_x86_cpu =3D { /* The above list is not sorted /wrt version numbers, watch out! */ }, .subsections =3D (const VMStateDescription*[]) { + &vmstate_exception_info, &vmstate_async_pf_msr, &vmstate_pv_eoi_msr, &vmstate_steal_time_msr, --=20 1.8.3.1