From nobody Mon Feb 9 08:11:57 2026 Delivered-To: importer@patchew.org Authentication-Results: mx.zohomail.com; dkim=fail; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; dmarc=fail(p=none dis=none) header.from=redhat.com ARC-Seal: i=1; a=rsa-sha256; t=1612399447; cv=none; d=zohomail.com; s=zohoarc; b=lQjPbcnB4cglex3zRG+g39SyZCe06rkJO8fSPL4KM3WdjKw7jsLTvUDPx5JTXZ/0iokL0mHPw46x6u+5Zt/jRPsQW1Meg4SoNHg35DlcoxXanSU9xDrLLzZmhSb1xpTdyDXVTZU+rQYElkOmZtbygl4qgCZPl+B33fva3VNwerE= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1612399447; h=Content-Type:Content-Transfer-Encoding:Cc:Date:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Archive:List-Help:List-Unsubscribe:MIME-Version:Message-ID:References:Sender:Subject:To; bh=XL7pAN2ei2uS8tPcluVqcUzLAMsJUai7U4gMv/imTms=; b=AmDC3MbxbCCFVYPJPAqbWrd/7RQlk7pfaP/A1y6NgOWjPZEmITyRmFzpfqBzdnzGDeAxmkZjWRHbmqPTwa6Wb235TUxjJd2J5lzi7jNDqV12taeibKgAv00SNM7eI+o4dVziINfEn+6elhM/H/q/96nVdsQnNYnFh1RkPz9RtFU= ARC-Authentication-Results: i=1; mx.zohomail.com; dkim=fail; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; dmarc=fail header.from= (p=none dis=none) header.from= Return-Path: Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) by mx.zohomail.com with SMTPS id 1612399447774209.680113440097; Wed, 3 Feb 2021 16:44:07 -0800 (PST) Received: from localhost ([::1]:57026 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1l7Skg-0003Qv-M7 for importer@patchew.org; Wed, 03 Feb 2021 19:44:06 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:56890) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1l7SZU-0001R5-Es for qemu-devel@nongnu.org; Wed, 03 Feb 2021 19:32:32 -0500 Received: from us-smtp-delivery-124.mimecast.com ([216.205.24.124]:22450) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.90_1) (envelope-from ) id 1l7SZK-0000fG-8h for qemu-devel@nongnu.org; Wed, 03 Feb 2021 19:32:32 -0500 Received: from mimecast-mx01.redhat.com (mimecast-mx01.redhat.com [209.132.183.4]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-235-ZFU5bkBMO7iWkXKAjyu7ZA-1; Wed, 03 Feb 2021 19:32:19 -0500 Received: from smtp.corp.redhat.com (int-mx07.intmail.prod.int.phx2.redhat.com [10.5.11.22]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx01.redhat.com (Postfix) with ESMTPS id 4539EAFA81 for ; Thu, 4 Feb 2021 00:32:18 +0000 (UTC) Received: from scv.redhat.com (ovpn-112-247.rdu2.redhat.com [10.10.112.247]) by smtp.corp.redhat.com (Postfix) with ESMTP id A4E9D1007622; Thu, 4 Feb 2021 00:32:17 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1612398741; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=XL7pAN2ei2uS8tPcluVqcUzLAMsJUai7U4gMv/imTms=; b=HWHUWG3ZtoHXy6VOrhqv3F6ywdONg0E5PlNYt8xqa/P1JvT9npV74wFUYoVom/Ks74SbTy 9ZgoJSZmPRKk0v1ZbgKMUO/midpjYWJ7dapbPF1aQRF3I0SSc1Ept/14T/s6QTWu70ubkc k0SbUJvH0P8iSY7EjuDsu0VAtLz5Uk4= X-MC-Unique: ZFU5bkBMO7iWkXKAjyu7ZA-1 From: John Snow To: Markus Armbruster , qemu-devel@nongnu.org Subject: [PATCH v5 13/15] qapi/introspect.py: add introspect.json dummy types Date: Wed, 3 Feb 2021 19:32:05 -0500 Message-Id: <20210204003207.2856909-14-jsnow@redhat.com> In-Reply-To: <20210204003207.2856909-1-jsnow@redhat.com> References: <20210204003207.2856909-1-jsnow@redhat.com> MIME-Version: 1.0 X-Scanned-By: MIMEDefang 2.84 on 10.5.11.22 Authentication-Results: relay.mimecast.com; auth=pass smtp.auth=CUSA124A263 smtp.mailfrom=jsnow@redhat.com X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Transfer-Encoding: quoted-printable Received-SPF: pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; envelope-from=qemu-devel-bounces+importer=patchew.org@nongnu.org; helo=lists.gnu.org; Received-SPF: pass client-ip=216.205.24.124; envelope-from=jsnow@redhat.com; helo=us-smtp-delivery-124.mimecast.com X-Spam_score_int: -32 X-Spam_score: -3.3 X-Spam_bar: --- X-Spam_report: (-3.3 / 5.0 requ) BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.539, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: John Snow , Eduardo Habkost , Cleber Rosa Errors-To: qemu-devel-bounces+importer=patchew.org@nongnu.org Sender: "Qemu-devel" X-ZohoMail-DKIM: fail (Header signature does not verify) Content-Type: text/plain; charset="utf-8" Add some aliases that declare intent for some of the "dictly-typed" objects we pass around in introspect.py. Signed-off-by: John Snow --- This patch is optional, it can be dropped if desired. If it's taken, it's probably best to squash it with the prior patch. It is purely for the sake of demonstrating what the _DObject was meant to convey: a Python Dict that represents some JSON Object. It does not add any type safety in and of itself, but does have some (light) annotational benefit. In this case, it's usually a specific data structure from the QAPI Schema we are referencing, but do not have "compile-time" access to in Python. These are loosely typed and don't bother reproducing the exact structure of the real types. Python 3.6 does not have support for TypedDict structures, so this is as good as we can do without involving a third-party library (e.g. Pydantic), in which we might be able to say: class SchemaMetaType(str, enum.Enum): BUILTIN =3D "builtin" ENUM =3D "enum" ARRAY =3D "array" OBJECT =3D "object" ALTERNATE =3D "alternate" COMMAND =3D "command" EVENT =3D "event" class SchemaInfo(pydantic.BaseModel): name: str meta-type: SchemaMetaType features: Optional[List[str]] data: Union[SchemaInfoBuiltin, SchemaInfoEnum, SchemaInfoArray, SchemaInfoObject, SchemaInfoAlternate, SchemaInfoCommand, SchemaInfoEvent] However, the cost of reproducing and keeping these structure definitions in-sync between the user-defined portion of the schema and the code generator is likely not worth doing any such thing. However, it does illustrate an interesting dependency the generator has on the user-defined schema itself in terms of types. So, I settled on using some light types that suggest the form of the object instead of enforcing the form. Signed-off-by: John Snow --- scripts/qapi/introspect.py | 51 +++++++++++++++++++++++--------------- 1 file changed, 31 insertions(+), 20 deletions(-) diff --git a/scripts/qapi/introspect.py b/scripts/qapi/introspect.py index 3afcdda7446..2a39726f40a 100644 --- a/scripts/qapi/introspect.py +++ b/scripts/qapi/introspect.py @@ -66,10 +66,15 @@ _value =3D Union[_scalar, _nonscalar] TreeValue =3D Union[_value, 'Annotated[_value]'] =20 -# This is an alias for an arbitrary JSON object, represented here as a Dic= t. -# It is stricter on the value type than the recursive definition above. -# It is used to represent SchemaInfo-related structures exclusively. -_DObject =3D Dict[str, object] +# These types are based on structures defined in QEMU's schema, so we lack +# precise types for them here. Python 3.6 does not offer TypedDict constru= cts, +# so they are broadly typed here as simple Python Dicts. +SchemaInfo =3D Dict[str, object] +SchemaInfoObject =3D Dict[str, object] +SchemaInfoObjectVariant =3D Dict[str, object] +SchemaInfoObjectMember =3D Dict[str, object] +SchemaInfoCommand =3D Dict[str, object] + =20 _NodeT =3D TypeVar('_NodeT', bound=3D_value) =20 @@ -162,7 +167,7 @@ def __init__(self, prefix: str, unmask: bool): ' * QAPI/QMP schema introspection', __doc__) self._unmask =3D unmask self._schema: Optional[QAPISchema] =3D None - self._trees: List[Annotated[_DObject]] =3D [] + self._trees: List[Annotated[SchemaInfo]] =3D [] self._used_types: List[QAPISchemaType] =3D [] self._name_map: Dict[str, str] =3D {} self._genc.add(mcgen(''' @@ -234,9 +239,18 @@ def _gen_features(features: List[QAPISchemaFeature] ) -> List[Annotated[str]]: return [Annotated(f.name, f.ifcond) for f in features] =20 - def _gen_tree(self, name: str, mtype: str, obj: _DObject, + def _gen_tree(self, name: str, mtype: str, obj: Dict[str, object], ifcond: List[str], features: Optional[List[QAPISchemaFeature]]) -> None: + """ + Build and append a SchemaInfo object to self._trees. + + :param name: The entity's name. + :param mtype: The entity's meta-type. + :param obj: Additional entity fields, as appropriate for the meta-= type. + :param ifcond: List of conditionals that apply to this entire enti= ty. + :param features: Optional features field for SchemaInfo. + """ comment: Optional[str] =3D None if mtype not in ('command', 'event', 'builtin', 'array'): if not self._unmask: @@ -251,8 +265,8 @@ def _gen_tree(self, name: str, mtype: str, obj: _DObjec= t, self._trees.append(Annotated(obj, ifcond, comment)) =20 def _gen_member(self, member: QAPISchemaObjectTypeMember - ) -> Annotated[_DObject]: - obj: _DObject =3D { + ) -> Annotated[SchemaInfoObjectMember]: + obj: SchemaInfoObjectMember =3D { 'name': member.name, 'type': self._use_type(member.type) } @@ -262,13 +276,9 @@ def _gen_member(self, member: QAPISchemaObjectTypeMemb= er obj['features'] =3D self._gen_features(member.features) return Annotated(obj, member.ifcond) =20 - def _gen_variants(self, tag_name: str, - variants: List[QAPISchemaVariant]) -> _DObject: - return {'tag': tag_name, - 'variants': [self._gen_variant(v) for v in variants]} - - def _gen_variant(self, variant: QAPISchemaVariant) -> Annotated[_DObje= ct]: - obj: _DObject =3D { + def _gen_variant(self, variant: QAPISchemaVariant + ) -> Annotated[SchemaInfoObjectVariant]: + obj: SchemaInfoObjectVariant =3D { 'case': variant.name, 'type': self._use_type(variant.type) } @@ -300,11 +310,12 @@ def visit_object_type_flat(self, name: str, info: Opt= ional[QAPISourceInfo], features: List[QAPISchemaFeature], members: List[QAPISchemaObjectTypeMember], variants: Optional[QAPISchemaVariants]) -> = None: - obj: _DObject =3D {'members': [self._gen_member(m) for m in member= s]} + obj: SchemaInfoObject =3D { + 'members': [self._gen_member(m) for m in members] + } if variants: - obj.update(self._gen_variants(variants.tag_member.name, - variants.variants)) - + obj['tag'] =3D variants.tag_member.name + obj['variants'] =3D [self._gen_variant(v) for v in variants.va= riants] self._gen_tree(name, 'object', obj, ifcond, features) =20 def visit_alternate_type(self, name: str, info: Optional[QAPISourceInf= o], @@ -329,7 +340,7 @@ def visit_command(self, name: str, info: Optional[QAPIS= ourceInfo], =20 arg_type =3D arg_type or self._schema.the_empty_object_type ret_type =3D ret_type or self._schema.the_empty_object_type - obj: _DObject =3D { + obj: SchemaInfoCommand =3D { 'arg-type': self._use_type(arg_type), 'ret-type': self._use_type(ret_type) } --=20 2.29.2