From nobody Fri Nov 14 12:16:52 2025 Delivered-To: importer@patchew.org Authentication-Results: mx.zohomail.com; dkim=pass header.i=@quicinc.com; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; arc=pass (i=1dmarc=pass fromdomain=quicinc.com); dmarc=pass(p=none dis=none) header.from=quicinc.com ARC-Seal: i=2; a=rsa-sha256; t=1588023790; cv=pass; d=zohomail.com; s=zohoarc; b=iA9vdwr9zwtbxAckHn5s12t202O2HiKE4HGJoszhEjneA3OzB1xLdkS5yAkQ9Zfy6BJY6aBl0VXPP3bQPqnCrV3uTm1vDssH4UgsHK0RSSRZOuhjBYevSwNvJokPoVYm7ekuFl0QsuB/JFC0LuXqkIygRdfuRMKWi2jBjR7SdBI= ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1588023790; h=Content-Type:Cc:Date:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Archive:List-Help:List-Unsubscribe:MIME-Version:Message-ID:References:Sender:Subject:To; bh=CCrr2Hg/amikv/N2vvXiB77ScBz4C6zaUKrFvvIxWsM=; b=UZ7GUi6MCqz6QiRD1cAqpeLkdu1R4P1VmzZZsSVucsLg0VjqO1YdA0MXjwAxDOb1KyPWHZDVTMX3h9UKWFmXCGgV6aTudsSus9p7KB3B9yz5VBHSpK3nDwHeGaWlpjhOeaHNxScK7aW064r4icsbvO2eKIfXgD7CWW1ubgPevjQ= ARC-Authentication-Results: i=2; mx.zohomail.com; dkim=pass header.i=@quicinc.com; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; arc=pass (i=1dmarc=pass fromdomain=quicinc.com); dmarc=pass header.from= (p=none dis=none) header.from= Return-Path: Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) by mx.zohomail.com with SMTPS id 1588023790503847.241175961758; Mon, 27 Apr 2020 14:43:10 -0700 (PDT) Received: from localhost ([::1]:34454 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jTBWu-0001eo-Gz for importer@patchew.org; Mon, 27 Apr 2020 17:43:08 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:33226) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jTBV7-0006th-9V for qemu-devel@nongnu.org; Mon, 27 Apr 2020 17:41:18 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.90_1) (envelope-from ) id 1jTBV6-0003Zz-Kz for qemu-devel@nongnu.org; Mon, 27 Apr 2020 17:41:17 -0400 Received: from alexa-out-sd-02.qualcomm.com ([199.106.114.39]:56017) by eggs.gnu.org with esmtps (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.90_1) (envelope-from ) id 1jTBUy-0003YP-Rl; Mon, 27 Apr 2020 17:41:09 -0400 Received: from unknown (HELO ironmsg03-sd.qualcomm.com) ([10.53.140.143]) by alexa-out-sd-02.qualcomm.com with ESMTP; 27 Apr 2020 14:41:06 -0700 Received: from nasanexm03a.na.qualcomm.com ([10.85.0.103]) by ironmsg03-sd.qualcomm.com with ESMTP/TLS/AES256-SHA; 27 Apr 2020 14:41:06 -0700 Received: from nasanexm03g.na.qualcomm.com (10.85.0.49) by nasanexm03a.na.qualcomm.com (10.85.0.103) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Mon, 27 Apr 2020 14:41:05 -0700 Received: from NAM10-MW2-obe.outbound.protection.outlook.com (199.106.107.6) by nasanexm03g.na.qualcomm.com (10.85.0.49) with Microsoft SMTP Server (TLS) id 15.0.1497.2 via Frontend Transport; Mon, 27 Apr 2020 14:41:05 -0700 Received: from MWHPR0201MB3547.namprd02.prod.outlook.com (2603:10b6:301:7b::24) by MWHPR0201MB3577.namprd02.prod.outlook.com (2603:10b6:301:76::19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2937.22; Mon, 27 Apr 2020 21:41:03 +0000 Received: from MWHPR0201MB3547.namprd02.prod.outlook.com ([fe80::10ad:5df5:d575:1f37]) by MWHPR0201MB3547.namprd02.prod.outlook.com ([fe80::10ad:5df5:d575:1f37%3]) with mapi id 15.20.2937.023; Mon, 27 Apr 2020 21:41:03 +0000 Received: from STEPLONG.qualcomm.com (108.176.222.2) by MN2PR12CA0014.namprd12.prod.outlook.com (2603:10b6:208:a8::27) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2937.13 via Frontend Transport; Mon, 27 Apr 2020 21:41:03 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=quicinc.com; i=@quicinc.com; q=dns/txt; s=qcdkim; t=1588023668; x=1619559668; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version; bh=LgCGX6obc0LwYH2h2R+wRRQ8+MJIS29iOFUVmsScMII=; b=M7fvxljZFbeu/gDr9K2NKeSHSsaVxZfBjz7C3cbdaSL9WVqSkumllFN2 n1Q3pXM1Zv//D7/xZEW2ldqXlNhfAbjL77Zg03rd9IGxVoNIr15Td4Lbk 11tp2GNVVLc9NI3v46wCfl8YQR2tR/7Wwyubklomgtn+EDFXfHhe4hz5S o=; ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=WkpRB3BjcRXhXDkbEZ77nDVgxdYRhFh/xey8vzEE1WAZkeVwXCI6nZB5bKUfyLz6K19x0LSMDvjD6JWA5+tVhMqv8ScYxe6ybpjDPuvMWlnVTi0i0iTN5xQT5yAUdLQaXcsrqfedYxq0srHyn6CriD/m/FFYguOWljZEzBaN7/0xfTPFkgXQHE1OUI1GeIKnsoBkfGxt9CQCaE5N2AU3XqjeI1PK00D92/yajenvt09ZHZwxwXXNBwjbUzLS6oQpOOEwGF5E2qS0QTMaK9F1ZHTQGBEE7amkx6DahwKFQECIXB/oZLnp/KCwwyJHKarGkdf/7mkTHDU+2u516c1xgA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=CCrr2Hg/amikv/N2vvXiB77ScBz4C6zaUKrFvvIxWsM=; b=esoNX/7ukMEYnex7w/YhPZMU8MeO71gZ9qQzarr9Pv1j34Wv98MhzSFd3iVrF0muEfpdXVWJ+OSlbhas19Toul28oDi0HUxc9jZ92zGHuQJtN+5gE9EzElRMFrdvVShsHLQ1IsITUsWJjvJJbODUhAF51hak8sU4Pdsfx1RvHttfhNycAH5szN8Ynhw98J1IxqU7yqG5dq4Cqb4t/iHMn2n3bPv1kJqu5CFdcP9MwEzohTKc6/QK6BZ/ADiW6oQJPXiMFLhlDoJWm09Dc8qWBVijh0pbippM5NQnoi3v4PjFYcJMuWK0BTRJcaypzMnOna56gg1oLFGWKpbbns7kdg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=quicinc.com; dmarc=pass action=none header.from=quicinc.com; dkim=pass header.d=quicinc.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=qualcomm.onmicrosoft.com; s=selector1-qualcomm-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=CCrr2Hg/amikv/N2vvXiB77ScBz4C6zaUKrFvvIxWsM=; b=iCDdvw11fCvC3OotsT7K3SRvdV2AhPbVfGi+A0b/kcjGfiaXA+RKbu9+gZjPCt7h9FsKPp27mUUleXKcT/yt5/h0BzCA/XOijtJ7d+L2wJ354ByL1fon3ufxYFzsI6f6oi0/8FzAZUyELtfksatub+PNy9UYUVW87TSL7zEJY0M= Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=steplong@quicinc.com; From: Stephen Long To: Subject: [PATCH RFC v3 1/3] target/arm: Implement SVE2 AESMC, AESIMC Date: Mon, 27 Apr 2020 14:40:44 -0700 Message-ID: <20200427214046.31401-2-steplong@quicinc.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20200427214046.31401-1-steplong@quicinc.com> References: <20200427214046.31401-1-steplong@quicinc.com> X-ClientProxiedBy: MN2PR12CA0014.namprd12.prod.outlook.com (2603:10b6:208:a8::27) To MWHPR0201MB3547.namprd02.prod.outlook.com (2603:10b6:301:7b::24) MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 X-Mailer: git-send-email 2.17.1 X-Originating-IP: [108.176.222.2] X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: a49b9651-6b99-465e-97e5-08d7eaf3af63 X-MS-TrafficTypeDiagnostic: MWHPR0201MB3577: X-MS-Exchange-Transport-Forked: True X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:221; X-Forefront-PRVS: 0386B406AA X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:MWHPR0201MB3547.namprd02.prod.outlook.com; PTR:; CAT:NONE; SFTY:; SFS:(39860400002)(376002)(366004)(346002)(396003)(136003)(6666004)(2616005)(478600001)(36756003)(6512007)(107886003)(66556008)(2906002)(66946007)(6486002)(66476007)(4326008)(316002)(1076003)(86362001)(6506007)(8936002)(81156014)(26005)(8676002)(16526019)(956004)(186003)(52116002)(5660300002)(6916009); DIR:OUT; SFP:1102; X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: m+TGI6B8Q+/zNA7JmKkqtZl8sxHaXdEK4XJJ7N7xpRJdyq4k4xL68jf4zxPAPFkjESQ/cCusqv0LjqwMkgEC12PPLIUCHsn7qYPnGLOvEMrV4HtIpfZxGuSuA79MpW2HUAvwGJf4Qx3LcWijOCJMyxCGE4wX+86Hv6nOTmyQqvXxFFz/K927e2Rfn5zaIUyzhUwlUOFiiOy3C7G9ZMpZ35RYVYEjs+7frfI97sY40/VNpyPMozbPSzXC4G0bhOUAjBeOuAV+FN820VRAcTWKZA78wwlpMEAeDegnKG5HJ+LBjyyHBJl7NcqOJtzIEggQ2RT1JqjarqCXhJXroaHajw7nLGw3ohL04pWBzODh1ABlSw3HYtGpfrNBrYvIYL/3Emjy3Rda+ACRdfkYyiZAoFj5vpt4ZKFmz3ibfjbyLe2MxywzUM4CRLLQWwNtZGZ7 X-MS-Exchange-AntiSpam-MessageData: KziP6W6CRSNB7D5WvPKIp38kDaxUghKsF7zlogk461tn1JnnKJ3nAMvOgrI4lFX/c9dv91STd2mkkhUtFT5m5Auf+LHp6NQg7OPv1OKAgzjxKtUh9SGQRfKEzeEhLoT0eHACJzL4tYHrx05v0XmBZ3MpQCifdttsEFRBcIr2S1xjXwRkPc2i4wslrFBZlkBIfT2OVz3e022t+yeTemIoZ5S1aiEsolA+98cOTg/AhBjJpoQ2ymepSODsNK3ITxJE6faCM0YYwL3NyIXYI/u7PDyE0rflBOlLduNN6LXR+2niCtcx9JrED8WclzJ9C9T+JPrGdZod0Z2/iqxcUNQsdQoUCfb58XbtgTf+Rb0IWgTCXLnl2xwma/1522tR+RCIIlJnrP/wSU9VdSX05udpF1ygoAxc+CpIBRkQC1afKD25Xk/vtX4L4/TuJ/yngOwdDhSEOskPEmr2rfZJ+iypkG7+oQk+vJVZmNaLAtpcPAkm81PtOOFIoVUL6Wd4aRbg4ebpgO/mzhd1XsD/4H0Xm2/0xe+Y58O61G4cCL6lom64PoZrh9mqnEOIw2Nu0RiHgKagPb/VJEQR8Mk38wUwSV0iWggN5/0JxlmbUr0Sh6DIB9d8aGbWwmDyYqiWWAkQF9BGoEI1VBajg+YNrAq1jyltkGcYD43JvmrelOAGACIUue3pdshnlc7T2I6gPos6pWH1Q50J91Qqhq5lLObxdFIlL1twkiZvRovOjufR4DV49Snb/t9ek+YWT1rlrOIL3JFqSKmOVup4YZQk0j+tGd/4yK8BMWX1+r1f0IROI0I= X-MS-Exchange-CrossTenant-Network-Message-Id: a49b9651-6b99-465e-97e5-08d7eaf3af63 X-MS-Exchange-CrossTenant-OriginalArrivalTime: 27 Apr 2020 21:41:03.7886 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 98e9ba89-e1a1-4e38-9007-8bdabc25de1d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: AKevp4RNh/l7aCN/r9BJe5z5j9j0B4iIY2cf8oUznfjqorsGET+DZQehVepK3+GF91yvRWRFB9UrtTHNFCLKhQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: MWHPR0201MB3577 X-OriginatorOrg: quicinc.com Received-SPF: pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; envelope-from=qemu-devel-bounces+importer=patchew.org@nongnu.org; helo=lists.gnu.org; Received-SPF: pass client-ip=199.106.114.39; envelope-from=steplong@quicinc.com; helo=alexa-out-sd-02.qualcomm.com X-detected-operating-system: by eggs.gnu.org: First seen = 2020/04/27 17:41:06 X-ACL-Warn: Detected OS = FreeBSD 9.x or newer [fuzzy] X-Received-From: 199.106.114.39 X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: qemu-arm@nongnu.org, richard.henderson@linaro.org, apazos@quicinc.com Errors-To: qemu-devel-bounces+importer=patchew.org@nongnu.org Sender: "Qemu-devel" X-ZohoMail-DKIM: pass (identity @qualcomm.onmicrosoft.com) Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="utf-8" Signed-off-by: Stephen Long --- target/arm/crypto_helper.c | 36 +++++++++++++++++++++--------------- target/arm/sve.decode | 10 ++++++++++ target/arm/translate-sve.c | 20 ++++++++++++++++++++ 3 files changed, 51 insertions(+), 15 deletions(-) diff --git a/target/arm/crypto_helper.c b/target/arm/crypto_helper.c index f800266727..ae2ea018af 100644 --- a/target/arm/crypto_helper.c +++ b/target/arm/crypto_helper.c @@ -14,6 +14,7 @@ #include "cpu.h" #include "exec/helper-proto.h" #include "crypto/aes.h" +#include "tcg/tcg-gvec-desc.h" =20 union CRYPTO_STATE { uint8_t bytes[16]; @@ -54,7 +55,7 @@ void HELPER(crypto_aese)(void *vd, void *vm, uint32_t dec= rypt) rd[1] =3D st.l[1]; } =20 -void HELPER(crypto_aesmc)(void *vd, void *vm, uint32_t decrypt) +void HELPER(crypto_aesmc)(void *vd, void *vm, uint32_t desc) { static uint32_t const mc[][256] =3D { { /* MixColumns lookup table */ @@ -190,23 +191,28 @@ void HELPER(crypto_aesmc)(void *vd, void *vm, uint32_= t decrypt) 0xbe805d9f, 0xb58d5491, 0xa89a4f83, 0xa397468d, } }; =20 - uint64_t *rd =3D vd; - uint64_t *rm =3D vm; - union CRYPTO_STATE st =3D { .l =3D { rm[0], rm[1] } }; - int i; + intptr_t i, opr_sz =3D simd_oprsz(desc); + intptr_t decrypt =3D simd_data(desc); =20 - assert(decrypt < 2); + for (i =3D 0; i < opr_sz; i +=3D 16) { + uint64_t *rd =3D vd + i; + uint64_t *rm =3D vm + i; + union CRYPTO_STATE st =3D { .l =3D { rm[0], rm[1] } }; + int i; =20 - for (i =3D 0; i < 16; i +=3D 4) { - CR_ST_WORD(st, i >> 2) =3D - mc[decrypt][CR_ST_BYTE(st, i)] ^ - rol32(mc[decrypt][CR_ST_BYTE(st, i + 1)], 8) ^ - rol32(mc[decrypt][CR_ST_BYTE(st, i + 2)], 16) ^ - rol32(mc[decrypt][CR_ST_BYTE(st, i + 3)], 24); - } + assert(decrypt < 2); =20 - rd[0] =3D st.l[0]; - rd[1] =3D st.l[1]; + for (i =3D 0; i < 16; i +=3D 4) { + CR_ST_WORD(st, i >> 2) =3D + mc[decrypt][CR_ST_BYTE(st, i)] ^ + rol32(mc[decrypt][CR_ST_BYTE(st, i + 1)], 8) ^ + rol32(mc[decrypt][CR_ST_BYTE(st, i + 2)], 16) ^ + rol32(mc[decrypt][CR_ST_BYTE(st, i + 3)], 24); + } + + rd[0] =3D st.l[0]; + rd[1] =3D st.l[1]; + } } =20 /* diff --git a/target/arm/sve.decode b/target/arm/sve.decode index de3768c24a..f58eb04d11 100644 --- a/target/arm/sve.decode +++ b/target/arm/sve.decode @@ -92,6 +92,10 @@ # Named instruction formats. These are generally used to # reduce the amount of duplication between instruction patterns. =20 +# One operand with unused vector element size +@rdn_e0 ........ .. ........... . ..... rd:5 \ + &rr_esz rn=3D%reg_movprfx esz=3D0 + # Two operand with unused vector element size @pd_pn_e0 ........ ........ ....... rn:4 . rd:4 &rr_esz es= z=3D0 =20 @@ -1419,3 +1423,9 @@ STNT1_zprz 1110010 .. 00 ..... 001 ... ..... ...= .. \ # SVE2 32-bit scatter non-temporal store (vector plus scalar) STNT1_zprz 1110010 .. 10 ..... 001 ... ..... ..... \ @rprr_scatter_store xs=3D0 esz=3D2 scale=3D0 + +#### SVE2 Crypto Extensions + +## SVE2 crypto unary operations +AESMC 01000101 00 10000011100 0 00000 ..... @rdn_e0 +AESIMC 01000101 00 10000011100 1 00000 ..... @rdn_e0 diff --git a/target/arm/translate-sve.c b/target/arm/translate-sve.c index 86c3d0ed11..6523621d21 100644 --- a/target/arm/translate-sve.c +++ b/target/arm/translate-sve.c @@ -7956,3 +7956,23 @@ static bool trans_SQRDCMLAH_zzzz(DisasContext *s, ar= g_CMLA_zzzz *a) }; return do_sve2_zzzz_fn(s, a->rd, a->rn, a->rm, a->ra, fns[a->esz], a->= rot); } + +#define DO_SVE2_AES_CRYPTO(NAME, name, DECRYPT) \ +static bool trans_##NAME(DisasContext *s, arg_rr_esz *a) \ +{ \ + if (!dc_isar_feature(aa64_sve2_aes, s)) { \ + return false; \ + } \ + if (sve_access_check(s)) { \ + unsigned vsz =3D vec_full_reg_size(s); \ + tcg_gen_gvec_2_ool(vec_full_reg_offset(s, a->rd), \ + vec_full_reg_offset(s, a->rn), \ + vsz, vsz, DECRYPT, gen_helper_crypto_##name);\ + } \ + return true; \ +} + +DO_SVE2_AES_CRYPTO(AESMC, aesmc, 0) +DO_SVE2_AES_CRYPTO(AESIMC, aesmc, 1) +DO_SVE2_AES_CRYPTO(AESE, aese, 0) +DO_SVE2_AES_CRYPTO(AESD, aese, 1) --=20 2.17.1 From nobody Fri Nov 14 12:16:52 2025 Delivered-To: importer@patchew.org Authentication-Results: mx.zohomail.com; dkim=pass header.i=@quicinc.com; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; arc=pass (i=1dmarc=pass fromdomain=quicinc.com); dmarc=pass(p=none dis=none) header.from=quicinc.com ARC-Seal: i=2; a=rsa-sha256; t=1588023791; cv=pass; d=zohomail.com; s=zohoarc; b=YrOS2hfWYWJkLZveFPMVYYlllwPbupFopd1VHa9j9fdWPcTC2/jLIBKuq/u1+FXomNEh7TDUBoMmICTCXk0/ft4hobK8ONznpnjZaKdkfKnd35jkjExCwLlPwWy+uL863AvlBoGAYsxgTN30kjdptZ8U1yyTkAA+N5HmFHymlGg= ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1588023791; h=Content-Type:Cc:Date:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Archive:List-Help:List-Unsubscribe:MIME-Version:Message-ID:References:Sender:Subject:To; bh=OeA5/UkwlJZRKpIC3EW9w9mTody8GONHY+eJaj22f20=; b=FNLGAK0bVdqhBNq7j8KmIW5NRuTPpgU3d7sn3GLAMhdtK4V8Ocs0K59uaXcGubQRRVaetcvKZNDw6KvJRC9Nbx1poiwpVOVYWZYlN4H7n99ibHHziV7M/mqegalTwPqPiHhdew9tQ7h3XlSUFy891rsNdXOy2sLWt0DNaEaroHM= ARC-Authentication-Results: i=2; mx.zohomail.com; dkim=pass header.i=@quicinc.com; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; arc=pass (i=1dmarc=pass fromdomain=quicinc.com); dmarc=pass header.from= (p=none dis=none) header.from= Return-Path: Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) by mx.zohomail.com with SMTPS id 158802379171766.28828890241618; Mon, 27 Apr 2020 14:43:11 -0700 (PDT) Received: from localhost ([::1]:34464 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jTBWw-0001l0-0g for importer@patchew.org; Mon, 27 Apr 2020 17:43:10 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:33242) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jTBV9-0006vD-EF for qemu-devel@nongnu.org; Mon, 27 Apr 2020 17:41:20 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.90_1) (envelope-from ) id 1jTBV8-0003aZ-GP for qemu-devel@nongnu.org; Mon, 27 Apr 2020 17:41:19 -0400 Received: from alexa-out-sd-01.qualcomm.com ([199.106.114.38]:18991) by eggs.gnu.org with esmtps (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.90_1) (envelope-from ) id 1jTBV0-0003YO-3Y; Mon, 27 Apr 2020 17:41:10 -0400 Received: from unknown (HELO ironmsg04-sd.qualcomm.com) ([10.53.140.144]) by alexa-out-sd-01.qualcomm.com with ESMTP; 27 Apr 2020 14:41:06 -0700 Received: from nasanexm03c.na.qualcomm.com ([10.85.0.106]) by ironmsg04-sd.qualcomm.com with ESMTP/TLS/AES256-SHA; 27 Apr 2020 14:41:06 -0700 Received: from nasanexm03g.na.qualcomm.com (10.85.0.49) by nasanexm03c.na.qualcomm.com (10.85.0.106) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Mon, 27 Apr 2020 14:41:06 -0700 Received: from NAM10-MW2-obe.outbound.protection.outlook.com (199.106.107.6) by nasanexm03g.na.qualcomm.com (10.85.0.49) with Microsoft SMTP Server (TLS) id 15.0.1497.2 via Frontend Transport; Mon, 27 Apr 2020 14:41:06 -0700 Received: from MWHPR0201MB3547.namprd02.prod.outlook.com (2603:10b6:301:7b::24) by MWHPR0201MB3577.namprd02.prod.outlook.com (2603:10b6:301:76::19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2937.22; Mon, 27 Apr 2020 21:41:04 +0000 Received: from MWHPR0201MB3547.namprd02.prod.outlook.com ([fe80::10ad:5df5:d575:1f37]) by MWHPR0201MB3547.namprd02.prod.outlook.com ([fe80::10ad:5df5:d575:1f37%3]) with mapi id 15.20.2937.023; Mon, 27 Apr 2020 21:41:04 +0000 Received: from STEPLONG.qualcomm.com (108.176.222.2) by MN2PR12CA0014.namprd12.prod.outlook.com (2603:10b6:208:a8::27) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2937.13 via Frontend Transport; Mon, 27 Apr 2020 21:41:03 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=quicinc.com; i=@quicinc.com; q=dns/txt; s=qcdkim; t=1588023670; x=1619559670; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version; bh=F7awvEuPIltKdb65/KCGxYIlUKiPHhaqZtEPEeI4p74=; b=oFi/Z7Hos4McyBTd7PLIqht25bwpYN3iNSepj+npLwMtyzKfCOtmPjdL rnLYqH7UBvc9xsr/be7JfSYmTvBj0Eml1wIkvElFZTz12ZJLgaRXAYtUf FAUvfEKGF7CA2S0xfBkboZBO8chiGFGSrEEVQrJ3KNjnoeD2pxt7SodU2 E=; ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Wlp+h3mkPiVNcmzj6Ivx2Sa/zNilIixGdMf/rGbde/+uDHOp6ffEOhPIIPGJDYGxWX2ldkbRKNEvyJV83+s1Cy5fYiqIUhlr6YUvmUE24qTUScbfx487cQdSKZn5ZQYFzTOiAWI4r/VQX1ATXlRsPvawwVV99VSaLSQpeSuEHy3XbshexiQQMEKcWbIsdF5s8t9u37YjxY7Fai3zI/uJlIT/KYQ0ax2ghlt26sbimgbYlYJ1g6hSYSkdBqQgphM8lEePAH0Y9xTT0sRO6NgnxRW27Ede/nLRZPOSubkp/r4KFL7fPV/5KKaj8io4UMwBknBGAyfqzzanUakpMKw9jw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=OeA5/UkwlJZRKpIC3EW9w9mTody8GONHY+eJaj22f20=; b=ofCvyWMjBbcPOi7nV1Rg/KuS+T1plZUHERx2G2IPorhNwp0bzziyYcSEWEp+BiNDJDzkzUMTZznw2KcUVgV7ajjMeBJrlDEqpxB1Zez6hY9142slBMT2R5oM1eA7H9nYqeoxEt1RBNimoORNu25UMqhO/q+W6M+wNdw1oghIxCuxVJ6pqCZ+7iPBQj9Nyos+P9HUZX96z2WBqs0LrPkZLFtsDnH1jmvMfLcwb9t9Edbm9Vd8GCS612RZj1A/6wrG1AyAY2CxFnWTMYP0QSS5787r6iOqXwaRJEx35JDBqu+/J3eTIwpAwZ34PT0SpPQWPEZyeFeJ/G8UIxqWIdcknA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=quicinc.com; dmarc=pass action=none header.from=quicinc.com; dkim=pass header.d=quicinc.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=qualcomm.onmicrosoft.com; s=selector1-qualcomm-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=OeA5/UkwlJZRKpIC3EW9w9mTody8GONHY+eJaj22f20=; b=DRyyvEzIQEPkotrn98CTfUGEXq++MzdHOuvoQBsXKFfz4mDmFUBJcqZiKvilaQOGFe+xh9rgnCkYJq/zDI1QUyxw2e4wmqPMRmrJ3FmsEDkTD0awLQbN7oV3b2CgEP08vw1gnybK3H1rh8/yNmZvEU2LYxp94fyII1ytRC6YrWM= Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=steplong@quicinc.com; From: Stephen Long To: Subject: [PATCH RFC v3 2/3] target/arm: Implement SVE2 AESE, AESD, SM4E Date: Mon, 27 Apr 2020 14:40:45 -0700 Message-ID: <20200427214046.31401-3-steplong@quicinc.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20200427214046.31401-1-steplong@quicinc.com> References: <20200427214046.31401-1-steplong@quicinc.com> X-ClientProxiedBy: MN2PR12CA0014.namprd12.prod.outlook.com (2603:10b6:208:a8::27) To MWHPR0201MB3547.namprd02.prod.outlook.com (2603:10b6:301:7b::24) MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 X-Mailer: git-send-email 2.17.1 X-Originating-IP: [108.176.222.2] X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 0140f95c-6b70-4388-b54c-08d7eaf3afea X-MS-TrafficTypeDiagnostic: MWHPR0201MB3577: X-MS-Exchange-Transport-Forked: True X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:32; X-Forefront-PRVS: 0386B406AA X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:MWHPR0201MB3547.namprd02.prod.outlook.com; PTR:; CAT:NONE; SFTY:; SFS:(39860400002)(376002)(366004)(346002)(396003)(136003)(6666004)(2616005)(478600001)(36756003)(6512007)(107886003)(66556008)(2906002)(66946007)(6486002)(66476007)(4326008)(316002)(1076003)(86362001)(6506007)(8936002)(81156014)(26005)(8676002)(16526019)(956004)(186003)(52116002)(5660300002)(6916009)(32563001); DIR:OUT; SFP:1102; X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: kl6+GI1+/+dU7TRz8xNTGHDIsrK8ctPFeUxOy634q11GAxh6avm/Rzp1vPrC/BYhA8eoPXF4MAAT3I6YTEfZwYfSXa7tc5RBMC2lkzl5z4damBEKG0H6FfAHaVqBYjzbtpxrpaE4vA3g7Ot0SVTjUhX+EsUFUYERQzlT3832tCNOCOnyjNWD7+z+zz8TIVOEXBu2FdhkF86sSSJuJ+RylOmdS2+SqtH0B2YsiF698JEWDrgxS1rZogPH+vZuPzrhVC7iybGSaid6kIx8eqNgLuesOgfmwY/hKIHXwxjotbBTK7BPoS60YuZ5ZNeXCGsrN73GKQnyjCftecshQootlCptXTZkCfjT7i6ssaFqCH6jzLvqgDjwNthCmv8tw3EuAH0zu6wL9+/8VT7iut8NBjuhShGnJeve1yVxOO7/Ho0coyTHaYH5FdTgGITk3GtD8B7qHNlq5HrgNjmi1KBN9Sv8Cw0Gg57m9jYsJ49hpFk= X-MS-Exchange-AntiSpam-MessageData: /tiRtikNN6YOH9ezUZo4+PnrAW3hQJZiHB6AxHgAYUeR8yn/bMXu79yA2L6jcI/qOaO5D11Rvb4mAqd673C9CASHWUjJsoYWDq+RCIpklWihlIVdz4/psJpD/ivTdicDCwQErkJNS+tepLv6lUg0lAzZxeY9coUxW6oFrvRnrRBPvZu8A+aZXGuFuFBjEctydS8vGCOIc6CaYGTXA32YAHln5t/VOVUc5MU6IbwbXd/q9bpYVxipfQpgAErnD8ZAQaO05r1q0V0DZxSeNlt2eInkBXTFJrn45DPGhA1LlKI5pGymrZ7CSjR28xkcFg0V0a/+NlAYQ/pOCv1KK7q9fk6bqpCHq939dNjf7BrtpOeDrlGfCnIhNnePY2UWbOVNdVCLFVz8cVnq9RTrdOCJ+AWxM73ut7XujhUBJKcjGf1XBHHf4U854Rj+Og9on7NwvlCl1RSacDs1tG601c3SDKYiymx8PIX+O6B0a7xZ47B1bcZpDrVoLpjmPhZxJvwgOAT7Cd4jbyCyVx3+6buOx2Y/cmMxeUmVSpLgqhgPMD5a6LQFNUYBfwOtsTiVbAq6GJeJJpFxIqrKGlQu6q4z2rUHcQqFLJWG6CCWgE6UWsF8H3qcNKUFVavhyUiGy90/BNrywqEhFefqHNFGx9ZqvO4v1yQ2MnNYc3JM6w4fu4M+9vN6jaRzCenLfMBxwGYLptBMo/12m69ngPVBp8/n/I+4CSUqNJSiOwbUAqQlU6fq63dLBZw1YE4v4ovN1UfQxgP+ye99qbmsqE0HMbuhrhD1fEzyFvRT7EDhU158HH4= X-MS-Exchange-CrossTenant-Network-Message-Id: 0140f95c-6b70-4388-b54c-08d7eaf3afea X-MS-Exchange-CrossTenant-OriginalArrivalTime: 27 Apr 2020 21:41:04.6830 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 98e9ba89-e1a1-4e38-9007-8bdabc25de1d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: XXkPpZbcNccONmKcxdBnRZuFk93eeawiyTQ8zEt06QSWK6sFgZCRzDlTuHV+UKLUuoW+xRjbPb+KX8l9a9Wz3w== X-MS-Exchange-Transport-CrossTenantHeadersStamped: MWHPR0201MB3577 X-OriginatorOrg: quicinc.com Received-SPF: pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; envelope-from=qemu-devel-bounces+importer=patchew.org@nongnu.org; helo=lists.gnu.org; Received-SPF: pass client-ip=199.106.114.38; envelope-from=steplong@quicinc.com; helo=alexa-out-sd-01.qualcomm.com X-detected-operating-system: by eggs.gnu.org: First seen = 2020/04/27 17:41:06 X-ACL-Warn: Detected OS = FreeBSD 9.x or newer [fuzzy] X-Received-From: 199.106.114.38 X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: qemu-arm@nongnu.org, richard.henderson@linaro.org, apazos@quicinc.com Errors-To: qemu-devel-bounces+importer=patchew.org@nongnu.org Sender: "Qemu-devel" X-ZohoMail-DKIM: pass (identity @qualcomm.onmicrosoft.com) Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="utf-8" Signed-off-by: Stephen Long --- target/arm/cpu.h | 5 +++++ target/arm/crypto_helper.c | 38 ++++++++++++++++++++++---------------- target/arm/helper-sve.h | 2 ++ target/arm/sve.decode | 6 ++++++ target/arm/sve_helper.c | 8 ++++++++ target/arm/translate-sve.c | 14 ++++++++++++++ 6 files changed, 57 insertions(+), 16 deletions(-) diff --git a/target/arm/cpu.h b/target/arm/cpu.h index d41c4a08c0..8b1dc38b9c 100644 --- a/target/arm/cpu.h +++ b/target/arm/cpu.h @@ -3880,6 +3880,11 @@ static inline bool isar_feature_aa64_sve2_f64mm(cons= t ARMISARegisters *id) return FIELD_EX64(id->id_aa64zfr0, ID_AA64ZFR0, F64MM) !=3D 0; } =20 +static inline bool isar_feature_aa64_sve2_sm4(const ARMISARegisters *id) +{ + return FIELD_EX64(id->id_aa64zfr0, ID_AA64ZFR0, SM4) !=3D 0; +} + /* * Feature tests for "does this exist in either 32-bit or 64-bit?" */ diff --git a/target/arm/crypto_helper.c b/target/arm/crypto_helper.c index ae2ea018af..45740c1bfd 100644 --- a/target/arm/crypto_helper.c +++ b/target/arm/crypto_helper.c @@ -30,29 +30,35 @@ union CRYPTO_STATE { #define CR_ST_WORD(state, i) (state.words[i]) #endif =20 -void HELPER(crypto_aese)(void *vd, void *vm, uint32_t decrypt) +void HELPER(crypto_aese)(void *vd, void *vm, uint32_t desc) { static uint8_t const * const sbox[2] =3D { AES_sbox, AES_isbox }; static uint8_t const * const shift[2] =3D { AES_shifts, AES_ishifts }; - uint64_t *rd =3D vd; - uint64_t *rm =3D vm; - union CRYPTO_STATE rk =3D { .l =3D { rm[0], rm[1] } }; - union CRYPTO_STATE st =3D { .l =3D { rd[0], rd[1] } }; - int i; =20 - assert(decrypt < 2); + intptr_t i, opr_sz =3D simd_oprsz(desc); + intptr_t decrypt =3D simd_data(desc); =20 - /* xor state vector with round key */ - rk.l[0] ^=3D st.l[0]; - rk.l[1] ^=3D st.l[1]; + for (i =3D 0; i < opr_sz; i +=3D 16) { + uint64_t *rd =3D vd + i; + uint64_t *rm =3D vm + i; + union CRYPTO_STATE rk =3D { .l =3D { rm[0], rm[1] } }; + union CRYPTO_STATE st =3D { .l =3D { rd[0], rd[1] } }; + int i; =20 - /* combine ShiftRows operation and sbox substitution */ - for (i =3D 0; i < 16; i++) { - CR_ST_BYTE(st, i) =3D sbox[decrypt][CR_ST_BYTE(rk, shift[decrypt][= i])]; - } + assert(decrypt < 2); + + /* xor state vector with round key */ + rk.l[0] ^=3D st.l[0]; + rk.l[1] ^=3D st.l[1]; + + /* combine ShiftRows operation and sbox substitution */ + for (i =3D 0; i < 16; i++) { + CR_ST_BYTE(st, i) =3D sbox[decrypt][CR_ST_BYTE(rk, shift[decry= pt][i])]; + } =20 - rd[0] =3D st.l[0]; - rd[1] =3D st.l[1]; + rd[0] =3D st.l[0]; + rd[1] =3D st.l[1]; + } } =20 void HELPER(crypto_aesmc)(void *vd, void *vm, uint32_t desc) diff --git a/target/arm/helper-sve.h b/target/arm/helper-sve.h index 51ad60e5c3..7eef4eb476 100644 --- a/target/arm/helper-sve.h +++ b/target/arm/helper-sve.h @@ -2690,3 +2690,5 @@ DEF_HELPER_FLAGS_5(sve2_sqrdcmlah_zzzz_d, TCG_CALL_NO= _RWG, =20 DEF_HELPER_FLAGS_6(fmmla_s, TCG_CALL_NO_RWG, void, ptr, ptr, ptr, ptr, ptr= , i32) DEF_HELPER_FLAGS_6(fmmla_d, TCG_CALL_NO_RWG, void, ptr, ptr, ptr, ptr, ptr= , i32) + +DEF_HELPER_FLAGS_3(sve2_sm4e, TCG_CALL_NO_RWG, void, ptr, ptr, i32) diff --git a/target/arm/sve.decode b/target/arm/sve.decode index f58eb04d11..1cb5792bb1 100644 --- a/target/arm/sve.decode +++ b/target/arm/sve.decode @@ -98,6 +98,7 @@ =20 # Two operand with unused vector element size @pd_pn_e0 ........ ........ ....... rn:4 . rd:4 &rr_esz es= z=3D0 +@pd5_pn5_e0 ........ ........ ...... rn:5 rd:5 &rr_esz es= z=3D0 =20 # Two operand @pd_pn ........ esz:2 .. .... ....... rn:4 . rd:4 &rr_esz @@ -1429,3 +1430,8 @@ STNT1_zprz 1110010 .. 10 ..... 001 ... ..... ...= .. \ ## SVE2 crypto unary operations AESMC 01000101 00 10000011100 0 00000 ..... @rdn_e0 AESIMC 01000101 00 10000011100 1 00000 ..... @rdn_e0 + +## SVE2 crpyto destructive binary operations +AESE 01000101 00 10001 0 11100 0 ..... ..... @pd5_pn5_e0 +AESD 01000101 00 10001 0 11100 1 ..... ..... @pd5_pn5_e0 +SM4E 01000101 00 10001 1 11100 0 ..... ..... @pd5_pn5_e0 diff --git a/target/arm/sve_helper.c b/target/arm/sve_helper.c index cd5c6f7fb0..b3a7594981 100644 --- a/target/arm/sve_helper.c +++ b/target/arm/sve_helper.c @@ -7516,3 +7516,11 @@ void HELPER(fmmla_d)(void *vd, void *va, void *vn, v= oid *vm, d[3] =3D float64_add(a[3], float64_add(p0, p1, status), status); } } + +void HELPER(sve2_sm4e)(void *vd, void *vn, uint32_t desc) +{ + intptr_t i, opr_sz =3D simd_oprsz(desc); + for (i =3D 0; i < opr_sz; i +=3D 16) { + HELPER(crypto_sm4e)(vd + i, vn + i); + } +} diff --git a/target/arm/translate-sve.c b/target/arm/translate-sve.c index 6523621d21..4253955471 100644 --- a/target/arm/translate-sve.c +++ b/target/arm/translate-sve.c @@ -7976,3 +7976,17 @@ DO_SVE2_AES_CRYPTO(AESMC, aesmc, 0) DO_SVE2_AES_CRYPTO(AESIMC, aesmc, 1) DO_SVE2_AES_CRYPTO(AESE, aese, 0) DO_SVE2_AES_CRYPTO(AESD, aese, 1) + +static bool trans_SM4E(DisasContext *s, arg_rr_esz *a) +{ + if (!dc_isar_feature(aa64_sve2_sm4, s)) { + return false; + } + if (sve_access_check(s)) { + unsigned vsz =3D vec_full_reg_size(s); + tcg_gen_gvec_2_ool(vec_full_reg_offset(s, a->rd), + vec_full_reg_offset(s, a->rn), + vsz, vsz, 0, gen_helper_sve2_sm4e); + } + return true; +} --=20 2.17.1 From nobody Fri Nov 14 12:16:52 2025 Delivered-To: importer@patchew.org Authentication-Results: mx.zohomail.com; dkim=pass header.i=@quicinc.com; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; arc=pass (i=1dmarc=pass fromdomain=quicinc.com); dmarc=pass(p=none dis=none) header.from=quicinc.com ARC-Seal: i=2; a=rsa-sha256; t=1588023791; cv=pass; d=zohomail.com; s=zohoarc; b=N2HLrSIisX7ZyiqoiZxXvRzKon8MCp/ngDaefZKBgOlVJz9fGh36otvnEM+8EmtibuMxx219QHmi4ONThhVT0PkfdlG6CkvbDOI5gl6f96b+QZyUeX+T0UGeWasGMpbzP32lUVKbwr4s+JKxVhDQjOt3432Ej2s7VWAf5m2wC+k= ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1588023791; h=Content-Type:Cc:Date:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Archive:List-Help:List-Unsubscribe:MIME-Version:Message-ID:References:Sender:Subject:To; bh=GCfjUJiBIpgM03wVzwpqm4VIMtdKavH/mALDd28rSfU=; b=V4HVsIHV+qMqTB6NO99i2ushccvGGcyR9THduDhW7Nv76+m+NK07O8GTr0qz6EFcstfJuZj6tqF7K1N+39hp7pVFDhePpgkr77krkwkXOBJ7dV7MIvP1JO01w/H6X8XD75ekoSmltbkviOdDQHThX9bSnDEQSZ3Kx/7ovuPSQM0= ARC-Authentication-Results: i=2; mx.zohomail.com; dkim=pass header.i=@quicinc.com; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; arc=pass (i=1dmarc=pass fromdomain=quicinc.com); dmarc=pass header.from= (p=none dis=none) header.from= Return-Path: Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) by mx.zohomail.com with SMTPS id 1588023791132379.6581846399282; Mon, 27 Apr 2020 14:43:11 -0700 (PDT) Received: from localhost ([::1]:34458 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jTBWv-0001fC-Hi for importer@patchew.org; Mon, 27 Apr 2020 17:43:09 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:33218) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jTBV6-0006tX-Nk for qemu-devel@nongnu.org; Mon, 27 Apr 2020 17:41:18 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.90_1) (envelope-from ) id 1jTBV4-0003Zl-SG for qemu-devel@nongnu.org; Mon, 27 Apr 2020 17:41:16 -0400 Received: from alexa-out-sd-01.qualcomm.com ([199.106.114.38]:18991) by eggs.gnu.org with esmtps (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.90_1) (envelope-from ) id 1jTBV2-0003YO-Sf; Mon, 27 Apr 2020 17:41:14 -0400 Received: from unknown (HELO ironmsg01-sd.qualcomm.com) ([10.53.140.141]) by alexa-out-sd-01.qualcomm.com with ESMTP; 27 Apr 2020 14:41:10 -0700 Received: from nasanexm03a.na.qualcomm.com ([10.85.0.103]) by ironmsg01-sd.qualcomm.com with ESMTP/TLS/AES256-SHA; 27 Apr 2020 14:41:10 -0700 Received: from APSANEXR01F.ap.qualcomm.com (10.85.0.39) by nasanexm03a.na.qualcomm.com (10.85.0.103) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Mon, 27 Apr 2020 14:41:10 -0700 Received: from NASANEXM01H.na.qualcomm.com (10.85.0.34) by APSANEXR01F.ap.qualcomm.com (10.85.0.39) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Mon, 27 Apr 2020 14:41:06 -0700 Received: from NAM10-MW2-obe.outbound.protection.outlook.com (199.106.107.6) by NASANEXM01H.na.qualcomm.com (10.85.0.34) with Microsoft SMTP Server (TLS) id 15.0.1497.2 via Frontend Transport; Mon, 27 Apr 2020 14:41:06 -0700 Received: from MWHPR0201MB3547.namprd02.prod.outlook.com (2603:10b6:301:7b::24) by MWHPR0201MB3577.namprd02.prod.outlook.com (2603:10b6:301:76::19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2937.22; Mon, 27 Apr 2020 21:41:06 +0000 Received: from MWHPR0201MB3547.namprd02.prod.outlook.com ([fe80::10ad:5df5:d575:1f37]) by MWHPR0201MB3547.namprd02.prod.outlook.com ([fe80::10ad:5df5:d575:1f37%3]) with mapi id 15.20.2937.023; Mon, 27 Apr 2020 21:41:06 +0000 Received: from STEPLONG.qualcomm.com (108.176.222.2) by MN2PR12CA0014.namprd12.prod.outlook.com (2603:10b6:208:a8::27) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2937.13 via Frontend Transport; Mon, 27 Apr 2020 21:41:04 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=quicinc.com; i=@quicinc.com; q=dns/txt; s=qcdkim; t=1588023672; x=1619559672; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version; bh=aoQf92eHwqYMv8cxGNlQBVaqX3vePWiIEIionsrUU3I=; b=cnIBnEruXw0ITRfITyDAU9U+FUiAx7KGzzpvzNlnAFZXSJPsN9tJQbJc prjPpheAbhRHoAGeDyg5shChqvpis270EC1nqewoGIVXbKVI2KIOZtMr+ We1mylwtd5ytanNjxPVkUiC/K8ghUe3hpyiwA1YCT/ccS8JDH5L6P9p0y c=; ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=laqgWYJl3eCB+2+hHLhOrnfabsI87wKNEKNOPeOVGhQclAh4kiDADkJl1F43GK9PErEtwmPT01Lyh2oZgumEHTuPG8D10VqHSsAzjWrdydmqUvE1Ch8jF928KHeNWkC49ebHENO9E1nICleam0R25OFN1XUU0QfktK5FGfta6Co1yy5vUmi2iOdyVmVe+4CfycLshSd0Eg+51e5y8HNepWD7rMH3wYYLvw3D5jNDnRwYMqBFgftKuhZMXtSGNz+D2CjnWrFicA4Mm/Kmc9MPmQtfU8jFwPEbOPE4DsIeg0jIKCnkLAEjhBkDrXsVpJzVSZCC5yVK1dlWVbq/FECh/A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=GCfjUJiBIpgM03wVzwpqm4VIMtdKavH/mALDd28rSfU=; b=PrPXf+n2q5QYgzShHnFIYid0R0KaoS3vAPece3/Eg2y/ZFto/CSPGwtlFY4PafjRygdgON1/Uz9DUzYFN+to8d6oc7G5mXjhWnpTJpRItJkLbgc4z9P/LquDaIRewfh+d4Q3GGxCDWtinuzaXWjaXi10clxmmpWTF4rq2Af1VUtQ5sF20tJhDfUF8ZL+Cu+dpognM+LOAGWBV/ecrCPS6+xQiLByvdbMR/X+SWS1xdd0sLH4QWMEkGkXQHpXmEu7vKU812RPCNnLP1/Q3mCaML9w1VSNqQQbLeGydPpAjG7o4UJLc7988dYz03F/DsJZSuJqfgTQNXZiMTI3ejPPUg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=quicinc.com; dmarc=pass action=none header.from=quicinc.com; dkim=pass header.d=quicinc.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=qualcomm.onmicrosoft.com; s=selector1-qualcomm-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=GCfjUJiBIpgM03wVzwpqm4VIMtdKavH/mALDd28rSfU=; b=WYrc+TnTZcUZvMGVzp7/iswKgiMUNu3FWFoS0oQtdUf8e4992btFzOv4ajyLb1/5n2Gbln1eUuWMGrv3FWX33RiULMdNFx+U5tJckFeqHyuij+GABr/m9QfbqDDZkrAy88OyllSrYJiWFK8re+2H9MwBfFEGIdmCx93+8manx9s= Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=steplong@quicinc.com; From: Stephen Long To: Subject: [PATCH RFC v3 3/3] target/arm: Implement SVE2 SM4EKEY, RAX1 Date: Mon, 27 Apr 2020 14:40:46 -0700 Message-ID: <20200427214046.31401-4-steplong@quicinc.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20200427214046.31401-1-steplong@quicinc.com> References: <20200427214046.31401-1-steplong@quicinc.com> X-ClientProxiedBy: MN2PR12CA0014.namprd12.prod.outlook.com (2603:10b6:208:a8::27) To MWHPR0201MB3547.namprd02.prod.outlook.com (2603:10b6:301:7b::24) MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 X-Mailer: git-send-email 2.17.1 X-Originating-IP: [108.176.222.2] X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 741754b0-e3d6-4865-2000-08d7eaf3b0b8 X-MS-TrafficTypeDiagnostic: MWHPR0201MB3577: X-MS-Exchange-Transport-Forked: True X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:28; X-Forefront-PRVS: 0386B406AA X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:MWHPR0201MB3547.namprd02.prod.outlook.com; PTR:; CAT:NONE; SFTY:; SFS:(39860400002)(376002)(366004)(346002)(396003)(136003)(6666004)(2616005)(478600001)(36756003)(6512007)(107886003)(66556008)(2906002)(66946007)(6486002)(66476007)(4326008)(316002)(1076003)(86362001)(6506007)(8936002)(81156014)(26005)(8676002)(16526019)(956004)(186003)(52116002)(5660300002)(6916009)(32563001); DIR:OUT; SFP:1102; X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: TjRIhQxQMt8GCj1fNKR9TXa5Iu0mNhcHo8QjzeObsMb8m+pZIxa46Nlmc4us7DvDF9oQL4A13nZIOg1eSSy+J4excPO7h082TGzuiCc0hwV+aNbGXKaJGjF9Ql7WFkzpLAo2Bw/A0C84GaJewbFL41sQD952YP+O6Jmg46aMcWrMziGVAxtrsvwxt14U+NEHL2cruh+zjoo1Kgxo1xi/wuXeDMDM9cF7DaJrfQEzGSyfCehvRtuH7M1avoNoBY5OralCTyd8eJTfuSNhiFmYm+7ttofl0dN9ehEukZHORcUZ1QN2Ead9/sluWIlZRUb8nigCh2LuMzlXrUmo3LEFdl+50RbDns0tgKKsOXsqoUwj15V676BuHbQo1D+QTMZiVhU+cFVBkR82jbojXRIn33Zr7fV/1gD5DfIizlBohReYNFOC8LWo6xY8fiNzhNX+nf658yxbXI+DsZ/tXyfOl8EieXj+vpxNJbAYMQeavJ9dXiIKoTmfVt79GDM9XM7s X-MS-Exchange-AntiSpam-MessageData: oxf7ZMpklpO/3gp7w9MpdNVftj2hSi089eMJCKF8j1FJcnzPlGs+6WF1IfrIX2A7h0iAib+J6pkZ8if93wCDG8e5I5zG8QeZzbiZFVFxvktEUIwADdD9W3lV4KVontFm0N0NLNB/W2ddoqPekfDW8hVybUd0z7oDLyJosz4HDiKx4CkURq7O7DBSVAt4kn/VAmkCZcgNunnctwKfgZ5XEcKrAEjHkoYCFvUbeWvSvbt2EU2HmRXgOtvhBRSAQbj9LpHxYYqQQ4oXeusJvkh4uissbBtYDxTI/KTGSn2Jpdm8OM8+rDtDCk9t8NRoZT9kHLDRWwONmuysFjrLOYseAq1MdGVqVhstt5pzKjSBwXiwnjSTz1n2IhebIVfhC/6RJ/urNdSa2fDfZO2bx0TpsbE4rHeVCKGUVzq1GZ6wSCNfXSt6jSHaQbQPitV/3lwGxr7VOYjkQnNu+sNuO0Kw1UDGZg4txeRHK4N+msZnmGEL+GN6ZI1MYxIoc/8w3t1d3wFRjwAA1rSe/4ymM+gJsT0HAq7VGaSxoeIpRqQnRl+SKKx3UmwMIMtDpUdE7G5N9WCn6+vcb5yg7pkLshAymHBxGaI0+kL2ii5uJrf7XCkfW/2fGBDjINpdSReDxkOuvlCmskFu++HSaKZxc124wfJnSCkJ2ipXiihAFo5C4GxTU68Qny9gYYA9NTDua2mugdULKvO5XmZsfuXeycmbjxl3x//nu6mkwDeK3nKljvRrS0F6NgARB90uSaU/kJmEPdRHDDUrs2G21OYL1yW0iIrm8tV4/cYxwu2M2qIGcmY= X-MS-Exchange-CrossTenant-Network-Message-Id: 741754b0-e3d6-4865-2000-08d7eaf3b0b8 X-MS-Exchange-CrossTenant-OriginalArrivalTime: 27 Apr 2020 21:41:06.1112 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 98e9ba89-e1a1-4e38-9007-8bdabc25de1d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: pEgrk+N6vt0P9ptrsg+0uFk01rzivsP3xFrNXX6ba5PmrJP36Xr6hITw0VPcI67/skc4BR8fpPkYDnHNca4mVA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: MWHPR0201MB3577 X-OriginatorOrg: quicinc.com Received-SPF: pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; envelope-from=qemu-devel-bounces+importer=patchew.org@nongnu.org; helo=lists.gnu.org; Received-SPF: pass client-ip=199.106.114.38; envelope-from=steplong@quicinc.com; helo=alexa-out-sd-01.qualcomm.com X-detected-operating-system: by eggs.gnu.org: First seen = 2020/04/27 17:41:06 X-ACL-Warn: Detected OS = FreeBSD 9.x or newer [fuzzy] X-Received-From: 199.106.114.38 X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: qemu-arm@nongnu.org, richard.henderson@linaro.org, apazos@quicinc.com Errors-To: qemu-devel-bounces+importer=patchew.org@nongnu.org Sender: "Qemu-devel" X-ZohoMail-DKIM: pass (identity @qualcomm.onmicrosoft.com) Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="utf-8" Signed-off-by: Stephen Long --- target/arm/crypto_helper.c | 12 ++++++++++++ target/arm/helper-sve.h | 1 + target/arm/helper.h | 2 ++ target/arm/sve.decode | 4 ++++ target/arm/sve_helper.c | 8 ++++++++ target/arm/translate-sve.c | 30 ++++++++++++++++++++++++++++++ 6 files changed, 57 insertions(+) diff --git a/target/arm/crypto_helper.c b/target/arm/crypto_helper.c index 45740c1bfd..0720b3b98f 100644 --- a/target/arm/crypto_helper.c +++ b/target/arm/crypto_helper.c @@ -705,3 +705,15 @@ void HELPER(crypto_sm4ekey)(void *vd, void *vn, void* = vm) rd[0] =3D d.l[0]; rd[1] =3D d.l[1]; } + +void HELPER(crypto_rax1)(void *vd, void *vn, void *vm, uint32_t desc) +{ + intptr_t i, opr_sz =3D simd_oprsz(desc) / 8; + uint64_t *d =3D vd, *n =3D vn, *m =3D vm; + + for (i =3D 0; i < opr_sz; ++i) { + uint64_t nn =3D n[i]; + uint64_t mm =3D m[i]; + d[i] =3D nn ^ rol64(mm, 1); + } +} diff --git a/target/arm/helper-sve.h b/target/arm/helper-sve.h index 7eef4eb476..059003c26e 100644 --- a/target/arm/helper-sve.h +++ b/target/arm/helper-sve.h @@ -2692,3 +2692,4 @@ DEF_HELPER_FLAGS_6(fmmla_s, TCG_CALL_NO_RWG, void, pt= r, ptr, ptr, ptr, ptr, i32) DEF_HELPER_FLAGS_6(fmmla_d, TCG_CALL_NO_RWG, void, ptr, ptr, ptr, ptr, ptr= , i32) =20 DEF_HELPER_FLAGS_3(sve2_sm4e, TCG_CALL_NO_RWG, void, ptr, ptr, i32) +DEF_HELPER_FLAGS_4(sve2_sm4ekey, TCG_CALL_NO_RWG, void, ptr, ptr, ptr, i32) diff --git a/target/arm/helper.h b/target/arm/helper.h index 37f489412c..c74cea76a2 100644 --- a/target/arm/helper.h +++ b/target/arm/helper.h @@ -537,6 +537,8 @@ DEF_HELPER_FLAGS_3(crypto_sm3partw2, TCG_CALL_NO_RWG, v= oid, ptr, ptr, ptr) DEF_HELPER_FLAGS_2(crypto_sm4e, TCG_CALL_NO_RWG, void, ptr, ptr) DEF_HELPER_FLAGS_3(crypto_sm4ekey, TCG_CALL_NO_RWG, void, ptr, ptr, ptr) =20 +DEF_HELPER_FLAGS_4(crypto_rax1, TCG_CALL_NO_RWG, void, ptr, ptr, ptr, i32) + DEF_HELPER_FLAGS_3(crc32, TCG_CALL_NO_RWG_SE, i32, i32, i32, i32) DEF_HELPER_FLAGS_3(crc32c, TCG_CALL_NO_RWG_SE, i32, i32, i32, i32) =20 diff --git a/target/arm/sve.decode b/target/arm/sve.decode index 1cb5792bb1..278530ca83 100644 --- a/target/arm/sve.decode +++ b/target/arm/sve.decode @@ -1435,3 +1435,7 @@ AESIMC 01000101 00 10000011100 1 00000 .....= @rdn_e0 AESE 01000101 00 10001 0 11100 0 ..... ..... @pd5_pn5_e0 AESD 01000101 00 10001 0 11100 1 ..... ..... @pd5_pn5_e0 SM4E 01000101 00 10001 1 11100 0 ..... ..... @pd5_pn5_e0 + +## SVE2 crypto constructive binary operations +SM4EKEY 01000101 00 1 ..... 11110 0 ..... ..... @rd_rn_rm_e0 +RAX1 01000101 00 1 ..... 11110 1 ..... ..... @rd_rn_rm_e0 diff --git a/target/arm/sve_helper.c b/target/arm/sve_helper.c index b3a7594981..3b560e702a 100644 --- a/target/arm/sve_helper.c +++ b/target/arm/sve_helper.c @@ -7524,3 +7524,11 @@ void HELPER(sve2_sm4e)(void *vd, void *vn, uint32_t = desc) HELPER(crypto_sm4e)(vd + i, vn + i); } } + +void HELPER(sve2_sm4ekey)(void *vd, void *vn, void *vm, uint32_t desc) +{ + intptr_t i, opr_sz =3D simd_oprsz(desc); + for (i =3D 0; i < opr_sz; i +=3D 16) { + HELPER(crypto_sm4ekey)(vd + i, vn + i, vm + i); + } +} diff --git a/target/arm/translate-sve.c b/target/arm/translate-sve.c index 4253955471..affe41779b 100644 --- a/target/arm/translate-sve.c +++ b/target/arm/translate-sve.c @@ -7990,3 +7990,33 @@ static bool trans_SM4E(DisasContext *s, arg_rr_esz *= a) } return true; } + +static bool trans_SM4EKEY(DisasContext *s, arg_rrr_esz *a) +{ + if (!dc_isar_feature(aa64_sve2_sm4, s)) { + return false; + } + if (sve_access_check(s)) { + unsigned vsz =3D vec_full_reg_size(s); + tcg_gen_gvec_3_ool(vec_full_reg_offset(s, a->rd), + vec_full_reg_offset(s, a->rn), + vec_full_reg_offset(s, a->rm), + vsz, vsz, 0, gen_helper_sve2_sm4ekey); + } + return true; +} + +static bool trans_RAX1(DisasContext *s, arg_rrr_esz *a) +{ + if (!dc_isar_feature(aa64_sve2_sm4, s)) { + return false; + } + if (sve_access_check(s)) { + unsigned vsz =3D vec_full_reg_size(s); + tcg_gen_gvec_3_ool(vec_full_reg_offset(s, a->rd), + vec_full_reg_offset(s, a->rn), + vec_full_reg_offset(s, a->rm), + vsz, vsz, 0, gen_helper_crypto_rax1); + } + return true; +} --=20 2.17.1