From nobody Sun Sep 28 15:24:53 2025 Delivered-To: importer@patchew.org Authentication-Results: mx.zohomail.com; dkim=pass; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; dmarc=pass(p=none dis=none) header.from=linaro.org ARC-Seal: i=1; a=rsa-sha256; t=1758893126; cv=none; d=zohomail.com; s=zohoarc; b=PgJZf2OFsfsu+jtO87zFssK2tzJb8/t0Qa5wHJU32oR05ytL7ZrOUE2r9ocdzi5cFg95UKmqoAtiag7IjdZnARqeOC/lZi7eAH3mUBfRulKNFfF/9FMrrwGLGrRskecpPd7LvnKA/Ph/5hFkiuHqEDqKj589PfgAsCsKFei0d48= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1758893126; h=Content-Type:Content-Transfer-Encoding:Cc:Cc:Date:Date:From:From:In-Reply-To:List-Subscribe:List-Post:List-Id:List-Archive:List-Help:List-Unsubscribe:MIME-Version:Message-ID:References:Sender:Subject:Subject:To:To:Message-Id:Reply-To; bh=jGF9SYUysCeSMvohomWtzEmgBAlqEy7LfikuuZCnSE8=; b=UYV2NpohQyKwCB6rMjsabPlFq9+qmjZ41Ym5EEwVnkI+8JccKjhlbUtc646n6GZgQVYu0pPYs1ojJLRHXEkM23z+t0z7zITXOyL7q8m9r0MjdeFErnct0nQqklIe2BVzPZC66uovdX5Z52L+AShqlXX3VgzT7R3Pu/8IXcJMz8A= ARC-Authentication-Results: i=1; mx.zohomail.com; dkim=pass; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; dmarc=pass header.from= (p=none dis=none) Return-Path: Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) by mx.zohomail.com with SMTPS id 1758893126512180.34269120370436; Fri, 26 Sep 2025 06:25:26 -0700 (PDT) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1v28Q9-0006QN-NT; Fri, 26 Sep 2025 09:23:33 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1v28Q2-0006NP-OF for qemu-devel@nongnu.org; Fri, 26 Sep 2025 09:23:26 -0400 Received: from mail-wm1-x329.google.com ([2a00:1450:4864:20::329]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1v28Pq-0004wW-Vd for qemu-devel@nongnu.org; Fri, 26 Sep 2025 09:23:26 -0400 Received: by mail-wm1-x329.google.com with SMTP id 5b1f17b1804b1-46c889b310dso17172595e9.0 for ; Fri, 26 Sep 2025 06:23:12 -0700 (PDT) Received: from draig.lan ([185.126.160.19]) by smtp.gmail.com with ESMTPSA id 5b1f17b1804b1-46e33fede76sm72062665e9.14.2025.09.26.06.23.02 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 26 Sep 2025 06:23:05 -0700 (PDT) Received: from draig.lan (localhost [IPv6:::1]) by draig.lan (Postfix) with ESMTP id E52535F93D; Fri, 26 Sep 2025 14:17:46 +0100 (BST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; t=1758892988; x=1759497788; darn=nongnu.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=jGF9SYUysCeSMvohomWtzEmgBAlqEy7LfikuuZCnSE8=; b=oVubruQpQzw9miH8k3GsIIFOAFWJXCeh9UgcIqcjupbosRjHDjAGHocnD7xfnTgPXl ERhjnnkpQqPoYVWlrG72UVxrstmExttVhsw7dKjnnC3w91AY6pWr7Hd2eZ6cziFsbct2 wCuE+pANbaRoScZcPcIZSuG+YQdwHTYtVXzMIUzND5stQNgxHoWHRxaYOfKvg1iynT+Q Qtq1V9z+94dqJYv/p7ZPac/jhtqE8r7GI0DS9zJdT3FS7JTQwJwb+jmSAAsTCEgKInvW JDtIYyBaP3zPU2f+/p/dcorMhMIOTSiPwIN9N/YOp7NsbPMjiONxyuHg/atMkp54EWh+ kheg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1758892988; x=1759497788; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=jGF9SYUysCeSMvohomWtzEmgBAlqEy7LfikuuZCnSE8=; b=l2H4YKqWFhS73nbtrbKc2tu0VFZGl8IzQzdd6S5uPzQsKtLnGFxX4ogfhz4dHYTiba HNsBfjqoWG8QXZEo0sNs08lmcS8lqzkayz2Mp/jvyNQG2cKzVd0HrxOuQjTdmS7ZL4g4 xFC2FjZvrL/BKNoQLHYNH29A8KnW+70r/hmt2/hTTCk6baT0gc8kEaibaHps+R3SO34m eiLhEu7hsBDpOkOBtWo2GrKoHlISqkVICT/B83dmXqWKqnh9CTzYbukqQXu87Yshv/lj l6CSE87gkrFRzejR2mcol3XKNwMvVomSeWSqkUOzIaXrYMYoUO/v/yFpYjqMKlHvk+/7 JwmQ== X-Gm-Message-State: AOJu0YzdXF8XT9Z1eBMJgRLB3oUbvGWq9KVRsYO/D2ZR98j47EsH/vQX Yg3lb/Ex4TpJAq3qxzyG17vRy08xxfWfnLhCYKHXXmUAI0Nrurg2X1dhZWdthqzaHwU= X-Gm-Gg: ASbGncvTRGGQhqBanHzm2VL4ST89Jq8EmxWf/LCcSCURtpj1cYrPS2fm6hDUzBWC72M k+ejgSRuthkjn5wdz3a3riJOrdkibRSGTHePz89/6h++sfGDVkSYSAd+IfAWH75jzjgyDEfNMZH b9oXAyMgQ1HK5Mca+Av0bGMHAjuq/FBOwvdTQNutsmy05XyvAPm7bRT47AEDhpEt2VcYwzYkqcv MSltKyH2CsA58ShdnAlS/ogIPnDMHUWBwlOQjrVYLta+hFQnj1tk69tNSuDEuzO/3RRPiVENdz+ qvtEtUX9cFdhrTBhZD8OLvfJ4v+A92l5JI93jA9HI631ybLbC6KFuo+cByju/g8bhy1L4luHF8F 5kz6uqLEYmL45laF/UUZUWxy6SVT3/9Wbmg== X-Google-Smtp-Source: AGHT+IEyGyWUW2/wdG0ovr9L6DM5NOfvi5exzft/R9C8jU7JhCsW8WP6MgkbSUZpiAWb1x3F0rYe/w== X-Received: by 2002:a05:600c:c05a:b0:46e:24a4:c247 with SMTP id 5b1f17b1804b1-46e33c37045mr51155205e9.5.1758892988038; Fri, 26 Sep 2025 06:23:08 -0700 (PDT) From: =?UTF-8?q?Alex=20Benn=C3=A9e?= To: qemu-devel@nongnu.org Cc: Pierrick Bouvier , =?UTF-8?q?Philippe=20Mathieu-Daud=C3=A9?= , =?UTF-8?q?Alex=20Benn=C3=A9e?= , Alexandre Iooss , Mahmoud Mandour Subject: [PULL 23/24] contrib/plugins/uftrace_symbols.py Date: Fri, 26 Sep 2025 14:17:42 +0100 Message-ID: <20250926131744.432185-24-alex.bennee@linaro.org> X-Mailer: git-send-email 2.47.3 In-Reply-To: <20250926131744.432185-1-alex.bennee@linaro.org> References: <20250926131744.432185-1-alex.bennee@linaro.org> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Received-SPF: pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; envelope-from=qemu-devel-bounces+importer=patchew.org@nongnu.org; helo=lists.gnu.org; Received-SPF: pass client-ip=2a00:1450:4864:20::329; envelope-from=alex.bennee@linaro.org; helo=mail-wm1-x329.google.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: qemu-devel-bounces+importer=patchew.org@nongnu.org Sender: qemu-devel-bounces+importer=patchew.org@nongnu.org X-ZohoMail-DKIM: pass (identity @linaro.org) X-ZM-MESSAGEID: 1758893129212116600 From: Pierrick Bouvier usage: contrib/plugins/uftrace_symbols.py \ --prefix-symbols \ arm-trusted-firmware/build/qemu/debug/bl1/bl1.elf \ arm-trusted-firmware/build/qemu/debug/bl2/bl2.elf \ arm-trusted-firmware/build/qemu/debug/bl31/bl31.elf \ u-boot/u-boot:0x60000000 \ u-boot/u-boot.relocated:0x000000023f6b6000 \ linux/vmlinux Will generate symbols and memory mapping files for uftrace, allowing to have an enhanced trace, instead of raw addresses. It takes a collection of elf files, and automatically find all their symbols, and generate an ordered memory map based on that. This script uses the python (native) pyelftools module. Reviewed-by: Philippe Mathieu-Daud=C3=A9 Signed-off-by: Pierrick Bouvier Acked-by: Alex Benn=C3=A9e Message-ID: <20250902075042.223990-9-pierrick.bouvier@linaro.org> Signed-off-by: Alex Benn=C3=A9e Message-ID: <20250922093711.2768983-25-alex.bennee@linaro.org> diff --git a/contrib/plugins/uftrace_symbols.py b/contrib/plugins/uftrace_s= ymbols.py new file mode 100755 index 00000000000..b49e03203c8 --- /dev/null +++ b/contrib/plugins/uftrace_symbols.py @@ -0,0 +1,152 @@ +#!/usr/bin/env python3 +# -*- coding: utf-8 -*- +# +# Create symbols and mapping files for uftrace. +# +# Copyright 2025 Linaro Ltd +# Author: Pierrick Bouvier +# +# SPDX-License-Identifier: GPL-2.0-or-later + +import argparse +import elftools # pip install pyelftools +import os + +from elftools.elf.elffile import ELFFile +from elftools.elf.sections import SymbolTableSection + +def elf_func_symbols(elf): + symbol_tables =3D [(idx, s) for idx, s in enumerate(elf.iter_sections(= )) + if isinstance(s, SymbolTableSection)] + symbols =3D [] + for _, section in symbol_tables: + for _, symbol in enumerate(section.iter_symbols()): + if symbol_size(symbol) =3D=3D 0: + continue + type =3D symbol['st_info']['type'] + if type =3D=3D 'STT_FUNC' or type =3D=3D 'STT_NOTYPE': + symbols.append(symbol) + symbols.sort(key =3D lambda x: symbol_addr(x)) + return symbols + +def symbol_size(symbol): + return symbol['st_size'] + +def symbol_addr(symbol): + addr =3D symbol['st_value'] + # clamp addr to 48 bits, like uftrace entries + return addr & 0xffffffffffff + +def symbol_name(symbol): + return symbol.name + +class BinaryFile: + def __init__(self, path, map_offset): + self.fullpath =3D os.path.realpath(path) + self.map_offset =3D map_offset + with open(path, 'rb') as f: + self.elf =3D ELFFile(f) + self.symbols =3D elf_func_symbols(self.elf) + + def path(self): + return self.fullpath + + def addr_start(self): + return self.map_offset + + def addr_end(self): + last_sym =3D self.symbols[-1] + return symbol_addr(last_sym) + symbol_size(last_sym) + self.map_of= fset + + def generate_symbol_file(self, prefix_symbols): + binary_name =3D os.path.basename(self.fullpath) + sym_file_path =3D f'./uftrace.data/{binary_name}.sym' + print(f'{sym_file_path} ({len(self.symbols)} symbols)') + with open(sym_file_path, 'w') as sym_file: + # print hexadecimal addresses on 48 bits + addrx =3D "0>12x" + for s in self.symbols: + addr =3D symbol_addr(s) + addr =3D f'{addr:{addrx}}' + size =3D f'{symbol_size(s):{addrx}}' + name =3D symbol_name(s) + if prefix_symbols: + name =3D f'{binary_name}:{name}' + print(addr, size, 'T', name, file=3Dsym_file) + +def parse_parameter(p): + s =3D p.split(":") + path =3D s[0] + if len(s) =3D=3D 1: + return path, 0 + if len(s) > 2: + raise ValueError('only one offset can be set') + offset =3D s[1] + if not offset.startswith('0x'): + err =3D f'offset "{offset}" is not an hexadecimal constant. ' + err +=3D 'It should starts with "0x".' + raise ValueError(err) + offset =3D int(offset, 16) + return path, offset + +def is_from_user_mode(map_file_path): + if os.path.exists(map_file_path): + with open(map_file_path, 'r') as map_file: + if not map_file.readline().startswith('# map stack on'): + return True + return False + +def generate_map(binaries): + map_file_path =3D './uftrace.data/sid-0.map' + + if is_from_user_mode(map_file_path): + print(f'do not overwrite {map_file_path} generated from qemu-user') + return + + mappings =3D [] + + # print hexadecimal addresses on 48 bits + addrx =3D "0>12x" + + mappings +=3D ['# map stack on highest address possible, to prevent uf= trace'] + mappings +=3D ['# from considering any kernel address'] + mappings +=3D ['ffffffffffff-ffffffffffff rw-p 00000000 00:00 0 [stack= ]'] + + for b in binaries: + m =3D f'{b.addr_start():{addrx}}-{b.addr_end():{addrx}}' + m +=3D f' r--p 00000000 00:00 0 {b.path()}' + mappings.append(m) + + with open(map_file_path, 'w') as map_file: + print('\n'.join(mappings), file=3Dmap_file) + print(f'{map_file_path}') + print('\n'.join(mappings)) + +def main(): + parser =3D argparse.ArgumentParser(description=3D + 'generate symbol files for uftrace') + parser.add_argument('elf_file', nargs=3D'+', + help=3D'path to an ELF file. ' + 'Use /path/to/file:0xdeadbeef to add a mapping off= set.') + parser.add_argument('--prefix-symbols', + help=3D'prepend binary name to symbols', + action=3Dargparse.BooleanOptionalAction) + args =3D parser.parse_args() + + if not os.path.exists('./uftrace.data'): + os.mkdir('./uftrace.data') + + binaries =3D [] + for file in args.elf_file: + path, offset =3D parse_parameter(file) + b =3D BinaryFile(path, offset) + binaries.append(b) + binaries.sort(key =3D lambda b: b.addr_end()); + + for b in binaries: + b.generate_symbol_file(args.prefix_symbols) + + generate_map(binaries) + +if __name__ =3D=3D '__main__': + main() --=20 2.47.3