From nobody Sun May 24 19:33:40 2026 Received: from mail-dy1-f202.google.com (mail-dy1-f202.google.com [74.125.82.202]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 2A9C43E1719 for ; Thu, 21 May 2026 17:55:39 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=74.125.82.202 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1779386142; cv=none; b=IuhXLM1NEVlL+fcz+AZwBU8F1EdJe7fM+eae6vMXsgrYrRMbUTz+io8WJZRzU6nQfqaYCCUueulseX6LzSammw9JFvp/G1SKcjF/HHmpE19kfUUmnMGleAld2OsZiviRJ4NV9DK6YPFhGoA1E8uortpxfCBH02vsjFyMt4CuskY= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1779386142; c=relaxed/simple; bh=PWE9Gdh37LLWr2tuhdLq7S0nam4hEYHuSpRBBLVwGH8=; h=Date:Mime-Version:Message-ID:Subject:From:To:Content-Type; b=NWPJOiFLPC895Ttud/t3CF4in2myvTg2ljX966LkeYAWd5XwGeLWxYiIQOEHbIKl3CcCCJ9pqdTSE9+k+dgS6p+1eDbxG7sEtVSDAy6y6rGIOJsA5MFiiYvpmZVXASqt4kjz3S0uMbpyHAeAUWK5vOC6Zy9N3mgfWH+khZK6Ly4= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=google.com; spf=pass smtp.mailfrom=flex--irogers.bounces.google.com; dkim=pass (2048-bit key) header.d=google.com header.i=@google.com header.b=IqvmpDlK; arc=none smtp.client-ip=74.125.82.202 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=google.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=flex--irogers.bounces.google.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=google.com header.i=@google.com header.b="IqvmpDlK" Received: by mail-dy1-f202.google.com with SMTP id 5a478bee46e88-2efc342ef15so8073690eec.1 for ; Thu, 21 May 2026 10:55:39 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20251104; t=1779386139; x=1779990939; darn=vger.kernel.org; h=to:from:subject:message-id:mime-version:date:from:to:cc:subject :date:message-id:reply-to; bh=OwJZ4rFsTmpxwL5qtXdjOZznkVLQwCVlL2xsNs7R4ac=; b=IqvmpDlK/jgf7Z+WIqA9PFOok65Yo6m9r82eXiUfmzgjZnSdZcKv3UORCsDUYAW1Lm Vw8w9h/C8VHmarok44C08i2HRTbB9hFnoj9DhubzZ2LN0vPQhJGOVcnasoo27BCFzuqM CoGyg6emUQYaDxMsmK6aICaKuJLBfIcuyEYJm/k0CnjKBaONOMP6aN3zEPXumM+S1kil nJOyNvMCzEJ2P6JxqQpzThggv2wvnBvSno0gJ8tnPBCpStWDJXQHFU6IQH/Zy2voK6UZ DoJ9kMcFwdRg2irSVlRCEMjMG9ONyF7Yzs46t3fwyswmRbFbktwktgqO0ea9cXH0iPaK o7aw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1779386139; x=1779990939; h=to:from:subject:message-id:mime-version:date:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=OwJZ4rFsTmpxwL5qtXdjOZznkVLQwCVlL2xsNs7R4ac=; b=cllKQRBkL33jiXHMQBM0csEnRyCsh6OMrFyVwq/IImKUhv6EB+2yaPeu1eGbjFaDNH uemtmW2HX9HFeKH05pEJwcKueZwy90uAYTzsyHBeESznIYuWNoRMMm2SkqkQWA/3nnvN R6/Rh+i7sSy+QEpmoqxc5rYzK5MjZoDetiKb59/7RO5SFm20zV8Jpq0XzgDhf7ENrhy1 Egh/qmF3l39brqoKEBObwEq58DufQ2WyNNpFjhB99awYKf9enPusJ7emb1D4g0SrwPHJ GvCq/Zvv2P9rG9wgSQcHY+VZJntCe1c0x3UQ5I/g+oVpCSfs14SYUZLeHjq6hUKFWKDu HvtA== X-Forwarded-Encrypted: i=1; AFNElJ8sdu6xDkAj7/PIyrGx/l7fRtXVUiOk73fr1HKiM+ri8qMzbOqkOSNSvjL1Q1mylZDaeDlRQYDyHvYRKMM=@vger.kernel.org X-Gm-Message-State: AOJu0YwdcWmoWbM+9w/lYFJvn9O/BLzuACWdpueybC1sQIMHEbQYuWfr TZ0crHXLgtg1mM+swIKPAEP0IgfLzDNdqXwuVlRVF7dfLFM9NX1gUKh98iAuqtuI82Z/ijghrtU vhdoHYeNGqg== X-Received: from dlbpk2.prod.google.com ([2002:a05:7022:3842:b0:134:ce13:c1a1]) (user=irogers job=prod-delivery.src-stubby-dispatcher) by 2002:a05:7300:6da7:b0:2f2:6dde:df50 with SMTP id 5a478bee46e88-30449054359mr112838eec.17.1779386138766; Thu, 21 May 2026 10:55:38 -0700 (PDT) Date: Thu, 21 May 2026 10:55:35 -0700 Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: Mime-Version: 1.0 X-Mailer: git-send-email 2.54.0.794.g4f17f83d09-goog Message-ID: <20260521175535.1531810-1-irogers@google.com> Subject: [PATCH v1] perf python: Clean up and restructure setup.py From: Ian Rogers To: Peter Zijlstra , Ingo Molnar , Arnaldo Carvalho de Melo , Namhyung Kim , Jiri Olsa , Ian Rogers , Adrian Hunter , James Clark , Leo Yan , linux-perf-users@vger.kernel.org, linux-kernel@vger.kernel.org Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="utf-8" Clean up and restructure the python setup script to resolve pylint warnings, improve code quality, and increase robustness and readability, targeting Python 3.9+ (the Linux kernel build minimum Python version). Changes: - Restructure the script to use a `main()` function as the entry point, leaving only imports, classes, and pure functions at module level. - Eliminate all global/module-level variables, making them local to `main()` or the respective classes/functions. - Make `clang_has_option` a pure function by passing all necessary parameters explicitly. - Extract clang compiler flag filtering into a new `filter_clang_options` helper function. This function uses a loop over a tuple of options, replacing ~30 lines of repetitive blocks and reducing branch/statement complexity in the main flow. - Cleanly define attributes in `__init__` for `BuildExt` and `InstallLib` and read environment variables dynamically within the methods, removing their dependency on global variables. - Replace legacy Popen with subprocess.run for safer process handling. - Use list-based flag filtering (split, filter, re-join) instead of regex `re.sub` substitutions on space-separated compiler flag strings. This avoids boundary bugs and safely handles flags with arguments (e.g. `-fcf-protection=3Dfull`). - Safely parse `CC` env var using `shlex.split` to handle quotes and pass compiler arguments as `list[str]` lists to helper functions, avoiding redundant string formatting and parsing. - Remove unused `import re`. - Rename setuptools command subclasses to PascalCase (BuildExt, InstallLib). - Add type annotations to functions and methods. - Add missing docstrings for module, functions, and classes. - Split long lines to adhere to standard limits. Assisted-by: Antigravity:gemini-3.5-flash Signed-off-by: Ian Rogers --- tools/perf/util/setup.py | 253 +++++++++++++++++++++++++-------------- 1 file changed, 166 insertions(+), 87 deletions(-) diff --git a/tools/perf/util/setup.py b/tools/perf/util/setup.py index b65b1792ca05..55ff7d8cba7e 100644 --- a/tools/perf/util/setup.py +++ b/tools/perf/util/setup.py @@ -1,108 +1,187 @@ -from os import getenv, path -from subprocess import Popen, PIPE -from re import sub +"""Setup script for perf python extension. + +This script is used to build and install the perf python binding. +It handles compiler-specific flags, especially for clang, and configures +the setuptools Extension. +""" + +import os import shlex +import subprocess +import sysconfig =20 -cc =3D getenv("CC") -assert cc, "Environment variable CC not set" +from setuptools import setup, Extension +from setuptools.command.build_ext import build_ext as _build_ext +from setuptools.command.install_lib import install_lib as _install_lib =20 -# Check if CC has options, as is the case in yocto, where it uses CC=3D"cc= --sysroot..." -cc_tokens =3D cc.split() -if len(cc_tokens) > 1: - cc =3D cc_tokens[0] - cc_options =3D " ".join([str(e) for e in cc_tokens[1:]]) + " " -else: - cc_options =3D "" =20 -# ignore optional stderr could be None as it is set to PIPE to avoid that. -# mypy: disable-error-code=3D"union-attr" -cc_is_clang =3D b"clang version" in Popen([cc, "-v"], stderr=3DPIPE).stder= r.readline() +def clang_has_option(cc: str, cc_args: list[str], src_feature_tests: str, = option: str) -> bool: + """Check if clang supports a specific option. =20 -srctree =3D getenv('srctree') -assert srctree, "Environment variable srctree, for the Linux sources, not = set" -src_feature_tests =3D f'{srctree}/tools/build/feature' + Args: + cc: The compiler executable. + cc_args: Compiler arguments from CC environment variable. + src_feature_tests: Path to the feature tests directory. + option: The compiler option to check (e.g., "-mcet"). =20 -def clang_has_option(option): + Returns: + True if the option is supported, False otherwise. + """ error_substrings =3D ( b"unknown argument", b"is not supported", b"unknown warning option" ) - cmd =3D shlex.split(f"{cc} {cc_options} {option}") + [ + cmd =3D [cc] + cc_args + [ + option, "-o", "/dev/null", - path.join(src_feature_tests, "test-hello.c") + os.path.join(src_feature_tests, "test-hello.c") ] - cc_output =3D Popen(cmd, stderr=3DPIPE).stderr.readlines() + try: + res =3D subprocess.run(cmd, stderr=3Dsubprocess.PIPE, stdout=3Dsub= process.DEVNULL, check=3DFalse) + cc_output =3D res.stderr.splitlines() + except OSError: + return False return not any(any(error in line for error in error_substrings) for li= ne in cc_output) =20 -if cc_is_clang: - from sysconfig import get_config_vars - vars =3D get_config_vars() + +def filter_clang_options(cc: str, cc_args: list[str], src_feature_tests: s= tr) -> None: + """Filter out unsupported clang options from sysconfig CFLAGS and OPT. + + Args: + cc: The compiler executable. + cc_args: Compiler arguments from CC environment variable. + src_feature_tests: Path to the feature tests directory. + """ + config_vars =3D sysconfig.get_config_vars() for var in ('CFLAGS', 'OPT'): - vars[var] =3D sub("-specs=3D[^ ]+", "", vars[var]) - if not clang_has_option("-mcet"): - vars[var] =3D sub("-mcet", "", vars[var]) - if not clang_has_option("-fcf-protection"): - vars[var] =3D sub("-fcf-protection", "", vars[var]) - if not clang_has_option("-fstack-clash-protection"): - vars[var] =3D sub("-fstack-clash-protection", "", vars[var]) - if not clang_has_option("-fstack-protector-strong"): - vars[var] =3D sub("-fstack-protector-strong", "", vars[var]) - if not clang_has_option("-fno-semantic-interposition"): - vars[var] =3D sub("-fno-semantic-interposition", "", vars[var]) - if not clang_has_option("-ffat-lto-objects"): - vars[var] =3D sub("-ffat-lto-objects", "", vars[var]) - if not clang_has_option("-ftree-loop-distribute-patterns"): - vars[var] =3D sub("-ftree-loop-distribute-patterns", "", vars[= var]) - if not clang_has_option("-gno-variable-location-views"): - vars[var] =3D sub("-gno-variable-location-views", "", vars[var= ]) + if var not in config_vars: + continue + + # Split into individual flags to avoid regex boundary issues + flags =3D config_vars[var].split() + + # Remove -specs=3D... + flags =3D [f for f in flags if not f.startswith("-specs=3D")] + + options =3D ( + "-mcet", + "-fcf-protection", + "-fstack-clash-protection", + "-fstack-protector-strong", + "-fno-semantic-interposition", + "-ffat-lto-objects", + "-ftree-loop-distribute-patterns", + "-gno-variable-location-views" + ) + for option in options: + if not clang_has_option(cc, cc_args, src_feature_tests, option= ): + # Remove the option and any variant (e.g. -option=3D...) + flags =3D [f for f in flags if not f.startswith(option)] + + # Re-join flags + config_vars[var] =3D " ".join(flags) + + +class BuildExt(_build_ext): + """Custom build_ext command to set output directories.""" + + def __init__(self, *args, **kwargs): + self.build_lib =3D None + self.build_temp =3D None + super().__init__(*args, **kwargs) + + def finalize_options(self) -> None: + _build_ext.finalize_options(self) + build_lib =3D os.getenv('PYTHON_EXTBUILD_LIB') + build_tmp =3D os.getenv('PYTHON_EXTBUILD_TMP') + if build_lib: + self.build_lib =3D build_lib + if build_tmp: + self.build_temp =3D build_tmp =20 -from setuptools import setup, Extension =20 -from setuptools.command.build_ext import build_ext as _build_ext -from setuptools.command.install_lib import install_lib as _install_lib +class InstallLib(_install_lib): + """Custom install_lib command to set output directory.""" =20 -class build_ext(_build_ext): - def finalize_options(self): - _build_ext.finalize_options(self) - self.build_lib =3D build_lib - self.build_temp =3D build_tmp + def __init__(self, *args, **kwargs): + self.build_dir =3D None + super().__init__(*args, **kwargs) =20 -class install_lib(_install_lib): - def finalize_options(self): + def finalize_options(self) -> None: _install_lib.finalize_options(self) - self.build_dir =3D build_lib - - -cflags =3D getenv('CFLAGS', '').split() -# switch off several checks (need to be at the end of cflags list) -cflags +=3D ['-fno-strict-aliasing', '-Wno-write-strings', '-Wno-unused-pa= rameter', '-Wno-redundant-decls' ] -if cc_is_clang: - cflags +=3D ["-Wno-unused-command-line-argument" ] - if clang_has_option("-Wno-cast-function-type-mismatch"): - cflags +=3D ["-Wno-cast-function-type-mismatch" ] -else: - cflags +=3D ['-Wno-cast-function-type' ] - -# The python headers have mixed code with declarations (decls after assert= s, for instance) -cflags +=3D [ "-Wno-declaration-after-statement" ] - -src_perf =3D f'{srctree}/tools/perf' -build_lib =3D getenv('PYTHON_EXTBUILD_LIB') -build_tmp =3D getenv('PYTHON_EXTBUILD_TMP') - -perf =3D Extension('perf', - sources =3D [ src_perf + '/util/python.c' ], - include_dirs =3D ['util/include'], - extra_compile_args =3D cflags, - ) - -setup(name=3D'perf', - version=3D'0.1', - description=3D'Interface with the Linux profiling infrastructure', - author=3D'Arnaldo Carvalho de Melo', - author_email=3D'acme@redhat.com', - license=3D'GPLv2', - url=3D'http://perf.wiki.kernel.org', - ext_modules=3D[perf], - cmdclass=3D{'build_ext': build_ext, 'install_lib': install_lib}) + build_lib =3D os.getenv('PYTHON_EXTBUILD_LIB') + if build_lib: + self.build_dir =3D build_lib + + +def main() -> None: + """Main entry point for the setup script.""" + cc_env =3D os.getenv("CC") + assert cc_env, "Environment variable CC not set" + + # Safe parsing of CC environment variable which might contain options/= quotes + cc_tokens =3D shlex.split(cc_env) + cc =3D cc_tokens[0] + cc_args =3D cc_tokens[1:] + + # Run CC -v to check if it is clang. + try: + cc_info =3D subprocess.run( + [cc, "-v"], stderr=3Dsubprocess.PIPE, stdout=3Dsubprocess.DEVN= ULL, check=3DFalse + ) + cc_is_clang =3D b"clang version" in cc_info.stderr + except OSError as e: + raise RuntimeError(f"Failed to execute compiler '{cc}': {e}") from= e + + srctree =3D os.getenv('srctree') + assert srctree, "Environment variable srctree, for the Linux sources, = not set" + src_feature_tests =3D f'{srctree}/tools/build/feature' + + if cc_is_clang: + filter_clang_options(cc, cc_args, src_feature_tests) + + cflags =3D os.getenv('CFLAGS', '').split() + # switch off several checks (need to be at the end of cflags list) + cflags +=3D [ + '-fno-strict-aliasing', + '-Wno-write-strings', + '-Wno-unused-parameter', + '-Wno-redundant-decls' + ] + if cc_is_clang: + cflags +=3D ["-Wno-unused-command-line-argument"] + if clang_has_option( + cc, cc_args, src_feature_tests, "-Wno-cast-function-type-misma= tch" + ): + cflags +=3D ["-Wno-cast-function-type-mismatch"] + else: + cflags +=3D ['-Wno-cast-function-type'] + + # The python headers have mixed code with declarations (decls after as= serts, for instance) + cflags +=3D ["-Wno-declaration-after-statement"] + + src_perf =3D f'{srctree}/tools/perf' + + perf =3D Extension( + 'perf', + sources=3D[os.path.join(src_perf, 'util/python.c')], + include_dirs=3D['util/include'], + extra_compile_args=3Dcflags, + ) + + setup( + name=3D'perf', + version=3D'0.1', + description=3D'Interface with the Linux profiling infrastructure', + author=3D'Arnaldo Carvalho de Melo', + author_email=3D'acme@redhat.com', + license=3D'GPLv2', + url=3D'http://perf.wiki.kernel.org', + ext_modules=3D[perf], + cmdclass=3D{'build_ext': BuildExt, 'install_lib': InstallLib}, + ) + + +if __name__ =3D=3D '__main__': + main() --=20 2.54.0.794.g4f17f83d09-goog