From nobody Fri Nov 14 16:50:37 2025 Delivered-To: importer@patchew.org Authentication-Results: mx.zohomail.com; dkim=pass; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; dmarc=pass(p=quarantine dis=none) header.from=redhat.com ARC-Seal: i=1; a=rsa-sha256; t=1760950518; cv=none; d=zohomail.com; s=zohoarc; b=C2DNSJ/Hltk3oHqKYSO3wn9z6G46QMGEiYzVgp43pC5UnnhcYrWQzCv6XRpKPPB10EJJDKyMXgZL2dT2SJMK9AlleHlot1Y6E02p5nlA0UQDGkvo/IDdR7cIRzq+jLB12HojVDGTLLB/j/65tKMkfqB1g9Q8V9jJIR22mGokTd0= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1760950518; h=Content-Transfer-Encoding:Cc:Cc:Date:Date:From:From:List-Subscribe:List-Post:List-Id:List-Archive:List-Help:List-Unsubscribe:MIME-Version:Message-ID:Sender:Subject:Subject:To:To:Message-Id:Reply-To; bh=O1N9QInq52Rbjr0nA9tnuHakpsGPPATamIrihiZF08w=; b=KGfduAYxC41pCdZy7gF3ZkBEBobFzIw7rx5YJeSsPEX++BfGIUpsKUUB40/ca1FdEgPc2q13tchbrNjJ4Y6bRmEL0XYmDUB5/EtaRZoDzSDYsULiSk3OTiW/+O+qWAFD8D2hSpgn7rE5aBFJez6oK+4Iah3wJHLQ0IH3Dj3cGN8= ARC-Authentication-Results: i=1; mx.zohomail.com; dkim=pass; spf=pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=qemu-devel-bounces+importer=patchew.org@nongnu.org; dmarc=pass header.from= (p=quarantine dis=none) Return-Path: Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) by mx.zohomail.com with SMTPS id 1760950518708433.03893168889306; Mon, 20 Oct 2025 01:55:18 -0700 (PDT) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1vAlfQ-0005d5-JJ; Mon, 20 Oct 2025 04:55:00 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1vAlfO-0005bz-BK for qemu-devel@nongnu.org; Mon, 20 Oct 2025 04:54:58 -0400 Received: from us-smtp-delivery-124.mimecast.com ([170.10.129.124]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1vAlfI-0002m0-1n for qemu-devel@nongnu.org; Mon, 20 Oct 2025 04:54:58 -0400 Received: from mx-prod-mc-08.mail-002.prod.us-west-2.aws.redhat.com (ec2-35-165-154-97.us-west-2.compute.amazonaws.com [35.165.154.97]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-85-iChkPPDiOdCetpC1j7ZCAw-1; Mon, 20 Oct 2025 04:54:38 -0400 Received: from mx-prod-int-08.mail-002.prod.us-west-2.aws.redhat.com (mx-prod-int-08.mail-002.prod.us-west-2.aws.redhat.com [10.30.177.111]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by mx-prod-mc-08.mail-002.prod.us-west-2.aws.redhat.com (Postfix) with ESMTPS id 33C431805C04; Mon, 20 Oct 2025 08:54:36 +0000 (UTC) Received: from thuth-p1g4.redhat.com (unknown [10.45.224.18]) by mx-prod-int-08.mail-002.prod.us-west-2.aws.redhat.com (Postfix) with ESMTP id 8CE8C1800589; Mon, 20 Oct 2025 08:54:32 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1760950488; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version: content-transfer-encoding:content-transfer-encoding; bh=O1N9QInq52Rbjr0nA9tnuHakpsGPPATamIrihiZF08w=; b=c456EXYU2anVFC29li2MaiIr4kdvwixuCnm+x5FJr92KIh6lxlMYuxSffO//bLVS44w4dy QYzRbOXgJxZGWOnRzR93z2zW1DIH1b0zQU7TntTJv/ij1K4HBcNyjGJPv4YlF08BZmuMRs 0IVVqZDof/dFgmJmsfqR4C5axxdFRcs= X-MC-Unique: iChkPPDiOdCetpC1j7ZCAw-1 X-Mimecast-MFC-AGG-ID: iChkPPDiOdCetpC1j7ZCAw_1760950477 From: Thomas Huth To: qemu-devel@nongnu.org, =?UTF-8?q?Alex=20Benn=C3=A9e?= , Yonggang Luo Cc: =?UTF-8?q?Philippe=20Mathieu-Daud=C3=A9?= , Peter Maydell , =?UTF-8?q?Daniel=20P=20=2E=20Berrang=C3=A9?= Subject: [PATCH] gitlab-ci: Decrease the size of the compiler cache Date: Mon, 20 Oct 2025 10:54:31 +0200 Message-ID: <20251020085431.23968-1-thuth@redhat.com> MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable X-Scanned-By: MIMEDefang 3.4.1 on 10.30.177.111 Received-SPF: pass (zohomail.com: domain of gnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; envelope-from=qemu-devel-bounces+importer=patchew.org@nongnu.org; helo=lists.gnu.org; Received-SPF: pass client-ip=170.10.129.124; envelope-from=thuth@redhat.com; helo=us-smtp-delivery-124.mimecast.com X-Spam_score_int: -16 X-Spam_score: -1.7 X-Spam_bar: - X-Spam_report: (-1.7 / 5.0 requ) BAYES_00=-1.9, DKIM_INVALID=0.1, DKIM_SIGNED=0.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001, RCVD_IN_VALIDITY_SAFE_BLOCKED=0.001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001 autolearn=no autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: qemu-devel-bounces+importer=patchew.org@nongnu.org Sender: qemu-devel-bounces+importer=patchew.org@nongnu.org X-ZohoMail-DKIM: pass (identity @redhat.com) X-ZM-MESSAGEID: 1760950524564158500 Content-Type: text/plain; charset="utf-8" From: Thomas Huth Uploading the cache from the runner takes a long time in the MSYS2 job, mostly due to the size of the compiler cache. However, looking at runs with a non-initialized cache, and by doing a "du -sh ." in the build directory, it seems like a build only takes about 236 MiB of data, so the compiler cache with 500 MiB certainly contains a lot of stale files. Thus decrease the size of the ccache to a more reasonable value to speed up the MSYS2 job in our CI (and add a "du -sh" at the end to have a reference for the required cache size in the future). Signed-off-by: Thomas Huth Reviewed-by: Philippe Mathieu-Daud=C3=A9 --- Looking at the latest runs in the CI, our recent attempt to decrease the cache size by cleaning the pacman cache did not help much: https://gitlab.com/qemu-project/qemu/-/jobs/11747329283 ... that run contains the "pacman -Sc" command, but the "Saving cache for successful job" step at the end still takes close to 20 minutes. So we likely have to shrink the compiler cache, too. In this run here: https://gitlab.com/thuth/qemu/-/jobs/11770708859#L1769 I added a "du -sh" and you can see that the build directory only takes 236 MB there. So a ccache with the size of 250M should be sufficient for the MSYS2 job. .gitlab-ci.d/windows.yml | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/.gitlab-ci.d/windows.yml b/.gitlab-ci.d/windows.yml index 6e1135d8b86..e2fef543899 100644 --- a/.gitlab-ci.d/windows.yml +++ b/.gitlab-ci.d/windows.yml @@ -94,7 +94,7 @@ msys2-64bit: - $env:MSYS =3D 'winsymlinks:native' # Enable native Windows symlink - $env:CCACHE_BASEDIR =3D "$env:CI_PROJECT_DIR" - $env:CCACHE_DIR =3D "$env:CCACHE_BASEDIR/ccache" - - $env:CCACHE_MAXSIZE =3D "500M" + - $env:CCACHE_MAXSIZE =3D "250M" - $env:CCACHE_DEPEND =3D 1 # cache misses are too expensive with preproc= essor mode - $env:CC =3D "ccache gcc" - mkdir build @@ -103,5 +103,6 @@ msys2-64bit: - ..\msys64\usr\bin\bash -lc "../configure $CONFIGURE_ARGS" - ..\msys64\usr\bin\bash -lc "make -j$env:JOBS" - ..\msys64\usr\bin\bash -lc "make check MTESTARGS=3D'$TEST_ARGS' || { c= at meson-logs/testlog.txt; exit 1; } ;" + - ..\msys64\usr\bin\bash -lc "du -sh ." - ..\msys64\usr\bin\bash -lc "ccache --show-stats" - Write-Output "Finished build at $(Get-Date -Format u)" --=20 2.51.0