From nobody Thu May 2 13:18:12 2024 Delivered-To: importer@patchew.org Received-SPF: pass (zohomail.com: domain of groups.io designates 66.175.222.12 as permitted sender) client-ip=66.175.222.12; envelope-from=bounce+27952+57878+1787277+3901457@groups.io; helo=web01.groups.io; Authentication-Results: mx.zohomail.com; dkim=pass; spf=pass (zohomail.com: domain of groups.io designates 66.175.222.12 as permitted sender) smtp.mailfrom=bounce+27952+57878+1787277+3901457@groups.io; dmarc=fail(p=none dis=none) header.from=intel.com ARC-Seal: i=1; a=rsa-sha256; t=1587591351; cv=none; d=zohomail.com; s=zohoarc; b=M2QlINFRhlZySKQY7goAs2wAnsZkKQsSMVpHIiXEG+l3STHxcbq1rUuq2MSynowtrrtAXY8Cs5WBboKGaqYNoyZcJykJg2nH0BF6//z6/HiAg/XRZwMEa0LmXc2xsHWtFXDIIANtm601hSvZSWHCA4geysJPHxTdKM6TfyAz2kU= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1587591351; h=Cc:Date:From:In-Reply-To:List-Id:List-Unsubscribe:Message-ID:Reply-To:References:Sender:Subject:To; bh=whNxPLkmlZqiSvF+Hfsj4DC1spXVmnXPTFvnNBL87UU=; b=FYcdelzAdaELslGtoIcg7MiygcXh9HneZd0cPXvoy1UH3TUtRYZ1zZEJAkCnNq8ci3xhRqTaISFR8z8In7qsugPzg/bGXPHlMLi2iw/NugkL2kJ1kK8VFXHlpnsEmigpcRQH8Onsr8h1fJPSDrdI9svhYjzMh5QwOv9mcKn4v+w= ARC-Authentication-Results: i=1; mx.zohomail.com; dkim=pass; spf=pass (zohomail.com: domain of groups.io designates 66.175.222.12 as permitted sender) smtp.mailfrom=bounce+27952+57878+1787277+3901457@groups.io; dmarc=fail header.from= (p=none dis=none) header.from= Received: from web01.groups.io (web01.groups.io [66.175.222.12]) by mx.zohomail.com with SMTPS id 1587591351915738.2278948850105; Wed, 22 Apr 2020 14:35:51 -0700 (PDT) Return-Path: X-Received: by 127.0.0.2 with SMTP id QUssYY1788612xWwpLHQmm6a; Wed, 22 Apr 2020 14:35:51 -0700 X-Received: from mga12.intel.com (mga12.intel.com []) by mx.groups.io with SMTP id smtpd.web10.3186.1587591349721322785 for ; Wed, 22 Apr 2020 14:35:51 -0700 IronPort-SDR: 4b3RTKVULYCzxWcC8xHceSUjuMeCW3VhhvIzoovvwKKuW5lS+U8uEIQ9PhHUx8DqtUDjozgt1O mkV73vgue+gw== X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False X-Received: from orsmga006.jf.intel.com ([10.7.209.51]) by fmsmga106.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 22 Apr 2020 14:35:48 -0700 IronPort-SDR: IPhWuY6/Y7yYLyGyCh9mZpo84G8lRtvGYI+hyv3BdkNKW1GloHR2F8jlJI8p7t6B7We3lcCtvw BFqlRRGqRt0w== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.73,304,1583222400"; d="scan'208";a="259211554" X-Received: from aedesimo-desk.amr.corp.intel.com ([10.7.159.171]) by orsmga006.jf.intel.com with ESMTP; 22 Apr 2020 14:35:47 -0700 From: "Ashley E Desimone" To: devel@edk2.groups.io Cc: Nate DeSimone , Puja Pandya , Erik Bjorge , Bret Barkelew , Prince Agyeman Subject: [edk2-devel] [edk2-staging/EdkRepo] [PATCH V2 1/3] EdkRepo: Initial commit of workspace_maitenance.py Date: Wed, 22 Apr 2020 14:35:21 -0700 Message-Id: <20200422213523.44888-2-ashley.e.desimone@intel.com> In-Reply-To: <20200422213523.44888-1-ashley.e.desimone@intel.com> References: <20200422213523.44888-1-ashley.e.desimone@intel.com> Precedence: Bulk List-Unsubscribe: Sender: devel@edk2.groups.io List-Id: Mailing-List: list devel@edk2.groups.io; contact devel+owner@edk2.groups.io Reply-To: devel@edk2.groups.io,ashley.e.desimone@intel.com X-Gm-Message-State: ZQ52AfrvfcdAJeI8aqAMGOGBx1787277AA= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=groups.io; q=dns/txt; s=20140610; t=1587591351; bh=mF0wXxxRLjU7/QivDjujLcjaeHbST2dWbC4imvtyPb4=; h=Cc:Date:From:Reply-To:Subject:To; b=WLPdflnUW0CP2GqxShQUidcOzpzrIp52hUWGTvLbAZEHiLQ8DUGw9MB18kdzeEFBQRG 2wHjqmsg7SStnERvzBrJn5vkGXiKJh7pt7VM9ZUiW1Bpz9XznRAMpmWI5evmVxf+oo+g/ LDAQFIr7oD9FPDXwB4GbnnKeW8QidmjAOLk= X-ZohoMail-DKIM: pass (identity @groups.io) Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Add workspace_maitenance.py including the implementation of generate_name_for_obsolete_backup() Signed-off-by: Ashley E Desimone Cc: Nate DeSimone Cc: Puja Pandya Cc: Erik Bjorge Cc: Bret Barkelew Cc: Prince Agyeman --- .../workspace_maitenance/workspace_maitenance.py | 30 ++++++++++++++++++= ++++ 1 file changed, 30 insertions(+) create mode 100644 edkrepo/common/workspace_maitenance/workspace_maitenanc= e.py diff --git a/edkrepo/common/workspace_maitenance/workspace_maitenance.py b/= edkrepo/common/workspace_maitenance/workspace_maitenance.py new file mode 100644 index 0000000..83204f8 --- /dev/null +++ b/edkrepo/common/workspace_maitenance/workspace_maitenance.py @@ -0,0 +1,30 @@ +#!/usr/bin/env python3 +# +## @file +# workspace_maitenance.py +# +# Copyright (c) 2017- 2020, Intel Corporation. All rights reserved.
+# SPDX-License-Identifier: BSD-2-Clause-Patent +# + +''' Contains shared workspace maitenance functions. ''' + +import os + +def generate_name_for_obsolete_backup(absolute_path): + if not os.path.exists(absolute_path): + raise ValueError("{} does not exist".format(absolute_path)) + original_name =3D os.path.basename(absolute_path) + dir_name =3D os.path.dirname(absolute_path) + unique_name =3D "" + unique_name_found =3D False + index =3D 1 + while not unique_name_found: + if index =3D=3D 1: + unique_name =3D "{}_old".format(original_name) + else: + unique_name =3D "{}_old{}".format(original_name, index) + if not os.path.exists(os.path.join(dir_name, unique_name)): + unique_name_found =3D True + index +=3D 1 + return unique_name \ No newline at end of file --=20 2.16.2.windows.1 -=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D- Groups.io Links: You receive all messages sent to this group. View/Reply Online (#57878): https://edk2.groups.io/g/devel/message/57878 Mute This Topic: https://groups.io/mt/73207042/1787277 Group Owner: devel+owner@edk2.groups.io Unsubscribe: https://edk2.groups.io/g/devel/unsub [importer@patchew.org] -=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D- From nobody Thu May 2 13:18:12 2024 Delivered-To: importer@patchew.org Received-SPF: pass (zohomail.com: domain of groups.io designates 66.175.222.12 as permitted sender) client-ip=66.175.222.12; envelope-from=bounce+27952+57880+1787277+3901457@groups.io; helo=web01.groups.io; Authentication-Results: mx.zohomail.com; dkim=pass; spf=pass (zohomail.com: domain of groups.io designates 66.175.222.12 as permitted sender) smtp.mailfrom=bounce+27952+57880+1787277+3901457@groups.io; dmarc=fail(p=none dis=none) header.from=intel.com ARC-Seal: i=1; a=rsa-sha256; t=1587591352; cv=none; d=zohomail.com; s=zohoarc; b=DGjaI2DarAdD9ON0B8zhJT39asKBJhXzabT0DvaxNJiER8bSiVZx0IKhY6jsY6TaHPXk34KGEAXCeDTzAkaGULqzPCZiFPql+3JqBrQUqKVQZxg44fTljvF7KnnvZdiYqBf9LItb8UPcdC3RMDiSVkCUSRnc634QBu2ik+RH+Z0= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1587591352; h=Cc:Date:From:In-Reply-To:List-Id:List-Unsubscribe:Message-ID:Reply-To:References:Sender:Subject:To; bh=a1NPwoEcvln+F1llLkSGebU9Lv/uJB9Npkx8HCnJNeA=; b=FMhCqA/JUGEC3ZvQJIzxbCwggbVaRq7oQSNRhT5x121oG7Pdqi8G5qgFZkhffeQ2TSYjidFWXRHBNomozLQK2B2w9b0wx64L032XA4nROhdT3pwzhv0MWOysURAtdl75FcO0d4iAksC+CD3jD3m2f4P/Q9O7w4BgYow8HzYm7RM= ARC-Authentication-Results: i=1; mx.zohomail.com; dkim=pass; spf=pass (zohomail.com: domain of groups.io designates 66.175.222.12 as permitted sender) smtp.mailfrom=bounce+27952+57880+1787277+3901457@groups.io; dmarc=fail header.from= (p=none dis=none) header.from= Received: from web01.groups.io (web01.groups.io [66.175.222.12]) by mx.zohomail.com with SMTPS id 15875913528071005.2337973058467; Wed, 22 Apr 2020 14:35:52 -0700 (PDT) Return-Path: X-Received: by 127.0.0.2 with SMTP id iFTTYY1788612xus8kDWIoTh; Wed, 22 Apr 2020 14:35:52 -0700 X-Received: from mga12.intel.com (mga12.intel.com []) by mx.groups.io with SMTP id smtpd.web10.3186.1587591349721322785 for ; Wed, 22 Apr 2020 14:35:52 -0700 IronPort-SDR: 1jv2unHRX0xVvDiRTQsuElUxZ1fcsxH3F6MNb6JtufZl10yKxOJf3j0Tj8/rHxky8WC9D957AZ m7lDqEGqG/tw== X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False X-Received: from orsmga006.jf.intel.com ([10.7.209.51]) by fmsmga106.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 22 Apr 2020 14:35:48 -0700 IronPort-SDR: o0m8v4M8jPrkge6B78048CfPJMbmTx7ujLXHCAFD7xkKGol/F2zTIiiKdOwLldrGQDAEDXpM2i ieCMKT5ALPVg== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.73,304,1583222400"; d="scan'208";a="259211557" X-Received: from aedesimo-desk.amr.corp.intel.com ([10.7.159.171]) by orsmga006.jf.intel.com with ESMTP; 22 Apr 2020 14:35:48 -0700 From: "Ashley E Desimone" To: devel@edk2.groups.io Cc: Nate DeSimone , Puja Pandya , Erik Bjorge , Bret Barkelew , Prince Agyeman Subject: [edk2-devel] [edk2-staging/EdkRepo] [PATCH V2 2/3] EdkRepo: Add edkrepo/common/workspace_maitenance/manifest_repos_maitenance Date: Wed, 22 Apr 2020 14:35:22 -0700 Message-Id: <20200422213523.44888-3-ashley.e.desimone@intel.com> In-Reply-To: <20200422213523.44888-1-ashley.e.desimone@intel.com> References: <20200422213523.44888-1-ashley.e.desimone@intel.com> Precedence: Bulk List-Unsubscribe: Sender: devel@edk2.groups.io List-Id: Mailing-List: list devel@edk2.groups.io; contact devel+owner@edk2.groups.io Reply-To: devel@edk2.groups.io,ashley.e.desimone@intel.com X-Gm-Message-State: G5ATOVsn51cA4pXHciaUX7Tjx1787277AA= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=groups.io; q=dns/txt; s=20140610; t=1587591352; bh=jMG+5a2Xxo9aMLGcLVavw3Cl/P/Ta1WhyfY76mxRmDY=; h=Cc:Date:From:Reply-To:Subject:To; b=laaxwJJq0rIKR+cvBQbfhcscqSqjbFkUgj/Scf4Zpcq2VO/D0hBPdyMf4orfIS9xPR4 +MIR5Oznw5CimLedMtUBp1SHTaq/37ja1OSJeJtuqkYd1z4hLSEpGJU7DTy1bCWNdDDFC GAz4xWPG2JtEOwgGdsXZ0bQdRiu7+LBsp0w= X-ZohoMail-DKIM: pass (identity @groups.io) Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Add a directory to edkrepo/common to store workspace maitenance functionatlity. Add edkrepo/common/workspace_matenance/humble directory to store related strings and included manifest_repos_maitenance_humble.py Add edkrepo/common/workspace_maitenance/manifest_repos_maitenance.py to support the maitenance of multiple manifest repositories. Added pull_single_manifest_repo() to manifest_repos_maitenance.py Updated setup.py to include the new directories. Signed-off-by: Ashley E Desimone Cc: Nate DeSimone Cc: Puja Pandya Cc: Erik Bjorge Cc: Bret Barkelew Cc: Prince Agyeman --- .../humble/manifest_repos_maitenance_humble.py | 23 +++++++++ .../manifest_repos_maitenance.py | 59 ++++++++++++++++++= ++++ setup.py | 5 +- 3 files changed, 85 insertions(+), 2 deletions(-) create mode 100644 edkrepo/common/workspace_maitenance/humble/manifest_rep= os_maitenance_humble.py create mode 100644 edkrepo/common/workspace_maitenance/manifest_repos_mait= enance.py diff --git a/edkrepo/common/workspace_maitenance/humble/manifest_repos_mait= enance_humble.py b/edkrepo/common/workspace_maitenance/humble/manifest_repo= s_maitenance_humble.py new file mode 100644 index 0000000..ee7b4bb --- /dev/null +++ b/edkrepo/common/workspace_maitenance/humble/manifest_repos_maitenance_= humble.py @@ -0,0 +1,23 @@ +#!/usr/bin/env python3 +# +## @file +# manifest_repos_mgmt_humble.py +# +# Copyright (c) 2017- 2020, Intel Corporation. All rights reserved.
+# SPDX-License-Identifier: BSD-2-Clause-Patent +# + +''' Contains user facing strings for manifest_repos_mgmt.py ''' + +from colorama import Fore +from colorama import Style + +CLONE_SINGLE_MAN_REPO =3D 'Cloning global manifest repository to: {} from:= {}' +SYNC_SINGLE_MAN_REPO =3D 'Syncing the global manifest repository: {}' +SINGLE_MAN_REPO_DIRTY =3D ('Uncommited changes present in the global manif= est ' + 'repository: {} Resolve these changes and attempt= your' + ' operation again.') +SINGLE_MAN_REPO_NOT_CFG_BRANCH =3D ('The current active branch, {}, is not= the ' + 'specified branch for global manifst rep= ository: {}') +SINGLE_MAN_REPO_CHECKOUT_CFG_BRANCH =3D 'Checking out the specified branch= : {} prior to syncing' +SINGLE_MAN_REPO_MOVED =3D '{}{}WARNING:{}{} The global manifest repository= has moved. Backing up previous global manifest repository to: {{}}{}\n'.fo= rmat(Style.BRIGHT, Fore.RED, Style.RESET_ALL, Fore.RED, Style.RESET_ALL) \ No newline at end of file diff --git a/edkrepo/common/workspace_maitenance/manifest_repos_maitenance.= py b/edkrepo/common/workspace_maitenance/manifest_repos_maitenance.py new file mode 100644 index 0000000..8944492 --- /dev/null +++ b/edkrepo/common/workspace_maitenance/manifest_repos_maitenance.py @@ -0,0 +1,59 @@ +#!/usr/bin/env python3 +# +## @file +# manifest_repos_mgmt.py +# +# Copyright (c) 2017- 2020, Intel Corporation. All rights reserved.
+# SPDX-License-Identifier: BSD-2-Clause-Patent +# + +import os +import traceback +import shutil + +import git +from git import Repo + +import edkrepo.config.config_factory as cfg +from edkrepo.common.edkrepo_exception import EdkrepoUncommitedChangesExcep= tion +from edkrepo.common.progress_handler import GitProgressHandler +import edkrepo.common.workspace_maitenance.humble.manifest_repos_maitenanc= e_humble as humble +from edkrepo.common.workspace_maitenance.workspace_maitenance import gener= ate_name_for_obsolete_backup + + +def pull_single_manifest_repo(url, branch, local_path, reset_hard=3DFalse): + ''' + Clones or syncs a single global manifest repository as defined in eith= er + the edkrepo.cfg or the edkrepo_user.cfg + ''' + # If a relative path is used join to the edkrepo global data directory= path + if not os.path.isabs(local_path): + local_path =3D os.path.join(cfg.get_edkrepo_global_data_directory(= ), local_path) + # Clone the repository if it does not exist locally + if not os.path.exists(local_path): + print(humble.CLONE_SINGLE_MAN_REPO.format(local_path, url)) + repo =3D Repo.clone_from(url, local_path, progress=3DGitProgressHa= ndler(), branch=3Dbranch) + # Sync the repository if it exists locally + else: + repo =3D Repo(local_path) + if url in repo.remotes['origin'].urls: + if repo.is_dirty(untracked_files=3DTrue) and not reset_hard: + raise EdkrepoUncommitedChangesException(humble.SINGLE_MAN_= REPO_DIRTY.format(local_path)) + elif repo.is_dirty(untracked_files=3DTrue) and reset_hard: + repo.git.reset('--hard') + print(humble.SYNC_SINGLE_MAN_REPO.format(local_path)) + if repo.active_branch.name !=3D branch: + print(humble.SINGLE_MAN_REPO_NOT_CFG_BRANCH.format(repo.ac= tive_branch.name, local_path)) + print(humble.SINGLE_MAN_REPO_CHECKOUT_CFG_BRANCH.format(br= anch)) + repo.git.checkout(branch) + repo.remotes.origin.pull() + # If the URL specified for this manifest repo has moved back up th= e existing + # local copy and clone the new repository + else: + new_path =3D generate_name_for_obsolete_backup(local_path) + new_path =3D os.path.join(os.path.dirname(local_path), new_pat= h) + print(humble.SINGLE_MANE_REPO_MOVED.format(new_path)) + shutil.move(local_path, new_path) + print (humble.CLONE_SIGNLE_MAN_REPO.format(local_path, url)) + repo =3D Repo.clone_from(url, local_path, progress=3DGitProgre= ssHandler(), branch=3Dbranch) + diff --git a/setup.py b/setup.py index 06a382b..f8bb0fc 100755 --- a/setup.py +++ b/setup.py @@ -12,8 +12,9 @@ setup(name=3D'edkrepo', version=3D'2.0.0', description=3D'The edkrepo tools', packages=3D['edkrepo', 'edkrepo.commands', 'edkrepo.commands.argumen= ts', 'edkrepo.commands.humble', - 'edkrepo.git_automation', 'edkrepo.common', 'edkrepo.confi= g', 'edkrepo.config.humble', - 'edkrepo_manifest_parser', 'project_utils'], + 'edkrepo.git_automation', 'edkrepo.common', 'edkrepo.commo= n.workspace_maitenance', + 'edkrepo.common.workspace_maitenance.humble', 'edkrepo.con= fig', 'edkrepo.config.humble', + 'edkrepo_manifest_parser', 'project_utils'], package_data=3D{ }, include_package_data=3DTrue, --=20 2.16.2.windows.1 -=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D- Groups.io Links: You receive all messages sent to this group. View/Reply Online (#57880): https://edk2.groups.io/g/devel/message/57880 Mute This Topic: https://groups.io/mt/73207044/1787277 Group Owner: devel+owner@edk2.groups.io Unsubscribe: https://edk2.groups.io/g/devel/unsub [importer@patchew.org] -=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D- From nobody Thu May 2 13:18:12 2024 Delivered-To: importer@patchew.org Received-SPF: pass (zohomail.com: domain of groups.io designates 66.175.222.12 as permitted sender) client-ip=66.175.222.12; envelope-from=bounce+27952+57879+1787277+3901457@groups.io; helo=web01.groups.io; Authentication-Results: mx.zohomail.com; dkim=pass; spf=pass (zohomail.com: domain of groups.io designates 66.175.222.12 as permitted sender) smtp.mailfrom=bounce+27952+57879+1787277+3901457@groups.io; dmarc=fail(p=none dis=none) header.from=intel.com ARC-Seal: i=1; a=rsa-sha256; t=1587591352; cv=none; d=zohomail.com; s=zohoarc; b=ZJBc/2exzKhiBZcjSvbMg8j1s8H6jsRdDSVi4r5Z5v6PFpjp0RdTxHK/AI0oJwj6bUiP8F3QOx0VlLpiE5w84eVGV3/3jK7yxeErzKCbFobP+SQfjN1isN/nRULHelLnthb54nDHAot0Mjq67SlmX9MiFf4IL39wlZlphjUsPFo= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1587591352; h=Cc:Date:From:In-Reply-To:List-Id:List-Unsubscribe:Message-ID:Reply-To:References:Sender:Subject:To; bh=xf+Ym0sfaxFL8ue1xMmXyAxCKTCTPRMZvnoRdrMpvvc=; b=kNegKcY2BBgfd00I/baipgIr02wjdlWVZtNBbSVISeQXtHyqWOQaA1+eky+h8KLV4J46hEC5+NM6VZbijpxQasAEWcxR4MNBTTIbdGVUscNeLzntL27Fpn/VNTzlBtRQLCiDPBbqtVf0dK/mT1Zmnb6MlIc9Qk1f/oiVT8b9/FU= ARC-Authentication-Results: i=1; mx.zohomail.com; dkim=pass; spf=pass (zohomail.com: domain of groups.io designates 66.175.222.12 as permitted sender) smtp.mailfrom=bounce+27952+57879+1787277+3901457@groups.io; dmarc=fail header.from= (p=none dis=none) header.from= Received: from web01.groups.io (web01.groups.io [66.175.222.12]) by mx.zohomail.com with SMTPS id 1587591352638840.1532148196484; Wed, 22 Apr 2020 14:35:52 -0700 (PDT) Return-Path: X-Received: by 127.0.0.2 with SMTP id AZvZYY1788612xcuRh6zTEbJ; Wed, 22 Apr 2020 14:35:52 -0700 X-Received: from mga12.intel.com (mga12.intel.com [192.55.52.136]) by mx.groups.io with SMTP id smtpd.web11.3242.1587591351647642157 for ; Wed, 22 Apr 2020 14:35:51 -0700 IronPort-SDR: n3OiqAslNXpF3tvDytPLaF863HAOo2GjRp8P68ZaxmCBTMPA3NuT7uW4TDl9ZMbOaDyjUdDsB8 5Dadxh7LDs4w== X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False X-Received: from orsmga006.jf.intel.com ([10.7.209.51]) by fmsmga106.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 22 Apr 2020 14:35:48 -0700 IronPort-SDR: P2xak3KaEjDSkmf+kSbYCC0KgH8au4OpcFahTp5rg9EWqJbDxZABlJ+vSV2jSbtbgoSbGVcmYH loBkJrhYC1iQ== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.73,304,1583222400"; d="scan'208";a="259211559" X-Received: from aedesimo-desk.amr.corp.intel.com ([10.7.159.171]) by orsmga006.jf.intel.com with ESMTP; 22 Apr 2020 14:35:48 -0700 From: "Ashley E Desimone" To: devel@edk2.groups.io Cc: Nate DeSimone , Puja Pandya , Erik Bjorge , Bret Barkelew , Prince Agyeman Subject: [edk2-devel] [edk2-staging/EdkRepo] [PATCH V2 3/3] EdkRepo: Update pull_latest_manifest_repo to use pull_single_manifest_repo Date: Wed, 22 Apr 2020 14:35:23 -0700 Message-Id: <20200422213523.44888-4-ashley.e.desimone@intel.com> In-Reply-To: <20200422213523.44888-1-ashley.e.desimone@intel.com> References: <20200422213523.44888-1-ashley.e.desimone@intel.com> Precedence: Bulk List-Unsubscribe: Sender: devel@edk2.groups.io List-Id: Mailing-List: list devel@edk2.groups.io; contact devel+owner@edk2.groups.io Reply-To: devel@edk2.groups.io,ashley.e.desimone@intel.com X-Gm-Message-State: X8L5qgVKYxKoTFxl6RfQqhGjx1787277AA= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=groups.io; q=dns/txt; s=20140610; t=1587591352; bh=k4p6Q6C+PNtjUNw+dlcbYzGhzctQCnCmuFEtCWAsL9M=; h=Cc:Date:From:Reply-To:Subject:To; b=uHsJ0bGz/MrFRYa9oAHIlVCr28jKl+bPliz4t1e3cNTD4DksfzeMtGkwJf1jAc0b3KG wCoPtfGwNQZJh22RFKd6apYT453KQaukFjEWBeDURD7F5Cc2mA+fjm7Dg3X5TY3t4qEP1 lB6gdzqYc4KXkAJbxALVK08clAeEsD8/qRQ= X-ZohoMail-DKIM: pass (identity @groups.io) Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Updates the implementation for pull_latest_manifest_repo to call pull_single_manifest repo. Removes definitions of strings used by pull_latest_manifest_repo from common/humble.py and from the imports of common_repo_functions.py Signed-off-by: Ashley E Desimone Cc: Nate DeSimone Cc: Puja Pandya Cc: Erik Bjorge Cc: Bret Barkelew Cc: Prince Agyeman --- edkrepo/common/common_repo_functions.py | 33 ++++-------------------------= ---- edkrepo/common/humble.py | 8 -------- 2 files changed, 4 insertions(+), 37 deletions(-) diff --git a/edkrepo/common/common_repo_functions.py b/edkrepo/common/commo= n_repo_functions.py index 0d39291..39b192c 100644 --- a/edkrepo/common/common_repo_functions.py +++ b/edkrepo/common/common_repo_functions.py @@ -46,12 +46,10 @@ from edkrepo.common.humble import COMMIT_TEMPLATE_NOT_F= OUND, COMMIT_TEMPLATE_CUS from edkrepo.common.humble import ADD_PRIMARY_REMOTE, REMOVE_PRIMARY_REMOTE from edkrepo.common.humble import FETCH_PRIMARY_REMOTE, MIRROR_PRIMARY_SHA= , TAG_AND_BRANCH_SPECIFIED from edkrepo.common.humble import MIRROR_BEHIND_PRIMARY_REPO, HOOK_NOT_FOU= ND_ERROR, SUBMODULE_FAILURE -from edkrepo.common.humble import MANIFEST_REPO_DIRTY, MANIFEST_REPO_MOVED= , CLONING_MANIFEST_REPO, SYNCING_MANIFEST_REPO from edkrepo.common.humble import INCLUDED_URL_LINE, INCLUDED_INSTEAD_OF_L= INE, INCLUDED_FILE_NAME from edkrepo.common.humble import ERROR_WRITING_INCLUDE, MULTIPLE_SOURCE_A= TTRIBUTES_SPECIFIED from edkrepo.common.humble import VERIFY_GLOBAL, VERIFY_ARCHIVED, VERIFY_P= ROJ, VERIFY_PROJ_FAIL -from edkrepo.common.humble import VERIFY_PROJ_NOT_IN_INDEX, VERIFY_GLOBAL_= FAIL, MANIFEST_REPO_NOT_CONFIG_BRANCH -from edkrepo.common.humble import MANIFEST_REPO_CHECKOUT_CONFIG_BRANCH +from edkrepo.common.humble import VERIFY_PROJ_NOT_IN_INDEX, VERIFY_GLOBAL_= FAIL from edkrepo.common.pathfix import get_actual_path from project_utils.sparse import BuildInfo, process_sparse_checkout from edkrepo.config.config_factory import get_workspace_path @@ -61,6 +59,7 @@ from edkrepo_manifest_parser.edk_manifest import CiIndexX= ml, ManifestXml from edkrepo.common.edkrepo_exception import EdkrepoNotFoundException, Edk= repoGitException, EdkrepoWarningException from edkrepo.common.edkrepo_exception import EdkrepoFoundMultipleException= , EdkrepoHookNotFoundException from edkrepo.common.edkrepo_exception import EdkrepoGitConfigSetupExceptio= n, EdkrepoManifestInvalidException +from edkrepo.common.workspace_maitenance.manifest_repos_maitenance import = pull_single_manifest_repo from edkrepo.common.ui_functions import init_color_console from edkrepo_manifest_parser import edk_manifest from edkrepo_manifest_parser.edk_manifest_validation import validate_manif= estrepo @@ -77,32 +76,8 @@ def pull_latest_manifest_repo(args, config, reset_hard= =3DFalse): branch =3D config['cfg_file'].manifest_repo_branch local_path =3D config['cfg_file'].manifest_repo_local_path init_color_console(False) - if not (os.path.isabs(local_path)): - #since only a relative path was specified it must be joined to the= Edkrepo Application Data Directory - local_path =3D os.path.join(get_edkrepo_global_data_directory(), l= ocal_path) - if not os.path.exists(local_path): - print (CLONING_MANIFEST_REPO.format(local_path, repo_url)) - repo =3D Repo.clone_from(repo_url, local_path, progress=3DGitProgr= essHandler(), branch=3Dbranch) - else: - repo =3D Repo(local_path) - if repo_url in repo.remotes['origin'].urls: - if repo.is_dirty(untracked_files=3DTrue) and not reset_hard: - raise EdkrepoWarningException(MANIFEST_REPO_DIRTY) - elif repo.is_dirty(untracked_files=3DTrue) and reset_hard: - repo.git.reset('--hard') - print (SYNCING_MANIFEST_REPO) - if repo.active_branch.name !=3D branch: - print(MANIFEST_REPO_NOT_CONFIG_BRANCH.format(repo.active_b= ranch.name)) - print(MANIFEST_REPO_CHECKOUT_CONFIG_BRANCH.format(branch)) - repo.git.checkout(branch) - repo.remotes.origin.pull() - else: - new_path =3D generate_name_for_obsolete_backup(local_path) - new_path =3D os.path.join(os.path.dirname(local_path), new_pat= h) - print(MANIFEST_REPO_MOVED.format(new_path)) - shutil.move(local_path, new_path) - print (CLONING_MANIFEST_REPO.format(local_path, repo_url)) - repo =3D Repo.clone_from(repo_url, local_path, progress=3DGitP= rogressHandler(), branch=3Dbranch) + pull_single_manifest_repo(repo_url, branch, local_path, reset_hard) + =20 def clone_repos(args, workspace_dir, repos_to_clone, project_client_side_h= ooks, config, skip_submodule, manifest): for repo_to_clone in repos_to_clone: diff --git a/edkrepo/common/humble.py b/edkrepo/common/humble.py index 64b9519..8ca38bb 100644 --- a/edkrepo/common/humble.py +++ b/edkrepo/common/humble.py @@ -34,14 +34,6 @@ MULTIPLE_SOURCE_ATTRIBUTES_SPECIFIED =3D 'BRANCH or TAG = name present with COMMIT I TAG_AND_BRANCH_SPECIFIED =3D 'BRANCH AND TAG name present in combination f= ield for {} repo. Using TAG.\n' CHECKING_CONNECTION =3D 'Checking connection to remote url: {}\n' =20 -# Informational messages and warnings for pull_latest_manifest_repo() -MANIFEST_REPO_DIRTY =3D 'Uncommited changes present in the global manifest= repository. Run edkrepo update-manifest-repo --hard to revert these change= s and sync the global manifest repository.\n' -MANIFEST_REPO_MOVED =3D '{}{}WARNING:{}{} The Global manifest repository h= as moved. Backing up previous global manifest repository to: {{}}{}\n'.form= at(Style.BRIGHT, Fore.RED, Style.RESET_ALL, Fore.RED, Style.RESET_ALL) -CLONING_MANIFEST_REPO =3D 'Cloning global manifest repository to: {} from:= {}\n' -SYNCING_MANIFEST_REPO =3D 'Syncing the global manifest repository.\n' -MANIFEST_REPO_NOT_CONFIG_BRANCH =3D 'The current active branch, {}, is not= the specified manifest repository branch' -MANIFEST_REPO_CHECKOUT_CONFIG_BRANCH =3D 'Checking out the specified manif= est repository branch, {}, prior to syncing' - #Error messages for sync_command.py SYNC_EXIT =3D 'Exiting without performing sync operations.' SYNC_UNCOMMITED_CHANGES =3D UNCOMMITED_CHANGES + SYNC_EXIT --=20 2.16.2.windows.1 -=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D- Groups.io Links: You receive all messages sent to this group. View/Reply Online (#57879): https://edk2.groups.io/g/devel/message/57879 Mute This Topic: https://groups.io/mt/73207043/1787277 Group Owner: devel+owner@edk2.groups.io Unsubscribe: https://edk2.groups.io/g/devel/unsub [importer@patchew.org] -=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-