ci-management.git
11 months agoFix: Add concurrency and permissions to verify 74/5174/1
Eric Ball [Tue, 12 Dec 2023 02:01:03 +0000 (18:01 -0800)]
Fix: Add concurrency and permissions to verify

Though concurrency is also defined in the composed workflow, this
action needs it as well. The permissions are also important to
allow to nested actions to execute properly.

Change-Id: I340202d53dac355a2f357535af058edd8223e175
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
11 months agoCI: Modify GHA workflow to use composed verify 72/5172/2
Eric Ball [Fri, 1 Dec 2023 23:44:44 +0000 (15:44 -0800)]
CI: Modify GHA workflow to use composed verify

This uses a single workflow composed of all actions that need to be
run to verify changes to the ci-management repo.

Issue: RELENG-4799
Change-Id: Ibe2ef9732c7d0a9e13e30fec2cb8c3b64bad1768
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
18 months agoChore: Remove outdated jobs 12/5112/2
Eric Ball [Thu, 11 May 2023 17:09:17 +0000 (10:09 -0700)]
Chore: Remove outdated jobs

These are no longer in use, and are attempting to use agents that are
no longer connected to the Jenkins server.

Change-Id: I2d632f236cfe5f16e8f1d04c57660686ced177a6
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
18 months agoRefactor: Add pre-commit config and update tox 94/5094/1
Anil Belur [Thu, 11 May 2023 11:33:20 +0000 (21:33 +1000)]
Refactor: Add pre-commit config and update tox

Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Change-Id: Id21a2886d92a0429de04f8e4321e19319c4d4f0d

18 months agoRefactor: Cleanup JJB for pre-commit 79/5079/3
Eric Ball [Thu, 4 May 2023 19:56:20 +0000 (12:56 -0700)]
Refactor: Cleanup JJB for pre-commit

This includes removing the file "static-slaves-ci-jobs", which does
not conform to modern naming conventions, and is no longer needed.

Change-Id: If1495c79ba85dea00f7a423f3055abee517dce7e
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
18 months agoRefactor: Cleanup TA JJB for pre-commit 77/5077/2
Eric Ball [Thu, 4 May 2023 17:56:08 +0000 (10:56 -0700)]
Refactor: Cleanup TA JJB for pre-commit

Change-Id: Ib7c8c15dfce840941d4c827e602cda7e119c1bfa
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
18 months agoCI: Update common packer to latest v0.12.1 93/5093/1
Anil Belur [Wed, 10 May 2023 22:21:47 +0000 (08:21 +1000)]
CI: Update common packer to latest v0.12.1

Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Change-Id: I3f97794945c12d24c78251c5cf3b6621f4b8b898

18 months agoCI: Upgrade global-jjb to latest v0.86.5 92/5092/1
Anil Belur [Wed, 10 May 2023 22:20:51 +0000 (08:20 +1000)]
CI: Upgrade global-jjb to latest v0.86.5

Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Change-Id: I460b4bc67002d65056f1f51db984858cea10c761

18 months agoCI: Add GHA for verification 76/5076/1
Eric Ball [Thu, 4 May 2023 18:04:16 +0000 (11:04 -0700)]
CI: Add GHA for verification

Change-Id: Idbaf7b32701386818ddc0da607a94bd57644ebdd
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
19 months agoRefactor!: JJB code to comply with updates to v5.x 74/5074/1
Anil Belur [Tue, 18 Apr 2023 22:40:10 +0000 (08:40 +1000)]
Refactor!: JJB code to comply with updates to v5.x

Update global-jjb v0.86.0, this updates the minimal
version of JJB to v5.0.2.

Change-Id: I73f710ee47720aa97d274577c1a86bf526a5651c
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
19 months agoChore: Add info job and view for robot repo 73/5073/1
Eric Ball [Tue, 18 Apr 2023 19:39:50 +0000 (12:39 -0700)]
Chore: Add info job and view for robot repo

Change-Id: Id6d0bce704eea5a8ff92f882fc01d9090a9b8cde
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
19 months agoMerge "Automation adds sdt.yaml"
Eric Ball [Wed, 12 Apr 2023 15:22:41 +0000 (15:22 +0000)]
Merge "Automation adds sdt.yaml"

22 months agoChore: Upgrade global-jjb to latest, v0.83.2 35/5035/1
Eric Ball [Tue, 17 Jan 2023 23:19:41 +0000 (15:19 -0800)]
Chore: Upgrade global-jjb to latest, v0.83.2

Change-Id: Ib38f271ca8e1bb251cc468fb8d6bb404f256000b
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
2 years agoChore: Update Ubuntu 18.04 ARM image 15/5015/1
Andrew Grimberg [Mon, 19 Sep 2022 22:25:08 +0000 (15:25 -0700)]
Chore: Update Ubuntu 18.04 ARM image

Change-Id: Ic27072f92fcc9e9a76ac622a51a37b55e6f727df
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
2 years agoChore: Upgrade common-packer to v0.9.5 14/5014/1
Andrew Grimberg [Mon, 19 Sep 2022 20:20:16 +0000 (13:20 -0700)]
Chore: Upgrade common-packer to v0.9.5

Change-Id: I95e4f301ac5d685742c11bf5d72f71799aac06d5
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
2 years agoChore: Update builders to latest 13/5013/1
Andrew Grimberg [Fri, 16 Sep 2022 16:24:42 +0000 (09:24 -0700)]
Chore: Update builders to latest

Update build systems to latest created by packer

Change-Id: I99e2609869696d24f2e5ce5040481f59c7935c08
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
2 years agoChore: Upgrade common-packer to v0.11.0 12/5012/1
Andrew Grimberg [Fri, 16 Sep 2022 13:14:07 +0000 (06:14 -0700)]
Chore: Upgrade common-packer to v0.11.0

Change-Id: I8e98f8a30f74bab95bcae0929df8c372cbeb85d9
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
2 years agoFix: Add lf-infra-publish to all jobs 52/4952/1
Eric Ball [Tue, 26 Jul 2022 19:27:37 +0000 (12:27 -0700)]
Fix: Add lf-infra-publish to all jobs

Some jobs did not have this publisher, which meant that logs were not
being archived, and that we were not receiving job cost data for
these jobs.

Change-Id: If380ad31104fc68935f59490bbc8d55de7a5b1af
Issue-ID: LF-Jira RELENG-4322
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
2 years agoChore: Upgrade global-jjb to v0.77.0 80/4880/2
Eric Ball [Tue, 24 May 2022 20:56:56 +0000 (13:56 -0700)]
Chore: Upgrade global-jjb to v0.77.0

This version brings in the latest version of JJB, which is required
for upgrading to the latest versions of some plugins.

For compatibility with the latest version of global-jjb, this update
includes the creation of the ansible.cfg managed file, and updates
the default version of JJB used by CI jobs.

Change-Id: I9af9386d8a171d9487a130edd7577dc1f5088040
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
2 years agoAutomation adds sdt.yaml 76/4776/2
LF Jenkins CI [Tue, 29 Mar 2022 17:37:40 +0000 (17:37 +0000)]
Automation adds sdt.yaml

Change-Id: I3dd9a7a53673af162760a69efd1649683e51c1cd
Signed-off-by: lf-jobbuilder <releng+lf-jobbuilder@linuxfoundation.org>
2 years agoAutomation adds security_tools.yaml 32/4732/2
LF Jenkins CI [Tue, 8 Mar 2022 19:55:34 +0000 (19:55 +0000)]
Automation adds security_tools.yaml

Change-Id: I9188721db59d3e3722dbeb9c0d06faead012bc3f
Signed-off-by: lf-jobbuilder <releng+lf-jobbuilder@linuxfoundation.org>
2 years agoChore: Update sigul bridge and server hostnames 94/4594/1
Eric Ball [Tue, 4 Jan 2022 21:47:08 +0000 (13:47 -0800)]
Chore: Update sigul bridge and server hostnames

Change-Id: I7d60d2444eedeb74d674ebe9bc433daa3bc6607b
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
2 years agoChore: Update global-jjb to v0.72.0 93/4593/1
Eric Ball [Tue, 4 Jan 2022 21:19:39 +0000 (13:19 -0800)]
Chore: Update global-jjb to v0.72.0

Change-Id: I1ec05fcdcbeaf370d79db6f4e21bcd446dca2673
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
2 years agoFix: Remove failing jenkins-cfg-merge job 92/4592/1
Eric Ball [Tue, 4 Jan 2022 21:02:58 +0000 (13:02 -0800)]
Fix: Remove failing jenkins-cfg-merge job

This job is no longer needed after the move to JCasC. Only the needed
jobs from the ci-jobs group are now included.

Change-Id: I57d79fba41a9614a7a6566fad1aeaf9f702628c4
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
3 years agoFix: Move all builders to standard, update images 10/4510/1
Eric Ball [Wed, 10 Nov 2021 21:02:20 +0000 (13:02 -0800)]
Fix: Move all builders to standard, update images

The v3-starter flavors have too small of a default disk attached for
our images.

Change-Id: I3e5125df3ab9c14894e6aba55bd312d1373ab081
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
3 years agoChore: Update all builders to v3 flavors 09/4509/1
Eric Ball [Wed, 10 Nov 2021 02:03:03 +0000 (18:03 -0800)]
Chore: Update all builders to v3 flavors

Change-Id: I9b206d1cfc186ea36af2a7b8d1536684f2aaa5d0
Issue-ID: LF-Jira RELENG-4036
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
3 years agoChore: Update common-packer to v0.9.4 08/4508/2
Eric Ball [Tue, 9 Nov 2021 23:17:19 +0000 (15:17 -0800)]
Chore: Update common-packer to v0.9.4

This also removes the var file for ubuntu-18.04-arm64, as that is now
included as a standard template in common-packer.

Change-Id: Ifcadc5554afb1b31705669f438d9254daf2cd461
Issue-ID: LF-Jira RELENG-4036
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
3 years agoUpgrade global-jjb to v0.69.0 07/4507/2
Eric Ball [Tue, 9 Nov 2021 22:41:48 +0000 (14:41 -0800)]
Upgrade global-jjb to v0.69.0

Change-Id: Ie861bbb6a2f832acbe771d289ad902dc14ffc40d
Issue-ID: LF-Jira RELENG-4036
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
3 years agoChore: Update CentOS 7 images 65/4465/1
Andrew Grimberg [Fri, 1 Oct 2021 15:09:40 +0000 (08:09 -0700)]
Chore: Update CentOS 7 images

Change-Id: I60cbfa5c03be4c08fa7eafde1ea8875fcc50217f
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
3 years agoFix: Add caret to escape Jenkins vars 14/4414/1
Eric Ball [Wed, 15 Sep 2021 19:41:59 +0000 (12:41 -0700)]
Fix: Add caret to escape Jenkins vars

Change-Id: I0e5369667f8d0b17f4e470ccdadf0ffc07f66362
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
3 years agoFix: Add blank lines to npm and pip managed config 01/4401/1
Anil Belur [Tue, 24 Aug 2021 00:03:35 +0000 (10:03 +1000)]
Fix: Add blank lines to npm and pip managed config

The blank lines are required as a part of JCASC config
or Jobs fail on file not found exception.

Issue-ID: LF-Jira RELENG-3890
Change-Id: Ia8455dcbfcb311b49a0895737866d477bb0c831e
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
3 years agoFix: Add jenkins-init-script to managed files 95/4395/1
Eric Ball [Thu, 12 Aug 2021 22:32:05 +0000 (15:32 -0700)]
Fix: Add jenkins-init-script to managed files

Change-Id: I3117f16f789597b9e020b013f9f03ad7e07fd3db
Issue-ID: LF-Jira RELENG-3737
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
3 years agoChore: Update global-jjb to v0.65.2 94/4394/1
Eric Ball [Thu, 12 Aug 2021 18:09:42 +0000 (11:09 -0700)]
Chore: Update global-jjb to v0.65.2

Change-Id: Id350a2d145d8b6d58df6289ed5e9e3a54c853e16
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
3 years agoFeat: Add JCASC managed config files 85/4385/2
Eric Ball [Tue, 3 Aug 2021 19:25:08 +0000 (12:25 -0700)]
Feat: Add JCASC managed config files

Change-Id: I89b80cd83c7cb26fbb767ec71a40355e3bc6d819
Issue-ID: LF-Jira RELENG-3737
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
3 years agoUpdate global-jjb to v0.65.1 77/4377/1
Eric Ball [Tue, 20 Jul 2021 20:25:29 +0000 (13:25 -0700)]
Update global-jjb to v0.65.1

Change-Id: I94d5d7c600c10346e2415b2f5d03148473f00d2b
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
3 years agoMerge "Automation adds pred-vanet-mec.yaml"
Eric Ball [Wed, 14 Jul 2021 21:15:56 +0000 (21:15 +0000)]
Merge "Automation adds pred-vanet-mec.yaml"

3 years agoDrop AVAILABILITY_ZONE 71/4371/1
Mohammed Naser [Wed, 14 Jul 2021 17:03:38 +0000 (13:03 -0400)]
Drop AVAILABILITY_ZONE

By default, OpenStack will schedule you into the right availablity
zone that has capacity, hard coding this can potentially result in
not being able to provision new virtual machines.

This patch drops the hard-wired value and lets Nova on the
scheduling size pick the correct availability zone.

Signed-off-by: Mohammed Naser <mnaser@vexxhost.com>
Change-Id: Ibd3759a5f41af9ffa8f652dd47a388c5572c33d6

3 years agoAutomation adds pred-vanet-mec.yaml 59/4259/2
LF Jenkins CI [Tue, 13 Jul 2021 19:52:13 +0000 (19:52 +0000)]
Automation adds pred-vanet-mec.yaml

Change-Id: I6191b5e94eac6b58d73694fbd3ad678448137543
Signed-off-by: lf-jobbuilder <releng+lf-jobbuilder@linuxfoundation.org>
3 years agoMove install of "rename" into ARM conditional 19/4319/1
Paul Carver [Wed, 9 Jun 2021 15:36:40 +0000 (11:36 -0400)]
Move install of "rename" into ARM conditional

In order to fix the ARM build it was necessary to install the "rename"
command, but that was done via apt which does not exist on CentOS (the
ARM build is done on Ubuntu, the AMD build on CentOS) and the "rename"
command is not required for the AMD build. This change fixes that
mistake.

Signed-off-by: Paul Carver <pcarver@att.com>
Change-Id: I49755198a5774a611ae5977d7f17645461d08302

3 years agoAutomation adds cassini.yaml 56/4256/2
LF Jenkins CI [Tue, 1 Jun 2021 20:59:22 +0000 (20:59 +0000)]
Automation adds cassini.yaml

Change-Id: I450c2f3256c162ec1bef7adbd553583172eff7e8
Signed-off-by: lf-jobbuilder <releng+lf-jobbuilder@linuxfoundation.org>
3 years agoAutomation adds security.yaml 53/4253/2
LF Jenkins CI [Mon, 17 May 2021 21:04:17 +0000 (21:04 +0000)]
Automation adds security.yaml

Change-Id: I505491bfce68338ec933a9010a58fb7094a8dc46
Signed-off-by: lf-jobbuilder <releng+lf-jobbuilder@linuxfoundation.org>
3 years agoChange weekly crons to "@weekly", hourly to daily 45/4245/1
Eric Ball [Thu, 13 May 2021 22:01:05 +0000 (15:01 -0700)]
Change weekly crons to "@weekly", hourly to daily

@weekly will provide automatic load balancing from Jenkins, rather
than running all jobs at the same time. As for docker jobs, hourly
is simply more frequent than is necessary, putting an unnecessary
strain on resources.

Change-Id: Ib370637c561d67a7ac3befe2eb3889c3c2b68b69
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
3 years agoUpdate global-jjb to v0.63.1 44/4244/1
Eric Ball [Thu, 13 May 2021 21:20:45 +0000 (14:20 -0700)]
Update global-jjb to v0.63.1

Change-Id: If958365a5076c57797d018b2ffad6e113037180d
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
3 years agoReplace ubuntu1604 with ubuntu1804 04/4204/3
Eric Ball [Thu, 1 Apr 2021 19:18:04 +0000 (12:18 -0700)]
Replace ubuntu1604 with ubuntu1804

Replace the agent and all scripts that reference it.

Issue: LF-Jira RELENG-3483
Change-Id: Iffe5d0a2a0a2dc50ccb20f5d32a9bcc3c5b7fcca
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
3 years agoUpdate packer jobs with CentOS 8 & Ubuntu 18.04 98/4198/1
Eric Ball [Tue, 30 Mar 2021 22:04:45 +0000 (15:04 -0700)]
Update packer jobs with CentOS 8 & Ubuntu 18.04

The top priority is to remove all Ubuntu 16.04 jobs, as the OS is EOL.
This also includes updates to global-jjb and common-packer.

Issue: LF-Jira RELENG-3483
Change-Id: Ifd1705cb5401814231ff2cb1d5fbdce0901cd3ef
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
3 years agoDisable iec jobs 83/4183/2
Eric Ball [Fri, 12 Mar 2021 21:03:47 +0000 (13:03 -0800)]
Disable iec jobs

The iec jobs are hanging, and never recover or timeout. They need to
be disabled until they have been fixed by the IEC team.

Change-Id: Ib3aeebda81a009a5801e091eeaeed41bfe8ad9a7
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
3 years agoMerge "Fix broken ARM64 REC build"
Eric Ball [Fri, 12 Feb 2021 18:02:20 +0000 (18:02 +0000)]
Merge "Fix broken ARM64 REC build"

3 years agoFix broken ARM64 REC build 54/4154/2
Paul Carver [Thu, 4 Feb 2021 15:55:38 +0000 (15:55 +0000)]
Fix broken ARM64 REC build

The REC ARM64 build has been broken for a while, likely due to the
change of Jenkins builder nodes from Ubuntu 16.04 to 18.04. A number of
fixes are needed, not all known at this time. This change is a start at
fixing them.

1) Force installation of libvirt-daemon-system because the start of
   libvirt is failing when it used to succeed.

2) Install "rename" command. This was present in Ubuntu 16.04, missing
   in 18.04 and back again in 20.04. The Arm build hosts were changed
   from 16.04 to 18.04 a while back and the build has been broken ever
   since (due to multiple issues).

Change-Id: I1cf7ed62bd796bb20da21c9205487c0c6a079e85
Signed-off-by: Paul Carver <pcarver@att.com>
3 years agoAutomation adds tami.yaml 34/4134/2
LF Jenkins CI [Fri, 5 Feb 2021 01:57:15 +0000 (01:57 +0000)]
Automation adds tami.yaml

Change-Id: I960b163805b1bbab60f1f52519fb2ace639d92ef
Signed-off-by: lf-jobbuilder <releng+lf-jobbuilder@linuxfoundation.org>
3 years agoUpdate global-jjb to v0.60.5 60/4060/1
Eric Ball [Tue, 26 Jan 2021 17:56:53 +0000 (09:56 -0800)]
Update global-jjb to v0.60.5

Change-Id: I0e88feb16957619791acf213e60a6cd2ecbd624b
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
3 years agoMerge "Update common-packer to v0.7.1"
Andrew Grimberg [Tue, 29 Dec 2020 21:52:46 +0000 (21:52 +0000)]
Merge "Update common-packer to v0.7.1"

3 years agoUpdate common-packer to v0.7.1 14/4014/1
Eric Ball [Tue, 29 Dec 2020 21:34:40 +0000 (13:34 -0800)]
Update common-packer to v0.7.1

This fix is needed to resume packer builds, which are currently
broken.

Issue: LF-Jira RELENG-3344
Change-Id: I490c3d0ef8c59ae981232de0edc5dcaf13238b26
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
3 years agoReplace python-decoratortools per error message 77/3977/5
Paul Carver [Tue, 8 Dec 2020 18:31:36 +0000 (13:31 -0500)]
Replace python-decoratortools per error message

According to the error message during the ARM64 verify job,
python-decoratortools is not available but the package
python-peak.util.decorators replaces it.

See
https://jenkins.akraino.org/job/ta-infra-ansible-arm64-master-verify/47/console
for details of the error.

Additionally, there seems to be an error due to a conflict between the
Ubuntu 18.04 of the builder VM vs the CentOS packages we're trying to
build. It seems the conflict didn't occur on the older Ubuntu 16.04
builder VMs that we used to use. Since the builder VMs get thrown away
and we don't really care about them after we finish building, we'll
force overwrite the Ubuntu version of '/usr/bin/annotate-output' with
the CentOS copy that is coming from the CentOS RPM that we care about.

This change also fixes a harmlessly incorrect redirection of stderr.

Finally, the build is failing due to missing lxml and urllib3 modules
for Python. It's not clear where these were coming from before the issue
mentioned above, but they are needed so this change adds them.

Signed-off-by: Paul Carver <pcarver@att.com>
Change-Id: Ib4e446190f718ef326a02087dc88fbfd8bdd293e

4 years agoAdd GCP job for KNI Industrial Edge 27/3927/2
Ricardo Noriega [Fri, 20 Nov 2020 13:56:11 +0000 (14:56 +0100)]
Add GCP job for KNI Industrial Edge

Signed-off-by: Ricardo Noriega <rnoriega@redhat.com>
Change-Id: Ia1211399f40233d816b7d122af7a236d4270a40a

4 years agoUse SCM 'gerrit' choosing strategy for kni jobs 96/3896/1
James E. Blair [Thu, 12 Nov 2020 21:38:45 +0000 (13:38 -0800)]
Use SCM 'gerrit' choosing strategy for kni jobs

The KNI jobs appear to be building the master branch even after
fetching proposed changes to gerrit.  Change the choosing strategy
from 'default' to 'gerrit' to correct this.

See https://plugins.jenkins.io/gerrit-trigger/ for docs.

Change-Id: I028cde257415b2eb297cfa100f68d109df3fac71
Signed-off-by: James E. Blair <jeblair@redhat.com>
4 years agoAdd job for blueprint-management-hub 86/3886/3
Ricardo Noriega [Fri, 6 Nov 2020 17:39:43 +0000 (18:39 +0100)]
Add job for blueprint-management-hub

  Also adapt PAE job to new script

Signed-off-by: Ricardo Noriega <rnoriega@redhat.com>
Change-Id: I71566641949b401501b6248ca466de699aa49a93

4 years agoMerge "Don't run instance collection on deploy jobs"
Eric Ball [Thu, 5 Nov 2020 22:24:00 +0000 (22:24 +0000)]
Merge "Don't run instance collection on deploy jobs"

4 years agoDon't run instance collection on deploy jobs 02/3802/6
James E. Blair [Mon, 19 Oct 2020 21:47:47 +0000 (14:47 -0700)]
Don't run instance collection on deploy jobs

The deploy jobs are run on dedicated hosts that don't have the
pre-requisites needed by the lf-infra-publishers (eg, facter,
xmlstarlet, click).  This change adds the contents of the
lf-infra-publish macro except for these post-build scripts:

  - lf-infra-sysstat
  - lf-infra-package-listing
  - lf-infra-capture-instance-metadata

And uses a modified log ship builder (Nexus only, not S3)
with fewer dependencies.

Signed-off-by: James E. Blair <jeblair@redhat.com>
Change-Id: Ia7603a70fbe1993d154d2bbafa50026be1627599

4 years agoAdd arm64 builder with aarch64_{build,dev} labels 03/3803/1
Eric Ball [Wed, 21 Oct 2020 00:52:45 +0000 (17:52 -0700)]
Add arm64 builder with aarch64_{build,dev} labels

Change-Id: I688c595d3d226481adb45b0e5eef5624e2d1c964
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
4 years agoAdd ubuntu18.04-arm64 to packer builds 98/3798/1
Eric Ball [Thu, 15 Oct 2020 20:48:21 +0000 (13:48 -0700)]
Add ubuntu18.04-arm64 to packer builds

Issue: LF-Jira RELENG-3240
Change-Id: Icf980d0269d1f521c0631145aa1a56ee341b0959
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
4 years agoUpdate global-jjb to 0.57.4,common-packer to 0.7.0 97/3797/1
Eric Ball [Thu, 15 Oct 2020 20:46:16 +0000 (13:46 -0700)]
Update global-jjb to 0.57.4,common-packer to 0.7.0

Change-Id: Icfe153e0ed559007827788dbebd6512c1a6799bd
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
4 years agoUse kni-cloud node for cloud jobs 94/3794/1
James E. Blair [Wed, 14 Oct 2020 16:33:53 +0000 (09:33 -0700)]
Use kni-cloud node for cloud jobs

And kni-baremetal for baremetal jobs.  The two long-lived jenkins
nodes prd-kni-baremetal-1 and -2 are different; one has cloud
credentials, the other is for bare metal deployments.  Use the
more specific kni-cloud and kni-baremetal labels (already present
on the nodes) to select them for the appropriate jobs.

Signed-off-by: James E. Blair <jeblair@redhat.com>
Change-Id: I20c9601934e8e9b5bdb89c56ef168985891c4fdd

4 years agoRemove KNI job that is no longer needed 93/3793/1
Ricardo Noriega [Tue, 13 Oct 2020 10:22:40 +0000 (12:22 +0200)]
Remove KNI job that is no longer needed

Signed-off-by: Ricardo Noriega <rnoriega@redhat.com>
Change-Id: Ib9d6e92d8df11c3b3fc02b4a382b770db3029658

4 years agoChange labels for new Jenkins slaves 79/3779/2
Ricardo Noriega [Thu, 1 Oct 2020 11:31:26 +0000 (13:31 +0200)]
Change labels for new Jenkins slaves

Signed-off-by: Ricardo Noriega <rnoriega@redhat.com>
Change-Id: I2412be59f6150c481fa987d0bfc745b00a1c1868

4 years agoUpdate global-jjb to the latest v0.57.3 05/3705/3
Anil Belur [Thu, 10 Sep 2020 04:36:09 +0000 (14:36 +1000)]
Update global-jjb to the latest v0.57.3

Update defaults with the required inputs for the openstack-cron
job email notifications.

Change-Id: Ic9c3dc0272abdc4d817fc32bf4da45a7979ae966
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
4 years agoRemove unused cloud builder configs & packer jobs 64/3664/1
Eric Ball [Thu, 6 Aug 2020 21:10:52 +0000 (14:10 -0700)]
Remove unused cloud builder configs & packer jobs

Since these are not being used anywhere in ci-management, they no
longer need to be maintained. This will simplify maintenance, and the
builders can always be re-added if they become necessary again.

Change-Id: I04a0dffc2672eb84958b6279081b858d4f2f8cf5
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
4 years agoFix instance volume to a size that works 63/3663/1
Andrew Grimberg [Wed, 5 Aug 2020 23:50:18 +0000 (16:50 -0700)]
Fix instance volume to a size that works

Change-Id: I41093f9d84db3a9d95becf7a9d73cb2baad40ab5
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
4 years agoUpdate cloud images to use a volume and v2 flavors 62/3662/1
Andrew Grimberg [Wed, 5 Aug 2020 23:19:39 +0000 (16:19 -0700)]
Update cloud images to use a volume and v2 flavors

Change-Id: Ife2ba1f36406a39a9c60d4a13ffed125d13825c7
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
4 years agoClone missing iec repo if not found 24/3624/2
Ciprian Barbu [Thu, 16 Jul 2020 06:20:15 +0000 (09:20 +0300)]
Clone missing iec repo if not found

Make sure iec repo is present for rec clusters.

At the same time, make sure K8S_MASTER_IP is exported in the ssh session
shell when running the install script

Signed-off-by: Ciprian Barbu <ciprian.barbu@enea.com>
Change-Id: I962359fc954198912faf589bee20c6f528b4875d

4 years agoFix KNI CI jobs 08/3608/2
Ricardo Noriega [Thu, 2 Jul 2020 10:53:44 +0000 (12:53 +0200)]
Fix KNI CI jobs

Currently the repo is pointing to github, not gerrit
so refs are not working.

Signed-off-by: Ricardo Noriega <rnoriega@redhat.com>
Change-Id: Iedf209eb326bd643e9ebe4b3b57448ac683b92e7

4 years agoMerge "iec: fuel: Map new UNH baremetal POD to IEC xDFs"
Eric Ball [Wed, 24 Jun 2020 20:46:45 +0000 (20:46 +0000)]
Merge "iec: fuel: Map new UNH baremetal POD to IEC xDFs"

4 years agoiec, rec: Abstract out common seba_on_arm usecase 81/3581/9
Alexandru Avadanii [Wed, 17 Jun 2020 12:52:01 +0000 (14:52 +0200)]
iec, rec: Abstract out common seba_on_arm usecase

- move seba_on_arm IEC usecase to its own macros/templates files;
- enable seba_on_arm install/test jobs for REC deployments running
  on aarch64 baremetal nodes;
- replace dashes with underscores in jjb variables that need to be
  handled by the jinja2 parser, since jinja2 does not allow dashes
  in variable names;

While at it, add vim temporary files ('*.sw?') to .gitignore.

Change-Id: I62ae4ebfd4955fb484876e3a63c8f02a77e90b38
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
4 years agoiec: fuel: Map new UNH baremetal POD to IEC xDFs 87/3587/1
Alexandru Avadanii [Thu, 18 Jun 2020 16:30:46 +0000 (18:30 +0200)]
iec: fuel: Map new UNH baremetal POD to IEC xDFs

Change-Id: Ibdb345e3eb9fc12be4782414c7f5fa51c333f0d4
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
4 years agoGracefully stop the remote-installer container 65/3565/3
Alexandru Antone [Thu, 11 Jun 2020 13:52:48 +0000 (16:52 +0300)]
Gracefully stop the remote-installer container

Force killing the container with 'rm -f' bypasses the SIGTERM handler
defined in the container's entry point shell script which would
gracefully stop the nfs-server before exiting.

This leaves TCP port 2049 bound on some hosts and subsequent runs of
the remote-installer will fail to properly start NFS shares.

Signed-off-by: Alexandru Antone <Alexandru.Antone@enea.com>
Change-Id: I56d77ffabdb901504193c5e5d6b7d0f73d52488d

4 years agovalidation: Enable validation for REC in UNH lab 55/3555/2
Alexandru Avadanii [Tue, 9 Jun 2020 12:25:45 +0000 (14:25 +0200)]
validation: Enable validation for REC in UNH lab

Add new jobs for running the validation jobs on the REC POD in UNH
lab, similar to running validation jobs on the IEC PODs in Enea lab.

The new job(s) will upload the logs to nexus.akraino.org in the
'unh' lab silo.

Change-Id: I99fcc4854ead367fad8d203eb448908b229d6781
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
4 years agoMerge "validation:Fix jobs cleanup issue with permissions"
Eric Ball [Tue, 26 May 2020 20:51:10 +0000 (20:51 +0000)]
Merge "validation:Fix jobs cleanup issue with permissions"

4 years agovalidation:Fix jobs cleanup issue with permissions 86/3486/3
DANIEL STOICA [Tue, 19 May 2020 09:05:39 +0000 (12:05 +0300)]
validation:Fix jobs cleanup issue with permissions

Change the owner for the kube directory, because might be
owned by root, causing permission issues when Jenkins tries to
perform the workspace cleanup

Signed-off-by: DANIEL STOICA <daniel.stoica@enea.com>
Change-Id: I6fedecb633ab8ce78b03a9d8b9bec8ce9926bfcb

4 years agoRevert "Add signing to Akraino deploy templates" 85/3485/1
Eric Ball [Mon, 18 May 2020 23:05:47 +0000 (16:05 -0700)]
Revert "Add signing to Akraino deploy templates"

This reverts commit 0904fdd5e0e3b113ee90e77c646a7f156d878762.
We are seeing issues with signing very large objects (specifically,
the ISOs being pushed by TA). Until we find a solution for this,
the change needs to be reverted so that it does not cause any further
interruption to normal work.

Change-Id: Ib79b2bbc9aaca92eaf60a2a836bba5e84487ba89
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
4 years agoMerge "update 5g-mec-cloud-gaming jobs to Jenkins"
Eric Ball [Mon, 18 May 2020 23:04:11 +0000 (23:04 +0000)]
Merge "update 5g-mec-cloud-gaming jobs to Jenkins"

4 years agoAdd S3_BUCKET environment variable 84/3484/3
Houa Yang [Mon, 18 May 2020 21:55:01 +0000 (16:55 -0500)]
Add S3_BUCKET environment variable

Add S3_BUCKET variable to address "unrecognized macro" error.
Although the job passes, the error is confusing and unsightly.
The S3_BUCKET environment variable is needed for log shipping to s3.

Signed-off-by: Houa Yang <hyang@contractor.linuxfoundation.org>
Change-Id: I90af7149ab9f9e3e69491f8b37add6cfef54a826

4 years agoupdate 5g-mec-cloud-gaming jobs to Jenkins 36/3436/7
feng [Wed, 13 May 2020 16:25:25 +0000 (00:25 +0800)]
update 5g-mec-cloud-gaming jobs to Jenkins

Change-Id: Ibb074147debc66f4182cf0f74a51e3db644ae90a

4 years agoupdate 5g-mec-cloud-gaming jobs 11/3411/2
feng [Mon, 11 May 2020 01:16:24 +0000 (09:16 +0800)]
update 5g-mec-cloud-gaming jobs

Change-Id: I88bde4a3492c4de9ab99e71cbe0d031247a8c651

4 years agoMerge "Add signing to Akraino deploy templates"
Eric Ball [Fri, 8 May 2020 21:10:09 +0000 (21:10 +0000)]
Merge "Add signing to Akraino deploy templates"

4 years agovalidation:Fix jobs cleanup issue with permissions 07/3407/2
DANIEL STOICA [Fri, 8 May 2020 13:10:00 +0000 (16:10 +0300)]
validation:Fix jobs cleanup issue with permissions

Transfer only the ~/.kube/config file for k8s tests, since the rest
of contents of the "~/.kube/" directory (e.g. http-cache) might be
owned by root, causing permission issues when Jenkins tries to
perform the workspace cleanup. Since only the config file is actually
needed for running the k8s tests, skip other files/directories in
"~/.kube/"

Signed-off-by: DANIEL STOICA <daniel.stoica@enea.com>
Change-Id: Ic3d6823bd45069e66eb085a8c09383461f517d12

4 years agoMerge "Support password-based ssh auth"
Eric Ball [Wed, 6 May 2020 22:44:16 +0000 (22:44 +0000)]
Merge "Support password-based ssh auth"

4 years agoSupport password-based ssh auth 96/3396/7
DANIEL STOICA [Wed, 29 Apr 2020 11:39:15 +0000 (14:39 +0300)]
Support password-based ssh auth

Add ssh password to the run_bluval.sh script command

JIRA: VAL-106

Signed-off-by: DANIEL STOICA <daniel.stoica@enea.com>
Depends-On: I04145b32621dae49485cb8640d80932345957826
Change-Id: I0f2974cd21d59e5b6ad85be37a0e71d064ec70ab

4 years agoMerge "iec: Add robot parsing for SEBA tests"
Eric Ball [Mon, 4 May 2020 22:21:46 +0000 (22:21 +0000)]
Merge "iec: Add robot parsing for SEBA tests"

4 years agoMerge "Automation adds pcei.yaml"
Eric Ball [Mon, 4 May 2020 21:28:54 +0000 (21:28 +0000)]
Merge "Automation adds pcei.yaml"

4 years agoUpdate authentication URI endpoint 99/3399/1
Eric Ball [Mon, 4 May 2020 21:13:17 +0000 (14:13 -0700)]
Update authentication URI endpoint

Change at the hosting provider seems to have caused a problem with the
authentication URI. Removing the trailing '/' fixes the problem.

Change-Id: I7078d528672fb65cc1b68e735cdf25cc11c8e88b
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
4 years agoAutomation adds pcei.yaml 28/3328/2
LF Jenkins CI [Mon, 4 May 2020 19:08:57 +0000 (19:08 +0000)]
Automation adds pcei.yaml

Change-Id: I34ca6643323313df6087de9177d3caae8c1eb6c2
Signed-off-by: lf-jobbuilder <releng+lf-jobbuilder@linuxfoundation.org>
4 years agoAdd signing to Akraino deploy templates 93/3393/3
Eric Ball [Wed, 29 Apr 2020 01:17:53 +0000 (18:17 -0700)]
Add signing to Akraino deploy templates

Since Akraino projects do not follow standard release procedures, we
will simply sign the artifacts before pushing them to Nexus, just to
provide signatures showing that all artifacts come from LF infra.

Change-Id: Ia3478900acd02d419fe49c25b1902b1a3459f73d
Issue-ID: LF-Jira RELENG-2819
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
4 years agoAutomation adds 5g-mec-cloud-gaming.yaml 25/3325/2
LF Jenkins CI [Wed, 29 Apr 2020 20:28:52 +0000 (20:28 +0000)]
Automation adds 5g-mec-cloud-gaming.yaml

Change-Id: I287f0d3682819fe7867bfdff22941eea7d00dc32
Signed-off-by: lf-jobbuilder <releng+lf-jobbuilder@linuxfoundation.org>
4 years agoiec: Add robot parsing for SEBA tests 89/3389/1
Alexandru Avadanii [Mon, 27 Apr 2020 10:37:43 +0000 (12:37 +0200)]
iec: Add robot parsing for SEBA tests

Leverage the Jenkins Robot publisher for parsing the SEBA-in-a-box
test results.

While at it, disable the IEC destroy phase for baremetal deployments,
since aarch64 baremetal PODs are not shared by multiple installers the
same way virtual PODs are, hence there's no need for the in-between jobs
cleanup.

Change-Id: I264a5e4a917ca7e97c48dec18864e48e3637ab8e
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
4 years agoAdded ealt-edge repo verify job 88/3388/1
Srinivasan Selvam [Mon, 27 Apr 2020 07:51:52 +0000 (13:21 +0530)]
Added ealt-edge repo verify job

Signed-off-by: Srinivasan Selvam <srinivasan.s.n@huawei.com>
Change-Id: Iaaabeaa5cb1ba4213d24a84a55e5b5fb6e9bc25f

4 years agoMerge "Remove libvirt provider jobs"
Eric Ball [Fri, 24 Apr 2020 23:40:24 +0000 (23:40 +0000)]
Merge "Remove libvirt provider jobs"

4 years agovalidation: iec: Pull docker images before run 83/3383/1
Alexandru Avadanii [Wed, 22 Apr 2020 13:56:31 +0000 (15:56 +0200)]
validation: iec: Pull docker images before run

Add a new 'PULL' job paramater for validation-<lab>-* jobs, as well
as 'bluval-*' jobs; set it to 'false' by default and 'true' for IEC
validation jobs since most IEC jobs run on static Jenkins slaves where
the validation docker images might already be present from previous
runs.

JIRA: VAL-107

Depends-on: Id4b7947a0de7abf07f69812c6deef71919b9041a

Change-Id: Ic2f690d6627f6ae284a27727f3c98fe03960cbda
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
4 years agoMerge "iec: view: Stop filtering out the sonar job"
Eric Ball [Tue, 21 Apr 2020 21:26:23 +0000 (21:26 +0000)]
Merge "iec: view: Stop filtering out the sonar job"

4 years agobluval: Extend job description with BP, lab, layer 77/3377/1
Alexandru Avadanii [Tue, 21 Apr 2020 16:28:42 +0000 (18:28 +0200)]
bluval: Extend job description with BP, lab, layer

bluval jobs are shared across different blueprints, labs and layers,
so display some useful information in the job history overview pane.

Change-Id: I38e7c700774765066524a99da1e5786c5fec1b58
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
4 years agoiec: view: Stop filtering out the sonar job 76/3376/1
Alexandru Avadanii [Tue, 21 Apr 2020 14:09:16 +0000 (16:09 +0200)]
iec: view: Stop filtering out the sonar job

The 'iec-sonar' job should be displayed under the IEC Jenkins view,
similar to 'iec-tox-verify-master'.

Change-Id: Icfcc0f516f638c59713601fa77e8088178980875
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
4 years agovalidation: Use blucon.sh if python3 not available 73/3373/2
Alexandru Avadanii [Sat, 18 Apr 2020 18:42:56 +0000 (20:42 +0200)]
validation: Use blucon.sh if python3 not available

The Validation project supports running the test suites using nothing
more than Docker as a prerequisite (i.e. if no python3 is available),
so leverage `blucon.sh` now that it supports overriding the validation
git repository path and results dir path.

For most slaves, the new method is merely a fail-safe, since they
already have python3.

JIRA: VAL-95

Depends-on: I4d3c10881de28c64bcca05ff23aa1025f67a1f5e

Change-Id: I08e89300637862e40344131532ec40efd5f68501
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>