ci-management.git
4 years agoFix build failure issue in community CI 68/2268/1
Jingzhao [Mon, 2 Mar 2020 14:39:48 +0000 (22:39 +0800)]
Fix build failure issue in community CI

In compass building script, the curl command gets file as
an incorrectly format from URL which finally results in
the compass building failure.

In this patch, the script file will be download by wget.
Then it will be run as a scripts by bash.

Signed-off-by: Jingzhao <Jingzhao.Ni@arm.com>
Change-Id: I8bd49cb818a3c67a7e752a6a1e5521dc570e57b9

4 years agoMerge "Add job for KNI blueprint on Google Cloud"
Eric Ball [Sat, 29 Feb 2020 00:31:28 +0000 (00:31 +0000)]
Merge "Add job for KNI blueprint on Google Cloud"

4 years agoAdd job for KNI blueprint on Google Cloud 61/2261/1
Ricardo Noriega [Thu, 27 Feb 2020 09:53:00 +0000 (10:53 +0100)]
Add job for KNI blueprint on Google Cloud

Signed-off-by: Ricardo Noriega <rnoriega@redhat.com>
Change-Id: Id5b37f86f73c27a8d25cdc0d879ad842075e2e04

4 years agota: iso: Workaround kernel missing read rights 58/2258/2
Alexandru Avadanii [Tue, 25 Feb 2020 17:48:15 +0000 (18:48 +0100)]
ta: iso: Workaround kernel missing read rights

libguestfs requires read access to the current running kernel,
as described in [1].

While at it, install missing rename dependency.

[1] https://bugs.launchpad.net/fuel/+bug/1467579

Change-Id: Ic0c9095e35dd740d48ddf83add530456a5cae92d
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
4 years agoMerge "Move iec jenkins job in jjb/akraino-templates"
Eric Ball [Tue, 25 Feb 2020 15:25:37 +0000 (15:25 +0000)]
Merge "Move iec jenkins job in jjb/akraino-templates"

4 years agoMerge "iec: compass: Fix log permissions, curl redirect"
Eric Ball [Tue, 25 Feb 2020 15:23:38 +0000 (15:23 +0000)]
Merge "iec: compass: Fix log permissions, curl redirect"

4 years agoMove iec jenkins job in jjb/akraino-templates 54/2254/7
Daniel Stoica [Mon, 24 Feb 2020 12:49:09 +0000 (14:49 +0200)]
Move iec jenkins job in jjb/akraino-templates

Signed-off-by: Daniel Stoica <daniel.stoica@enea.com>
Change-Id: I86539d875ccb91536f79894438bc45dca474b32b

4 years agoiec: compass: Fix log permissions, curl redirect 56/2256/1
Alexandru Avadanii [Tue, 25 Feb 2020 09:01:27 +0000 (10:01 +0100)]
iec: compass: Fix log permissions, curl redirect

- follow HTTP redirect (`curl -L`) where appropiate;
- fix workspace permissions so logs uploading can archive log files
  before pushing them to Nexus (by changing the file owner to the
  current user/group);
- destroy: do not break on error, in case some resources are missing,
  keep trying to cleanup the rest anyway;

Change-Id: I7696b3ce7172b74f5b8977353ad27b70b264933b
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
4 years agostatic slaves: Perform global-jjb init 50/2250/4
Alexandru Avadanii [Fri, 21 Feb 2020 12:31:15 +0000 (13:31 +0100)]
static slaves: Perform global-jjb init

global-jjb was recently bumped to 0.51, which assumes
jenkins-init-scripts were already executed on the build slave
(e.g. by sourcing ~jenkins/lf-env.sh), which is always true for
Openstack instances dynamically spawned by Jenkins, but not yet
for static slaves like AArch64 dev/build/baremetal PODs.

Add a new job, triggered on ci-management gerrit merge (only if
global-jjb reference is changed) that executes the jenkins-init-scripts
similar to dynamic slaves initialization.

NOTE: Since jenkins-init-scripts are not fully idempotent, some
actions (e.g. id_rsa keypair generation) are executed even though
they are not mandatory (for the id_rsa keypair this means the
private/public keys will be forcefully regenerated each time this new
job runs).

Change-Id: I62433a45c7966aed1d1184fa60e87ee4211996e4
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
4 years agota: login shell, filename expansion enabled 53/2253/2
Alexandru Avadanii [Sun, 23 Feb 2020 15:26:18 +0000 (16:26 +0100)]
ta: login shell, filename expansion enabled

Recent global-jjb bumps introduced changes to python-tools-install.sh
which now disables filename expansion (globbing).
Since TA RPM merge / ISO build jobs combine python-tools-install.sh and
other sh script files into a single build step (i.e. resulting a single
sh script), this breaks globbing for the TA RPM/ISO upload handling.

Also, since python-tools-install.sh does not run as a login shell (`bash
-l`), ~/.profile is not sourced and PATH might be missing certain paths
like ~/.local/bin, where `lftools` is located, resulting in build
failures due to missing/not found `lftools`.

To mitigate the above issues:
1. split the offending build step into 2 separate steps
to allow spawning the second step under a login shell (without modifying
python-tools-install.sh);
2. Run the second step under a login shell, so PATH contains `lftools`
installed by pip;
3. Add `set +f` to enable globbing (this is not critical after splitting
the build step above, since python-tools-install.sh disabling globbing
will no longer affect the second step; but it should make it more
obvious that the script *requires* globbing);

Change-Id: I4a5e6a4a88a296cb21d68338f8e5a5b219076308
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
4 years agoUpdate global-jjb to v0.51.1 47/2247/2
Eric Ball [Thu, 20 Feb 2020 20:17:51 +0000 (12:17 -0800)]
Update global-jjb to v0.51.1

This will ensure compatibility will all of the latest Jenkins
plugins.

Change-Id: Ibee61d798ad14841a8e4d929557c877fd869b854
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
4 years agoMerge "[validation] Improve relationship between jobs"
Eric Ball [Thu, 20 Feb 2020 18:45:56 +0000 (18:45 +0000)]
Merge "[validation] Improve relationship between jobs"

4 years ago[validation] Improve relationship between jobs 42/2242/2
Cristina Pauna [Tue, 18 Feb 2020 14:21:31 +0000 (16:21 +0200)]
[validation] Improve relationship between jobs

- Added a fix so that when bluval-run-daily-tests job fails, the upstream
akraino-validation-lab-daily job also fails.
- Made the validation parameters more generic (the tests can be ran on
openstack too, not just on k8s clusters)
- Moved the templates from the project folder to the templates folder

JIRA: VAL-98

Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
Change-Id: I915ff9a0347e20390b297483b39a051f39fdf205

4 years agoTA: aarch64 RPM/ISO build jobs: voting, email 34/2234/6
Alexandru Avadanii [Tue, 11 Feb 2020 13:29:15 +0000 (14:29 +0100)]
TA: aarch64 RPM/ISO build jobs: voting, email

1. Enable gerrit voting for TA patches verify jobs (RPM builds);
2. E-mail armband@enea.com on arm64 (aarch64) job failures for:
   - TA RPM merge jobs (not verify);
   - TA ISO build;

Change-Id: I6a3f668001698e42bb6b87f31e03191fcb6559bc
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
4 years agoTA: aarch64 dedicated build server 32/2232/1
Alexandru Avadanii [Tue, 11 Feb 2020 12:27:58 +0000 (13:27 +0100)]
TA: aarch64 dedicated build server

Move TA RPM/ISO build jobs from `aarch64_dev`-labeled nodes to a new
dedicated build machine labeled `aarch64_build`.

Change-Id: I011ed992a43240b1ae644d788c47c0aaf8713aaf
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
4 years agoCI/CD for ARC portal 13/2213/1
Ioakeim Samaras [Wed, 29 Jan 2020 02:49:24 +0000 (18:49 -0800)]
CI/CD for ARC portal

The following jenkins jobs are supported

- Common maven jobs
- Building and uploading the docker images

Signed-off-by: Ioakeim Samaras <is661a@att.com>
Change-Id: Icf140349432a5aa6f293acbfeec7c5f9f426ec29

4 years agoFix issue related to substring search 06/2206/2
valentin.radulescu [Tue, 21 Jan 2020 20:23:51 +0000 (12:23 -0800)]
Fix issue related to substring search

JIRA:VAL-78

Signed-off-by: valentin.radulescu <valentin.radulescu@enea.com>
Change-Id: I17dee3c41a2046927b085205c096507452560506

4 years agoMerge "[validation] Disable jobs for tag"
Eric Ball [Mon, 20 Jan 2020 20:16:14 +0000 (20:16 +0000)]
Merge "[validation] Disable jobs for tag"

4 years agoStore blu-val results in nexus. 19/2019/7
valentin.radulescu [Wed, 20 Nov 2019 15:23:53 +0000 (07:23 -0800)]
Store blu-val results in nexus.

After the tests are run, the results are put in an archive
and pushed in nexus.
JIRA:VAL-78

Signed-off-by: valentin.radulescu <valentin.radulescu@enea.com>
Change-Id: I1021f30f560ec67433e83f22b14877b340f489c7

4 years agoMerge "Add log parser support"
Eric Ball [Thu, 16 Jan 2020 18:57:12 +0000 (18:57 +0000)]
Merge "Add log parser support"

4 years agoAdd log parser support 00/2100/18
valentin.radulescu [Fri, 6 Dec 2019 13:32:22 +0000 (05:32 -0800)]
Add log parser support

JIRA: VAL-90

Signed-off-by: valentin.radulescu <valentin.radulescu@enea.com>
Change-Id: I111f5aab331156c201cb5f855492aee1dcb45236

4 years agoRestore the sonar config to just use the default 86/2186/2
Trevor Tao [Fri, 10 Jan 2020 02:46:23 +0000 (10:46 +0800)]
Restore the sonar config to just use the default

Remove the unneccesary sonar config as those files are not available
now, and we can just use the default

Signed-off-by: Trevor Tao <trevor.tao@arm.com>
Change-Id: I248f4f2762d3ebaae9493df000f7ed3b4d010f2d
Signed-off-by: Trevor Tao <trevor.tao@arm.com>
4 years agoFix build-blocker level param typos 64/2164/1
Alexandru Avadanii [Tue, 17 Dec 2019 19:27:36 +0000 (20:27 +0100)]
Fix build-blocker level param typos

s/blocking-level/block-level/g as per [1].

[1] https://docs.openstack.org/infra/jenkins-job-builder/properties.html

Change-Id: Iea628d0a7c8b3285ece13280abdda1aa85dbea2b
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
4 years agoMerge "Add new job to deploy kni on baremetal"
Eric Ball [Tue, 17 Dec 2019 16:43:32 +0000 (16:43 +0000)]
Merge "Add new job to deploy kni on baremetal"

4 years agoAdd new job to deploy kni on baremetal 31/2031/10
Yolanda Robla [Wed, 20 Nov 2019 16:16:55 +0000 (17:16 +0100)]
Add new job to deploy kni on baremetal

This commit add jobs for the kni blueprints to
be ran using the baremetal profile

Signed-off-by: Yolanda Robla <yroblamo@redhat.com>
Change-Id: I8449bbad86f6297717b508a2b608359e56f2aac5

4 years agoAutomation adds INFO jobs 31/2131/34
LF Jenkins CI [Mon, 16 Dec 2019 18:49:43 +0000 (18:49 +0000)]
Automation adds INFO jobs

Automation adds INFO.yaml management jobs for all
top level projects.

This is the first step before adding INFO.yaml
files for all these top level projects
to allow committers to self manage their
committers

Change-Id: Ife7ac9815fb85c3bfde9f3c7960d605f7668c653
Signed-off-by: lf-jobbuilder <releng+lf-jobbuilder@linuxfoundation.org>
4 years agoMerge "Add Sonarcloud scans for IEC"
Eric Ball [Thu, 12 Dec 2019 17:41:21 +0000 (17:41 +0000)]
Merge "Add Sonarcloud scans for IEC"

4 years agoAdd Sonarcloud scans for IEC 88/2088/6
Jianlin Lv [Tue, 3 Dec 2019 02:52:06 +0000 (10:52 +0800)]
Add Sonarcloud scans for IEC

Setup gerrit-sonar job in JJB that scan golang file of IEC

Signed-off-by: Jianlin Lv <Jianlin.Lv@arm.com>
Change-Id: I7742e0146a342620dfb38e4fd20d3739a889c227

4 years agoFix icn-daaas trigger paths 21/2121/1
Eric Ball [Thu, 12 Dec 2019 00:38:23 +0000 (16:38 -0800)]
Fix icn-daaas trigger paths

This also renames the templates file to the blueprint level, and
moves the project file into the correct directory.

Issue: LF-Jira IT-18489
Change-Id: I40f480eebd2a5511fc7442a67b8e49d09ea9ad40
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
4 years agoAdd CI job templates for icn/daaas 11/2111/2
Dileep Ranganathan [Tue, 10 Dec 2019 00:27:37 +0000 (16:27 -0800)]
Add CI job templates for icn/daaas

Added verify, merge jobs for helm charts and microservices.

Issue-ID: ICN-201
Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com>
Change-Id: I0a9e201a2d13aca1bcbf997108ff00abd480a413

4 years ago[validation] Disable jobs for tag 03/2103/1
Cristina Pauna [Mon, 9 Dec 2019 12:08:30 +0000 (14:08 +0200)]
[validation] Disable jobs for tag

The 2.0.1 images have been built so there's no reason to keep running
the jenkins jobs for them.

Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
Change-Id: I3193e46766a92e71d79a83f5c55a5f20fd3663f6

4 years agoAdd ubuntu1804-helm build image 02/2102/1
Dileep Ranganathan [Sat, 7 Dec 2019 01:03:47 +0000 (17:03 -0800)]
Add ubuntu1804-helm build image

Added ubuntu1804-helm-8c-32g build image config.

Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com>
Change-Id: Ibe28c8466bc131a2937f09ff015321a1d790a7d3

4 years agoFixed issue in packer provision playbook 01/2101/1
Dileep Ranganathan [Sat, 7 Dec 2019 00:00:06 +0000 (16:00 -0800)]
Fixed issue in packer provision playbook

Added missing golang checksum
Fixed formatting

Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com>
Change-Id: Id48daf88d412897608b248ad4b8dbcb5063a1555

4 years agoMerge "[validation] Build images for 2.0.1 tag"
Eric Ball [Fri, 6 Dec 2019 22:22:58 +0000 (22:22 +0000)]
Merge "[validation] Build images for 2.0.1 tag"

4 years agoAdd helm build image 97/2097/3
Dileep Ranganathan [Fri, 6 Dec 2019 01:20:25 +0000 (17:20 -0800)]
Add helm build image

Added helm build image

Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com>
Change-Id: I238b96c4f9af04f08efeec8717b89b3f5dd4e639

4 years ago[validation] Build images for 2.0.1 tag 98/2098/1
Cristina Pauna [Fri, 6 Dec 2019 10:03:22 +0000 (12:03 +0200)]
[validation] Build images for 2.0.1 tag

Created a new tag for the validation project to include bug-fixes to LTP
and OS layer.

Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
Change-Id: I39aa93e183cddbecc9ca4463067bda2a7475dfa7

4 years agoiec: compass: Bump docker-compose to 1.24.1 93/2093/1
Alexandru Avadanii [Thu, 5 Dec 2019 09:28:34 +0000 (10:28 +0100)]
iec: compass: Bump docker-compose to 1.24.1

Since IEC CI jobs run on the same Jenkins static slaves where TA REC
artifact building occurs, installing `docker-compose` and its
requirements (including python-requests) via `sudo pip install`
creates a conflict that breaks TA ISO upload (see upstream bug
linked below).

Bump docker-compose to a newer version, which will stop forcefully
downgrading the python-requests package, working around the original
issue.

Upstream-bug: https://jira.linuxfoundation.org/browse/RELENG-2558

Change-Id: Ic449f3d43c5df45846b7008db50efcbcd339c3f9
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
4 years agoBump go version to latest ones 70/2070/3
Yolanda Robla [Thu, 28 Nov 2019 11:54:09 +0000 (12:54 +0100)]
Bump go version to latest ones

For latest code to run it is needed to have latest
go version. So bumping that, and also adding a
removal of the previous go versions that can give
conflict.

Signed-off-by: Yolanda Robla <yroblamo@redhat.com>
Change-Id: Iba8b8e5c460d9b917a96d757ba3f7c9827afcec6

4 years agoMerge "Fixed bug related to icn/daaas jjb template"
Eric Ball [Tue, 3 Dec 2019 00:21:25 +0000 (00:21 +0000)]
Merge "Fixed bug related to icn/daaas jjb template"

4 years agoMerge "Fix iec view bug & Remove useless file"
Eric Ball [Mon, 2 Dec 2019 22:05:50 +0000 (22:05 +0000)]
Merge "Fix iec view bug & Remove useless file"

4 years agoiec: Fix multiple predefined params mix up 80/2080/1
Alexandru Avadanii [Mon, 2 Dec 2019 09:31:30 +0000 (10:31 +0100)]
iec: Fix multiple predefined params mix up

When multiple predefined parameters are defined, multiline
markup should be used to prevent them mixing up.

Change-Id: I1c784335ea5bff3b61f10d64c2aae9ec29622379
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
4 years agoFix iec view bug & Remove useless file 67/2067/5
jingzhao [Thu, 28 Nov 2019 02:02:14 +0000 (10:02 +0800)]
Fix iec view bug & Remove useless file

The deleted file is a softlink which pointed to compass-work folder.
In compass-work folder, there is a log file which can not be
compressed since the priviledge problem. It results pushing log failure.
So, we have to remove this softlink.

Signed-off-by: jingzhao <Jingzhao.Ni@arm.com>
Change-Id: I7c568728fa7aa1da1c1aa982a12c0cfb1e23aca5

4 years agoFixed bug related to icn/daaas jjb template 66/2066/1
Dileep Ranganathan [Thu, 28 Nov 2019 00:16:19 +0000 (16:16 -0800)]
Fixed bug related to icn/daaas jjb template

Job not being picked up due to wrong path.

Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com>
Change-Id: I3174e669cf3b69cd4ff3f26e5f91e55d92b5f1a3

4 years agoMerge "Add verify job for icn/daaas"
Eric Ball [Wed, 27 Nov 2019 22:44:20 +0000 (22:44 +0000)]
Merge "Add verify job for icn/daaas"

4 years agoMerge "Change owner of results folder and its files"
Eric Ball [Wed, 27 Nov 2019 22:33:35 +0000 (22:33 +0000)]
Merge "Change owner of results folder and its files"

4 years agoMerge "IEC jobs in Akraino Lab"
Eric Ball [Wed, 27 Nov 2019 22:32:07 +0000 (22:32 +0000)]
Merge "IEC jobs in Akraino Lab"

4 years agoAdd verify job for icn/daaas 64/2064/1
Dileep Ranganathan [Wed, 27 Nov 2019 22:28:20 +0000 (14:28 -0800)]
Add verify job for icn/daaas

Added verify job for icn/daaas

Signed-off-by: Dileep Ranganathan <dileep.ranganathan@intel.com>
Change-Id: I34e7b46d3b76b28af335503c05a1fd7cd63b84a6

4 years agoChange owner of results folder and its files 55/2055/4
valentin.radulescu [Tue, 26 Nov 2019 15:17:44 +0000 (07:17 -0800)]
Change owner of results folder and its files

JIRA: VAL-88

Remove the trap from the script. Change the owner after the
scripts exists.

Signed-off-by: valentin.radulescu <valentin.radulescu@enea.com>
Change-Id: I9284c041c436f7ca173b61e3d5d87fdc85581ebb

4 years agota: aarch64 ISO build: Bump timeout from 2h to 3h 62/2062/1
Alexandru Avadanii [Wed, 27 Nov 2019 17:40:54 +0000 (18:40 +0100)]
ta: aarch64 ISO build: Bump timeout from 2h to 3h

aarch64 ISO build usually takes 1h30-1h45, but depending on upstream
mirrors it might take more than 2h. Bump the job timeout accordingly.

Change-Id: I8ccb4575340ff3718582e24ca6b501734cb63867
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
4 years agoMerge "iec: Fix current build parameter passing"
Eric Ball [Tue, 26 Nov 2019 16:57:20 +0000 (16:57 +0000)]
Merge "iec: Fix current build parameter passing"

4 years agoIEC jobs in Akraino Lab 46/2046/2
jingzhao [Mon, 25 Nov 2019 10:14:49 +0000 (18:14 +0800)]
IEC jobs in Akraino Lab

In this patch, some modifications are completed based on the R2
requirements.
1. The IEC type is added into name of jenkins jobs.
2. The new IEC-type1 job is added into Akraino CI/CD.
   The IEC-type1 job is designed to verify the IEC task on Edge
   node. In this job, 2 VMs will be started for simulating the
   Low-power remote-edge nodes in the host. After that, the IEC
   basic infrastructure will be deployed on it for verifying the
   user case.

Signed-off-by: jingzhao <Jingzhao.Ni@arm.com>
Change-Id: Ida4a22a1c39a8171f2fd48cde79aa8dd7008b707

4 years agoMerge "ta: iso deploy: Fix artifact name in checksum file"
Eric Ball [Mon, 25 Nov 2019 22:41:51 +0000 (22:41 +0000)]
Merge "ta: iso deploy: Fix artifact name in checksum file"

4 years agoMerge "[validation] Build release images"
Eric Ball [Mon, 25 Nov 2019 22:40:43 +0000 (22:40 +0000)]
Merge "[validation] Build release images"

4 years agoiec: Fix current build parameter passing 50/2050/2
Alexandru Avadanii [Mon, 25 Nov 2019 20:28:11 +0000 (21:28 +0100)]
iec: Fix current build parameter passing

The Parameterized Trigger plugin requires parameters that are
passed down from the parent job to also be defined in the child job,
otherwise they are simply discarded.

Fix this by explicitly defining the same parameters in each child job.

Change-Id: I64ba6987527757bb0bf4e7d5224904424c91f3ec
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
4 years agota: iso deploy: Fix artifact name in checksum file 49/2049/1
Alexandru Avadanii [Mon, 25 Nov 2019 18:12:14 +0000 (19:12 +0100)]
ta: iso deploy: Fix artifact name in checksum file

On non-x86_64 platforms, we rename the artifacts (and their
corresponding checksum files) to include the platform architecture
in their names.

However, the contents of the checksum files should also be updated
to reflect the new artifact naming.

Change-Id: I2fb2fc8feb6299f3ee2dc26cc2fe7df929e4509a
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
4 years ago[validation] Build release images 98/1998/7
Cristina Pauna [Mon, 18 Nov 2019 13:23:17 +0000 (15:23 +0200)]
[validation] Build release images

The tag for the release has been made for the validation project at [1]
Added the jobs that will build the container images from this tag
Also moved the project templates in the akraino-templates folder

[1] https://gerrit.akraino.org/r/admin/repos/validation,tags

Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
Change-Id: Ia6a1750a37ff8deabfe87667a0d8d91efe4ca8ce

4 years agoUpdate icn unit test job 11/2011/1
chengli3 [Wed, 20 Nov 2019 02:04:52 +0000 (10:04 +0800)]
Update icn unit test job

1. Remove individual feature test plan. Because Jenkins can't vote
for multiple jobs. For example, we have two jobs for two different
features. If one job passes but another fails, Jenkins can't vote
both +1 and -1. So this patch merges all tests into a single one,
which follows the Akraino comminuty template.

2. Add icn view

Signed-off-by: chengli3 <cheng1.li@intel.com>
Change-Id: Ide8aa3fd9edd19bd3886bce622d9172c469768b7

4 years agoChange owner of results folder and its files. 79/1979/2
valentin.radulescu [Thu, 14 Nov 2019 11:58:53 +0000 (03:58 -0800)]
Change owner of results folder and its files.

JIRA: VAL-88

The files in results folder are created by root in container.

Signed-off-by: valentin.radulescu <valentin.radulescu@enea.com>
Change-Id: I9d7b9450c6ae379a8f41492d84f037e3557ef032

4 years agoAdd triggers to ci-build job. 30/1930/1
Tamas Lendvay [Thu, 7 Nov 2019 09:55:15 +0000 (11:55 +0200)]
Add triggers to ci-build job.

Triggers if manifest and build-tools repo changed.

Signed-off-by: Tamas Lendvay <tamas.lendvay@nokia.com>
Issue: REC-30
Change-Id: I8ba22ddc541c9c8d03fb95dd8ddbcdbf223b9e6b
Signed-off-by: Tamas Lendvay <tamas.lendvay@nokia.com>
4 years agoMerge "Update parameters for validation-enea-daily."
Eric Ball [Thu, 31 Oct 2019 18:19:38 +0000 (18:19 +0000)]
Merge "Update parameters for validation-enea-daily."

4 years agoUpdate parameters for validation-enea-daily. 77/1877/2
valentin.radulescu [Wed, 30 Oct 2019 11:56:05 +0000 (04:56 -0700)]
Update parameters for validation-enea-daily.

Signed-off-by: valentin.radulescu <valentin.radulescu@enea.com>
Change-Id: I323ca0a51baa5f1c1e7882de6e6cc3667bc328f8

4 years agota: Avoid dpkg/apt race conditions on static slave 82/1882/2
Alexandru Avadanii [Wed, 30 Oct 2019 19:00:06 +0000 (20:00 +0100)]
ta: Avoid dpkg/apt race conditions on static slave

AArch64 slaves running the TA RPM/ISO build jobs are static and
have two executors, allowing TA build jobs to run into DPKG/APT
race conditions.

Avoid this by skipping all DEB installations if the required
packages are already installed.

Change-Id: I0bb21c6e99dd43e0fbbf9abb5f1a2599255079f9
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
4 years agoMerge "Add ci validation script"
Eric Ball [Mon, 28 Oct 2019 21:16:22 +0000 (21:16 +0000)]
Merge "Add ci validation script"

4 years agoAdd ci validation script 57/1657/10
valentin.radulescu [Thu, 26 Sep 2019 15:59:57 +0000 (08:59 -0700)]
Add ci validation script

Add run_bluval.sh which triggers validation script.
Add jobs for iec.

Signed-off-by: valentin.radulescu <valentin.radulescu@enea.com>
Change-Id: I26338e7b6038149d4f122f7e5a4df978ca73d678

4 years agoAdd verify and merge jobs for ta/caas-storage. 50/1850/1
Tamas Lendvay [Fri, 25 Oct 2019 13:17:53 +0000 (16:17 +0300)]
Add verify and merge jobs for ta/caas-storage.

Signed-off-by: Tamas Lendvay <tamas.lendvay@nokia.com>
Change-Id: I8e71f3f65e7ac426129f252e0d30762c26c776f3
Signed-off-by: Tamas Lendvay <tamas.lendvay@nokia.com>
4 years agoMerge "Add new job to verify blueprint-basic-3-masters"
Eric Ball [Wed, 23 Oct 2019 16:37:33 +0000 (16:37 +0000)]
Merge "Add new job to verify blueprint-basic-3-masters"

4 years agoMerge "Clean the docker images after CI build."
Eric Ball [Tue, 22 Oct 2019 17:52:36 +0000 (17:52 +0000)]
Merge "Clean the docker images after CI build."

4 years agoClean the docker images after CI build. 13/1813/2
Daniel Stoica [Mon, 21 Oct 2019 12:50:39 +0000 (15:50 +0300)]
Clean the docker images after CI build.

JIRA: VAL-52

Signed-off-by: Daniel Stoica <daniel.stoica@enea.com>
Change-Id: Idc11e7b59567d892c8bc8fb7cc3d9822a5d208d0

4 years agoMerge "Merge job scm pull origin/master/HEAD"
Eric Ball [Fri, 18 Oct 2019 18:48:43 +0000 (18:48 +0000)]
Merge "Merge job scm pull origin/master/HEAD"

4 years agoMerge job scm pull origin/master/HEAD 98/1798/2
Tamas Lendvay [Thu, 17 Oct 2019 13:54:26 +0000 (16:54 +0300)]
Merge job scm pull origin/master/HEAD

Issue: REC-453
Change-Id: I1eb1368952868f5caa3e33e06003ab35e852b901
Signed-off-by: Tamas Lendvay <tamas.lendvay@nokia.com>
4 years agoMerge "Create icn project jenkins job"
Eric Ball [Thu, 17 Oct 2019 17:31:05 +0000 (17:31 +0000)]
Merge "Create icn project jenkins job"

4 years agoAdd new job to verify blueprint-basic-3-masters 80/1780/3
Yolanda Robla [Mon, 14 Oct 2019 12:14:22 +0000 (14:14 +0200)]
Add new job to verify blueprint-basic-3-masters

Create a set of jobs to verify the 3 masters
blueprint, in a similar way as blueprint-pae

Signed-off-by: Yolanda Robla <yroblamo@redhat.com>
Change-Id: I9bd8e21b9f8aa04664a10ad7428fdc222bf10439

4 years agoCreate icn project jenkins job 94/1794/10
chengli3 [Wed, 16 Oct 2019 13:50:40 +0000 (21:50 +0800)]
Create icn project jenkins job

Signed-off-by: chengli3 <cheng1.li@intel.com>
Change-Id: I92855e58c7197881425f6d3dfb805a5bac8adb34

4 years agoMerge "Migrate current Sonar jobs to Sonarcloud"
Eric Ball [Wed, 16 Oct 2019 23:09:48 +0000 (23:09 +0000)]
Merge "Migrate current Sonar jobs to Sonarcloud"

4 years agoUpgrade global-jjb to v0.45.0 75/1775/1
Eric Ball [Sat, 12 Oct 2019 00:41:36 +0000 (17:41 -0700)]
Upgrade global-jjb to v0.45.0

This will add the latest Sonar jobs, which will enable adding
Sonarcloud scans to Akraino projects.

Change-Id: Ie1ffd77cb83aae0d60e5e516559e05de32278eb8
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
4 years agoUpdate centos7-builder image 38/1738/1
Eric Ball [Fri, 4 Oct 2019 19:55:44 +0000 (12:55 -0700)]
Update centos7-builder image

Change-Id: Ia8a1644c575c403ea1f6f260643ef0d6c83c098b
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
4 years agoUpdate common-packer to latest master 30/1730/1
Eric Ball [Thu, 3 Oct 2019 18:52:14 +0000 (11:52 -0700)]
Update common-packer to latest master

The current version is out of date, and the latest changes are needed
for a successful build.

Change-Id: Id92fbe47bcac81bd3751decf0abc1022c1bee9b7
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
4 years agota: Bump builders RAM for problematic RPMs 84/1684/1
Alexandru Avadanii [Tue, 1 Oct 2019 00:04:08 +0000 (02:04 +0200)]
ta: Bump builders RAM for problematic RPMs

Some RPM packages run into OOM issues while building bigger artifacts
so bump their RAM accordingly:
- caas-cpupooler;
- caas-etcd;
- caas-kubedns;
- caas-metrics;

Change-Id: Id3b74044e183963615245e8e23fee9f10811a29f
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
4 years agota-builder-rpm: Update CentOS mirror/vault repo 52/1652/1
Alexandru Avadanii [Wed, 25 Sep 2019 21:36:16 +0000 (23:36 +0200)]
ta-builder-rpm: Update CentOS mirror/vault repo

CentOS just moved certain repositories to the Vault, so update
our hardcoded RPM URL accordingly.

Change-Id: Iceb0ba15bfc9299b45c26cfb07bad644770160f6
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
4 years agoAdd "https://" to RPM_REPO_URL 16/1616/1
Eric Ball [Wed, 18 Sep 2019 23:31:55 +0000 (16:31 -0700)]
Add "https://" to RPM_REPO_URL

Change-Id: I684687a2f242e8bd85c1686bb954f83e0e97691c
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
4 years agoMerge "ta: Make arm64 RPM verify jobs non-voting"
Eric Ball [Wed, 18 Sep 2019 16:49:46 +0000 (16:49 +0000)]
Merge "ta: Make arm64 RPM verify jobs non-voting"

4 years agoMerge "shell: ta-rpm-deploy: curl should follow redirects"
Eric Ball [Wed, 18 Sep 2019 16:44:46 +0000 (16:44 +0000)]
Merge "shell: ta-rpm-deploy: curl should follow redirects"

4 years agota: Make arm64 RPM verify jobs non-voting 09/1609/1
Alexandru Avadanii [Wed, 18 Sep 2019 12:25:42 +0000 (14:25 +0200)]
ta: Make arm64 RPM verify jobs non-voting

arm64 RPM builds are not yet ready for all projects, yielding false
verify job failures, so make them non-voting, at least until we
finish upstreaming all the required changes for TA RPMs to build
on aarch64.

build-tools/manifest/rpmbuilder verify jobs will remain as voting
jobs, since they should already work fine on aarch64.

Change-Id: I6549edbc409017d031dcc46020034033a9e58a20
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
4 years agolf-display-node-uuid: Do not fail on static slaves 08/1608/1
Alexandru Avadanii [Wed, 18 Sep 2019 10:46:28 +0000 (12:46 +0200)]
lf-display-node-uuid: Do not fail on static slaves

Not all Jenkins slaves are Openstack instances, which will obviously
break the jobs trying to print the node's UUID.
So make the UUID querying non-critical.

Fixes: a919490352dbd01f08d0b78e935ef90778c77dff

Change-Id: I1bb7f3414c18e2477a2b7bb55bd242c06431f614
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
4 years agoshell: ta-rpm-deploy: curl should follow redirects 07/1607/1
Alexandru Avadanii [Wed, 18 Sep 2019 10:35:05 +0000 (12:35 +0200)]
shell: ta-rpm-deploy: curl should follow redirects

Currently, `curl` exits with a 0 status code for HTTP/301, which is
the case for both existent and non-existent artifacts in nexus3,
breaking the logic behind duplicate artifact checking.

This should fix uploading aarch64 artifacts, which are currently
wrongly detected as duplicates due to the above quirk.

Change-Id: I6b3164476b4fcb95115934eda72d53edf102858b
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
4 years agoAdd RPM_REPO_URL global variable 04/1604/1
Eric Ball [Tue, 17 Sep 2019 23:03:44 +0000 (16:03 -0700)]
Add RPM_REPO_URL global variable

The ta-rpm-deploy.sh script is using ALT_NEXUS_URL to point to this
URL, which is causing issues elsewhere in some jobs. What we really
want is to set this globally, and have scripts use this global var
rather than setting their own.

Change-Id: I9b0017b42421610e4537063140b3d6d37421c21b
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
4 years agoMerge "Clear ALT_NEXUS_URL and SERVER_ID after netrc"
Eric Ball [Tue, 17 Sep 2019 21:37:21 +0000 (21:37 +0000)]
Merge "Clear ALT_NEXUS_URL and SERVER_ID after netrc"

4 years agoClear ALT_NEXUS_URL and SERVER_ID after netrc 03/1603/1
Eric Ball [Tue, 17 Sep 2019 21:05:36 +0000 (14:05 -0700)]
Clear ALT_NEXUS_URL and SERVER_ID after netrc

After the netrc has been created, these need to be cleared so that
future calls to create-netrc aren't stuck using them. This has been
causing problems with pushing logs.

Change-Id: Ib351e38950ca0a382a006b473d8e2a703d0d6a66
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
4 years agoMerge "shell: ta-rpm-deploy: Cleanup stale duplicates dir"
Eric Ball [Tue, 17 Sep 2019 18:35:05 +0000 (18:35 +0000)]
Merge "shell: ta-rpm-deploy: Cleanup stale duplicates dir"

4 years agoshell: ta-rpm-deploy: Cleanup stale duplicates dir 94/1594/1
Alexandru Avadanii [Mon, 16 Sep 2019 22:06:32 +0000 (00:06 +0200)]
shell: ta-rpm-deploy: Cleanup stale duplicates dir

Cleanup duplicates directories if present from previous runs, e.g.
on static Jenkins slaves.

Change-Id: I18512b7e9152de37f3e73cc66bcc06c2657a3138
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
4 years agota: Multiarch (amd64, arm64) for all packages 34/1534/5
Alexandru Avadanii [Wed, 4 Sep 2019 16:18:29 +0000 (18:18 +0200)]
ta: Multiarch (amd64, arm64) for all packages

Although most packages are arch-independent, since we push to
an arch-specific repository (.../aarch64/Packages or
.../x86_64/Packages), we need to run all verify/merge build jobs on
aarch64 too.

Change-Id: Idb6d36ee5e60df87224a1c23826bef3cf64efdde
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
4 years agota: multiarch build: ISO, python-peewee RPM 41/1441/9
Alexandru Avadanii [Wed, 21 Aug 2019 13:24:09 +0000 (15:24 +0200)]
ta: multiarch build: ISO, python-peewee RPM

Enable both amd64 and arm64 builds for python-peewee, which will
later be extended to all arch-dependent packages in TA.

To accomodate non-x86 ISO builds (triggered on RPM changes merge):
- rename artifacts to include the machine architecture in their
  names (e.g. bootcd.aarch64.iso, bootcd.aarch64.iso.md5 etc.),
  only applicable if $(uname -m) is not 'x86_64' so x86 artifact
  names remain unchanged (e.g. bootcd.iso);
- akraino-project-stream-type-ta: new 'arch' job parameter,
  defaulting to 'amd64', which will allow selecting the proper
  ISO build job (for arm64 TA RPM merge jobs, 'arch' should be
  set to 'arm64', while for amd64 no action is required);
- create arch-specific ISO build jobs (ta-ci-build-{amd64,arm64})
  and let the TA RPM merge jobs trigger the appropiate one;

While at it, fix some related issues:
- adjust ta-rpm-deploy.sh to publish artifacts for the
  current machine architecture (x86_64 or aarch64);
- explicitly set shell to bash where needed, e.g. where `pushd`
  bash builtin is used (otherwise it will fail on systems using
  sh as default shell);
- cleanup git repository destination before clone to allow
  re-running the jobs on non-volatile slaves;
- extend dependency package installation for Debian systems,
  not only RHEL;

Depends-on: I32cfdc2adc43fb703843383a1e94a807919f4e8c
Depends-on: I3a940e2e0ece6febc9fc90d6bbbc6ff8ef212e14

Change-Id: If3adcae723aa4932fc095cc71debdef2d28840ff
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
4 years agoMerge "Add node UUI display macro"
Jessica Wagantall [Wed, 11 Sep 2019 20:12:57 +0000 (20:12 +0000)]
Merge "Add node UUI display macro"

4 years agoAdd node UUI display macro 69/1569/1
Jessica Wagantall [Wed, 11 Sep 2019 18:13:06 +0000 (11:13 -0700)]
Add node UUI display macro

Add macro to display node's UUID
Add macro to ta-ci-build

Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Change-Id: I7d6b43c771718c2458ed2405d90998403e8fdf5e

4 years agotox-verify for portal-onapsdk 27/1527/3
Ioakeim Samaras [Wed, 4 Sep 2019 07:54:27 +0000 (10:54 +0300)]
tox-verify for portal-onapsdk

Added project for using gerrit-tox-verify job template
for portal_user_interface/portal-onapsdk.

Signed-off-by: Ioakeim Samaras <ioakeim.samaras@ericsson.com>
Change-Id: I62112d947522d0226ed9ce45d7e280f662b24f5e

4 years agoCaaS registry machine update 25/1525/1
Balazs Szekeres [Tue, 3 Sep 2019 18:29:35 +0000 (20:29 +0200)]
CaaS registry machine update

CaaS registry needed a bigger machine for build. (out of memory)

Signed-off-by: Balazs Szekeres <balazs.szekeres@nokia.com>
Change-Id: Ifa9207312572501547bfc8e2ff199dc1cf1d4776

4 years agoUpgrade global-jjb v0.42.0 73/1473/1
Anil Belur [Tue, 27 Aug 2019 05:51:00 +0000 (11:21 +0530)]
Upgrade global-jjb v0.42.0

- Pull in lftools v0.26.1 to fix the issue with
  processing the patterns passed to deploy archives.

Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Change-Id: I0ffdff54e5e431e82df24d985ebfbc63ae92034c

4 years agoCreating cloudtaf.yaml 27/1327/4
amin m [Tue, 6 Aug 2019 09:48:30 +0000 (11:48 +0200)]
Creating cloudtaf.yaml

Change-Id: I64e0bfe812d96b4dbe780f74084efc4600fe357a
Signed-off-by: amin m <amin.m@nokia.com>
4 years agoMerge "Add Ubuntu 18.04 docker nodes, including arm64"
Eric Ball [Thu, 22 Aug 2019 21:47:03 +0000 (21:47 +0000)]
Merge "Add Ubuntu 18.04 docker nodes, including arm64"

4 years agoAdd Ubuntu 18.04 docker nodes, including arm64 51/1451/1
Eric Ball [Thu, 22 Aug 2019 21:14:01 +0000 (14:14 -0700)]
Add Ubuntu 18.04 docker nodes, including arm64

Not replacing ubuntu1604 docker node for now. Once these have been
heavily tested and vetted, it will be much safer to move the other
docker node to Ubuntu 18.04 & v2 hardware.

Issue: RELENG-2071
Change-Id: Id3d5d06256371948f52e2454de39d87304908bb2
Signed-off-by: Eric Ball <eball@linuxfoundation.org>