ci-management.git
2 years agoClear ALT_NEXUS_URL and SERVER_ID after netrc 03/1603/1
Eric Ball [Tue, 17 Sep 2019 21:05:36 +0000 (14:05 -0700)]
Clear ALT_NEXUS_URL and SERVER_ID after netrc

After the netrc has been created, these need to be cleared so that
future calls to create-netrc aren't stuck using them. This has been
causing problems with pushing logs.

Change-Id: Ib351e38950ca0a382a006b473d8e2a703d0d6a66
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
2 years agota: multiarch build: ISO, python-peewee RPM 41/1441/9
Alexandru Avadanii [Wed, 21 Aug 2019 13:24:09 +0000 (15:24 +0200)]
ta: multiarch build: ISO, python-peewee RPM

Enable both amd64 and arm64 builds for python-peewee, which will
later be extended to all arch-dependent packages in TA.

To accomodate non-x86 ISO builds (triggered on RPM changes merge):
- rename artifacts to include the machine architecture in their
  names (e.g. bootcd.aarch64.iso, bootcd.aarch64.iso.md5 etc.),
  only applicable if $(uname -m) is not 'x86_64' so x86 artifact
  names remain unchanged (e.g. bootcd.iso);
- akraino-project-stream-type-ta: new 'arch' job parameter,
  defaulting to 'amd64', which will allow selecting the proper
  ISO build job (for arm64 TA RPM merge jobs, 'arch' should be
  set to 'arm64', while for amd64 no action is required);
- create arch-specific ISO build jobs (ta-ci-build-{amd64,arm64})
  and let the TA RPM merge jobs trigger the appropiate one;

While at it, fix some related issues:
- adjust ta-rpm-deploy.sh to publish artifacts for the
  current machine architecture (x86_64 or aarch64);
- explicitly set shell to bash where needed, e.g. where `pushd`
  bash builtin is used (otherwise it will fail on systems using
  sh as default shell);
- cleanup git repository destination before clone to allow
  re-running the jobs on non-volatile slaves;
- extend dependency package installation for Debian systems,
  not only RHEL;

Depends-on: I32cfdc2adc43fb703843383a1e94a807919f4e8c
Depends-on: I3a940e2e0ece6febc9fc90d6bbbc6ff8ef212e14

Change-Id: If3adcae723aa4932fc095cc71debdef2d28840ff
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2 years agoMerge "Add node UUI display macro"
Jessica Wagantall [Wed, 11 Sep 2019 20:12:57 +0000 (20:12 +0000)]
Merge "Add node UUI display macro"

2 years agoAdd node UUI display macro 69/1569/1
Jessica Wagantall [Wed, 11 Sep 2019 18:13:06 +0000 (11:13 -0700)]
Add node UUI display macro

Add macro to display node's UUID
Add macro to ta-ci-build

Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Change-Id: I7d6b43c771718c2458ed2405d90998403e8fdf5e

2 years agotox-verify for portal-onapsdk 27/1527/3
Ioakeim Samaras [Wed, 4 Sep 2019 07:54:27 +0000 (10:54 +0300)]
tox-verify for portal-onapsdk

Added project for using gerrit-tox-verify job template
for portal_user_interface/portal-onapsdk.

Signed-off-by: Ioakeim Samaras <ioakeim.samaras@ericsson.com>
Change-Id: I62112d947522d0226ed9ce45d7e280f662b24f5e

2 years agoCaaS registry machine update 25/1525/1
Balazs Szekeres [Tue, 3 Sep 2019 18:29:35 +0000 (20:29 +0200)]
CaaS registry machine update

CaaS registry needed a bigger machine for build. (out of memory)

Signed-off-by: Balazs Szekeres <balazs.szekeres@nokia.com>
Change-Id: Ifa9207312572501547bfc8e2ff199dc1cf1d4776

2 years agoUpgrade global-jjb v0.42.0 73/1473/1
Anil Belur [Tue, 27 Aug 2019 05:51:00 +0000 (11:21 +0530)]
Upgrade global-jjb v0.42.0

- Pull in lftools v0.26.1 to fix the issue with
  processing the patterns passed to deploy archives.

Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Change-Id: I0ffdff54e5e431e82df24d985ebfbc63ae92034c

2 years agoCreating cloudtaf.yaml 27/1327/4
amin m [Tue, 6 Aug 2019 09:48:30 +0000 (11:48 +0200)]
Creating cloudtaf.yaml

Change-Id: I64e0bfe812d96b4dbe780f74084efc4600fe357a
Signed-off-by: amin m <amin.m@nokia.com>
2 years agoMerge "Add Ubuntu 18.04 docker nodes, including arm64"
Eric Ball [Thu, 22 Aug 2019 21:47:03 +0000 (21:47 +0000)]
Merge "Add Ubuntu 18.04 docker nodes, including arm64"

2 years agoAdd Ubuntu 18.04 docker nodes, including arm64 51/1451/1
Eric Ball [Thu, 22 Aug 2019 21:14:01 +0000 (14:14 -0700)]
Add Ubuntu 18.04 docker nodes, including arm64

Not replacing ubuntu1604 docker node for now. Once these have been
heavily tested and vetted, it will be much safer to move the other
docker node to Ubuntu 18.04 & v2 hardware.

Issue: RELENG-2071
Change-Id: Id3d5d06256371948f52e2454de39d87304908bb2
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
2 years agoUpdate ta-ci-build node 49/1449/2
Jessica Wagantall [Thu, 22 Aug 2019 18:06:43 +0000 (11:06 -0700)]
Update ta-ci-build node

Add V2-32G node to the cloud.
Use 32G node to build ta-ci-build which fails to
complete the virt-copy of guest-image.img into /boot
V2-32G Helps processing this faster.

Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Change-Id: Ie679b231f5be07f53b41ece5515a2a570dcf325f

2 years agoMerge "Once nexus3 push is complete, unset alt_nexus_url"
Eric Ball [Mon, 19 Aug 2019 17:46:49 +0000 (17:46 +0000)]
Merge "Once nexus3 push is complete, unset alt_nexus_url"

3 years agoOnce nexus3 push is complete, unset alt_nexus_url 26/1426/1
Eric Ball [Sat, 17 Aug 2019 02:09:58 +0000 (19:09 -0700)]
Once nexus3 push is complete, unset alt_nexus_url

create-netrc uses the value of alt_nexus_url if it's set. We need to
remove this value so that the correct credentials are used for
pushing logs at the end of the job.

Change-Id: Ie3704f3e83226088e6b2d700c0e3ee2c5318e257
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
3 years agoFix cron setting for StarlingX 14/1414/2
Alex Kozyrev [Thu, 15 Aug 2019 19:48:34 +0000 (15:48 -0400)]
Fix cron setting for StarlingX

Change-Id: Id4c23d533a5ae957b6b5eb91e860393dca85d460
Signed-off-by: Alex Kozyrev <alex.kozyrev@windriver.com>
3 years agoincrease timeout to ci build job 11/1411/1
amin m [Thu, 15 Aug 2019 09:07:00 +0000 (11:07 +0200)]
increase timeout to ci build job

Change-Id: Ibdc37421b94a3b13457b72bd23719d82745cb1dd

3 years agoFixing bash expansion 88/1388/3
amin m [Mon, 12 Aug 2019 12:38:59 +0000 (14:38 +0200)]
Fixing bash expansion

Change-Id: Id1bb352a98cac52aab5eb9ac7621bbeadfd1b373
Signed-off-by: amin m <amin.m@nokia.com>
3 years agoUpload changed RPMs/SRPMs to Nexus 35/1335/5
amin m [Wed, 7 Aug 2019 13:16:16 +0000 (15:16 +0200)]
Upload changed RPMs/SRPMs to Nexus

Change-Id: Id71de6e22b51b843a2f05f4113f0657496cb7c06
Signed-off-by: amin m <amin.m@nokia.com>
3 years agoMerge "Modify KNI jobs to use ci in our internal repo"
Eric Ball [Tue, 6 Aug 2019 16:53:16 +0000 (16:53 +0000)]
Merge "Modify KNI jobs to use ci in our internal repo"

3 years agoMerge "Add default params for use in Sonarcloud jobs"
Eric Ball [Thu, 1 Aug 2019 21:20:12 +0000 (21:20 +0000)]
Merge "Add default params for use in Sonarcloud jobs"

3 years agoAdd default params for use in Sonarcloud jobs 10/1310/1
Eric Ball [Thu, 1 Aug 2019 20:31:55 +0000 (13:31 -0700)]
Add default params for use in Sonarcloud jobs

Change-Id: Ibcab9a106d116e450947e667bcaf282e790ffc1c
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
3 years agoAdd custom Ubuntu 18.04 arm64 packer file 97/1297/8
Eric Ball [Wed, 31 Jul 2019 20:50:06 +0000 (13:50 -0700)]
Add custom Ubuntu 18.04 arm64 packer file

The default file in common-packer calls for the flavor
"lf-standard-1", which Akraino does not have in its cloud. By
switching to an available flavor, this should fix our broken packer
build.

Change-Id: I213167072395b0985b914776068ad502aa3c8209
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
3 years agoModify KNI jobs to use ci in our internal repo 94/1294/2
Yolanda Robla [Wed, 31 Jul 2019 08:38:48 +0000 (10:38 +0200)]
Modify KNI jobs to use ci in our internal repo

The deploy scripts need to be moved to the internal repo,
in order to be reused. Also, as deploy is part of the logic
of the process and not part of the CI itself, moving them to
the internal project seems more reasonable.

Signed-off-by: Yolanda Robla <yroblamo@redhat.com>
Change-Id: Iab289664dfc48186805a168575076c74c9dd8b7d

3 years agoMerge "Update to common-packer v0.3.1, packer 1.4.2"
Eric Ball [Tue, 30 Jul 2019 22:02:45 +0000 (22:02 +0000)]
Merge "Update to common-packer v0.3.1, packer 1.4.2"

3 years agoChange compare type from REG_EXP to ANT 72/1272/1
Yolanda Robla [Fri, 26 Jul 2019 13:16:14 +0000 (15:16 +0200)]
Change compare type from REG_EXP to ANT

In order to trigger the job on file changes properly,
change the compare type from REG_EXP to ANT.

Signed-off-by: Yolanda Robla <yroblamo@redhat.com>
Change-Id: I275a9ebf08b49bb0d3672d0e321f371936c01346

3 years agoMerge "Fix typo in trigger"
Eric Ball [Wed, 24 Jul 2019 18:17:35 +0000 (18:17 +0000)]
Merge "Fix typo in trigger"

3 years agoMerge "Increase node size to fix out of memory errors"
Andrew Grimberg [Wed, 24 Jul 2019 17:03:35 +0000 (17:03 +0000)]
Merge "Increase node size to fix out of memory errors"

3 years agoFix typo in trigger 50/1250/1
Yolanda Robla [Wed, 24 Jul 2019 09:09:10 +0000 (11:09 +0200)]
Fix typo in trigger

The gerrit regex to include all files modified
in a subdir is dir/**, not dir/*

Signed-off-by: Yolanda Robla <yroblamo@redhat.com>
Change-Id: Ic81718ebab5f41fa6c02eba6bf8272f3d9d8dfba

3 years agoIncrease node size to fix out of memory errors 20/1220/2
Eric Ball [Thu, 18 Jul 2019 22:10:37 +0000 (15:10 -0700)]
Increase node size to fix out of memory errors

Both of these jobs were having issues during rpmbuild due to low
memory. Based on sandbox testing, increasing the node mem fixes
the problem.

Issue: IT-16836
Change-Id: I9751c39cd197d3ee621917f95e6dd205ec81d503
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
3 years agoAdd CentOS 7 2c-8g builder for high-RAM TA builds 49/1249/1
Eric Ball [Tue, 23 Jul 2019 21:14:59 +0000 (14:14 -0700)]
Add CentOS 7 2c-8g builder for high-RAM TA builds

Change-Id: I0fa820f552db86fd6b832f3f1c98a5fc7d721162
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
3 years agoMerge "Add missing base path on deploy jobs"
Eric Ball [Tue, 23 Jul 2019 17:07:43 +0000 (17:07 +0000)]
Merge "Add missing base path on deploy jobs"

3 years agoMerge "[iec] view: Hide downstream projects"
Eric Ball [Tue, 23 Jul 2019 17:03:19 +0000 (17:03 +0000)]
Merge "[iec] view: Hide downstream projects"

3 years agoAdd missing base path on deploy jobs 26/1226/1
Yolanda Robla [Fri, 19 Jul 2019 13:03:26 +0000 (15:03 +0200)]
Add missing base path on deploy jobs

Base is called by all the profiles and sites,
so we need to have a job triggered on it, when
this changes.

Signed-off-by: Yolanda Robla <yroblamo@redhat.com>
Change-Id: I63ec32aa13e6da0adfecd15b5b54efd7f69b29cf

3 years agoUpdate to common-packer v0.3.1, packer 1.4.2 22/1222/3
Eric Ball [Fri, 19 Jul 2019 00:19:22 +0000 (17:19 -0700)]
Update to common-packer v0.3.1, packer 1.4.2

Updating to the latest common-packer. As part of the upgrade
requirements, this includes an update to the packer version.

Change-Id: I6a2eeaacbe6ba16f58171c5f9b25500f702759b3
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
3 years agoAdd ubuntu-18.04-arm64 to docker builders list 21/1221/1
Eric Ball [Thu, 18 Jul 2019 22:59:47 +0000 (15:59 -0700)]
Add ubuntu-18.04-arm64 to docker builders list

There are several projects in need of arm64 docker builds.

Change-Id: Ie93822e06b50f7e7b3a85921770003f80b092040
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
3 years ago[iec] view: Hide downstream projects 14/1214/3
Alexandru Avadanii [Wed, 17 Jul 2019 17:22:05 +0000 (19:22 +0200)]
[iec] view: Hide downstream projects

IEC Jenkins project view is getting cluttered with all the downstream
static project jobs (e.g. deploy, destroy, install-<usecase>).

Filter only parent jobs (e.g. iec-compass-virtual-ubuntu1604-master),
which offer the best high-level visibility of the overall job status.

Change-Id: I26490baaf0e6c2dc294432804a1f7ba033e9ab6b
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
3 years agoMerge "Enable merge jobs to trigger downstream job"
Eric Ball [Thu, 18 Jul 2019 00:57:23 +0000 (00:57 +0000)]
Merge "Enable merge jobs to trigger downstream job"

3 years agoMerge "[iec] seba-on-arm: Installer/OS specific params"
Eric Ball [Wed, 17 Jul 2019 23:41:17 +0000 (23:41 +0000)]
Merge "[iec] seba-on-arm: Installer/OS specific params"

3 years agoEnable merge jobs to trigger downstream job 92/1192/2
Eric Ball [Mon, 15 Jul 2019 21:20:58 +0000 (14:20 -0700)]
Enable merge jobs to trigger downstream job

Enable all merge jobs in ta project to trigger
a downstream ta-ci-build job, so that ta-ci-build
is triggered on every successful merge.

Issue: IT-16719
Change-Id: Ib0debc513f697e0ad77d49a89329cc66bb27f46b
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
3 years agoAdd new jobs for blueprint-pae repo 10/1210/4
Yolanda Robla [Tue, 16 Jul 2019 15:01:26 +0000 (17:01 +0200)]
Add new jobs for blueprint-pae repo

The content from kni/templates has been moved to
kni/blueprint-pae. So we are creating new jobs for it
and disable the older ones. We are also updating
the shell for those jobs, to match with the current
workflow.

Signed-off-by: Yolanda Robla <yroblamo@redhat.com>
Change-Id: I597bb960b40d2f33ee78cf4129c7aed7479f4d54

3 years ago[iec] seba-on-arm: Installer/OS specific params 09/1209/2
Alexandru Avadanii [Thu, 11 Jul 2019 19:46:05 +0000 (21:46 +0200)]
[iec] seba-on-arm: Installer/OS specific params

The IEC usecase job (e.g. seba-on-arm installation) parameters should
be installer specific and OS specific, e.g. Ubuntu deployed using Fuel
defaults to 'ubuntu' user, while CentOS deployed using Fuel defaults
to 'centos'.

While at it, unify currently separate parameters for the SSH
credentials in Fuel/Compass installations and fix the IEC dir location
for Fuel.

Change-Id: I93613aacc41eb8a2cfd1662b7d76ade36c7c8090
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
3 years agoMerge "[iec, validation] verify: disable submodule clone"
Eric Ball [Tue, 16 Jul 2019 01:29:59 +0000 (01:29 +0000)]
Merge "[iec, validation] verify: disable submodule clone"

3 years agoMerge "Remove triggering job on patchsets"
Eric Ball [Mon, 15 Jul 2019 14:05:12 +0000 (14:05 +0000)]
Merge "Remove triggering job on patchsets"

3 years agoRemove triggering job on patchsets 67/1167/2
Ricardo Noriega [Thu, 11 Jul 2019 16:11:31 +0000 (18:11 +0200)]
Remove triggering job on patchsets

  This should only be triggered by comment keyword

Signed-off-by: Ricardo Noriega <rnoriega@redhat.com>
Change-Id: Ifb10ff9a2d842a16869c46b4f6f2f79aaebb2a30

3 years ago[iec, validation] verify: disable submodule clone 69/1169/1
Alexandru Avadanii [Thu, 11 Jul 2019 21:08:56 +0000 (23:08 +0200)]
[iec, validation] verify: disable submodule clone

Both IEC and the validation projects have git submodules that should
not be evaluated during the verify steps.

Change-Id: Ia28bdb08c70209b97a5759f5fbb8ed86921ed913
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
3 years agoMerge "Update global-jjb to v0.39.1"
Eric Ball [Thu, 11 Jul 2019 21:01:43 +0000 (21:01 +0000)]
Merge "Update global-jjb to v0.39.1"

3 years ago[validation] docker: Keep going after build fail 58/1158/1
Alexandru Avadanii [Wed, 10 Jul 2019 13:37:09 +0000 (15:37 +0200)]
[validation] docker: Keep going after build fail

When building all validation docker images, if one of the image builds
fails, the next image builds are currently skipped.

Keep going through all the build steps, while still exiting with a non
zero return code in case one of the steps fails.

Change-Id: Ib983ec311caaa71c9429280aa9295568380e9387
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
3 years agoFix the error when deploying VM by compass 33/1133/3
Jingzhao.Ni [Mon, 8 Jul 2019 03:11:25 +0000 (11:11 +0800)]
Fix the error when deploying VM by compass

When deploying the VM by compass, the absolute file path is too long
to find the correct file. It results in the deployment failure.
In this patch, we create a soft-link which pointed to the work file.
By this way, it could walk around this problem.

Signed-off-by: Jingzhao.Ni <Jingzhao.Ni@arm.com>
Change-Id: I74ef712d19cf5fe6161a58725b474421739777cb

3 years agoUpdate global-jjb to v0.39.1 22/1022/3
Eric Ball [Wed, 19 Jun 2019 20:55:24 +0000 (13:55 -0700)]
Update global-jjb to v0.39.1

This includes changes required for compatibility, in the form of
adding "submodule-disable" definition to all instances of
lf-infra-gerrit-scm calls.

Change-Id: I27bc9c927166f1ffb36f27ff5dfa9882052e01f9
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
3 years agoMerge "[iec] Multiple operating systems support"
Eric Ball [Wed, 3 Jul 2019 17:07:12 +0000 (17:07 +0000)]
Merge "[iec] Multiple operating systems support"

3 years agoEnabling local environment 18/1118/1
Ricardo Noriega [Wed, 3 Jul 2019 16:24:56 +0000 (18:24 +0200)]
Enabling local environment

Signed-off-by: Ricardo Noriega <rnoriega@redhat.com>
Change-Id: Ide197d8461290299555e71010ab9b970ef924832

3 years agoMerge "Job to publish binary for libvirt deploys"
Eric Ball [Tue, 2 Jul 2019 22:29:42 +0000 (22:29 +0000)]
Merge "Job to publish binary for libvirt deploys"

3 years ago[iec] Multiple operating systems support 94/1094/2
Alexandru Avadanii [Sat, 29 Jun 2019 16:31:22 +0000 (18:31 +0200)]
[iec] Multiple operating systems support

Add an `os` matrix to our IEC CI jobs, preparing for enabling
CentOS7/Ubuntu18.04 jobs in parallel to existing Ubuntu16.04.

Change-Id: I1a76fa3a187331b079aa78b2cbe58bd6bdc118a3
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
3 years agoJob to publish binary for libvirt deploys 67/967/6
Ricardo Noriega [Mon, 10 Jun 2019 14:18:08 +0000 (16:18 +0200)]
Job to publish binary for libvirt deploys

  This job will be only triggered with the keyword
  `build-binary` located in any comment. This job will be
  usually triggered when there is a version bump.

Signed-off-by: Ricardo Noriega <rnoriega@redhat.com>
Change-Id: Iaf06365b44e3853ebbe524afb8b7ef39dc902cb7

3 years agoRemove useless software when installing OS 59/1059/1
Jingzhao.Ni [Wed, 26 Jun 2019 11:00:10 +0000 (19:00 +0800)]
Remove useless software when installing OS

In k8-nosdn-nofeature-noha.yml files, there is a list
of software which are not essential for IEC prjects,
it was removed for accelerating VM deployment speed.

Signed-off-by: Jingzhao.Ni <Jingzhao.Ni@arm.com>
Change-Id: Ie74a63e565bd560deea4f2bb6e70d7384d65d476

3 years agoAdd JJB for remote-installer docker build 33/1033/1
re2429 [Fri, 21 Jun 2019 17:50:26 +0000 (13:50 -0400)]
Add JJB for remote-installer docker build

Signed-off-by: re2429 <re2429@att.com>
Change-Id: Ibdf575c229aa584119657bbd0759c00e367840a0

3 years agoEnable docker daemon experimental features 23/1023/1
Ferenc Tóth [Thu, 20 Jun 2019 08:21:38 +0000 (10:21 +0200)]
Enable docker daemon experimental features

`docker build --squash` requires docker daemon experimental mode enabled.
(This is valid for builder systems only, the product remains intact.)

Signed-off-by: Ferenc Tóth <ferenc.2.toth@nokia.com>
Change-Id: I130832123d460716e938c0dbcec6cdbfdd4ab7e6

3 years agoFix bug & Modify VM configuration 02/1002/1
Jingzhao.Ni [Mon, 17 Jun 2019 09:40:56 +0000 (17:40 +0800)]
Fix bug & Modify VM configuration

1. The "docker ps" command without sudo privilege causes getting wrong
 docker id.
2. Modify the virtual cpu number and virtual memory capacity up to
 12G

Signed-off-by: Jingzhao.Ni <Jingzhao.Ni@arm.com>
Change-Id: Ic3af4ef06fc32a8101d78257ce7d300826f1f7fc

3 years agoMerge "Deploy SEBA on compass task"
Eric Ball [Thu, 13 Jun 2019 14:45:06 +0000 (14:45 +0000)]
Merge "Deploy SEBA on compass task"

3 years agoDeploy SEBA on compass task 89/989/1
jialv01 [Thu, 13 Jun 2019 09:53:16 +0000 (17:53 +0800)]
Deploy SEBA on compass task

Deploy seba into community CI/CD platform

Signed-off-by: Jianlin Lv <Jianlin.Lv@arm.com>
Change-Id: I17fa9bae5a5a0b65ef5af790b4e1b8f75e9a6f7a

3 years agoRemove the NODE_NAME judgement in compass scripts 85/985/1
Jingzhao.Ni [Wed, 12 Jun 2019 15:27:34 +0000 (23:27 +0800)]
Remove the NODE_NAME judgement in compass scripts

Remove the NODE_NAME judgement in the scripts.

Signed-off-by: Jingzhao.Ni <Jingzhao.Ni@arm.com>
Change-Id: I348f09e961f75e534f69b9e34867bce011d6c531

3 years agoRun StarlingX validation weekly 80/980/1
Alex Kozyrev [Tue, 11 Jun 2019 17:27:09 +0000 (13:27 -0400)]
Run StarlingX validation weekly

Change-Id: I0d5e0a84545c0add7eddc1f28aec5e383f7b3a52

3 years agoMerge "Declare NODE_NAME environment variable"
Eric Ball [Tue, 11 Jun 2019 13:11:59 +0000 (13:11 +0000)]
Merge "Declare NODE_NAME environment variable"

3 years agoDeclare NODE_NAME environment variable 66/966/2
Jingzhao.Ni [Mon, 10 Jun 2019 13:01:07 +0000 (21:01 +0800)]
Declare NODE_NAME environment variable

Undeclaring NODE_NAME parameter results in the wrong network
configuration used which will cause deploying failure when
deploying hosts. In this patch, "arm-virtual-host" will be
assigned to NODE_NAME for fixing this error.
At the same time, a bug in iec installation script was resolved.

Signed-off-by: Jingzhao.Ni <Jingzhao.Ni@arm.com>
Change-Id: I79b638cfa41e650e0c08e601a8efb7635922cca0

3 years agoMerge "Fixes to run in node, and in workspace"
Eric Ball [Mon, 10 Jun 2019 22:11:26 +0000 (22:11 +0000)]
Merge "Fixes to run in node, and in workspace"

3 years agoFixes to run in node, and in workspace 63/963/1
Yolanda Robla [Fri, 7 Jun 2019 15:00:18 +0000 (17:00 +0200)]
Fixes to run in node, and in workspace

Switched the deployment to 1-node, for less memory
requirements.
Also fix some issues with WORKSPACE and GOPATH

Signed-off-by: Yolanda Robla <yroblamo@redhat.com>
Change-Id: I1f5b572f0be0dea69d9ffd78d2c4ff5b634a5144

3 years agoMerge "[iec] Add Fuel uninstall script & build step"
Eric Ball [Fri, 7 Jun 2019 14:46:50 +0000 (14:46 +0000)]
Merge "[iec] Add Fuel uninstall script & build step"

3 years agoMerge "Add new job for deploying libvirt"
Eric Ball [Fri, 7 Jun 2019 14:16:59 +0000 (14:16 +0000)]
Merge "Add new job for deploying libvirt"

3 years agoAdd new job for deploying libvirt 30/930/11
Yolanda Robla [Mon, 3 Jun 2019 09:23:06 +0000 (11:23 +0200)]
Add new job for deploying libvirt

It includes verify and merge jobs, to execute a deploy
on libvirt on a third-party CI.

Signed-off-by: Yolanda Robla <yroblamo@redhat.com>
Change-Id: I0c331f36eb7461cceb6cfdab50bc54ae0a0b96c6

3 years agoMerge "Change installer/binary jobs from merge to verify"
Eric Ball [Wed, 5 Jun 2019 20:03:24 +0000 (20:03 +0000)]
Merge "Change installer/binary jobs from merge to verify"

3 years agoChange installer/binary jobs from merge to verify 46/946/2
Yolanda Robla [Wed, 5 Jun 2019 09:14:04 +0000 (11:14 +0200)]
Change installer/binary jobs from merge to verify

The value of these jobs is to launch a brief test each time
a patch lands, they do not provide any value on merge. So changing
the naming and the behaviour to achieve that.

Signed-off-by: Yolanda Robla <yroblamo@redhat.com>
Change-Id: I4c2f42ecdac9abdb9c3696ce62d870f632529293

3 years agoMerge "Try to fix "sudo pip xxx" problem on CI platform"
Eric Ball [Wed, 5 Jun 2019 18:36:03 +0000 (18:36 +0000)]
Merge "Try to fix "sudo pip xxx" problem on CI platform"

3 years ago[iec] Add Fuel uninstall script & build step 47/947/3
Alexandru Avadanii [Mon, 27 May 2019 15:47:28 +0000 (17:47 +0200)]
[iec] Add Fuel uninstall script & build step

- add iec-fuel-destroy.sh, responsible for uninstalling Fuel resources
  from the jumpserver;
- move Compass uninstall step after usecase(s) step(s);
- rework `deploy_type` matrix to be installer-agnostic and introduce
  a new `installer` matrix;
- add blocking threshold for usecase(s) step(s) so destroy step is
  always performed;

Change-Id: Ifaba336e436131a8ac9e871e706c0b8234b617ed
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
3 years agoTry to fix "sudo pip xxx" problem on CI platform 36/936/2
Jingzhao.Ni [Tue, 4 Jun 2019 02:53:50 +0000 (10:53 +0800)]
Try to fix "sudo pip xxx" problem on CI platform

The main purpose of this patch is trying to fix the problem about
"sudo pip xxxx" error. In this patch, the following things will be
done.
1. Add a function which is used for checking pip environments in
   iec-compass-build.sh.
   The check_env function was added in iec-compass-build.sh file.
   It will be used for checking whether there is any error when
   running "sudo pip xxx" and "pip xxx" command. If error existed,
   the pip software will be reinstall.

2. Remove the "sed" command which is used for replaceing the "sudo
   pip xxx" command.
   Since the compass requires some software which need to be run on
   sudo mode, there is no need to replace those "sudo" command by
   "python -m pip install xxx". So the replace cmd was removed.

Signed-off-by: Jingzhao.Ni <Jingzhao.Ni@arm.com>
Change-Id: I384e8213926e86ec9aafbcf20c3586291f63e016

3 years agoAdd Jenkins job for StarlingX blueprint 40/940/2
Alex Kozyrev [Tue, 4 Jun 2019 14:15:37 +0000 (10:15 -0400)]
Add Jenkins job for StarlingX blueprint

Signed-off-by: Alex Kozyrev <alex.kozyrev@windriver.com>
Change-Id: Ic88e39fab56c9e6499469f75c6b706446a55e857

3 years ago[validation] docker: Fix manifest push wildcard 02/902/1
Alexandru Avadanii [Thu, 30 May 2019 13:34:28 +0000 (16:34 +0300)]
[validation] docker: Fix manifest push wildcard

The `make -C docker/*/. something` is expanded to
`make -C docker/firstsubdir/. docker/secondsubdir/. something`,
which leads to `make` interpreting the second directory as a
target name instead of running in that directory.
Switch to an explicit sh for loop to avoid this.

Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
Change-Id: I7ae64f37b27079994c150b7d98af683d89b5c173

3 years agoMerge "Replace the root command with user mode"
Eric Ball [Tue, 28 May 2019 17:18:44 +0000 (17:18 +0000)]
Merge "Replace the root command with user mode"

3 years agoReplace the root command with user mode 55/855/3
Jingzhao.Ni [Mon, 27 May 2019 12:31:16 +0000 (20:31 +0800)]
Replace the root command with user mode

The "sudo pip install" command cause some error when deploying
compass. So replace the "sudo pip install" with the "python -m
 pip install pyyaml" command.

Signed-off-by: Jingzhao.Ni <Jingzhao.Ni@arm.com>
Change-Id: Ia86e5a8b1c75e6367d044e94e356f7d1a855418e

3 years ago[ta] Add "remerge" trigger to TA merge jobs 54/854/1
Saku Chydenius [Mon, 27 May 2019 12:23:35 +0000 (15:23 +0300)]
[ta] Add "remerge" trigger to TA merge jobs

Signed-off-by: Saku Chydenius <saku.chydenius@nokia.com>
Change-Id: I61131d86bed58e1408015443aff50bedd64b23ce

3 years ago[ta] Store more image build result artifacts 53/853/1
Saku Chydenius [Sun, 26 May 2019 16:33:16 +0000 (19:33 +0300)]
[ta] Store more image build result artifacts

All image build result files are included except the big images.

Change-Id: Icf6ef47ec688bfbd9727a3851c3b09d569594746
Signed-off-by: Saku Chydenius <saku.chydenius@nokia.com>
3 years agoMerge "[ta] Move image build job to a bigger build minion"
Eric Ball [Fri, 24 May 2019 19:01:07 +0000 (19:01 +0000)]
Merge "[ta] Move image build job to a bigger build minion"

3 years ago[ta] Install build time dependencies to slaves 28/828/1
Saku Chydenius [Fri, 24 May 2019 12:02:20 +0000 (15:02 +0300)]
[ta] Install build time dependencies to slaves

These are required when building TA ISO image

Change-Id: Ib5405b4ccea13dc99f460200d29a432e9bd3cb18
Signed-off-by: Saku Chydenius <saku.chydenius@nokia.com>
3 years agoMerge "Add new job for deploying kni on AWS"
Eric Ball [Thu, 23 May 2019 15:18:04 +0000 (15:18 +0000)]
Merge "Add new job for deploying kni on AWS"

3 years agoRevert "Revert Add DOCKERHUB_REGISTRY global var" 04/804/1
Eric Ball [Thu, 23 May 2019 14:39:50 +0000 (07:39 -0700)]
Revert "Revert Add DOCKERHUB_REGISTRY global var"

This reverts commit 0971296e4eb80b08195fc7c28045c900908ff11f.

Change-Id: Ie7a2302c879b3512bff73d68d957bde3042182e9
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
3 years agoAdd new job for deploying kni on AWS 93/593/8
Yolanda Robla [Thu, 2 May 2019 07:23:43 +0000 (09:23 +0200)]
Add new job for deploying kni on AWS

Change-Id: Ieae618b9dfe99880f218cb409d328106633419e8
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
3 years agoMerge "Add IEC Foundation Framework Deployment Work"
Eric Ball [Thu, 23 May 2019 14:08:45 +0000 (14:08 +0000)]
Merge "Add IEC Foundation Framework Deployment Work"

3 years agoMerge "[ta] Increase slave size for selected components"
Eric Ball [Thu, 23 May 2019 14:05:40 +0000 (14:05 +0000)]
Merge "[ta] Increase slave size for selected components"

3 years agoRevert "Add DOCKERHUB_REGISTRY global var to pro" 98/798/1
Anil Belur [Thu, 23 May 2019 09:34:56 +0000 (19:34 +1000)]
Revert "Add DOCKERHUB_REGISTRY global var to pro"

Revert "Add DOCKERHUB_REGISTRY global var to prod Jenkins"
This reverts commit f538ce85786c51fd6fbcd5e07e53d701c07e43a5.

The change is causing docker jobs to fail.
https://jira.linuxfoundation.org/browse/IT-16409

Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Change-Id: Ib30eefea1b74bf6e8bd9e8e7c98be185dd9af27c

3 years agoAdd IEC Foundation Framework Deployment Work 97/797/5
trevor tao [Thu, 23 May 2019 08:48:10 +0000 (16:48 +0800)]
Add IEC Foundation Framework Deployment Work

Add IEC foundation deployment working scripts for
IEC working environment and related verification to
the environment.

Signed-off-by: trevor tao <trevor.tao@arm.com>
Change-Id: I40b255cd9412b75deb052acd01932fddec06a826
Signed-off-by: trevor tao <trevor.tao@arm.com>
3 years ago[ta] Move image build job to a bigger build minion 29/829/4
Ossi Koivistoinen [Fri, 24 May 2019 14:18:21 +0000 (17:18 +0300)]
[ta] Move image build job to a bigger build minion

TA image build job runs out of memory when the executor
has 8 GB memory. It has been tested to work with 16 GB.

Change-Id: Idc7a5855f47c6c0e539677a71dd989627985c14d
Signed-off-by: Ossi Koivistoinen <ossi.koivistoinen@nokia.com>
3 years ago[ta] Increase slave size for selected components 90/790/2
Saku Chydenius [Thu, 23 May 2019 06:27:08 +0000 (09:27 +0300)]
[ta] Increase slave size for selected components

These components were either timing out or getting out-of-memory while
building the RPM.

Signed-off-by: Saku Chydenius <saku.chydenius@nokia.com>
Change-Id: I15c12fbf33ba2b74767dca48e0ff59687a19af6d

3 years agoMerge "[iec] Trigger all usecases in parent jobs"
Eric Ball [Thu, 23 May 2019 01:24:52 +0000 (01:24 +0000)]
Merge "[iec] Trigger all usecases in parent jobs"

3 years agoMerge "[ta] Moved RPMs to Nexus3"
Eric Ball [Wed, 22 May 2019 22:27:34 +0000 (22:27 +0000)]
Merge "[ta] Moved RPMs to Nexus3"

3 years agoMerge "Add DOCKERHUB_REGISTRY global var to prod Jenkins"
Eric Ball [Wed, 22 May 2019 20:54:38 +0000 (20:54 +0000)]
Merge "Add DOCKERHUB_REGISTRY global var to prod Jenkins"

3 years ago[ta] Moved RPMs to Nexus3 80/780/2
raghuramamendru [Fri, 17 May 2019 06:14:33 +0000 (01:14 -0500)]
[ta] Moved RPMs to Nexus3

Includes:
- TA RPMs moved from Nexus2 to Nexus3
- "ta-settings" used instead of "images-snapshots-settings"

Change-Id: I07cd86f09ec8fc0aa43c0f0b8eb328dfa8102edf
Signed-off-by: raghuramamendru <raghurama.mendru@nokia.com>
3 years agoMerge "Add 3 virtual hosts into IEC CI/CD platform"
Eric Ball [Wed, 22 May 2019 17:53:57 +0000 (17:53 +0000)]
Merge "Add 3 virtual hosts into IEC CI/CD platform"

3 years agoMerge "[iec] Publish logs to LF Nexus"
Eric Ball [Wed, 22 May 2019 17:05:28 +0000 (17:05 +0000)]
Merge "[iec] Publish logs to LF Nexus"

3 years agoAdd 3 virtual hosts into IEC CI/CD platform 74/774/4
Jingzhao.Ni [Wed, 22 May 2019 02:09:31 +0000 (10:09 +0800)]
Add 3 virtual hosts into IEC CI/CD platform

In this patch, the 3 virtual host was deployed on CI platform.
Firstly, it add the 3rd host into k8-nosdn-nofeature-noha.yml
confiugration file.
Secondly, it modifies the confiugration file for avoiding install
K8s by compass.

Signed-off-by: Jingzhao.Ni <Jingzhao.Ni@arm.com>
Change-Id: I5b1b6d4140a37182137325668b4bc7076c8b4f1d

3 years agoAdd DOCKERHUB_REGISTRY global var to prod Jenkins 73/773/1
Eric Ball [Wed, 22 May 2019 00:46:20 +0000 (17:46 -0700)]
Add DOCKERHUB_REGISTRY global var to prod Jenkins

Change-Id: I5d16e3fe8bce4e0ec5105a020cf23b55d49595a2
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
3 years agoMerge "[ta] Add TA verify and merge jobs"
Eric Ball [Tue, 21 May 2019 20:41:29 +0000 (20:41 +0000)]
Merge "[ta] Add TA verify and merge jobs"

3 years ago[ta] Add TA verify and merge jobs 08/708/24
Saku Chydenius [Wed, 15 May 2019 13:54:42 +0000 (16:54 +0300)]
[ta] Add TA verify and merge jobs

Includes:

    - TA-specific macros and templates to akraino_templates/

    - Verify and merge jobs for all the "ta/*" git repositories that
      produce RPMs. Merge jobs will upload RPMs to Nexus repository
      "images-snapshots".

    - Verify jobs for the three supporting tool and configuration git
      repositories ta/{manifest|build-tools|rpmbuilder}

    - Image build job to produce the TA end product: ISO image

    - Publish ISO images to Nexus

    - Moved shell scripts to jjb/shell

Signed-off-by: Saku Chydenius <saku.chydenius@nokia.com>
Change-Id: I2b1ecd6f34c2dd5f5c8fbb9ff09ab180d943a3d9