validation.git
4 years agoUse a more generic kubectl command to check status 99/1899/3
valentin.radulescu [Fri, 1 Nov 2019 15:14:26 +0000 (08:14 -0700)]
Use a more generic kubectl command to check status

VAL-73:
Use "kubectl version" instead of "kubectl get pods
--all-namespaces" to check status.

Signed-off-by: valentin.radulescu <valentin.radulescu@enea.com>
Change-Id: Ie7549f9af0060aa7e13e363f0a3b289e290a0bdf

5 years agoMerge "Add iec tests"
Juha Kosonen [Mon, 28 Oct 2019 12:59:13 +0000 (12:59 +0000)]
Merge "Add iec tests"

5 years agoAdd iec tests 20/1820/2
valentin.radulescu [Tue, 22 Oct 2019 13:18:51 +0000 (06:18 -0700)]
Add iec tests

Increase timeout to allow sonobuoy containers to start.

Signed-off-by: valentin.radulescu <valentin.radulescu@enea.com>
Change-Id: I82998aaa2b1a04dc99a05a2cf5144df19bf21110

5 years agoCopy helm charts from tagged version v2.15.1 61/1861/1
Juha Kosonen [Mon, 28 Oct 2019 11:41:08 +0000 (13:41 +0200)]
Copy helm charts from tagged version v2.15.1

JIRA: VAL-71

Change-Id: I0d5e3082805c3aeac24889414973032a5ee29f84
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
5 years agoRECV-110 ETCD Bluval Integration 04/1804/2
Naga Sugguna [Fri, 18 Oct 2019 19:33:57 +0000 (19:33 +0000)]
RECV-110 ETCD Bluval Integration

Change-Id: Ic88641416478271ccd71403dcd7cbcc251599801
Signed-off-by: Naga Sugguna <ns156u@att.com>
5 years agoMerge "Add remote session to etcd HA testcases"
Naga Sugguna [Fri, 18 Oct 2019 17:46:13 +0000 (17:46 +0000)]
Merge "Add remote session to etcd HA testcases"

5 years agoAdd remote session to etcd HA testcases 93/1793/1
Indumathi Buddi [Wed, 16 Oct 2019 04:54:46 +0000 (04:54 +0000)]
Add remote session to etcd HA testcases

Signed-off-by: Indumathi Buddi <ib405q@att.com>
Change-Id: I9219a85f48cb722d609793e8f43dc953328d4ae6

5 years agoAdd Redfish Robot test 81/1781/1
Juha Kosonen [Mon, 14 Oct 2019 13:27:56 +0000 (16:27 +0300)]
Add Redfish Robot test

Validate common use cases by running Redfish Usecase Checkers suite
via Redfish Test Framework.

JIRA: VAL-67

Change-Id: Ibfec4f6a70dd4dfd62fc0ceb9a871509b53a0745
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
5 years agoMerge "New container for logging"
Naga Sugguna [Thu, 10 Oct 2019 03:37:08 +0000 (03:37 +0000)]
Merge "New container for logging"

5 years agoSkip DNS domain tests 45/1745/1
Juha Kosonen [Tue, 8 Oct 2019 10:47:22 +0000 (13:47 +0300)]
Skip DNS domain tests

For the time being do not execute e2e tests which assume fixed domain
name [1] conflicting cluster's domain name. Configurability has
been implemented [2] but available only starting from k8s 1.16.

[1] https://github.com/vmware-tanzu/sonobuoy/issues/733
[2] https://github.com/kubernetes/kubernetes/pull/79284

JIRA: VAL-61

Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
Change-Id: I9b13dc7a402b3304b2b22a33a6eb8e446d3abcc6

5 years agoMerge "Switch back to 1.15 in k8s layer container"
Juha Kosonen [Mon, 7 Oct 2019 16:21:52 +0000 (16:21 +0000)]
Merge "Switch back to 1.15 in k8s layer container"

5 years agoSwitch back to 1.15 in k8s layer container 41/1741/1
Juha Kosonen [Mon, 7 Oct 2019 12:48:38 +0000 (15:48 +0300)]
Switch back to 1.15 in k8s layer container

Verification needed before version upgrade.

JIRA: VAL-65

Change-Id: I3e38a5f421a05fb3024ef83fd1c3c1d4bd267278
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
5 years ago[UI] Enable HTTPs default port 40/1740/2
Ioakeim Samaras [Mon, 7 Oct 2019 10:06:00 +0000 (13:06 +0300)]
[UI] Enable HTTPs default port

The UI should be accessible using
the default https (i.e. 443) port.

JIRA: VAL-64

Signed-off-by: Ioakeim Samaras <ioakeim.samaras@ericsson.com>
Change-Id: I48452327bca0aa7029ecaf69dd9c927ea2a27977

5 years agoMerge "[UI] Optional trust of all SSL Certificates"
Deepak Kataria [Fri, 4 Oct 2019 13:19:59 +0000 (13:19 +0000)]
Merge "[UI] Optional trust of all SSL Certificates"

5 years ago[UI] Optional trust of all SSL Certificates 36/1736/2
Ioakeim Samaras [Fri, 4 Oct 2019 09:02:51 +0000 (12:02 +0300)]
[UI] Optional trust of all SSL Certificates

The user can select whether the UI should
trust all SSL certificates or not.

JIRA: VAL-63

Signed-off-by: Ioakeim Samaras <ioakeim.samaras@ericsson.com>
Change-Id: I3d1b7dba74342550aa743f906affba7cf7ddd7fc

5 years agoSet kube-conformance back to v1.15 33/1733/2
Juha Kosonen [Fri, 4 Oct 2019 07:56:51 +0000 (10:56 +0300)]
Set kube-conformance back to v1.15

The image was upgraded in [1].

The version must be in line with target deployment's version if
internal registry is used. REC is based on 1.15 and utilize internal
registry.

[1] https://gerrit.akraino.org/r/c/validation/+/1691

Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
Change-Id: I42738c2845c874e457bf317aeb95465f93c4102b

5 years ago[UI] Handling users and passwords 27/1727/1
Ioakeim Samaras [Thu, 3 Oct 2019 13:26:17 +0000 (16:26 +0300)]
[UI] Handling users and passwords

The UI does not reset passwords on startup.
Also, only the admin user is created during startup.
Then, new users can be created by the admin.
Moreover, 3 level of privileges are supported,
namely admin, tsc and lab owner.
Finally, the admin user is enabled to reset users.

JIRA: VAL-62

Signed-off-by: Ioakeim Samaras <ioakeim.samaras@ericsson.com>
Change-Id: Ie799c5b7eedf557855cccdc5a60395ec074ac381

5 years agoNew container for logging 25/1725/1
Daniel Stoica [Thu, 3 Oct 2019 11:33:40 +0000 (14:33 +0300)]
New container for logging

Added a container basic tools needed for testing logging layer
JIRA: VAL-53

Signed-off-by: Daniel Stoica <daniel.stoica@enea.com>
Change-Id: I37e95397200ef10c0e2f53642141cb3cd3fae8cb

5 years agoMerge "[UI] Fix ONAP Portal SDK redirection bug"
Deepak Kataria [Thu, 3 Oct 2019 11:12:25 +0000 (11:12 +0000)]
Merge "[UI] Fix ONAP Portal SDK redirection bug"

5 years agodocker: manifest push: Ignore missing images 18/1718/1
Alexandru Avadanii [Thu, 3 Oct 2019 10:26:17 +0000 (12:26 +0200)]
docker: manifest push: Ignore missing images

Certain containers might lack one of the images that should be part
of the multiarch tag, so create the manifest without them and do not
bail in such scenarios.

Change-Id: Ia1094d1dfb1c998d7eda5e68c751d75ab3966c5b
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
5 years agodocker: Fix aarch64 mysql docker build/push skip 02/1702/2
Alexandru Avadanii [Wed, 2 Oct 2019 12:25:41 +0000 (14:25 +0200)]
docker: Fix aarch64 mysql docker build/push skip

The previous attempt of skipping the mysql container image build on
aarch64 did not really work.

Rework our .push_image by adding a wrapper make target, push-image,
for each docker container.

Fixes: ffc875998692929c2e4c0881aec6b68c9f2fbab8

Change-Id: I1fe2d0ad05fda224db1991d07f46653f89b5a82b
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
5 years agok8s, kube-conformance: K8s 1.16.0, Sonobuoy 1.16.1 91/1691/1
Alexandru Avadanii [Tue, 1 Oct 2019 14:17:35 +0000 (16:17 +0200)]
k8s, kube-conformance: K8s 1.16.0, Sonobuoy 1.16.1

Change-Id: I99668fff76cb899d3b58013002451bb9d473a927
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
5 years agomysql: Skip build/push on aarch64 90/1690/1
Alexandru Avadanii [Tue, 1 Oct 2019 13:46:55 +0000 (15:46 +0200)]
mysql: Skip build/push on aarch64

MySQL 5.6 is not officially available on aarch64 platforms, so
skip building/pushing the arm64 artifacts for our mysql container.

Change-Id: I21c6ae3cf33d46966e432c53f57cffc80d4d4170
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
5 years ago[UI] Fix ONAP Portal SDK redirection bug 86/1686/1
Ioakeim Samaras [Tue, 1 Oct 2019 11:57:08 +0000 (14:57 +0300)]
[UI] Fix ONAP Portal SDK redirection bug

Whenever a login redirection is needed,
the user is redirected to the UI login page.

JIRA: VAL-60

Signed-off-by: Ioakeim Samaras <ioakeim.samaras@ericsson.com>
Change-Id: I220ef9b046ff4263717877480f750b2e8299c690

5 years ago[UI] Use MySQL instead of MariaDB 62/1662/1
Ioakeim Samaras [Fri, 27 Sep 2019 12:08:58 +0000 (15:08 +0300)]
[UI] Use MySQL instead of MariaDB

The UI MariaDB database is substituted
with MySQL. In this way, the deployment
to Amazon ECS can be supported.

JIRA: VAL-58

Signed-off-by: Ioakeim Samaras <ioakeim.samaras@ericsson.com>
Change-Id: Iba311b6165a0fe09f187e7787b59739d4c353e02

5 years agoMerge "Refactor conformance robot test"
Juha Kosonen [Fri, 27 Sep 2019 11:04:37 +0000 (11:04 +0000)]
Merge "Refactor conformance robot test"

5 years ago[UI] Support user creation 58/1658/1
Ioakeim Samaras [Thu, 26 Sep 2019 16:59:59 +0000 (19:59 +0300)]
[UI] Support user creation

Creation of users is supported.
The AES PKCS#5 is used for
encrypting/decrypting passwords in database.

JIRA: VAL-57

Signed-off-by: Ioakeim Samaras <ioakeim.samaras@ericsson.com>
Change-Id: I2469eac0c2b7ab99f3853ac3a023b325c51285f2

5 years ago[UI] Prevent UI from XSS 53/1653/1
Ioakeim Samaras [Thu, 26 Sep 2019 07:26:30 +0000 (10:26 +0300)]
[UI] Prevent UI from XSS

Prevent UI from XSS (Cross-site-scripting)
attacks.

JIRA: VAL-56

Signed-off-by: Ioakeim Samaras <ioakeim.samaras@ericsson.com>
Change-Id: Iab877852f0f4c35e36a23c2cae301dffd3d57827

5 years agoRefactor conformance robot test 97/1597/6
Juha Kosonen [Tue, 17 Sep 2019 12:29:26 +0000 (15:29 +0300)]
Refactor conformance robot test

- upload and use images in internal repository if the repository
  is defined
- create sonobuoy manifest file dynamically
- increase sonobuoy timeout to avoid early abort

JIRA: VAL-48

Change-Id: I49c721bc8a4da90942167ecd835c8e5bb26f5364
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
5 years ago[UI] Encrypt passwords in db 49/1649/1
Ioakeim Samaras [Wed, 25 Sep 2019 12:35:35 +0000 (15:35 +0300)]
[UI] Encrypt passwords in db

The passwords stored in database are encrypted.
In this way, this data cannot be used by individuals
that shouldn't have access to it.

JIRA: VAL-55

Signed-off-by: Ioakeim Samaras <ioakeim.samaras@ericsson.com>
Change-Id: I3eb3b6a23398d37faa59938f84368711e7666978

5 years agoMerge "[UI] Support of HTTPS"
Naga Sugguna [Tue, 24 Sep 2019 15:49:00 +0000 (15:49 +0000)]
Merge "[UI] Support of HTTPS"

5 years ago[UI] Support of HTTPS 44/1644/2
Ioakeim Samaras [Tue, 24 Sep 2019 09:21:15 +0000 (12:21 +0300)]
[UI] Support of HTTPS

HTTPs with the appropriate SSL certificates
is supported in order to secure the connection
between the client and the UI.

JIRA: VAL-54

Signed-off-by: Ioakeim Samaras <ioakeim.samaras@ericsson.com>
Change-Id: I4fe37d98fbc5cfa45a12eef0f1af820877758f54

5 years agoMerge "send_logs script"
Ioakeim Samaras [Tue, 24 Sep 2019 06:43:12 +0000 (06:43 +0000)]
Merge "send_logs script"

5 years agosend_logs script 37/1637/2
Naga Sugguna [Fri, 20 Sep 2019 15:40:40 +0000 (15:40 +0000)]
send_logs script

Change-Id: I44d00dff3b066b21b9a0dca34deeda67254db1ed
Signed-off-by: Naga Sugguna <ns156u@att.com>
5 years agoMerge "[UI] Support data registration"
Deepak Kataria [Fri, 20 Sep 2019 18:09:40 +0000 (18:09 +0000)]
Merge "[UI] Support data registration"

5 years ago[UI] Support data registration 36/1636/2
Ioakeim Samaras [Fri, 20 Sep 2019 14:26:55 +0000 (17:26 +0300)]
[UI] Support data registration

Data regarding available labs, blueprints, versions,
layers is created/deleted/updated by the UI users
using user-friendly views.

JIRA: VAL-44

Signed-off-by: Ioakeim Samaras <ioakeim.samaras@ericsson.com>
Change-Id: Ic69e5bf9c150e51cc6d83b7ed5124632075943eb

5 years agoMerge "Generate Tempest test report"
Deepak Kataria [Fri, 20 Sep 2019 13:48:27 +0000 (13:48 +0000)]
Merge "Generate Tempest test report"

5 years agoMerge "Add etcd ha test cases"
Deepak Kataria [Wed, 18 Sep 2019 18:22:04 +0000 (18:22 +0000)]
Merge "Add etcd ha test cases"

5 years ago[UI] Common class for results 84/1584/2
Ioakeim Samaras [Mon, 16 Sep 2019 12:57:59 +0000 (15:57 +0300)]
[UI] Common class for results

A common class for Nexus and database results
is used.

JIRA: VAL-49

Signed-off-by: Ioakeim Samaras <ioakeim.samaras@ericsson.com>
Change-Id: I62e68091b0a978d721f6468a7b2bf73d899c4027

5 years agoAdd etcd ha test cases 02/802/6
Juha Kosonen [Thu, 23 May 2019 13:31:02 +0000 (16:31 +0300)]
Add etcd ha test cases

This is on par with the etcd tests for Airship on
ha/ha_etcd_api_ctl_sch.robot.

JIRA: VAL-25

Co-Authored-By: Juha Kosonen <juha.kosonen@nokia.com>
Change-Id: I492ac86d0c34b3768469c4272bfc4a502a2847f7
Signed-off-by: Indumathi Buddi <ib405q@att.com>
5 years agoFix repo url retrieval 73/1573/1
Juha Kosonen [Thu, 12 Sep 2019 08:37:34 +0000 (11:37 +0300)]
Fix repo url retrieval

Allow also non-printable characters as a field separator when listing
repositories.

JIRA: VAL-47

Change-Id: If8628fd55adc5f2d38e8680d3f96e9a0cbd5b94e
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
5 years agoMerge "Add Helm chart repository Robot tests"
Deepak Kataria [Wed, 11 Sep 2019 11:31:24 +0000 (11:31 +0000)]
Merge "Add Helm chart repository Robot tests"

5 years agoAdd Helm chart repository Robot tests 28/1528/3
Juha Kosonen [Wed, 4 Sep 2019 08:25:46 +0000 (11:25 +0300)]
Add Helm chart repository Robot tests

Verifies charts can be added and removed from a chart repository.

Tests verified on REC cluster only.

JIRA: VAL-43

Change-Id: Iad1a5771210d8d2a7386f64db57a382a8bb96054
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
5 years agoGenerate Tempest test report 61/1561/1
Juha Kosonen [Tue, 10 Sep 2019 13:04:29 +0000 (16:04 +0300)]
Generate Tempest test report

Store generated HTML report to results. Save also tempest configuration
file since this may be useful when debugging failed cases.

Change-Id: I5fefb093da8adc39ff0441b20c4e75dd8635c79b
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
5 years agoMerge "LTP integrated with bluval"
Deepak Kataria [Fri, 6 Sep 2019 15:21:42 +0000 (15:21 +0000)]
Merge "LTP integrated with bluval"

5 years ago[UI] Fix Dockerfile 45/1545/1
Ioakeim Samaras [Fri, 6 Sep 2019 07:31:23 +0000 (10:31 +0300)]
[UI] Fix Dockerfile

The new name of the built war file
is now supported

Signed-off-by: Ioakeim Samaras <ioakeim.samaras@ericsson.com>
Change-Id: I48d968c2b989f7f471f8260db49978e82831b94b

5 years agoMerge "Add Robot test for running Tempest test suite"
Naga Sugguna [Wed, 4 Sep 2019 14:47:55 +0000 (14:47 +0000)]
Merge "Add Robot test for running Tempest test suite"

5 years agoMerge "[UI] Support UI partial control"
Naga Sugguna [Tue, 3 Sep 2019 15:44:16 +0000 (15:44 +0000)]
Merge "[UI] Support UI partial control"

5 years agoMerge "Create docker layer container for Docker Bench"
Deepak Kataria [Mon, 2 Sep 2019 20:40:30 +0000 (20:40 +0000)]
Merge "Create docker layer container for Docker Bench"

5 years ago[UI] Support UI partial control 48/1248/11
Ioakeim Samaras [Tue, 23 Jul 2019 15:36:37 +0000 (18:36 +0300)]
[UI] Support UI partial control

The UI is capable of retrieving the results
from Nexus that every blueprint owner has
independently pushed.

JIRA: VAL-38

Signed-off-by: Ioakeim Samaras <ioakeim.samaras@ericsson.com>
Change-Id: I256641d1faed21025bc688a4a469f7af5f43d45f

5 years agoLTP integrated with bluval 72/1472/2
Naga Sugguna [Mon, 26 Aug 2019 15:44:51 +0000 (10:44 -0500)]
LTP integrated with bluval

Signed-off-by: Naga Sugguna <ns156u@att.com>
Change-Id: I1dcb678058dbb0dccd794761f431c5235862899e

5 years agoMerge "docker bench integrated with bluval"
Juha Kosonen [Tue, 27 Aug 2019 12:59:25 +0000 (12:59 +0000)]
Merge "docker bench integrated with bluval"

5 years agoAdd Robot test for running Tempest test suite 25/1125/6
Juha Kosonen [Fri, 5 Jul 2019 11:36:05 +0000 (14:36 +0300)]
Add Robot test for running Tempest test suite

Runs the test set defined by RefStack [1]. Creates OpenStack resources
needed for running Tempest tests if required.

Blacklist mechanism for excluding test cases from execution is
supported.

[1] https://refstack.openstack.org/api/v1/guidelines/2019.06/tests?target=platform&type=required&alias=true&flag=false

JIRA: VAL-36

Change-Id: I30e3f3a084e028c7ec75f1254319448ebace72a9
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
5 years agoCreate docker layer container for Docker Bench 71/1471/2
Juha Kosonen [Mon, 26 Aug 2019 14:17:53 +0000 (17:17 +0300)]
Create docker layer container for Docker Bench

Change-Id: Iefcbd481aa4993a59528feed3faa40cf279a890c
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
5 years agoAdd mandatory LTP tests 61/1461/1
Indumathi Buddi [Mon, 26 Aug 2019 03:48:53 +0000 (03:48 +0000)]
Add mandatory LTP tests

Signed-off-by: Indumathi Buddi <ib405q@att.com>
Change-Id: I5fba2485b375d7fec42b8e4963b97a98a1158aba

5 years agofix: as per CSO 50/1450/2
Naga Sugguna [Thu, 22 Aug 2019 20:19:16 +0000 (20:19 +0000)]
fix: as per CSO

Signed-off-by: Naga Sugguna <ns156u@att.com>
Change-Id: Ie95987ee60a7760121161782305a45273bc9f68c

5 years agoMerge "Add Robot test for validating Helm charts"
Deepak Kataria [Thu, 22 Aug 2019 18:51:00 +0000 (18:51 +0000)]
Merge "Add Robot test for validating Helm charts"

5 years agoAdd Robot test for validating Helm charts 48/1448/1
Juha Kosonen [Thu, 22 Aug 2019 11:14:03 +0000 (14:14 +0300)]
Add Robot test for validating Helm charts

Uses linter to check charts are well-formed and tests rendering by
dry-running the install.

JIRA: VAL-43

Change-Id: If0eaaf6d5e5deaf4e9bd2d8fb6303b66d2035a1f
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
5 years agogenerate test_info.yaml 43/1443/3
Naga Sugguna [Wed, 21 Aug 2019 14:48:21 +0000 (09:48 -0500)]
generate test_info.yaml

Signed-off-by: Naga Sugguna <ns156u@att.com>
Change-Id: I870a98af01e96213025ce2f989410efada677364

5 years agoCustomize the volume list per layer 41/1341/4
Your Name [Wed, 7 Aug 2019 14:56:51 +0000 (07:56 -0700)]
Customize the volume list per layer

- Create an input yaml file for the list of volumes that will be mounted
to the container when running the tests.
- Customize the list of containers for each layer.
- Add the posibility to store the bluval-<blueprint>.yaml file outside
the validation project and mount it at runtime.

Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
Change-Id: Id3c21cb861879cd3040b06badfb9622429734ce6

5 years agodocker bench integrated with bluval 29/1429/1
Naga Sugguna [Mon, 19 Aug 2019 03:31:52 +0000 (03:31 +0000)]
docker bench integrated with bluval

Signed-off-by: Naga Sugguna <ns156u@att.com>
Change-Id: I316fb4085b36c52da50a5b42c31b750cf456bb59

5 years ago[k8s] sonobuoy: Align all images with v0.15.1 tag 23/1323/1
Alexandru Avadanii [Mon, 5 Aug 2019 13:18:00 +0000 (15:18 +0200)]
[k8s] sonobuoy: Align all images with v0.15.1 tag

We previously bumped the sonobuoy and its required tooling (e.g.
e2e.test) to the minor version 0.15, but some binaries/images were
still pointing to 0.13/0.14 versions; let's align all of them.

Change-Id: Ic27aab02fe41d7fed06d5a45796c7bddd0db9940
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
5 years ago[k8s] Skip Aggregator test 04/1304/1
Cristina Pauna [Thu, 1 Aug 2019 11:33:18 +0000 (14:33 +0300)]
[k8s] Skip Aggregator test

The validation k8s container contains k8s v1.15 which adds the
Aggregator test to the conformance suite. However this tests fails when
ran against clusters with older version of k8s, therefore we skip it.

JIRA: VAL-8

Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
Change-Id: I18cbc40a1d51e4f9b81872a289025a66b384d50c

5 years agoSupport of test cases' addtitional tag 53/1253/2
Ioakeim Samaras [Wed, 24 Jul 2019 12:25:38 +0000 (15:25 +0300)]
Support of test cases' addtitional tag

Test cases can now be tagged as optional

Signed-off-by: Ioakeim Samaras <ioakeim.samaras@ericsson.com>
Change-Id: I97e217ff3c1270d56853bab36c97b75c056f5151

5 years agoMerge "[RECV-94] Separate docker/robot invoking"
Ioakeim Samaras [Mon, 22 Jul 2019 06:48:28 +0000 (06:48 +0000)]
Merge "[RECV-94] Separate docker/robot invoking"

5 years ago[k8s] validation: kube-conformance s/v1.11/v1.15/ 52/1152/5
Alexandru Avadanii [Tue, 9 Jul 2019 16:27:00 +0000 (18:27 +0200)]
[k8s] validation: kube-conformance s/v1.11/v1.15/

Bump kube-conformance from v1.11 to v1.15 to pick up newer test images,
e.g. nginx-slim only has arm64 support starting with the next version
after the one pinned by e2e tests in kubernetes v1.11.10, while
e2e.test binary only has proper etcd arm64 support starting with 1.15.

- update README;
- bump dockerhub image tag;
- bump git submodule pinned commit from upstream
  heptio/kube-conformance;
- bump tag in image referenced by sonobuoy configuration;

While at it, also align related resource versions in K8s image:
- bump kubectl/gingo/e2e.test in K8s image from v1.13.0 to v1.15.x
  (latest minor release available for the 1.15 major release);
- pin sonobuoy binary version to v0.14.3 tag;
- bump sonobuoy timeouts to accomodate runs on slower hardware;

Change-Id: Ia0e632219694a63e9cdf06d7e6dad89cff016361
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
5 years agoMerge "[UI] UI enhancements"
Ioakeim Samaras [Tue, 9 Jul 2019 06:42:47 +0000 (06:42 +0000)]
Merge "[UI] UI enhancements"

5 years ago[UI] UI enhancements 16/1116/6
Ioakeim Samaras [Wed, 3 Jul 2019 11:43:32 +0000 (14:43 +0300)]
[UI] UI enhancements

- Representation of declarative result
  info
- Re-deployment of db when persistent
  storage already exists
- Searching matching fields should be
  supported in the front-end app
- Loading gif should be displayed when
  the front-end apps is trying to receive results
- Deletion of submissions should be disabled

JIRA: VAL-37

Signed-off-by: Ioakeim Samaras <ioakeim.samaras@ericsson.com>
Change-Id: Ie140cd595543790c90ab60d50288cc825bd07a6b

5 years ago[RECV-94] Separate docker/robot invoking 32/1132/1
Naga Sugguna [Fri, 5 Jul 2019 15:37:10 +0000 (10:37 -0500)]
[RECV-94] Separate docker/robot invoking

Change-Id: I3dbeda2c11be09fbb250417042c6f76a01c92d0f
Signed-off-by: Naga Sugguna <ns156u@att.com>
5 years agoskip, show_stopper, all tested 49/949/19
Naga Sugguna [Wed, 5 Jun 2019 23:50:55 +0000 (23:50 +0000)]
skip, show_stopper, all tested

* skip, If you want to skip any testcase you can just give "True"
  for this.

* show_stopper, testcase failed meaning we should not continue.
  If you are expecting too many failures because of this failure,
  you mark it as show_stopper: True

* all is special layer, that means all layers.

* -d/--delegate is an option to delegate validation to docker
  containers. docker containers will never use this.

Change-Id: I92b1fc0ac47a6ca3b75e1e2e75c9aea0d206fdaf
Signed-off-by: Naga Sugguna <ns156u@att.com>
5 years agoMerge "Add Docker Bench for Security"
Juha Kosonen [Fri, 5 Jul 2019 10:09:15 +0000 (10:09 +0000)]
Merge "Add Docker Bench for Security"

5 years agoMerge "Remove e2e layer"
Cristina Pauna [Thu, 4 Jul 2019 08:38:00 +0000 (08:38 +0000)]
Merge "Remove e2e layer"

5 years agoRemove e2e layer 26/1026/3
Juha Kosonen [Thu, 20 Jun 2019 11:56:54 +0000 (14:56 +0300)]
Remove e2e layer

e2e.sh is using kubetest for running tests. This is not needed since
we already use Sonobuoy for e2e tests on k8s layer.

Change-Id: Ib26737ef2e5c7af712e17034b9c0233ecaab8ed3
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
5 years ago[docker] Fix build for mariadb 13/1113/1
Cristina Pauna [Wed, 3 Jul 2019 08:53:39 +0000 (11:53 +0300)]
[docker] Fix build for mariadb

The mariadb container is failing to build on aarch64 because it's using
an image without arm support. Also standardized the location where the
validation code is cloned.

Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
Change-Id: I3bf262ea565e487f635b398d0f49314eceb5162e

5 years agoAdd Docker Bench for Security 04/1104/3
Juha Kosonen [Tue, 2 Jul 2019 10:49:55 +0000 (13:49 +0300)]
Add Docker Bench for Security

The Docker Bench for Security [1] is a script that checks for common
best-practices around deploying Docker containers. The Robot test case
added uploads the test script on all nodes of the cluster, runs all
available CIS tests and downloads produced execution logs.

[1] https://github.com/docker/docker-bench-security/tree/master

JIRA: VAL-35

Change-Id: I107673363453f38344fd9db3c88b88ea70f1074a
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
5 years agoMerge "UI adaptation for supporting ONAP portal SDK"
Ioakeim Samaras [Tue, 2 Jul 2019 13:54:59 +0000 (13:54 +0000)]
Merge "UI adaptation for supporting ONAP portal SDK"

5 years agoMerge "[docker] Standardize the location of the code"
Naga Sugguna [Tue, 2 Jul 2019 13:32:55 +0000 (13:32 +0000)]
Merge "[docker] Standardize the location of the code"

5 years agoMerge "[docker] Renamed hw layer to hardware"
Cristina Pauna [Tue, 2 Jul 2019 13:05:00 +0000 (13:05 +0000)]
Merge "[docker] Renamed hw layer to hardware"

5 years ago[docker] Standardize the location of the code 05/1105/1
Cristina Pauna [Tue, 2 Jul 2019 11:27:07 +0000 (14:27 +0300)]
[docker] Standardize the location of the code

Use the same location to clone the repository inside the docker images.
/opt/akraino/validation/
Use /opt/akraino/results to store the results of the tests

Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
Change-Id: I6ec594d66d84539608d5c3cef8a0277b7b2b54d7

5 years agoUI adaptation for supporting ONAP portal SDK 44/1044/5
Ioakeim Samaras [Mon, 24 Jun 2019 16:08:46 +0000 (19:08 +0300)]
UI adaptation for supporting ONAP portal SDK

JIRA: VAL-29

Signed-off-by: Ioakeim Samaras <ioakeim.samaras@ericsson.com>
Change-Id: I1ff3118e09b7cc91b465fb8293a0e7765c82a581

5 years ago[docker] Renamed hw layer to hardware 98/1098/1
Cristina Pauna [Mon, 1 Jul 2019 08:07:17 +0000 (11:07 +0300)]
[docker] Renamed hw layer to hardware

It was decided in the team meeting that all references to the hardware
layer should be named "hardware" instead of "hw" for consistency.

Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
Change-Id: I00a725d8653275627e2489fa09398587dd5a5481

5 years ago[k8s conformance] sonobuoy: Use Akraino images 95/1095/1
Alexandru Avadanii [Sat, 29 Jun 2019 19:24:36 +0000 (21:24 +0200)]
[k8s conformance] sonobuoy: Use Akraino images

Instead of pulling upstream images, which are x86-specific, switch
to our own Akraino images with multiarch (x86_64 + AArch64) support:
- akraino/validation:sonobuoy-plugin-systemd-logs-latest
- akraino/validation:kube-conformance-v1.11

JIRA: VAL-24

Change-Id: I195e111350a95c8d198f73420a1b2ba76a8600f2
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
5 years agoMerge "[docker] Add sonobuoy multiarch image build"
Cristina Pauna [Fri, 28 Jun 2019 11:41:09 +0000 (11:41 +0000)]
Merge "[docker] Add sonobuoy multiarch image build"

5 years ago[docker] Add sonobuoy multiarch image build 62/1062/3
Alexandru Avadanii [Tue, 25 Jun 2019 15:46:42 +0000 (17:46 +0200)]
[docker] Add sonobuoy multiarch image build

Upstream sonobuoy lacks 2 images for AArch64 architecture, so build
our own multiarch amd64 (x86_64) + arm64 (AArch64) images for:
- sonobuoy-plugin-systemd-logs (tag version 'latest');
- kube-conformance (tag version 'v1.11');

The new images will be pushed to Dockerhub as:
- akraino/validation:sonobuoy-plugin-systemd-logs-latest
- akraino/validation:kube-conformance-v1.11

Since upstream Dockerfiles require small changes for AArch64 support,
implement a new patching mechanism via new make targets in
`docker/build.mk`:
- .submodules_init
  * initializes the (newly added) git submodules in this repository
    and pulls the pinned-down commit for each submodule;
- .submodules_patched
  * Applies patches found in the `patches` and/or `patches/<arch>`
    subdirectories for each submodule (using `git am -3`), so we can
    apply AArch64-specific changes only on arm64 platforms;
- .submodules_clean
  * Un-applies patches by resetting each git submodule to its
    pinned-down commit;

To add support for pre-build actions like submodules init + patching,
turn `.build` make target into a double-colon target and extend it
for the two new containers accordingly.

To prevent tox verify failures, adjust ui .eslintrc and tox.ini to
remove the git submodules first (second one being a temporary
workaround until ci-management allows configuring verify jobs with
git submodule handling disabled).

JIRA: VAL-24

Change-Id: Ibfeb3551e44e82fdade2886985ca4577b7d32522
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
5 years agoMerge "fix: hp_baremetal ping"
Ioakeim Samaras [Thu, 27 Jun 2019 07:34:22 +0000 (07:34 +0000)]
Merge "fix: hp_baremetal ping"

5 years agoMerge "[ui] Fix docker build for UI container"
Ioakeim Samaras [Wed, 26 Jun 2019 08:52:18 +0000 (08:52 +0000)]
Merge "[ui] Fix docker build for UI container"

5 years agofix: hp_baremetal ping 53/1053/1
Naga Sugguna [Tue, 25 Jun 2019 15:24:13 +0000 (10:24 -0500)]
fix: hp_baremetal ping

Change-Id: Ib100994e543311b1ec7b5916b6a1874ec4e0f320
Signed-off-by: Naga Sugguna <ns156u@att.com>
5 years agoMerge "Fix Sonobuoy test execution completion waiting"
Juha Kosonen [Tue, 25 Jun 2019 05:22:04 +0000 (05:22 +0000)]
Merge "Fix Sonobuoy test execution completion waiting"

5 years agoRemove NA test cases 46/1046/2
Naga Sugguna [Mon, 24 Jun 2019 19:47:02 +0000 (14:47 -0500)]
Remove NA test cases

Change-Id: If5217a2c17d0e3bf3428078e2f8d74e59522bbdb
Signed-off-by: Naga Sugguna <ns156u@att.com>
5 years agoFix Sonobuoy test execution completion waiting 42/1042/1
Juha Kosonen [Mon, 24 Jun 2019 13:32:35 +0000 (16:32 +0300)]
Fix Sonobuoy test execution completion waiting

JIRA: VAL-34

Change-Id: I2175553f7a3d42fc3b0f00e75cef9b1c10bc6bf6
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
5 years agoREC testcases 45/1045/1
Naga Sugguna [Mon, 24 Jun 2019 13:05:38 +0000 (08:05 -0500)]
REC testcases

Test cases for REC

Change-Id: I6d26a6f0b0c9dfd5db745abdab8ed48b86175ff5
Signed-off-by: Naga Sugguna <ns156u@att.com>
5 years ago[ui] Fix docker build for UI container 32/1032/1
Cristina Pauna [Fri, 21 Jun 2019 12:59:50 +0000 (15:59 +0300)]
[ui] Fix docker build for UI container

The build is failing because it expects the java code to be built
before copying the executable inside the ui container

JIRA: VAL-31

Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
Change-Id: I1f3d92bab9d1de8fbe93a2da0667c82aca44789f

5 years agoMerge "Fix OS Dockerfile"
Naga Sugguna [Thu, 13 Jun 2019 00:21:22 +0000 (00:21 +0000)]
Merge "Fix OS Dockerfile"

5 years agoAdd Bare metal hardware test cases for hp: 50/950/6
Miguel Montiel [Wed, 5 Jun 2019 23:55:22 +0000 (23:55 +0000)]
Add Bare metal hardware test cases for hp:

 - Connectivity
 - Health
 - Chassis
 - idrac
 - Bios
 - Firmware

Updated Dockerfile for hw container

Updated variable.yaml to have a consolidated list
of variables for the robot test cases

Change-Id: Ie6b6cbfb8854310665602279872409852e36182e
Signed-off-by: Miguel Montiel <mm747b@att.com>
5 years agoAdd container script for hw layer test 29/929/4
Miguel Montiel [Fri, 31 May 2019 22:33:15 +0000 (22:33 +0000)]
Add container script for hw layer test

 Dockerfile which installs
  - Dependencies
  - Robot framework

Change-Id: I2d465fdf771c4fc087afe7fd233064cdccfe5fce
Signed-off-by: Miguel Montiel <mm747b@att.com>
5 years agoFix OS Dockerfile 88/988/1
Miguel Montiel [Wed, 12 Jun 2019 20:48:05 +0000 (20:48 +0000)]
Fix OS Dockerfile

 - Default command removed
 - Add blueval dependencies

Change-Id: Ieb9df39bc85e3b828a4bb67738d395440363952b
Signed-off-by: Miguel Montiel <mm747b@att.com>
5 years agoOS layer typo fixed 87/987/2
Miguel Montiel [Wed, 12 Jun 2019 18:45:55 +0000 (18:45 +0000)]
OS layer typo fixed

Change-Id: I2ef006f89eedaecbe8cd653345b91552b1c0f4f4
Signed-off-by: Miguel Montiel <mm747b@att.com>
5 years agoMerge "[k8s] Run the tests using bluval"
Cristina Pauna [Mon, 10 Jun 2019 11:48:52 +0000 (11:48 +0000)]
Merge "[k8s] Run the tests using bluval"

5 years agoMerge "UI initial implementation."
Cristina Pauna [Mon, 10 Jun 2019 11:43:04 +0000 (11:43 +0000)]
Merge "UI initial implementation."

5 years agoUI initial implementation. 35/735/17
Ioakeim Samaras [Fri, 17 May 2019 12:23:59 +0000 (15:23 +0300)]
UI initial implementation.

- A user can commit and be informed about
  submissions of blueprint validation requests.
- Appropriate dockerfiles have been added for the
  UI and the required postgreSQL db.
- .gitignore file has been updated
- Integration with Jenkins completed
- The URL of the result is retrieved and
  displayed
- Multi-threading is now supported
- Notification callback from Jenkins implemented
- Results are retrieved from Nexus
- Results are displayed
- UI and postgreSQL docker projects support the
  makefile automation build and push process
- README file is included
- CHANGELOG file is included
- Coala static code analysis was performed

JIRA: VAL-14

Signed-off-by: Ioakeim Samaras <ioakeim.samaras@ericsson.com>
Change-Id: Icd2a97426bfbfc6e4eb4ec5edbda6689e2d4645f