User Tools

Site Tools


civilinfrastructureplatform:ciptesting:centalisedtesting:cioverview

This is an old revision of the document!


Continuous Integration Testing Overview

The CIP CI infrastructure monitors the CIP Kernel branches for changes. Once a change is detected a build process is kicked off using GitLab CI/CD that provides binaries for a number of different Kernel configurations. These binaries are then tested on real hardware (where appropriate) using LAVA.

Tests

Boot Test (Healthcheck)

This checks that the provided Kernel will boot on the target device.

Spectre/Meltdown Checker

Linux Test Project (LTP)

LTP consists of a collection of tools for testing the Linux Kernel. More information can be found on the LTP website.

We currently support the following LTP tests:

* ltp-cve-tests * ltp-dio-tests * ltp-fs-tests * ltp-ipc-tests * ltp-math-tests * ltp-sched-tests * ltp-syscalls-tests * ltp-timers-tests

The tests can take a long time to run, so currently they are only run during CIP Kernel release candidate testing.

CIP Kernel Configurations

The Kernel configurations that CIP is using are stored in the cip-kernel-config repository.

The below table maps which of these configurations is automatically built and tested by the CIP CI infrastructure.

Kernel Arch Configuration Built Tested Target Devices Device Tree
v4.19.y-cip arm hitachi_cyclonev_defconfig Y N - -
hitachi_omap_defconfig Y N - -
moxa_mxc_defconfig Y N - -
renesas_shmobile_defconfig Y Y r8a7743-iwg20d-q7
r8a7745-iwg22d-sodimm
r8a7743-iwg20d-q7-dbcm-ca.dtb
r8a7745-iwg22d-sodimm-dbhd-ca.dtb
siemens_imx6.config Y N - -
arm64 moxa_eds_defconfig Y N - -
renesas_defconfig Y Y r8a774c0-ek874
r8a774a1-hihope-rzg2m-ex
r8a774c0-ek874.dtb
r8a774a1-hihope-rzg2m-ex.dtb
x86 plathome_obsvx2.config Y N - -
siemens_iot2000.config Y N - -
siemens_server_defconfig Y N - -
toshiba_atom_baytrail_cip.config Y N - -
v4.19.y-cip-rt arm hitachi_cyclonev_defconfig Y N - -
hitachi_omap_defconfig Y N - -
moxa_mxc_defconfig Y N - -
renesas_shmobile_defconfig Y Y r8a7743-iwg20d-q7
r8a7745-iwg22d-sodimm
r8a7743-iwg20d-q7-dbcm-ca.dtb
r8a7745-iwg22d-sodimm-dbhd-ca.dtb
siemens_imx6.config Y N - -
socfpga_defconfig Y N - -
arm64 moxa_eds_defconfig Y N - -
renesas_defconfig Y Y r8a774c0-ek874
r8a774a1-hihope-rzg2m-ex
r8a774c0-ek874.dtb
r8a774a1-hihope-rzg2m-ex.dtb
x86 plathome_obsvx2.config Y N - -
siemens_i386-rt.config Y N - -
siemens_iot2000.config Y N - -
siemens_server_defconfig Y N - -
toshiba_atom_baytrail_cip.config Y N - -
v4.4.y-cip arm hitachi_omap_defconfig Y N - -
moxa_mxc_defconfig Y N - -
renesas_shmobile_defconfig Y Y r8a7743-iwg20d-q7
r8a7745-iwg22d-sodimm
r8a7743-iwg20d-q7-dbcm-ca.dtb
r8a7745-iwg22d-sodimm-dbhd-ca.dtb
siemens_am335x-axm2_defconfig Y N - -
siemens_am335x-draco_defconfig Y N - -
siemens_am335x-dxr2_defconfig Y N - -
siemens_am335x-etamin_defconfig Y N - -
siemens_am57xx-pxm3.config Y N - -
siemens_dcu2.config Y N - -
siemens_imx6_defconfig Y N - -
toshiba_tegra_defconfig Y N - -
toshiba_zynq_defconfig Y N - -
x86 plathome_obsvx1.config Y N - -
siemens_iot2000.config Y N - -
siemens_server_defconfig Y N - -
toshiba_defconfig Y N - -
v4.4.y-cip-rt arm hitachi_omap_defconfig Y N - -
moxa_mxc_defconfig Y N - -
renesas_shmobile_defconfig Y Y r8a7743-iwg20d-q7
r8a7745-iwg22d-sodimm
r8a7743-iwg20d-q7-dbcm-ca.dtb
r8a7745-iwg22d-sodimm-dbhd-ca.dtb
siemens_am335x-axm2_defconfig Y N - -
siemens_am335x-draco_defconfig Y N - -
siemens_am335x-dxr2_defconfig Y N - -
siemens_am335x-etamin_defconfig Y N - -
siemens_am57xx-pxm3.config Y N - -
siemens_dcu2.config Y N - -
siemens_imx6_defconfig Y N - -
toshiba_tegra_defconfig Y N - -
toshiba_zynq_defconfig Y N - -
x86 plathome_obsvx1.config Y N - -
siemens_i386-rt.config Y N - -
siemens_iot2000.config Y N - -
siemens_server_defconfig Y N - -
toshiba_defconfig Y N - -

Extra Kernel Configurations

CIP also builds and tests a few non-CIP related Kernel configurations that are present in the Kernel.

The below table maps which of these configurations is automatically built and tested by the CIP CI infrastructure.

Kernel Arch Configuration Built Tested Target Devices Device Tree
v4.19.y-cip arm shmobile_defconfig Y Y r8a7743-iwg20d-q7
r8a7745-iwg22d-sodimm
r8a7743-iwg20d-q7-dbcm-ca.dtb
r8a7745-iwg22d-sodimm-dbhd-ca.dtb
arm64 defconfig Y Y r8a774c0-ek874
r8a774a1-hihope-rzg2m-ex
r8a774c0-ek874.dtb
r8a774a1-hihope-rzg2m-ex.dtb
v4.19.y-cip-rt arm shmobile_defconfig Y Y r8a7743-iwg20d-q7
r8a7745-iwg22d-sodimm
r8a7743-iwg20d-q7-dbcm-ca.dtb
r8a7745-iwg22d-sodimm-dbhd-ca.dtb
arm64 defconfig Y Y r8a774c0-ek874
r8a774a1-hihope-rzg2m-ex
r8a774c0-ek874.dtb
r8a774a1-hihope-rzg2m-ex.dtb
v4.4.y-cip arm shmobile_defconfig Y Y r8a7743-iwg20d-q7
r8a7745-iwg22d-sodimm
r8a7743-iwg20d-q7-dbcm-ca.dtb
r8a7745-iwg22d-sodimm-dbhd-ca.dtb
v4.4.y-cip-rt arm shmobile_defconfig Y Y r8a7743-iwg20d-q7
r8a7745-iwg22d-sodimm
r8a7743-iwg20d-q7-dbcm-ca.dtb
r8a7745-iwg22d-sodimm-dbhd-ca.dtb
civilinfrastructureplatform/ciptesting/centalisedtesting/cioverview.1577975583.txt.gz · Last modified: 2020/01/02 14:33 by patersonc