civilinfrastructureplatform:ciptestingreferencetestcases
Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision | Next revision Both sides next revision | ||
|
civilinfrastructureplatform:ciptestingreferencetestcases [2018/05/16 13:22] rajmarshall [Procedure:] fix formatting |
civilinfrastructureplatform:ciptestingreferencetestcases [2018/05/16 14:04] rajmarshall update all the example BBB outputs and remove the B@D version number |
||
|---|---|---|---|
| Line 1: | Line 1: | ||
| ====== B@D Reference Test Cases (5/5)====== | ====== B@D Reference Test Cases (5/5)====== | ||
| - | These instructions provide some Example Tests and Test Cases you can use to validate your CIP Board-at-Desk Single-Developer (B@D) v1.0 Virtual Machine (VM) or from which, you can learn how all of the tooling works together. | + | These instructions provide some Example Tests and Test Cases you can use to validate your CIP Board-at-Desk Single-Developer (B@D) Virtual Machine (VM) or from which, you can learn how all of the tooling works together. |
| This set of instructions assumes you have already connected the board to the machine where you have installed B@D. If that is not the case please go back to the [[beagleboneblackboard|Beaglebone Black Setup & Configuration wiki page]] or [[renesasboard|Renesas IWG20M]] depending on the board you are using, which is step 3. | This set of instructions assumes you have already connected the board to the machine where you have installed B@D. If that is not the case please go back to the [[beagleboneblackboard|Beaglebone Black Setup & Configuration wiki page]] or [[renesasboard|Renesas IWG20M]] depending on the board you are using, which is step 3. | ||
| Line 16: | Line 16: | ||
| ==== Prerequisites: ==== | ==== Prerequisites: ==== | ||
| - | * A working CIP Board-at-Desk Single-Developer (B@D) v1.0 Virtual Machine | + | * A working CIP Board-at-Desk Single-Developer (B@D) Virtual Machine |
| ==== Procedure: ==== | ==== Procedure: ==== | ||
| Line 96: | Line 96: | ||
| ==== Prerequisites: ==== | ==== Prerequisites: ==== | ||
| - | * A working CIP Board-at-Desk Single-Developer (B@D) v1.0 Virtual Machine | + | * A working CIP Board-at-Desk Single-Developer (B@D) Virtual Machine |
| * A Beaglebone Black that is powered up, connected to the LAN with an ethernet cable and connected to the host machine with an FTDI cable. | * A Beaglebone Black that is powered up, connected to the LAN with an ethernet cable and connected to the host machine with an FTDI cable. | ||
| * A locally built CIP kernel and initramfs. | * A locally built CIP kernel and initramfs. | ||
| Line 197: | Line 197: | ||
| ==== Prerequisites: ==== | ==== Prerequisites: ==== | ||
| - | * A working CIP Board-at-Desk Single-Developer (B@D) v1.0 Virtual Machine | + | * A working CIP Board-at-Desk Single-Developer (B@D) Virtual Machine |
| * A Beaglebone Black that is powered up, connected to the LAN with an ethernet cable and connected to the host machine with an FTDI cable. | * A Beaglebone Black that is powered up, connected to the LAN with an ethernet cable and connected to the host machine with an FTDI cable. | ||
| * A locally built CIP kernel and initramfs. | * A locally built CIP kernel and initramfs. | ||
| Line 237: | Line 237: | ||
| This is what the start of the Health Check looks like: | This is what the start of the Health Check looks like: | ||
| - | Root tmp directory created at /var/lib/lava/dispatcher/tmp/11 | + | lava-dispatcher, installed at version: 2018.4-2~bpo9+1 |
| start: 0 validate | start: 0 validate | ||
| + | Start time: 2018-05-10 12:14:13.326013+00:00 (UTC) | ||
| Validating that http://localhost:8010/initramfs/initramfs.cpio.gz exists | Validating that http://localhost:8010/initramfs/initramfs.cpio.gz exists | ||
| - | Validating that http://localhost:8010/cip-releaseTest/cip_v4.4.83/v4.4.83-cip8/arm/omap2plus_defconfig/zImage exists | + | Validating that http://localhost:8010/cip-test/cip_v4.4.126/v4.4.126-cip22/arm/omap2plus_defconfig/zImage exists |
| - | Validating that http://localhost:8010/cip-releaseTest/cip_v4.4.83/v4.4.83-cip8/arm/omap2plus_defconfig/dtbs/am335x-boneblack.dtb exists | + | Validating that http://localhost:8010/cip-test/cip_v4.4.126/v4.4.126-cip22/arm/omap2plus_defconfig/dtbs/am335x-boneblack.dtb exists |
| - | Validating that http://localhost:8010/cip-releaseTest/cip_v4.4.83/v4.4.83-cip8/arm/omap2plus_defconfig/modules.tar.xz exists | + | Validating that http://localhost:8010/cip-test/cip_v4.4.126/v4.4.126-cip22/arm/omap2plus_defconfig/modules.tar.xz exists |
| - | no device environment specified | + | validate duration: 0.02 |
| - | booti, bootm and bootz are being deprecated soon, please use 'image','uimage' or 'zimage' | + | case: validate |
| - | device may need manual intervention to reboot | + | case_id: 128 |
| - | validate duration: 3.01 | + | definition: lava |
| - | start: 1 tftp-deploy (max 240s) | + | result: pass |
| - | start: 1.1 download_retry (max 240s) | + | start: 1 tftp-deploy (timeout 00:04:00) [common] |
| - | start: 1.1.1 http_download (max 240s) | + | start: 1.1 download-retry (timeout 00:04:00) [common] |
| + | start: 1.1.1 http-download (timeout 00:04:00) [common] | ||
| Not decompressing ramdisk as can be used compressed. | Not decompressing ramdisk as can be used compressed. | ||
| - | No compression specified. | + | downloading http://localhost:8010/initramfs/initramfs.cpio.gz |
| - | downloading http://localhost:8010/initramfs/initramfs.cpio.gz as /var/lib/lava/dispatcher/tmp/11/tftp-deploy-Blt0p9/initramfs.cpio.gz | + | saving as /var/lib/lava/dispatcher/tmp/11/tftp-deploy-pozjv6jf/ramdisk/initramfs.cpio.gz |
| <snip> | <snip> | ||
| Line 258: | Line 260: | ||
| </snip> | </snip> | ||
| - | case: finalize | + | Finalising connection for namespace 'common' |
| + | end: 4.2 read-feedback (duration 00:00:01) [common] | ||
| + | end: 4 finalize (duration 00:00:01) [common] | ||
| + | Cleaning after the job | ||
| + | Cleaning up download directory: /var/lib/lava/dispatcher/tmp/11/tftp-deploy-pozjv6jf/ramdisk | ||
| + | Cleaning up download directory: /var/lib/lava/dispatcher/tmp/11/tftp-deploy-pozjv6jf/kernel | ||
| + | Cleaning up download directory: /var/lib/lava/dispatcher/tmp/11/tftp-deploy-pozjv6jf/dtb | ||
| + | Cleaning up download directory: /var/lib/lava/dispatcher/tmp/11/tftp-deploy-pozjv6jf/modules | ||
| + | Override tmp directory removed at /var/lib/lava/dispatcher/tmp/11 | ||
| + | Root tmp directory removed at /var/lib/lava/dispatcher/tmp/11 | ||
| + | Job finished correctly | ||
| + | case: job | ||
| + | case_id: 142 | ||
| definition: lava | definition: lava | ||
| result: pass | result: pass | ||
| - | level: 4 | + | |
| - | duration: 0.105773925781 | + | |
| - | extra: ... | + | |
| - | Cleanup: removing /var/lib/lava/dispatcher/tmp/11 | + | |
| ===== Test #5: Running the Health Check for the Renesas IWG20M Device ===== | ===== Test #5: Running the Health Check for the Renesas IWG20M Device ===== | ||
| Line 270: | Line 281: | ||
| ==== Prerequisites: ==== | ==== Prerequisites: ==== | ||
| - | * A working CIP Board-at-Desk Single-Developer (B@D) v1.0 Virtual Machine | + | * A working CIP Board-at-Desk Single-Developer (B@D) Virtual Machine |
| * An IWG20M that is powered up, connected to the LAN with an ethernet cable and connected to the host machine with a USB cable. | * An IWG20M that is powered up, connected to the LAN with an ethernet cable and connected to the host machine with a USB cable. | ||
| * A locally built CIP kernel and initramfs. | * A locally built CIP kernel and initramfs. | ||
| Line 343: | Line 354: | ||
| ==== Prerequisites: ==== | ==== Prerequisites: ==== | ||
| - | * A working CIP Board-at-Desk Single-Developer (B@D) v1.0 Virtual Machine | + | * A working CIP Board-at-Desk Single-Developer (B@D) Virtual Machine |
| * A Beaglebone Black that is powered up, connected to the LAN with an ethernet cable and connected to the host machine with an FTDI cable. | * A Beaglebone Black that is powered up, connected to the LAN with an ethernet cable and connected to the host machine with an FTDI cable. | ||
| * A built kernel for the Beaglebone Black (see Test #3) | * A built kernel for the Beaglebone Black (see Test #3) | ||
| Line 397: | Line 408: | ||
| This is an example what the start of the test looks like in the Beaglebone case: | This is an example what the start of the test looks like in the Beaglebone case: | ||
| - | Root tmp directory created at /var/lib/lava/dispatcher/tmp/12 | + | lava-dispatcher, installed at version: 2018.4-2~bpo9+1 |
| start: 0 validate | start: 0 validate | ||
| + | Start time: 2018-05-10 12:14:13.326013+00:00 (UTC) | ||
| Validating that http://localhost:8010/initramfs/initramfs.cpio.gz exists | Validating that http://localhost:8010/initramfs/initramfs.cpio.gz exists | ||
| - | Validating that http://localhost:8010/cip-example/cip_v4.4.83/v4.4.83-cip8/arm/omap2plus_defconfig/zImage exists | + | Validating that http://localhost:8010/cip-test/cip_v4.4.126/v4.4.126-cip22/arm/omap2plus_defconfig/zImage exists |
| - | Validating that http://localhost:8010/cip-example/cip_v4.4.83/v4.4.83-cip8/arm/omap2plus_defconfig/dtbs/am335x-boneblack.dtb exists | + | Validating that http://localhost:8010/cip-test/cip_v4.4.126/v4.4.126-cip22/arm/omap2plus_defconfig/dtbs/am335x-boneblack.dtb exists |
| - | Validating that http://localhost:8010/cip-example/cip_v4.4.83/v4.4.83-cip8/arm/omap2plus_defconfig/modules.tar.xz exists | + | Validating that http://localhost:8010/cip-test/cip_v4.4.126/v4.4.126-cip22/arm/omap2plus_defconfig/modules.tar.xz exists |
| - | no device environment specified | + | validate duration: 0.02 |
| - | booti, bootm and bootz are being deprecated soon, please use 'image','uimage' or 'zimage' | + | case: validate |
| - | device may need manual intervention to reboot | + | case_id: 128 |
| - | validate duration: 1.07 | + | definition: lava |
| - | start: 1 tftp-deploy (max 240s) | + | result: pass |
| - | start: 1.1 download_retry (max 240s) | + | start: 1 tftp-deploy (timeout 00:04:00) [common] |
| - | start: 1.1.1 http_download (max 240s) | + | start: 1.1 download-retry (timeout 00:04:00) [common] |
| + | start: 1.1.1 http-download (timeout 00:04:00) [common] | ||
| Not decompressing ramdisk as can be used compressed. | Not decompressing ramdisk as can be used compressed. | ||
| - | No compression specified. | + | downloading http://localhost:8010/initramfs/initramfs.cpio.gz |
| - | downloading http://localhost:8010/initramfs/initramfs.cpio.gz as /var/lib/lava/dispatcher/tmp/11/tftp-deploy-iZGX26/initramfs.cpio.gz | + | saving as /var/lib/lava/dispatcher/tmp/11/tftp-deploy-pozjv6jf/ramdisk/initramfs.cpio.gz |
| <snip> | <snip> | ||
| Line 418: | Line 431: | ||
| </snip> | </snip> | ||
| - | finalize duration: 0.10 | + | Finalising connection for namespace 'common' |
| - | case: finalize | + | end: 4.2 read-feedback (duration 00:00:01) [common] |
| + | end: 4 finalize (duration 00:00:01) [common] | ||
| + | Cleaning after the job | ||
| + | Cleaning up download directory: /var/lib/lava/dispatcher/tmp/11/tftp-deploy-pozjv6jf/ramdisk | ||
| + | Cleaning up download directory: /var/lib/lava/dispatcher/tmp/11/tftp-deploy-pozjv6jf/kernel | ||
| + | Cleaning up download directory: /var/lib/lava/dispatcher/tmp/11/tftp-deploy-pozjv6jf/dtb | ||
| + | Cleaning up download directory: /var/lib/lava/dispatcher/tmp/11/tftp-deploy-pozjv6jf/modules | ||
| + | Override tmp directory removed at /var/lib/lava/dispatcher/tmp/11 | ||
| + | Root tmp directory removed at /var/lib/lava/dispatcher/tmp/11 | ||
| + | Job finished correctly | ||
| + | case: job | ||
| + | case_id: 142 | ||
| definition: lava | definition: lava | ||
| result: pass | result: pass | ||
| - | level: 4 | ||
| - | duration: 0.10351395607 | ||
| - | extra: ... | ||
| - | Cleanup: removing /var/lib/lava/dispatcher/tmp/12 | ||
| // Note: After running the test, if the (4) user LED's are all off, manually reboot the board by pressing the reset button (S1) or disconnect and reconnect the power cable to the board before re-running the test.// | // Note: After running the test, if the (4) user LED's are all off, manually reboot the board by pressing the reset button (S1) or disconnect and reconnect the power cable to the board before re-running the test.// | ||
| - | 9. You can see an example of a successful test log file [[https://gitlab.com/cip-project/cip-testing/testing/snippets/1666438| the Beaglebone Black Test results ]]. | + | 9. You can see an example of a successful test log file [[https://gitlab.com/snippets/1715994| the Beaglebone Black Test results ]]. |
| ===== Test #7: Testing Externally Built Kernels ===== | ===== Test #7: Testing Externally Built Kernels ===== | ||
| ==== Prerequisites: ==== | ==== Prerequisites: ==== | ||
| - | * A working CIP Board-at-Desk Single-Developer (B@D) v1.0 Virtual Machine | + | * A working CIP Board-at-Desk Single-Developer (B@D) Virtual Machine |
| * A board on which to test that kernel. | * A board on which to test that kernel. | ||
| * A defined device and device dictionary for the new device. Copy the dictionary entry into /etc/lava-server/dispatcher-config/devices (see /vagrant/integration-scripts/configure_lava.sh for examples). | * A defined device and device dictionary for the new device. Copy the dictionary entry into /etc/lava-server/dispatcher-config/devices (see /vagrant/integration-scripts/configure_lava.sh for examples). | ||
| Line 449: | Line 469: | ||
| ---- | ---- | ||
| ===== LAVA 2018-4 ===== | ===== LAVA 2018-4 ===== | ||
| - | With this version of LAVA, in the above test cases replace any of the following sequences: | + | With this version of LAVA, in the above test cases, replace any of the following sequences: |
| > Click on Scheduler and then select All Devices. | > Click on Scheduler and then select All Devices. | ||
| Line 457: | Line 477: | ||
| > Click the Force Health Check button. | > Click the Force Health Check button. | ||
| - | With | + | With: |
| In Administration scroll down to Devices and select it, tick the appropriate device and then in the Action pull down select 'Update health of selected devices to Unknown' and click the 'Go' button. | In Administration scroll down to Devices and select it, tick the appropriate device and then in the Action pull down select 'Update health of selected devices to Unknown' and click the 'Go' button. | ||
civilinfrastructureplatform/ciptestingreferencetestcases.txt · Last modified: 2018/11/08 13:24 by rajmarshall
Page Tools
Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Noncommercial-Share Alike 4.0 International
