Test Report

Build: 20210915.0019 / Release: v2022dev3

Images: Fixed function AMD64, Fixed function ARM64 (uboot), Fixed function ARMhf (uboot), HMI AMD64, HMI ARMhf (uboot)

Low Medium High Critical a - automated m - manual

This report omits test cases that have not been executed. Please check the full version of the report page for the complete list of test cases.

Summary

type	defined	executed	pass	skip	fail	incomplete
automated	35	128	105	2	10	11
manual	34	80	72	0	8	0

Results

ID	Fixed function ARMhf (uboot) (edit)	Fixed function ARM64 (uboot) (edit)	Fixed function ARM64 (rpi64) (edit)	Fixed function AMD64 (edit)	HMI ARMhf (uboot) (edit)	HMI ARM64 (rpi64) (edit)	HMI AMD64 (edit)	Notes
apertis-update-manager-ota-api-switch-network (m)	PASS	PASS	NOT TESTED	N/A	N/A	N/A	N/A
apertis-update-manager-ota-check-network-failure (m)	PASS	PASS	NOT TESTED	N/A	N/A	N/A	N/A
apertis-update-manager-ota-rollback (m)	FAIL	FAIL	NOT TESTED	N/A	N/A	N/A	N/A	https://phabricator.apertis.org/T7964 https://phabricator.apertis.org/T7964
apparmor (a)	PASS	PASS	NOT TESTED	PASS	PASS	N/A	PASS
apparmor-basic-profiles (a)	PASS	PASS	NOT TESTED	PASS	PASS	N/A	PASS
apparmor-bluez (m)	N/A	N/A	N/A	N/A	PASS	N/A	PASS
apparmor-bluez-avrcp-volume (m)	N/A	N/A	N/A	N/A	PASS	N/A	PASS
apparmor-bluez-setup (m)	N/A	N/A	N/A	N/A	PASS	N/A	PASS
apparmor-chaiwala-system (a)	PASS	PASS	NOT TESTED	PASS	PASS	N/A	PASS
apparmor-dbus (a)	PASS	PASS	NOT TESTED	PASS	PASS	N/A	PASS
apparmor-gstreamer1-0 (a)	N/A	N/A	N/A	N/A	PASS	N/A	PASS
apparmor-pipewire (a)	N/A	N/A	N/A	N/A	FAIL	N/A	FAIL
apparmor-tumbler (a)	N/A	N/A	N/A	N/A	FAIL	N/A	FAIL
aum-api (a)	INCOMPLETE	INCOMPLETE	NOT TESTED	N/A	N/A	N/A	N/A
aum-offline-upgrade (a)	PASS	INCOMPLETE	NOT TESTED	N/A	N/A	N/A	N/A
aum-offline-upgrade-branch (a)	INCOMPLETE	INCOMPLETE	NOT TESTED	N/A	NOT TESTED	NOT TESTED	N/A
aum-offline-upgrade-collection_id (a)	PASS	PASS	NOT TESTED	INCOMPLETE	PASS	N/A	PASS
aum-offline-upgrade-signed (a)	PASS	INCOMPLETE	NOT TESTED	N/A	N/A	N/A	N/A
aum-ota-api (a)	FAIL	PASS	NOT TESTED	N/A	N/A	N/A	N/A
aum-ota-auto (a)	PASS	PASS	NOT TESTED	N/A	N/A	N/A	N/A
aum-ota-out-of-space (a)	PASS	PASS	NOT TESTED	N/A	N/A	N/A	N/A
aum-ota-rollback-blacklist (a)	PASS	PASS	NOT TESTED	N/A	N/A	N/A	N/A
aum-ota-signed (a)	PASS	PASS	NOT TESTED	N/A	N/A	N/A	N/A
aum-out-of-space (a)	INCOMPLETE	PASS	NOT TESTED	N/A	N/A	N/A	N/A
aum-power-cut (a)	PASS	PASS	NOT TESTED	N/A	N/A	N/A	N/A
aum-rollback-blacklist (a)	PASS	PASS	NOT TESTED	N/A	N/A	N/A	N/A
bluez-avrcp-volume (m)	N/A	N/A	N/A	N/A	PASS	N/A	PASS
bluez-file-transfer (m)	N/A	N/A	N/A	N/A	PASS	N/A	PASS
bluez-hfp (m)	N/A	N/A	N/A	N/A	PASS	N/A	PASS
bluez-hfp-call-hold (m)	N/A	N/A	N/A	N/A	PASS	N/A	PASS
bluez-hfp-incoming-call-notification (m)	N/A	N/A	N/A	N/A	PASS	N/A	PASS
bluez-phone (m)	N/A	N/A	N/A	N/A	PASS	N/A	PASS
bluez-setup (m)	N/A	N/A	N/A	N/A	PASS	N/A	PASS
boot-no-crashes (a)	PASS	PASS	NOT TESTED	PASS	PASS	N/A	PASS
boot-performance (a)	PASS	PASS	NOT TESTED	PASS	PASS	N/A	PASS
cgroups-resource-control (a)	N/A	N/A	N/A	N/A	PASS	N/A	PASS
connman (a)	PASS	PASS	NOT TESTED	PASS	PASS	N/A	PASS
connman-new-supplicant (a)	PASS	PASS	NOT TESTED	PASS	PASS	N/A	PASS
connman-pan-network-access (m)	N/A	N/A	N/A	N/A	FAIL	N/A	FAIL	https://phabricator.apertis.org/T8280 https://phabricator.apertis.org/T8288
connman-pan-tethering (m)	N/A	N/A	N/A	N/A	FAIL	N/A	FAIL	https://phabricator.apertis.org/T8280 https://phabricator.apertis.org/T8288
connman-services (m)	N/A	N/A	N/A	N/A	PASS	N/A	PASS
connman-services-reboot (m)	N/A	N/A	N/A	N/A	PASS	N/A	PASS
connman-services-switchover (m)	N/A	N/A	N/A	N/A	PASS	N/A	PASS
dbus-dos-reply-time (a)	FAIL	FAIL	NOT TESTED	FAIL	FAIL	N/A	FAIL
disk-rootfs-fsck (a)	PASS	PASS	NOT TESTED	INCOMPLETE	PASS	N/A	PASS
fixedfunction-webserver (m)	PASS	PASS	NOT TESTED	PASS	N/A	N/A	N/A
gettext-i18n (a)	N/A	N/A	N/A	N/A	UNKNOWN	N/A	UNKNOWN
glib-gio-fs (a)	PASS	PASS	NOT TESTED	PASS	PASS	N/A	PASS
gstreamer1-0-decode (a)	N/A	N/A	N/A	N/A	PASS	N/A	PASS
gupnp-services (a)	N/A	N/A	N/A	N/A	PASS	N/A	PASS
hmi-audio-play-pause (m)	N/A	N/A	N/A	N/A	PASS	N/A	PASS
hmi-audio-skip-start-end (m)	N/A	N/A	N/A	N/A	PASS	N/A	PASS
hmi-audio-volume-control (m)	N/A	N/A	N/A	N/A	PASS	N/A	PASS
hmi-flatpak-rhythmbox-app-launch (m)	N/A	N/A	N/A	N/A	PASS	N/A	PASS
hmi-flatpak-rhythmbox-uninstall (m)	N/A	N/A	N/A	N/A	PASS	N/A	PASS
hmi-video-load (m)	N/A	N/A	N/A	N/A	FAIL	N/A	PASS	https://phabricator.apertis.org/T8288
hmi-video-play-pause (m)	N/A	N/A	N/A	N/A	FAIL	N/A	PASS	https://phabricator.apertis.org/T8288
image-bootable (m)	PASS	PASS	NOT TESTED	PASS	PASS	N/A	PASS
image-gui-start (m)	N/A	N/A	N/A	N/A	PASS	N/A	PASS
iptables-basic (a)	PASS	PASS	NOT TESTED	PASS	PASS	N/A	PASS
iptables-nmap (a)	N/A	N/A	N/A	N/A	PASS	N/A	PASS
licensing-summary-availability (m)	PASS	PASS	NOT TESTED	PASS	PASS	N/A	PASS
ostree-collection-id (a)	PASS	PASS	NOT TESTED	INCOMPLETE	PASS	N/A	PASS
rfkill-toggle (m)	N/A	N/A	N/A	N/A	PASS	N/A	PASS
robotframework (m)	PASS	PASS	NOT TESTED	PASS	PASS	N/A	PASS
sanity-check (a)	PASS	PASS	NOT TESTED	INCOMPLETE	PASS	N/A	PASS
sanity-check-manual (m)	PASS	PASS	NOT TESTED	PASS	PASS	N/A	PASS
secure-boot-imx6 (m)	PASS	N/A	N/A	N/A	N/A	N/A	N/A
video-animation-on-boot (m)	N/A	N/A	N/A	N/A	PASS	N/A	PASS