The Linux Foundation

 
AlsaPilot41

From The Linux Foundation

Results in this section are for the moment just to track the tests as they evolve and document any test issues.

General 4.1 testing results/issues are here: TestPilot41

Contents

multiple arch runs in the build chroots

ppc64/sles11 - has /proc/asound - lsb-test-alsa-t2c-4.0.93.20100428-1

Total Tests Passed: 827
Total Tests Failed (including waived): 39

ppc32/sles11 - has /proc/asound - lsb-test-alsa-t2c-4.0.93.20100428-1

Total Tests Passed: 828
Total Tests Failed (including waived): 38

ia64/sles11 - no /proc/asound - lsb-test-alsa-t2c-4.0.93.20100428-1

Total Tests Passed: 630
Total Tests Failed (including waived): 236

s390/sles11 - no /proc/asound - lsb-test-alsa-t2c-4.0.90.20100424-1

Total Tests Passed: 600
Total Tests Failed (including waived): 255

s390x/sles11 - no /proc/asound - lsb-test-alsa-t2c-4.0.93.20100429-2

Total Tests Passed: 631
Total Tests Failed (including waived): 235

x86_64/opensuse-11.1 - no /proc/asound - lsb-test-alsa-t2c-4.0.93.20100428-1

Total Tests Passed: 632
Total Tests Failed (including waived): 234

The good news here, just look at the numbers, is that not much peculiar with regards to arch is going on. We get roughly the same counts based on the presence of a kernel driver. s390 is slightly higher than the rest, and we'll need to dig into this in more detail.

4/30/2010 - A re-run of the updated package, with many of the problem tests modified/disabled now gives the same results on s390/s390x (lsb-test-alsa-t2c-4.0.94.20100429-1):

Total Tests Passed: 664
Total Tests Failed (including waived): 202
Total Tests Failed (excluding waived): 202

201 of the 202 are UNRESOLVED, the one FAIL is (ALSA_PCM_Interface_General_Functions):

520|15 43 00019619 1 1|Test target(s):
520|15 43 00019619 1 2|snd_pcm_sw_params
520|15 43 00019619 1 3|--------
520|15 43 00019619 1 4| 
520|15 43 00019619 1 5|Requirement failed:
520|15 43 00019619 1 6| 
520|15 43 00019619 1 7|{snd_pcm_sw_params.04.01}
520|15 43 00019619 1 8|<<< REQ NOT FOUND >>>
520|15 43 00019619 1 9| 
220|15 43 1 10:53:44|FAIL

Which is one of the "normal" tests. 04.01 would be the 0 return (success) condition which is not happening. stdout shows:

.ALSA lib pcm_hw.c:1429:(_snd_pcm_hw_open) Invalid value for card
ALSA_PCM_Interface_General_Functions: pcm.c:674: snd_pcm_stream: Assertion `pcm'
 failed.
.Unable to determine current swparams for null: Input/output error
....ALSA lib pcm_hw.c:1429:(_snd_pcm_hw_open) Invalid value for card
ALSA_PCM_Interface_General_Functions: pcm.c:661: snd_pcm_type: Assertion `pcm' f
ailed.

The "Unable to determine..." is part of the setup code I added for the normal tests, so this may still need some work.

Mandriva Cooker

  • lsb-test-alsa-t2c-4.0.92.20100427-1
  • 11 of 15 normal tests completed, remaining 4 are in a partial state where the "normal" function test

works but I'm not yet able to trigger an error condition. Most of the normal tests are using the "null" pcm.

  • The majority of the "normal" tests are in the ALSA_PCM_Interface_General_Functions group.
  • ens1370 sound driver enabled in a kvm virtual machine

Run with sound driver enabled:

/ALSA-t2c/tests/ALSA_Control_Interface/ALSA_Control_Interface 84 UNRESOLVED
/ALSA-t2c/tests/ALSA_Control_Interface/ALSA_Control_Interface 85 UNRESOLVED
/ALSA-t2c/tests/ALSA_Control_Interface/ALSA_Control_Interface 86 UNRESOLVED
/ALSA-t2c/tests/ALSA_Control_Interface/ALSA_Control_Interface 87 UNRESOLVED
/ALSA-t2c/tests/ALSA_Control_Interface/ALSA_Control_Interface 88 UNRESOLVED
/ALSA-t2c/tests/ALSA_Control_Interface/ALSA_Control_Interface 89 UNRESOLVED
/ALSA-t2c/tests/ALSA_Control_Interface/ALSA_Control_Interface 92 UNRESOLVED
/ALSA-t2c/tests/ALSA_Control_Interface/ALSA_Control_Interface 93 UNRESOLVED
/ALSA-t2c/tests/ALSA_Control_Interface/ALSA_Control_Interface 112 UNRESOLVED
/ALSA-t2c/tests/ALSA_Control_Interface/ALSA_Control_Interface 113 UNRESOLVED
/ALSA-t2c/tests/ALSA_Hardware_Dependant_Interface/ALSA_Hardware_Dependant_Interface 1 UNRESOLVED
/ALSA-t2c/tests/ALSA_Hardware_Dependant_Interface/ALSA_Hardware_Dependant_Interface 16 UNRESOLVED
/ALSA-t2c/tests/ALSA_Hardware_Dependant_Interface/ALSA_Hardware_Dependant_Interface 17 UNRESOLVED
/ALSA-t2c/tests/ALSA_Hardware_Dependant_Interface/ALSA_Hardware_Dependant_Interface 27 UNRESOLVED
/ALSA-t2c/tests/ALSA_Hardware_Dependant_Interface/ALSA_Hardware_Dependant_Interface 38 UNRESOLVED
/ALSA-t2c/tests/ALSA_Hardware_Dependant_Interface/ALSA_Hardware_Dependant_Interface 39 UNRESOLVED
/ALSA-t2c/tests/ALSA_Hardware_Dependant_Interface/ALSA_Hardware_Dependant_Interface 40 UNRESOLVED
/ALSA-t2c/tests/ALSA_Hardware_Dependant_Interface/ALSA_Hardware_Dependant_Interface 41 UNRESOLVED
/ALSA-t2c/tests/ALSA_Hardware_Dependant_Interface/ALSA_Hardware_Dependant_Interface 42 UNRESOLVED
/ALSA-t2c/tests/ALSA_High_level_Control_Interface/ALSA_High_level_Control_Interface 16 UNRESOLVED
/ALSA-t2c/tests/ALSA_High_level_Control_Interface/ALSA_High_level_Control_Interface 18 UNRESOLVED
/ALSA-t2c/tests/ALSA_Mixer_Interface/ALSA_Mixer_Interface 16 UNRESOLVED
/ALSA-t2c/tests/ALSA_PCM_Interface_Direct_Access_Functions/ALSA_PCM_Interface_Direct_Access_Functions 2 UNRESOLVED
/ALSA-t2c/tests/ALSA_PCM_Interface_Direct_Access_Functions/ALSA_PCM_Interface_Direct_Access_Functions 3 UNRESOLVED
/ALSA-t2c/tests/ALSA_PCM_Interface_General_Functions/ALSA_PCM_Interface_General_Functions 11 UNRESOLVED
/ALSA-t2c/tests/ALSA_Sequencer_Event_API/ALSA_Sequencer_Event_API 4 UNRESOLVED
/ALSA-t2c/tests/ALSA_Timer_Interface/ALSA_Timer_Interface 1 UNRESOLVED
/ALSA-t2c/tests/ALSA_Timer_Interface/ALSA_Timer_Interface 2 UNRESOLVED
/ALSA-t2c/tests/ALSA_Timer_Interface/ALSA_Timer_Interface 17 UNRESOLVED
/ALSA-t2c/tests/ALSA_Timer_Interface/ALSA_Timer_Interface 27 UNRESOLVED
/ALSA-t2c/tests/ALSA_Timer_Interface/ALSA_Timer_Interface 32 UNRESOLVED
/ALSA-t2c/tests/ALSA_Timer_Interface/ALSA_Timer_Interface 33 UNRESOLVED
/ALSA-t2c/tests/ALSA_Timer_Interface/ALSA_Timer_Interface 34 UNRESOLVED
/ALSA-t2c/tests/ALSA_Timer_Interface/ALSA_Timer_Interface 35 UNRESOLVED
/ALSA-t2c/tests/ALSA_Timer_Interface/ALSA_Timer_Interface 36 UNRESOLVED
/ALSA-t2c/tests/ALSA_Timer_Interface/ALSA_Timer_Interface 37 UNRESOLVED


Test was run: 20100428 22:14:26 
Test Suite Version: unset
Test Suite Architecture: unset
Total Tests Passed: 830
Total Tests Failed (including waived): 36
Total Tests Failed (excluding waived): 36

Run with sound driver disabled (service alsa stop):

(detail omitted)
Test was run: 20100428 21:52:53 
Test Suite Version: unset
Test Suite Architecture: unset
Total Tests Passed: 620
Total Tests Failed (including waived): 246

Of the second set, only of the normal tests using the "null" pcm are in the UNRESOLVED set: snd_pcm_hwparams, which is one of the incomplete tests, also failing when the sound driver is present.

So it would appear that we'll either have to require sound hardware to be enabled, or have all tests that access the pcm use "null", rather than something like "hw:0" (current default).

5/5/2010 - lsb-test-alsa-t2c-4.0.94.20100429-1 - work done to disable shallow tests with issues, same kvm setup

Total Tests Passed: 866
Total Tests Failed (including waived): 0

OpenSuSE-11.3/ia32

  • Same kvm setup as Mandriva, ens1370 sound driver
  • lsb-test-alsa-t2c-4.0.93.20100428-1.i486
/ALSA-t2c/tests/ALSA_Control_Interface/ALSA_Control_Interface 84 UNRESOLVED
/ALSA-t2c/tests/ALSA_Control_Interface/ALSA_Control_Interface 85 UNRESOLVED
/ALSA-t2c/tests/ALSA_Control_Interface/ALSA_Control_Interface 86 UNRESOLVED
/ALSA-t2c/tests/ALSA_Control_Interface/ALSA_Control_Interface 87 UNRESOLVED
/ALSA-t2c/tests/ALSA_Control_Interface/ALSA_Control_Interface 88 UNRESOLVED
/ALSA-t2c/tests/ALSA_Control_Interface/ALSA_Control_Interface 89 UNRESOLVED
/ALSA-t2c/tests/ALSA_Control_Interface/ALSA_Control_Interface 92 UNRESOLVED
/ALSA-t2c/tests/ALSA_Control_Interface/ALSA_Control_Interface 93 UNRESOLVED
/ALSA-t2c/tests/ALSA_Control_Interface/ALSA_Control_Interface 112 UNRESOLVED
/ALSA-t2c/tests/ALSA_Control_Interface/ALSA_Control_Interface 113 UNRESOLVED
/ALSA-t2c/tests/ALSA_Global_defines_and_functions/ALSA_Global_defines_and_functions 3 UNRESOLVED
/ALSA-t2c/tests/ALSA_Hardware_Dependant_Interface/ALSA_Hardware_Dependant_Interface 1 UNRESOLVED
/ALSA-t2c/tests/ALSA_Hardware_Dependant_Interface/ALSA_Hardware_Dependant_Interface 16 UNRESOLVED
/ALSA-t2c/tests/ALSA_Hardware_Dependant_Interface/ALSA_Hardware_Dependant_Interface 17 UNRESOLVED
/ALSA-t2c/tests/ALSA_Hardware_Dependant_Interface/ALSA_Hardware_Dependant_Interface 27 UNRESOLVED
/ALSA-t2c/tests/ALSA_Hardware_Dependant_Interface/ALSA_Hardware_Dependant_Interface 38 UNRESOLVED
/ALSA-t2c/tests/ALSA_Hardware_Dependant_Interface/ALSA_Hardware_Dependant_Interface 39 UNRESOLVED
/ALSA-t2c/tests/ALSA_Hardware_Dependant_Interface/ALSA_Hardware_Dependant_Interface 40 UNRESOLVED
/ALSA-t2c/tests/ALSA_Hardware_Dependant_Interface/ALSA_Hardware_Dependant_Interface 41 UNRESOLVED
/ALSA-t2c/tests/ALSA_Hardware_Dependant_Interface/ALSA_Hardware_Dependant_Interface 42 UNRESOLVED
/ALSA-t2c/tests/ALSA_High_level_Control_Interface/ALSA_High_level_Control_Interface 16 UNRESOLVED
/ALSA-t2c/tests/ALSA_High_level_Control_Interface/ALSA_High_level_Control_Interface 18 UNRESOLVED
/ALSA-t2c/tests/ALSA_Mixer_Interface/ALSA_Mixer_Interface 16 UNRESOLVED
/ALSA-t2c/tests/ALSA_PCM_Interface_Direct_Access_Functions/ALSA_PCM_Interface_Direct_Access_Functions 2 UNRESOLVED
/ALSA-t2c/tests/ALSA_PCM_Interface_Direct_Access_Functions/ALSA_PCM_Interface_Direct_Access_Functions 3 UNRESOLVED
/ALSA-t2c/tests/ALSA_PCM_Interface_General_Functions/ALSA_PCM_Interface_General_Functions 2 UNRESOLVED
/ALSA-t2c/tests/ALSA_Sequencer_Event_API/ALSA_Sequencer_Event_API 4 UNRESOLVED
/ALSA-t2c/tests/ALSA_Timer_Interface/ALSA_Timer_Interface 1 UNRESOLVED
/ALSA-t2c/tests/ALSA_Timer_Interface/ALSA_Timer_Interface 2 UNRESOLVED
/ALSA-t2c/tests/ALSA_Timer_Interface/ALSA_Timer_Interface 17 UNRESOLVED
/ALSA-t2c/tests/ALSA_Timer_Interface/ALSA_Timer_Interface 27 UNRESOLVED
/ALSA-t2c/tests/ALSA_Timer_Interface/ALSA_Timer_Interface 32 UNRESOLVED
/ALSA-t2c/tests/ALSA_Timer_Interface/ALSA_Timer_Interface 33 UNRESOLVED
/ALSA-t2c/tests/ALSA_Timer_Interface/ALSA_Timer_Interface 34 UNRESOLVED
/ALSA-t2c/tests/ALSA_Timer_Interface/ALSA_Timer_Interface 35 UNRESOLVED
/ALSA-t2c/tests/ALSA_Timer_Interface/ALSA_Timer_Interface 36 UNRESOLVED
/ALSA-t2c/tests/ALSA_Timer_Interface/ALSA_Timer_Interface 37 UNRESOLVED

Test was run: 20100429 11:16:12 
Test Suite Version: unset
Test Suite Architecture: unset
Total Tests Passed: 829
Total Tests Failed (including waived): 37
Total Tests Failed (excluding waived): 37

Picked up an extra failure or 2, dropped the ALSA_PCM_Interface_General_Functions 11 UNRESOLVED as I disabled the snd_pcm_hwparams with the known issue in this build.

One unique one in this set is:

/ALSA-t2c/tests/ALSA_Global_defines_and_functions/ALSA_Global_defines_and_functions 3 UNRESOLVED

Journal Detail:

520|3 3 00021996 1 1|Test target(s):
520|3 3 00021996 1 2|snd_async_del_handler
520|3 3 00021996 1 3|--------
520|3 3 00021993 1 1|ALSA_Global_defines_and_functions: child process was terminated by signal 6
220|3 3 2 11:16:19|UNRESOLVED

Results beyond this point are after I pushed changes to do checks or completely disable a number of the shallow tests that were returning UNRESOLVED most everywhere:

RHEL54/IA32

Again in a kvm, ens1370 driver:

/ALSA-t2c/tests/ALSA_Simple_Mixer_Interface/ALSA_Simple_Mixer_Interface 10 UNRESOLVED
/ALSA-t2c/tests/ALSA_Simple_Mixer_Interface/ALSA_Simple_Mixer_Interface 12 UNRESOLVED
/ALSA-t2c/tests/ALSA_Simple_Mixer_Interface/ALSA_Simple_Mixer_Interface 13 UNRESOLVED
/ALSA-t2c/tests/ALSA_Simple_Mixer_Interface/ALSA_Simple_Mixer_Interface 60 UNRESOLVED

Test was run: 20100430 08:07:33 
Test Suite Version: unset
Test Suite Architecture: unset
Total Tests Passed: 862
Total Tests Failed (including waived): 4
Total Tests Failed (excluding waived): 4

RHEL6 Beta/ia32

Also in a kvm, ens1370 driver:

/ALSA-t2c/tests/ALSA_Simple_Mixer_Interface/ALSA_Simple_Mixer_Interface 10 UNRESOLVED
/ALSA-t2c/tests/ALSA_Simple_Mixer_Interface/ALSA_Simple_Mixer_Interface 12 UNRESOLVED
/ALSA-t2c/tests/ALSA_Simple_Mixer_Interface/ALSA_Simple_Mixer_Interface 13 UNRESOLVED
/ALSA-t2c/tests/ALSA_Simple_Mixer_Interface/ALSA_Simple_Mixer_Interface 60 UNRESOLVED

Test was run: 20100430 08:07:57 
Test Suite Version: unset
Test Suite Architecture: unset
Total Tests Passed: 862
Total Tests Failed (including waived): 4
Total Tests Failed (excluding waived): 4

Journal detail:

[root@rhel6-32 alsa-t2c]# grep -B3 UNRESOLVED results/0001e/journal 
520|29 10 00002316 1 2|snd_mixer_selem_get_enum_item
520|29 10 00002316 1 3|--------
520|29 10 00002306 1 1|ALSA_Simple_Mixer_Interface: child process was terminated by signal 6
220|29 10 2 08:08:44|UNRESOLVED
--
520|29 12 00002320 1 2|snd_mixer_selem_get_enum_item_name
520|29 12 00002320 1 3|--------
520|29 12 00002306 1 1|ALSA_Simple_Mixer_Interface: child process was terminated by signal 6
220|29 12 2 08:08:44|UNRESOLVED
--
520|29 13 00002322 1 2|snd_mixer_selem_get_enum_item_name
520|29 13 00002322 1 3|--------
520|29 13 00002306 1 1|ALSA_Simple_Mixer_Interface: child process was terminated by signal 6
220|29 13 2 08:08:44|UNRESOLVED
--
520|29 60 00002370 1 2|snd_mixer_selem_set_enum_item
520|29 60 00002370 1 3|--------
520|29 60 00002306 1 1|ALSA_Simple_Mixer_Interface: child process was terminated by signal 6
220|29 60 2 08:08:46|UNRESOLVED

SLES11/ia32

kvm, ens1370 driver, same results:

/ALSA-t2c/tests/ALSA_Simple_Mixer_Interface/ALSA_Simple_Mixer_Interface 10 UNRESOLVED
/ALSA-t2c/tests/ALSA_Simple_Mixer_Interface/ALSA_Simple_Mixer_Interface 12 UNRESOLVED
/ALSA-t2c/tests/ALSA_Simple_Mixer_Interface/ALSA_Simple_Mixer_Interface 13 UNRESOLVED
/ALSA-t2c/tests/ALSA_Simple_Mixer_Interface/ALSA_Simple_Mixer_Interface 60 UNRESOLVED

Test was run: 20100501 07:11:35 
Test Suite Version: unset
Test Suite Architecture: unset
Total Tests Passed: 862
Total Tests Failed (including waived): 4

[Article] [Discussion] [View source] [History]