The Linux Foundation

 
TestPilot40

From The Linux Foundation

Revision as of 19:13, 24 July 2009 by Stewb (Talk | contribs)

(diff) ←Older revision | view current revision (diff) | Newer revision→ (diff)

Assorted comments and experiences with LSB 4.0 testing. Note that comments about possible waivers are to be considered informal; the way to get a waiver granted is to file a problem report through the certification system. For instructions on installing and running the tests, please see these instructions from ISPRAS.

Note on maintaining this page: start by pasting test results from a given system which has an unknown failure. As analysis proceeds, migrate those raw results into an explanation; don't remove the problems. The idea is to have an in informal log of problems people might run into.

If you need more of a scratch page for collecting specific items from this page for items that need resolving, please use TestPilot40/Unresolved. However, please keep a record here in TestPilot40 of final actions taken.

Contents

Pre-test System Setup

Various bits of information on system resources, additional packages, and locale setup have been migrated to a more version generic page

Beta Process Links

Core test

  • Newer glibc implementations are showing a number of failures in the exec* tests. A typical journal will look something like this:
/tset/POSIX.os/procenv/sysconf/T.sysconf 1 FAIL
/tset/POSIX.os/procprim/exec/T.execl 15 FAIL
/tset/POSIX.os/procprim/exec/T.execl 16 UNRESOLVED
/tset/POSIX.os/procprim/exec/T.execle 15 FAIL
/tset/POSIX.os/procprim/exec/T.execle 16 UNRESOLVED
/tset/POSIX.os/procprim/exec/T.execlp 15 FAIL
/tset/POSIX.os/procprim/exec/T.execlp 16 UNRESOLVED
/tset/POSIX.os/procprim/exec/T.execv 15 FAIL
/tset/POSIX.os/procprim/exec/T.execv 16 UNRESOLVED
/tset/POSIX.os/procprim/exec/T.execve 15 FAIL
/tset/POSIX.os/procprim/exec/T.execve 16 UNRESOLVED
/tset/POSIX.os/procprim/exec/T.execvp 15 FAIL
/tset/POSIX.os/procprim/exec/T.execvp 16 UNRESOLVED

It would appear that the values for _SC_ARG_MAX(glibc) and ARG_MAX(kernel) no longer agree, plus it would seem that the value returned by _SC_ARG_MAX is not actually honored when an application tries to use it. More detail can be found in bug 2288.

  • There was an issue with the __fxstat, __lsxtat, __xstat test where a fixed value of "3" for ver was being used, and the 64bit platforms require "1". Tests have been corrected to use _STAT_VER. this is tracked in bug 2424
/tset/LI18NUX2K.L1/base/__fxstat/T.__fxstat 1 FAIL
/tset/LI18NUX2K.L1/base/__lxstat/T.__lxstat 1 FAIL
/tset/LI18NUX2K.L1/base/__lxstat/T.__lxstat 2 FAIL
/tset/LI18NUX2K.L1/base/__xstat/T.__xstat 1 FAIL
  • There is an issue with the strerror_r test where it segfaults on 64bit platforms due to clashing definitions of strerror_r. This is tracked in bug 2336. A fix has been pushed (11/25/08) to test in XSI mode which should resolve the crash.
/tset/ANSI.os/string/strerror_r/T.strerror_r 1 UNRESOLVED
  Checks the functionality of strerror_r()
unexpected signal 11 (SIGSEGV) received
  • T.sysconf 5 fails on some distributions over a disagreement in the value of OPEN_MAX returned by sysconf and the system headers. This is tracked in bug 2435. OPEN_MAX has been removed from limits.h in LSB-4.0 and the test appears to compile correctly now where it compares _SC_OPEN_MAX >= _POSIX_OPEN_MAX.
/tset/POSIX.os/procenv/sysconf/T.sysconf 5 FAIL
  sysconf(_SC_OPEN_MAX) did not return the value of OPEN_MAX
value returned: 1024, OPEN_MAX: 256
(OPEN_MAX should not be defined in <limits.h> if 
the run-time value can vary.)
  • Distributions that use Red Hat's chkconfig can fail 2 of the initd tests. Previous discussion of these tests seemed to indicate there's some disagreement as to whether the strict dependency called out in the spec/tests is valid.

ref: bug 2443 Feedback from upstream indicates a new version of chkconfig should honor this behavior when called as install_init or remove_initd.

/tset/initd/misc/install/general-tc 3 FAIL
  Reference 20.3-3(C) Testing activation of initscript
If an initscript depends on a boot facility it shall not be
activated by a call to install_initd if the dependency is not met
Call /usr/lib/lsb/install_initd /etc/init.d/lsb-initA
exit code 0 returned, expected 1
Check that lsb-initA is not installed in initscript directories
/etc/rc.d/rc0.d/K50lsb-initA: found a symlink
exit code 2 returned, expected 1
/etc/rc.d/rc1.d/K50lsb-initA: found a symlink
exit code 2 returned, expected 1
/etc/rc.d/rc2.d/S51lsb-initA: found a symlink
exit code 2 returned, expected 1
/etc/rc.d/rc3.d/S51lsb-initA: found a symlink
exit code 2 returned, expected 1
/etc/rc.d/rc4.d/S51lsb-initA: found a symlink
exit code 2 returned, expected 1
/etc/rc.d/rc5.d/S51lsb-initA: found a symlink
exit code 2 returned, expected 1
/etc/rc.d/rc6.d/K50lsb-initA: found a symlink
exit code 2 returned, expected 1
Cleanup, deactivate initscripts, if any
Cleanup, remove initscript files, if any

/tset/initd/misc/install/general-tc 5 FAIL
  Reference 20.4-5(C)  Testing deactivation of initscript
If a boot facility provided by an initscript is depended on by another
initscript the script shall not be deactivated by a call to remove_initd
Call /usr/lib/lsb/install_initd /etc/init.d/lsb-initB
Call /usr/lib/lsb/install_initd /etc/init.d/lsb-initA
Check that lsb-initA is installed in initscript directories
/etc/rc.d/rc0.d/K50lsb-initA: found a symlink
/etc/rc.d/rc1.d/K50lsb-initA: found a symlink
/etc/rc.d/rc2.d/S51lsb-initA: found a symlink
/etc/rc.d/rc3.d/S51lsb-initA: found a symlink
/etc/rc.d/rc4.d/S51lsb-initA: found a symlink
/etc/rc.d/rc5.d/S51lsb-initA: found a symlink
/etc/rc.d/rc6.d/K50lsb-initA: found a symlink
Check that lsb-initB is installed in initscript directories
/etc/rc.d/rc0.d/K50lsb-initB: found a symlink
/etc/rc.d/rc1.d/K50lsb-initB: found a symlink
/etc/rc.d/rc2.d/S50lsb-initB: found a symlink
/etc/rc.d/rc3.d/S50lsb-initB: found a symlink
/etc/rc.d/rc4.d/S50lsb-initB: found a symlink
/etc/rc.d/rc5.d/S50lsb-initB: found a symlink
/etc/rc.d/rc6.d/K50lsb-initB: found a symlink
Call /usr/lib/lsb/install_initd /etc/init.d/lsb-initB
exit code 0 returned, expected non-zero
Check that lsb-initB is installed in initscript directories
/etc/rc.d/rc0.d/K??lsb-initB: file not found
/etc/rc.d/rc1.d/K??lsb-initB: file not found
/etc/rc.d/rc2.d/S??lsb-initB: file not found
exit code 1 returned, expected 2
/etc/rc.d/rc3.d/S??lsb-initB: file not found
exit code 1 returned, expected 2
/etc/rc.d/rc4.d/S??lsb-initB: file not found
exit code 1 returned, expected 2
/etc/rc.d/rc5.d/S??lsb-initB: file not found
exit code 1 returned, expected 2
/etc/rc.d/rc6.d/K??lsb-initB: file not found
Cleanup, deactivate initscripts, if any
Cleanup, remove initscript files, if any
  • T.munlock test 2 is failing on some distributions, returning ENOMEM. Root cause is not known yet, but the issue is tracked in bug 2436. A fix has been pushed (11/26/08) to correct this issue.
/tset/LSB.os/procenv/munlock/T.munlock 2 FAIL
  Checks the munlock() for return vaulue 0
munlock return -1, expected to return zero
errno was set to 12
  • Fedora 9 / x86_64 observes an issue with strftime, which looks locale-related:
/tset/ANSI.os/time/strftime/T.strftime 9 	Failed 	
with TZ=ABC-4:30:20 strftime() gave incorrect standard timezone name
observed "MST", expected "ABC"
with TZ=JKL3:10PNM4:40 strftime() gave incorrect standard timezone name
observed "MST", expected "JKL"
with TZ=JKL3:10PNM4:40 strftime() gave incorrect daylight saving timezone name
observed "MDT", expected "PNM"
  • Fedora 9 / x86_64 observes an issue with pipe:
/tset/POSIX.os/ioprim/pipe/T.pipe 4 	Unresolved 	
deletion reason: unable to find an unused file descriptor
  • Fedora 9 / x86_64 no longer supplies /usr/X11R6, should this be required?
/tset/LSB.fhs/usr/x11r6/x11r6-tc 1 	Failed 	
Reference 4.4-1(A)
The /usr/X11R6 directory exists and is searchable
/usr/X11R6: directory not found
  • Fedora 9 / x86_64 observes an issue with adjtime:
/tset/LSB.fhs/var/lib-hwclock/lib-hwclock-tc 1 	Failed 	
Reference 5.8.5.1
/var/lib/hwclock : State directory for hwclock (optional)
This directory contains the file /var/lib/hwclock/adjtime
In FHS 2.1, this file was /etc/adjtime, but as hwclock updates it, that was obviously incorrect.
Found /etc/adjtime, should be in /var/lib/hwclock

This test was added per bug 1483 and few distributions seem to honor the described behavior at this time.

  • Fedora 9 / x86_64 observes an issue with nice:
/tset/LSB.os/procenv/nice/T.nice 9 	Failed 	
nice(-1) did not return expected values
ERRNO VALUES: expected: 1 (EPERM), observed: 0 (NO ERROR)
  • Fedora 9 / x86_64 had a problem with daemon 2 after daemon 1 was disabled:
/tset/LSB.os/procprim/daemon/T.daemon 2 	Unreported 	
Messages from the test
(none)

Note: daemon 2 has also been disabled until the tests can be reworked (12/09/08 Stew)

  • SLES11 (only some archs - namely s390x and ppc64) has two failures in /tset/LSB.os/procenv/ulimit/T.ulimit {4,5}:
super user attempt to double its file size limit failed
ulimit(2) failed with errno = 0 (NO ERROR)
attempt by process (effective UID not super-user) to increase its file size limit using ulimit() did not return expected values
ERRNO VALUES: expected: 1 (EPERM), observed: 0 (NO ERROR)

libstdcpp test

  • Seeing these 2 tests fail fairly consistently across distributions. No further diagnosis has been done at this time.
/27_io/objects/char/12048-5.cc 1 FAIL
_27_io_objects_char_12048-5.exe: 
.../lsb-test-libstdcpp-4.1.0/testsuite/27_io/objects/char/12048-5.cc:47: 
void test01(): Assertion `c3 == std::char_traits<char>::to_char_type(c2)' failed.

/27_io/objects/wchar_t/12048-5.cc 1 FAIL
_27_io_objects_wchar_t_12048-5.exe: 
.../lsb-test-libstdcpp-4.1.0/testsuite/27_io/objects/wchar_t/12048-5.cc:45: 
void test01(): Assertion `c3 == std::char_traits<wchar_t>::to_char_type(c2)' failed.

ref: http://gcc.gnu.org/bugzilla/show_bug.cgi?id=12048

  • Also seeing this test fail, although not quite as much as the previous 2:
/27_io/fpos/14320-1.cc 1 FAIL
_27_io_fpos_14320-1.exe:
.../lsb-test-libstdcpp-4.1.0/testsuite/27_io/fpos/14320-1.cc:54:
void test01(): Assertion `found' failed.

ref: http://gcc.gnu.org/bugzilla/show_bug.cgi?id=14320

The previous 3 tests are covered in bug 2459

  • Mats adds:
/22_locale/money_put/put/char/9780-3.cc 1 	Failed 	
_22_locale_money_put_put_char_9780-3.exe:
.../lsb-test-libstdcpp-4.1.0/testsuite/22_locale/money_put/put/char/9780-3.cc:42:
int main(): Assertion `res == "-EUR 12.345.678,90"' failed.

/27_io/basic_istream/extractors_other/char/1.cc 1 	Failed 	
_27_io_basic_istream_extractors_other_char_1.exe:
.../lsb-test-libstdcpp-4.1.0/testsuite/27_io/basic_istream/extractors_other/char/1.cc:127:
void test01(): Assertion `state1 == state2' failed.

/27_io/basic_istream/extractors_other/wchar_t/1.cc 1 	Failed 	
_27_io_basic_istream_extractors_other_wchar_t_1.exe:
.../lsb-test-libstdcpp-4.1.0/testsuite/27_io/basic_istream/extractors_other/wchar_t/1.cc:125:
void test01(): Assertion `state1 == state2' failed.

ref: http://gcc.gnu.org/bugzilla/show_bug.cgi?id=9780

  • also see bug 2445 for some locales changes that are impacting the tests
  • Seem to be getting a considerable number of failures with libstdc++ > 4.1.0. I had originally discounted these as being locale setup issues, but I'm seeing them on rpm based systems too, where I thought I knew how to setup the locales for testing.

SLES10/ia32 (libstdc++-4.1.0):

/27_io/fpos/14320-1.cc 1 FAIL
/27_io/objects/char/12048-5.cc 1 FAIL
/27_io/objects/wchar_t/12048-5.cc 1 FAIL
Total Tests Passed: 1801
Total Tests Failed (including waived): 3
Total Tests Failed (excluding waived): 3

Mandriva 2009.0/ia32 (libstdc++-4.3.2):

/22_locale/codecvt/always_noconv/wchar_t/3.cc 1 FAIL
/22_locale/codecvt/encoding/wchar_t/3.cc 1 FAIL
/22_locale/codecvt/in/wchar_t/3.cc 1 FAIL
/22_locale/codecvt/length/wchar_t/3.cc 1 FAIL
/22_locale/codecvt/max_length/wchar_t/3.cc 1 FAIL
/22_locale/codecvt/out/wchar_t/3.cc 1 FAIL
/22_locale/codecvt/unshift/wchar_t/3.cc 1 FAIL
/22_locale/time_put/put/char/4.cc 1 FAIL
/22_locale/time_put/put/char/wrapped_env.cc 1 FAIL
/22_locale/time_put/put/char/wrapped_locale.cc 1 FAIL
/22_locale/time_put/put/wchar_t/4.cc 1 FAIL
/22_locale/time_put/put/wchar_t/wrapped_env.cc 1 FAIL
/22_locale/time_put/put/wchar_t/wrapped_locale.cc 1 FAIL
/27_io/basic_istream/extractors_other/char/1.cc 1 FAIL
/27_io/basic_istream/extractors_other/wchar_t/1.cc 1 FAIL
/27_io/fpos/14320-1.cc 1 FAIL
/27_io/objects/char/12048-5.cc 1 FAIL
/27_io/objects/wchar_t/12048-5.cc 1 FAIL
Total Tests Passed: 1786
Total Tests Failed (including waived): 18
Total Tests Failed (excluding waived): 18

Mandriva 2008.1/x86_64 (libstdc++-4.2.3) - nearly the same as Mandriva 2009, but dropping a few (journal compare):

/22_locale/time_put/put/char/4.cc 1 FAIL,PASS
/22_locale/time_put/put/char/wrapped_env.cc 1 FAIL,PASS
/22_locale/time_put/put/char/wrapped_locale.cc 1 FAIL,PASS
/22_locale/time_put/put/wchar_t/4.cc 1 FAIL,PASS
/22_locale/time_put/put/wchar_t/wrapped_env.cc 1 FAIL,PASS
/22_locale/time_put/put/wchar_t/wrapped_locale.cc 1 FAIL,PASS
/27_io/fpos/14320-1.cc 1 FAIL,PASS
/ext/pb_assoc/example/mapping_level_neg.cc 1 NOTINUSE,MISSING
Total Tests Passed: 1792
Total Tests Failed (including waived): 11
Total Tests Failed (excluding waived): 11

Ubuntu 8.10/ia32 (libstdc++-4.3.2) - somewhat worse than Mandriva 2009, locales issues still?:

/22_locale/codecvt/always_noconv/char/wrapped_locale.cc 1 FAIL
/22_locale/codecvt/always_noconv/wchar_t/wrapped_locale.cc 1 FAIL
/22_locale/codecvt/encoding/char/wrapped_locale.cc 1 FAIL
/22_locale/codecvt/encoding/wchar_t/wrapped_locale.cc 1 FAIL
/22_locale/codecvt/in/char/wrapped_locale.cc 1 FAIL
/22_locale/codecvt/in/wchar_t/wrapped_locale.cc 1 FAIL
/22_locale/codecvt/length/char/wrapped_locale.cc 1 FAIL
/22_locale/codecvt/length/wchar_t/wrapped_locale.cc 1 FAIL
/22_locale/codecvt/max_length/char/wrapped_locale.cc 1 FAIL
/22_locale/codecvt/max_length/wchar_t/wrapped_locale.cc 1 FAIL
/22_locale/codecvt/out/char/wrapped_locale.cc 1 FAIL
/22_locale/codecvt/out/wchar_t/wrapped_locale.cc 1 FAIL
/22_locale/codecvt/unshift/char/wrapped_locale.cc 1 FAIL
/22_locale/codecvt/unshift/wchar_t/wrapped_locale.cc 1 FAIL
/22_locale/collate/compare/char/wrapped_locale.cc 1 FAIL
/22_locale/collate/compare/wchar_t/wrapped_locale.cc 1 FAIL
/22_locale/collate/hash/char/wrapped_locale.cc 1 FAIL
/22_locale/collate/hash/wchar_t/wrapped_locale.cc 1 FAIL
/22_locale/collate/transform/char/wrapped_locale.cc 1 FAIL
/22_locale/collate/transform/wchar_t/wrapped_locale.cc 1 FAIL
/22_locale/ctype/cons/char/wrapped_locale.cc 1 FAIL
/22_locale/ctype/is/char/wrapped_locale.cc 1 FAIL
/22_locale/ctype/is/wchar_t/wrapped_locale.cc 1 FAIL
/22_locale/ctype/narrow/char/wrapped_locale.cc 1 FAIL
/22_locale/ctype/narrow/wchar_t/wrapped_locale.cc 1 FAIL
/22_locale/ctype/scan/char/wrapped_locale.cc 1 FAIL
/22_locale/ctype/scan/wchar_t/wrapped_locale.cc 1 FAIL
/22_locale/ctype/to/char/wrapped_locale.cc 1 FAIL
/22_locale/ctype/to/wchar_t/wrapped_locale.cc 1 FAIL
/22_locale/ctype/widen/char/wrapped_locale.cc 1 FAIL
/22_locale/ctype/widen/wchar_t/wrapped_locale.cc 1 FAIL
/22_locale/messages/members/char/wrapped_locale.cc 1 FAIL
/22_locale/money_get/get/char/wrapped_locale.cc 1 FAIL
/22_locale/money_get/get/wchar_t/wrapped_locale.cc 1 FAIL
/22_locale/money_put/put/char/wrapped_locale.cc 1 FAIL
/22_locale/money_put/put/wchar_t/wrapped_locale.cc 1 FAIL
/22_locale/moneypunct/members/char/wrapped_locale.cc 1 FAIL
/22_locale/moneypunct/members/wchar_t/wrapped_locale.cc 1 FAIL
/22_locale/num_get/get/char/wrapped_locale.cc 1 FAIL
/22_locale/num_get/get/wchar_t/wrapped_locale.cc 1 FAIL
/22_locale/num_put/put/char/wrapped_locale.cc 1 FAIL
/22_locale/num_put/put/wchar_t/wrapped_locale.cc 1 FAIL
/22_locale/numpunct/members/char/wrapped_locale.cc 1 FAIL
/22_locale/numpunct/members/wchar_t/wrapped_locale.cc 1 FAIL
/22_locale/time_get/date_order/char/wrapped_locale.cc 1 FAIL
/22_locale/time_get/date_order/wchar_t/wrapped_locale.cc 1 FAIL
/22_locale/time_get/get_date/char/wrapped_locale.cc 1 FAIL
/22_locale/time_get/get_date/wchar_t/4.cc 1 FAIL
/22_locale/time_get/get_date/wchar_t/wrapped_locale.cc 1 FAIL
/22_locale/time_get/get_monthname/char/wrapped_locale.cc 1 FAIL
/22_locale/time_get/get_monthname/wchar_t/wrapped_locale.cc 1 FAIL
/22_locale/time_get/get_time/char/wrapped_locale.cc 1 FAIL
/22_locale/time_get/get_time/wchar_t/wrapped_locale.cc 1 FAIL
/22_locale/time_get/get_weekday/char/wrapped_locale.cc 1 FAIL
/22_locale/time_get/get_weekday/wchar_t/wrapped_locale.cc 1 FAIL
/22_locale/time_get/get_year/char/wrapped_locale.cc 1 FAIL
/22_locale/time_get/get_year/wchar_t/wrapped_locale.cc 1 FAIL
/22_locale/time_put/put/char/wrapped_locale.cc 1 FAIL
/22_locale/time_put/put/wchar_t/wrapped_locale.cc 1 FAIL
/27_io/basic_filebuf/imbue/wchar_t/12868.cc 1 FAIL
/27_io/basic_istream/extractors_other/char/1.cc 1 FAIL
/27_io/basic_istream/extractors_other/wchar_t/1.cc 1 FAIL
/27_io/basic_streambuf/imbue/char/13007-1.cc 1 FAIL
/27_io/basic_streambuf/imbue/wchar_t/13007-1.cc 1 FAIL
/27_io/fpos/14320-1.cc 1 FAIL
/27_io/objects/char/12048-5.cc 1 FAIL
/27_io/objects/wchar_t/12048-5.cc 1 FAIL
/ext/stdio_sync_filebuf/wchar_t/12077.cc 1 FAIL
Total Tests Passed: 1736
Total Tests Failed (including waived): 68
Total Tests Failed (excluding waived): 68

FC9/ia32 (libstdc++-4.3.0) - a bit better, why is this 4.3.0 better than 4.2.3 or 4.3.2?

/22_locale/money_put/put/char/9780-3.cc 1 FAIL
/27_io/basic_istream/extractors_other/char/1.cc 1 FAIL
/27_io/basic_istream/extractors_other/wchar_t/1.cc 1 FAIL
/27_io/fpos/14320-1.cc 1 FAIL
/27_io/objects/char/12048-5.cc 1 FAIL
/27_io/objects/wchar_t/12048-5.cc 1 FAIL
Total Tests Passed: 1798
Total Tests Failed (including waived): 6
Total Tests Failed (excluding waived): 6

OpenSuSE 11.1/x86_64 (libstdc++-4.3.3_20081022), also SLES11 (various platforms):

/22_locale/money_put/put/char/9780-3.cc 1 FAIL
/22_locale/time_put/put/char/4.cc 1 FAIL
/22_locale/time_put/put/char/wrapped_env.cc 1 FAIL
/22_locale/time_put/put/char/wrapped_locale.cc 1 FAIL
/22_locale/time_put/put/wchar_t/4.cc 1 FAIL
/22_locale/time_put/put/wchar_t/wrapped_env.cc 1 FAIL
/22_locale/time_put/put/wchar_t/wrapped_locale.cc 1 FAIL
/27_io/basic_istream/extractors_other/char/1.cc 1 FAIL
/27_io/basic_istream/extractors_other/wchar_t/1.cc 1 FAIL
/27_io/objects/char/12048-5.cc 1 FAIL
/27_io/objects/wchar_t/12048-5.cc 1 FAIL
Total Tests Passed: 1792
Total Tests Failed (including waived): 11
Total Tests Failed (excluding waived): 11

XTS5

In the 4.0 beta release, 64bit platforms will tend to show an excessive number of failures, around 75 or so.

This is tracked in bug 2342, which we believe has been fixed in the snapshot builds.

The following failure shows up in a number of distributions:

/tset/Xlib3/clsdsply/Test 6 FAIL

Journal detail doesn't tell a lot:

Assertion XCloseDisplay-6.(A)
When the client has grabbed the server, then a call to
XCloseDisplay performs a XUngrabServer.
METH: Create a connection for client1 using XOpenDisplay.
METH: Create a connection for client2 using XOpenDisplay.
METH: Create a window using XCreateWindow.
METH: Grab the server for the default display using XGrabServer.
METH: Create a process using tet_fork.
METH: In child process:
METH:    Generate a ChangeProperty request using XChangeProperty.
METH: Wait sufficient time for the ChangeProperty request to be processed.
METH: Verify that no PropertyChange event has been generated by client2 using XCheckWindowEvent.
METH: Close the client1 connection using XCloseDisplay.
METH: In child process:
METH:     Wait suffient time for the ChangeProperty request to be processed.
METH:     Verify that a ChangeProperty request was generated by client2.
TRACE: --- Running test with visual class TrueColor, depth 16
CHECK: XCloseDisplay-6  1, line 220
REPORT: XCloseDisplay() did not ungrab the server.
CHECK: XCloseDisplay-6  1, line 843

Issue is tracked in bug 2405. It would appear to be xcb-based systems that fail, and there is some feeling that it's a test bug (more detail in the bug).

Perl

  • The perl tests are dependent on a number of other features not specified by LSB being present for successful testing. They include libperl.so (and possibly more).
  • Some distributions have divided perl up into many different sub-packages, replacing parts of the perl source tarball with "equivalent" CPAN modules that may behave differently than the perl tests expect. It can be a challenge to find all the necessary perl bits to install to re-create what a build of the upstream perl tarball would install.

Printing

  • An additional test was added to lsb-test-printing to test for the directory /usr/share/ppd, which may not be present on all distributions (bug 2157).
  • A couple of the foomaticrip tests seem to be failing on a number of distributions (FC9 listed, foomatic-3.0.2-67.fc9.i386):
/testfoomaticrip/testfoomaticrip 3 FAIL
/testfoomaticrip/testfoomaticrip 11 FAIL

An additional FAIL was observed on SLES11 beta (using foomatic-3.0.2-269.35):

/testfoomaticrip/testfoomaticrip 13 FAIL

Journal Detail:

/testfoomaticrip/testfoomaticrip 3 FAIL
  Reference III.8.2
foomatic-rip inserts standard PPD options into the correct
sections of a DSC-compliant PostScript file and withing the
sections also in the correct order.
Executing /usr/bin/foomatic-rip --ppd /opt/lsb/test/printing/tet_tmp_dir/26243aa/testfoomaticrip/foomatic-test.ppd -o FilterPath=/opt/lsb/test/printing/tet_tmp_dir/26243aa/testfoomaticrip/  /opt/lsb/test/printing/tet_tmp_dir/26243aa/testfoomaticrip/foomatic-test-input-ps.ps
Checking: JCLSetup: Option6
Checking: Prolog: Option5
Checking: Setup: PageSize Option1 Option7 Option8 Option2 Option3
Checking: PageSetup: Page 1: Option4, Page 2: Option4, Page 3: Option4, Page 4: Option4
Output written to stdout did not contain "\%\%Page:\s*1\s+1.*\%\%BeginFeature:\s*\*Option4\s+Choice\d.*gsave.*\%\%Page:\s*2\s+2.*\%\%BeginFeature:\s*\*Option4\s+Choice\d.*gsave.*\%\%Page:\s*3\s+3.*\%\%BeginFeature:\s*\*Option4\s+Choice\d.*gsave.*\%\%Page:\s*4\s+4.*\%\%BeginFeature:\s*\*Option4\s+Choice\d.*gsave"
  URL: http://developer.linux-foundation.org/lsbchk?suite=lsb-test-printing&arch=ia32&testcase=/testfoomaticrip/testfoomaticrip&tpnum=3&result=FAIL

/testfoomaticrip/testfoomaticrip 11 FAIL
  Reference III.8.2
Option settings can be applied to selected pages
(page overrides)
Executing /usr/bin/foomatic-rip --ppd /opt/lsb/test/printing/tet_tmp_dir/26243aa/testfoomaticrip/foomatic-test.ppd -o FilterPath=/opt/lsb/test/printing/tet_tmp_dir/26243aa/testfoomaticrip/ -o 3:Option4=Choice3 /opt/lsb/test/printing/tet_tmp_dir/26243aa/testfoomaticrip/foomatic-test-input-ps.ps
Checking: PageSetup: Page 1: Option4=Choice1, Page 2: Option4=Choice1, Page 3: Option4=Choice3, Page 4: Option4=Choice1
Output written to stdout did not contain "\%\%Page:\s*1\s+1.*\%\%BeginFeature:\s*\*Option4\s+Choice1.*gsave.*\%\%Page:\s*2\s+2.*\%\%BeginFeature:\s*\*Option4\s+Choice1.*gsave.*\%\%Page:\s*3\s+3.*\%\%BeginFeature:\s*\*Option4\s+Choice3.*gsave.*\%\%Page:\s*4\s+4.*\%\%BeginFeature:\s*\*Option4\s+Choice1.*gsave"
Executing /usr/bin/foomatic-rip --ppd /opt/lsb/test/printing/tet_tmp_dir/26243aa/testfoomaticrip/foomatic-test.ppd -o FilterPath=/opt/lsb/test/printing/tet_tmp_dir/26243aa/testfoomaticrip/ -o 2-4:FoomaticOption1=Choice3 /opt/lsb/test/printing/tet_tmp_dir/26243aa/testfoomaticrip/foomatic-test-input-ps.ps
Checking: FoomaticOption1=Choice3 for pages 2-4
Executing /usr/bin/foomatic-rip --ppd /opt/lsb/test/printing/tet_tmp_dir/26243aa/testfoomaticrip/foomatic-test.ppd -o FilterPath=/opt/lsb/test/printing/tet_tmp_dir/26243aa/testfoomaticrip/ -o odd:FoomaticOption1=Choice3 /opt/lsb/test/printing/tet_tmp_dir/26243aa/testfoomaticrip/foomatic-test-input-ps.ps
Checking: FoomaticOption1=Choice3 for odd pages
Executing /usr/bin/foomatic-rip --ppd /opt/lsb/test/printing/tet_tmp_dir/26243aa/testfoomaticrip/foomatic-test.ppd -o FilterPath=/opt/lsb/test/printing/tet_tmp_dir/26243aa/testfoomaticrip/ -o 1-2,4:FoomaticOption1=Choice3 /opt/lsb/test/printing/tet_tmp_dir/26243aa/testfoomaticrip/foomatic-test-input-ps.ps
Checking: FoomaticOption1=Choice3 for pages 1-2 and 4
  URL: http://developer.linux-foundation.org/lsbchk?suite=lsb-test-printing&arch=ia32&testcase=/testfoomaticrip/testfoomaticrip&tpnum=11&result=FAIL

Mail list threads (with no real resolution, perl issue?): thread start, continuation

And the bug - local testing seems to point to a regression in foomatic-rip itself. This was confirmed by upstream, the bug being introduced with this commit:

revno: 127
committer: Linux Foundation Patch Queue Manager <pqm@linux-foundation.org>
branch nick: foomatic-filters
timestamp: Sun 2008-04-20 12:20:20 -0700
message:
  Fixed problem of enumerated choice options with settings \"True\" and \"False\" not handled correctly. Added &rbinumcopies; placeholder.

Distributions shipping snapshots of 3.x should update to the 20081119 commit:

revno: 137
committer: Linux Foundation Patch Queue Manager <pqm@linux-foundation.org>
branch nick: foomatic-filters
timestamp: Wed 2008-11-19 03:20:10 -0800
message:
  PageSetup sections were inserted after the first PostScript code line of the p
age and not directly after \"%%Page ...\".
  • Distributions using the 4.0 branch of foomatic filter exhibit a different set of FAILS, with one test consuming the CPU until it's killed:
/testfoomaticrip/testfoomaticrip 7 FAIL
/testfoomaticrip/testfoomaticrip 8 FAIL
/testfoomaticrip/testfoomaticrip 10 FAIL
/testfoomaticrip/testfoomaticrip 11 FAIL
/testfoomaticrip/testfoomaticrip 13 FAIL

from top:

6824 root      20   0 15884 4284 2092 R 99.2  0.4   0:53.85 foomatic-rip

Tracked in bug 2423

This is now fixed in upstream bzr. Distributions should use at least revision 185:

revno: 185
committer: Linux Foundation Patch Queue Manager <pqm@linux-foundation.org>
branch nick: foomatic-filters-devel
timestamp: Sun 2008-11-30 16:50:04 -0800
message:
  Fixed several bugs in the merging of PJL options.

Python

Python 2.6 is beginning to show up in some distributions (OpenSuSE 11.1 beta). Our scheme with a dual 2.4/2.5 setup falls apart with a 2.6 version - bug 2363. Changes were pushed to snapshots to partially address this so the tests at least run, but there are still a number of failures:

95 tests OK.
13 tests failed:
test_deque test_enumerate test_eof test_format test_gc
test_generators test_genexps test_iterlen test_itertools test_list
test_syntax test_unicode test_unicodedata

The remaining 13 tests have now been reworked to run correctly under Python-2.6 in post-beta snapshot builds and should not fail in RCs and the final 4.0 test suite.

Desktop Test

xml

We're seeing xml failures against more modern libxml (bug 2274). We went through this once before when 2.6.27 came about. Rather than continue down the path of parallel test setups, a thought is to disable the non-portable regression tests. Typical results (Fedora 10 Beta, x86_64, libxml2-2.7.1):

XML_10 5 FAIL
XML_10 6 FAIL
XML_10 8 FAIL
XML_10 9 FAIL
XML_10 14 FAIL
XML_10 58 FAIL
XML_10 59 FAIL
XML_10 63 FAIL
XML_10 70 FAIL
XML_10 78 FAIL
XML_10 81 FAIL
XML_10 82 FAIL
XML_10 98 FAIL
XML_10 100 FAIL
XML_30 4 FAIL
XML_31 4 FAIL
XML_4 8 FAIL
XML_5 8 FAIL

Test was run: 20081021 16:34:06 
Test Suite Version: unset
Test Suite Architecture: unset
Total Tests Passed: 2449
Total Tests Failed (including waived): 18
Total Tests Failed (excluding waived): 18

There is also an journal issue exposed in these failures (bug 2347), which we believe has been fixed in the snapshot builds.

A modification for bug 2274 to disable the non-portable regression tests has been pushed to both the 3.2 branch and development and should be reflected in snapshot builds and RCs, as well as the next 3.2.X refresh.

cairo

Some initial discussion/results for the new Cairo tests is here: CairoTesting40. I (Stew) decided to treat the image variations as warnings for LSB testing.

There are 2 tests that fail almost everywhere:

path-data-image 0 UNREPORTED
  Error: CAIRO_STATUS_NULL_POINTER (cairo_append_path(cr, &path) \
         path.data = NULL, path.num_data = 0, path.status = CAIRO_STATUS_SUCCESS)

path-data-xlib 1 UNREPORTED
  Error: CAIRO_STATUS_NULL_POINTER (cairo_append_path(cr, &path) \
         path.data = NULL, path.num_data = 0, path.status = CAIRO_STATUS_SUCCESS)

These tests do not appear in newer cairo versions and the thought is to disable them (bug 2353).

Two additional failures are showing up in the newest distributions (OpenSuSE 11.1 (cairo-1.7.4), Fedora 10 (cairo-1.7.4)):

surface-finish-twice-image 0 FAIL
  Error: Function under test failed

surface-finish-twice-xlib 1 FAIL
  Error: Function under test failed

I'm not finding 1.7.4 source, but a diff of the 1.0.2 test code with 1.6.4 only shows test API changes. A diff with 1.8.0 does show:

-    if (cairo_surface_status (surface) != CAIRO_STATUS_SURFACE_FINISHED)
+    if (cairo_surface_status (surface) != CAIRO_STATUS_SUCCESS)
+       return CAIRO_TEST_FAILURE;
+
+    cairo_surface_finish (surface);
+    if (cairo_surface_status (surface) != CAIRO_STATUS_SUCCESS)
        return CAIRO_TEST_FAILURE;

Checking for only CAIRO_STATUS_SUCCESS fails on older versions of cairo. It looks like this is simply a regression test by the comments, so perhaps it should be disabled too:

 *   Subject: [Bug 2950]  New: *** glibc detected *** double free or corruption
 *   URL: https://bugs.freedesktop.org/show_bug.cgi?id=2950
 *
 *   The following short program gives the error message:
 *
 *     *** glibc detected *** double free or corruption: 0x082a7268 ***
 *     Aborted
 *
 * 2005-04-13 Carl Worth <cworth@cworth.org>
 *
 *   Looks like surface->finished was never being set. Now fixed.

The 4 tests mentioned above have been disabled in post-beta snapshot builds and should not show up the the RCs or final test suites.

gtk

Seeing a number of GtkTreeSelection failures on some distributions. This appears to be from a patch added to upstream and is tracked in bug 2170:

/tests/functions/GtkTreeSelection/GtkTreeSelection 45 FAIL
/tests/functions/GtkTreeSelection/GtkTreeSelection 46 FAIL
/tests/functions/GtkTreeSelection/GtkTreeSelection 47 FAIL
/tests/functions/GtkTreeSelection/GtkTreeSelection 48 FAIL
/tests/functions/GtkTreeSelection/GtkTreeSelection 49 FAIL
/tests/functions/GtkTreeSelection/GtkTreeSelection 50 FAIL
/tests/functions/GtkTreeSelection/GtkTreeSelection 51 FAIL
/tests/functions/GtkTreeSelection/GtkTreeSelection 52 FAIL
/tests/functions/GtkTreeSelection/GtkTreeSelection 53 FAIL
/tests/functions/GtkTreeSelection/GtkTreeSelection 54 FAIL
/tests/functions/GtkTreeSelection/GtkTreeSelection 55 FAIL
/tests/functions/GtkTreeSelection/GtkTreeSelection 56 FAIL
/tests/functions/GtkTreeSelection/GtkTreeSelection 57 FAIL
/tests/functions/GtkTreeSelection/GtkTreeSelection 58 FAIL
/tests/functions/GtkTreeSelection/GtkTreeSelection 59 FAIL
/tests/functions/GtkTreeSelection/GtkTreeSelection 60 FAIL
/tests/functions/GtkTreeSelection/GtkTreeSelection 61 FAIL
/tests/functions/GtkTreeSelection/GtkTreeSelection 62 FAIL
/tests/functions/GtkTreeSelection/GtkTreeSelection 63 FAIL
/tests/functions/GtkTreeSelection/GtkTreeSelection 64 FAIL
/tests/functions/GtkTreeSelection/GtkTreeSelection 65 FAIL
/tests/functions/GtkTreeSelection/GtkTreeSelection 66 FAIL
/tests/functions/GtkTreeSelection/GtkTreeSelection 67 FAIL
/tests/functions/GtkTreeSelection/GtkTreeSelection 68 FAIL
/tests/functions/GtkTreeSelection/GtkTreeSelection 69 FAIL
/tests/functions/GtkTreeSelection/GtkTreeSelection 170 FAIL
/tests/functions/GtkTreeSelection/GtkTreeSelection 171 FAIL
/tests/functions/GtkTreeSelection/GtkTreeSelection 172 FAIL
/tests/functions/GtkTreeSelection/GtkTreeSelection 173 FAIL
/tests/functions/GtkTreeSelection/GtkTreeSelection 174 FAIL
/tests/functions/GtkTreeSelection/GtkTreeSelection 175 FAIL

Seeing a number of failures with GtkAdjustment, GtkSpinButton, MainLoop on distribuitions shipping gtk-2.14.0. This is tracked in bug 2380 and would appear to be a regression in 2.14.x with x < 3, as 2.14.3 system do not show the failures. Typical results (F10 beta):

/tests/functions/GtkAdjustment/GtkAdjustment 61 FAIL
/tests/functions/GtkAdjustment/GtkAdjustment 62 FAIL
/tests/functions/GtkAdjustment/GtkAdjustment 63 FAIL
/tests/functions/GtkAdjustment/GtkAdjustment 69 FAIL
/tests/functions/GtkAdjustment/GtkAdjustment 72 FAIL
/tests/functions/GtkAdjustment/GtkAdjustment 73 FAIL
/tests/functions/GtkAdjustment/GtkAdjustment 74 FAIL
/tests/functions/GtkAdjustment/GtkAdjustment 75 FAIL
/tests/functions/GtkSpinButton/GtkSpinButton 48 FAIL
/tests/functions/MainLoop/MainLoop 6 FAIL
/tests/functions/MainLoop/MainLoop 7 FAIL

Seeing tests return UNRESOLVED with SIGSEGV on 2.14.0+ based systems. This is tracked in bug 2379. Root cause has not yet been determined. A modification has been applied to the tests to let the tests run and a bug has been filed with upstream, but it's not yet clear whether it's a test or gtk issue. Results are not consistent as to which subtest may fail, but a typical run (Mandriva 2009.0) might look like this:

/tests/functions/GtkFileSelection/GtkFileSelection 2 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 5 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 8 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 9 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 10 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 12 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 13 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 15 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 16 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 17 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 18 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 19 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 20 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 21 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 22 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 23 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 24 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 25 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 26 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 27 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 28 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 29 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 30 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 31 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 32 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 33 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 34 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 35 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 36 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 37 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 38 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 39 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 40 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 41 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 42 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 43 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 44 UNRESOLVED
/tests/functions/GtkFileSelection/GtkFileSelection 45 UNRESOLVED
/tests/functions/GtkFontSelectionDialog/GtkFontSelectionDialog 4 UNRESOLVED
/tests/functions/GtkFontSelectionDialog/GtkFontSelectionDialog 8 UNRESOLVED
/tests/functions/GtkFontSelectionDialog/GtkFontSelectionDialog 9 UNRESOLVED
/tests/functions/GtkFontSelectionDialog/GtkFontSelectionDialog 10 UNRESOLVED
/tests/functions/GtkFontSelectionDialog/GtkFontSelectionDialog 11 UNRESOLVED
/tests/functions/GtkFontSelectionDialog/GtkFontSelectionDialog 12 UNRESOLVED
/tests/functions/GtkFontSelectionDialog/GtkFontSelectionDialog 13 UNRESOLVED
/tests/functions/GtkFontSelectionDialog/GtkFontSelectionDialog 14 UNRESOLVED
/tests/functions/GtkFontSelectionDialog/GtkFontSelectionDialog 15 UNRESOLVED
/tests/functions/GtkFontSelectionDialog/GtkFontSelectionDialog 16 UNRESOLVED
/tests/functions/GtkFontSelectionDialog/GtkFontSelectionDialog 17 UNRESOLVED
/tests/functions/GtkFontSelectionDialog/GtkFontSelectionDialog 18 UNRESOLVED
/tests/functions/GtkFontSelectionDialog/GtkFontSelectionDialog 19 UNRESOLVED

qt4

These failed on Fedora 9 / x86_64:

tst_QColor_setNamedColor 4 FAIL
tst_QIcon_isNull 3 FAIL
tst_QItemSelectionModel_selectedRows 10 FAIL
tst_QLineEdit_selectedText 30 FAIL
tst_QPixmapCache_cacheLimit 1 FAIL
tst_QTextDocumentFragment_html_anchorColor 112 FAIL
tst_QTreeView_construction 2 FAIL
tst_QTreeView_itemDelegate 14 FAIL
tst_QUuid_less 6 FAIL

desktop-t2c test

These failed on Fedora 9 / x86_64 and were not marked as "known".

/gdk-pixbuf-t2c/tests/FileSaving/FileSaving 29 UNRESOLVED
/gdk-pixbuf-t2c/tests/FileSaving/FileSaving 30 UNRESOLVED
/gdk-pixbuf-t2c/tests/FileSaving/FileSaving 31 UNRESOLVED
/gdk-pixbuf-t2c/tests/FileSaving/FileSaving 32 UNRESOLVED
/gdk-pixbuf-t2c/tests/FileSaving/FileSaving 33 UNRESOLVED
/gdk-pixbuf-t2c/tests/FileSaving/FileSaving 34 UNRESOLVED
/gdk-pixbuf-t2c/tests/GdkPixbufLoader_external/GdkPixbufLoader_external 1 UNINITIATED
/gdk-pixbuf-t2c/tests/GdkPixbufLoader_external/GdkPixbufLoader_external 2 UNINITIATED
/gdk-pixbuf-t2c/tests/GdkPixbufLoader_external/GdkPixbufLoader_external 3 UNINITIATED
/gdk-pixbuf-t2c/tests/ModuleInterface_external/ModuleInterface_external 1 UNINITIATED
/gdk-pixbuf-t2c/tests/ModuleInterface_external/ModuleInterface_external 2 UNINITIATED
/gdk-pixbuf-t2c/tests/ModuleInterface_external/ModuleInterface_external 3 UNINITIATED
/gdk-pixbuf-t2c/tests/ModuleInterface_external/ModuleInterface_external 4 UNINITIATED
/gdk-pixbuf-t2c/tests/ModuleInterface_external/ModuleInterface_external 5 UNINITIATED
/gdk-pixbuf-t2c/tests/ModuleInterface_external/ModuleInterface_external 6 UNINITIATED
/gdk-pixbuf-t2c/tests/ModuleInterface_external/ModuleInterface_external 7 UNINITIATED
/gdk-pixbuf-t2c/tests/ModuleInterface_external/ModuleInterface_external 8 UNINITIATED
/gdk-pixbuf-t2c/tests/ModuleInterface_external/ModuleInterface_external 9 UNINITIATED
/glib-t2c/tests/glib_key_parser/glib_key_parser 82 FAIL
/glib-t2c/tests/glib_key_parser/glib_key_parser 83 FAIL
/glib-t2c/tests/glib_key_parser/glib_key_parser 84 FAIL
/glib-t2c/tests/glib_key_parser/glib_key_parser 106 FAIL
/glib-t2c/tests/glib_key_parser/glib_key_parser 107 FAIL
/glib-t2c/tests/glib_key_parser/glib_key_parser 108 FAIL
/glib-t2c/tests/glib_key_parser/glib_key_parser 114 FAIL

cpp-tc2 test

These failed on Fedora 9/x86_64 and were not marked as "Known". Exactly the same set of failures was also observed on SLES 11/x86.

/libstdcxx-t2c/tests/codecvt/codecvt 24 FAIL
/libstdcxx-t2c/tests/codecvt/codecvt 27 FAIL
/libstdcxx-t2c/tests/codecvt/codecvt 29 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 3 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 4 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 5 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 8 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 9 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 10 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 13 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 14 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 15 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 18 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 19 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 20 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 23 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 24 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 25 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 28 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 29 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 30 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 33 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 34 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 35 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 38 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 39 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 40 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 43 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 44 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 47 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 48 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 52 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 53 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 57 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 58 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 62 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 63 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 67 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 68 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 72 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 73 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 77 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 78 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 81 FAIL
/libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 84 FAIL
/libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 4 FAIL
/libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 7 FAIL
/libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 12 FAIL
/libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 15 FAIL
/libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 20 FAIL
/libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 23 FAIL
/libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 28 FAIL
/libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 31 FAIL
/libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 36 FAIL
/libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 39 FAIL
/libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 44 FAIL
/libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 47 FAIL
/libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 52 FAIL
/libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 55 FAIL
/libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 60 FAIL
/libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 63 FAIL
/libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 68 FAIL
/libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 73 FAIL
/libstdcxx-t2c/tests/num_get_do_get6/num_get_do_get6 15 FAIL
/libstdcxx-t2c/tests/num_get_do_get6/num_get_do_get6 16 FAIL
/libstdcxx-t2c/tests/num_get_do_get6/num_get_do_get6 21 FAIL
/libstdcxx-t2c/tests/num_get_do_get6/num_get_do_get6 22 FAIL
/libstdcxx-t2c/tests/num_get_do_get6/num_get_do_get6 28 FAIL
/libstdcxx-t2c/tests/num_get_do_get6/num_get_do_get6 29 FAIL
/libstdcxx-t2c/tests/num_get_do_get6/num_get_do_get6 31 FAIL
/libstdcxx-t2c/tests/num_get_do_get6/num_get_do_get6 32 FAIL
/libstdcxx-t2c/tests/num_get_do_get6/num_get_do_get6 33 FAIL
/libstdcxx-t2c/tests/num_get_do_get6/num_get_do_get6 34 FAIL
/libstdcxx-t2c/tests/num_get_do_get6/num_get_do_get6 35 FAIL
/libstdcxx-t2c/tests/num_get_do_get6/num_get_do_get6 36 FAIL
/libstdcxx-t2c/tests/num_get_do_get6/num_get_do_get6 37 FAIL
/libstdcxx-t2c/tests/num_get_do_get6/num_get_do_get6 38 FAIL
/libstdcxx-t2c/tests/num_put_do_put5/num_put_do_put5 9 FAIL
/libstdcxx-t2c/tests/num_put_do_put5/num_put_do_put5 18 FAIL
/libstdcxx-t2c/tests/num_put_do_put7/num_put_do_put7 55 FAIL
/libstdcxx-t2c/tests/num_put_do_put7/num_put_do_put7 58 FAIL
/libstdcxx-t2c/tests/num_put_do_put7/num_put_do_put7 61 FAIL
/libstdcxx-t2c/tests/num_put_do_put7/num_put_do_put7 64 FAIL
/libstdcxx-t2c/tests/time_get/time_get 37 FAIL
/libstdcxx-t2c/tests/time_get/time_get 38 FAIL
/libstdcxx-t2c/tests/time_get/time_get 39 FAIL
/libstdcxx-t2c/tests/time_get/time_get 40 FAIL

olver-core test

azov-qt3 test

WIth version 1.0-2, the number of unresolved tests considerably reduced. On Fedora 9 / x86_64, still see:

/Qt3_OpenGL-t2c/tests/QGLWidget/QGLWidget 6 	Unresolved 	
Messages from the test

Target interface(s):
QGLWidget::grabFrameBuffer(bool)
--------
unexpected signal 11 (SIGSEGV) received
/Qt3_OpenGL-t2c/tests/QGLWidget/QGLWidget 21 	Unresolved 	
Messages from the test

Target interface(s):
QGLWidget::renderText(double, double, double, QString const&, QFont const&, int)
--------
unexpected signal 4 (SIGILL) received
/Qt3_OpenGL-t2c/tests/QGLWidget/QGLWidget 41 	Unresolved 	
Messages from the test

Target interface(s):
QGLWidget::renderText(int, int, QString const&, QFont const&, int)
--------
unexpected signal 11 (SIGSEGV) received
/Qt3_OpenGL-t2c/tests/QGLContext/QGLContext 16 	Unresolved 	
Messages from the test

Target interface(s):
QGLContext::generateFontDisplayLists(QFont const&, int)
--------
unexpected signal 11 (SIGSEGV) received

azov-qt4 test

With version 1.0-2, the number of unresolveds greatly reduced. On Fedora 9 / x86_64 still see:

/Qt4_Dialogs-t2c/tests/QFileDialog/QFileDialog 16 	Unresolved 	
Messages from the test

Target interface(s):
QFileDialog::resolveSymlinks() const
--------
Child process was terminated by signal 6.
Abnormal child process termination. errno: 22.
/Qt4_Dialogs-t2c/tests/QFileDialog/QFileDialog 22 	Unresolved 	
Messages from the test

Target interface(s):
QFileDialog::currentChanged(QString const&)
--------
unexpected signal 11 (SIGSEGV) received

[Article] [Discussion] [View source] [History]