The Linux Foundation

 
QmtestCplusplus3

From The Linux Foundation

Contents

LSB 3: C++ Testsuite Results and Analysis

Add newest info at the top.

03 May 2005

qmtest_libstdcpp-3.4.3-0 rpm package on Mandriva Linux 2006.0 x86 (cooker), gcc 3.4.3

--- TESTS THAT DID NOT PASS --------------------------------------------------
/27_io/fpos/14320-1.cc 1 FAIL
/27_io/objects/char/12048-5.cc 1 FAIL
/27_io/objects/wchar_t/12048-5.cc 1 FAIL

--- STATISTICS ---------------------------------------------------------------
Total Tests Passed: 1404
Total Tests Failed (including waived): 3
Total Tests Failed (excluding waived): 3

16 March 2005

Investigating the code, these tests are expected to fail:

22_locale/locale/cons/12658_thread.cc
26_numerics/c99_classification_macros_c.cc  (compile)
27_io/fpos/mbstate_t/4_neg.cc
27_io/fpos/14320-1.cc
27_io/objects/char/12048-5.cc
27_io/objects/wchar_t/12048-5.cc

I had misunderstood the logic here, expected-fail means the testsuite maintainers know it will fail, not that it's a negative test. So while these are real problems, they're not indicating different behavior than the ABI.

10 March 2005

ia32 build results: gcc 3.4.2 on FC2

--- TESTS THAT DID NOT PASS --------------------------------------------------

: 25_algorithms/find_first_of/concept_check_1.cc: FAIL    
: 26_numerics/c99_classification_macros_c.cc    : FAIL    
: 27_io/fpos/14320-1.cc                         : FAIL    
: 27_io/fpos/mbstate_t/4_neg.cc                 : FAIL    
: 27_io/objects/char/12048-5.cc                 : FAIL    
: 27_io/objects/wchar_t/12048-5.cc              : FAIL    
: ext/enc_filebuf/char/13189.cc                 : FAIL    
: ext/enc_filebuf/wchar_t/13189.cc              : FAIL    

--- STATISTICS ---------------------------------------------------------------

: 1407        tests total
: 8 (  1%) tests FAIL
: 1399 ( 99%) tests PASS

ia32 runtime results: gcc 3.4.2 on FC2

--- TESTS THAT DID NOT PASS --------------------------------------------------

: 27_io/fpos/14320-1.cc                         : FAIL    
: 27_io/objects/char/12048-5.cc                 : FAIL    
: 27_io/objects/wchar_t/12048-5.cc              : FAIL    

--- STATISTICS ---------------------------------------------------------------

: 1407        tests total
: 3 (  0%) tests FAIL
: 102 (  7%) tests UNTESTED
: 1302 ( 93%) tests PASS

x86_64 build results: gcc 3.4.3 on RHEL4

--- TESTS THAT DID NOT PASS --------------------------------------------------

: 26_numerics/c99_classification_macros_c.cc    : FAIL    
: 27_io/fpos/mbstate_t/4_neg.cc                 : FAIL    
: 27_io/ios_base/cons/assign_neg.cc             : FAIL    
: 27_io/ios_base/cons/copy_neg.cc               : FAIL    
: 27_io/objects/char/12048-5.cc                 : FAIL    
: 27_io/objects/wchar_t/12048-5.cc              : FAIL    
: ext/enc_filebuf/char/13189.cc                 : FAIL    
: ext/enc_filebuf/wchar_t/13189.cc              : FAIL    

--- STATISTICS ---------------------------------------------------------------

: 1407        tests total
: 8 (  1%) tests FAIL
: 1399 ( 99%) tests PASS

x86_64 runtime results: gcc 3.4.3 on RHEL4

--- TESTS THAT DID NOT PASS --------------------------------------------------

: 27_io/objects/char/12048-5.cc                 : FAIL    
: 27_io/objects/wchar_t/12048-5.cc              : FAIL    
: 
--- STATISTICS ---------------------------------------------------------------

: 1407        tests total
: 2 (  0%) tests FAIL
: 102 (  7%) tests UNTESTED
: 1303 ( 93%) tests PASS

ia_64 build results: gcc 3.4.3 on RHEL4

--- TESTS THAT DID NOT PASS --------------------------------------------------

: 25_algorithms/min_max.cc                      : FAIL    
: 26_numerics/complex/13450.cc                  : FAIL    
: 26_numerics/complex/pow.cc                    : FAIL    
: 27_io/fpos/mbstate_t/4_neg.cc                 : FAIL    
: 27_io/ios_base/cons/assign_neg.cc             : FAIL    
: 27_io/ios_base/cons/copy_neg.cc               : FAIL    
: 27_io/objects/char/12048-5.cc                 : FAIL    
: 27_io/objects/wchar_t/12048-5.cc              : FAIL    

--- STATISTICS ---------------------------------------------------------------

: 1407        tests total
: 8 (  1%) tests FAIL
: 1399 ( 99%) tests PASS

ia_64 runtime results: gcc 3.4.3 on RHEL4

--- TESTS THAT DID NOT PASS --------------------------------------------------

: 27_io/objects/char/12048-5.cc                 : FAIL    
: 27_io/objects/wchar_t/12048-5.cc              : FAIL    

--- STATISTICS ---------------------------------------------------------------

: 1407        tests total
: 2 (  0%) tests FAIL
: 102 (  7%) tests UNTESTED
: 1303 ( 93%) tests PASS

ppc build results: gcc 3.4.3 on RHEL4

--- TESTS THAT DID NOT PASS --------------------------------------------------

: 26_numerics/c99_classification_macros_c.cc    : FAIL    
: 27_io/fpos/14320-1.cc                         : FAIL    
: 27_io/fpos/mbstate_t/4_neg.cc                 : FAIL    
: 27_io/ios_base/cons/assign_neg.cc             : FAIL    
: 27_io/ios_base/cons/copy_neg.cc               : FAIL    
: 27_io/objects/char/12048-5.cc                 : FAIL    
: 27_io/objects/wchar_t/12048-5.cc              : FAIL    
: ext/enc_filebuf/char/13189.cc                 : FAIL    
: ext/enc_filebuf/wchar_t/13189.cc              : FAIL    

--- STATISTICS ---------------------------------------------------------------

: 1407        tests total
: 9 (  1%) tests FAIL
: 1398 ( 99%) tests PASS

ppc runtime results: gcc 3.4.3 on RHEL4

--- TESTS THAT DID NOT PASS --------------------------------------------------

: 27_io/fpos/14320-1.cc                         : FAIL    
: 27_io/objects/char/12048-5.cc                 : FAIL    
: 27_io/objects/wchar_t/12048-5.cc              : FAIL    

--- STATISTICS ---------------------------------------------------------------

: 1407        tests total
: 3 (  0%) tests FAIL
: 102 (  7%) tests UNTESTED
: 1302 ( 93%) tests PASS

ppc64 build results: gcc 3.4.3 on RHEL4

--- TESTS THAT DID NOT PASS --------------------------------------------------

: 26_numerics/c99_classification_macros_c.cc    : FAIL    
: 27_io/fpos/mbstate_t/4_neg.cc                 : FAIL    
: 27_io/ios_base/cons/assign_neg.cc             : FAIL    
: 27_io/ios_base/cons/copy_neg.cc               : FAIL    
: 27_io/objects/char/12048-5.cc                 : FAIL    
: 27_io/objects/wchar_t/12048-5.cc              : FAIL    
: ext/enc_filebuf/char/13189.cc                 : FAIL    
: ext/enc_filebuf/wchar_t/13189.cc              : FAIL    

--- STATISTICS ---------------------------------------------------------------

: 1407        tests total
: 8 (  1%) tests FAIL
: 1399 ( 99%) tests PASS

ppc64 runtime results: gcc 3.4.3 on RHEL4

--- TESTS THAT DID NOT PASS --------------------------------------------------

: 27_io/objects/char/12048-5.cc                 : FAIL    
: 27_io/objects/wchar_t/12048-5.cc              : FAIL    

--- STATISTICS ---------------------------------------------------------------

: 1407        tests total
: 2 (  0%) tests FAIL
: 102 (  7%) tests UNTESTED
: 1303 ( 93%) tests PASS

s390 build results: gcc 3.4.3 on RHEL4

--- TESTS THAT DID NOT PASS --------------------------------------------------

: 27_io/fpos/14320-1.cc                         : FAIL    
: 27_io/fpos/mbstate_t/4_neg.cc                 : FAIL    
: 27_io/ios_base/cons/assign_neg.cc             : FAIL    
: 27_io/ios_base/cons/copy_neg.cc               : FAIL    
: 27_io/objects/char/12048-5.cc                 : FAIL    
: 27_io/objects/wchar_t/12048-5.cc              : FAIL    

--- STATISTICS ---------------------------------------------------------------

: 1407        tests total
: 6 (  0%) tests FAIL
: 1401 (100%) tests PASS

s390 runtime results: gcc 3.4.3 on RHEL4

--- TESTS THAT DID NOT PASS --------------------------------------------------
: 27_io/fpos/14320-1.cc                         : FAIL    
: 27_io/objects/char/12048-5.cc                 : FAIL    
: 27_io/objects/wchar_t/12048-5.cc              : FAIL    

--- STATISTICS ---------------------------------------------------------------

: 1407        tests total
: 3 (  0%) tests FAIL
: 102 (  7%) tests UNTESTED
: 1302 ( 93%) tests PASS

s390x build results: gcc 3.4.3 on RHEL4

--- TESTS THAT DID NOT PASS --------------------------------------------------

: 26_numerics/c99_classification_macros_c.cc    : FAIL    
: 27_io/fpos/mbstate_t/4_neg.cc                 : FAIL    
: 27_io/ios_base/cons/assign_neg.cc             : FAIL    
: 27_io/ios_base/cons/copy_neg.cc               : FAIL    
: 27_io/objects/char/12048-5.cc                 : FAIL    
: 27_io/objects/wchar_t/12048-5.cc              : FAIL    
: ext/enc_filebuf/char/13189.cc                 : FAIL    
: ext/enc_filebuf/wchar_t/13189.cc              : FAIL    

--- STATISTICS ---------------------------------------------------------------

: 1407        tests total
: 8 (  1%) tests FAIL
: 1399 ( 99%) tests PASS

s390x runtime results: gcc 3.4.3 on RHEL4

--- TESTS THAT DID NOT PASS --------------------------------------------------

: 27_io/objects/char/12048-5.cc                 : FAIL    
: 27_io/objects/wchar_t/12048-5.cc              : FAIL    

--- STATISTICS ---------------------------------------------------------------

: 1407        tests total
: 2 (  0%) tests FAIL
: 102 (  7%) tests UNTESTED
: 1303 ( 93%) tests PASS

23 Feb 2005

build_v3_dist
has been updated and run successfully and the cvs tree synced up with the changes made. Database/stub library and
missing_data.txt
updated with the symbol problems found.

ia32/mdk101 build results:

--- TESTS THAT DID NOT PASS --------------------------
: 24_iterators/istreambuf_iterator/2.cc         : FAIL
: 26_numerics/c99_classification_macros_c.cc    : FAIL
: 27_io/basic_stringbuf/overflow/char/1.cc      : FAIL
: 27_io/fpos/mbstate_t/4_neg.cc                 : FAIL
: 27_io/ios_base/sync_with_stdio/16959.cc       : FAIL
: ext/enc_filebuf/char/13189.cc                 : FAIL
: ext/enc_filebuf/wchar_t/13189.cc              : FAIL
: ext/pool_allocator/allocate_chunk.cc          : FAIL

--- STATISTICS ---------------------------------------
: 1407        tests total
: 8 (  1%) tests FAIL
: 1399 ( 99%) tests PASS

ia32/mdk101 runtime results (untested results omitted):

--- TESTS THAT DID NOT PASS --------------------------
: 24_iterators/istreambuf_iterator/2.cc         : FAIL
: 27_io/basic_stringbuf/overflow/char/1.cc      : FAIL
: 27_io/ios_base/sync_with_stdio/16959.cc       : FAIL

--- STATISTICS ---------------------------------------
: 1407        tests total
: 3 (  0%) tests FAIL
: 102 (  7%) tests UNTESTED
: 1302 ( 93%) tests PASS

x86_64/fc3 build results:

--- TESTS THAT DID NOT PASS --------------------------
: 24_iterators/istreambuf_iterator/2.cc         : FAIL
: 26_numerics/c99_classification_macros_c.cc    : FAIL
: 27_io/fpos/mbstate_t/4_neg.cc                 : FAIL
: ext/enc_filebuf/char/13189.cc                 : FAIL
: ext/enc_filebuf/wchar_t/13189.cc              : FAIL
: ext/pool_allocator/allocate_chunk.cc          : FAIL

--- STATISTICS ---------------------------------------
: 1407        tests total
: 6 (  0%) tests FAIL
: 1401 (100%) tests PASS

x86_64/fc3 runtime results (untested results omitted):

--- TESTS THAT DID NOT PASS --------------------------
: 24_iterators/istreambuf_iterator/2.cc         : FAIL

--- STATISTICS ---------------------------------------
: 1407        tests total
: 1 (  0%) tests FAIL
: 102 (  7%) tests UNTESTED
: 1304 ( 93%) tests PASS

18 Feb 2005

A build 18 Feb against a gcc 3.4.1 ia32 (Mdk 10.1) platform reported for the build pass:

: 1402        tests total
: 1 (  0%) tests ERROR
: 85 (  6%) tests FAIL
: 1316 ( 94%) tests PASS

And for the run pass:

: 1402        tests total
: 1 (  0%) tests ERROR
: 75 (  5%) tests FAIL
: 101 (  7%) tests UNTESTED
: 1225 ( 87%) tests PASS

The same source/tools were used for a gcc 3.4.2 x86_64 (fc3) platform with these results:

: 1402        tests total
: 1 (  0%) tests ERROR
: 92 (  7%) tests FAIL
: 1309 ( 93%) tests PASS
: 1402        tests total
: 1 (  0%) tests ERROR
: 82 (  6%) tests FAIL
: 101 (  7%) tests UNTESTED
: 1218 ( 87%) tests PASS

These will not be listed here individually as a lot of the trouble breaks down to size mismatches: stub libstdc++ having different sizes than the runtime library. In both cases, the following five symbols account for all of those reports, they are in the DB with size zero, and don't have the stub library size updated by
missing_data.txt
(all new 3.4 symbols). This will be rerun when the stub is corrected.
_ZNSbIwSt11char_traitsIwESaIwEE4_Rep20_S_empty_rep_storageE
_ZNSs4_Rep20_S_empty_rep_storageE
_ZNSt10money_base8_S_atomsE
_ZNSt17__timepunct_cacheIwE12_S_timezonesE
_ZTVN9__gnu_cxx18stdio_sync_filebufIwSt11char_traitsIwEEE
The error comes from not building
abi_check
which is now no longer a single-source-file program, but as we don't configure in the directory, there is no makefile bug 709. There are also compile fails due to
LOCALEDIR
not being defined; this is related to the previous problem as the
scripts
directory has a file (
testsuite_flags
, generated from
testsuite_flags.in
) which is supposed to supply this to the build, and this is also not happening since configure is not run. It is believed that at least the latter can be fixed by running
build_v3_dist
, which does not currently seem to work on this tree and thus has not been run.

[[[QmtestCplusplus3]]/Comments User Comments] [[Include(QmtestCplusplus3/Comments)]]


[Article] [Discussion] [View source] [History]