# Comparing directories # REFERENCE: base-artifacts/sumfiles # CURRENT: artifacts/sumfiles # Comparing 1 common sum files: tests.sum Comparing: REFERENCE:/tmp/gxx-sum1.83192 CURRENT: /tmp/gxx-sum2.83192 +---------+---------+ o RUN STATUS: | REF | RES | +------------------------------------------+---------+---------+ | Passes [PASS] | 6401 | 6211 | | Unexpected fails [FAIL] | 2 | 172 | | Errors [ERROR] | 0 | 0 | | Unexpected passes [XPASS] | 2 | 2 | | Expected fails [XFAIL] | 16 | 16 | | Known fails [KFAIL] | 0 | 0 | | Unresolved [UNRESOLVED] | 0 | 0 | | Unsupported [UNSUPPORTED] | 42 | 41 | | Untested [UNTESTED] | 0 | 0 | +------------------------------------------+---------+---------+ REF PASS ratio: 0.992883 RES PASS ratio: 0.966625 o REGRESSIONS: +------------------------------------------+---------+ | PASS now FAIL [PASS => FAIL] | 165 | | FAIL appears [ => FAIL] | 3 | +------------------------------------------+---------+ | TOTAL_REGRESSIONS | 168 | +------------------------------------------+---------+ - PASS now FAIL [PASS => FAIL]: Executed from: glibc:ctype glibc:ctype=ctype/tst-ctype-tls-dlopen-static Executed from: glibc:debug glibc:debug=debug/tst-sprintf-fortify-rdonly-static Executed from: glibc:dlfcn glibc:dlfcn=dlfcn/tststatic glibc:dlfcn=dlfcn/tststatic2 glibc:dlfcn=dlfcn/tststatic3 glibc:dlfcn=dlfcn/tststatic4 glibc:dlfcn=dlfcn/tststatic5 Executed from: glibc:elf glibc:elf=elf/ifuncmain1picstatic glibc:elf=elf/ifuncmain1static glibc:elf=elf/ifuncmain2picstatic glibc:elf=elf/ifuncmain2static glibc:elf=elf/ifuncmain4picstatic glibc:elf=elf/ifuncmain4static glibc:elf=elf/ifuncmain5picstatic glibc:elf=elf/ifuncmain5static glibc:elf=elf/ifuncmain7picstatic glibc:elf=elf/ifuncmain7static glibc:elf=elf/ifuncmain9picstatic glibc:elf=elf/ifuncmain9static glibc:elf=elf/tst-array1-static glibc:elf=elf/tst-array1-static-cmp glibc:elf=elf/tst-array5-static glibc:elf=elf/tst-array5-static-cmp glibc:elf=elf/tst-bz15311 glibc:elf=elf/tst-bz28937 glibc:elf=elf/tst-dl-cache-long-path glibc:elf=elf/tst-dl-iter-static glibc:elf=elf/tst-dl-printf-static glibc:elf=elf/tst-dl_find_object-static glibc:elf=elf/tst-dlopen-sgid glibc:elf=elf/tst-dso-ordering-all2-0 glibc:elf=elf/tst-dso-ordering-all3-0 glibc:elf=elf/tst-dso-ordering-all3-1 glibc:elf=elf/tst-dso-ordering-all3-2 glibc:elf=elf/tst-dso-ordering-all3-3 glibc:elf=elf/tst-dso-ordering-all4-0 glibc:elf=elf/tst-dso-ordering-all4-1 glibc:elf=elf/tst-dso-ordering-all4-10 glibc:elf=elf/tst-dso-ordering-all4-11 glibc:elf=elf/tst-dso-ordering-all4-12 glibc:elf=elf/tst-dso-ordering-all4-13 glibc:elf=elf/tst-dso-ordering-all4-14 glibc:elf=elf/tst-dso-ordering-all4-15 glibc:elf=elf/tst-dso-ordering-all4-16 glibc:elf=elf/tst-dso-ordering-all4-17 glibc:elf=elf/tst-dso-ordering-all4-18 glibc:elf=elf/tst-dso-ordering-all4-19 glibc:elf=elf/tst-dso-ordering-all4-2 glibc:elf=elf/tst-dso-ordering-all4-20 glibc:elf=elf/tst-dso-ordering-all4-21 glibc:elf=elf/tst-dso-ordering-all4-22 glibc:elf=elf/tst-dso-ordering-all4-23 glibc:elf=elf/tst-dso-ordering-all4-24 glibc:elf=elf/tst-dso-ordering-all4-25 glibc:elf=elf/tst-dso-ordering-all4-26 glibc:elf=elf/tst-dso-ordering-all4-27 glibc:elf=elf/tst-dso-ordering-all4-28 glibc:elf=elf/tst-dso-ordering-all4-29 glibc:elf=elf/tst-dso-ordering-all4-3 glibc:elf=elf/tst-dso-ordering-all4-30 glibc:elf=elf/tst-dso-ordering-all4-31 glibc:elf=elf/tst-dso-ordering-all4-32 glibc:elf=elf/tst-dso-ordering-all4-33 glibc:elf=elf/tst-dso-ordering-all4-34 glibc:elf=elf/tst-dso-ordering-all4-35 glibc:elf=elf/tst-dso-ordering-all4-36 glibc:elf=elf/tst-dso-ordering-all4-37 glibc:elf=elf/tst-dso-ordering-all4-38 glibc:elf=elf/tst-dso-ordering-all4-39 glibc:elf=elf/tst-dso-ordering-all4-4 glibc:elf=elf/tst-dso-ordering-all4-40 glibc:elf=elf/tst-dso-ordering-all4-41 glibc:elf=elf/tst-dso-ordering-all4-42 glibc:elf=elf/tst-dso-ordering-all4-43 glibc:elf=elf/tst-dso-ordering-all4-44 glibc:elf=elf/tst-dso-ordering-all4-45 glibc:elf=elf/tst-dso-ordering-all4-46 glibc:elf=elf/tst-dso-ordering-all4-47 glibc:elf=elf/tst-dso-ordering-all4-48 glibc:elf=elf/tst-dso-ordering-all4-49 glibc:elf=elf/tst-dso-ordering-all4-5 glibc:elf=elf/tst-dso-ordering-all4-50 glibc:elf=elf/tst-dso-ordering-all4-51 glibc:elf=elf/tst-dso-ordering-all4-52 glibc:elf=elf/tst-dso-ordering-all4-53 glibc:elf=elf/tst-dso-ordering-all4-54 glibc:elf=elf/tst-dso-ordering-all4-55 glibc:elf=elf/tst-dso-ordering-all4-56 glibc:elf=elf/tst-dso-ordering-all4-6 glibc:elf=elf/tst-dso-ordering-all4-7 glibc:elf=elf/tst-dso-ordering-all4-8 glibc:elf=elf/tst-dso-ordering-all4-9 glibc:elf=elf/tst-dso-ordering1 glibc:elf=elf/tst-dso-ordering10 glibc:elf=elf/tst-dso-ordering2 glibc:elf=elf/tst-dso-ordering3 glibc:elf=elf/tst-dso-ordering4 glibc:elf=elf/tst-dso-ordering5 glibc:elf=elf/tst-dso-ordering6 glibc:elf=elf/tst-dso-ordering7 glibc:elf=elf/tst-dso-ordering8 glibc:elf=elf/tst-dso-ordering9 glibc:elf=elf/tst-dst-static glibc:elf=elf/tst-env-setuid-static glibc:elf=elf/tst-env-setuid-tunables glibc:elf=elf/tst-execstack-prog-static glibc:elf=elf/tst-execstack-prog-static-noexecstack glibc:elf=elf/tst-execstack-prog-static-tunable glibc:elf=elf/tst-getauxval-static glibc:elf=elf/tst-glibc-hwcaps-prepend-cache glibc:elf=elf/tst-ldconfig-X glibc:elf=elf/tst-ldconfig-bad-aux-cache glibc:elf=elf/tst-ldconfig-ld_so_conf-update glibc:elf=elf/tst-ldconfig-p glibc:elf=elf/tst-ldconfig-soname glibc:elf=elf/tst-linkall-static glibc:elf=elf/tst-ptrguard1-static glibc:elf=elf/tst-rtld-run-static glibc:elf=elf/tst-single_threaded-pthread-static glibc:elf=elf/tst-single_threaded-static glibc:elf=elf/tst-single_threaded-static-dlopen glibc:elf=elf/tst-stackguard1-static glibc:elf=elf/tst-tls-allocation-failure-static glibc:elf=elf/tst-tls1-static glibc:elf=elf/tst-tls1-static-non-pie glibc:elf=elf/tst-tls9-static glibc:elf=elf/tst-tlsalign-extern-static glibc:elf=elf/tst-tlsalign-static glibc:elf=elf/tst-tunables glibc:elf=elf/tst-tunables-enable_secure Executed from: glibc:gmon glibc:gmon=gmon/tst-gmon-static glibc:gmon=gmon/tst-gmon-static-gprof Executed from: glibc:io glibc:io=io/tst-statx Executed from: glibc:localedata glibc:localedata=localedata/bug-setlocale1-static glibc:localedata=localedata/tst-langinfo-setlocale-static Executed from: glibc:malloc glibc:malloc=malloc/tst-aligned-alloc-static glibc:malloc=malloc/tst-interpose-static-nothread glibc:malloc=malloc/tst-interpose-static-thread Executed from: glibc:math glibc:math=math/atest-exp glibc:math=math/atest-exp2 glibc:math=math/atest-sincos glibc:math=math/test-fpucw-ieee-static glibc:math=math/test-fpucw-static glibc:math=math/test-signgam-uchar-init-static glibc:math=math/test-signgam-uchar-static glibc:math=math/test-signgam-uint-init-static glibc:math=math/test-signgam-uint-static glibc:math=math/test-signgam-ullong-init-static glibc:math=math/test-signgam-ullong-static Executed from: glibc:misc glibc:misc=misc/tst-align-clone-internal glibc:misc=misc/tst-clone2-internal glibc:misc=misc/tst-clone3-internal glibc:misc=misc/tst-empty glibc:misc=misc/tst-fd_to_filename glibc:misc=misc/tst-getpid1-internal Executed from: glibc:nss glibc:nss=nss/tst-field Executed from: glibc:posix glibc:posix=posix/tst-affinity-static glibc:posix=posix/tst-exec-static glibc:posix=posix/tst-libc-message glibc:posix=posix/tst-spawn-static Executed from: glibc:resolv glibc:resolv=resolv/tst-ns_name_length_uncompressed glibc:resolv=resolv/tst-ns_rr_cursor glibc:resolv=resolv/tst-ns_samebinaryname glibc:resolv=resolv/tst-resolv-txnid-collision Executed from: glibc:string glibc:string=string/test-memswap - FAIL appears [ => FAIL]: Executed from: glibc:elf glibc:elf=elf/tst-ifunc-bz28817 glibc:elf=elf/tst-ifunc-resolver-protector-static glibc:elf=elf/tst-ifunc-resolver-protector-static-non-pie o IMPROVEMENTS TO BE CHECKED: +------------------------------------------+---------+ | PASS disappears [PASS => ] | 25 | | New PASS [ => PASS] | 2 | | UNSUPPORTED disappears [UNSUP=> ] | 1 | | Flaky cases, ignored [~RANDOM ] | 2 | +------------------------------------------+---------+ | TOTAL_IMPROVEMENTS_TO_BE_CHECKED | 30 | +------------------------------------------+---------+ - PASS disappears [PASS => ]: Executed from: glibc:libio glibc:libio=libio/tst-cleanup-default-static glibc:libio=libio/tst-cleanup-default-static-cmp glibc:libio=libio/tst-cleanup-nostart-stop-gc-static glibc:libio=libio/tst-cleanup-nostart-stop-gc-static-cmp glibc:libio=libio/tst-cleanup-start-stop-gc-static glibc:libio=libio/tst-cleanup-start-stop-gc-static-cmp glibc:libio=libio/tst-stdio-static glibc:libio=libio/tst-wfiledoallocate-static Executed from: glibc:nptl glibc:nptl=nptl/tst-cancel21-static glibc:nptl=nptl/tst-cancel24-static glibc:nptl=nptl/tst-cond11-static glibc:nptl=nptl/tst-cond8-static glibc:nptl=nptl/tst-locale1 glibc:nptl=nptl/tst-locale2 glibc:nptl=nptl/tst-mutex8-static glibc:nptl=nptl/tst-mutexpi8-static glibc:nptl=nptl/tst-pthread-gdb-attach-static glibc:nptl=nptl/tst-pthread-key1-static glibc:nptl=nptl/tst-pthread_exit-nothreads-static glibc:nptl=nptl/tst-sem11-static glibc:nptl=nptl/tst-sem12-static glibc:nptl=nptl/tst-stackguard1-static Executed from: glibc:setjmp glibc:setjmp=setjmp/tst-setjmp-static Executed from: glibc:stdlib glibc:stdlib=stdlib/tst-getenv-static glibc:stdlib=stdlib/tst-secure-getenv - New PASS [ => PASS]: Executed from: glibc:elf glibc:elf=elf/tst-ifunc-resolver-protector Executed from: glibc:nptl glibc:nptl=nptl/tst-thread-affinity-pthread - UNSUPPORTED disappears [UNSUP=> ]: Executed from: glibc:libio glibc:libio=libio/tst-fopen-compat - Flaky cases, ignored [~RANDOM ]: Executed from: glibc:inet glibc:inet=inet/tst-deadline glibc:inet=inet/tst-idna_name_classify # Regressions found # Regressions in 1 common sum files found