# Comparing directories
# REFERENCE: base-artifacts/sumfiles
# CURRENT:   artifacts/sumfiles

# Comparing 1 common sum files:
gdb.sum
Comparing:
REFERENCE:/tmp/gxx-sum1.1460029
CURRENT:  /tmp/gxx-sum2.1460029

                                             +---------+---------+
o  RUN STATUS:                               |   REF   |   RES   |
  +------------------------------------------+---------+---------+
  | Passes                            [PASS] |  122979 |  123007 |
  | Unexpected fails                  [FAIL] |     151 |     152 |
  | Errors                           [ERROR] |       3 |       2 |
  | Unexpected passes                [XPASS] |       0 |       0 |
  | Expected fails                   [XFAIL] |      99 |      96 |
  | Known fails                      [KFAIL] |     160 |     160 |
  | Unresolved                  [UNRESOLVED] |       2 |       2 |
  | Unsupported                [UNSUPPORTED] |     602 |     602 |
  | Untested                      [UNTESTED] |      88 |      88 |
  +------------------------------------------+---------+---------+

    REF PASS ratio: 0.991917
    RES PASS ratio: 0.991910
    ***** WARNING: No REF execution test FAILed. Check execution engine configuration. *****
    ***** WARNING: No RES execution test FAILed. Check execution engine configuration. *****

o  REGRESSIONS:
  +------------------------------------------+---------+
  +------------------------------------------+---------+
  | TOTAL_REGRESSIONS                        |       0 |
  +------------------------------------------+---------+


o  IMPROVEMENTS TO BE CHECKED:
  +------------------------------------------+---------+
  | PASS disappears           [PASS =>     ] |      24 |
  | New PASS                  [     => PASS] |      46 |
  | XFAIL disappears          [XFAIL=>     ] |       4 |
  | XFAIL appears             [     =>XFAIL] |       1 |
  | Flaky cases, ignored   [~RANDOM     ]    |      40 |
  +------------------------------------------+---------+
  | TOTAL_IMPROVEMENTS_TO_BE_CHECKED         |     115 |
  +------------------------------------------+---------+

  - PASS disappears           [PASS =>     ]:

  Executed from: gdb:gdb.threads/attach-many-short-lived-threads.exp
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 1: attach
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 1: break at break_fn: 1
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 1: break at break_fn: 2
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 1: break at break_fn: 3
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 1: break break_fn
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 1: detach
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 1: no new threads
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 1: print seconds_left
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 1: reset timer in the inferior
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 1: set breakpoint always-inserted off
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 1: set breakpoint always-inserted on
  Executed from: gdb:gdb.threads/hand-call-new-thread.exp
    gdb:gdb.threads/hand-call-new-thread.exp=gdb.threads/hand-call-new-thread.exp: iter 2: gdb-command<p new_thread ()>
  Executed from: gdb:gdb.threads/next-fork-exec-other-thread.exp
    gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=3: next to break here
    gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=3: next to for loop
    gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=4: next to break here
    gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=4: next to for loop
    gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=4: next to other line
    gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=5: next to break here
    gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=5: next to for loop
    gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=5: next to other line
    gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=6: next to other line
    gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=vfork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=0: next to break here
    gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=vfork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=0: next to for loop
    gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=vfork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=0: next to other line


  - New PASS                  [     => PASS]:

  Executed from: gdb:gdb.linespec/cpcompletion.exp
    gdb:gdb.linespec/cpcompletion.exp=gdb.linespec/cpcompletion.exp: anon-ns: tab complete "b (" (second tab)
    gdb:gdb.linespec/cpcompletion.exp=gdb.linespec/cpcompletion.exp: anon-ns: tab complete "b the_anon_ns_wrapper_ns::(anonymous namespace)::anon_ns_function()"
  Executed from: gdb:gdb.threads/attach-many-short-lived-threads.exp
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: attach
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: break at break_fn: 1
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: break at break_fn: 2
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: break at break_fn: 3
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: break break_fn
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: detach
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: no new threads
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: print seconds_left
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: reset timer in the inferior
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: set breakpoint always-inserted off
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: set breakpoint always-inserted on
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 4: attach
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 4: break at break_fn: 1
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 4: break at break_fn: 2
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 4: break at break_fn: 3
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 4: break break_fn
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 4: detach
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 4: no new threads
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 4: print seconds_left
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 4: reset timer in the inferior
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 4: set breakpoint always-inserted off
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 4: set breakpoint always-inserted on
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 5: attach
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 5: break at break_fn: 1
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 5: break at break_fn: 2
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 5: break at break_fn: 3
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 5: break break_fn
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 5: detach
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 5: no new threads
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 5: print seconds_left
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 5: reset timer in the inferior
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 5: set breakpoint always-inserted off
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 5: set breakpoint always-inserted on
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 6: attach
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 6: break at break_fn: 1
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 6: break at break_fn: 2
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 6: break at break_fn: 3
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 6: break break_fn
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 6: detach
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 6: no new threads
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 6: print seconds_left
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 6: reset timer in the inferior
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 6: set breakpoint always-inserted off
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 6: set breakpoint always-inserted on


  - XFAIL disappears          [XFAIL=>     ]:

  Executed from: gdb:gdb.threads/attach-many-short-lived-threads.exp
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: attach (EPERM)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 4: attach (EPERM)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 5: attach (EPERM)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 6: attach (EPERM)


  - XFAIL appears             [     =>XFAIL]:

  Executed from: gdb:gdb.threads/attach-many-short-lived-threads.exp
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 1: attach (EPERM)


  - Flaky cases, ignored   [~RANDOM     ]:

  Executed from: gdb:gdb.linespec/cpcompletion.exp
    gdb:gdb.linespec/cpcompletion.exp=breakpoints not deleted
  Executed from: gdb:gdb.threads/hand-call-new-thread.exp
    gdb:gdb.threads/hand-call-new-thread.exp=gdb.threads/hand-call-new-thread.exp: iter 2: gdb-command<p new_thread ()> (GDB internal error)
  Executed from: gdb:gdb.threads/interrupt-while-step-over.exp
    gdb:gdb.threads/interrupt-while-step-over.exp=gdb.threads/interrupt-while-step-over.exp: displaced-stepping=off: iter=11: wait for stops (timeout)
    gdb:gdb.threads/interrupt-while-step-over.exp=gdb.threads/interrupt-while-step-over.exp: displaced-stepping=off: iter=13: wait for stops (timeout)
    gdb:gdb.threads/interrupt-while-step-over.exp=gdb.threads/interrupt-while-step-over.exp: displaced-stepping=off: iter=16: wait for stops (timeout)
    gdb:gdb.threads/interrupt-while-step-over.exp=gdb.threads/interrupt-while-step-over.exp: displaced-stepping=off: iter=17: wait for stops (timeout)
    gdb:gdb.threads/interrupt-while-step-over.exp=gdb.threads/interrupt-while-step-over.exp: displaced-stepping=off: iter=19: wait for stops (timeout)
    gdb:gdb.threads/interrupt-while-step-over.exp=gdb.threads/interrupt-while-step-over.exp: displaced-stepping=off: iter=2: wait for stops (timeout)
    gdb:gdb.threads/interrupt-while-step-over.exp=gdb.threads/interrupt-while-step-over.exp: displaced-stepping=off: iter=5: wait for stops (timeout)
    gdb:gdb.threads/interrupt-while-step-over.exp=gdb.threads/interrupt-while-step-over.exp: displaced-stepping=off: iter=6: wait for stops (timeout)
    gdb:gdb.threads/interrupt-while-step-over.exp=gdb.threads/interrupt-while-step-over.exp: displaced-stepping=off: iter=8: wait for stops (timeout)
  Executed from: gdb:gdb.threads/next-fork-exec-other-thread.exp
    gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=3: next to for loop (timeout)
    gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=6: next to for loop (timeout)
    gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=vfork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=0: next to other line (timeout)
    gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=vfork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=1: next to other line (timeout)
  Executed from: gdb:gdb.threads/next-fork-other-thread.exp
    gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=3: next to break here
    gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=3: next to for loop
    gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=3: next to for loop (timeout)
    gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=4: next to break here
    gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=4: next to for loop
    gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=4: next to other line
    gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=5: next to break here
    gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=5: next to for loop
    gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=5: next to other line
    gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=6: next to break here
    gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=6: next to for loop
    gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=6: next to other line
    gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=7: next to break here
    gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=7: next to for loop
    gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=7: next to other line
    gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=2: next to break here
    gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=2: next to for loop
    gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=2: next to other line
    gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=3: next to break here
    gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=3: next to for loop
    gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=3: next to other line
    gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=4: next to for loop (timeout)
    gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=4: next to other line
    gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=2: next to break here
    gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=3: next to other line



# Improvements found
# No regression found in 1 common sum files