diff --git a/notify/configure-toolchain.txt b/notify/configure-toolchain.txt new file mode 100644 index 00000000..8e581352 --- /dev/null +++ b/notify/configure-toolchain.txt @@ -0,0 +1,5 @@ + +Most relevant configure and test flags: none, autodetected on armv8l-unknown-linux-gnueabihf + +Full configure and make flags for each step: + diff --git a/notify/fixes.sum b/notify/fixes.sum new file mode 100644 index 00000000..7dcb391c --- /dev/null +++ b/notify/fixes.sum @@ -0,0 +1,10 @@ + === gdb tests === + +Running gdb:gdb.base/return.exp ... +ERROR: no fileid for 020aadd8e31a + + === Results Summary === + +# of stable fails 1376 +# of flaky entries 1600 +# of all tests 107606 diff --git a/notify/jira/comment-template.txt b/notify/jira/comment-template.txt index ba0eafbc..7e347b3c 100644 --- a/notify/jira/comment-template.txt +++ b/notify/jira/comment-template.txt @@ -1,3 +1,3 @@ [GNU-692] -FAIL: 1 regressions: 1 improvements +1 regression 1 fix Details: https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-arm-build/1539/artifact/artifacts/notify/mail-body.txt/*view*/ diff --git a/notify/lnt_report.json b/notify/lnt_report.json index 3e8fc94f..e1493559 100644 --- a/notify/lnt_report.json +++ b/notify/lnt_report.json @@ -15,12 +15,12 @@ "git_gdb": "https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=c60b22e8edaeb7beffcf00c5616f4d4f12aae1be (unchanged)", "__report_version__": "1" }, - "Start Time": "2024-08-01 07:23:22" + "Start Time": "2024-08-01 07:23:11" }, "Tests": [ { "Data": [ - 1369 + 1376 ], "Info": {}, "Name": "tcwg_gnu_native_check_gdb.TOTAL.fails.nb_fails" @@ -28,7 +28,7 @@ , { "Data": [ - 1826 + 1600 ], "Info": {}, "Name": "tcwg_gnu_native_check_gdb.TOTAL.flaky.nb_flaky" diff --git a/notify/mail-body.txt b/notify/mail-body.txt index bbac2c7d..c0926bb8 100644 --- a/notify/mail-body.txt +++ b/notify/mail-body.txt @@ -1,39 +1,36 @@ -Dear contributor, our automatic CI has detected problems related to your patch(es). Please find some details below. If you have any questions, please follow up on linaro-toolchain@lists.linaro.org mailing list, Libera's #linaro-tcwg channel, or ping your favourite Linaro toolchain developer on the usual project channel. +Dear contributor, -We appreciate that it might be difficult to find the necessary logs or reproduce the issue locally. If you can't get what you need from our CI within minutes, let us know and we will be happy to help. - -In master-arm after: +Our automatic CI has detected problems related to your patch(es). Please find some details below. +In master-arm, after: | baseline build -FAIL: 1 regressions: 1 improvements - -regressions.sum: - === gdb tests === +Produces 1 regression 1 fix: + | + | regressions.sum: + | Running gdb:gdb.base/return.exp ... + | ERROR: no fileid for 49f91510da1b + | + | fixes.sum: + | Running gdb:gdb.base/return.exp ... + | ERROR: no fileid for 020aadd8e31a -Running gdb:gdb.base/return.exp ... -ERROR: no fileid for 49f91510da1b +Used configuration : + *CI config* tcwg_gnu_native_check_gdb master-arm + *configure and test flags:* none, autodetected on armv8l-unknown-linux-gnueabihf +If you have any questions regarding this report, please ask on linaro-toolchain@lists.linaro.org mailing list. -improvements.sum: - === gdb tests === - -Running gdb:gdb.base/return.exp ... -ERROR: no fileid for 020aadd8e31a +-----------------8<--------------------------8<--------------------------8<-------------------------- +The information below contains the details of the failures, and the ways to reproduce a debug environment: -You can find the failure logs in *.log.1.xz files in - - https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-arm-build/1539/artifact/artifacts/00-sumfiles/ +You can find the failure logs in + * https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-arm-build/1539/artifact/artifacts/ The full lists of regressions and improvements as well as configure and make commands are in - - https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-arm-build/1539/artifact/artifacts/notify/ + * https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-arm-build/1539/artifact/artifacts/notify/ The list of [ignored] baseline and flaky failures are in - - https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-arm-build/1539/artifact/artifacts/sumfiles/xfails.xfail - -The configuration of this build is: -CI config tcwg_gnu_native_check_gdb master-arm - ------------------8<--------------------------8<--------------------------8<-------------------------- -The information below can be used to reproduce a debug environment: + * https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-arm-build/1539/artifact/artifacts/sumfiles/xfails.xfail Current build : https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-arm-build/1539/artifact/artifacts Reference build : https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-arm-build/1531/artifact/artifacts diff --git a/notify/mail-subject.txt b/notify/mail-subject.txt index 8ca592f1..3b9e18ff 100644 --- a/notify/mail-subject.txt +++ b/notify/mail-subject.txt @@ -1 +1 @@ -[Linaro-TCWG-CI] baseline build: FAIL: 1 regressions: 1 improvements on arm +[Linaro-TCWG-CI] baseline build: 1 regression 1 fix on arm diff --git a/notify/regressions.sum b/notify/regressions.sum index 9b0e1912..9aa27255 100644 --- a/notify/regressions.sum +++ b/notify/regressions.sum @@ -5,6 +5,6 @@ ERROR: no fileid for 49f91510da1b === Results Summary === -# of stable fails 1369 -# of flaky entries 1826 +# of stable fails 1376 +# of flaky entries 1600 # of all tests 107606 diff --git a/notify/results-summary.txt b/notify/results-summary.txt index e7e1ad55..dbd549a9 100644 --- a/notify/results-summary.txt +++ b/notify/results-summary.txt @@ -1,5 +1,5 @@ === Results Summary === -# of stable fails 1369 -# of flaky entries 1826 +# of stable fails 1376 +# of flaky entries 1600 # of all tests 107606 diff --git a/notify/results.compare.txt b/notify/results.compare.txt index 6f0b5c4c..5233eaa0 100644 --- a/notify/results.compare.txt +++ b/notify/results.compare.txt @@ -1,12 +1,12 @@ # Comparing directories # REFERENCE: base-artifacts/sumfiles -# CURRENT: artifacts/sumfiles +# CURRENT: artifacts/99-rewrite/artifacts.old/sumfiles # Comparing 1 common sum files: gdb.sum Comparing: -REFERENCE:/tmp/gxx-sum1.1189822 -CURRENT: /tmp/gxx-sum2.1189822 +REFERENCE:/tmp/gxx-sum1.828687 +CURRENT: /tmp/gxx-sum2.828687 +---------+---------+ o RUN STATUS: | REF | RES | @@ -30,9 +30,8 @@ o RUN STATUS: | REF | RES | o REGRESSIONS: +------------------------------------------+---------+ | ERROR appears [ =>ERROR] | 1 | - | FAIL appears [ => FAIL] | 1 | +------------------------------------------+---------+ - | TOTAL_REGRESSIONS | 2 | + | TOTAL_REGRESSIONS | 1 | +------------------------------------------+---------+ - ERROR appears [ =>ERROR]: @@ -41,23 +40,17 @@ o REGRESSIONS: gdb:gdb.base/return.exp=no fileid for 49f91510da1b - - FAIL appears [ => FAIL]: - - Executed from: gdb:gdb.threads/detach-step-over.exp - gdb:gdb.threads/detach-step-over.exp=gdb.threads/detach-step-over.exp: breakpoint-condition-evaluation=host: target-non-stop=on: non-stop=on: displaced=off: test_detach_command: iter 2: seen all stops (timeout) - - o IMPROVEMENTS TO BE CHECKED: +------------------------------------------+---------+ - | PASS disappears [PASS => ] | 63 | - | New PASS [ => PASS] | 428 | - | FAIL disappears [FAIL => ] | 1 | + | PASS disappears [PASS => ] | 54 | + | New PASS [ => PASS] | 411 | | XFAIL disappears [XFAIL=> ] | 6 | | KFAIL disappears [KFAIL=> ] | 3 | - | ERROR disappears [ERROR=> ] | 2 | + | ERROR disappears [ERROR=> ] | 1 | + | Flaky cases, ignored [~RANDOM ] | 29 | +------------------------------------------+---------+ - | TOTAL_IMPROVEMENTS_TO_BE_CHECKED | 503 | + | TOTAL_IMPROVEMENTS_TO_BE_CHECKED | 504 | +------------------------------------------+---------+ - PASS disappears [PASS => ]: @@ -120,16 +113,6 @@ o IMPROVEMENTS TO BE CHECKED: gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=fork: target-non-stop=auto: non-stop=off: displaced-stepping=auto: i=29: next to break here gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=fork: target-non-stop=auto: non-stop=off: displaced-stepping=auto: i=29: next to for loop gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=fork: target-non-stop=auto: non-stop=off: displaced-stepping=auto: i=29: next to other line - Executed from: gdb:gdb.threads/next-fork-other-thread.exp - gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=0: next to break here - gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=0: next to for loop - gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=0: next to other line - gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=1: next to break here - gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=1: next to for loop - gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=1: next to other line - gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=2: next to break here - gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=2: next to for loop - gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=2: next to other line - New PASS [ => PASS]: @@ -141,13 +124,7 @@ o IMPROVEMENTS TO BE CHECKED: gdb:gdb.base/gdb-sigterm.exp=gdb.base/gdb-sigterm.exp: pass=1: set debug infrun 1 gdb:gdb.base/gdb-sigterm.exp=gdb.base/gdb-sigterm.exp: pass=1: set range-stepping off Executed from: gdb:gdb.base/help.exp - gdb:gdb.base/help.exp=gdb.base/help.exp: apropos after documenting aliases - gdb:gdb.base/help.exp=gdb.base/help.exp: apropos after documenting aliases showing mybt10 doc - gdb:gdb.base/help.exp=gdb.base/help.exp: documenting builtin where alias disallowed - gdb:gdb.base/help.exp=gdb.base/help.exp: help after documenting aliases gdb:gdb.base/help.exp=gdb.base/help.exp: help data - gdb:gdb.base/help.exp=gdb.base/help.exp: help mybt after documenting aliases showing mybt doc - gdb:gdb.base/help.exp=gdb.base/help.exp: help obscure Executed from: gdb:gdb.threads/attach-many-short-lived-threads.exp gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 10: attach gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 10: break at break_fn: 1 @@ -213,8 +190,6 @@ o IMPROVEMENTS TO BE CHECKED: gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 9: reset timer in the inferior gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 9: set breakpoint always-inserted off gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 9: set breakpoint always-inserted on - Executed from: gdb:gdb.threads/detach-step-over.exp - gdb:gdb.threads/detach-step-over.exp=gdb.threads/detach-step-over.exp: breakpoint-condition-evaluation=host: target-non-stop=on: non-stop=off: displaced=off: test_detach_command: iter 3: stop with SIGUSR1 Executed from: gdb:gdb.threads/next-fork-exec-other-thread.exp gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=11: next to break here gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=11: next to for loop @@ -552,17 +527,6 @@ o IMPROVEMENTS TO BE CHECKED: gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=vfork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=3: next to break here gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=vfork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=3: next to for loop gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=vfork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=3: next to other line - Executed from: gdb:gdb.threads/next-fork-other-thread.exp - gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=2: next to break here - gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=2: next to for loop - gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=2: next to other line - gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=3: next to break here - gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=3: next to for loop - gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=3: next to other line - gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=4: next to other line - gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=1: next to break here - gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=1: next to for loop - gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=1: next to other line Executed from: gdb:gdb.threads/process-dies-while-handling-bp.exp gdb:gdb.threads/process-dies-while-handling-bp.exp=gdb.threads/process-dies-while-handling-bp.exp: non_stop=off: cond_bp_target=1: inferior 1 exited gdb:gdb.threads/process-dies-while-handling-bp.exp=gdb.threads/process-dies-while-handling-bp.exp: non_stop=off: cond_bp_target=1: no threads left @@ -572,12 +536,6 @@ o IMPROVEMENTS TO BE CHECKED: gdb:gdb.tui/pr30056.exp=gdb.tui/pr30056.exp: Control-C aborts isearch - - FAIL disappears [FAIL => ]: - - Executed from: gdb:gdb.base/gdb-sigterm.exp - gdb:gdb.base/gdb-sigterm.exp=gdb.base/gdb-sigterm.exp: pass=0: expect eof (GDB internal error) - - - XFAIL disappears [XFAIL=> ]: Executed from: gdb:gdb.threads/attach-many-short-lived-threads.exp @@ -600,12 +558,47 @@ o IMPROVEMENTS TO BE CHECKED: - ERROR disappears [ERROR=> ]: - Executed from: gdb:gdb.base/help.exp - gdb:gdb.base/help.exp=Undefined command "apropos handle signal". Executed from: gdb:gdb.base/return.exp gdb:gdb.base/return.exp=no fileid for 020aadd8e31a + - Flaky cases, ignored [~RANDOM ]: + + Executed from: gdb:gdb.base/gdb-sigterm.exp + gdb:gdb.base/gdb-sigterm.exp=gdb.base/gdb-sigterm.exp: pass=0: expect eof (GDB internal error) + Executed from: gdb:gdb.base/help.exp + gdb:gdb.base/help.exp=Undefined command "apropos handle signal". + gdb:gdb.base/help.exp=gdb.base/help.exp: apropos after documenting aliases + gdb:gdb.base/help.exp=gdb.base/help.exp: apropos after documenting aliases showing mybt10 doc + gdb:gdb.base/help.exp=gdb.base/help.exp: documenting builtin where alias disallowed + gdb:gdb.base/help.exp=gdb.base/help.exp: help after documenting aliases + gdb:gdb.base/help.exp=gdb.base/help.exp: help mybt after documenting aliases showing mybt doc + gdb:gdb.base/help.exp=gdb.base/help.exp: help obscure + Executed from: gdb:gdb.threads/detach-step-over.exp + gdb:gdb.threads/detach-step-over.exp=gdb.threads/detach-step-over.exp: breakpoint-condition-evaluation=host: target-non-stop=on: non-stop=off: displaced=off: test_detach_command: iter 3: stop with SIGUSR1 + gdb:gdb.threads/detach-step-over.exp=gdb.threads/detach-step-over.exp: breakpoint-condition-evaluation=host: target-non-stop=on: non-stop=on: displaced=off: test_detach_command: iter 2: seen all stops (timeout) + Executed from: gdb:gdb.threads/next-fork-other-thread.exp + gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=2: next to break here + gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=2: next to for loop + gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=2: next to other line + gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=3: next to break here + gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=3: next to for loop + gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=3: next to other line + gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=4: next to other line + gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=0: next to break here + gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=0: next to for loop + gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=0: next to other line + gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=1: next to break here + gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=1: next to for loop + gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=1: next to other line + gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=2: next to break here + gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=2: next to for loop + gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=2: next to other line + gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=1: next to break here + gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=1: next to for loop + gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=1: next to other line + + # Regressions found # Regressions in 1 common sum files found