diff --git a/notify/configure-toolchain.txt b/notify/configure-toolchain.txt new file mode 100644 index 00000000..8e581352 --- /dev/null +++ b/notify/configure-toolchain.txt @@ -0,0 +1,5 @@ + +Most relevant configure and test flags: none, autodetected on armv8l-unknown-linux-gnueabihf + +Full configure and make flags for each step: + diff --git a/notify/fixes.sum b/notify/fixes.sum new file mode 100644 index 00000000..5a1ab238 --- /dev/null +++ b/notify/fixes.sum @@ -0,0 +1,10 @@ + === gdb tests === + +Running gdb:gdb.base/return.exp ... +ERROR: no fileid for 4271de4f1137 + + === Results Summary === + +# of stable fails 1370 +# of flaky entries 1612 +# of all tests 107251 diff --git a/notify/jira/comment-template.txt b/notify/jira/comment-template.txt index a55466b5..c208e8be 100644 --- a/notify/jira/comment-template.txt +++ b/notify/jira/comment-template.txt @@ -1,3 +1,3 @@ [GNU-692] -FAIL: 1 regressions: 1 improvements +1 regression 1 fix Details: https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-arm-build/1531/artifact/artifacts/notify/mail-body.txt/*view*/ diff --git a/notify/lnt_report.json b/notify/lnt_report.json index b7ea68a3..1546a0ca 100644 --- a/notify/lnt_report.json +++ b/notify/lnt_report.json @@ -15,12 +15,12 @@ "git_gdb": "https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=c60b22e8edaeb7beffcf00c5616f4d4f12aae1be (unchanged)", "__report_version__": "1" }, - "Start Time": "2024-08-01 07:23:20" + "Start Time": "2024-08-01 07:22:58" }, "Tests": [ { "Data": [ - 1366 + 1370 ], "Info": {}, "Name": "tcwg_gnu_native_check_gdb.TOTAL.fails.nb_fails" @@ -28,7 +28,7 @@ , { "Data": [ - 1959 + 1612 ], "Info": {}, "Name": "tcwg_gnu_native_check_gdb.TOTAL.flaky.nb_flaky" diff --git a/notify/mail-body.txt b/notify/mail-body.txt index 8bad011b..c01eb1f8 100644 --- a/notify/mail-body.txt +++ b/notify/mail-body.txt @@ -1,39 +1,36 @@ -Dear contributor, our automatic CI has detected problems related to your patch(es). Please find some details below. If you have any questions, please follow up on linaro-toolchain@lists.linaro.org mailing list, Libera's #linaro-tcwg channel, or ping your favourite Linaro toolchain developer on the usual project channel. +Dear contributor, -We appreciate that it might be difficult to find the necessary logs or reproduce the issue locally. If you can't get what you need from our CI within minutes, let us know and we will be happy to help. - -In master-arm after: +Our automatic CI has detected problems related to your patch(es). Please find some details below. +In master-arm, after: | baseline build -FAIL: 1 regressions: 1 improvements - -regressions.sum: - === gdb tests === +Produces 1 regression 1 fix: + | + | regressions.sum: + | Running gdb:gdb.base/return.exp ... + | ERROR: no fileid for 020aadd8e31a + | + | fixes.sum: + | Running gdb:gdb.base/return.exp ... + | ERROR: no fileid for 4271de4f1137 -Running gdb:gdb.base/return.exp ... -ERROR: no fileid for 020aadd8e31a +Used configuration : + *CI config* tcwg_gnu_native_check_gdb master-arm + *configure and test flags:* none, autodetected on armv8l-unknown-linux-gnueabihf +If you have any questions regarding this report, please ask on linaro-toolchain@lists.linaro.org mailing list. -improvements.sum: - === gdb tests === - -Running gdb:gdb.base/return.exp ... -ERROR: no fileid for 4271de4f1137 +-----------------8<--------------------------8<--------------------------8<-------------------------- +The information below contains the details of the failures, and the ways to reproduce a debug environment: -You can find the failure logs in *.log.1.xz files in - - https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-arm-build/1531/artifact/artifacts/00-sumfiles/ +You can find the failure logs in + * https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-arm-build/1531/artifact/artifacts/ The full lists of regressions and improvements as well as configure and make commands are in - - https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-arm-build/1531/artifact/artifacts/notify/ + * https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-arm-build/1531/artifact/artifacts/notify/ The list of [ignored] baseline and flaky failures are in - - https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-arm-build/1531/artifact/artifacts/sumfiles/xfails.xfail - -The configuration of this build is: -CI config tcwg_gnu_native_check_gdb master-arm - ------------------8<--------------------------8<--------------------------8<-------------------------- -The information below can be used to reproduce a debug environment: + * https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-arm-build/1531/artifact/artifacts/sumfiles/xfails.xfail Current build : https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-arm-build/1531/artifact/artifacts Reference build : https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-arm-build/1520/artifact/artifacts diff --git a/notify/mail-subject.txt b/notify/mail-subject.txt index 8ca592f1..3b9e18ff 100644 --- a/notify/mail-subject.txt +++ b/notify/mail-subject.txt @@ -1 +1 @@ -[Linaro-TCWG-CI] baseline build: FAIL: 1 regressions: 1 improvements on arm +[Linaro-TCWG-CI] baseline build: 1 regression 1 fix on arm diff --git a/notify/regressions.sum b/notify/regressions.sum index 48ffbd36..fe178ac9 100644 --- a/notify/regressions.sum +++ b/notify/regressions.sum @@ -5,6 +5,6 @@ ERROR: no fileid for 020aadd8e31a === Results Summary === -# of stable fails 1366 -# of flaky entries 1959 +# of stable fails 1370 +# of flaky entries 1612 # of all tests 107251 diff --git a/notify/results-summary.txt b/notify/results-summary.txt index 6c4e7768..655cbbd5 100644 --- a/notify/results-summary.txt +++ b/notify/results-summary.txt @@ -1,5 +1,5 @@ === Results Summary === -# of stable fails 1366 -# of flaky entries 1959 +# of stable fails 1370 +# of flaky entries 1612 # of all tests 107251 diff --git a/notify/results.compare.txt b/notify/results.compare.txt index 95dbdcdf..2c9e6e29 100644 --- a/notify/results.compare.txt +++ b/notify/results.compare.txt @@ -1,12 +1,12 @@ # Comparing directories # REFERENCE: base-artifacts/sumfiles -# CURRENT: artifacts/sumfiles +# CURRENT: artifacts/99-rewrite/artifacts.old/sumfiles # Comparing 1 common sum files: gdb.sum Comparing: -REFERENCE:/tmp/gxx-sum1.1926386 -CURRENT: /tmp/gxx-sum2.1926386 +REFERENCE:/tmp/gxx-sum1.825179 +CURRENT: /tmp/gxx-sum2.825179 +---------+---------+ o RUN STATUS: | REF | RES | @@ -29,16 +29,14 @@ o RUN STATUS: | REF | RES | o REGRESSIONS: +------------------------------------------+---------+ - | ERROR appears [ =>ERROR] | 2 | + | ERROR appears [ =>ERROR] | 1 | | KFAIL appears [ =>KFAIL] | 3 | +------------------------------------------+---------+ - | TOTAL_REGRESSIONS | 5 | + | TOTAL_REGRESSIONS | 4 | +------------------------------------------+---------+ - ERROR appears [ =>ERROR]: - Executed from: gdb:gdb.base/help.exp - gdb:gdb.base/help.exp=Undefined command "apropos handle signal". Executed from: gdb:gdb.base/return.exp gdb:gdb.base/return.exp=no fileid for 020aadd8e31a @@ -54,28 +52,22 @@ o REGRESSIONS: o IMPROVEMENTS TO BE CHECKED: +------------------------------------------+---------+ - | PASS disappears [PASS => ] | 201 | - | New PASS [ => PASS] | 76 | - | FAIL disappears [FAIL => ] | 2 | + | PASS disappears [PASS => ] | 193 | + | New PASS [ => PASS] | 70 | | XFAIL disappears [XFAIL=> ] | 1 | | XFAIL appears [ =>XFAIL] | 5 | | KFAIL disappears [KFAIL=> ] | 1 | | UNTESTED now PASS [UNTES=> PASS] | 1 | | ERROR disappears [ERROR=> ] | 1 | + | Flaky cases, ignored [~RANDOM ] | 17 | +------------------------------------------+---------+ - | TOTAL_IMPROVEMENTS_TO_BE_CHECKED | 288 | + | TOTAL_IMPROVEMENTS_TO_BE_CHECKED | 289 | +------------------------------------------+---------+ - PASS disappears [PASS => ]: Executed from: gdb:gdb.base/help.exp - gdb:gdb.base/help.exp=gdb.base/help.exp: apropos after documenting aliases - gdb:gdb.base/help.exp=gdb.base/help.exp: apropos after documenting aliases showing mybt10 doc - gdb:gdb.base/help.exp=gdb.base/help.exp: documenting builtin where alias disallowed - gdb:gdb.base/help.exp=gdb.base/help.exp: help after documenting aliases gdb:gdb.base/help.exp=gdb.base/help.exp: help data - gdb:gdb.base/help.exp=gdb.base/help.exp: help mybt after documenting aliases showing mybt doc - gdb:gdb.base/help.exp=gdb.base/help.exp: help obscure Executed from: gdb:gdb.threads/attach-many-short-lived-threads.exp gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 10: attach gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 10: break at break_fn: 1 @@ -130,8 +122,6 @@ o IMPROVEMENTS TO BE CHECKED: gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 9: reset timer in the inferior gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 9: set breakpoint always-inserted off gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 9: set breakpoint always-inserted on - Executed from: gdb:gdb.threads/detach-step-over.exp - gdb:gdb.threads/detach-step-over.exp=gdb.threads/detach-step-over.exp: breakpoint-condition-evaluation=host: target-non-stop=on: non-stop=off: displaced=off: test_detach_command: iter 3: stop with SIGUSR1 Executed from: gdb:gdb.threads/next-fork-exec-other-thread.exp gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=10: next to break here gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=10: next to for loop @@ -268,8 +258,6 @@ o IMPROVEMENTS TO BE CHECKED: gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=vfork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=9: next to break here gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=vfork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=9: next to for loop gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=vfork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=9: next to other line - Executed from: gdb:gdb.threads/next-fork-other-thread.exp - gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=2: next to other line Executed from: gdb:gdb.threads/process-dies-while-handling-bp.exp gdb:gdb.threads/process-dies-while-handling-bp.exp=gdb.threads/process-dies-while-handling-bp.exp: non_stop=off: cond_bp_target=0: inferior 1 exited gdb:gdb.threads/process-dies-while-handling-bp.exp=gdb.threads/process-dies-while-handling-bp.exp: non_stop=off: cond_bp_target=0: no threads left @@ -309,8 +297,6 @@ o IMPROVEMENTS TO BE CHECKED: gdb:gdb.threads/create-fail.exp=gdb.threads/create-fail.exp: iteration 6: run till end gdb:gdb.threads/create-fail.exp=gdb.threads/create-fail.exp: iteration 8: run till end gdb:gdb.threads/create-fail.exp=gdb.threads/create-fail.exp: iteration 9: run till end - Executed from: gdb:gdb.threads/detach-step-over.exp - gdb:gdb.threads/detach-step-over.exp=gdb.threads/detach-step-over.exp: breakpoint-condition-evaluation=host: target-non-stop=on: non-stop=on: displaced=off: test_detach_command: iter 2: attach Executed from: gdb:gdb.threads/next-fork-exec-other-thread.exp gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=10: next to break here gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=10: next to for loop @@ -342,12 +328,6 @@ o IMPROVEMENTS TO BE CHECKED: gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=vfork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=1: next to break here gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=vfork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=1: next to for loop gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=vfork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=1: next to other line - Executed from: gdb:gdb.threads/next-fork-other-thread.exp - gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=2: next to break here - gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=2: next to for loop - gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=0: next to break here - gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=0: next to for loop - gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=0: next to other line Executed from: gdb:gdb.threads/schedlock.exp gdb:gdb.threads/schedlock.exp=gdb.threads/schedlock.exp: schedlock=off: cmd=next: call_function=1: current thread advanced - unlocked gdb:gdb.threads/schedlock.exp=gdb.threads/schedlock.exp: schedlock=off: cmd=next: call_function=1: next does not change thread @@ -365,14 +345,6 @@ o IMPROVEMENTS TO BE CHECKED: gdb:gdb.threads/schedlock.exp=gdb.threads/schedlock.exp: schedlock=step: cmd=step: current thread advanced - locked - - FAIL disappears [FAIL => ]: - - Executed from: gdb:gdb.base/osabi.exp - gdb:gdb.base/osabi.exp=gdb.base/osabi.exp: set osabi none (timeout) - Executed from: gdb:gdb.threads/detach-step-over.exp - gdb:gdb.threads/detach-step-over.exp=gdb.threads/detach-step-over.exp: breakpoint-condition-evaluation=host: target-non-stop=on: non-stop=on: displaced=off: test_detach_command: iter 2: attach (GDB internal error) - - - XFAIL disappears [XFAIL=> ]: Executed from: gdb:gdb.threads/attach-many-short-lived-threads.exp @@ -407,6 +379,31 @@ o IMPROVEMENTS TO BE CHECKED: gdb:gdb.base/return.exp=no fileid for 4271de4f1137 + - Flaky cases, ignored [~RANDOM ]: + + Executed from: gdb:gdb.base/help.exp + gdb:gdb.base/help.exp=Undefined command "apropos handle signal". + gdb:gdb.base/help.exp=gdb.base/help.exp: apropos after documenting aliases + gdb:gdb.base/help.exp=gdb.base/help.exp: apropos after documenting aliases showing mybt10 doc + gdb:gdb.base/help.exp=gdb.base/help.exp: documenting builtin where alias disallowed + gdb:gdb.base/help.exp=gdb.base/help.exp: help after documenting aliases + gdb:gdb.base/help.exp=gdb.base/help.exp: help mybt after documenting aliases showing mybt doc + gdb:gdb.base/help.exp=gdb.base/help.exp: help obscure + Executed from: gdb:gdb.base/osabi.exp + gdb:gdb.base/osabi.exp=gdb.base/osabi.exp: set osabi none (timeout) + Executed from: gdb:gdb.threads/detach-step-over.exp + gdb:gdb.threads/detach-step-over.exp=gdb.threads/detach-step-over.exp: breakpoint-condition-evaluation=host: target-non-stop=on: non-stop=off: displaced=off: test_detach_command: iter 3: stop with SIGUSR1 + gdb:gdb.threads/detach-step-over.exp=gdb.threads/detach-step-over.exp: breakpoint-condition-evaluation=host: target-non-stop=on: non-stop=on: displaced=off: test_detach_command: iter 2: attach + gdb:gdb.threads/detach-step-over.exp=gdb.threads/detach-step-over.exp: breakpoint-condition-evaluation=host: target-non-stop=on: non-stop=on: displaced=off: test_detach_command: iter 2: attach (GDB internal error) + Executed from: gdb:gdb.threads/next-fork-other-thread.exp + gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=2: next to other line + gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=2: next to break here + gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=2: next to for loop + gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=0: next to break here + gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=0: next to for loop + gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=0: next to other line + + # Regressions found # Regressions in 1 common sum files found