diff --git a/notify/configure-toolchain.txt b/notify/configure-toolchain.txt new file mode 100644 index 00000000..ccf8155a --- /dev/null +++ b/notify/configure-toolchain.txt @@ -0,0 +1,5 @@ + +Most relevant configure and test flags: none, autodetected on aarch64-unknown-linux-gnu + +Full configure and make flags for each step: + diff --git a/notify/fixes.sum b/notify/fixes.sum new file mode 100644 index 00000000..2ab0ded2 --- /dev/null +++ b/notify/fixes.sum @@ -0,0 +1,6 @@ + + === Results Summary === + +# of stable fails 86 +# of flaky entries 126 +# of all tests 117975 diff --git a/notify/jira/comment-card.txt b/notify/jira/comment-card.txt index 91b1be89..bb4d5a6a 100644 --- a/notify/jira/comment-card.txt +++ b/notify/jira/comment-card.txt @@ -1,3 +1,3 @@ [GNU-1248] -FAIL: 24 regressions +24 regressions Details: https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-aarch64-build/1048/artifact/artifacts/notify/mail-body.txt/*view*/ diff --git a/notify/jira/comment-template.txt b/notify/jira/comment-template.txt index d827087c..9c26dd68 100644 --- a/notify/jira/comment-template.txt +++ b/notify/jira/comment-template.txt @@ -1,4 +1,4 @@ [GNU-692] https://linaro.atlassian.net/browse/GNU-1248 -FAIL: 24 regressions +24 regressions Details: https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-aarch64-build/1048/artifact/artifacts/notify/mail-body.txt/*view*/ diff --git a/notify/jira/description b/notify/jira/description index 3f74b907..292db37b 100644 --- a/notify/jira/description +++ b/notify/jira/description @@ -8,19 +8,25 @@ Date: Thu May 30 22:54:07 2024 -0400 Remove includes reported as unused by clangd. Then, add any includes necessary to get rid of errors (includes possibly relying on previous includes).. - - I didn't remove the includes of gdb-safe-ctypes.h, because it appears to -... 5 lines of the commit log omitted. +... 7 lines of the commit log omitted. * tcwg_gdb_check ** master-aarch64 *** FAIL: 24 regressions *** https://git-us.linaro.org/toolchain/ci/interesting-commits.git/plain/gdb/sha1/9102a6c15c756c55e77c0fa7deecfc58fa8a361e/tcwg_gdb_check/master-aarch64/details.txt *** https://ci.linaro.org/job/tcwg_gdb_check--master-aarch64-build/1281/artifact/artifacts +** master-arm +*** FAIL: 24 regressions +*** https://git-us.linaro.org/toolchain/ci/interesting-commits.git/plain/gdb/sha1/9102a6c15c756c55e77c0fa7deecfc58fa8a361e/tcwg_gdb_check/master-arm/details.txt +*** https://ci.linaro.org/job/tcwg_gdb_check--master-arm-build/1276/artifact/artifacts * tcwg_gnu_native_check_gdb ** master-aarch64 -*** FAIL: 24 regressions -*** https://git-us.linaro.org/toolchain/ci/interesting-commits.git/plain/gdb/sha1/9102a6c15c756c55e77c0fa7deecfc58fa8a361e/tcwg_gnu_native_check_gdb/master-aarch64/details.txt +*** 24 regressions +*** https://gitlab.com/LinaroLtd/tcwg/ci/interesting-commits/-/raw/master/gdb/sha1/9102a6c15c756c55e77c0fa7deecfc58fa8a361e/tcwg_gnu_native_check_gdb/master-aarch64/details.txt *** https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-aarch64-build/1048/artifact/artifacts +** master-arm +*** 24 regressions +*** https://gitlab.com/LinaroLtd/tcwg/ci/interesting-commits/-/raw/master/gdb/sha1/9102a6c15c756c55e77c0fa7deecfc58fa8a361e/tcwg_gnu_native_check_gdb/master-arm/details.txt +*** https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-arm-build/1284/artifact/artifacts -Latest data: https://git-us.linaro.org/toolchain/ci/interesting-commits.git/plain/gdb/sha1/9102a6c15c756c55e77c0fa7deecfc58fa8a361e/jira/yaml +Latest data: https://gitlab.com/LinaroLtd/tcwg/ci/interesting-commits/-/raw/master/gdb/sha1/9102a6c15c756c55e77c0fa7deecfc58fa8a361e/jira/yaml diff --git a/notify/jira/summary b/notify/jira/summary index 6d2ee362..be73874e 100644 --- a/notify/jira/summary +++ b/notify/jira/summary @@ -1 +1 @@ -gdb-15-branchpoint-116-g9102a6c15c7: FAIL: 24 regressions +gdb-15-branchpoint-116-g9102a6c15c7: 24 regressions diff --git a/notify/jira/yaml b/notify/jira/yaml index ec420e71..b1f93219 100644 --- a/notify/jira/yaml +++ b/notify/jira/yaml @@ -2,7 +2,7 @@ IssueType: Sub-task Key: GNU-1248 Summary: | - gdb-15-branchpoint-116-g9102a6c15c7: FAIL: 24 regressions + gdb-15-branchpoint-116-g9102a6c15c7: 24 regressions Components: GDB Start date: 2024-06-08 Description: | @@ -16,19 +16,25 @@ Remove includes reported as unused by clangd. Then, add any includes necessary to get rid of errors (includes possibly relying on previous includes).. - - I didn't remove the includes of gdb-safe-ctypes.h, because it appears to - ... 5 lines of the commit log omitted. + ... 7 lines of the commit log omitted. * tcwg_gdb_check ** master-aarch64 *** FAIL: 24 regressions *** https://git-us.linaro.org/toolchain/ci/interesting-commits.git/plain/gdb/sha1/9102a6c15c756c55e77c0fa7deecfc58fa8a361e/tcwg_gdb_check/master-aarch64/details.txt *** https://ci.linaro.org/job/tcwg_gdb_check--master-aarch64-build/1281/artifact/artifacts + ** master-arm + *** FAIL: 24 regressions + *** https://git-us.linaro.org/toolchain/ci/interesting-commits.git/plain/gdb/sha1/9102a6c15c756c55e77c0fa7deecfc58fa8a361e/tcwg_gdb_check/master-arm/details.txt + *** https://ci.linaro.org/job/tcwg_gdb_check--master-arm-build/1276/artifact/artifacts * tcwg_gnu_native_check_gdb ** master-aarch64 - *** FAIL: 24 regressions - *** https://git-us.linaro.org/toolchain/ci/interesting-commits.git/plain/gdb/sha1/9102a6c15c756c55e77c0fa7deecfc58fa8a361e/tcwg_gnu_native_check_gdb/master-aarch64/details.txt + *** 24 regressions + *** https://gitlab.com/LinaroLtd/tcwg/ci/interesting-commits/-/raw/master/gdb/sha1/9102a6c15c756c55e77c0fa7deecfc58fa8a361e/tcwg_gnu_native_check_gdb/master-aarch64/details.txt *** https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-aarch64-build/1048/artifact/artifacts + ** master-arm + *** 24 regressions + *** https://gitlab.com/LinaroLtd/tcwg/ci/interesting-commits/-/raw/master/gdb/sha1/9102a6c15c756c55e77c0fa7deecfc58fa8a361e/tcwg_gnu_native_check_gdb/master-arm/details.txt + *** https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-arm-build/1284/artifact/artifacts - Latest data: https://git-us.linaro.org/toolchain/ci/interesting-commits.git/plain/gdb/sha1/9102a6c15c756c55e77c0fa7deecfc58fa8a361e/jira/yaml + Latest data: https://gitlab.com/LinaroLtd/tcwg/ci/interesting-commits/-/raw/master/gdb/sha1/9102a6c15c756c55e77c0fa7deecfc58fa8a361e/jira/yaml diff --git a/notify/lnt_report.json b/notify/lnt_report.json index e3a6c721..38cb635d 100644 --- a/notify/lnt_report.json +++ b/notify/lnt_report.json @@ -16,7 +16,7 @@ "git_gdb": "https://sourceware.org/git/?p=binutils-gdb.git;a=commit;h=9102a6c15c756c55e77c0fa7deecfc58fa8a361e (+ 1 commits)", "__report_version__": "1" }, - "Start Time": "2024-06-08 04:19:20" + "Start Time": "2024-06-03 19:38:53" }, "Tests": [ { @@ -29,7 +29,7 @@ , { "Data": [ - 754 + 126 ], "Info": {}, "Name": "tcwg_gnu_native_check_gdb.TOTAL.flaky.nb_flaky" diff --git a/notify/mail-body.txt b/notify/mail-body.txt index 83074ad9..55b7fdcd 100644 --- a/notify/mail-body.txt +++ b/notify/mail-body.txt @@ -1,11 +1,8 @@ -Dear contributor, our automatic CI has detected problems related to your patch(es). Please find some details below. If you have any questions, please follow up on linaro-toolchain@lists.linaro.org mailing list, Libera's #linaro-tcwg channel, or ping your favourite Linaro toolchain developer on the usual project channel. +Dear contributor, -We appreciate that it might be difficult to find the necessary logs or reproduce the issue locally. If you can't get what you need from our CI within minutes, let us know and we will be happy to help. - -We track this report status in https://linaro.atlassian.net/browse/GNU-1248 , please let us know if you are looking at the problem and/or when you have a fix. - -In master-aarch64 after: +Our automatic CI has detected problems related to your patch(es). Please find some details below. +In master-aarch64, after: | commit gdb-15-branchpoint-116-g9102a6c15c7 | Author: Simon Marchi | Date: Thu May 30 22:54:07 2024 -0400 @@ -15,54 +12,41 @@ In master-aarch64 after: | Remove includes reported as unused by clangd. Then, add any includes | necessary to get rid of errors (includes possibly relying on previous | includes).. - | - | I didn't remove the includes of gdb-safe-ctypes.h, because it appears to - | ... 5 lines of the commit log omitted. + | ... 7 lines of the commit log omitted. -FAIL: 24 regressions +Produces 24 regressions: + | + | regressions.sum: + | Running gdb:gdb.python/tui-window.exp ... + | FAIL: gdb.python/tui-window.exp: Window was updated + | Running gdb:gdb.tui/empty.exp ... + | FAIL: gdb.tui/empty.exp: asm-regs: 90x40: box 1 (ll corner is |, not +) + | FAIL: gdb.tui/empty.exp: asm-regs: 90x40: box 2 (ul corner is |, not +) + | ... and 25 more -regressions.sum: - === gdb tests === +Used configuration : + *CI config* tcwg_gnu_native_check_gdb master-aarch64 + *configure and test flags:* none, autodetected on aarch64-unknown-linux-gnu -Running gdb:gdb.python/tui-window.exp ... -FAIL: gdb.python/tui-window.exp: Window was updated +We track this bug report under https://linaro.atlassian.net/browse/GNU-1248. Please let us know if you have a fix. -Running gdb:gdb.tui/empty.exp ... -FAIL: gdb.tui/empty.exp: asm-regs: 90x40: box 1 (ll corner is |, not +) -FAIL: gdb.tui/empty.exp: asm-regs: 90x40: box 2 (ul corner is |, not +) -FAIL: gdb.tui/empty.exp: asm: 90x40: box 1 (ll corner is , not +) -FAIL: gdb.tui/empty.exp: split-regs: 90x40: box 1 (ll corner is |, not +) -... and 28 more entries +If you have any questions regarding this report, please ask on linaro-toolchain@lists.linaro.org mailing list. -You can find the failure logs in *.log.1.xz files in - - https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-aarch64-build/1048/artifact/artifacts/00-sumfiles/ -The full lists of regressions and progressions as well as configure and make commands are in - - https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-aarch64-build/1048/artifact/artifacts/notify/ -The list of [ignored] baseline and flaky failures are in - - https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-aarch64-build/1048/artifact/artifacts/sumfiles/xfails.xfail +-----------------8<--------------------------8<--------------------------8<-------------------------- -The configuration of this build is: -CI config tcwg_gnu_native_check_gdb master-aarch64 +The information below contains the details of the failures, and the ways to reproduce a debug environment: ------------------8<--------------------------8<--------------------------8<-------------------------- -The information below can be used to reproduce a debug environment: +You can find the failure logs in + * https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-aarch64-build/1048/artifact/artifacts/ +The full lists of regressions and improvements as well as configure and make commands are in + * https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-aarch64-build/1048/artifact/artifacts/notify/ +The list of [ignored] baseline and flaky failures are in + * https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-aarch64-build/1048/artifact/artifacts/sumfiles/xfails.xfail Current build : https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-aarch64-build/1048/artifact/artifacts Reference build : https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-aarch64-build/1047/artifact/artifacts -Reproduce last good and first bad builds: https://git-us.linaro.org/toolchain/ci/interesting-commits.git/plain/gdb/sha1/9102a6c15c756c55e77c0fa7deecfc58fa8a361e/tcwg_gnu_native_check_gdb/master-aarch64/reproduction_instructions.txt +Instruction to reproduce the build : https://gitlab.com/LinaroLtd/tcwg/ci/interesting-commits/-/raw/master/gdb/sha1/9102a6c15c756c55e77c0fa7deecfc58fa8a361e/tcwg_gnu_native_check_gdb/master-aarch64/reproduction_instructions.txt Full commit : https://sourceware.org/git/?p=binutils-gdb.git;a=commitdiff;h=9102a6c15c756c55e77c0fa7deecfc58fa8a361e -List of configurations that regressed due to this commit : -* tcwg_gdb_check -** master-aarch64 -*** FAIL: 24 regressions -*** https://git-us.linaro.org/toolchain/ci/interesting-commits.git/plain/gdb/sha1/9102a6c15c756c55e77c0fa7deecfc58fa8a361e/tcwg_gdb_check/master-aarch64/details.txt -*** https://ci.linaro.org/job/tcwg_gdb_check--master-aarch64-build/1281/artifact/artifacts -* tcwg_gnu_native_check_gdb -** master-aarch64 -*** FAIL: 24 regressions -*** https://git-us.linaro.org/toolchain/ci/interesting-commits.git/plain/gdb/sha1/9102a6c15c756c55e77c0fa7deecfc58fa8a361e/tcwg_gnu_native_check_gdb/master-aarch64/details.txt -*** https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-aarch64-build/1048/artifact/artifacts - diff --git a/notify/mail-subject.txt b/notify/mail-subject.txt index a9d856c8..dd915387 100644 --- a/notify/mail-subject.txt +++ b/notify/mail-subject.txt @@ -1 +1 @@ -[Linaro-TCWG-CI] gdb-15-branchpoint-116-g9102a6c15c7: FAIL: 24 regressions on aarch64 +[Linaro-TCWG-CI] gdb-15-branchpoint-116-g9102a6c15c7: 24 regressions on aarch64 diff --git a/notify/regressions.sum b/notify/regressions.sum index cf9d0401..6a5725e5 100644 --- a/notify/regressions.sum +++ b/notify/regressions.sum @@ -39,5 +39,5 @@ FAIL: gdb.tui/resize.exp: source box after resize (ll corner is , not +) === Results Summary === # of stable fails 110 -# of flaky entries 754 +# of flaky entries 126 # of all tests 117975 diff --git a/notify/results-summary.txt b/notify/results-summary.txt index 46124a3a..08788a06 100644 --- a/notify/results-summary.txt +++ b/notify/results-summary.txt @@ -1,5 +1,5 @@ === Results Summary === # of stable fails 110 -# of flaky entries 754 +# of flaky entries 126 # of all tests 117975 diff --git a/notify/results.compare.txt b/notify/results.compare.txt index 7ac4bff8..c8fd1604 100644 --- a/notify/results.compare.txt +++ b/notify/results.compare.txt @@ -1,12 +1,12 @@ # Comparing directories # REFERENCE: base-artifacts/sumfiles -# CURRENT: artifacts/sumfiles +# CURRENT: artifacts/99-rewrite/artifacts.old/sumfiles # Comparing 1 common sum files: gdb.sum Comparing: -REFERENCE:/tmp/gxx-sum1.1180791 -CURRENT: /tmp/gxx-sum2.1180791 +REFERENCE:/tmp/gxx-sum1.3915691 +CURRENT: /tmp/gxx-sum2.3915691 +---------+---------+ o RUN STATUS: | REF | RES | @@ -90,9 +90,10 @@ o REGRESSIONS: o IMPROVEMENTS TO BE CHECKED: +------------------------------------------+---------+ | PASS disappears [PASS => ] | 27 | - | New PASS [ => PASS] | 48 | + | New PASS [ => PASS] | 44 | | XFAIL disappears [XFAIL=> ] | 4 | | XFAIL appears [ =>XFAIL] | 1 | + | Flaky cases, ignored [~RANDOM ] | 4 | +------------------------------------------+---------+ | TOTAL_IMPROVEMENTS_TO_BE_CHECKED | 80 | +------------------------------------------+---------+ @@ -179,12 +180,8 @@ o IMPROVEMENTS TO BE CHECKED: gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 8: set breakpoint always-inserted off gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 8: set breakpoint always-inserted on Executed from: gdb:gdb.threads/process-dies-while-detaching.exp - gdb:gdb.threads/process-dies-while-detaching.exp=gdb.threads/process-dies-while-detaching.exp: multi-process: continue: watchpoint:hw: continue - gdb:gdb.threads/process-dies-while-detaching.exp=gdb.threads/process-dies-while-detaching.exp: multi-process: continue: watchpoint:hw: continue to breakpoint: _exit gdb:gdb.threads/process-dies-while-detaching.exp=gdb.threads/process-dies-while-detaching.exp: multi-process: continue: watchpoint:hw: detach child gdb:gdb.threads/process-dies-while-detaching.exp=gdb.threads/process-dies-while-detaching.exp: multi-process: continue: watchpoint:hw: switch to parent - gdb:gdb.threads/process-dies-while-detaching.exp=gdb.threads/process-dies-while-detaching.exp: single-process: continue: watchpoint:hw: continue - gdb:gdb.threads/process-dies-while-detaching.exp=gdb.threads/process-dies-while-detaching.exp: single-process: continue: watchpoint:hw: continue to breakpoint: _exit - XFAIL disappears [XFAIL=> ]: @@ -202,6 +199,15 @@ o IMPROVEMENTS TO BE CHECKED: gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 1: attach (EPERM) + - Flaky cases, ignored [~RANDOM ]: + + Executed from: gdb:gdb.threads/process-dies-while-detaching.exp + gdb:gdb.threads/process-dies-while-detaching.exp=gdb.threads/process-dies-while-detaching.exp: multi-process: continue: watchpoint:hw: continue + gdb:gdb.threads/process-dies-while-detaching.exp=gdb.threads/process-dies-while-detaching.exp: multi-process: continue: watchpoint:hw: continue to breakpoint: _exit + gdb:gdb.threads/process-dies-while-detaching.exp=gdb.threads/process-dies-while-detaching.exp: single-process: continue: watchpoint:hw: continue + gdb:gdb.threads/process-dies-while-detaching.exp=gdb.threads/process-dies-while-detaching.exp: single-process: continue: watchpoint:hw: continue to breakpoint: _exit + + # Regressions found # Regressions in 1 common sum files found