Skip to content

Add GitHub Action summary support to new test framework#46047

Merged
ahus1 merged 1 commit intokeycloak:mainfrom
stianst:tf-github-actions-report
Feb 6, 2026
Merged

Add GitHub Action summary support to new test framework#46047
ahus1 merged 1 commit intokeycloak:mainfrom
stianst:tf-github-actions-report

Conversation

@stianst
Copy link
Contributor

@stianst stianst commented Feb 5, 2026 •
edited
Loading

Example run with mock broken tests:
image

https://github.com/stianst/keycloak/actions/runs/21706517453

One issue I found is if you click directly on the links the line-number is lost, but if you open the link in a new tab it goes to the correct line. Got no clue why, and nothing I can fix as the link is correct, so GitHub or Chrome must be doing something odd.

Closes #46045

Signed-off-by: stianst stianst@gmail.com

@stianst stianst requested a review from a team as a code owner February 5, 2026 10:03
@pruivo
Copy link
Member

pruivo commented Feb 5, 2026

One issue I found is if you click directly on the links the line-number is lost, but if you open the link in a new tab it goes to the correct line.

Same, but opening in a new tab/window doesn't work for me (i.e., the line number is lost).

Having the list of tests failing looks great to me!

@stianst
Copy link
Contributor Author

stianst commented Feb 5, 2026

One issue I found is if you click directly on the links the line-number is lost, but if you open the link in a new tab it goes to the correct line.

Same, but opening in a new tab/window doesn't work for me (i.e., the line number is lost).

Having the list of tests failing looks great to me!

Weird, you on Chrome as well? Does it work if you copy/paste the link?

@pruivo
Copy link
Member

pruivo commented Feb 5, 2026

One issue I found is if you click directly on the links the line-number is lost, but if you open the link in a new tab it goes to the correct line.

Same, but opening in a new tab/window doesn't work for me (i.e., the line number is lost).
Having the list of tests failing looks great to me!

Weird, you on Chrome as well? Does it work if you copy/paste the link?

Google Chrome 144.0.7559.96

Copy/paste works.

@stianst stianst force-pushed the tf-github-actions-report branch from f49b865 to 817a993 Compare February 6, 2026 05:24
@stianst
Copy link
Contributor Author

stianst commented Feb 6, 2026 •
edited
Loading

Updated to remove success output as GitHub collapses the summary for the run if there is many jobs with output, which means failures and slow tests will often be hidden.

Honestly, if all is good silence is probably the best ;)

@stianst stianst force-pushed the tf-github-actions-report branch from 817a993 to 5f25f17 Compare February 6, 2026 05:28
@stianst
Add GitHub Action summary support to new test framework
afd1429 
Closes keycloak#46045

Signed-off-by: stianst <stianst@gmail.com>
@stianst stianst force-pushed the tf-github-actions-report branch from 5f25f17 to afd1429 Compare February 6, 2026 10:21
@ahus1 ahus1 enabled auto-merge (squash) February 6, 2026 12:39
@ahus1 ahus1 merged commit 4ff0234 into keycloak:main Feb 6, 2026
87 checks passed
@stianst stianst deleted the tf-github-actions-report branch February 9, 2026 06:38
@vaceksimon vaceksimon mentioned this pull request Feb 13, 2026
Open
2 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@ahus1 ahus1 ahus1 approved these changes

@vaceksimon vaceksimon Awaiting requested review from vaceksimon

+1 more reviewer

@lhanusov lhanusov lhanusov approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

area/test-framework

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Add GitHub Action summary support to new test framework

4 participants

@stianst @pruivo @ahus1 @lhanusov