Skip to content

Include previous tests in ContractTest via ContractTestSettings #2097

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
joelrosario merged 2 commits into from
Nov 26, 2025
Merged

Include previous tests in ContractTest via ContractTestSettings #2097

joelrosario merged 2 commits into from
Nov 26, 2025

Conversation

@StarKhan6368
Copy link
Contributor

@StarKhan6368 StarKhan6368 commented Nov 25, 2025

What: Include previous tests in ContractTest via ContractTestSettings

How:

  • Consider the previous test in case it is a sub-run provided through ContracTestSettings.
  • The previous test currently only affects the path and overall coverage calculations.

Checklist:

  • Unit Tests
  • Build passing locally
  • Sonar Quality Gate
  • Security scans don't report any vulnerabilities
  • Documentation added/updated (share link)
  • Sample Project added/updated (share link)
  • Demo video (share link)
  • Article on Website (share link)
  • Roadmpap updated (share link)
  • Conference Talk (share link)

@StarKhan6368
Add previous tests to contractTest calculation
e7bd78b 
- Takes previous test into account in-case it's a sub-run
- Only effects the path and overall coverage calculation
- Add simple tests for the same
@github-actions
Copy link

github-actions bot commented Nov 25, 2025

Summary

Line coverage Branch coverage

Assembly Line coverage Branch coverage
application 56.3% 42.8%
application/backwardCompatibility 80.6% 56.6%
application/mcp 5.2% 0%
io/specmatic/conversions 91.2% 79.4%
io/specmatic/core 79.6% 62.1%
io/specmatic/core/azure 0% 0%
io/specmatic/core/config 95.4% 84.2%
io/specmatic/core/config/v1 97.8% 25%
io/specmatic/core/config/v2 97.7% 74.1%
io/specmatic/core/config/v3 97.6% 83.6%
io/specmatic/core/discriminator 53.2% 43.1%
io/specmatic/core/examples/module 21.6% 14.4%
io/specmatic/core/examples/server 11.3% 0%
io/specmatic/core/filters 81.2% 74.4%
io/specmatic/core/git 5% 3.4%
io/specmatic/core/jsonoperator 76.4% 70.8%
io/specmatic/core/jsonoperator/value 85.1% 75.5%
io/specmatic/core/lifecycle 0% ****
io/specmatic/core/log 80.7% 61.2%
io/specmatic/core/matchers 77.5% 54.5%
io/specmatic/core/overlay 85.7% 58.3%
io/specmatic/core/pattern 86.4% 74.9%
io/specmatic/core/pattern/config 100% ****
io/specmatic/core/pattern/regex 94% 86.5%
io/specmatic/core/route/modules 92.8% 75%
io/specmatic/core/utilities 61% 54.6%
io/specmatic/core/value 85.3% 73.2%
io/specmatic/core/wsdl/parser 80.9% 41.4%
io/specmatic/core/wsdl/parser/message 89% 67.8%
io/specmatic/core/wsdl/parser/operation 100% 100%
io/specmatic/core/wsdl/payload 71.7% 33.3%
io/specmatic/junit5/support 0% ****
io/specmatic/mcp/constants 0% ****
io/specmatic/mcp/report 0% 0%
io/specmatic/mcp/test 0% 0%
io/specmatic/mcp/test/client 0% 0%
io/specmatic/mcp/test/client/model 0% 0%
io/specmatic/mock 53.7% 54.1%
io/specmatic/proxy 64.7% 49.4%
io/specmatic/reports 82.5% 15.8%
io/specmatic/specmatic/core 0% ****
io/specmatic/specmatic/executable 100% ****
io/specmatic/specmatic/mcp 0% ****
io/specmatic/stub 76.5% 70.2%
io/specmatic/stub/listener 100% 50%
io/specmatic/stub/report 98% 77.2%
io/specmatic/test 70.8% 59.4%
io/specmatic/test/asserts 97.1% 85.8%
io/specmatic/test/handlers 90.9% 63.5%
io/specmatic/test/listeners 47% 23.6%
io/specmatic/test/reports 63.6% 28.9%
io/specmatic/test/reports/coverage 98.2% 53.8%
io/specmatic/test/reports/coverage/console 85.5% 80%
io/specmatic/test/reports/coverage/html 0% 0%
io/specmatic/test/reports/renderers 11.8% 12.1%
io/specmatic/test/utils 92.1% 82%

@joelrosario joelrosario merged commit 5dd229b into main Nov 26, 2025
@joelrosario joelrosario deleted the update-contract-test-settings branch November 26, 2025 06:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@joelrosario joelrosario joelrosario approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@StarKhan6368 @joelrosario