Skip to content

Merging with same testsuite name doesn't provide any stats at root level #239

@mjblue

Description

@mjblue

In V6.0 we have 2 xml files with the same testsuite name. These results are combined but there is no testsuite added, the combined xml has and so no results are seen when uploading the combined results in Azure Devops.

In the attachment. I have provided the 2 output files (cucumber1.xml and cucucmber2.xml) as well as the results for v5 ( combv5.xml ) and v6 ( comb.xml)

combinations.zip

In V5 the test suites were not combined to give one combined status for the same test suite ran twice, e.g

in xml file 1 - test 1 run at 09:00 failed
in xml file 2 - test 1 run at 09:12 passed

The way the surefire rerun functionallity generates xml is to mark the 'earliest' same test as 'skipped' and the 'latest' test run of the same test as 'passed' and will just show the stats as 1 test.

For the 2 files attached:
V5 gave us a valid xml but without combined testsuites
V6 gives an invalid xml

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions