'How do I set up the calculation of tests(not steps) in the statistics of the report portal?
I ran into a problem - I can not configure statistics for passing tests (not steps). All dashboards are built on the basis of counting the test steps. Nowhere can I find information that will help me solve the problem.
Solution 1:[1]
Unfortunately, this is not possible with current implementation. The only suggest in this case would be re-structuring test results you send to reportportal. As example, you can use integration with Cucumber. There are two reporters: ScenarioReporter and StepReporter. Step reporter sends each scenario step as separate test item. Scenario reporter aggregates information of all steps executed and then sends only one test item. ReportPortal accepts any structure: you can send suite-test-step as well as test-step or suite-test. Statistics in built based on lower tree level (for items that do not have children). So, for Cucumber's ScenarioReporter, the lowest item is scenario (not a step) and as result you can build statistics on top of Scenarios. Hope it helps.
Solution 2:[2]
It's been awhile, since the original question, but since I ran into the same problem here's how I solved it: I have a 3-tier solution: Launch-> Suite -> Step. All my test cases are sent to ReportPortal as steps. I completely skip the "test" tag. As a result, I get correct number of test cases in Dashboards and all the statistics for the failed tests, etc.
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|---|
| Solution 1 | avarabyeu |
| Solution 2 | Sparkle |