test-reporting

Remove tests that were not executed from Allure report

由 本秂侑毒 提交于 2021-02-17 05:11:40
问题 While running test I use different test-suites (xml files with list of tests to execute). E.g. I need to run smoke-tests so I choose corresponding xml with simplest tests (login/logout; selecting main tabs; check that data is displayed). But in generated allure report there are all test that are in the project (all methods with @Test annotation). And tests that have not been executed have statuses passed , failed ; this information misleading to conclusion that we have tested more than we

possible values for @CucumberOptions(plugin = …)

由 ＊爱你＆永不变心＊ 提交于 2021-02-10 05:47:11
问题 I am using @CucumberOptions(plugin = {"pretty"} for test report in cucumber but the default colors for this are really bad..so I am looking to change the font color in output report. Anyone as any idea..how proceed further? 回答1: For console colors see Console-Colours. For reports you can specify that the report be output in JSON and then pass the generated JSON to a custom formatter. See Custom-Formatters. BTW, this is how TeamCity creates its reports. Here is an example of generating both

Kotlin Spek - How to generate XML with tests report?

由 旧城冷巷雨未停 提交于 2019-12-25 05:50:27
问题 I am using Spek to test my Kotlin app. I would like to publish my tests report after Jenkins build. JUnit or TestNG would generate XML report which Jenkins can use to generate tests stats. Does Spek generate such report? If so, how to configure my Gradle project to get it? If not, what are the other reporting options available? 回答1: I haven't checked thoroughly my build directory. Since Spek is using JUnit 5 Platform Engine it will produce reports the same way as JUnit 5 would have done.

MSTest data driven Test set DisplayName for Rows from DataSource

由 白昼怎懂夜的黑 提交于 2019-12-23 07:06:04
问题 How can I set the DisplayName of a Data Row in data driven tests, where the data source is a XML and the provider is Microsoft.VisualStudio.TestTools.DataSource.XML. XML: <?xml version="1.0" encoding="utf-8" ?> <environments> <environment><name>IE</name></environment> <environment><name>Chrome</name></environment> </environments> App Config: <!-- CONNECTION STRINGS SETTINGS --> <connectionStrings> <add name="IE_Chrome" connectionString="IE_Chrome.xml" providerName="Microsoft.VisualStudio

How to get JaCoCo instrumentation code coverage while executing webApplication on server

由 [亡魂溺海] 提交于 2019-12-23 05:06:30
问题 I want to get a code coverage report (or tracking controller flow of an application) when I execute the some scenario on live application i.e. while application running in server, so I have refereed the official Jacoco documentation and did as fallows As a first step, I tried to bind the jacoco agent to the application running port export MAVEN_OPTS=-javaagent:/home/user/.m2/repository/org/jacoco/org.jacoco.agent/0.7.4.201502262128/org.jacoco.agent-0.7.4.201502262128-runtime.jar=includes=*

Renaming test results of UITestActionLog files or folders as the test case name

由 天大地大妈咪最大 提交于 2019-12-11 22:02:43
问题 Really appreciate your help Adrian. I was able to add the .settingfile, how can I change the generated folder name as the testcase name , lets say I have my testcase as test1(){} I want the result folder to be named as test1 as well? I Select the option on the general tab and define the User_defined Scheme , but what ever I write there appears on my test result folder, I want it to be the name of my test case In coded UI, we need to rename the test result UITestActionLog files or folders to

cucumber.json report getting overwritten by rerun scenario report

由 时光怂恿深爱的人放手 提交于 2019-12-10 10:25:46
问题 I have got UI Test project and a API test project with same technology stack (JAVA1.8, Cucumber-JVM, JUnit, Maven) and both projects are showing me this problem. Probably because same set of dependencies are present in both. I have employed the Flaky test re-run mechanism using maven-surefire-plugin build-in functionality <rerunFailingTestsCount>1</rerunFailingTestsCount> . Also, I have cucumber dependencies added based on <groupId>io.cucumber</groupId> and not <groupId>info.cukes</groupId> .

cucumber.json report getting overwritten by rerun scenario report

由 烈酒焚心 提交于 2019-12-05 18:41:21
I have got UI Test project and a API test project with same technology stack (JAVA1.8, Cucumber-JVM, JUnit, Maven) and both projects are showing me this problem. Probably because same set of dependencies are present in both. I have employed the Flaky test re-run mechanism using maven-surefire-plugin build-in functionality <rerunFailingTestsCount>1</rerunFailingTestsCount> . Also, I have cucumber dependencies added based on <groupId>io.cucumber</groupId> and not <groupId>info.cukes</groupId> . Both these have their own version of cucumber-java and cucumber-jvm dependencies. My POM.XML looks

Protractor coverage not generating report

由 孤者浪人 提交于 2019-12-05 07:28:56
问题 Backend of our app is in PHP and for frontend we are using AngularJs . We successfully managed to run e2e tests on local as well as on production server using protractor . After writing loads of e2e tests for our app, we started looking for its coverage similar to that of unit testing. After searching for lot, luckily we find https://www.npmjs.com/package/grunt-protractor-coverage , exactly what we wanted. I took help from http://lkrnac.net/blog/2014/04/measuring-code-coverage-by-protractor/

Insert screenshots in SpecRun/SpecFlow test execution reports

由 不羁岁月 提交于 2019-12-04 14:23:15
问题 I'm using SpecFlow with Selenium WebDriver and SpecRun as test runner to create and execute automated test cases and I'm looking for a solution to insert screenshots in the test execution report. I wrote a method to create screenshots after every Assert function. The images are saved to a specific location, but when I make the result analysis I have to follow the report and the images as well. It would be nice to have them in the same location (precisely in the report html). Is there any way
订阅 test-reporting