Failsafe Report
Summary
[Summary] [Package List] [Test Cases]
| Tests | Errors | Failures | Skipped | Success Rate | Time |
|---|---|---|---|---|---|
| 962 | 0 | 0 | 136 | 85.9% | 6427 s |
Note: failures are anticipated and checked for with assertions while errors are unanticipated.
Package List
[Summary] [Package List] [Test Cases]
| Package | Tests | Errors | Failures | Skipped | Success Rate | Time |
|---|---|---|---|---|---|---|
| org.apache.maven.surefire.its | 718 | 0 | 0 | 131 | 81.8% | 4512 s |
| org.apache.maven.surefire.its.jiras | 244 | 0 | 0 | 5 | 98.0% | 1915 s |
Note: package statistics are not computed recursively, they only sum up all of its testsuites numbers.
org.apache.maven.surefire.its
| - | Class | Tests | Errors | Failures | Skipped | Success Rate | Time |
|---|---|---|---|---|---|---|---|
 |
JUnit47ConcurrencyIT | 1 | 0 | 0 | 0 | 100% | 7.273 s |
|
CheckTestNgCustomObjectFactoryIT | 1 | 0 | 0 | 0 | 100% | 7.235 s |
|
IncludesExcludesIT | 3 | 0 | 0 | 0 | 100% | 18.39 s |
|
CheckTestFailIfNoTestsIT | 3 | 0 | 0 | 0 | 100% | 15.25 s |
|
TestNgSuccessPercentageIT | 1 | 0 | 0 | 0 | 100% | 6.982 s |
|
UseIsolatedClassLoaderIT | 1 | 0 | 0 | 0 | 100% | 6.430 s |
 |
TestMultipleMethodPatternsIT | 180 | 0 | 0 | 87 | 51.7% | 356.5 s |
|
JUnit47WithCucumberIT | 2 | 0 | 0 | 0 | 100% | 12.05 s |
|
TestMultipleMethodPatternsTestNGIT | 90 | 0 | 0 | 41 | 54.4% | 280.4 s |
|
TestMultipleMethodsIT | 3 | 0 | 0 | 0 | 100% | 19.08 s |
|
CheckTestNgListenerReporterIT | 9 | 0 | 0 | 1 | 88.9% | 56.06 s |
|
EnvironmentVariableIT | 1 | 0 | 0 | 0 | 100% | 7.276 s |
|
SystemPropertiesTestIT | 2 | 0 | 0 | 0 | 100% | 12.10 s |
|
SmartStackTraceIT | 1 | 0 | 0 | 0 | 100% | 6.357 s |
|
CheckTestNgGroupThreadParallelIT | 1 | 0 | 0 | 0 | 100% | 6.636 s |
|
AbstractTestCaseIT | 1 | 0 | 0 | 0 | 100% | 6.345 s |
|
JUnit44HamcrestIT | 1 | 0 | 0 | 0 | 100% | 6.464 s |
|
TimeoutForkedTestIT | 1 | 0 | 0 | 0 | 100% | 15.50 s |
|
ForkCountTestNGIT | 8 | 0 | 0 | 0 | 100% | 97.51 s |
|
SiblingAggregatorIT | 1 | 0 | 0 | 0 | 100% | 6.775 s |
|
JUnitPlatformIT | 15 | 0 | 0 | 0 | 100% | 106.1 s |
|
CheckTestNgCustomTestRunnerFactoryIT | 1 | 0 | 0 | 0 | 100% | 7.281 s |
|
ArchUnitIT | 1 | 0 | 0 | 0 | 100% | 8.172 s |
|
CheckTestNgBeforeMethodIT | 1 | 0 | 0 | 0 | 100% | 7.303 s |
|
PlainOldJavaClasspathIT | 1 | 0 | 0 | 0 | 100% | 5.797 s |
|
ClasspathScopeFilteringIT | 1 | 0 | 0 | 0 | 100% | 6.822 s |
|
LongWindowsPathIT | 1 | 0 | 0 | 1 | 0% | 0.044 s |
|
XmlReporterRunTimeIT | 1 | 0 | 0 | 0 | 100% | 26.00 s |
|
WorkingDirectoryIsInvalidPropertyIT | 1 | 0 | 0 | 0 | 100% | 5.205 s |
|
MultiModuleProjectWithJPMSIT | 1 | 0 | 0 | 0 | 100% | 9.736 s |
|
AggregateReportIT | 1 | 0 | 0 | 0 | 100% | 9.450 s |
|
ForkCountMultiModuleIT | 4 | 0 | 0 | 0 | 100% | 35.33 s |
|
PojoSimpleIT | 1 | 0 | 0 | 0 | 100% | 5.070 s |
|
CrashDetectionIT | 3 | 0 | 0 | 0 | 100% | 20.39 s |
|
ForkConsoleOutputWithErrorsIT | 1 | 0 | 0 | 0 | 100% | 6.592 s |
|
JUnit47RerunFailingTestWithCucumberIT | 6 | 0 | 0 | 0 | 100% | 42.99 s |
|
Surefire1602IT | 1 | 0 | 0 | 0 | 100% | 13.16 s |
|
JUnitPlatformStreamCorruptionIT | 3 | 0 | 0 | 1 | 66.7% | 12.37 s |
|
JUnit4RunListenerIT | 2 | 0 | 0 | 0 | 100% | 14.04 s |
|
ClasspathFilteringIT | 1 | 0 | 0 | 0 | 100% | 8.247 s |
|
CheckTestNgSuiteXmlSingleIT | 1 | 0 | 0 | 0 | 100% | 8.426 s |
|
CheckSingleTestIT | 4 | 0 | 0 | 0 | 100% | 28.03 s |
|
CheckTestNgExecuteErrorIT | 1 | 0 | 0 | 0 | 100% | 6.947 s |
|
EnvironmentVariablesIT | 3 | 0 | 0 | 0 | 100% | 19.85 s |
|
DefaultConfigurationIT | 1 | 0 | 0 | 0 | 100% | 7.082 s |
|
CucumberIT | 1 | 0 | 0 | 0 | 100% | 9.390 s |
|
JUnit47StaticInnerClassTestsIT | 1 | 0 | 0 | 0 | 100% | 5.800 s |
|
JUnit48TestCategoriesIT | 8 | 0 | 0 | 0 | 100% | 53.39 s |
|
CheckTestFailIfNoTestsForkCountIT | 6 | 0 | 0 | 0 | 100% | 38.09 s |
|
NoRunnableTestsInClassIT | 1 | 0 | 0 | 0 | 100% | 5.795 s |
|
TestMethodPatternIT | 14 | 0 | 0 | 0 | 100% | 92.01 s |
|
JUnit47RedirectOutputIT | 2 | 0 | 0 | 0 | 100% | 14.94 s |
|
JUnit4IgnoreIT | 2 | 0 | 0 | 0 | 100% | 11.11 s |
|
JUnitPlatformEnginesIT | 76 | 0 | 0 | 0 | 100% | 390.3 s |
|
TestSingleMethodIT | 9 | 0 | 0 | 0 | 100% | 63.20 s |
|
CheckTestNgSuiteXmlIT | 3 | 0 | 0 | 0 | 100% | 22.59 s |
|
ResultCountingIT | 3 | 0 | 0 | 0 | 100% | 21.48 s |
|
AdditionalClasspathIT | 2 | 0 | 0 | 0 | 100% | 14.27 s |
|
IncludesExcludesFromFileIT | 6 | 0 | 0 | 0 | 100% | 33.43 s |
|
CheckTestNgBeforeMethodFailureIT | 1 | 0 | 0 | 0 | 100% | 7.226 s |
|
ClassPathOrderIT | 1 | 0 | 0 | 0 | 100% | 7.237 s |
|
ArgLinePropertiesIT | 1 | 0 | 0 | 0 | 100% | 6.554 s |
|
JUnitPlatformRerunFailingTestsIT | 7 | 0 | 0 | 0 | 100% | 159.5 s |
|
ForkConsoleOutputIT | 4 | 0 | 0 | 0 | 100% | 31.53 s |
|
ModulePathIT | 2 | 0 | 0 | 0 | 100% | 14.82 s |
|
WorkingDirectoryIT | 4 | 0 | 0 | 0 | 100% | 26.44 s |
|
TestNgParallelWithAnnotationsIT | 1 | 0 | 0 | 0 | 100% | 13.26 s |
|
FailFastTestNgIT | 8 | 0 | 0 | 0 | 100% | 211.0 s |
|
JUnit47ParallelIT | 59 | 0 | 0 | 0 | 100% | 423.2 s |
|
RunOrderIT | 12 | 0 | 0 | 0 | 100% | 118.0 s |
|
RunOrderParallelForksIT | 12 | 0 | 0 | 0 | 100% | 132.8 s |
|
ConsoleOutputIT | 8 | 0 | 0 | 0 | 100% | 83.67 s |
|
TwoTestCasesIT | 4 | 0 | 0 | 0 | 100% | 25.27 s |
|
FailFastJUnitIT | 14 | 0 | 0 | 0 | 100% | 366.6 s |
|
JUnit47ParallelNotThreadSafeIT | 1 | 0 | 0 | 0 | 100% | 5.660 s |
|
UnicodeTestNamesIT | 1 | 0 | 0 | 0 | 100% | 11.16 s |
|
WorkingDirectoryMissingIT | 1 | 0 | 0 | 0 | 100% | 5.760 s |
|
ForkCountIT | 8 | 0 | 0 | 0 | 100% | 120.6 s |
|
CheckTestNgListenersIT | 1 | 0 | 0 | 0 | 100% | 6.450 s |
|
Junit5ModulePathIT | 2 | 0 | 0 | 0 | 100% | 15.33 s |
|
CheckTestNgPathWithSpacesIT | 1 | 0 | 0 | 0 | 100% | 15.36 s |
|
CheckTestNgJdk14IT | 1 | 0 | 0 | 0 | 100% | 7.021 s |
|
ReportersIT | 1 | 0 | 0 | 0 | 100% | 6.063 s |
|
JUnit4VersionsIT | 19 | 0 | 0 | 0 | 100% | 112.0 s |
|
JUnit4RerunFailingTestsIT | 5 | 0 | 0 | 0 | 100% | 127.3 s |
|
FailFastJUnitPlatformIT | 7 | 0 | 0 | 0 | 100% | 74.15 s |
|
AssumptionFailureReportIT | 1 | 0 | 0 | 0 | 100% | 6.895 s |
|
CheckTestNg740ParallelIT | 2 | 0 | 0 | 0 | 100% | 16.03 s |
|
JUnit4ForkAlwaysStaticInitPollutionIT | 1 | 0 | 0 | 0 | 100% | 5.656 s |
|
Java9FullApiIT | 3 | 0 | 0 | 0 | 100% | 26.07 s |
|
UmlautDirIT | 4 | 0 | 0 | 0 | 100% | 32.57 s |
|
CheckTestNgVersionsIT | 4 | 0 | 0 | 0 | 100% | 32.06 s |
|
ArgLineIT | 1 | 0 | 0 | 0 | 100% | 6.213 s |
|
PlexusConflictIT | 2 | 0 | 0 | 0 | 100% | 16.17 s |
|
JUnitDepIT | 4 | 0 | 0 | 0 | 100% | 31.51 s |
|
CheckTestNgReportTestIT | 3 | 0 | 0 | 0 | 100% | 25.04 s |
|
TestNgGroupsIT | 5 | 0 | 0 | 0 | 100% | 32.66 s |
org.apache.maven.surefire.its.jiras
Test Cases
[Summary] [Package List] [Test Cases]
Surefire224WellFormedXmlFailuresIT
|
testWellFormedXmlFailures | 5.946 s |
JUnit47ConcurrencyIT
|
test47 | 7.273 s |
Surefire740TruncatedCommaIT
|
testRussianLocaleReport | 6.284 s |
CheckTestNgCustomObjectFactoryIT
|
testTestNgListenerReporter | 7.221 s |
Surefire801ForkNeverClassLoaderIT
|
testShouldBeOkWithForkNever | 6.183 s |
Surefire260TestWithIdenticalNamesIT
|
testWithIdenticalNames | 10.38 s |
IncludesExcludesIT
|
testPathBasedIncludesExcludes | 6.318 s |
|
testIncludesExcludes | 5.522 s |
|
testRegexIncludesExcludes | 6.540 s |
CheckTestFailIfNoTestsIT
|
failIfNoTests | 4.356 s |
|
dontFailIfNoTests | 5.638 s |
|
jUnit48CategoriesFailWhenNoTests | 5.236 s |
Surefire832ProviderSelectionIT
|
testJUnitRunCategoryAB | 6.968 s |
Surefire1036NonFilterableJUnitRunnerWithCategoriesIT
|
test | 6.532 s |
TestNgSuccessPercentageIT
|
testPassesWhenFailuresLessThanSuccessPercentage | 6.981 s |
UseIsolatedClassLoaderIT
|
testUseSystemClassLoader | 6.426 s |
TestMultipleMethodPatternsIT
|
shouldNotRunExcludedClassesAndMethods[0] | 6.469 s |
|
shouldMatchExactClassAndMethodCharacters[0] | 5.468 s |
|
shouldMatchExactClassAndMethodWildcard[0] | 6.530 s |
|
testSuccessTwo[0] | 7.484 s |
|
simpleNameTest[0] | 5.836 s |
|
simpleNameTestWithJavaExt[0] | 5.653 s |
|
regexClass[0] | 6.141 s |
|
shouldNotRunExcludedClasses[0] | 7.486 s |
|
shouldNotRunExcludedMethods[0] | 6.680 s |
|
simpleNameTestWithJavaExtWildcardPkg[0] | 9.291 s |
|
shouldMatchMultiplePatterns[0] | 6.135 s |
|
shouldMatchExactClassAndMethodsPostfix[0] | 6.380 s |
|
simpleNameTestWithWildcardPkg[0] | 5.970 s |
|
shouldMatchWildcardPackageAndClassAndMethod[0] | 5.905 s |
|
shouldMatchExactClassAndMultipleMethods[0] | 5.612 s |
|
fullyQualifiedTest[0] | 5.935 s |
|
matchSimpleClassAndMethodWithJavaExtWildcardPkg[0] | 5.767 s |
|
negativeTest[0] | 0 s |
| - | skipped | - |
|
testRegexSuccessTwo[0] | 6.270 s |
|
shouldMatchExactClassAndMethodsWildcard[0] | 6.062 s |
|
shouldMatchMultiplePatternsComplex[0] | 5.810 s |
|
simpleNameTestAsParallel[0] | 0 s |
| - | skipped | - |
|
matchSimpleClassAndMethodWithWildcardPkg[0] | 5.697 s |
|
shouldMatchMultiplePatternsAsParallel[0] | 0 s |
| - | skipped | - |
|
shouldNotRunExcludedClassesIfIncluded[0] | 5.869 s |
|
shouldMatchSimpleClassNameAndMethod[0] | 6.123 s |
|
shouldMatchExactClassAndMethodPostfix[0] | 5.937 s |
|
shouldMatchMultiplePatternsComplexAsParallel[0] | 0 s |
| - | skipped | - |
|
matchSimpleClassAndMethodWithJavaExt[0] | 5.868 s |
|
regexClassAndMethod[0] | 5.713 s |
|
shouldNotRunExcludedClassesAndMethods[1] | 6.346 s |
|
shouldMatchExactClassAndMethodCharacters[1] | 6.582 s |
|
shouldMatchExactClassAndMethodWildcard[1] | 11.18 s |
|
testSuccessTwo[1] | 6.478 s |
|
simpleNameTest[1] | 12.16 s |
|
simpleNameTestWithJavaExt[1] | 6.775 s |
|
regexClass[1] | 7.351 s |
|
shouldNotRunExcludedClasses[1] | 6.657 s |
|
shouldNotRunExcludedMethods[1] | 7.110 s |
|
simpleNameTestWithJavaExtWildcardPkg[1] | 6.043 s |
|
shouldMatchMultiplePatterns[1] | 4.742 s |
|
shouldMatchExactClassAndMethodsPostfix[1] | 4.553 s |
|
simpleNameTestWithWildcardPkg[1] | 3.311 s |
|
shouldMatchWildcardPackageAndClassAndMethod[1] | 3.347 s |
|
shouldMatchExactClassAndMultipleMethods[1] | 3.295 s |
|
fullyQualifiedTest[1] | 2.659 s |
|
matchSimpleClassAndMethodWithJavaExtWildcardPkg[1] | 2.963 s |
|
negativeTest[1] | 0 s |
| - | skipped | - |
|
testRegexSuccessTwo[1] | 2.121 s |
|
shouldMatchExactClassAndMethodsWildcard[1] | 2.274 s |
|
shouldMatchMultiplePatternsComplex[1] | 2.755 s |
|
simpleNameTestAsParallel[1] | 2.595 s |
|
matchSimpleClassAndMethodWithWildcardPkg[1] | 2.341 s |
|
shouldMatchMultiplePatternsAsParallel[1] | 2.447 s |
|
shouldNotRunExcludedClassesIfIncluded[1] | 2.524 s |
|
shouldMatchSimpleClassNameAndMethod[1] | 2.209 s |
|
shouldMatchExactClassAndMethodPostfix[1] | 2.078 s |
|
shouldMatchMultiplePatternsComplexAsParallel[1] | 2.003 s |
|
matchSimpleClassAndMethodWithJavaExt[1] | 2.057 s |
|
regexClassAndMethod[1] | 1.828 s |
|
shouldNotRunExcludedClassesAndMethods[2] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodCharacters[2] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodWildcard[2] | 0 s |
| - | skipped | - |
|
testSuccessTwo[2] | 0 s |
| - | skipped | - |
|
simpleNameTest[2] | 1.999 s |
|
simpleNameTestWithJavaExt[2] | 2.061 s |
|
regexClass[2] | 2.375 s |
|
shouldNotRunExcludedClasses[2] | 2.046 s |
|
shouldNotRunExcludedMethods[2] | 0 s |
| - | skipped | - |
|
simpleNameTestWithJavaExtWildcardPkg[2] | 1.812 s |
|
shouldMatchMultiplePatterns[2] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodsPostfix[2] | 0 s |
| - | skipped | - |
|
simpleNameTestWithWildcardPkg[2] | 2.141 s |
|
shouldMatchWildcardPackageAndClassAndMethod[2] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMultipleMethods[2] | 0 s |
| - | skipped | - |
|
fullyQualifiedTest[2] | 1.765 s |
|
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2] | 0 s |
| - | skipped | - |
|
negativeTest[2] | 1.877 s |
|
testRegexSuccessTwo[2] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodsWildcard[2] | 0 s |
| - | skipped | - |
|
shouldMatchMultiplePatternsComplex[2] | 0 s |
| - | skipped | - |
|
simpleNameTestAsParallel[2] | 0 s |
| - | skipped | - |
|
matchSimpleClassAndMethodWithWildcardPkg[2] | 0 s |
| - | skipped | - |
|
shouldMatchMultiplePatternsAsParallel[2] | 0 s |
| - | skipped | - |
|
shouldNotRunExcludedClassesIfIncluded[2] | 1.836 s |
|
shouldMatchSimpleClassNameAndMethod[2] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodPostfix[2] | 0 s |
| - | skipped | - |
|
shouldMatchMultiplePatternsComplexAsParallel[2] | 0 s |
| - | skipped | - |
|
matchSimpleClassAndMethodWithJavaExt[2] | 0 s |
| - | skipped | - |
|
regexClassAndMethod[2] | 0 s |
| - | skipped | - |
|
shouldNotRunExcludedClassesAndMethods[3] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodCharacters[3] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodWildcard[3] | 0 s |
| - | skipped | - |
|
testSuccessTwo[3] | 0 s |
| - | skipped | - |
|
simpleNameTest[3] | 1.777 s |
|
simpleNameTestWithJavaExt[3] | 2.018 s |
|
regexClass[3] | 2.014 s |
|
shouldNotRunExcludedClasses[3] | 2.044 s |
|
shouldNotRunExcludedMethods[3] | 0 s |
| - | skipped | - |
|
simpleNameTestWithJavaExtWildcardPkg[3] | 2.259 s |
|
shouldMatchMultiplePatterns[3] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodsPostfix[3] | 0 s |
| - | skipped | - |
|
simpleNameTestWithWildcardPkg[3] | 2.527 s |
|
shouldMatchWildcardPackageAndClassAndMethod[3] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMultipleMethods[3] | 0 s |
| - | skipped | - |
|
fullyQualifiedTest[3] | 2.241 s |
|
matchSimpleClassAndMethodWithJavaExtWildcardPkg[3] | 0 s |
| - | skipped | - |
|
negativeTest[3] | 1.746 s |
|
testRegexSuccessTwo[3] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodsWildcard[3] | 0 s |
| - | skipped | - |
|
shouldMatchMultiplePatternsComplex[3] | 0 s |
| - | skipped | - |
|
simpleNameTestAsParallel[3] | 1.722 s |
|
matchSimpleClassAndMethodWithWildcardPkg[3] | 0 s |
| - | skipped | - |
|
shouldMatchMultiplePatternsAsParallel[3] | 0 s |
| - | skipped | - |
|
shouldNotRunExcludedClassesIfIncluded[3] | 1.457 s |
|
shouldMatchSimpleClassNameAndMethod[3] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodPostfix[3] | 0 s |
| - | skipped | - |
|
shouldMatchMultiplePatternsComplexAsParallel[3] | 0 s |
| - | skipped | - |
|
matchSimpleClassAndMethodWithJavaExt[3] | 0 s |
| - | skipped | - |
|
regexClassAndMethod[3] | 0 s |
| - | skipped | - |
|
shouldNotRunExcludedClassesAndMethods[4] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodCharacters[4] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodWildcard[4] | 0 s |
| - | skipped | - |
|
testSuccessTwo[4] | 0 s |
| - | skipped | - |
|
simpleNameTest[4] | 1.293 s |
|
simpleNameTestWithJavaExt[4] | 1.716 s |
|
regexClass[4] | 1.335 s |
|
shouldNotRunExcludedClasses[4] | 1.430 s |
|
shouldNotRunExcludedMethods[4] | 0 s |
| - | skipped | - |
|
simpleNameTestWithJavaExtWildcardPkg[4] | 1.325 s |
|
shouldMatchMultiplePatterns[4] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodsPostfix[4] | 0 s |
| - | skipped | - |
|
simpleNameTestWithWildcardPkg[4] | 1.373 s |
|
shouldMatchWildcardPackageAndClassAndMethod[4] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMultipleMethods[4] | 0 s |
| - | skipped | - |
|
fullyQualifiedTest[4] | 1.372 s |
|
matchSimpleClassAndMethodWithJavaExtWildcardPkg[4] | 0 s |
| - | skipped | - |
|
negativeTest[4] | 1.271 s |
|
testRegexSuccessTwo[4] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodsWildcard[4] | 0 s |
| - | skipped | - |
|
shouldMatchMultiplePatternsComplex[4] | 0 s |
| - | skipped | - |
|
simpleNameTestAsParallel[4] | 0 s |
| - | skipped | - |
|
matchSimpleClassAndMethodWithWildcardPkg[4] | 0 s |
| - | skipped | - |
|
shouldMatchMultiplePatternsAsParallel[4] | 0 s |
| - | skipped | - |
|
shouldNotRunExcludedClassesIfIncluded[4] | 1.327 s |
|
shouldMatchSimpleClassNameAndMethod[4] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodPostfix[4] | 0 s |
| - | skipped | - |
|
shouldMatchMultiplePatternsComplexAsParallel[4] | 0 s |
| - | skipped | - |
|
matchSimpleClassAndMethodWithJavaExt[4] | 0 s |
| - | skipped | - |
|
regexClassAndMethod[4] | 0 s |
| - | skipped | - |
|
shouldNotRunExcludedClassesAndMethods[5] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodCharacters[5] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodWildcard[5] | 0 s |
| - | skipped | - |
|
testSuccessTwo[5] | 0 s |
| - | skipped | - |
|
simpleNameTest[5] | 1.326 s |
|
simpleNameTestWithJavaExt[5] | 1.632 s |
|
regexClass[5] | 1.747 s |
|
shouldNotRunExcludedClasses[5] | 1.708 s |
|
shouldNotRunExcludedMethods[5] | 0 s |
| - | skipped | - |
|
simpleNameTestWithJavaExtWildcardPkg[5] | 1.536 s |
|
shouldMatchMultiplePatterns[5] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodsPostfix[5] | 0 s |
| - | skipped | - |
|
simpleNameTestWithWildcardPkg[5] | 1.370 s |
|
shouldMatchWildcardPackageAndClassAndMethod[5] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMultipleMethods[5] | 0 s |
| - | skipped | - |
|
fullyQualifiedTest[5] | 1.358 s |
|
matchSimpleClassAndMethodWithJavaExtWildcardPkg[5] | 0 s |
| - | skipped | - |
|
negativeTest[5] | 1.689 s |
|
testRegexSuccessTwo[5] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodsWildcard[5] | 0 s |
| - | skipped | - |
|
shouldMatchMultiplePatternsComplex[5] | 0 s |
| - | skipped | - |
|
simpleNameTestAsParallel[5] | 1.666 s |
|
matchSimpleClassAndMethodWithWildcardPkg[5] | 0 s |
| - | skipped | - |
|
shouldMatchMultiplePatternsAsParallel[5] | 0 s |
| - | skipped | - |
|
shouldNotRunExcludedClassesIfIncluded[5] | 1.352 s |
|
shouldMatchSimpleClassNameAndMethod[5] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodPostfix[5] | 0 s |
| - | skipped | - |
|
shouldMatchMultiplePatternsComplexAsParallel[5] | 0 s |
| - | skipped | - |
|
matchSimpleClassAndMethodWithJavaExt[5] | 0 s |
| - | skipped | - |
|
regexClassAndMethod[5] | 0 s |
| - | skipped | - |
Surefire1712ExtractedModulenameWithoutASMIT
|
test | 7.000 s |
JUnit47WithCucumberIT
|
testWithParallelClasses | 6.381 s |
|
testWithoutParallel | 5.661 s |
Surefire1964IT
|
shouldFilterTests | 5.433 s |
|
shouldFilterTestsInPluginProcess | 5.090 s |
Surefire613TestCountInParallelIT
|
testParallelBuildResultCount | 6.711 s |
Surefire1967CheckTestNgMethodParallelOrderingIT
|
testNgParallelOrderingWithEarlyVersion6 | 6.036 s |
|
testNgParallelOrderingWithVersion6 | 6.495 s |
|
testNgParallelOrdering | 7.507 s |
SpockIT
|
test | 0 s |
| - | skipped | - |
TestMultipleMethodPatternsTestNGIT
|
shouldNotRunExcludedClassesAndMethods[0] | 7.262 s |
|
shouldMatchExactClassAndMethodCharacters[0] | 6.619 s |
|
shouldMatchExactClassAndMethodWildcard[0] | 7.505 s |
|
testSuccessTwo[0] | 7.309 s |
|
simpleNameTest[0] | 6.415 s |
|
simpleNameTestWithJavaExt[0] | 5.921 s |
|
regexClass[0] | 7.123 s |
|
shouldNotRunExcludedClasses[0] | 7.617 s |
|
shouldNotRunExcludedMethods[0] | 6.417 s |
|
simpleNameTestWithJavaExtWildcardPkg[0] | 8.960 s |
|
shouldMatchMultiplePatterns[0] | 7.498 s |
|
shouldMatchExactClassAndMethodsPostfix[0] | 6.311 s |
|
simpleNameTestWithWildcardPkg[0] | 6.330 s |
|
shouldMatchWildcardPackageAndClassAndMethod[0] | 5.899 s |
|
shouldMatchExactClassAndMultipleMethods[0] | 6.094 s |
|
fullyQualifiedTest[0] | 6.135 s |
|
matchSimpleClassAndMethodWithJavaExtWildcardPkg[0] | 6.610 s |
|
negativeTest[0] | 0 s |
| - | skipped | - |
|
testRegexSuccessTwo[0] | 6.672 s |
|
shouldMatchExactClassAndMethodsWildcard[0] | 6.129 s |
|
shouldMatchMultiplePatternsComplex[0] | 6.033 s |
|
simpleNameTestAsParallel[0] | 6.267 s |
|
matchSimpleClassAndMethodWithWildcardPkg[0] | 6.386 s |
|
shouldMatchMultiplePatternsAsParallel[0] | 6.254 s |
|
shouldNotRunExcludedClassesIfIncluded[0] | 5.688 s |
|
shouldMatchSimpleClassNameAndMethod[0] | 6.080 s |
|
shouldMatchExactClassAndMethodPostfix[0] | 7.584 s |
|
shouldMatchMultiplePatternsComplexAsParallel[0] | 6.306 s |
|
matchSimpleClassAndMethodWithJavaExt[0] | 6.121 s |
|
regexClassAndMethod[0] | 6.402 s |
|
shouldNotRunExcludedClassesAndMethods[1] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodCharacters[1] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodWildcard[1] | 0 s |
| - | skipped | - |
|
testSuccessTwo[1] | 0 s |
| - | skipped | - |
|
simpleNameTest[1] | 6.724 s |
|
simpleNameTestWithJavaExt[1] | 7.055 s |
|
regexClass[1] | 7.092 s |
|
shouldNotRunExcludedClasses[1] | 7.535 s |
|
shouldNotRunExcludedMethods[1] | 0 s |
| - | skipped | - |
|
simpleNameTestWithJavaExtWildcardPkg[1] | 6.687 s |
|
shouldMatchMultiplePatterns[1] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodsPostfix[1] | 0 s |
| - | skipped | - |
|
simpleNameTestWithWildcardPkg[1] | 11.87 s |
|
shouldMatchWildcardPackageAndClassAndMethod[1] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMultipleMethods[1] | 0 s |
| - | skipped | - |
|
fullyQualifiedTest[1] | 4.732 s |
|
matchSimpleClassAndMethodWithJavaExtWildcardPkg[1] | 0 s |
| - | skipped | - |
|
negativeTest[1] | 4.185 s |
|
testRegexSuccessTwo[1] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodsWildcard[1] | 0 s |
| - | skipped | - |
|
shouldMatchMultiplePatternsComplex[1] | 0 s |
| - | skipped | - |
|
simpleNameTestAsParallel[1] | 3.314 s |
|
matchSimpleClassAndMethodWithWildcardPkg[1] | 0 s |
| - | skipped | - |
|
shouldMatchMultiplePatternsAsParallel[1] | 0 s |
| - | skipped | - |
|
shouldNotRunExcludedClassesIfIncluded[1] | 3.668 s |
|
shouldMatchSimpleClassNameAndMethod[1] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodPostfix[1] | 0 s |
| - | skipped | - |
|
shouldMatchMultiplePatternsComplexAsParallel[1] | 0 s |
| - | skipped | - |
|
matchSimpleClassAndMethodWithJavaExt[1] | 0 s |
| - | skipped | - |
|
regexClassAndMethod[1] | 0 s |
| - | skipped | - |
|
shouldNotRunExcludedClassesAndMethods[2] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodCharacters[2] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodWildcard[2] | 0 s |
| - | skipped | - |
|
testSuccessTwo[2] | 0 s |
| - | skipped | - |
|
simpleNameTest[2] | 3.127 s |
|
simpleNameTestWithJavaExt[2] | 2.714 s |
|
regexClass[2] | 2.872 s |
|
shouldNotRunExcludedClasses[2] | 2.236 s |
|
shouldNotRunExcludedMethods[2] | 0 s |
| - | skipped | - |
|
simpleNameTestWithJavaExtWildcardPkg[2] | 2.368 s |
|
shouldMatchMultiplePatterns[2] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodsPostfix[2] | 0 s |
| - | skipped | - |
|
simpleNameTestWithWildcardPkg[2] | 2.685 s |
|
shouldMatchWildcardPackageAndClassAndMethod[2] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMultipleMethods[2] | 0 s |
| - | skipped | - |
|
fullyQualifiedTest[2] | 2.516 s |
|
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2] | 0 s |
| - | skipped | - |
|
negativeTest[2] | 2.085 s |
|
testRegexSuccessTwo[2] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodsWildcard[2] | 0 s |
| - | skipped | - |
|
shouldMatchMultiplePatternsComplex[2] | 0 s |
| - | skipped | - |
|
simpleNameTestAsParallel[2] | 2.422 s |
|
matchSimpleClassAndMethodWithWildcardPkg[2] | 0 s |
| - | skipped | - |
|
shouldMatchMultiplePatternsAsParallel[2] | 0 s |
| - | skipped | - |
|
shouldNotRunExcludedClassesIfIncluded[2] | 2.475 s |
|
shouldMatchSimpleClassNameAndMethod[2] | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodPostfix[2] | 0 s |
| - | skipped | - |
|
shouldMatchMultiplePatternsComplexAsParallel[2] | 0 s |
| - | skipped | - |
|
matchSimpleClassAndMethodWithJavaExt[2] | 0 s |
| - | skipped | - |
|
regexClassAndMethod[2] | 0 s |
| - | skipped | - |
Surefire772BothReportsIT
|
testSkippedSurefireReportGeneration | 6.351 s |
|
testSkippedFailsafeReportGeneration | 6.039 s |
|
testReportGeneration | 6.515 s |
TestMultipleMethodsIT
|
testJunit48Provider4 | 6.504 s |
|
testJunit44 | 5.866 s |
|
testJunit48Provider47 | 6.711 s |
Surefire1426JvmCrashShouldNotBeIgnoredIT
|
mavenShouldFail | 5.294 s |
Surefire2298IT
|
shouldNotCreateFilesForNested | 6.971 s |
CheckTestNgListenerReporterIT
|
testNgListenerReporter[0: TestNG 5.6] | 6.847 s |
|
testNgListenerReporter[1: TestNG 5.7] | 7.377 s |
|
testNgListenerReporter[2: TestNG 5.10] | 6.780 s |
|
testNgListenerReporter[3: TestNG 5.13] | 0 s |
| - | skipped | - |
|
testNgListenerReporter[4: TestNG 5.14.6] | 6.373 s |
|
testNgListenerReporter[5: TestNG 5.14.9] | 10.35 s |
|
testNgListenerReporter[6: TestNG 6.0] | 6.211 s |
|
testNgListenerReporter[7: TestNG 6.14.3] | 6.358 s |
|
testNgListenerReporter[8: TestNG 7.0.0] | 5.727 s |
Surefire1144XmlRunTimeIT
|
testXmlRunTime | 7.093 s |
EnvironmentVariableIT
|
environmentVariable | 7.271 s |
Surefire1993JpmsProvidingModulesIT
|
verify | 8.868 s |
SystemPropertiesTestIT
|
testSystemProperties | 5.894 s |
|
testSystemPropertiesNoFork | 6.207 s |
Surefire1179IT
|
suiteXmlForkCountTwoReuse | 11.20 s |
Surefire920TestFailureIgnoreWithTimeoutIT
|
timeoutInForkWithBuildFail | 18.55 s |
|
timeoutInForkWithNoBuildFail | 11.10 s |
Surefire1080ParallelForkDoubleTestIT
|
test | 5.684 s |
SmartStackTraceIT
|
misg | 6.355 s |
CheckTestNgGroupThreadParallelIT
|
testNgGroupThreadParallel | 6.634 s |
Surefire1185DoNotSpawnTestsIT
|
doNotSpawnUnwantedTests | 5.546 s |
Surefire1364SystemPropertiesIT
Surefire1367AssumptionLogsIT
|
shouldSeeLogsInPlugin | 5.154 s |
|
shouldSeeLogsParallelInPlugin | 5.911 s |
|
shouldSeeLogsParallelForked | 5.369 s |
|
shouldSeeLogsForked | 6.243 s |
AbstractTestCaseIT
|
abstractTestCase | 6.334 s |
JUnit44HamcrestIT
|
testJUnit44Hamcrest | 6.464 s |
Surefire1055CorrectConcurrentTestCountIT
|
testTestNgAndJUnitTogether | 6.121 s |
Surefire1585IT
|
shouldRunWithJupiterApi | 6.570 s |
|
shouldRunWithVintage | 6.006 s |
Surefire2006ShadefireTransformersIT
|
shadefireShouldBeUsed | 10.10 s |
TimeoutForkedTestIT
|
testTimeoutForked | 15.50 s |
Surefire1643IT
|
shouldNotMixResults | 29.23 s |
ForkCountTestNGIT
SiblingAggregatorIT
|
testSiblingAggregator | 6.773 s |
Surefire1122ParallelAndFlakyTestsIT
|
parallelCreatesCorrectReportFork | 5.748 s |
|
nonParallelCreatesCorrectReport | 5.613 s |
|
parallelCreatesCorrectReport | 5.128 s |
Surefire1053SystemPropertiesIT
|
checkWarningsSysPropTwice | 5.958 s |
|
checkWarningsFileEncoding | 5.711 s |
JUnitPlatformIT
CheckTestNgCustomTestRunnerFactoryIT
|
testTestNgListenerReporter | 7.267 s |
Surefire141PluggableProvidersIT
|
pluggableProviderPresent | 5.688 s |
|
invokeRuntimeException | 6.090 s |
|
invokeReporterException | 6.319 s |
|
constructorRuntimeException | 6.161 s |
ArchUnitIT
|
simpleCucumberUsage | 8.155 s |
CheckTestNgBeforeMethodIT
|
testNgBeforeMethod | 7.289 s |
PlainOldJavaClasspathIT
|
testPlainOldJavaClasspath | 5.796 s |
ClasspathScopeFilteringIT
|
additionalClasspath | 6.815 s |
Surefire1787JUnit5IT
Surefire1152RerunFailingTestsInSuiteIT
|
testJUnit48Provider47 | 7.500 s |
|
testJUnit48Provider4 | 7.903 s |
LongWindowsPathIT
|
shouldRunInSystemTmp | 0 s |
| - | skipped | - |
Surefire817SystemExitIT
|
systemExit1 | 6.832 s |
XmlReporterRunTimeIT
|
testForkAlways | 26.00 s |
WorkingDirectoryIsInvalidPropertyIT
|
testWorkingDirectory | 5.204 s |
Surefire847AdditionalFailureIT
|
testJUnitRunCategoryAB | 7.206 s |
MultiModuleProjectWithJPMSIT
|
test | 9.734 s |
AggregateReportIT
|
aggregateReport | 9.437 s |
ForkCountMultiModuleIT
|
testForkCountOneNoReuse | 10.56 s |
|
testForkCountTwoNoReuse | 8.211 s |
|
testForkCountTwoReuse | 7.756 s |
|
testForkCountOneReuse | 8.800 s |
PojoSimpleIT
|
twoTestsWithFixtures | 5.069 s |
Surefire673MockitoIT
|
testBuildFailingWhenErrors | 7.370 s |
CrashDetectionIT
|
hardCrashInReusableFork | 7.310 s |
|
crashInReusableFork | 6.840 s |
|
crashInFork | 6.236 s |
ForkConsoleOutputWithErrorsIT
|
xmlFileContainsConsoleOutput | 6.591 s |
Surefire1098BalancedRunOrderIT
|
reorderedParallelClasses | 11.92 s |
Surefire1082ParallelJUnitParameterizedIT
|
checkClassesRunParallel | 6.859 s |
|
shouldRunTwo | 7.889 s |
|
checkOutFileClassesRunParallel | 6.678 s |
Surefire772SpecifiedReportsIT
|
testSkippedSurefireReportGeneration | 5.917 s |
|
testSkippedFailsafeReportGeneration | 7.494 s |
|
testReportGeneration | 6.402 s |
Surefire772NoSurefireReportsIT
|
testOptionalSurefireReportGeneration | 5.706 s |
|
testSkippedSurefireReportGeneration | 6.371 s |
|
testSkipOptionalSurefireReportGeneration | 5.840 s |
|
testReportGeneration | 6.388 s |
Surefire1570ModularFailsafeIT
|
shouldRunWithJupiterApi | 10.89 s |
JUnit47RerunFailingTestWithCucumberIT
Surefire901MIssingResultfileWhenNoTestsIT
|
failsafeWithNoTests | 6.527 s |
Surefire1028UnableToRunSingleIT
|
methodFilteringParallelExecution | 5.310 s |
Surefire1602IT
|
nonCanonicalPath | 13.16 s |
Surefire1914XmlReportingParameterizedTestIT
|
testXmlReport[5.8.2] | 6.871 s |
|
testXmlReport[5.9.1] | 7.248 s |
|
testXmlReport[5.13.4] | 8.088 s |
JUnitPlatformStreamCorruptionIT
|
warningIsNotEmitted | 5.802 s |
|
warningIsNotEmittedWithJulToLog4j | 0 s |
| - | https://issues.apache.org/jira/browse/SUREFIRE-1659?focusedCommentId=17374005&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-17374005 | - |
|
warningIsNotEmittedWithJulToSlf4j | 6.562 s |
Surefire985ParameterizedRunnerAndCategoriesIT
|
test | 5.616 s |
JUnit4RunListenerIT
|
testJUnit4RunListener | 7.528 s |
|
testRunlistenerJunitCoreProvider | 6.506 s |
ClasspathFilteringIT
|
additionalClasspath | 8.241 s |
CheckTestNgSuiteXmlSingleIT
|
testNgSuite | 8.425 s |
Surefire2190JUnitIT
|
test | 15.40 s |
CheckSingleTestIT
|
singleTestDotJava | 6.707 s |
|
singleTestNonExistentOverride | 6.662 s |
|
singleTestNonExistent | 7.405 s |
|
singleTest | 7.226 s |
Surefire1295AttributeJvmCrashesToTestsIT
|
test[0] | 8.143 s |
|
test[1] | 11.17 s |
|
test[2] | 8.387 s |
|
test[3] | 8.497 s |
|
test[4] | 11.34 s |
|
test[5] | 8.367 s |
|
test[6] | 9.459 s |
|
test[7] | 11.52 s |
|
test[8] | 9.525 s |
CheckTestNgExecuteErrorIT
|
executionError | 6.930 s |
Surefire1158RemoveInfoLinesIT
Surefire812Log4JClassLoaderIT
|
testJunit3ParallelBuildResultCount | 6.744 s |
EnvironmentVariablesIT
|
testWhenUseSystemClassLoader | 7.007 s |
|
testExcludedEnv | 6.307 s |
|
testWhenDontUseSystemClassLoader | 6.533 s |
DefaultConfigurationIT
|
defaultConfiguration | 7.080 s |
Surefire1264IT
|
positiveTests | 11.53 s |
|
negativeTests | 7.965 s |
Surefire2143ParameterizedSkippedIT
|
junit4ParameterizedSkipped | 7.463 s |
|
junit5ParameterizedSkipped | 7.144 s |
Surefire926FailureWith2ProvidersIT
|
testBuildFailingWhenErrors | 7.648 s |
CucumberIT
|
simpleCucumberUsage | 9.386 s |
Surefire2065IT
|
shouldNotDetectFlakyTestsWhenRunningOnlyJunit4 | 6.558 s |
|
shouldNotDetectFlakyTestsWhenRunningOnlyJunit5 | 6.932 s |
|
shouldNotDetectFlakyTestsWhenCombiningJunit4And5Tests | 7.169 s |
Surefire1136CwdPropagationInForkedModeIT
|
testTestNgAndJUnitTogether | 5.779 s |
JUnit47StaticInnerClassTestsIT
|
testStaticInnerClassTests | 5.799 s |
JUnit48TestCategoriesIT
CheckTestFailIfNoTestsForkCountIT
|
dontFailIfNoTestsForkAlways | 6.494 s |
|
failIfNoTestsForkNever | 6.125 s |
|
failIfNoTestsForkAlways | 6.931 s |
|
failIfNoTestsForkOnce | 6.417 s |
|
dontFailIfNoTestsForkNever | 5.765 s |
|
dontFailIfNoTestsForkOnce | 6.336 s |
NoRunnableTestsInClassIT
|
testJunit3ParallelBuildResultCount | 5.793 s |
Surefire747MethodParallelWithSuiteCountIT
|
testMethodsParallelWithSuite | 10.90 s |
|
testClassesParallelWithSuite | 13.46 s |
TestMethodPatternIT
Surefire1278GroupNameEndingIT
|
testOnlyGroups | 6.030 s |
JUnit47RedirectOutputIT
|
testClassesParallel | 9.637 s |
|
testPrintSummaryTrueWithRedirect | 5.307 s |
Surefire975DefaultVMEncodingIT
|
runWithRussian1251 | 5.851 s |
JUnit4IgnoreIT
|
testJunit4Ignore | 5.471 s |
|
testJunit47ParallelIgnore | 5.635 s |
JUnitPlatformEnginesIT
Surefire828EmptyGroupExprIT
|
testJUnitRunEmptyExcludeGroups | 6.512 s |
|
testJUnitRunEmptyGroups | 6.816 s |
|
testTestNGRunEmptyExcludeGroups | 5.956 s |
|
testTestNGRunEmptyGroups | 4.617 s |
Surefire569RunTestFromDependencyJarsIT
|
shouldScanAndRunTestsInDependencyJars | 13.72 s |
Surefire1881IT
|
test | 8.578 s |
TestSingleMethodIT
Surefire2095FailsafeJvmCrashShouldNotBeIgnoredIT
|
mavenShouldFail | 7.316 s |
Surefire1095NpeInRunListenerIT
|
testRunStartedWithJUnit40 | 5.680 s |
|
testRunStartedWithJUnit45 | 9.843 s |
|
testRunStartedWithJUnit47 | 5.931 s |
CheckTestNgSuiteXmlIT
|
suiteXmlForkAlways | 8.343 s |
|
suiteXml | 7.501 s |
|
suiteXmlForkCountTwoReuse | 6.742 s |
Surefire803MultiFailsafeExecsIT
|
testOneExecutionRunInTwoBuilds | 15.24 s |
|
testSecondExecutionRunsAfterFirstExecutionFails | 9.471 s |
Surefire772NoFailsafeReportsIT
|
testSkippedFailsafeReportGeneration | 5.929 s |
|
testForcedFailsafeReportGeneration | 6.406 s |
|
testSkipForcedFailsafeReportGeneration | 6.139 s |
|
testReportGeneration | 5.546 s |
Surefire570MultipleReportDirectoriesIT
|
testReportWithAggregate | 15.67 s |
|
testReportWithoutAggregate | 16.95 s |
Surefire1146RerunFailedAndParameterizedIT
|
testsAreRerun | 5.671 s |
ResultCountingIT
|
testCountingWithJunit481ForkAlways | 9.325 s |
|
testCountingWithJunit481ForkOnce | 5.938 s |
|
testCountingWithJunit481ForkNever | 6.212 s |
Surefire809GroupExpressionsIT
|
testNGRunCategoryAB | 7.492 s |
|
testExcludedGroups | 6.564 s |
|
testJUnitRunCategoryNotC | 6.828 s |
|
incorrectJUnitVersions | 5.211 s |
|
categoryAB | 4.699 s |
|
testNGRunCategoryNotC | 4.812 s |
AdditionalClasspathIT
|
additionalClasspathElements | 6.479 s |
|
additionalClasspathDependencies | 7.779 s |
IncludesExcludesFromFileIT
|
testSimpleMixed | 6.156 s |
|
testMissingExcludes | 5.711 s |
|
testRegex | 6.345 s |
|
testPath | 5.118 s |
|
testMissingIncludes | 4.930 s |
|
testSimple | 5.171 s |
CheckTestNgBeforeMethodFailureIT
|
testNgBeforeMethodFailure | 7.214 s |
Surefire2117XmlReportingNestedIT
|
testXmlReport[5.8.2] | 7.844 s |
|
testXmlReport[5.9.1] | 8.077 s |
|
testXmlReport[5.13.4] | 7.112 s |
ClassPathOrderIT
|
classPathOrder | 7.231 s |
Surefire42NotExtendingTestCaseIT
|
testInnerClass | 5.584 s |
ArgLinePropertiesIT
|
argLine | 6.542 s |
Surefire995CategoryInheritanceIT
Surefire818NpeIgnoresTestsIT
|
testBuildFailingWhenErrors | 6.629 s |
JUnitPlatformRerunFailingTestsIT
Surefire2036IT
|
selectJUnit5UsingConfiguredProviderWithPlatformRunner | 6.961 s |
Surefire705ParallelForkTimeoutIT
|
testTimeoutForked | 9.581 s |
Surefire1024VerifyFailsafeIfTestedIT
|
shouldScanAndRunTestsInDependencyJars | 6.324 s |
Surefire733AllOverrridesCapturedIT
|
testLogOutput | 6.431 s |
Surefire628ConsoleOutputBeforeAndAfterClassIT
|
testJunit3ParallelBuildResultCount | 6.216 s |
Surefire2032NestedSkippedIT
|
testXmlReport | 6.543 s |
ForkConsoleOutputIT
|
printSummaryTrueWithRedirect | 6.177 s |
|
printSummaryFalseWithoutRedirect | 10.81 s |
|
printSummaryTrueWithoutRedirect | 9.300 s |
|
printSummaryFalseWithRedirect | 5.233 s |
Surefire634UnsettableSystemPropertiesWarningIT
|
testJunit3ParallelBuildResultCount | 5.981 s |
ModulePathIT
|
testModulePathWithSpaces | 7.390 s |
|
testModulePath | 7.430 s |
WorkingDirectoryIT
|
testWorkingDirectory | 6.075 s |
|
testWorkingDirectoryChildOnlyNoFork | 5.145 s |
|
testWorkingDirectoryNoFork | 4.883 s |
|
testWorkingDirectoryChildOnly | 10.33 s |
Surefire162CharsetProviderIT
|
testCharsetProvider | 6.389 s |
TestNgParallelWithAnnotationsIT
|
testTestNgGroupThreadParallel | 13.25 s |
FailFastTestNgIT
JUnit47ParallelIT
Surefire146ForkPerTestNoSetupIT
|
testForkPerTestNoSetup | 5.180 s |
Surefire44InnerClassTestIT
|
testInnerClass | 5.824 s |
Surefire979WrongClassLoaderIT
|
wrongClassloaderUSedInSmartStacktraceparser | 5.687 s |
Surefire621TestCountingJunit3InParallelIT
Surefire1535TestNGParallelSuitesIT
|
forks0 | 7.427 s |
|
forks2 | 7.604 s |
|
forks0Redirected | 7.757 s |
|
forks2Redirected | 7.183 s |
Surefire1135ImproveIgnoreMessageForTestNGIT
|
testNgReport57 | 7.408 s |
|
testNgReport688 | 7.468 s |
RunOrderIT
Surefire649EmptyStringSystemPropertiesIT
|
systemPropertyVariables | 5.994 s |
|
systemProperties | 7.763 s |
RunOrderParallelForksIT
ConsoleOutputIT
TwoTestCasesIT
|
testJunit4Suite | 5.354 s |
|
testTestNGSuite | 6.897 s |
|
testTwoTestCases | 6.530 s |
|
testTwoTestCaseSuite | 6.485 s |
Surefire735ForkFailWithRedirectConsoleOutputIT
|
vmStartFail | 5.838 s |
|
vmStartFailShouldFailBuildk | 6.305 s |
Surefire500PuzzlingErrorIT
|
testBuildFailingWhenErrors | 6.406 s |
Surefire1733JUnitIT
|
test | 8.584 s |
Surefire1744AlwaysIncludeOutputLogsIT
|
testAlwaysIncludeOutputLogs | 5.844 s |
Surefire1934OutErrElementsIT
|
testOutErrElementsDisabled | 8.449 s |
|
testOutErrElementsEnabled | 5.510 s |
Surefire1360PropertiesElementIT
|
testPropertiesElementEnabled | 5.189 s |
|
testPropertiesElementDisabled | 6.954 s |
Surefire377TestNgAndJUnitTogetherIT
|
testTestNgAndJUnit4Together | 6.670 s |
|
testTestNgAndJUnitTogether | 7.101 s |
FailFastJUnitIT
Surefire1265Java9IT
|
shouldRunInPluginJava9 | 6.418 s |
JUnit47ParallelNotThreadSafeIT
|
test | 5.659 s |
UnicodeTestNamesIT
|
checkFileNamesWithUnicode | 11.16 s |
Surefire697NiceSummaryIT
|
testBuildFailingWhenErrors | 6.579 s |
Surefire408ManualProviderSelectionIT
|
testParallelBuildResultCount | 5.803 s |
WorkingDirectoryMissingIT
|
testWorkingDirectory | 5.760 s |
Surefire930TestNgSuiteXmlIT
|
suiteXmlRun | 7.700 s |
Surefire1534ReuseForksFalseWithJavaModuleIT
|
testExecuteWithReuseForksFalseWithJavaModule | 6.819 s |
|
testExecuteWithReuseForksFalseWithJavaModuleWithFilter | 7.352 s |
|
testExecuteWithZeroForkCountWithJavaModule | 6.379 s |
ForkCountIT
Surefire946KillMainProcessInReusableForkIT
|
test[halt-exit] | 28.20 s |
|
test[halt-kill] | 25.24 s |
|
test[exit-exit] | 24.52 s |
|
test[exit-kill] | 24.62 s |
|
test[interrupt-exit] | 23.75 s |
|
test[interrupt-kill] | 23.11 s |
CheckTestNgListenersIT
|
testNgListenerReporter | 6.448 s |
Surefire806SpecifiedTestControlsIT
|
singleTestInSingleExecutionProject | 6.914 s |
|
twoSpecifiedTestExecutionsInCorrectExecutionBlocks | 0 s |
| - | since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution | - |
|
singleTestInOneExecutionOfMultiExecutionProject | 0 s |
| - | since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution | - |
Surefire1209RerunAndForkCountIT
|
notReusableForksJUnit47 | 13.72 s |
|
reusableForksJUnit47 | 13.93 s |
|
reusableForksJUnit4 | 13.06 s |
|
notReusableForksJUnit4 | 13.67 s |
Surefire1733TestngIT
|
test | 9.285 s |
Junit5ModulePathIT
|
testModulePathWithSpaces | 7.967 s |
|
testModulePath | 7.357 s |
Surefire1041FailingJUnitRunnerIT
|
reportErrorInJUnitRunnerAsTestError | 6.675 s |
Surefire674BuildFailingWhenFailsafeErrorsIT
|
testBuildFailingWhenErrors | 7.778 s |
Surefire376TestNgAfterSuiteFailureIT
|
testAfterSuiteFailure | 6.420 s |
Surefire1737IT
|
selectJUnit5UsingConfiguredProviderWithPlatformRunner | 3.714 s |
Surefire510TestClassPathForkModesIT
|
testForkOnce | 5.847 s |
|
testForkAlways | 5.957 s |
CheckTestNgPathWithSpacesIT
|
testWithSpaces | 15.36 s |
CheckTestNgJdk14IT
|
testNgJdk14 | 7.019 s |
ReportersIT
|
testRedirectOutputTestNg | 6.062 s |
JUnit4VersionsIT
Surefire1004RunTestFromDependencyJarsTypeAndClassifierIT
|
shouldScanAndRunTestsInDependencyJars | 6.443 s |
Surefire1490ReportTitleDescriptionIT
|
shouldHaveCustomizedReportTitleAndDescription | 12.87 s |
|
shouldHaveDefaultReportTitleAndDescription | 13.84 s |
Surefire674BuildFailingWhenErrorsIT
|
testBuildFailingWhenErrors | 6.004 s |
JUnit4RerunFailingTestsIT
|
testRerunFailingErrorTestsFalse | 23.54 s |
|
testRerunFailingErrorTestsWithOneRetry | 28.16 s |
|
testRerunFailingErrorTestsTwoRetry | 25.55 s |
|
testRerunOneTestMethod | 25.45 s |
|
testRerunOneTestClass | 24.61 s |
Surefire685CommaSeparatedIncludesIT
|
testBuildFailingWhenErrors | 6.515 s |
Surefire855AllowFailsafeUseArtifactFileIT
|
jarNotForkingShouldUseFile | 10.44 s |
|
jarShouldUseFile | 8.380 s |
|
warShouldUseClasses | 6.387 s |
|
osgiBundleShouldUseFile | 6.115 s |
FailFastJUnitPlatformIT
|
test[oneFork-ff1] | 10.65 s |
|
test[oneFork-ff2] | 10.49 s |
|
test[twoForks-ff1] | 10.13 s |
|
test[twoForks-ff2] | 10.12 s |
|
test[oneFork-ff3] | 11.98 s |
|
test[twoForks-ff3] | 10.20 s |
|
test[unsupported-version] | 10.57 s |
AssumptionFailureReportIT
|
testWriteSkippedMessageToReport | 6.878 s |
Surefire943ReportContentIT
|
test_noParallel | 12.07 s |
|
test_parallelBoth | 5.461 s |
CheckTestNg740ParallelIT
|
withTestNG740AndParallelSetWithoutThreadCount | 8.001 s |
|
withTestNG740AndParallelSet | 8.013 s |
JUnit4ForkAlwaysStaticInitPollutionIT
|
testJunit4Ignore | 5.655 s |
Java9FullApiIT
|
shouldLoadMultipleJavaModules_JavaHome | 9.106 s |
|
shouldLoadMultipleJavaModules_ToolchainsXML | 8.561 s |
|
shouldLoadMultipleJavaModules_JvmParameter | 8.398 s |
UmlautDirIT
|
surefire1617WithColonInLocalRepo | 15.51 s |
|
surefire1617WithColonInProjectDir | 5.670 s |
|
testUmlautIsolatedClassLoader | 5.387 s |
|
testUmlaut | 6.002 s |
CheckTestNgVersionsIT
|
test751 | 8.176 s |
|
test69136 | 8.478 s |
|
test6143 | 7.779 s |
|
test6821 | 7.612 s |
Surefire1396CustomProviderClassPathIT
|
pluggableProviderClasspathCorrect | 6.448 s |
Surefire1211JUnitTestNgIT
|
withoutJUnit | 6.092 s |
|
withJUnit | 6.200 s |
ArgLineIT
|
argLine | 6.202 s |
PlexusConflictIT
|
testPlexusConflict | 10.83 s |
|
testPlexusConflictIsolatedClassLoader | 5.341 s |
JUnitDepIT
|
testJUnit44DepWithSneaky381 | 5.895 s |
|
testJUnit44Dep | 6.009 s |
|
testJUnit47Dep | 9.351 s |
|
testJUnit48Dep | 10.25 s |
Surefire1383ScanSessionDependenciesIT
|
test | 6.410 s |
Surefire972BizarreNoClassDefIT
|
testJunit3ParallelBuildResultCount | 6.863 s |
Surefire1177TestngParallelSuitesIT
|
twoSuitesInParallelForked | 8.454 s |
|
twoSuitesInParallel | 8.115 s |
Surefire839TestWithoutCategoriesIT
|
classWithoutCategoryForked | 6.791 s |
|
classWithoutCategory | 6.124 s |
CheckTestNgReportTestIT
|
testNgReport | 9.477 s |
|
shouldNotBeVerbose | 7.984 s |
|
shouldBeVerbose | 7.572 s |
Surefire1153IncludesAndSpecifiedTestIT
|
testSpecifiedTestInIncludes | 9.736 s |
|
testSpecifiedTestNotInIncludes | 5.886 s |
Surefire1202RerunAndSkipIT
|
junit47 | 18.22 s |
|
junit4 | 18.78 s |
TestNgGroupsIT
|
testExclusion | 6.156 s |
|
testGroupsAndExclusion | 6.803 s |
|
groupsWithDash | 6.670 s |
|
testOnlyGroups | 6.608 s |
|
groupsBySimpleRegex | 6.421 s |
Surefire257NotRerunningTestsIT
|
shouldNotRerun | 8.664 s |
Surefire34SecurityManagerIT
|
testSecurityManager | 0 s |
| - | skipped | - |
|
shouldFailOnJDK | 6.164 s |
|
testSecurityManagerSuccessful | 0 s |
| - | skipped | - |
Failure Details
[Summary] [Package List] [Test Cases]