Failsafe Report
Summary
[Summary] [Package List] [Test Cases]
| Tests | Errors | Failures | Skipped | Success Rate | Time |
|---|---|---|---|---|---|
| 745 | 0 | 0 | 153 | 79.5% | 5024 s |
Note: failures are anticipated and checked for with assertions while errors are unanticipated.
Package List
[Summary] [Package List] [Test Cases]
| Package | Tests | Errors | Failures | Skipped | Success Rate | Time |
|---|---|---|---|---|---|---|
| org.apache.maven.surefire.its | 545 | 0 | 0 | 148 | 72.8% | 3615 s |
| org.apache.maven.surefire.its.jiras | 200 | 0 | 0 | 5 | 97.5% | 1409 s |
Note: package statistics are not computed recursively, they only sum up all of its testsuites numbers.
org.apache.maven.surefire.its
| - | Class | Tests | Errors | Failures | Skipped | Success Rate | Time |
|---|---|---|---|---|---|---|---|
 |
CheckTestNgCustomObjectFactoryIT | 1 | 0 | 0 | 1 | 0% | 0.052 s |
 |
IncludesExcludesIT | 3 | 0 | 0 | 0 | 100% | 11.65 s |
|
CheckTestFailIfNoTestsIT | 2 | 0 | 0 | 0 | 100% | 14.00 s |
|
TestNgSuccessPercentageIT | 1 | 0 | 0 | 1 | 0% | 0 s |
|
UseIsolatedClassLoaderIT | 1 | 0 | 0 | 0 | 100% | 2.743 s |
|
TestMultipleMethodPatternsIT | 30 | 0 | 0 | 20 | 33.3% | 124.6 s |
|
TestMultipleMethodPatternsTestNGIT | 30 | 0 | 0 | 3 | 90.0% | 83.60 s |
|
JUnit4PlatformFailingBeforeAllRerunIT | 1 | 0 | 0 | 0 | 100% | 4.641 s |
|
TestMultipleMethodPatternsTestNGIncludesExcludesIT | 30 | 0 | 0 | 20 | 33.3% | 131.1 s |
|
TestMultipleMethodsIT | 1 | 0 | 0 | 0 | 100% | 2.532 s |
|
JUnit447RedirectOutputIT | 2 | 0 | 0 | 0 | 100% | 7.257 s |
|
FailFastJUnit4IT | 7 | 0 | 0 | 0 | 100% | 172.9 s |
|
CheckTestNgListenerReporterIT | 2 | 0 | 0 | 0 | 100% | 26.90 s |
|
EnvironmentVariableIT | 1 | 0 | 0 | 0 | 100% | 5.478 s |
|
JUnit447WithCucumberIT | 2 | 0 | 0 | 0 | 100% | 7.180 s |
|
SystemPropertiesTestIT | 2 | 0 | 0 | 0 | 100% | 5.869 s |
|
JUnit4PlatformRerunFailingTestsIT | 7 | 0 | 0 | 0 | 100% | 83.23 s |
|
JUnit447ConcurrencyIT | 1 | 0 | 0 | 0 | 100% | 4.804 s |
|
JUnit447RerunFailingTestWithCucumberIT | 6 | 0 | 0 | 0 | 100% | 32.50 s |
|
SmartStackTraceIT | 1 | 0 | 0 | 0 | 100% | 3.179 s |
|
CheckTestNgGroupThreadParallelIT | 1 | 0 | 0 | 0 | 100% | 15.41 s |
|
ArchUnit4IT | 1 | 0 | 0 | 0 | 100% | 22.59 s |
|
AbstractTestCaseIT | 1 | 0 | 0 | 0 | 100% | 16.58 s |
|
TimeoutForkedTestIT | 1 | 0 | 0 | 0 | 100% | 3.678 s |
|
ForkCountTestNGIT | 8 | 0 | 0 | 0 | 100% | 153.3 s |
|
SiblingAggregatorIT | 1 | 0 | 0 | 0 | 100% | 4.407 s |
|
FailFastJUnit4PlatformIT | 6 | 0 | 0 | 0 | 100% | 53.03 s |
|
CheckTestNgBeforeMethodIT | 1 | 0 | 0 | 0 | 100% | 16.93 s |
|
PlainOldJavaClasspathIT | 1 | 0 | 0 | 0 | 100% | 3.892 s |
|
ClasspathScopeFilteringIT | 1 | 0 | 0 | 0 | 100% | 9.059 s |
|
LongWindowsPathIT | 1 | 0 | 0 | 1 | 0% | 0.090 s |
|
JUnit4UnsupportedVersionsIT | 2 | 0 | 0 | 0 | 100% | 2.838 s |
|
JUnit4PlatformStreamCorruptionIT | 3 | 0 | 0 | 1 | 66.7% | 7.424 s |
|
XmlReporterRunTimeIT | 2 | 0 | 0 | 0 | 100% | 38.26 s |
|
WorkingDirectoryIsInvalidPropertyIT | 1 | 0 | 0 | 0 | 100% | 0.799 s |
|
MultiModuleProjectWithJPMSIT | 1 | 0 | 0 | 0 | 100% | 12.00 s |
|
AggregateReportIT | 1 | 0 | 0 | 0 | 100% | 27.86 s |
|
ForkCountMultiModuleIT | 4 | 0 | 0 | 0 | 100% | 79.50 s |
|
CrashDetectionIT | 3 | 0 | 0 | 0 | 100% | 19.35 s |
|
ForkConsoleOutputWithErrorsIT | 1 | 0 | 0 | 0 | 100% | 15.91 s |
|
TestMultipleMethodPatternsTestNGIncludesIT | 30 | 0 | 0 | 20 | 33.3% | 172.2 s |
|
Surefire1602IT | 1 | 0 | 0 | 0 | 100% | 7.930 s |
|
JUnit4RunListenerIT | 2 | 0 | 0 | 0 | 100% | 7.317 s |
|
ClasspathFilteringIT | 1 | 0 | 0 | 0 | 100% | 9.579 s |
|
CheckSingleTestIT | 4 | 0 | 0 | 0 | 100% | 31.34 s |
|
CheckTestNgExecuteErrorIT | 1 | 0 | 0 | 0 | 100% | 16.62 s |
|
EnvironmentVariablesIT | 3 | 0 | 0 | 0 | 100% | 44.99 s |
|
DefaultConfigurationIT | 1 | 0 | 0 | 0 | 100% | 6.986 s |
|
CucumberIT | 1 | 0 | 0 | 0 | 100% | 12.81 s |
|
JUnit448TestCategoriesIT | 8 | 0 | 0 | 0 | 100% | 82.46 s |
|
CheckTestFailIfNoTestsForkCountIT | 6 | 0 | 0 | 0 | 100% | 35.29 s |
|
NoRunnableTestsInClassIT | 1 | 0 | 0 | 0 | 100% | 3.689 s |
|
TestMethodPatternIT | 10 | 0 | 0 | 0 | 100% | 31.70 s |
|
JUnit4IgnoreIT | 2 | 0 | 0 | 0 | 100% | 7.175 s |
|
JUnit4PlatformEnginesIT | 73 | 0 | 0 | 0 | 100% | 257.9 s |
|
TestSingleMethodIT | 6 | 0 | 0 | 0 | 100% | 18.42 s |
|
JUnit447ParallelIT | 59 | 0 | 0 | 59 | 0% | 0.045 s |
|
IncludesExcludesJunit5IT | 3 | 0 | 0 | 0 | 100% | 11.94 s |
|
ResultCountingIT | 3 | 0 | 0 | 0 | 100% | 12.93 s |
|
AdditionalClasspathIT | 2 | 0 | 0 | 0 | 100% | 26.69 s |
|
IncludesExcludesFromFileIT | 6 | 0 | 0 | 0 | 100% | 18.68 s |
|
CheckTestNgBeforeMethodFailureIT | 1 | 0 | 0 | 0 | 100% | 16.98 s |
|
ClassPathOrderIT | 1 | 0 | 0 | 0 | 100% | 10.20 s |
|
ArgLinePropertiesIT | 1 | 0 | 0 | 0 | 100% | 17.44 s |
|
ForkConsoleOutputIT | 4 | 0 | 0 | 0 | 100% | 58.37 s |
|
ModulePathIT | 2 | 0 | 0 | 0 | 100% | 13.16 s |
|
WorkingDirectoryIT | 4 | 0 | 0 | 0 | 100% | 8.227 s |
|
TestNgParallelWithAnnotationsIT | 1 | 0 | 0 | 0 | 100% | 8.947 s |
|
FailFastTestNgIT | 4 | 0 | 0 | 0 | 100% | 120.1 s |
|
RunOrderIT | 10 | 0 | 0 | 0 | 100% | 50.88 s |
|
JUnit4PlatformIT | 15 | 0 | 0 | 0 | 100% | 63.43 s |
|
RunOrderParallelForksIT | 10 | 0 | 0 | 0 | 100% | 110.4 s |
|
ConsoleOutputIT | 8 | 0 | 0 | 0 | 100% | 343.7 s |
|
TwoTestCasesIT | 2 | 0 | 0 | 0 | 100% | 4.891 s |
|
IncludesExcludesFromFileJunit5IT | 6 | 0 | 0 | 0 | 100% | 21.59 s |
|
ReportTestTimestampIT | 2 | 0 | 0 | 0 | 100% | 7.501 s |
|
UnicodeTestNamesIT | 1 | 0 | 0 | 0 | 100% | 2.993 s |
|
TestMultipleMethodPatternsIncludesExcludesIT | 30 | 0 | 0 | 20 | 33.3% | 152.9 s |
|
WorkingDirectoryMissingIT | 1 | 0 | 0 | 0 | 100% | 2.844 s |
|
ForkCountIT | 8 | 0 | 0 | 0 | 100% | 183.3 s |
|
Junit5ModulePathIT | 2 | 0 | 0 | 0 | 100% | 12.31 s |
|
CheckTestNgPathWithSpacesIT | 1 | 0 | 0 | 0 | 100% | 9.923 s |
|
ReportersIT | 1 | 0 | 0 | 0 | 100% | 4.469 s |
|
JUnit4VersionsIT | 4 | 0 | 0 | 0 | 100% | 15.39 s |
|
JUnit4RerunFailingTestsIT | 5 | 0 | 0 | 0 | 100% | 73.06 s |
|
AssumptionFailureReportIT | 1 | 0 | 0 | 0 | 100% | 16.56 s |
|
CheckTestNg740ParallelIT | 2 | 0 | 0 | 0 | 100% | 30.47 s |
|
JUnit4ForkAlwaysStaticInitPollutionIT | 1 | 0 | 0 | 0 | 100% | 6.030 s |
|
Java9FullApiIT | 3 | 0 | 0 | 0 | 100% | 74.36 s |
|
UmlautDirIT | 4 | 0 | 0 | 0 | 100% | 39.73 s |
|
CheckTestNgVersionsIT | 4 | 0 | 0 | 2 | 50.0% | 8.920 s |
|
ArgLineIT | 1 | 0 | 0 | 0 | 100% | 15.75 s |
|
PlexusConflictIT | 2 | 0 | 0 | 0 | 100% | 7.518 s |
|
CheckTestNgReportTestIT | 3 | 0 | 0 | 0 | 100% | 45.56 s |
|
TestNgGroupsIT | 5 | 0 | 0 | 0 | 100% | 13.29 s |
org.apache.maven.surefire.its.jiras
Test Cases
[Summary] [Package List] [Test Cases]
Surefire224WellFormedXmlFailuresIT
|
testWellFormedXmlFailures | 4.175 s |
Surefire740TruncatedCommaIT
|
testRussianLocaleReport | 15.51 s |
CheckTestNgCustomObjectFactoryIT
|
testTestNgListenerReporter | 0 s |
| - | objectFactory not support by testng engine | - |
Surefire801ForkNeverClassLoaderIT
|
testShouldBeOkWithForkNever | 1.828 s |
Surefire260TestWithIdenticalNamesIT
|
testWithIdenticalNames | 14.73 s |
IncludesExcludesIT
|
testPathBasedIncludesExcludes | 4.699 s |
|
testIncludesExcludes | 3.797 s |
|
testRegexIncludesExcludes | 3.131 s |
CheckTestFailIfNoTestsIT
|
failIfNoTests | 10.12 s |
|
dontFailIfNoTests | 3.762 s |
Surefire832ProviderSelectionIT
|
testJUnitRunCategoryAB | 4.460 s |
TestNgSuccessPercentageIT
|
testPassesWhenFailuresLessThanSuccessPercentage | 0 s |
| - | FIXME percentage attribute looks to be sypported but is failing in this case | - |
UseIsolatedClassLoaderIT
|
testUseSystemClassLoader | 2.741 s |
TestMultipleMethodPatternsIT
Surefire1712ExtractedModulenameWithoutASMIT
|
test | 3.851 s |
Surefire1964IT
|
shouldFilterTests | 3.821 s |
|
shouldFilterTestsInPluginProcess | 2.234 s |
Surefire613TestCountInParallelIT
|
testParallelBuildResultCount | 5.448 s |
Surefire1967CheckTestNgMethodParallelOrderingIT
|
testNgParallelOrdering | 4.396 s |
SpockIT
|
test | 0 s |
| - | skipped | - |
TestMultipleMethodPatternsTestNGIT
|
shouldNotRunExcludedClassesAndMethods | 4.214 s |
|
shouldMatchExactClassAndMethodCharacters | 3.357 s |
|
shouldMatchExactClassAndMethodWildcard | 3.549 s |
|
testSuccessTwo | 3.003 s |
|
simpleNameTest | 2.717 s |
|
simpleNameTestWithJavaExt | 2.589 s |
|
regexClass | 2.523 s |
|
shouldNotRunExcludedClasses | 2.863 s |
|
shouldNotRunExcludedMethods | 2.846 s |
|
simpleNameTestWithJavaExtWildcardPkg | 2.570 s |
|
shouldMatchMultiplePatterns | 2.583 s |
|
shouldMatchExactClassAndMethodsPostfix | 2.999 s |
|
simpleNameTestWithWildcardPkg | 3.052 s |
|
shouldMatchWildcardPackageAndClassAndMethod | 2.655 s |
|
shouldMatchExactClassAndMultipleMethods | 2.988 s |
|
fullyQualifiedTest | 3.396 s |
|
matchSimpleClassAndMethodWithJavaExtWildcardPkg | 2.855 s |
|
negativeTest | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodsWildcard | 2.882 s |
|
shouldMatchMultiplePatternsComplex | 2.714 s |
|
simpleNameTestAsParallel | 2.937 s |
|
matchSimpleClassAndMethodWithWildcardPkg | 3.662 s |
|
shouldMatchMultiplePatternsAsParallel | 3.735 s |
|
shouldNotRunExcludedClassesIfIncluded | 3.273 s |
|
shouldMatchSimpleClassNameAndMethod | 3.193 s |
|
shouldMatchExactClassAndMethodPostfix | 3.317 s |
|
shouldMatchMultiplePatternsComplexAsParallel | 4.096 s |
|
matchSimpleClassAndMethodWithJavaExt | 2.948 s |
|
testRegexSuccessTwo | 0 s |
| - | TestNG does not support regex method patterns | - |
|
regexClassAndMethod | 0 s |
| - | TestNG does not support regex method patterns | - |
JUnit4PlatformFailingBeforeAllRerunIT
|
testBeforeAllFailures | 4.639 s |
Surefire772BothReportsIT
|
testSkippedSurefireReportGeneration | 3.238 s |
|
testSkippedFailsafeReportGeneration | 2.911 s |
|
testReportGeneration | 2.464 s |
TestMultipleMethodPatternsTestNGIncludesExcludesIT
|
shouldNotRunExcludedClassesAndMethods | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodCharacters | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodWildcard | 0 s |
| - | skipped | - |
|
testSuccessTwo | 0 s |
| - | skipped | - |
|
simpleNameTest | 10.97 s |
|
simpleNameTestWithJavaExt | 10.56 s |
|
regexClass | 12.34 s |
|
shouldNotRunExcludedClasses | 11.52 s |
|
shouldNotRunExcludedMethods | 0 s |
| - | skipped | - |
|
simpleNameTestWithJavaExtWildcardPkg | 17.48 s |
|
shouldMatchMultiplePatterns | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodsPostfix | 0 s |
| - | skipped | - |
|
simpleNameTestWithWildcardPkg | 14.12 s |
|
shouldMatchWildcardPackageAndClassAndMethod | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMultipleMethods | 0 s |
| - | skipped | - |
|
fullyQualifiedTest | 13.27 s |
|
matchSimpleClassAndMethodWithJavaExtWildcardPkg | 0 s |
| - | skipped | - |
|
negativeTest | 10.85 s |
|
shouldMatchExactClassAndMethodsWildcard | 0 s |
| - | skipped | - |
|
shouldMatchMultiplePatternsComplex | 0 s |
| - | skipped | - |
|
simpleNameTestAsParallel | 13.82 s |
|
matchSimpleClassAndMethodWithWildcardPkg | 0 s |
| - | skipped | - |
|
shouldMatchMultiplePatternsAsParallel | 0 s |
| - | skipped | - |
|
shouldNotRunExcludedClassesIfIncluded | 15.93 s |
|
shouldMatchSimpleClassNameAndMethod | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodPostfix | 0 s |
| - | skipped | - |
|
shouldMatchMultiplePatternsComplexAsParallel | 0 s |
| - | skipped | - |
|
matchSimpleClassAndMethodWithJavaExt | 0 s |
| - | skipped | - |
|
testRegexSuccessTwo | 0 s |
| - | TestNG does not support regex method patterns | - |
|
regexClassAndMethod | 0 s |
| - | TestNG does not support regex method patterns | - |
TestMultipleMethodsIT
|
testJunit44 | 2.530 s |
Surefire1036NonFilterableJUnit4RunnerWithCategoriesIT
|
test | 3.410 s |
JUnit447RedirectOutputIT
|
testClassesParallel | 3.953 s |
|
testPrintSummaryTrueWithRedirect | 3.291 s |
Surefire2298IT
|
shouldNotCreateFilesForNested | 4.974 s |
FailFastJUnit4IT
CheckTestNgListenerReporterIT
|
testNgListenerReporter(String, String)[1] | 17.14 s |
|
testNgListenerReporter(String, String)[2] | 9.530 s |
Surefire1144XmlRunTimeIT
|
testXmlRunTime | 5.359 s |
EnvironmentVariableIT
|
environmentVariable | 5.473 s |
JUnit447WithCucumberIT
|
testWithParallelClasses | 3.863 s |
|
testWithoutParallel | 3.304 s |
Surefire1993JpmsProvidingModulesIT
|
verify | 6.657 s |
SystemPropertiesTestIT
|
testSystemProperties | 3.444 s |
|
testSystemPropertiesNoFork | 2.419 s |
Surefire1179IT
|
suiteXmlForkCountTwoReuse | 9.201 s |
JUnit4PlatformRerunFailingTestsIT
Surefire920TestFailureIgnoreWithTimeoutIT
|
timeoutInForkWithBuildFail | 5.205 s |
|
timeoutInForkWithNoBuildFail | 4.055 s |
JUnit447ConcurrencyIT
|
test47 | 4.799 s |
JUnit447RerunFailingTestWithCucumberIT
Surefire1080ParallelForkDoubleTestIT
|
test | 3.166 s |
SmartStackTraceIT
|
misg | 3.164 s |
CheckTestNgGroupThreadParallelIT
|
testNgGroupThreadParallel | 15.32 s |
Surefire1185DoNotSpawnTestsIT
|
doNotSpawnUnwantedTests | 3.019 s |
Surefire1364SystemPropertiesIT
|
testNg | 14.09 s |
|
junit4Forked | 13.94 s |
|
testNgInProcess | 12.09 s |
|
junit4InProcess | 13.25 s |
ArchUnit4IT
|
simpleCucumberUsage | 22.52 s |
Surefire1367AssumptionLogsIT
|
shouldSeeLogsInPlugin | 11.65 s |
|
shouldSeeLogsParallelInPlugin | 0 s |
| - | https://github.com/apache/maven-surefire/issues/3242 | - |
|
shouldSeeLogsParallelForked | 0 s |
| - | https://github.com/apache/maven-surefire/issues/3242 | - |
|
shouldSeeLogsForked | 13.57 s |
AbstractTestCaseIT
|
abstractTestCase | 16.48 s |
Surefire1055CorrectConcurrentTestCountIT
|
testTestNgAndJUnitTogether | 2.656 s |
Surefire1585IT
|
shouldRunWithJupiterApi | 4.105 s |
|
shouldRunWithVintage | 2.921 s |
Surefire2006ShadefireTransformersIT
|
shadefireShouldBeUsed | 4.127 s |
Surefire412InnerClassTestIT
|
testInnerClass | 3.863 s |
Surefire1733JUnit4IT
|
test | 8.270 s |
TimeoutForkedTestIT
|
testTimeoutForked | 3.675 s |
Surefire1643IT
|
shouldNotMixResults | 25.88 s |
ForkCountTestNGIT
SiblingAggregatorIT
|
testSiblingAggregator | 4.397 s |
Surefire1122ParallelAndFlakyTestsIT
|
parallelCreatesCorrectReportFork | 2.994 s |
|
nonParallelCreatesCorrectReport | 3.890 s |
|
parallelCreatesCorrectReport | 1.499 s |
Surefire1053SystemPropertiesIT
|
checkWarningsSysPropTwice | 2.404 s |
|
checkWarningsFileEncoding | 20.64 s |
FailFastJUnit4PlatformIT
Surefire141PluggableProvidersIT
|
pluggableProviderPresent | 12.60 s |
|
invokeRuntimeException | 11.75 s |
|
invokeReporterException | 13.67 s |
|
constructorRuntimeException | 15.39 s |
CheckTestNgBeforeMethodIT
|
testNgBeforeMethod | 16.83 s |
PlainOldJavaClasspathIT
|
testPlainOldJavaClasspath | 3.884 s |
ClasspathScopeFilteringIT
|
additionalClasspath | 9.046 s |
Surefire1152RerunFailingTestsInSuiteIT
|
testJUnit48Provider4 | 6.724 s |
LongWindowsPathIT
|
shouldRunInSystemTmp | 0 s |
| - | skipped | - |
JUnit4UnsupportedVersionsIT
|
testJunitTemp(JUnitVersion)[1] | 1.256 s |
|
testJunitTemp(JUnitVersion)[2] | 1.514 s |
JUnit4PlatformStreamCorruptionIT
|
warningIsNotEmitted | 2.841 s |
|
warningIsNotEmittedWithJulToLog4j | 0 s |
| - | https://issues.apache.org/jira/browse/SUREFIRE-1659?focusedCommentId=17374005&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-17374005 | - |
|
warningIsNotEmittedWithJulToSlf4j | 4.566 s |
Surefire817SystemExitIT
|
systemExit1 | 4.642 s |
XmlReporterRunTimeIT
|
testForkAlwaysWithChecksumOverride | 18.93 s |
|
testForkAlways | 19.32 s |
WorkingDirectoryIsInvalidPropertyIT
|
testWorkingDirectory | 0.784 s |
Surefire847AdditionalFailureIT
|
testJUnitRunCategoryAB | 3.998 s |
MultiModuleProjectWithJPMSIT
|
test | 11.99 s |
AggregateReportIT
|
aggregateReport | 27.79 s |
ForkCountMultiModuleIT
|
testForkCountOneNoReuse | 22.53 s |
|
testForkCountTwoNoReuse | 17.69 s |
|
testForkCountTwoReuse | 19.37 s |
|
testForkCountOneReuse | 19.89 s |
Surefire673MockitoIT
|
testBuildFailingWhenErrors | 5.150 s |
CrashDetectionIT
|
hardCrashInReusableFork | 8.592 s |
|
crashInReusableFork | 5.800 s |
|
crashInFork | 4.936 s |
ForkConsoleOutputWithErrorsIT
|
xmlFileContainsConsoleOutput | 15.90 s |
Surefire772SpecifiedReportsIT
|
testSkippedSurefireReportGeneration | 2.973 s |
|
testSkippedFailsafeReportGeneration | 2.748 s |
|
testReportGeneration | 2.514 s |
TestMultipleMethodPatternsTestNGIncludesIT
|
shouldNotRunExcludedClassesAndMethods | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodCharacters | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodWildcard | 0 s |
| - | skipped | - |
|
testSuccessTwo | 0 s |
| - | skipped | - |
|
simpleNameTest | 11.10 s |
|
simpleNameTestWithJavaExt | 34.22 s |
|
regexClass | 15.21 s |
|
shouldNotRunExcludedClasses | 14.13 s |
|
shouldNotRunExcludedMethods | 0 s |
| - | skipped | - |
|
simpleNameTestWithJavaExtWildcardPkg | 13.94 s |
|
shouldMatchMultiplePatterns | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodsPostfix | 0 s |
| - | skipped | - |
|
simpleNameTestWithWildcardPkg | 26.51 s |
|
shouldMatchWildcardPackageAndClassAndMethod | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMultipleMethods | 0 s |
| - | skipped | - |
|
fullyQualifiedTest | 16.47 s |
|
matchSimpleClassAndMethodWithJavaExtWildcardPkg | 0 s |
| - | skipped | - |
|
negativeTest | 14.61 s |
|
shouldMatchExactClassAndMethodsWildcard | 0 s |
| - | skipped | - |
|
shouldMatchMultiplePatternsComplex | 0 s |
| - | skipped | - |
|
simpleNameTestAsParallel | 20.01 s |
|
matchSimpleClassAndMethodWithWildcardPkg | 0 s |
| - | skipped | - |
|
shouldMatchMultiplePatternsAsParallel | 0 s |
| - | skipped | - |
|
shouldNotRunExcludedClassesIfIncluded | 5.796 s |
|
shouldMatchSimpleClassNameAndMethod | 0 s |
| - | skipped | - |
|
shouldMatchExactClassAndMethodPostfix | 0 s |
| - | skipped | - |
|
shouldMatchMultiplePatternsComplexAsParallel | 0 s |
| - | skipped | - |
|
matchSimpleClassAndMethodWithJavaExt | 0 s |
| - | skipped | - |
|
testRegexSuccessTwo | 0 s |
| - | TestNG does not support regex method patterns | - |
|
regexClassAndMethod | 0 s |
| - | TestNG does not support regex method patterns | - |
Surefire772NoSurefireReportsIT
|
testOptionalSurefireReportGeneration | 3.108 s |
|
testSkippedSurefireReportGeneration | 3.174 s |
|
testSkipOptionalSurefireReportGeneration | 2.440 s |
|
testReportGeneration | 2.452 s |
Surefire1570ModularFailsafeIT
|
shouldRunWithJupiterApi | 8.564 s |
Surefire901MIssingResultfileWhenNoTestsIT
|
failsafeWithNoTests | 2.169 s |
Surefire1028UnableToRunSingleIT
|
methodFilteringParallelExecution | 3.033 s |
Surefire1602IT
|
nonCanonicalPath | 7.928 s |
Surefire1914XmlReportingParameterizedTestIT
|
testXmlReport(String)[1] | 4.547 s |
|
testXmlReport(String)[2] | 4.422 s |
|
testXmlReport(String)[3] | 4.505 s |
Surefire985ParameterizedRunnerAndCategoriesIT
|
test | 2.982 s |
JUnit4RunListenerIT
|
testJUnit4RunListener | 3.462 s |
|
testRunlistenerJunitCoreProvider | 3.845 s |
ClasspathFilteringIT
|
additionalClasspath | 9.572 s |
CheckSingleTestIT
|
singleTestDotJava | 16.92 s |
|
singleTestNonExistentOverride | 5.034 s |
|
singleTestNonExistent | 3.219 s |
|
singleTest | 6.021 s |
Surefire1295AttributeJvmCrashesToTestsIT
CheckTestNgExecuteErrorIT
|
executionError | 16.52 s |
Surefire812Log4JClassLoaderIT
|
testJunit3ParallelBuildResultCount | 4.478 s |
EnvironmentVariablesIT
|
testWhenUseSystemClassLoader | 6.188 s |
|
testExcludedEnv | 34.83 s |
|
testWhenDontUseSystemClassLoader | 3.948 s |
DefaultConfigurationIT
|
defaultConfiguration | 6.967 s |
Surefire1264IT
|
positiveTests | 56.42 s |
|
negativeTests | 27.57 s |
Surefire2143ParameterizedSkippedIT
|
junit4ParameterizedSkipped | 4.279 s |
|
junit5ParameterizedSkipped | 5.065 s |
Surefire926FailureWith2ProvidersIT
|
testBuildFailingWhenErrors | 4.596 s |
CucumberIT
|
simpleCucumberUsage | 12.80 s |
JUnit448TestCategoriesIT
Surefire2065IT
|
shouldNotDetectFlakyTestsWhenRunningOnlyJunit4 | 4.087 s |
|
shouldNotDetectFlakyTestsWhenRunningOnlyJunit5 | 4.190 s |
|
shouldNotDetectFlakyTestsWhenCombiningJunit4And5Tests | 5.109 s |
Surefire1136CwdPropagationInForkedModeIT
|
testTestNgAndJUnitTogether | 3.740 s |
CheckTestFailIfNoTestsForkCountIT
|
dontFailIfNoTestsForkAlways | 13.87 s |
|
failIfNoTestsForkNever | 4.563 s |
|
failIfNoTestsForkAlways | 5.135 s |
|
failIfNoTestsForkOnce | 4.580 s |
|
dontFailIfNoTestsForkNever | 2.867 s |
|
dontFailIfNoTestsForkOnce | 4.129 s |
NoRunnableTestsInClassIT
|
testJunit3ParallelBuildResultCount | 3.687 s |
TestMethodPatternIT
Surefire1278GroupNameEndingIT
|
testOnlyGroups | 3.183 s |
Surefire975DefaultVMEncodingIT
|
runWithRussian1251 | 10.05 s |
JUnit4IgnoreIT
|
testJunit4Ignore | 3.940 s |
|
testJunit4ParallelIgnore | 3.230 s |
Surefire569RunTestFromDependencyJarsIT
|
shouldScanAndRunTestsInDependencyJars | 5.849 s |
JUnit4PlatformEnginesIT
Surefire1881IT
|
test | 10.82 s |
TestSingleMethodIT
|
fullyQualifiedTestNg | 2.965 s |
|
testJunit48parallel | 2.852 s |
|
testJunit48Provider47 | 3.150 s |
|
fullyQualifiedJunit48Provider4 | 3.119 s |
|
testTestNg5149 | 2.815 s |
|
testTestNg | 3.506 s |
Surefire2095FailsafeJvmCrashShouldNotBeIgnoredIT
|
mavenShouldFail | 3.137 s |
Surefire1095NpeInRunListenerIT
|
testRunStartedWithJUnit4 | 2.822 s |
Surefire2190JUnit4IT
|
test | 7.149 s |
Surefire803MultiFailsafeExecsIT
|
testOneExecutionRunInTwoBuilds | 9.768 s |
|
testSecondExecutionRunsAfterFirstExecutionFails | 5.898 s |
JUnit447ParallelIT
|
unknownThreadCountClasses | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
threadCountSuites | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
unlimitedThreadsSuitesAndMethods1 | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
unlimitedThreadsSuitesAndMethods2 | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
unknownThreadCountMethods | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
threadCountClassesAndMethods | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
reusableThreadCountClassesAndMethodsOptimized | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
unknownThreadCountSuites | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
reusableThreadCountAll | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
forcedShutdown | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
unknownThreadCountAll | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
serial | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
reusableThreadCountAllOptimized | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
suites | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
unlimitedThreadsMethods1 | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
unlimitedThreadsMethods2 | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
unlimitedThreadsSuitesAndClasses1 | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
unlimitedThreadsSuitesAndClasses2 | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
threadCountAllOptimized | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
threadCountAll | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
everyThreadCountSuitesAndClasses | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
unknownThreadCountBoth | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
threadCountSuitesAndClassesOptimized | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
classesAndMethods | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
everyThreadCountSuitesAndMethods | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
unknownThreadCountSuitesAndClasses | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
reusableThreadCountSuitesAndClassesOptimized | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
unknownThreadCountSuitesAndMethods | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
suitesAndClasses | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
suitesAndMethods | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
shutdown | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
threadCountClassesAndMethodsOneCore | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
everyThreadCountClassesAndMethods | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
all | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
unknownThreadCountClassesAndMethods | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
threadCountSuitesAndMethodsOptimized | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
reusableThreadCountSuitesAndMethodsOptimized | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
unlimitedThreadsClasses1 | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
unlimitedThreadsClasses2 | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
threadCountClasses | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
everyThreadCountAll | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
threadCountMethods | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
unlimitedThreadsSuites1 | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
unlimitedThreadsSuites2 | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
threadCountSuitesAndClasses | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
unlimitedThreadsClassesAndMethods1 | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
unlimitedThreadsClassesAndMethods2 | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
threadCountSuitesAndMethods | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
classes | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
reusableThreadCountSuitesAndClasses | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
methods | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
reusableThreadCountSuitesAndMethods | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
timeoutAndForcedShutdown | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
threadCountClassesAndMethodsOptimized | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
unlimitedThreadsAll1 | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
unlimitedThreadsAll2 | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
forcedShutdownVerifyingLogs | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
threadCountClassesAndMethodsOneCoreOptimized | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
|
reusableThreadCountClassesAndMethods | 0 s |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
Surefire772NoFailsafeReportsIT
|
testSkippedFailsafeReportGeneration | 2.193 s |
|
testForcedFailsafeReportGeneration | 2.920 s |
|
testSkipForcedFailsafeReportGeneration | 2.093 s |
|
testReportGeneration | 2.015 s |
IncludesExcludesJunit5IT
|
testPathBasedIncludesExcludes | 4.437 s |
|
testIncludesExcludes | 3.719 s |
|
testRegexIncludesExcludes | 3.763 s |
Surefire570MultipleReportDirectoriesIT
|
testReportWithAggregate | 16.25 s |
|
testReportWithoutAggregate | 13.46 s |
Surefire1146RerunFailedAndParameterizedIT
|
testsAreRerun | 4.644 s |
Surefire1211JUnit4TestNgIT
|
withoutJUnit | 13.99 s |
|
withJUnit | 3.482 s |
ResultCountingIT
|
testCountingWithJunit481ForkAlways | 5.223 s |
|
testCountingWithJunit481ForkOnce | 4.523 s |
|
testCountingWithJunit481ForkNever | 3.159 s |
AdditionalClasspathIT
|
additionalClasspathElements | 16.91 s |
|
additionalClasspathDependencies | 9.698 s |
IncludesExcludesFromFileIT
|
testSimpleMixed | 5.298 s |
|
testMissingExcludes | 1.431 s |
|
testRegex | 3.806 s |
|
testPath | 3.418 s |
|
testMissingIncludes | 1.292 s |
|
testSimple | 3.415 s |
CheckTestNgBeforeMethodFailureIT
|
testNgBeforeMethodFailure | 16.88 s |
Surefire2117XmlReportingNestedIT
|
testXmlReport(String)[1] | 4.912 s |
|
testXmlReport(String)[2] | 4.912 s |
|
testXmlReport(String)[3] | 7.119 s |
ClassPathOrderIT
|
classPathOrder | 10.18 s |
ArgLinePropertiesIT
|
argLine | 17.34 s |
Surefire995CategoryInheritanceIT
Surefire818NpeIgnoresTestsIT
|
testBuildFailingWhenErrors | 4.434 s |
Surefire2036IT
|
selectJUnit5UsingConfiguredProviderWithPlatformRunner | 4.089 s |
Surefire705ParallelForkTimeoutIT
|
testTimeoutForked | 4.690 s |
Surefire1024VerifyFailsafeIfTestedIT
|
shouldScanAndRunTestsInDependencyJars | 4.430 s |
Surefire733AllOverrridesCapturedIT
|
testLogOutput | 3.107 s |
Surefire628ConsoleOutputBeforeAndAfterClassIT
|
testJunit3ParallelBuildResultCount | 3.837 s |
Surefire1082ParallelJUnit4ParameterizedIT
|
checkClassesRunParallel | 4.708 s |
|
checkOutFileClassesRunParallel | 5.377 s |
Surefire2032NestedSkippedIT
|
testXmlReport | 5.181 s |
ForkConsoleOutputIT
|
printSummaryTrueWithRedirect | 15.94 s |
|
printSummaryFalseWithoutRedirect | 13.33 s |
|
printSummaryTrueWithoutRedirect | 13.13 s |
|
printSummaryFalseWithRedirect | 15.95 s |
Surefire634UnsettableSystemPropertiesWarningIT
|
testJunit3ParallelBuildResultCount | 3.811 s |
ModulePathIT
|
testModulePathWithSpaces | 6.924 s |
|
testModulePath | 6.233 s |
WorkingDirectoryIT
|
testWorkingDirectory | 2.861 s |
|
testWorkingDirectoryChildOnlyNoFork | 1.439 s |
|
testWorkingDirectoryNoFork | 1.213 s |
|
testWorkingDirectoryChildOnly | 2.702 s |
Surefire162CharsetProviderIT
|
testCharsetProvider | 3.218 s |
TestNgParallelWithAnnotationsIT
|
testTestNgGroupThreadParallel | 8.945 s |
FailFastTestNgIT
Surefire146ForkPerTestNoSetupIT
|
testForkPerTestNoSetup | 2.955 s |
Surefire979WrongClassLoaderIT
|
wrongClassloaderUSedInSmartStacktraceparser | 3.058 s |
|
wrongClassloaderUSedInSmartStacktraceparserJunit5 | 2.175 s |
Surefire621TestCountingJunit3InParallelIT
Surefire1135ImproveIgnoreMessageForTestNGIT
|
testNgReport688 | 5.821 s |
RunOrderIT
JUnit4PlatformIT
Surefire649EmptyStringSystemPropertiesIT
|
systemPropertyVariables | 3.491 s |
|
systemProperties | 3.187 s |
RunOrderParallelForksIT
ConsoleOutputIT
TwoTestCasesIT
|
testJunit4Suite | 2.193 s |
|
testTwoTestCases | 2.693 s |
Surefire735ForkFailWithRedirectConsoleOutputIT
|
vmStartFail | 1.860 s |
|
vmStartFailShouldFailBuildk | 1.782 s |
Surefire500PuzzlingErrorIT
|
testBuildFailingWhenErrors | 4.798 s |
Surefire1744AlwaysIncludeOutputLogsIT
|
testAlwaysIncludeOutputLogs | 2.849 s |
Surefire1934OutErrElementsIT
|
testOutErrElementsDisabled | 3.804 s |
|
testOutErrElementsEnabled | 4.016 s |
Surefire1360PropertiesElementIT
|
testPropertiesElementEnabled | 2.658 s |
|
testPropertiesElementDisabled | 3.554 s |
IncludesExcludesFromFileJunit5IT
|
testSimpleMixed | 5.824 s |
|
testMissingExcludes | 2.027 s |
|
testRegex | 4.182 s |
|
testPath | 4.005 s |
|
testMissingIncludes | 1.183 s |
|
testSimple | 4.322 s |
ReportTestTimestampIT
|
testReportTestTimestampEnabled | 3.619 s |
|
testReportTestTimestampDisabled | 3.876 s |
Surefire1265Java9IT
|
shouldRunInPluginJava9 | 2.750 s |
UnicodeTestNamesIT
|
checkFileNamesWithUnicode | 2.986 s |
Surefire697NiceSummaryIT
|
testBuildFailingWhenErrors | 3.749 s |
Surefire408ManualProviderSelectionIT
|
testParallelBuildResultCount | 2.335 s |
TestMultipleMethodPatternsIncludesExcludesIT
WorkingDirectoryMissingIT
|
testWorkingDirectory | 2.842 s |
Surefire1534ReuseForksFalseWithJavaModuleIT
|
testExecuteWithReuseForksFalseWithJavaModule | 15.16 s |
|
testExecuteWithReuseForksFalseWithJavaModuleWithFilter | 14.23 s |
|
testExecuteWithZeroForkCountWithJavaModule | 3.023 s |
ForkCountIT
Surefire1260NewTestsPatternIT
|
defaultConfig | 3.798 s |
Surefire377TestNgAndJUnit4TogetherIT
|
testTestNgAndJUnit4Together | 4.328 s |
|
testTestNgAndJUnitTogether | 5.624 s |
Surefire946KillMainProcessInReusableForkIT
|
test(String, String)[1] | 27.49 s |
|
test(String, String)[2] | 25.13 s |
|
test(String, String)[3] | 23.09 s |
|
test(String, String)[4] | 23.15 s |
|
test(String, String)[5] | 23.47 s |
|
test(String, String)[6] | 23.48 s |
Surefire806SpecifiedTestControlsIT
|
singleTestInSingleExecutionProject | 4.027 s |
|
twoSpecifiedTestExecutionsInCorrectExecutionBlocks | 0 s |
| - | since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution | - |
|
singleTestInOneExecutionOfMultiExecutionProject | 0 s |
| - | since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution | - |
Surefire1209RerunAndForkCountIT
|
reusableForksJUnit | 12.13 s |
|
notReusableForksJUnit | 13.95 s |
SurefireJUnit4MethodParallelWithSuiteCountIT
|
testMethodsParallelWithSuite | 5.147 s |
|
testClassesParallelWithSuite | 8.552 s |
Surefire1733TestngIT
|
test | 8.028 s |
Junit5ModulePathIT
|
testModulePathWithSpaces | 6.354 s |
|
testModulePath | 5.945 s |
Surefire1041FailingJUnitRunnerIT
|
reportErrorInJUnitRunnerAsTestError | 2.920 s |
Surefire674BuildFailingWhenFailsafeErrorsIT
|
testBuildFailingWhenErrors | 7.026 s |
Surefire376TestNgAfterSuiteFailureIT
|
testAfterSuiteFailure | 4.497 s |
Surefire1737IT
|
selectJUnit5UsingConfiguredProviderWithPlatformRunner | 1.996 s |
Surefire510TestClassPathForkModesIT
|
testForkOnce | 4.384 s |
|
testForkAlways | 3.986 s |
CheckTestNgPathWithSpacesIT
|
testWithSpaces | 9.909 s |
ReportersIT
|
testRedirectOutputTestNg | 4.460 s |
JUnit4VersionsIT
|
testJunit(JUnitVersion)[1] | 3.626 s |
|
testJunit(JUnitVersion)[2] | 3.474 s |
|
testJunit(JUnitVersion)[3] | 4.392 s |
|
testJunit(JUnitVersion)[4] | 3.729 s |
Surefire1004RunTestFromDependencyJarsTypeAndClassifierIT
|
shouldScanAndRunTestsInDependencyJars | 3.399 s |
Surefire1490ReportTitleDescriptionIT
|
shouldHaveCustomizedReportTitleAndDescription | 9.367 s |
|
shouldHaveDefaultReportTitleAndDescription | 9.496 s |
Surefire674BuildFailingWhenErrorsIT
|
testBuildFailingWhenErrors | 3.495 s |
JUnit4RerunFailingTestsIT
|
testRerunFailingErrorTestsFalse | 16.22 s |
|
testRerunFailingErrorTestsWithOneRetry | 17.59 s |
|
testRerunFailingErrorTestsTwoRetry | 14.92 s |
|
testRerunOneTestMethod | 12.21 s |
|
testRerunOneTestClass | 12.11 s |
Surefire685CommaSeparatedIncludesIT
|
testBuildFailingWhenErrors | 3.550 s |
Surefire855AllowFailsafeUseArtifactFileIT
|
jarNotForkingShouldUseFile | 16.52 s |
|
jarShouldUseFile | 4.384 s |
|
warShouldUseClasses | 7.476 s |
|
osgiBundleShouldUseFile | 3.809 s |
AssumptionFailureReportIT
|
testWriteSkippedMessageToReport | 16.48 s |
Surefire943ReportContentIT
|
test_noParallel | 10.35 s |
|
test_parallelBoth | 4.006 s |
CheckTestNg740ParallelIT
|
withTestNG740AndParallelSetWithoutThreadCount | 20.26 s |
|
withTestNG740AndParallelSet | 10.11 s |
JUnit4ForkAlwaysStaticInitPollutionIT
|
testJunit4Ignore | 6.028 s |
Java9FullApiIT
|
shouldLoadMultipleJavaModules_JavaHome | 22.51 s |
|
shouldLoadMultipleJavaModules_ToolchainsXML | 37.76 s |
|
shouldLoadMultipleJavaModules_JvmParameter | 14.07 s |
UmlautDirIT
|
surefire1617WithColonInLocalRepo | 20.03 s |
|
surefire1617WithColonInProjectDir | 12.43 s |
|
testUmlautIsolatedClassLoader | 3.910 s |
|
testUmlaut | 3.346 s |
CheckTestNgVersionsIT
|
test751 | 0 s |
| - | Disable for now as runOrder is not implemented for TestNG in Surefire | - |
|
test69136 | 5.129 s |
|
test6143 | 0 s |
| - | Disable for now as runOrder is not implemented for TestNG in Surefire | - |
|
test6821 | 3.743 s |
Surefire1396CustomProviderClassPathIT
|
pluggableProviderClasspathCorrect | 35.34 s |
ArgLineIT
|
argLine | 15.67 s |
PlexusConflictIT
|
testPlexusConflict | 4.041 s |
|
testPlexusConflictIsolatedClassLoader | 3.464 s |
Surefire1383ScanSessionDependenciesIT
|
test | 2.990 s |
Surefire972BizarreNoClassDefIT
|
testJunit3ParallelBuildResultCount | 4.943 s |
Surefire1787JUnit45IT
|
apiAndEngine | 3.817 s |
|
testNgWithJupiterApi | 4.139 s |
|
testNg | 3.613 s |
|
junit5Suite | 3.457 s |
|
bothEngines | 4.382 s |
|
selectJUnit4 | 3.669 s |
|
selectJUnit5 | 4.429 s |
|
testNgWithJupiterEngine | 4.676 s |
|
bothApis | 4.559 s |
Surefire839TestWithoutCategoriesIT
|
classWithoutCategoryForked | 4.453 s |
|
classWithoutCategory | 4.105 s |
CheckTestNgReportTestIT
|
testNgReport | 18.57 s |
|
shouldNotBeVerbose | 8.917 s |
|
shouldBeVerbose | 18.05 s |
Surefire1153IncludesAndSpecifiedTestIT
|
testSpecifiedTestInIncludes | 2.854 s |
|
testSpecifiedTestNotInIncludes | 3.155 s |
Surefire1202RerunAndSkipIT
|
junit4 | 17.73 s |
TestNgGroupsIT
|
testExclusion | 2.621 s |
|
testGroupsAndExclusion | 2.663 s |
|
groupsWithDash | 2.493 s |
|
testOnlyGroups | 2.699 s |
|
groupsBySimpleRegex | 2.803 s |
Surefire257NotRerunningTestsIT
|
shouldNotRerun | 10.54 s |
Failure Details
[Summary] [Package List] [Test Cases]