Failsafe Report
Summary
[Summary] [Package List] [Test Cases]
| Tests | Errors | Failures | Skipped | Success Rate | Time |
|---|---|---|---|---|---|
| 800 | 0 | 0 | 154 | 80.8% | 3003 s |
Note: failures are anticipated and checked for with assertions while errors are unanticipated.
Package List
[Summary] [Package List] [Test Cases]
| Package | Tests | Errors | Failures | Skipped | Success Rate | Time |
|---|---|---|---|---|---|---|
| org.apache.maven.surefire.its | 568 | 0 | 0 | 148 | 73.9% | 1954 s |
| org.apache.maven.surefire.its.jiras | 232 | 0 | 0 | 6 | 97.4% | 1049 s |
Note: package statistics are not computed recursively, they only sum up all of its testsuites numbers.
org.apache.maven.surefire.its
org.apache.maven.surefire.its.jiras
Test Cases
[Summary] [Package List] [Test Cases]
CrashDetectionIT
| hardCrashInReusableFork | 2.439 s | |
| crashInReusableFork | 2.955 s | |
| crashInFork | 2.550 s |
TestMethodPatternIT
IncludesExcludesFromFileJunit5IT
| testSimpleMixed | 2.052 s | |
| testMissingExcludes | 1.696 s | |
| testRegex | 2.230 s | |
| testPath | 2.123 s | |
| testMissingIncludes | 1.662 s | |
| testSimple | 2.182 s |
IncludesExcludesIT
| testPathBasedIncludesExcludes | 2.128 s | |
| testIncludesExcludes | 2.084 s | |
| testRegexIncludesExcludes | 2.066 s |
CucumberIT
| simpleCucumberUsage | 3.546 s |
JUnit4RunListenerIT
| testJUnit4RunListener | 2.027 s | |
| testRunlistenerJunitCoreProvider | 1.923 s |
WorkingDirectoryIsInvalidPropertyIT
| testWorkingDirectory | 1.643 s |
Surefire257NotRerunningTestsIT
| shouldNotRerun | 4.428 s |
CheckSingleTestIT
| singleTestDotJava | 3.460 s | |
| singleTestNonExistentOverride | 2.049 s | |
| singleTestNonExistent | 1.862 s | |
| singleTest | 2.456 s |
Surefire162CharsetProviderIT
| testCharsetProvider | 3.229 s |
Surefire1082ParallelJUnit4ParameterizedIT
| checkClassesRunParallel | 4.301 s | |
| checkOutFileClassesRunParallel | 4.225 s |
JUnit4IgnoreIT
| testJunit4Ignore | 1.949 s | |
| testJunit4ParallelIgnore | 2.008 s |
Surefire2117XmlReportingNestedIT
| testXmlReport(String)[1] | 2.739 s | |
| testXmlReport(String)[2] | 2.566 s | |
| testXmlReport(String)[3] | 3.337 s |
Surefire3511JUnit4OneClassAtATimeIT
| runsEachTestClassOnItsOwn | 2.836 s |
Surefire2006ShadefireTransformersIT
| shadefireShouldBeUsed | 2.351 s |
GroupsWithTestNgOnClasspathIT
Surefire570MultipleReportDirectoriesIT
| testReportWithAggregate | 7.685 s | |
| testReportWithoutAggregate | 6.540 s |
JUnit4PlatformFailingBeforeAllRerunIT
| testBeforeAllFailures | 2.415 s | |
| testRecoveredBeforeAllDoesNotFailBuild | 2.164 s |
IncludesExcludesFromFileIT
| testSimpleMixed | 2.329 s | |
| testMissingExcludes | 1.597 s | |
| testRegex | 2.289 s | |
| testPath | 1.987 s | |
| testMissingIncludes | 1.522 s | |
| testSimple | 2.162 s |
JUnit447ConcurrencyIT
| test47 | 3.038 s |
Surefire2260NonUniqueScenariosIT
| identicallyNamedCucumberScenariosRemainDistinctDuringRerun | 2.269 s |
Surefire1534ReuseForksFalseWithJavaModuleIT
| testExecuteWithReuseForksFalseWithJavaModule | 8.624 s | |
| testExecuteWithReuseForksFalseWithJavaModuleWithFilter | 7.627 s | |
| testExecuteWithZeroForkCountWithJavaModule | 2.270 s |
Surefire920TestFailureIgnoreWithTimeoutIT
| timeoutInForkWithBuildFail | 3.232 s | |
| timeoutInForkWithNoBuildFail | 3.188 s |
CheckTestNgBeforeMethodIT
| testNgBeforeMethod | 2.658 s |
JUnit447RedirectOutputIT
| testClassesParallel | 2.019 s | |
| testPrintSummaryTrueWithRedirect | 2.392 s |
Surefire1144XmlRunTimeIT
| testXmlRunTime | 4.125 s |
MultiModuleProjectWithJPMSIT
| test | 4.218 s |
Surefire812Log4JClassLoaderIT
| testJunit3ParallelBuildResultCount | 2.065 s |
Surefire500PuzzlingErrorIT
| testBuildFailingWhenErrors | 2.627 s |
CheckTestNgListenerReporterIT
| testNgListenerReporter(String, String)[1] | 2.314 s | |
| testNgListenerReporter(String, String)[2] | 2.273 s |
JUnit4ForkAlwaysStaticInitPollutionIT
| testJunit4Ignore | 2.476 s |
UseIsolatedClassLoaderIT
| testUseSystemClassLoader | 2.251 s |
Surefire224WellFormedXmlFailuresIT
| testWellFormedXmlFailures | 2.325 s |
Surefire1787JUnit45IT
| apiAndEngine | 2.616 s | |
| testNgWithJupiterApi | 2.586 s | |
| testNg | 2.559 s | |
| junit5Suite | 2.672 s | |
| bothEngines | 2.404 s | |
| selectJUnit4 | 2.490 s | |
| selectJUnit5 | 2.593 s | |
| testNgWithJupiterEngine | 3.207 s | |
| bothApis | 3.177 s |
Surefire1490ReportTitleDescriptionIT
| shouldHaveCustomizedReportTitleAndDescription | 6.096 s | |
| shouldHaveDefaultReportTitleAndDescription | 6.275 s |
CucumberJUnit4VintageIT
| cucumberScenariosCountedOnPlatform17 | 2.963 s |
Surefire1570ModularFailsafeIT
| shouldRunWithJupiterApi | 6.002 s |
JUnit447WithCucumberIT
| testWithParallelClasses | 1.911 s | |
| testWithoutParallel | 2.004 s |
Surefire674BuildFailingWhenFailsafeErrorsIT
| testBuildFailingWhenErrors | 3.332 s |
AssumptionFailureReportIT
| testWriteSkippedMessageToReport | 8.110 s |
JUnit4FailingAfterClassIT
| testAfterClassFailureWithRerunDoesNotRerunPassingTests | 2.023 s | |
| testAfterClassFailureIsReported | 2.129 s |
UnicodeTestNamesIT
| checkFileNamesWithUnicode | 3.119 s |
Surefire1153IncludesAndSpecifiedTestIT
| testSpecifiedTestInIncludes | 2.346 s | |
| testSpecifiedTestNotInIncludes | 3.065 s |
JUnit4RerunFailingTestsIT
| testRerunFailingErrorTestsFalse | 7.955 s | |
| testRerunFailingErrorTestsWithOneRetry | 8.231 s | |
| testRerunFailingErrorTestsTwoRetry | 7.604 s | |
| testRerunOneTestMethod | 8.124 s | |
| testRerunOneTestClass | 8.681 s |
TestNgGroupsIT
| testExclusion | 2.630 s | |
| testGroupsAndExclusion | 2.622 s | |
| groupsWithDash | 2.404 s | |
| testOnlyGroups | 2.194 s | |
| groupsBySimpleRegex | 2.252 s |
Surefire1135ImproveIgnoreMessageForTestNGIT
| testNgReport688 | 2.468 s |
CheckTestNgVersionsIT
| test751 | 0 s | |
| - | Disable for now as runOrder is not implemented for TestNG in Surefire | - |
| test69136 | 1.926 s | |
| test6143 | 0 s | |
| - | Disable for now as runOrder is not implemented for TestNG in Surefire | - |
| test6821 | 2.011 s |
Surefire2095FailsafeJvmCrashShouldNotBeIgnoredIT
| mavenShouldFail | 1.928 s |
RunOrderIT
AdditionalClasspathForkIT
| relativeClasspathElementResolvedAgainstWorkingDirectory | 9.063 s |
Surefire735ForkFailWithRedirectConsoleOutputIT
| vmStartFail | 2.016 s | |
| vmStartFailShouldFailBuildk | 1.782 s |
Surefire673MockitoIT
| testBuildFailingWhenErrors | 3.369 s |
Surefire1602IT
| nonCanonicalPath | 5.074 s |
CheckTestNgPathWithSpacesIT
| testWithSpaces | 2.444 s |
Surefire1185DoNotSpawnTestsIT
| doNotSpawnUnwantedTests | 2.424 s |
Surefire1209RerunAndForkCountIT
| reusableForksJUnit | 10.62 s | |
| notReusableForksJUnit | 10.47 s |
CheckTestNgBeforeMethodFailureIT
| testNgBeforeMethodFailure | 3.095 s |
ConsoleOutputIT
AdditionalClasspathIT
| additionalClasspathElements | 7.929 s | |
| additionalClasspathDependencies | 3.597 s |
NoRunnableTestsInClassIT
| testJunit3ParallelBuildResultCount | 2.141 s |
JUnit5TestExecutionListenerIT
| testJUnit5TestExecutionListener | 2.151 s |
Surefire3178FailIfNoTestsIT
| emptyTestClassFailsVerification | 1.951 s |
CheckTestFailIfNoTestsForkCountIT
| dontFailIfNoTestsForkAlways | 2.698 s | |
| failIfNoTestsForkNever | 2.165 s | |
| failIfNoTestsForkAlways | 2.049 s | |
| failIfNoTestsForkOnce | 2.348 s | |
| dontFailIfNoTestsForkNever | 1.655 s | |
| dontFailIfNoTestsForkOnce | 2.267 s |
IncludesExcludesJunit5IT
| testPathBasedIncludesExcludes | 2.130 s | |
| testIncludesExcludes | 2.219 s | |
| testRegexIncludesExcludes | 1.920 s |
Surefire1055CorrectConcurrentTestCountIT
| testTestNgAndJUnitTogether | 2.507 s |
AbstractTestCaseIT
| abstractTestCase | 8.310 s |
Surefire818NpeIgnoresTestsIT
| testBuildFailingWhenErrors | 2.357 s |
Surefire510TestClassPathForkModesIT
| testForkOnce | 2.502 s | |
| testForkAlways | 2.691 s |
TimeoutForkedTestIT
| testTimeoutForked | 3.245 s |
Surefire1585IT
| shouldRunWithJupiterApi | 3.510 s | |
| shouldRunWithVintage | 2.804 s |
Surefire972BizarreNoClassDefIT
| testJunit3ParallelBuildResultCount | 3.285 s |
Surefire3503ExcludedGroupsWithJUnit4IT
| excludedGroupsShouldSkipTaggedTests | 3.062 s | |
| groupsShouldOnlyRunTaggedTests | 2.515 s |
JUnit4UnsupportedVersionsIT
| testJunitTemp(JUnitVersion)[1] | 1.498 s | |
| testJunitTemp(JUnitVersion)[2] | 1.458 s |
RunOrderParallelForksIT
Surefire634UnsettableSystemPropertiesWarningIT
| testJunit3ParallelBuildResultCount | 2.156 s |
Surefire772NoSurefireReportsIT
| testOptionalSurefireReportGeneration | 1.982 s | |
| testSkippedSurefireReportGeneration | 2.141 s | |
| testSkipOptionalSurefireReportGeneration | 1.789 s | |
| testReportGeneration | 1.865 s |
ForkCountIT
Surefire2239TestNgRerunIT
| rerunsTestNgTestsWithSurefireAndFailsafe | 2.960 s |
TestMultipleMethodsIT
| testJunit44 | 2.913 s |
Surefire740TruncatedCommaIT
| testRussianLocaleReport | 5.736 s |
Surefire1264IT
| positiveTests | 14.70 s | |
| negativeTests | 16.95 s |
Surefire995CategoryInheritanceIT
WorkingDirectoryMissingIT
| testWorkingDirectory | 2.302 s |
Surefire2298IT
| shouldNotCreateFilesForNested | 2.356 s |
UmlautDirIT
| surefire1617WithColonInLocalRepo | 17.24 s | |
| surefire1617WithColonInProjectDir | 6.066 s | |
| testUmlautIsolatedClassLoader | 2.710 s | |
| testUmlaut | 2.849 s |
PlainOldJavaClasspathIT
| testPlainOldJavaClasspath | 2.034 s |
JUnit5BeforeAllContainerFailureIT
| testBeforeAllContainerFailure | 1.832 s |
Surefire621TestCountingJunit3InParallelIT
Surefire839TestWithoutCategoriesIT
| classWithoutCategoryForked | 2.825 s | |
| classWithoutCategory | 2.305 s |
TwoTestCasesIT
| testJunit4Suite | 2.454 s | |
| testTwoTestCases | 2.631 s |
WorkingDirectoryIT
| testWorkingDirectory | 2.439 s | |
| testWorkingDirectoryChildOnlyNoFork | 1.980 s | |
| testWorkingDirectoryNoFork | 1.736 s | |
| testWorkingDirectoryChildOnly | 2.415 s |
Surefire3210ReportNameSuffixIT
| reportNameSuffixIsUsedInTestcaseClassname | 2.785 s |
CheckTestFailIfNoTestsIT
| failIfNoTests | 2.616 s | |
| dontFailIfNoTests | 1.970 s |
JUnit4PlatformEnginesIT
TestNgSuccessPercentageIT
| testPassesWhenFailuresLessThanSuccessPercentage | 0 s | |
| - | FIXME percentage attribute looks to be sypported but is failing in this case | - |
SiblingAggregatorIT
| testSiblingAggregator | 2.596 s |
Surefire1383ScanSessionDependenciesIT
| test | 2.212 s |
Surefire1179IT
| suiteXmlForkCountTwoReuse | 6.368 s |
Surefire1152RerunFailingTestsInSuiteIT
| testJUnit48Provider4 | 3.072 s |
Surefire376TestNgAfterSuiteFailureIT
| testAfterSuiteFailure | 2.248 s |
Surefire1934OutErrElementsIT
| testOutErrElementsDisabled | 2.550 s | |
| testOutErrElementsEnabled | 2.605 s |
XmlReporterRunTimeIT
| testForkAlwaysWithChecksumOverride | 17.74 s | |
| testForkAlways | 17.36 s |
Surefire1053SystemPropertiesIT
| checkWarningsSysPropTwice | 2.691 s | |
| checkWarningsFileEncoding | 5.344 s |
ArgLinePropertiesIT
| argLine | 9.721 s |
Surefire946KillMainProcessInReusableForkIT
| test(String, String)[1] | 26.68 s | |
| test(String, String)[2] | 26.55 s | |
| test(String, String)[3] | 26.27 s | |
| test(String, String)[4] | 26.27 s | |
| test(String, String)[5] | 26.30 s | |
| test(String, String)[6] | 26.36 s |
Surefire1881IT
| test | 4.973 s |
Surefire772SpecifiedReportsIT
| testSkippedSurefireReportGeneration | 2.168 s | |
| testSkippedFailsafeReportGeneration | 1.747 s | |
| testReportGeneration | 1.734 s |
Surefire1967CheckTestNgMethodParallelOrderingIT
| testNgParallelOrdering | 2.736 s |
Surefire838TimeoutExtensionIT
| extensionInvokedOnTimeout | 13.26 s |
FailFastJUnit4PlatformIT
Surefire705ParallelForkTimeoutIT
| testTimeoutForked | 3.661 s |
Surefire685CommaSeparatedIncludesIT
| testBuildFailingWhenErrors | 2.582 s |
Surefire2032NestedSkippedIT
| testXmlReport | 2.498 s |
Surefire1733TestngIT
| test | 4.007 s |
JUnit5FailingAfterAllIT
| testAfterAllFailureIsReported | 1.880 s | |
| testAfterAllFailureWithRerunDoesNotRerunPassingTests | 2.404 s |
Java9FullApiIT
| shouldLoadMultipleJavaModules_JavaHome | 6.885 s | |
| shouldLoadMultipleJavaModules_ToolchainsXML | 6.518 s | |
| shouldLoadMultipleJavaModules_JvmParameter | 6.731 s |
Surefire1080ParallelForkDoubleTestIT
| test | 2.651 s |
Surefire1766SkipTestsDecoupledIT
| skipTestsShouldOnlySkipSurefireNotFailsafe | 2.818 s | |
| mavenTestSkipShouldSkipBoth | 1.975 s | |
| skipITsShouldSkipFailsafeOnly | 2.813 s | |
| noSkipShouldRunBoth | 3.486 s |
ForkConsoleOutputWithErrorsIT
| xmlFileContainsConsoleOutput | 5.631 s |
Surefire1024VerifyFailsafeIfTestedIT
| shouldScanAndRunTestsInDependencyJars | 2.481 s |
ReportersIT
| testRedirectOutputTestNg | 1.979 s |
Surefire806SpecifiedTestControlsIT
| singleTestInSingleExecutionProject | 2.126 s | |
| twoSpecifiedTestExecutionsInCorrectExecutionBlocks | 0 s | |
| - | since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution | - |
| singleTestInOneExecutionOfMultiExecutionProject | 0 s | |
| - | since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution | - |
Surefire569RunTestFromDependencyJarsIT
| shouldScanAndRunTestsInDependencyJars | 3.053 s |
Surefire817SystemExitIT
| systemExit1 | 2.250 s |
FailFastJUnit4IT
Surefire1202RerunAndSkipIT
| junit4 | 16.07 s |
ArgLineIT
| argLine | 7.859 s |
DefaultConfigurationIT
| defaultConfiguration | 2.510 s |
Surefire1265Java9IT
| shouldRunInPluginJava9 | 2.348 s |
Surefire926FailureWith2ProvidersIT
| testBuildFailingWhenErrors | 2.493 s |
Surefire1136CwdPropagationInForkedModeIT
| testTestNgAndJUnitTogether | 2.452 s |
Surefire803MultiFailsafeExecsIT
| testOneExecutionRunInTwoBuilds | 4.842 s | |
| testSecondExecutionRunsAfterFirstExecutionFails | 2.971 s |
Surefire1712ExtractedModulenameWithoutASMIT
| test | 2.866 s |
Surefire772BothReportsIT
| testSkippedSurefireReportGeneration | 2.149 s | |
| testSkippedFailsafeReportGeneration | 1.960 s | |
| testReportGeneration | 1.837 s |
PlexusConflictIT
| testPlexusConflict | 1.918 s | |
| testPlexusConflictIsolatedClassLoader | 1.917 s |
Surefire1260NewTestsPatternIT
| defaultConfig | 2.888 s |
Surefire1146RerunFailedAndParameterizedIT
| testsAreRerun | 2.442 s |
TestMultipleMethodPatternsIncludesExcludesIT
Surefire901MIssingResultfileWhenNoTestsIT
| failsafeWithNoTests | 1.909 s |
Surefire1278GroupNameEndingIT
| testOnlyGroups | 2.270 s |
TestMultipleMethodPatternsTestNGIT
| shouldNotRunExcludedClassesAndMethods | 3.338 s | |
| shouldMatchExactClassAndMethodCharacters | 3.278 s | |
| shouldMatchExactClassAndMethodWildcard | 3.055 s | |
| testSuccessTwo | 3.183 s | |
| simpleNameTest | 2.807 s | |
| simpleNameTestWithJavaExt | 3.091 s | |
| regexClass | 3.271 s | |
| shouldNotRunExcludedClasses | 3.497 s | |
| shouldNotRunExcludedMethods | 3.089 s | |
| simpleNameTestWithJavaExtWildcardPkg | 3.267 s | |
| shouldMatchMultiplePatterns | 2.850 s | |
| shouldMatchExactClassAndMethodsPostfix | 2.851 s | |
| simpleNameTestWithWildcardPkg | 2.790 s | |
| shouldMatchWildcardPackageAndClassAndMethod | 2.530 s | |
| shouldMatchExactClassAndMultipleMethods | 2.449 s | |
| fullyQualifiedTest | 2.343 s | |
| matchSimpleClassAndMethodWithJavaExtWildcardPkg | 2.249 s | |
| negativeTest | 0 s | |
| - | skipped | - |
| shouldMatchExactClassAndMethodsWildcard | 2.465 s | |
| shouldMatchMultiplePatternsComplex | 2.621 s | |
| simpleNameTestAsParallel | 2.563 s | |
| matchSimpleClassAndMethodWithWildcardPkg | 2.038 s | |
| shouldMatchMultiplePatternsAsParallel | 2.391 s | |
| shouldNotRunExcludedClassesIfIncluded | 2.400 s | |
| shouldMatchSimpleClassNameAndMethod | 2.557 s | |
| shouldMatchExactClassAndMethodPostfix | 2.581 s | |
| shouldMatchMultiplePatternsComplexAsParallel | 2.466 s | |
| matchSimpleClassAndMethodWithJavaExt | 2.034 s | |
| testRegexSuccessTwo | 0 s | |
| - | TestNG does not support regex method patterns | - |
| regexClassAndMethod | 0 s | |
| - | TestNG does not support regex method patterns | - |
Surefire674BuildFailingWhenErrorsIT
| testBuildFailingWhenErrors | 2.771 s |
ResultCountingIT
| testCountingWithJunit481ForkAlways | 4.580 s | |
| testCountingWithJunit481ForkOnce | 2.213 s | |
| testCountingWithJunit481ForkNever | 1.797 s |
Surefire1993JpmsProvidingModulesIT
| verify | 3.425 s |
Surefire2190JUnit4IT
| test | 2.827 s |
Surefire2143ParameterizedSkippedIT
| junit4ParameterizedSkipped | 2.572 s | |
| junit5ParameterizedSkipped | 2.463 s |
Surefire1914XmlReportingParameterizedTestIT
| testXmlReport(String)[1] | 3.338 s | |
| testXmlReport(String)[2] | 2.952 s | |
| testXmlReport(String)[3] | 3.060 s |
Surefire2036IT
| selectJUnit5UsingConfiguredProviderWithPlatformRunner | 2.395 s |
LongWindowsPathIT
| shouldRunInSystemTmp | 0 s | |
| - | skipped | - |
CheckTestNgExecuteErrorIT
| executionError | 2.572 s |
ReportTestTimestampIT
| testReportTestTimestampEnabled | 1.953 s | |
| testReportTestTimestampDisabled | 2.109 s |
Surefire141PluggableProvidersIT
| pluggableProviderPresent | 7.454 s | |
| invokeRuntimeException | 7.849 s | |
| invokeReporterException | 5.597 s | |
| constructorRuntimeException | 6.575 s |
Surefire3380ForkedSourceQualifiedNameIT
| testXmlReport(String)[1] | 8.172 s | |
| testXmlReport(String)[2] | 6.872 s | |
| testXmlReport(String)[3] | 6.823 s |
Surefire733AllOverrridesCapturedIT
| testLogOutput | 2.154 s |
Surefire1041FailingJUnitRunnerIT
| reportErrorInJUnitRunnerAsTestError | 2.589 s |
Surefire855AllowFailsafeUseArtifactFileIT
| jarNotForkingShouldUseFile | 8.077 s | |
| jarShouldUseFile | 4.901 s | |
| warShouldUseClasses | 6.163 s | |
| osgiBundleShouldUseFile | 4.146 s |
FailFastTestNgIT
SystemPropertiesTestIT
| testSystemProperties | 3.007 s | |
| testSystemPropertiesNoFork | 2.449 s |
Surefire1360PropertiesElementIT
| testPropertiesElementEnabled | 2.350 s | |
| testPropertiesElementDisabled | 2.398 s |
Surefire408ManualProviderSelectionIT
| testParallelBuildResultCount | 2.074 s |
Surefire3511NestedSuitesIT
| reportsNestedSuitesAsOneTestClass | 2.635 s |
JUnit448TestCategoriesIT
Surefire1122ParallelAndFlakyTestsIT
| parallelCreatesCorrectReportFork | 1.939 s | |
| nonParallelCreatesCorrectReport | 2.402 s | |
| parallelCreatesCorrectReport | 1.764 s |
Surefire1964IT
| shouldFilterTests | 2.309 s | |
| shouldFilterTestsInPluginProcess | 1.915 s |
Surefire1036NonFilterableJUnit4RunnerWithCategoriesIT
| test | 2.714 s |
ModulePathIT
| testModulePathWithSpaces | 2.818 s | |
| testModulePath | 2.658 s |
JUnit447ParallelIT
| unknownThreadCountClasses | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| threadCountSuites | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| unlimitedThreadsSuitesAndMethods1 | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| unlimitedThreadsSuitesAndMethods2 | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| unknownThreadCountMethods | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| threadCountClassesAndMethods | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| reusableThreadCountClassesAndMethodsOptimized | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| unknownThreadCountSuites | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| reusableThreadCountAll | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| forcedShutdown | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| unknownThreadCountAll | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| serial | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| reusableThreadCountAllOptimized | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| suites | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| unlimitedThreadsMethods1 | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| unlimitedThreadsMethods2 | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| unlimitedThreadsSuitesAndClasses1 | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| unlimitedThreadsSuitesAndClasses2 | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| threadCountAllOptimized | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| threadCountAll | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| everyThreadCountSuitesAndClasses | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| unknownThreadCountBoth | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| threadCountSuitesAndClassesOptimized | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| classesAndMethods | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| everyThreadCountSuitesAndMethods | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| unknownThreadCountSuitesAndClasses | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| reusableThreadCountSuitesAndClassesOptimized | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| unknownThreadCountSuitesAndMethods | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| suitesAndClasses | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| suitesAndMethods | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| shutdown | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| threadCountClassesAndMethodsOneCore | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| everyThreadCountClassesAndMethods | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| all | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| unknownThreadCountClassesAndMethods | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| threadCountSuitesAndMethodsOptimized | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| reusableThreadCountSuitesAndMethodsOptimized | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| unlimitedThreadsClasses1 | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| unlimitedThreadsClasses2 | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| threadCountClasses | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| everyThreadCountAll | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| threadCountMethods | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| unlimitedThreadsSuites1 | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| unlimitedThreadsSuites2 | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| threadCountSuitesAndClasses | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| unlimitedThreadsClassesAndMethods1 | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| unlimitedThreadsClassesAndMethods2 | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| threadCountSuitesAndMethods | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| classes | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| reusableThreadCountSuitesAndClasses | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| methods | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| reusableThreadCountSuitesAndMethods | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| timeoutAndForcedShutdown | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| threadCountClassesAndMethodsOptimized | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| unlimitedThreadsAll1 | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| unlimitedThreadsAll2 | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| forcedShutdownVerifyingLogs | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| threadCountClassesAndMethodsOneCoreOptimized | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
| reusableThreadCountClassesAndMethods | 0 s | |
| - | class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled | - |
Surefire412InnerClassTestIT
| testInnerClass | 2.607 s |
CheckTestNgCustomObjectFactoryIT
| testTestNgListenerReporter | 0 s | |
| - | objectFactory not support by testng engine | - |
CheckTestNgGroupThreadParallelIT
| testNgGroupThreadParallel | 2.262 s |
TestMultipleMethodPatternsIT
Surefire772NoFailsafeReportsIT
| testSkippedFailsafeReportGeneration | 1.890 s | |
| testForcedFailsafeReportGeneration | 1.939 s | |
| testSkipForcedFailsafeReportGeneration | 1.821 s | |
| testReportGeneration | 1.601 s |
Surefire146ForkPerTestNoSetupIT
| testForkPerTestNoSetup | 2.773 s |
CheckTestNgReportTestIT
| testNgReport | 7.038 s | |
| shouldNotBeVerbose | 5.625 s | |
| shouldBeVerbose | 8.907 s |
JUnit4VersionsIT
| testJunit(JUnitVersion)[1] | 1.888 s | |
| testJunit(JUnitVersion)[2] | 1.914 s | |
| testJunit(JUnitVersion)[3] | 1.831 s | |
| testJunit(JUnitVersion)[4] | 1.844 s |
Surefire697NiceSummaryIT
| testBuildFailingWhenErrors | 2.659 s |
TestSingleMethodIT
| fullyQualifiedTestNg | 2.383 s | |
| testJunit48parallel | 2.245 s | |
| testJunit48Provider47 | 2.254 s | |
| fullyQualifiedJunit48Provider4 | 2.317 s | |
| testTestNg5149 | 2.366 s | |
| testTestNg | 2.468 s |
Surefire1643IT
| shouldNotMixResults | 25.44 s |
TestMultipleMethodPatternsTestNGIncludesExcludesIT
| shouldNotRunExcludedClassesAndMethods | 0 s | |
| - | skipped | - |
| shouldMatchExactClassAndMethodCharacters | 0 s | |
| - | skipped | - |
| shouldMatchExactClassAndMethodWildcard | 0 s | |
| - | skipped | - |
| testSuccessTwo | 0 s | |
| - | skipped | - |
| simpleNameTest | 7.110 s | |
| simpleNameTestWithJavaExt | 7.626 s | |
| regexClass | 7.961 s | |
| shouldNotRunExcludedClasses | 6.576 s | |
| shouldNotRunExcludedMethods | 0 s | |
| - | skipped | - |
| simpleNameTestWithJavaExtWildcardPkg | 6.822 s | |
| shouldMatchMultiplePatterns | 0 s | |
| - | skipped | - |
| shouldMatchExactClassAndMethodsPostfix | 0 s | |
| - | skipped | - |
| simpleNameTestWithWildcardPkg | 6.272 s | |
| shouldMatchWildcardPackageAndClassAndMethod | 0 s | |
| - | skipped | - |
| shouldMatchExactClassAndMultipleMethods | 0 s | |
| - | skipped | - |
| fullyQualifiedTest | 5.523 s | |
| matchSimpleClassAndMethodWithJavaExtWildcardPkg | 0 s | |
| - | skipped | - |
| negativeTest | 5.373 s | |
| shouldMatchExactClassAndMethodsWildcard | 0 s | |
| - | skipped | - |
| shouldMatchMultiplePatternsComplex | 0 s | |
| - | skipped | - |
| simpleNameTestAsParallel | 5.612 s | |
| matchSimpleClassAndMethodWithWildcardPkg | 0 s | |
| - | skipped | - |
| shouldMatchMultiplePatternsAsParallel | 0 s | |
| - | skipped | - |
| shouldNotRunExcludedClassesIfIncluded | 5.898 s | |
| shouldMatchSimpleClassNameAndMethod | 0 s | |
| - | skipped | - |
| shouldMatchExactClassAndMethodPostfix | 0 s | |
| - | skipped | - |
| shouldMatchMultiplePatternsComplexAsParallel | 0 s | |
| - | skipped | - |
| matchSimpleClassAndMethodWithJavaExt | 0 s | |
| - | skipped | - |
| testRegexSuccessTwo | 0 s | |
| - | TestNG does not support regex method patterns | - |
| regexClassAndMethod | 0 s | |
| - | TestNG does not support regex method patterns | - |
EnvironmentVariableIT
| environmentVariable | 2.099 s |
TestNgParallelWithAnnotationsIT
| testTestNgGroupThreadParallel | 8.873 s |
Surefire979WrongClassLoaderIT
| wrongClassloaderUSedInSmartStacktraceparser | 3.268 s | |
| wrongClassloaderUSedInSmartStacktraceparserJunit5 | 3.099 s |
JUnit4PlatformStreamCorruptionIT
| warningIsNotEmitted | 1.913 s | |
| warningIsNotEmittedWithJulToLog4j | 0 s | |
| - | https://issues.apache.org/jira/browse/SUREFIRE-1659?focusedCommentId=17374005&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-17374005 | - |
| warningIsNotEmittedWithJulToSlf4j | 2.185 s |
Surefire1004RunTestFromDependencyJarsTypeAndClassifierIT
| shouldScanAndRunTestsInDependencyJars | 2.418 s |
EnvironmentVariablesIT
| testWhenUseSystemClassLoader | 2.333 s | |
| testExcludedEnv | 5.565 s | |
| testWhenDontUseSystemClassLoader | 2.367 s |
Surefire1211JUnit4TestNgIT
| withoutJUnit | 5.744 s | |
| withJUnit | 2.444 s |
Surefire943ReportContentIT
| test_noParallel | 8.272 s | |
| test_parallelBoth | 4.439 s |
Surefire628ConsoleOutputBeforeAndAfterClassIT
| testJunit3ParallelBuildResultCount | 2.499 s |
ForkCountMultiModuleIT
| testForkCountOneNoReuse | 9.922 s | |
| testForkCountTwoNoReuse | 7.406 s | |
| testForkCountTwoReuse | 6.542 s | |
| testForkCountOneReuse | 7.969 s |
ArchUnit4IT
| simpleCucumberUsage | 8.450 s |
Surefire3529LibraryClassOrdererIT
| runOrderShouldKeepClassOrdererFromJunitPlatformProperties | 2.696 s |
Surefire2065IT
| shouldNotDetectFlakyTestsWhenRunningOnlyJunit4 | 2.297 s | |
| shouldNotDetectFlakyTestsWhenRunningOnlyJunit5 | 2.407 s | |
| shouldNotDetectFlakyTestsWhenCombiningJunit4And5Tests | 2.601 s |
Surefire1744AlwaysIncludeOutputLogsIT
| testAlwaysIncludeOutputLogs | 2.206 s |
SpockIT
| test | 0 s | |
| - | skipped | - |
Surefire2151ToolchainForkDiscoveryIT
| newerToolchainJdkAcrossMultipleForks | 0 s | |
| - | skipped | - |
| reuseForksFalseWithToolchainRunsAllTests | 5.786 s | |
| forkCountGreaterThanOneWithToolchainRunsAllTests | 7.757 s |
AggregateReportIT
| aggregateReport | 10.28 s |
Surefire3465IT
ClassPathOrderIT
| classPathOrder | 2.533 s |
Surefire1364SystemPropertiesIT
| testNg | 5.773 s | |
| junit4Forked | 5.726 s | |
| testNgInProcess | 8.177 s | |
| junit4InProcess | 6.691 s |
JUnit4PlatformRerunFailingTestsIT
Surefire1295AttributeJvmCrashesToTestsIT
Surefire1737IT
| selectJUnit5UsingConfiguredProviderWithPlatformRunner | 1.899 s |
Surefire377TestNgAndJUnit4TogetherIT
| testTestNgAndJUnit4Together | 2.472 s | |
| testTestNgAndJUnitTogether | 2.605 s |
SurefireJUnit4MethodParallelWithSuiteCountIT
| testMethodsParallelWithSuite | 4.701 s | |
| testClassesParallelWithSuite | 8.259 s |
Junit5ModulePathIT
| testModulePathWithSpaces | 2.358 s | |
| testModulePath | 2.699 s |
JUnit447RerunFailingTestWithCucumberIT
Surefire3460IT
| printFromNullTcclThread | 3.033 s |
Surefire862MissingSummaryFilesIT
| missingSummaryFilesAreIgnored | 1.627 s |
Surefire2300BeforeAllAssumptionIT
| reportsTestsAbortedByBeforeAllAssumptionAsSkipped | 1.991 s |
ClasspathScopeFilteringIT
| additionalClasspath | 3.452 s |
Surefire1367AssumptionLogsIT
| shouldSeeLogsInPlugin | 3.990 s | |
| shouldSeeLogsParallelInPlugin | 0 s | |
| - | https://github.com/apache/maven-surefire/issues/3242 | - |
| shouldSeeLogsParallelForked | 0 s | |
| - | https://github.com/apache/maven-surefire/issues/3242 | - |
| shouldSeeLogsForked | 5.956 s |
Surefire985ParameterizedRunnerAndCategoriesIT
| test | 2.914 s |
Surefire3446IT
| shouldRunSelectedNestedClass | 3.344 s |
SmartStackTraceIT
| misg | 2.184 s |
JUnit4PlatformIT
Surefire975DefaultVMEncodingIT
| runWithRussian1251 | 5.905 s |
Surefire3456PreferIPv4StackIT
| preferIPv4StackIsAppliedBeforeNetworkingIsInitialized | 2.957 s |
CheckTestNg740ParallelIT
| withTestNG740AndParallelSetWithoutThreadCount | 3.790 s | |
| withTestNG740AndParallelSet | 2.708 s | |
| withTestNGParallelTests | 2.851 s | |
| withTestNGParallelInstances | 3.178 s |
Surefire3468SpockGroupsIT
| groupsShouldOnlyRunSlowTestsOfEveryEngine | 4.998 s | |
| excludedGroupsShouldSkipSlowTestsOfEveryEngine | 3.788 s |
Surefire260TestWithIdenticalNamesIT
| testWithIdenticalNames | 5.854 s |
Surefire832ProviderSelectionIT
| testJUnitRunCategoryAB | 2.606 s |
Surefire847AdditionalFailureIT
| testJUnitRunCategoryAB | 2.620 s |
Surefire2274FailsafeFlakeCountIT
| failsafeVerifyFailsWhenFlakeCountExceedsLimit | 2.154 s |
ForkConsoleOutputIT
| printSummaryTrueWithRedirect | 5.306 s | |
| printSummaryFalseWithoutRedirect | 5.840 s | |
| printSummaryTrueWithoutRedirect | 5.471 s | |
| printSummaryFalseWithRedirect | 4.605 s |
Surefire2241JUnitParamsRerunIT
| identicallyReportedJUnitParamsTestsRemainDistinctDuringRerun | 2.248 s |
Surefire649EmptyStringSystemPropertiesIT
| systemPropertyVariables | 2.893 s | |
| systemProperties | 2.719 s |
Surefire613TestCountInParallelIT
| testParallelBuildResultCount | 2.924 s |
Surefire1095NpeInRunListenerIT
| testRunStartedWithJUnit4 | 2.178 s |
Surefire801ForkNeverClassLoaderIT
| testShouldBeOkWithForkNever | 1.950 s |
Surefire1733JUnit4IT
| test | 4.032 s |
TestMultipleMethodPatternsTestNGIncludesIT
| shouldNotRunExcludedClassesAndMethods | 0 s | |
| - | skipped | - |
| shouldMatchExactClassAndMethodCharacters | 0 s | |
| - | skipped | - |
| shouldMatchExactClassAndMethodWildcard | 0 s | |
| - | skipped | - |
| testSuccessTwo | 0 s | |
| - | skipped | - |
| simpleNameTest | 7.092 s | |
| simpleNameTestWithJavaExt | 7.936 s | |
| regexClass | 7.368 s | |
| shouldNotRunExcludedClasses | 7.613 s | |
| shouldNotRunExcludedMethods | 0 s | |
| - | skipped | - |
| simpleNameTestWithJavaExtWildcardPkg | 6.218 s | |
| shouldMatchMultiplePatterns | 0 s | |
| - | skipped | - |
| shouldMatchExactClassAndMethodsPostfix | 0 s | |
| - | skipped | - |
| simpleNameTestWithWildcardPkg | 5.516 s | |
| shouldMatchWildcardPackageAndClassAndMethod | 0 s | |
| - | skipped | - |
| shouldMatchExactClassAndMultipleMethods | 0 s | |
| - | skipped | - |
| fullyQualifiedTest | 6.001 s | |
| matchSimpleClassAndMethodWithJavaExtWildcardPkg | 0 s | |
| - | skipped | - |
| negativeTest | 4.702 s | |
| shouldMatchExactClassAndMethodsWildcard | 0 s | |
| - | skipped | - |
| shouldMatchMultiplePatternsComplex | 0 s | |
| - | skipped | - |
| simpleNameTestAsParallel | 5.884 s | |
| matchSimpleClassAndMethodWithWildcardPkg | 0 s | |
| - | skipped | - |
| shouldMatchMultiplePatternsAsParallel | 0 s | |
| - | skipped | - |
| shouldNotRunExcludedClassesIfIncluded | 6.336 s | |
| shouldMatchSimpleClassNameAndMethod | 0 s | |
| - | skipped | - |
| shouldMatchExactClassAndMethodPostfix | 0 s | |
| - | skipped | - |
| shouldMatchMultiplePatternsComplexAsParallel | 0 s | |
| - | skipped | - |
| matchSimpleClassAndMethodWithJavaExt | 0 s | |
| - | skipped | - |
| testRegexSuccessTwo | 0 s | |
| - | TestNG does not support regex method patterns | - |
| regexClassAndMethod | 0 s | |
| - | TestNG does not support regex method patterns | - |
Surefire1396CustomProviderClassPathIT
| pluggableProviderClasspathCorrect | 7.282 s |
Surefire1028UnableToRunSingleIT
| methodFilteringParallelExecution | 2.666 s |
Surefire3462TestNgSuiteListenerIT
| testNgOnlyProjectScansWithoutWarning | 2.909 s | |
| suiteListenerIsNotInvokedOncePerScannedClass | 3.028 s |
Surefire3532MainModuleRequiresJUnitIT
| junit5 | 3.041 s | |
| junit6 | 3.378 s |
ClasspathFilteringIT
| additionalClasspath | 3.414 s |
Failure Details
[Summary] [Package List] [Test Cases]
