Fork me on GitHub

Failsafe Report

Summary

[Summary] [Package List] [Test Cases]


Tests Errors Failures Skipped Success Rate Time
800 0 0 154 80.8% 3003 s

Note: failures are anticipated and checked for with assertions while errors are unanticipated.


Package List

[Summary] [Package List] [Test Cases]


Package Tests Errors Failures Skipped Success Rate Time
org.apache.maven.surefire.its 568 0 0 148 73.9% 1954 s
org.apache.maven.surefire.its.jiras 232 0 0 6 97.4% 1049 s

Note: package statistics are not computed recursively, they only sum up all of its testsuites numbers.

org.apache.maven.surefire.its

- Class Tests Errors Failures Skipped Success Rate Time
CrashDetectionIT 3 0 0 0 100% 7.947 s
TestMethodPatternIT 10 0 0 0 100% 24.42 s
IncludesExcludesFromFileJunit5IT 6 0 0 0 100% 11.95 s
IncludesExcludesIT 3 0 0 0 100% 6.281 s
CucumberIT 1 0 0 0 100% 3.548 s
JUnit4RunListenerIT 2 0 0 0 100% 3.952 s
WorkingDirectoryIsInvalidPropertyIT 1 0 0 0 100% 1.643 s
CheckSingleTestIT 4 0 0 0 100% 9.834 s
JUnit4IgnoreIT 2 0 0 0 100% 3.959 s
GroupsWithTestNgOnClasspathIT 5 0 0 0 100% 12.95 s
JUnit4PlatformFailingBeforeAllRerunIT 2 0 0 0 100% 4.582 s
IncludesExcludesFromFileIT 6 0 0 0 100% 11.89 s
JUnit447ConcurrencyIT 1 0 0 0 100% 3.039 s
Surefire2260NonUniqueScenariosIT 1 0 0 0 100% 2.271 s
CheckTestNgBeforeMethodIT 1 0 0 0 100% 2.660 s
JUnit447RedirectOutputIT 2 0 0 0 100% 4.414 s
MultiModuleProjectWithJPMSIT 1 0 0 0 100% 4.220 s
CheckTestNgListenerReporterIT 2 0 0 0 100% 4.622 s
JUnit4ForkAlwaysStaticInitPollutionIT 1 0 0 0 100% 2.476 s
UseIsolatedClassLoaderIT 1 0 0 0 100% 2.252 s
CucumberJUnit4VintageIT 1 0 0 0 100% 2.963 s
JUnit447WithCucumberIT 2 0 0 0 100% 3.916 s
AssumptionFailureReportIT 1 0 0 0 100% 8.142 s
JUnit4FailingAfterClassIT 2 0 0 0 100% 4.154 s
UnicodeTestNamesIT 1 0 0 0 100% 3.120 s
JUnit4RerunFailingTestsIT 5 0 0 0 100% 40.60 s
TestNgGroupsIT 5 0 0 0 100% 12.10 s
CheckTestNgVersionsIT 4 0 0 2 50.0% 3.943 s
RunOrderIT 11 0 0 0 100% 41.63 s
AdditionalClasspathForkIT 1 0 0 0 100% 9.106 s
Surefire1602IT 1 0 0 0 100% 5.076 s
CheckTestNgPathWithSpacesIT 1 0 0 0 100% 2.446 s
CheckTestNgBeforeMethodFailureIT 1 0 0 0 100% 3.104 s
ConsoleOutputIT 8 0 0 0 100% 114.2 s
AdditionalClasspathIT 2 0 0 0 100% 11.57 s
NoRunnableTestsInClassIT 1 0 0 0 100% 2.141 s
JUnit5TestExecutionListenerIT 1 0 0 0 100% 2.153 s
CheckTestFailIfNoTestsForkCountIT 6 0 0 0 100% 13.19 s
IncludesExcludesJunit5IT 3 0 0 0 100% 6.272 s
AbstractTestCaseIT 1 0 0 0 100% 8.346 s
TimeoutForkedTestIT 1 0 0 0 100% 3.247 s
JUnit4UnsupportedVersionsIT 2 0 0 0 100% 2.958 s
RunOrderParallelForksIT 11 0 0 0 100% 70.56 s
ForkCountIT 16 0 0 0 100% 177.9 s
Surefire2239TestNgRerunIT 1 0 0 0 100% 2.961 s
TestMultipleMethodsIT 1 0 0 0 100% 2.915 s
WorkingDirectoryMissingIT 1 0 0 0 100% 2.304 s
UmlautDirIT 4 0 0 0 100% 28.87 s
PlainOldJavaClasspathIT 1 0 0 0 100% 2.034 s
JUnit5BeforeAllContainerFailureIT 1 0 0 0 100% 1.832 s
TwoTestCasesIT 2 0 0 0 100% 5.089 s
WorkingDirectoryIT 4 0 0 0 100% 8.575 s
CheckTestFailIfNoTestsIT 2 0 0 0 100% 4.591 s
JUnit4PlatformEnginesIT 73 0 0 0 100% 177.3 s
TestNgSuccessPercentageIT 1 0 0 1 0% 0 s
SiblingAggregatorIT 1 0 0 0 100% 2.597 s
XmlReporterRunTimeIT 2 0 0 0 100% 35.10 s
ArgLinePropertiesIT 1 0 0 0 100% 9.754 s
FailFastJUnit4PlatformIT 6 0 0 0 100% 33.74 s
JUnit5FailingAfterAllIT 2 0 0 0 100% 4.284 s
Java9FullApiIT 3 0 0 0 100% 20.14 s
ForkConsoleOutputWithErrorsIT 1 0 0 0 100% 5.632 s
ReportersIT 1 0 0 0 100% 1.979 s
FailFastJUnit4IT 7 0 0 0 100% 150.4 s
ArgLineIT 1 0 0 0 100% 7.911 s
DefaultConfigurationIT 1 0 0 0 100% 2.525 s
PlexusConflictIT 2 0 0 0 100% 3.837 s
TestMultipleMethodPatternsIncludesExcludesIT 30 0 0 20 33.3% 63.37 s
TestMultipleMethodPatternsTestNGIT 30 0 0 3 90.0% 74.09 s
ResultCountingIT 3 0 0 0 100% 8.592 s
LongWindowsPathIT 1 0 0 1 0% 0.013 s
CheckTestNgExecuteErrorIT 1 0 0 0 100% 2.573 s
ReportTestTimestampIT 2 0 0 0 100% 4.063 s
FailFastTestNgIT 4 0 0 0 100% 103.5 s
SystemPropertiesTestIT 2 0 0 0 100% 5.457 s
JUnit448TestCategoriesIT 8 0 0 0 100% 28.79 s
ModulePathIT 2 0 0 0 100% 5.478 s
JUnit447ParallelIT 59 0 0 59 0% 0.003 s
CheckTestNgCustomObjectFactoryIT 1 0 0 1 0% 0 s
CheckTestNgGroupThreadParallelIT 1 0 0 0 100% 2.270 s
TestMultipleMethodPatternsIT 30 0 0 20 33.3% 61.57 s
CheckTestNgReportTestIT 3 0 0 0 100% 21.57 s
JUnit4VersionsIT 4 0 0 0 100% 7.481 s
TestSingleMethodIT 6 0 0 0 100% 14.04 s
TestMultipleMethodPatternsTestNGIncludesExcludesIT 30 0 0 20 33.3% 64.82 s
EnvironmentVariableIT 1 0 0 0 100% 2.100 s
TestNgParallelWithAnnotationsIT 1 0 0 0 100% 8.873 s
JUnit4PlatformStreamCorruptionIT 3 0 0 1 66.7% 4.100 s
EnvironmentVariablesIT 3 0 0 0 100% 10.27 s
ForkCountMultiModuleIT 4 0 0 0 100% 31.84 s
ArchUnit4IT 1 0 0 0 100% 8.488 s
AggregateReportIT 1 0 0 0 100% 10.33 s
ClassPathOrderIT 1 0 0 0 100% 2.533 s
JUnit4PlatformRerunFailingTestsIT 7 0 0 0 100% 44.92 s
Junit5ModulePathIT 2 0 0 0 100% 5.059 s
JUnit447RerunFailingTestWithCucumberIT 6 0 0 0 100% 15.80 s
Surefire2300BeforeAllAssumptionIT 1 0 0 0 100% 1.991 s
ClasspathScopeFilteringIT 1 0 0 0 100% 3.454 s
SmartStackTraceIT 1 0 0 0 100% 2.187 s
JUnit4PlatformIT 15 0 0 0 100% 31.94 s
CheckTestNg740ParallelIT 4 0 0 0 100% 12.53 s
Surefire2274FailsafeFlakeCountIT 1 0 0 0 100% 2.154 s
ForkConsoleOutputIT 4 0 0 0 100% 21.22 s
Surefire2241JUnitParamsRerunIT 1 0 0 0 100% 2.248 s
TestMultipleMethodPatternsTestNGIncludesIT 30 0 0 20 33.3% 64.70 s
ClasspathFilteringIT 1 0 0 0 100% 3.414 s

org.apache.maven.surefire.its.jiras

- Class Tests Errors Failures Skipped Success Rate Time
Surefire257NotRerunningTestsIT 1 0 0 0 100% 4.429 s
Surefire162CharsetProviderIT 1 0 0 0 100% 3.232 s
Surefire1082ParallelJUnit4ParameterizedIT 2 0 0 0 100% 8.531 s
Surefire2117XmlReportingNestedIT 3 0 0 0 100% 8.661 s
Surefire3511JUnit4OneClassAtATimeIT 1 0 0 0 100% 2.838 s
Surefire2006ShadefireTransformersIT 1 0 0 0 100% 2.354 s
Surefire570MultipleReportDirectoriesIT 2 0 0 0 100% 14.23 s
Surefire1534ReuseForksFalseWithJavaModuleIT 3 0 0 0 100% 18.52 s
Surefire920TestFailureIgnoreWithTimeoutIT 2 0 0 0 100% 6.425 s
Surefire1144XmlRunTimeIT 1 0 0 0 100% 4.128 s
Surefire812Log4JClassLoaderIT 1 0 0 0 100% 2.067 s
Surefire500PuzzlingErrorIT 1 0 0 0 100% 2.627 s
Surefire224WellFormedXmlFailuresIT 1 0 0 0 100% 2.325 s
Surefire1787JUnit45IT 9 0 0 0 100% 24.31 s
Surefire1490ReportTitleDescriptionIT 2 0 0 0 100% 12.38 s
Surefire1570ModularFailsafeIT 1 0 0 0 100% 6.004 s
Surefire674BuildFailingWhenFailsafeErrorsIT 1 0 0 0 100% 3.332 s
Surefire1153IncludesAndSpecifiedTestIT 2 0 0 0 100% 5.414 s
Surefire1135ImproveIgnoreMessageForTestNGIT 1 0 0 0 100% 2.469 s
Surefire2095FailsafeJvmCrashShouldNotBeIgnoredIT 1 0 0 0 100% 1.928 s
Surefire735ForkFailWithRedirectConsoleOutputIT 2 0 0 0 100% 3.800 s
Surefire673MockitoIT 1 0 0 0 100% 3.370 s
Surefire1185DoNotSpawnTestsIT 1 0 0 0 100% 2.424 s
Surefire1209RerunAndForkCountIT 2 0 0 0 100% 21.09 s
Surefire3178FailIfNoTestsIT 1 0 0 0 100% 1.951 s
Surefire1055CorrectConcurrentTestCountIT 1 0 0 0 100% 2.509 s
Surefire818NpeIgnoresTestsIT 1 0 0 0 100% 2.358 s
Surefire510TestClassPathForkModesIT 2 0 0 0 100% 5.195 s
Surefire1585IT 2 0 0 0 100% 6.315 s
Surefire972BizarreNoClassDefIT 1 0 0 0 100% 3.286 s
Surefire3503ExcludedGroupsWithJUnit4IT 2 0 0 0 100% 5.580 s
Surefire634UnsettableSystemPropertiesWarningIT 1 0 0 0 100% 2.157 s
Surefire772NoSurefireReportsIT 4 0 0 0 100% 7.780 s
Surefire740TruncatedCommaIT 1 0 0 0 100% 5.740 s
Surefire1264IT 2 0 0 0 100% 31.65 s
Surefire995CategoryInheritanceIT 7 0 0 0 100% 15.19 s
Surefire2298IT 1 0 0 0 100% 2.357 s
Surefire621TestCountingJunit3InParallelIT 5 0 0 0 100% 14.39 s
Surefire839TestWithoutCategoriesIT 2 0 0 0 100% 5.131 s
Surefire3210ReportNameSuffixIT 1 0 0 0 100% 2.793 s
Surefire1383ScanSessionDependenciesIT 1 0 0 0 100% 2.213 s
Surefire1179IT 1 0 0 0 100% 6.369 s
Surefire1152RerunFailingTestsInSuiteIT 1 0 0 0 100% 3.072 s
Surefire376TestNgAfterSuiteFailureIT 1 0 0 0 100% 2.248 s
Surefire1934OutErrElementsIT 2 0 0 0 100% 5.158 s
Surefire1053SystemPropertiesIT 2 0 0 0 100% 8.045 s
Surefire946KillMainProcessInReusableForkIT 6 0 0 0 100% 161.1 s
Surefire1881IT 1 0 0 0 100% 4.974 s
Surefire772SpecifiedReportsIT 3 0 0 0 100% 5.651 s
Surefire1967CheckTestNgMethodParallelOrderingIT 1 0 0 0 100% 2.738 s
Surefire838TimeoutExtensionIT 1 0 0 0 100% 15.06 s
Surefire705ParallelForkTimeoutIT 1 0 0 0 100% 3.662 s
Surefire685CommaSeparatedIncludesIT 1 0 0 0 100% 2.587 s
Surefire2032NestedSkippedIT 1 0 0 0 100% 2.500 s
Surefire1733TestngIT 1 0 0 0 100% 4.008 s
Surefire1080ParallelForkDoubleTestIT 1 0 0 0 100% 2.655 s
Surefire1766SkipTestsDecoupledIT 4 0 0 0 100% 11.09 s
Surefire1024VerifyFailsafeIfTestedIT 1 0 0 0 100% 2.483 s
Surefire806SpecifiedTestControlsIT 3 0 0 2 33.3% 2.127 s
Surefire569RunTestFromDependencyJarsIT 1 0 0 0 100% 3.054 s
Surefire817SystemExitIT 1 0 0 0 100% 2.252 s
Surefire1202RerunAndSkipIT 1 0 0 0 100% 16.07 s
Surefire1265Java9IT 1 0 0 0 100% 2.350 s
Surefire926FailureWith2ProvidersIT 1 0 0 0 100% 2.493 s
Surefire1136CwdPropagationInForkedModeIT 1 0 0 0 100% 2.453 s
Surefire803MultiFailsafeExecsIT 2 0 0 0 100% 7.815 s
Surefire1712ExtractedModulenameWithoutASMIT 1 0 0 0 100% 2.868 s
Surefire772BothReportsIT 3 0 0 0 100% 5.949 s
Surefire1260NewTestsPatternIT 1 0 0 0 100% 2.888 s
Surefire1146RerunFailedAndParameterizedIT 1 0 0 0 100% 2.442 s
Surefire901MIssingResultfileWhenNoTestsIT 1 0 0 0 100% 1.911 s
Surefire1278GroupNameEndingIT 1 0 0 0 100% 2.271 s
Surefire674BuildFailingWhenErrorsIT 1 0 0 0 100% 2.773 s
Surefire1993JpmsProvidingModulesIT 1 0 0 0 100% 3.427 s
Surefire2190JUnit4IT 1 0 0 0 100% 2.828 s
Surefire2143ParameterizedSkippedIT 2 0 0 0 100% 5.038 s
Surefire1914XmlReportingParameterizedTestIT 3 0 0 0 100% 9.356 s
Surefire2036IT 1 0 0 0 100% 2.395 s
Surefire141PluggableProvidersIT 4 0 0 0 100% 29.29 s
Surefire3380ForkedSourceQualifiedNameIT 3 0 0 0 100% 21.87 s
Surefire733AllOverrridesCapturedIT 1 0 0 0 100% 2.155 s
Surefire1041FailingJUnitRunnerIT 1 0 0 0 100% 2.590 s
Surefire855AllowFailsafeUseArtifactFileIT 4 0 0 0 100% 23.29 s
Surefire1360PropertiesElementIT 2 0 0 0 100% 4.749 s
Surefire408ManualProviderSelectionIT 1 0 0 0 100% 2.079 s
Surefire3511NestedSuitesIT 1 0 0 0 100% 2.636 s
Surefire1122ParallelAndFlakyTestsIT 3 0 0 0 100% 6.107 s
Surefire1964IT 2 0 0 0 100% 4.224 s
Surefire1036NonFilterableJUnit4RunnerWithCategoriesIT 1 0 0 0 100% 2.714 s
Surefire412InnerClassTestIT 1 0 0 0 100% 2.609 s
Surefire772NoFailsafeReportsIT 4 0 0 0 100% 7.255 s
Surefire146ForkPerTestNoSetupIT 1 0 0 0 100% 2.774 s
Surefire697NiceSummaryIT 1 0 0 0 100% 2.661 s
Surefire1643IT 1 0 0 0 100% 25.45 s
Surefire979WrongClassLoaderIT 2 0 0 0 100% 6.370 s
Surefire1004RunTestFromDependencyJarsTypeAndClassifierIT 1 0 0 0 100% 2.419 s
Surefire1211JUnit4TestNgIT 2 0 0 0 100% 8.189 s
Surefire943ReportContentIT 2 0 0 0 100% 12.71 s
Surefire628ConsoleOutputBeforeAndAfterClassIT 1 0 0 0 100% 2.501 s
Surefire3529LibraryClassOrdererIT 1 0 0 0 100% 2.701 s
Surefire2065IT 3 0 0 0 100% 7.306 s
Surefire1744AlwaysIncludeOutputLogsIT 1 0 0 0 100% 2.207 s
SpockIT 1 0 0 1 0% 0.008 s
Surefire2151ToolchainForkDiscoveryIT 3 0 0 1 66.7% 13.55 s
Surefire3465IT 4 0 0 0 100% 10.77 s
Surefire1364SystemPropertiesIT 4 0 0 0 100% 26.37 s
Surefire1295AttributeJvmCrashesToTestsIT 9 0 0 0 100% 91.06 s
Surefire1737IT 1 0 0 0 100% 1.901 s
Surefire377TestNgAndJUnit4TogetherIT 2 0 0 0 100% 5.078 s
SurefireJUnit4MethodParallelWithSuiteCountIT 2 0 0 0 100% 12.96 s
Surefire3460IT 1 0 0 0 100% 3.038 s
Surefire862MissingSummaryFilesIT 1 0 0 0 100% 1.627 s
Surefire1367AssumptionLogsIT 4 0 0 2 50.0% 9.949 s
Surefire985ParameterizedRunnerAndCategoriesIT 1 0 0 0 100% 2.915 s
Surefire3446IT 1 0 0 0 100% 3.346 s
Surefire975DefaultVMEncodingIT 1 0 0 0 100% 5.906 s
Surefire3456PreferIPv4StackIT 1 0 0 0 100% 2.959 s
Surefire3468SpockGroupsIT 2 0 0 0 100% 8.791 s
Surefire260TestWithIdenticalNamesIT 1 0 0 0 100% 5.856 s
Surefire832ProviderSelectionIT 1 0 0 0 100% 2.607 s
Surefire847AdditionalFailureIT 1 0 0 0 100% 2.620 s
Surefire649EmptyStringSystemPropertiesIT 2 0 0 0 100% 5.613 s
Surefire613TestCountInParallelIT 1 0 0 0 100% 2.925 s
Surefire1095NpeInRunListenerIT 1 0 0 0 100% 2.179 s
Surefire801ForkNeverClassLoaderIT 1 0 0 0 100% 1.958 s
Surefire1733JUnit4IT 1 0 0 0 100% 4.034 s
Surefire1396CustomProviderClassPathIT 1 0 0 0 100% 9.138 s
Surefire1028UnableToRunSingleIT 1 0 0 0 100% 2.668 s
Surefire3462TestNgSuiteListenerIT 2 0 0 0 100% 5.939 s
Surefire3532MainModuleRequiresJUnitIT 2 0 0 0 100% 6.422 s

Test Cases

[Summary] [Package List] [Test Cases]

CrashDetectionIT

hardCrashInReusableFork 2.439 s
crashInReusableFork 2.955 s
crashInFork 2.550 s

TestMethodPatternIT

testMethodPatternAfter(String)[1] 2.591 s
testMethodPatternAfter(String)[2] 2.009 s
testJUnit4WithCategoryFilter(String)[1] 2.439 s
testJUnit4WithCategoryFilter(String)[2] 2.171 s
testJUnit4(String)[1] 2.496 s
testJUnit4(String)[2] 2.278 s
testTestNGMethodPattern(String)[1] 2.535 s
testTestNGMethodPattern(String)[2] 2.206 s
testTestNgMethodBefore(String)[1] 2.538 s
testTestNgMethodBefore(String)[2] 3.121 s

IncludesExcludesFromFileJunit5IT

testSimpleMixed 2.052 s
testMissingExcludes 1.696 s
testRegex 2.230 s
testPath 2.123 s
testMissingIncludes 1.662 s
testSimple 2.182 s

IncludesExcludesIT

testPathBasedIncludesExcludes 2.128 s
testIncludesExcludes 2.084 s
testRegexIncludesExcludes 2.066 s

CucumberIT

simpleCucumberUsage 3.546 s

JUnit4RunListenerIT

testJUnit4RunListener 2.027 s
testRunlistenerJunitCoreProvider 1.923 s

WorkingDirectoryIsInvalidPropertyIT

testWorkingDirectory 1.643 s

Surefire257NotRerunningTestsIT

shouldNotRerun 4.428 s

CheckSingleTestIT

singleTestDotJava 3.460 s
singleTestNonExistentOverride 2.049 s
singleTestNonExistent 1.862 s
singleTest 2.456 s

Surefire162CharsetProviderIT

testCharsetProvider 3.229 s

Surefire1082ParallelJUnit4ParameterizedIT

checkClassesRunParallel 4.301 s
checkOutFileClassesRunParallel 4.225 s

JUnit4IgnoreIT

testJunit4Ignore 1.949 s
testJunit4ParallelIgnore 2.008 s

Surefire2117XmlReportingNestedIT

testXmlReport(String)[1] 2.739 s
testXmlReport(String)[2] 2.566 s
testXmlReport(String)[3] 3.337 s

Surefire3511JUnit4OneClassAtATimeIT

runsEachTestClassOnItsOwn 2.836 s

Surefire2006ShadefireTransformersIT

shadefireShouldBeUsed 2.351 s

GroupsWithTestNgOnClasspathIT

groupsFilterTestNgAndJupiterTests 2.840 s
groupsWhichAreNotTagExpressionsOnlyFilterTestNgTests 2.576 s
groupsOnlyRunTaggedJupiterTestsWhenTestNgIsOnTheClasspath 2.738 s
excludedGroupsFilterTestNgAndJupiterTests 2.666 s
excludedGroupsSkipTaggedJupiterTestsWhenTestNgIsOnTheClasspath 2.128 s

Surefire570MultipleReportDirectoriesIT

testReportWithAggregate 7.685 s
testReportWithoutAggregate 6.540 s

JUnit4PlatformFailingBeforeAllRerunIT

testBeforeAllFailures 2.415 s
testRecoveredBeforeAllDoesNotFailBuild 2.164 s

IncludesExcludesFromFileIT

testSimpleMixed 2.329 s
testMissingExcludes 1.597 s
testRegex 2.289 s
testPath 1.987 s
testMissingIncludes 1.522 s
testSimple 2.162 s

JUnit447ConcurrencyIT

test47 3.038 s

Surefire2260NonUniqueScenariosIT

identicallyNamedCucumberScenariosRemainDistinctDuringRerun 2.269 s

Surefire1534ReuseForksFalseWithJavaModuleIT

testExecuteWithReuseForksFalseWithJavaModule 8.624 s
testExecuteWithReuseForksFalseWithJavaModuleWithFilter 7.627 s
testExecuteWithZeroForkCountWithJavaModule 2.270 s

Surefire920TestFailureIgnoreWithTimeoutIT

timeoutInForkWithBuildFail 3.232 s
timeoutInForkWithNoBuildFail 3.188 s

CheckTestNgBeforeMethodIT

testNgBeforeMethod 2.658 s

JUnit447RedirectOutputIT

testClassesParallel 2.019 s
testPrintSummaryTrueWithRedirect 2.392 s

Surefire1144XmlRunTimeIT

testXmlRunTime 4.125 s

MultiModuleProjectWithJPMSIT

test 4.218 s

Surefire812Log4JClassLoaderIT

testJunit3ParallelBuildResultCount 2.065 s

Surefire500PuzzlingErrorIT

testBuildFailingWhenErrors 2.627 s

CheckTestNgListenerReporterIT

testNgListenerReporter(String, String)[1] 2.314 s
testNgListenerReporter(String, String)[2] 2.273 s

JUnit4ForkAlwaysStaticInitPollutionIT

testJunit4Ignore 2.476 s

UseIsolatedClassLoaderIT

testUseSystemClassLoader 2.251 s

Surefire224WellFormedXmlFailuresIT

testWellFormedXmlFailures 2.325 s

Surefire1787JUnit45IT

apiAndEngine 2.616 s
testNgWithJupiterApi 2.586 s
testNg 2.559 s
junit5Suite 2.672 s
bothEngines 2.404 s
selectJUnit4 2.490 s
selectJUnit5 2.593 s
testNgWithJupiterEngine 3.207 s
bothApis 3.177 s

Surefire1490ReportTitleDescriptionIT

shouldHaveCustomizedReportTitleAndDescription 6.096 s
shouldHaveDefaultReportTitleAndDescription 6.275 s

CucumberJUnit4VintageIT

cucumberScenariosCountedOnPlatform17 2.963 s

Surefire1570ModularFailsafeIT

shouldRunWithJupiterApi 6.002 s

JUnit447WithCucumberIT

testWithParallelClasses 1.911 s
testWithoutParallel 2.004 s

Surefire674BuildFailingWhenFailsafeErrorsIT

testBuildFailingWhenErrors 3.332 s

AssumptionFailureReportIT

testWriteSkippedMessageToReport 8.110 s

JUnit4FailingAfterClassIT

testAfterClassFailureWithRerunDoesNotRerunPassingTests 2.023 s
testAfterClassFailureIsReported 2.129 s

UnicodeTestNamesIT

checkFileNamesWithUnicode 3.119 s

Surefire1153IncludesAndSpecifiedTestIT

testSpecifiedTestInIncludes 2.346 s
testSpecifiedTestNotInIncludes 3.065 s

JUnit4RerunFailingTestsIT

testRerunFailingErrorTestsFalse 7.955 s
testRerunFailingErrorTestsWithOneRetry 8.231 s
testRerunFailingErrorTestsTwoRetry 7.604 s
testRerunOneTestMethod 8.124 s
testRerunOneTestClass 8.681 s

TestNgGroupsIT

testExclusion 2.630 s
testGroupsAndExclusion 2.622 s
groupsWithDash 2.404 s
testOnlyGroups 2.194 s
groupsBySimpleRegex 2.252 s

Surefire1135ImproveIgnoreMessageForTestNGIT

testNgReport688 2.468 s

CheckTestNgVersionsIT

test751 0 s
- Disable for now as runOrder is not implemented for TestNG in Surefire -
test69136 1.926 s
test6143 0 s
- Disable for now as runOrder is not implemented for TestNG in Surefire -
test6821 2.011 s

Surefire2095FailsafeJvmCrashShouldNotBeIgnoredIT

mavenShouldFail 1.928 s

RunOrderIT

testRandomJUnit4DifferentSeed 6.707 s
testRandomSeedPassedToJUnit5 3.956 s
testNonExistingRunOrderJUnit4 1.503 s
testRandomJUnit4SameSeed 12.65 s
testRandomJUnit4PrintSeedWithGivenSeed 2.299 s
testReverseAlphabeticalJUnit4 2.101 s
testReverseAlphabeticalJUnit5 2.268 s
testReverseAlphabeticalJUnit6 2.260 s
testAlphabeticalJUnit4 2.586 s
testAlphabeticalJUnit5 2.466 s
testAlphabeticalJUnit6 2.826 s

AdditionalClasspathForkIT

relativeClasspathElementResolvedAgainstWorkingDirectory 9.063 s

Surefire735ForkFailWithRedirectConsoleOutputIT

vmStartFail 2.016 s
vmStartFailShouldFailBuildk 1.782 s

Surefire673MockitoIT

testBuildFailingWhenErrors 3.369 s

Surefire1602IT

nonCanonicalPath 5.074 s

CheckTestNgPathWithSpacesIT

testWithSpaces 2.444 s

Surefire1185DoNotSpawnTestsIT

doNotSpawnUnwantedTests 2.424 s

Surefire1209RerunAndForkCountIT

reusableForksJUnit 10.62 s
notReusableForksJUnit 10.47 s

CheckTestNgBeforeMethodFailureIT

testNgBeforeMethodFailure 3.095 s

ConsoleOutputIT

properNewlinesAndEncodingWithDifferentEncoding(String)[1] 2.503 s
properNewlinesAndEncodingWithDifferentEncoding(String)[2] 2.795 s
properNewlinesAndEncodingWithDefaultEncodings(String)[1] 2.637 s
properNewlinesAndEncodingWithDefaultEncodings(String)[2] 2.519 s
largerSoutThanMemory(String)[1] 53.24 s
largerSoutThanMemory(String)[2] 46.62 s
properNewlinesAndEncodingWithoutFork(String)[1] 1.906 s
properNewlinesAndEncodingWithoutFork(String)[2] 1.917 s

AdditionalClasspathIT

additionalClasspathElements 7.929 s
additionalClasspathDependencies 3.597 s

NoRunnableTestsInClassIT

testJunit3ParallelBuildResultCount 2.141 s

JUnit5TestExecutionListenerIT

testJUnit5TestExecutionListener 2.151 s

Surefire3178FailIfNoTestsIT

emptyTestClassFailsVerification 1.951 s

CheckTestFailIfNoTestsForkCountIT

dontFailIfNoTestsForkAlways 2.698 s
failIfNoTestsForkNever 2.165 s
failIfNoTestsForkAlways 2.049 s
failIfNoTestsForkOnce 2.348 s
dontFailIfNoTestsForkNever 1.655 s
dontFailIfNoTestsForkOnce 2.267 s

IncludesExcludesJunit5IT

testPathBasedIncludesExcludes 2.130 s
testIncludesExcludes 2.219 s
testRegexIncludesExcludes 1.920 s

Surefire1055CorrectConcurrentTestCountIT

testTestNgAndJUnitTogether 2.507 s

AbstractTestCaseIT

abstractTestCase 8.310 s

Surefire818NpeIgnoresTestsIT

testBuildFailingWhenErrors 2.357 s

Surefire510TestClassPathForkModesIT

testForkOnce 2.502 s
testForkAlways 2.691 s

TimeoutForkedTestIT

testTimeoutForked 3.245 s

Surefire1585IT

shouldRunWithJupiterApi 3.510 s
shouldRunWithVintage 2.804 s

Surefire972BizarreNoClassDefIT

testJunit3ParallelBuildResultCount 3.285 s

Surefire3503ExcludedGroupsWithJUnit4IT

excludedGroupsShouldSkipTaggedTests 3.062 s
groupsShouldOnlyRunTaggedTests 2.515 s

JUnit4UnsupportedVersionsIT

testJunitTemp(JUnitVersion)[1] 1.498 s
testJunitTemp(JUnitVersion)[2] 1.458 s

RunOrderParallelForksIT

testRandomJUnit4DifferentSeed 9.586 s
testRandomSeedPassedToJUnit5 4.971 s
testNonExistingRunOrderJUnit4 1.531 s
testRandomJUnit4SameSeed 20.07 s
testRandomJUnit4PrintSeedWithGivenSeed 4.291 s
testReverseAlphabeticalJUnit4 4.510 s
testReverseAlphabeticalJUnit5 4.594 s
testReverseAlphabeticalJUnit6 5.532 s
testAlphabeticalJUnit4 4.860 s
testAlphabeticalJUnit5 5.081 s
testAlphabeticalJUnit6 5.529 s

Surefire634UnsettableSystemPropertiesWarningIT

testJunit3ParallelBuildResultCount 2.156 s

Surefire772NoSurefireReportsIT

testOptionalSurefireReportGeneration 1.982 s
testSkippedSurefireReportGeneration 2.141 s
testSkipOptionalSurefireReportGeneration 1.789 s
testReportGeneration 1.865 s

ForkCountIT

testForkNever(String)[1] 7.271 s
testForkNever(String)[2] 5.840 s
testForkOncePerThreadSingleThread(String)[1] 7.167 s
testForkOncePerThreadSingleThread(String)[2] 5.622 s
testForkCountOneNoReuse(String)[1] 7.950 s
testForkCountOneNoReuse(String)[2] 6.507 s
testForkCountTwoNoReuse(String)[1] 20.22 s
testForkCountTwoNoReuse(String)[2] 11.85 s
testForkCountTwoReuse(String)[1] 19.26 s
testForkCountTwoReuse(String)[2] 12.74 s
testForkOncePerThreadTwoThreads(String)[1] 19.74 s
testForkOncePerThreadTwoThreads(String)[2] 13.14 s
testForkCountOneReuse(String)[1] 9.598 s
testForkCountOneReuse(String)[2] 8.474 s
testForkOnce(String)[1] 10.40 s
testForkOnce(String)[2] 8.552 s

Surefire2239TestNgRerunIT

rerunsTestNgTestsWithSurefireAndFailsafe 2.960 s

TestMultipleMethodsIT

testJunit44 2.913 s

Surefire740TruncatedCommaIT

testRussianLocaleReport 5.736 s

Surefire1264IT

positiveTests 14.70 s
negativeTests 16.95 s

Surefire995CategoryInheritanceIT

junit4xShouldExcludeInheritedCategory 2.569 s
junit4xShouldRunInheritedCategory 2.792 s
junit4xShouldExcludeExplicitCategory 2.067 s
junit4xShouldRunInheritedCategories 2.005 s
junit4xShouldRunExplicitCategory 1.827 s
junit4xShouldExecuteInheritedCategories 2.045 s
negativeTestShouldRunAllCategories 1.878 s

WorkingDirectoryMissingIT

testWorkingDirectory 2.302 s

Surefire2298IT

shouldNotCreateFilesForNested 2.356 s

UmlautDirIT

surefire1617WithColonInLocalRepo 17.24 s
surefire1617WithColonInProjectDir 6.066 s
testUmlautIsolatedClassLoader 2.710 s
testUmlaut 2.849 s

PlainOldJavaClasspathIT

testPlainOldJavaClasspath 2.034 s

JUnit5BeforeAllContainerFailureIT

testBeforeAllContainerFailure 1.832 s

Surefire621TestCountingJunit3InParallelIT

testJunit3ParallelBuildResultCount 2.917 s
testJunit3ParallelSuiteBuildResultCount 3.205 s
testJunit3AllParallelBuildResultCount 2.797 s
testJunit3BuildResultCount 2.584 s
testJunit3SuiteBuildResultCount 2.879 s

Surefire839TestWithoutCategoriesIT

classWithoutCategoryForked 2.825 s
classWithoutCategory 2.305 s

TwoTestCasesIT

testJunit4Suite 2.454 s
testTwoTestCases 2.631 s

WorkingDirectoryIT

testWorkingDirectory 2.439 s
testWorkingDirectoryChildOnlyNoFork 1.980 s
testWorkingDirectoryNoFork 1.736 s
testWorkingDirectoryChildOnly 2.415 s

Surefire3210ReportNameSuffixIT

reportNameSuffixIsUsedInTestcaseClassname 2.785 s

CheckTestFailIfNoTestsIT

failIfNoTests 2.616 s
dontFailIfNoTests 1.970 s

JUnit4PlatformEnginesIT

testJupiterEngineWithAssertionsFailEmptyStringParameters(String, String, String, String)[1] 2.364 s
testJupiterEngineWithAssertionsFailEmptyStringParameters(String, String, String, String)[2] 2.066 s
testJupiterEngineWithAssertionsFailEmptyStringParameters(String, String, String, String)[3] 2.439 s
testJupiterEngineWithAssertionsFailEmptyStringParameters(String, String, String, String)[4] 2.160 s
testToRegex 0.004 s
testJupiterEngineWithAssertionsFailNoParameters(String, String, String, String)[1] 2.173 s
testJupiterEngineWithAssertionsFailNoParameters(String, String, String, String)[2] 1.969 s
testJupiterEngineWithAssertionsFailNoParameters(String, String, String, String)[3] 2.201 s
testJupiterEngineWithAssertionsFailNoParameters(String, String, String, String)[4] 2.076 s
testJupiterEngineWithExceptionMessage(String, String, String, String)[1] 1.973 s
testJupiterEngineWithExceptionMessage(String, String, String, String)[2] 2.049 s
testJupiterEngineWithExceptionMessage(String, String, String, String)[3] 1.908 s
testJupiterEngineWithExceptionMessage(String, String, String, String)[4] 2.004 s
testTags(String, String, String, String)[1] 1.951 s
testTags(String, String, String, String)[2] 2.078 s
testTags(String, String, String, String)[3] 2.007 s
testTags(String, String, String, String)[4] 1.964 s
failingBeforeAllMethod(String, String, String, String)[1] 1.835 s
failingBeforeAllMethod(String, String, String, String)[2] 1.981 s
failingBeforeAllMethod(String, String, String, String)[3] 1.942 s
failingBeforeAllMethod(String, String, String, String)[4] 2.127 s
testJupiterEngineWithTestTemplateNotClassifiedAsFlake(String, String, String, String)[1] 4.037 s
testJupiterEngineWithTestTemplateNotClassifiedAsFlake(String, String, String, String)[2] 3.860 s
testJupiterEngineWithTestTemplateNotClassifiedAsFlake(String, String, String, String)[3] 3.783 s
testJupiterEngineWithTestTemplateNotClassifiedAsFlake(String, String, String, String)[4] 4.297 s
testJupiterEngineWithAssertionsFailMessage(String, String, String, String)[1] 2.079 s
testJupiterEngineWithAssertionsFailMessage(String, String, String, String)[2] 2.411 s
testJupiterEngineWithAssertionsFailMessage(String, String, String, String)[3] 2.190 s
testJupiterEngineWithAssertionsFailMessage(String, String, String, String)[4] 2.052 s
errorInBeforeAllMethod(String, String, String, String)[1] 1.973 s
errorInBeforeAllMethod(String, String, String, String)[2] 2.292 s
errorInBeforeAllMethod(String, String, String, String)[3] 2.208 s
errorInBeforeAllMethod(String, String, String, String)[4] 2.188 s
testJupiterEngineWithFailureInParameterizedSource(String, String, String, String)[1] 1.952 s
testJupiterEngineWithFailureInParameterizedSource(String, String, String, String)[2] 2.029 s
testJupiterEngineWithFailureInParameterizedSource(String, String, String, String)[3] 1.907 s
testJupiterEngineWithFailureInParameterizedSource(String, String, String, String)[4] 2.346 s
testJupiterEngineWithFailureInTestTemplateProvider(String, String, String, String)[1] 1.897 s
testJupiterEngineWithFailureInTestTemplateProvider(String, String, String, String)[2] 2.042 s
testJupiterEngineWithFailureInTestTemplateProvider(String, String, String, String)[3] 2.085 s
testJupiterEngineWithFailureInTestTemplateProvider(String, String, String, String)[4] 2.325 s
testJupiterEngineWithErrorInParameterizedSource(String, String, String, String)[1] 2.624 s
testJupiterEngineWithErrorInParameterizedSource(String, String, String, String)[2] 2.118 s
testJupiterEngineWithErrorInParameterizedSource(String, String, String, String)[3] 2.117 s
testJupiterEngineWithErrorInParameterizedSource(String, String, String, String)[4] 2.008 s
testJupiterEngine(String, String, String, String)[1] 2.675 s
testJupiterEngine(String, String, String, String)[2] 2.888 s
testJupiterEngine(String, String, String, String)[3] 2.985 s
testJupiterEngine(String, String, String, String)[4] 3.852 s
testJupiterEngineWithDisplayNames(String, String, String, String)[1] 3.260 s
testJupiterEngineWithDisplayNames(String, String, String, String)[2] 3.609 s
testJupiterEngineWithDisplayNames(String, String, String, String)[3] 3.475 s
testJupiterEngineWithDisplayNames(String, String, String, String)[4] 4.092 s
testJupiterEngineWithErrorInTestTemplateProvider(String, String, String, String)[1] 2.471 s
testJupiterEngineWithErrorInTestTemplateProvider(String, String, String, String)[2] 2.920 s
testJupiterEngineWithErrorInTestTemplateProvider(String, String, String, String)[3] 2.778 s
testJupiterEngineWithErrorInTestTemplateProvider(String, String, String, String)[4] 2.743 s
testJupiterEngineWithFailureInTestFactory(String, String, String, String)[1] 2.770 s
testJupiterEngineWithFailureInTestFactory(String, String, String, String)[2] 2.664 s
testJupiterEngineWithFailureInTestFactory(String, String, String, String)[3] 2.273 s
testJupiterEngineWithFailureInTestFactory(String, String, String, String)[4] 2.408 s
testJupiterEngineWithErrorInTestFactory(String, String, String, String)[1] 2.208 s
testJupiterEngineWithErrorInTestFactory(String, String, String, String)[2] 2.427 s
testJupiterEngineWithErrorInTestFactory(String, String, String, String)[3] 2.692 s
testJupiterEngineWithErrorInTestFactory(String, String, String, String)[4] 2.472 s
platform(String, String, String, String)[1] 2.354 s
platform(String, String, String, String)[2] 2.158 s
platform(String, String, String, String)[3] 2.283 s
platform(String, String, String, String)[4] 2.602 s
testJupiterEngineWithParameterizedTestsNotClassifiedAsFlake(String, String, String, String)[1] 2.790 s
testJupiterEngineWithParameterizedTestsNotClassifiedAsFlake(String, String, String, String)[2] 2.714 s
testJupiterEngineWithParameterizedTestsNotClassifiedAsFlake(String, String, String, String)[3] 2.217 s
testJupiterEngineWithParameterizedTestsNotClassifiedAsFlake(String, String, String, String)[4] 2.300 s

TestNgSuccessPercentageIT

testPassesWhenFailuresLessThanSuccessPercentage 0 s
- FIXME percentage attribute looks to be sypported but is failing in this case -

SiblingAggregatorIT

testSiblingAggregator 2.596 s

Surefire1383ScanSessionDependenciesIT

test 2.212 s

Surefire1179IT

suiteXmlForkCountTwoReuse 6.368 s

Surefire1152RerunFailingTestsInSuiteIT

testJUnit48Provider4 3.072 s

Surefire376TestNgAfterSuiteFailureIT

testAfterSuiteFailure 2.248 s

Surefire1934OutErrElementsIT

testOutErrElementsDisabled 2.550 s
testOutErrElementsEnabled 2.605 s

XmlReporterRunTimeIT

testForkAlwaysWithChecksumOverride 17.74 s
testForkAlways 17.36 s

Surefire1053SystemPropertiesIT

checkWarningsSysPropTwice 2.691 s
checkWarningsFileEncoding 5.344 s

ArgLinePropertiesIT

argLine 9.721 s

Surefire946KillMainProcessInReusableForkIT

test(String, String)[1] 26.68 s
test(String, String)[2] 26.55 s
test(String, String)[3] 26.27 s
test(String, String)[4] 26.27 s
test(String, String)[5] 26.30 s
test(String, String)[6] 26.36 s

Surefire1881IT

test 4.973 s

Surefire772SpecifiedReportsIT

testSkippedSurefireReportGeneration 2.168 s
testSkippedFailsafeReportGeneration 1.747 s
testReportGeneration 1.734 s

Surefire1967CheckTestNgMethodParallelOrderingIT

testNgParallelOrdering 2.736 s

Surefire838TimeoutExtensionIT

extensionInvokedOnTimeout 13.26 s

FailFastJUnit4PlatformIT

test(String, String, Map, int, int, int, int, boolean)[1] 3.773 s
test(String, String, Map, int, int, int, int, boolean)[2] 5.912 s
test(String, String, Map, int, int, int, int, boolean)[3] 5.118 s
test(String, String, Map, int, int, int, int, boolean)[4] 5.756 s
test(String, String, Map, int, int, int, int, boolean)[5] 7.578 s
test(String, String, Map, int, int, int, int, boolean)[6] 5.567 s

Surefire705ParallelForkTimeoutIT

testTimeoutForked 3.661 s

Surefire685CommaSeparatedIncludesIT

testBuildFailingWhenErrors 2.582 s

Surefire2032NestedSkippedIT

testXmlReport 2.498 s

Surefire1733TestngIT

test 4.007 s

JUnit5FailingAfterAllIT

testAfterAllFailureIsReported 1.880 s
testAfterAllFailureWithRerunDoesNotRerunPassingTests 2.404 s

Java9FullApiIT

shouldLoadMultipleJavaModules_JavaHome 6.885 s
shouldLoadMultipleJavaModules_ToolchainsXML 6.518 s
shouldLoadMultipleJavaModules_JvmParameter 6.731 s

Surefire1080ParallelForkDoubleTestIT

test 2.651 s

Surefire1766SkipTestsDecoupledIT

skipTestsShouldOnlySkipSurefireNotFailsafe 2.818 s
mavenTestSkipShouldSkipBoth 1.975 s
skipITsShouldSkipFailsafeOnly 2.813 s
noSkipShouldRunBoth 3.486 s

ForkConsoleOutputWithErrorsIT

xmlFileContainsConsoleOutput 5.631 s

Surefire1024VerifyFailsafeIfTestedIT

shouldScanAndRunTestsInDependencyJars 2.481 s

ReportersIT

testRedirectOutputTestNg 1.979 s

Surefire806SpecifiedTestControlsIT

singleTestInSingleExecutionProject 2.126 s
twoSpecifiedTestExecutionsInCorrectExecutionBlocks 0 s
- since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution -
singleTestInOneExecutionOfMultiExecutionProject 0 s
- since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution -

Surefire569RunTestFromDependencyJarsIT

shouldScanAndRunTestsInDependencyJars 3.053 s

Surefire817SystemExitIT

systemExit1 2.250 s

FailFastJUnit4IT

test(String, String, Map, int, int, int, int, boolean)[1] 7.319 s
test(String, String, Map, int, int, int, int, boolean)[2] 19.63 s
test(String, String, Map, int, int, int, int, boolean)[3] 14.93 s
test(String, String, Map, int, int, int, int, boolean)[4] 19.53 s
test(String, String, Map, int, int, int, int, boolean)[5] 19.65 s
test(String, String, Map, int, int, int, int, boolean)[6] 42.96 s
test(String, String, Map, int, int, int, int, boolean)[7] 26.38 s

Surefire1202RerunAndSkipIT

junit4 16.07 s

ArgLineIT

argLine 7.859 s

DefaultConfigurationIT

defaultConfiguration 2.510 s

Surefire1265Java9IT

shouldRunInPluginJava9 2.348 s

Surefire926FailureWith2ProvidersIT

testBuildFailingWhenErrors 2.493 s

Surefire1136CwdPropagationInForkedModeIT

testTestNgAndJUnitTogether 2.452 s

Surefire803MultiFailsafeExecsIT

testOneExecutionRunInTwoBuilds 4.842 s
testSecondExecutionRunsAfterFirstExecutionFails 2.971 s

Surefire1712ExtractedModulenameWithoutASMIT

test 2.866 s

Surefire772BothReportsIT

testSkippedSurefireReportGeneration 2.149 s
testSkippedFailsafeReportGeneration 1.960 s
testReportGeneration 1.837 s

PlexusConflictIT

testPlexusConflict 1.918 s
testPlexusConflictIsolatedClassLoader 1.917 s

Surefire1260NewTestsPatternIT

defaultConfig 2.888 s

Surefire1146RerunFailedAndParameterizedIT

testsAreRerun 2.442 s

TestMultipleMethodPatternsIncludesExcludesIT

shouldNotRunExcludedClassesAndMethods 0 s
- skipped -
shouldMatchExactClassAndMethodCharacters 0 s
- skipped -
shouldMatchExactClassAndMethodWildcard 0 s
- skipped -
testSuccessTwo 0 s
- skipped -
simpleNameTest 5.327 s
simpleNameTestWithJavaExt 5.505 s
regexClass 5.048 s
shouldNotRunExcludedClasses 7.045 s
shouldNotRunExcludedMethods 0 s
- skipped -
simpleNameTestWithJavaExtWildcardPkg 7.166 s
shouldMatchMultiplePatterns 0 s
- skipped -
shouldMatchExactClassAndMethodsPostfix 0 s
- skipped -
simpleNameTestWithWildcardPkg 7.779 s
shouldMatchWildcardPackageAndClassAndMethod 0 s
- skipped -
shouldMatchExactClassAndMultipleMethods 0 s
- skipped -
fullyQualifiedTest 6.976 s
matchSimpleClassAndMethodWithJavaExtWildcardPkg 0 s
- skipped -
negativeTest 6.336 s
testRegexSuccessTwo 0 s
- skipped -
shouldMatchExactClassAndMethodsWildcard 0 s
- skipped -
shouldMatchMultiplePatternsComplex 0 s
- skipped -
simpleNameTestAsParallel 6.687 s
matchSimpleClassAndMethodWithWildcardPkg 0 s
- skipped -
shouldMatchMultiplePatternsAsParallel 0 s
- skipped -
shouldNotRunExcludedClassesIfIncluded 5.455 s
shouldMatchSimpleClassNameAndMethod 0 s
- skipped -
shouldMatchExactClassAndMethodPostfix 0 s
- skipped -
shouldMatchMultiplePatternsComplexAsParallel 0 s
- skipped -
matchSimpleClassAndMethodWithJavaExt 0 s
- skipped -
regexClassAndMethod 0 s
- skipped -

Surefire901MIssingResultfileWhenNoTestsIT

failsafeWithNoTests 1.909 s

Surefire1278GroupNameEndingIT

testOnlyGroups 2.270 s

TestMultipleMethodPatternsTestNGIT

shouldNotRunExcludedClassesAndMethods 3.338 s
shouldMatchExactClassAndMethodCharacters 3.278 s
shouldMatchExactClassAndMethodWildcard 3.055 s
testSuccessTwo 3.183 s
simpleNameTest 2.807 s
simpleNameTestWithJavaExt 3.091 s
regexClass 3.271 s
shouldNotRunExcludedClasses 3.497 s
shouldNotRunExcludedMethods 3.089 s
simpleNameTestWithJavaExtWildcardPkg 3.267 s
shouldMatchMultiplePatterns 2.850 s
shouldMatchExactClassAndMethodsPostfix 2.851 s
simpleNameTestWithWildcardPkg 2.790 s
shouldMatchWildcardPackageAndClassAndMethod 2.530 s
shouldMatchExactClassAndMultipleMethods 2.449 s
fullyQualifiedTest 2.343 s
matchSimpleClassAndMethodWithJavaExtWildcardPkg 2.249 s
negativeTest 0 s
- skipped -
shouldMatchExactClassAndMethodsWildcard 2.465 s
shouldMatchMultiplePatternsComplex 2.621 s
simpleNameTestAsParallel 2.563 s
matchSimpleClassAndMethodWithWildcardPkg 2.038 s
shouldMatchMultiplePatternsAsParallel 2.391 s
shouldNotRunExcludedClassesIfIncluded 2.400 s
shouldMatchSimpleClassNameAndMethod 2.557 s
shouldMatchExactClassAndMethodPostfix 2.581 s
shouldMatchMultiplePatternsComplexAsParallel 2.466 s
matchSimpleClassAndMethodWithJavaExt 2.034 s
testRegexSuccessTwo 0 s
- TestNG does not support regex method patterns -
regexClassAndMethod 0 s
- TestNG does not support regex method patterns -

Surefire674BuildFailingWhenErrorsIT

testBuildFailingWhenErrors 2.771 s

ResultCountingIT

testCountingWithJunit481ForkAlways 4.580 s
testCountingWithJunit481ForkOnce 2.213 s
testCountingWithJunit481ForkNever 1.797 s

Surefire1993JpmsProvidingModulesIT

verify 3.425 s

Surefire2190JUnit4IT

test 2.827 s

Surefire2143ParameterizedSkippedIT

junit4ParameterizedSkipped 2.572 s
junit5ParameterizedSkipped 2.463 s

Surefire1914XmlReportingParameterizedTestIT

testXmlReport(String)[1] 3.338 s
testXmlReport(String)[2] 2.952 s
testXmlReport(String)[3] 3.060 s

Surefire2036IT

selectJUnit5UsingConfiguredProviderWithPlatformRunner 2.395 s

LongWindowsPathIT

shouldRunInSystemTmp 0 s
- skipped -

CheckTestNgExecuteErrorIT

executionError 2.572 s

ReportTestTimestampIT

testReportTestTimestampEnabled 1.953 s
testReportTestTimestampDisabled 2.109 s

Surefire141PluggableProvidersIT

pluggableProviderPresent 7.454 s
invokeRuntimeException 7.849 s
invokeReporterException 5.597 s
constructorRuntimeException 6.575 s

Surefire3380ForkedSourceQualifiedNameIT

testXmlReport(String)[1] 8.172 s
testXmlReport(String)[2] 6.872 s
testXmlReport(String)[3] 6.823 s

Surefire733AllOverrridesCapturedIT

testLogOutput 2.154 s

Surefire1041FailingJUnitRunnerIT

reportErrorInJUnitRunnerAsTestError 2.589 s

Surefire855AllowFailsafeUseArtifactFileIT

jarNotForkingShouldUseFile 8.077 s
jarShouldUseFile 4.901 s
warShouldUseClasses 6.163 s
osgiBundleShouldUseFile 4.146 s

FailFastTestNgIT

test(String, String, Map, int, int, int, int, boolean)[1] 14.47 s
test(String, String, Map, int, int, int, int, boolean)[2] 19.62 s
test(String, String, Map, int, int, int, int, boolean)[3] 43.18 s
test(String, String, Map, int, int, int, int, boolean)[4] 26.21 s

SystemPropertiesTestIT

testSystemProperties 3.007 s
testSystemPropertiesNoFork 2.449 s

Surefire1360PropertiesElementIT

testPropertiesElementEnabled 2.350 s
testPropertiesElementDisabled 2.398 s

Surefire408ManualProviderSelectionIT

testParallelBuildResultCount 2.074 s

Surefire3511NestedSuitesIT

reportsNestedSuitesAsOneTestClass 2.635 s

JUnit448TestCategoriesIT

testCategoriesACFullyQualifiedClassName 4.842 s
testBadCategoryForkAlways 1.820 s
testCategoriesABForkAlways 2.881 s
testCategoriesBadCategory 2.156 s
testCategoriesACClassNameSuffix 5.004 s
testCategoriesACFullyQualifiedClassNameForkAlways 5.237 s
testCategoriesAB 2.135 s
testCategoriesACClassNameSuffixForkAlways 4.717 s

Surefire1122ParallelAndFlakyTestsIT

parallelCreatesCorrectReportFork 1.939 s
nonParallelCreatesCorrectReport 2.402 s
parallelCreatesCorrectReport 1.764 s

Surefire1964IT

shouldFilterTests 2.309 s
shouldFilterTestsInPluginProcess 1.915 s

Surefire1036NonFilterableJUnit4RunnerWithCategoriesIT

test 2.714 s

ModulePathIT

testModulePathWithSpaces 2.818 s
testModulePath 2.658 s

JUnit447ParallelIT

unknownThreadCountClasses 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
threadCountSuites 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
unlimitedThreadsSuitesAndMethods1 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
unlimitedThreadsSuitesAndMethods2 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
unknownThreadCountMethods 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
threadCountClassesAndMethods 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
reusableThreadCountClassesAndMethodsOptimized 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
unknownThreadCountSuites 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
reusableThreadCountAll 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
forcedShutdown 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
unknownThreadCountAll 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
serial 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
reusableThreadCountAllOptimized 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
suites 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
unlimitedThreadsMethods1 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
unlimitedThreadsMethods2 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
unlimitedThreadsSuitesAndClasses1 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
unlimitedThreadsSuitesAndClasses2 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
threadCountAllOptimized 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
threadCountAll 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
everyThreadCountSuitesAndClasses 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
unknownThreadCountBoth 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
threadCountSuitesAndClassesOptimized 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
classesAndMethods 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
everyThreadCountSuitesAndMethods 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
unknownThreadCountSuitesAndClasses 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
reusableThreadCountSuitesAndClassesOptimized 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
unknownThreadCountSuitesAndMethods 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
suitesAndClasses 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
suitesAndMethods 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
shutdown 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
threadCountClassesAndMethodsOneCore 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
everyThreadCountClassesAndMethods 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
all 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
unknownThreadCountClassesAndMethods 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
threadCountSuitesAndMethodsOptimized 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
reusableThreadCountSuitesAndMethodsOptimized 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
unlimitedThreadsClasses1 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
unlimitedThreadsClasses2 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
threadCountClasses 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
everyThreadCountAll 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
threadCountMethods 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
unlimitedThreadsSuites1 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
unlimitedThreadsSuites2 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
threadCountSuitesAndClasses 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
unlimitedThreadsClassesAndMethods1 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
unlimitedThreadsClassesAndMethods2 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
threadCountSuitesAndMethods 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
classes 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
reusableThreadCountSuitesAndClasses 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
methods 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
reusableThreadCountSuitesAndMethods 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
timeoutAndForcedShutdown 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
threadCountClassesAndMethodsOptimized 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
unlimitedThreadsAll1 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
unlimitedThreadsAll2 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
forcedShutdownVerifyingLogs 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
threadCountClassesAndMethodsOneCoreOptimized 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -
reusableThreadCountClassesAndMethods 0 s
- class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled -

Surefire412InnerClassTestIT

testInnerClass 2.607 s

CheckTestNgCustomObjectFactoryIT

testTestNgListenerReporter 0 s
- objectFactory not support by testng engine -

CheckTestNgGroupThreadParallelIT

testNgGroupThreadParallel 2.262 s

TestMultipleMethodPatternsIT

shouldNotRunExcludedClassesAndMethods 0 s
- skipped -
shouldMatchExactClassAndMethodCharacters 0 s
- skipped -
shouldMatchExactClassAndMethodWildcard 0 s
- skipped -
testSuccessTwo 0 s
- skipped -
simpleNameTest 4.686 s
simpleNameTestWithJavaExt 5.430 s
regexClass 5.255 s
shouldNotRunExcludedClasses 4.859 s
shouldNotRunExcludedMethods 0 s
- skipped -
simpleNameTestWithJavaExtWildcardPkg 7.078 s
shouldMatchMultiplePatterns 0 s
- skipped -
shouldMatchExactClassAndMethodsPostfix 0 s
- skipped -
simpleNameTestWithWildcardPkg 7.235 s
shouldMatchWildcardPackageAndClassAndMethod 0 s
- skipped -
shouldMatchExactClassAndMultipleMethods 0 s
- skipped -
fullyQualifiedTest 7.347 s
matchSimpleClassAndMethodWithJavaExtWildcardPkg 0 s
- skipped -
negativeTest 5.669 s
testRegexSuccessTwo 0 s
- skipped -
shouldMatchExactClassAndMethodsWildcard 0 s
- skipped -
shouldMatchMultiplePatternsComplex 0 s
- skipped -
simpleNameTestAsParallel 7.058 s
matchSimpleClassAndMethodWithWildcardPkg 0 s
- skipped -
shouldMatchMultiplePatternsAsParallel 0 s
- skipped -
shouldNotRunExcludedClassesIfIncluded 6.911 s
shouldMatchSimpleClassNameAndMethod 0 s
- skipped -
shouldMatchExactClassAndMethodPostfix 0 s
- skipped -
shouldMatchMultiplePatternsComplexAsParallel 0 s
- skipped -
matchSimpleClassAndMethodWithJavaExt 0 s
- skipped -
regexClassAndMethod 0 s
- skipped -

Surefire772NoFailsafeReportsIT

testSkippedFailsafeReportGeneration 1.890 s
testForcedFailsafeReportGeneration 1.939 s
testSkipForcedFailsafeReportGeneration 1.821 s
testReportGeneration 1.601 s

Surefire146ForkPerTestNoSetupIT

testForkPerTestNoSetup 2.773 s

CheckTestNgReportTestIT

testNgReport 7.038 s
shouldNotBeVerbose 5.625 s
shouldBeVerbose 8.907 s

JUnit4VersionsIT

testJunit(JUnitVersion)[1] 1.888 s
testJunit(JUnitVersion)[2] 1.914 s
testJunit(JUnitVersion)[3] 1.831 s
testJunit(JUnitVersion)[4] 1.844 s

Surefire697NiceSummaryIT

testBuildFailingWhenErrors 2.659 s

TestSingleMethodIT

fullyQualifiedTestNg 2.383 s
testJunit48parallel 2.245 s
testJunit48Provider47 2.254 s
fullyQualifiedJunit48Provider4 2.317 s
testTestNg5149 2.366 s
testTestNg 2.468 s

Surefire1643IT

shouldNotMixResults 25.44 s

TestMultipleMethodPatternsTestNGIncludesExcludesIT

shouldNotRunExcludedClassesAndMethods 0 s
- skipped -
shouldMatchExactClassAndMethodCharacters 0 s
- skipped -
shouldMatchExactClassAndMethodWildcard 0 s
- skipped -
testSuccessTwo 0 s
- skipped -
simpleNameTest 7.110 s
simpleNameTestWithJavaExt 7.626 s
regexClass 7.961 s
shouldNotRunExcludedClasses 6.576 s
shouldNotRunExcludedMethods 0 s
- skipped -
simpleNameTestWithJavaExtWildcardPkg 6.822 s
shouldMatchMultiplePatterns 0 s
- skipped -
shouldMatchExactClassAndMethodsPostfix 0 s
- skipped -
simpleNameTestWithWildcardPkg 6.272 s
shouldMatchWildcardPackageAndClassAndMethod 0 s
- skipped -
shouldMatchExactClassAndMultipleMethods 0 s
- skipped -
fullyQualifiedTest 5.523 s
matchSimpleClassAndMethodWithJavaExtWildcardPkg 0 s
- skipped -
negativeTest 5.373 s
shouldMatchExactClassAndMethodsWildcard 0 s
- skipped -
shouldMatchMultiplePatternsComplex 0 s
- skipped -
simpleNameTestAsParallel 5.612 s
matchSimpleClassAndMethodWithWildcardPkg 0 s
- skipped -
shouldMatchMultiplePatternsAsParallel 0 s
- skipped -
shouldNotRunExcludedClassesIfIncluded 5.898 s
shouldMatchSimpleClassNameAndMethod 0 s
- skipped -
shouldMatchExactClassAndMethodPostfix 0 s
- skipped -
shouldMatchMultiplePatternsComplexAsParallel 0 s
- skipped -
matchSimpleClassAndMethodWithJavaExt 0 s
- skipped -
testRegexSuccessTwo 0 s
- TestNG does not support regex method patterns -
regexClassAndMethod 0 s
- TestNG does not support regex method patterns -

EnvironmentVariableIT

environmentVariable 2.099 s

TestNgParallelWithAnnotationsIT

testTestNgGroupThreadParallel 8.873 s

Surefire979WrongClassLoaderIT

wrongClassloaderUSedInSmartStacktraceparser 3.268 s
wrongClassloaderUSedInSmartStacktraceparserJunit5 3.099 s

JUnit4PlatformStreamCorruptionIT

warningIsNotEmitted 1.913 s
warningIsNotEmittedWithJulToLog4j 0 s
- https://issues.apache.org/jira/browse/SUREFIRE-1659?focusedCommentId=17374005&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-17374005 -
warningIsNotEmittedWithJulToSlf4j 2.185 s

Surefire1004RunTestFromDependencyJarsTypeAndClassifierIT

shouldScanAndRunTestsInDependencyJars 2.418 s

EnvironmentVariablesIT

testWhenUseSystemClassLoader 2.333 s
testExcludedEnv 5.565 s
testWhenDontUseSystemClassLoader 2.367 s

Surefire1211JUnit4TestNgIT

withoutJUnit 5.744 s
withJUnit 2.444 s

Surefire943ReportContentIT

test_noParallel 8.272 s
test_parallelBoth 4.439 s

Surefire628ConsoleOutputBeforeAndAfterClassIT

testJunit3ParallelBuildResultCount 2.499 s

ForkCountMultiModuleIT

testForkCountOneNoReuse 9.922 s
testForkCountTwoNoReuse 7.406 s
testForkCountTwoReuse 6.542 s
testForkCountOneReuse 7.969 s

ArchUnit4IT

simpleCucumberUsage 8.450 s

Surefire3529LibraryClassOrdererIT

runOrderShouldKeepClassOrdererFromJunitPlatformProperties 2.696 s

Surefire2065IT

shouldNotDetectFlakyTestsWhenRunningOnlyJunit4 2.297 s
shouldNotDetectFlakyTestsWhenRunningOnlyJunit5 2.407 s
shouldNotDetectFlakyTestsWhenCombiningJunit4And5Tests 2.601 s

Surefire1744AlwaysIncludeOutputLogsIT

testAlwaysIncludeOutputLogs 2.206 s

SpockIT

test 0 s
- skipped -

Surefire2151ToolchainForkDiscoveryIT

newerToolchainJdkAcrossMultipleForks 0 s
- skipped -
reuseForksFalseWithToolchainRunsAllTests 5.786 s
forkCountGreaterThanOneWithToolchainRunsAllTests 7.757 s

AggregateReportIT

aggregateReport 10.28 s

Surefire3465IT

shouldRunTestsIncludedByPatternWithWildcardDirectory 2.710 s
shouldRunTestsIncludedByPatternWithPackageDirectory 2.989 s
shouldKeepRunningTestsNotMatchedByExcludePatternWithPackageDirectory 2.362 s
shouldRunTestsIncludedByRegex 2.711 s

ClassPathOrderIT

classPathOrder 2.533 s

Surefire1364SystemPropertiesIT

testNg 5.773 s
junit4Forked 5.726 s
testNgInProcess 8.177 s
junit4InProcess 6.691 s

JUnit4PlatformRerunFailingTestsIT

testRerunFailingErrorTestsFalse 8.574 s
testRerunFailingErrorTestsWithOneRetry 7.972 s
testParameterizedTest 2.138 s
testRerunFailingErrorTestsTwoRetry 8.143 s
testFailOnTooManyFlakes 2.122 s
testRerunOneTestMethod 8.157 s
testRerunOneTestClass 7.806 s

Surefire1295AttributeJvmCrashesToTestsIT

test(String, ForkMode)[1] 8.004 s
test(String, ForkMode)[2] 12.70 s
test(String, ForkMode)[3] 9.583 s
test(String, ForkMode)[4] 9.420 s
test(String, ForkMode)[5] 11.59 s
test(String, ForkMode)[6] 10.37 s
test(String, ForkMode)[7] 8.723 s
test(String, ForkMode)[8] 12.24 s
test(String, ForkMode)[9] 8.413 s

Surefire1737IT

selectJUnit5UsingConfiguredProviderWithPlatformRunner 1.899 s

Surefire377TestNgAndJUnit4TogetherIT

testTestNgAndJUnit4Together 2.472 s
testTestNgAndJUnitTogether 2.605 s

SurefireJUnit4MethodParallelWithSuiteCountIT

testMethodsParallelWithSuite 4.701 s
testClassesParallelWithSuite 8.259 s

Junit5ModulePathIT

testModulePathWithSpaces 2.358 s
testModulePath 2.699 s

JUnit447RerunFailingTestWithCucumberIT

testRerunFailingErrorTestsFalse(String)[1] 2.803 s
testRerunFailingErrorTestsFalse(String)[2] 2.405 s
testRerunFailingErrorTestsWithOneRetry(String)[1] 2.858 s
testRerunFailingErrorTestsWithOneRetry(String)[2] 2.453 s
testRerunFailingErrorTestsTwoRetry(String)[1] 2.944 s
testRerunFailingErrorTestsTwoRetry(String)[2] 2.309 s

Surefire3460IT

printFromNullTcclThread 3.033 s

Surefire862MissingSummaryFilesIT

missingSummaryFilesAreIgnored 1.627 s

Surefire2300BeforeAllAssumptionIT

reportsTestsAbortedByBeforeAllAssumptionAsSkipped 1.991 s

ClasspathScopeFilteringIT

additionalClasspath 3.452 s

Surefire1367AssumptionLogsIT

shouldSeeLogsInPlugin 3.990 s
shouldSeeLogsParallelInPlugin 0 s
- https://github.com/apache/maven-surefire/issues/3242 -
shouldSeeLogsParallelForked 0 s
- https://github.com/apache/maven-surefire/issues/3242 -
shouldSeeLogsForked 5.956 s

Surefire985ParameterizedRunnerAndCategoriesIT

test 2.914 s

Surefire3446IT

shouldRunSelectedNestedClass 3.344 s

SmartStackTraceIT

misg 2.184 s

JUnit4PlatformIT

testVintageEngine(String, String)[1] 2.153 s
testVintageEngine(String, String)[2] 2.082 s
testVintageEngine(String, String)[3] 1.960 s
testVintageEngine(String, String)[4] 2.009 s
testVintageEngine(String, String)[5] 1.909 s
testJQwikEngine(String, String)[1] 2.045 s
testJQwikEngine(String, String)[2] 2.040 s
testJQwikEngine(String, String)[3] 1.934 s
testJQwikEngine(String, String)[4] 1.993 s
testJQwikEngine(String, String)[5] 2.031 s
testMultipleEngines(String, String)[1] 2.489 s
testMultipleEngines(String, String)[2] 2.217 s
testMultipleEngines(String, String)[3] 2.230 s
testMultipleEngines(String, String)[4] 2.418 s
testMultipleEngines(String, String)[5] 2.393 s

Surefire975DefaultVMEncodingIT

runWithRussian1251 5.905 s

Surefire3456PreferIPv4StackIT

preferIPv4StackIsAppliedBeforeNetworkingIsInitialized 2.957 s

CheckTestNg740ParallelIT

withTestNG740AndParallelSetWithoutThreadCount 3.790 s
withTestNG740AndParallelSet 2.708 s
withTestNGParallelTests 2.851 s
withTestNGParallelInstances 3.178 s

Surefire3468SpockGroupsIT

groupsShouldOnlyRunSlowTestsOfEveryEngine 4.998 s
excludedGroupsShouldSkipSlowTestsOfEveryEngine 3.788 s

Surefire260TestWithIdenticalNamesIT

testWithIdenticalNames 5.854 s

Surefire832ProviderSelectionIT

testJUnitRunCategoryAB 2.606 s

Surefire847AdditionalFailureIT

testJUnitRunCategoryAB 2.620 s

Surefire2274FailsafeFlakeCountIT

failsafeVerifyFailsWhenFlakeCountExceedsLimit 2.154 s

ForkConsoleOutputIT

printSummaryTrueWithRedirect 5.306 s
printSummaryFalseWithoutRedirect 5.840 s
printSummaryTrueWithoutRedirect 5.471 s
printSummaryFalseWithRedirect 4.605 s

Surefire2241JUnitParamsRerunIT

identicallyReportedJUnitParamsTestsRemainDistinctDuringRerun 2.248 s

Surefire649EmptyStringSystemPropertiesIT

systemPropertyVariables 2.893 s
systemProperties 2.719 s

Surefire613TestCountInParallelIT

testParallelBuildResultCount 2.924 s

Surefire1095NpeInRunListenerIT

testRunStartedWithJUnit4 2.178 s

Surefire801ForkNeverClassLoaderIT

testShouldBeOkWithForkNever 1.950 s

Surefire1733JUnit4IT

test 4.032 s

TestMultipleMethodPatternsTestNGIncludesIT

shouldNotRunExcludedClassesAndMethods 0 s
- skipped -
shouldMatchExactClassAndMethodCharacters 0 s
- skipped -
shouldMatchExactClassAndMethodWildcard 0 s
- skipped -
testSuccessTwo 0 s
- skipped -
simpleNameTest 7.092 s
simpleNameTestWithJavaExt 7.936 s
regexClass 7.368 s
shouldNotRunExcludedClasses 7.613 s
shouldNotRunExcludedMethods 0 s
- skipped -
simpleNameTestWithJavaExtWildcardPkg 6.218 s
shouldMatchMultiplePatterns 0 s
- skipped -
shouldMatchExactClassAndMethodsPostfix 0 s
- skipped -
simpleNameTestWithWildcardPkg 5.516 s
shouldMatchWildcardPackageAndClassAndMethod 0 s
- skipped -
shouldMatchExactClassAndMultipleMethods 0 s
- skipped -
fullyQualifiedTest 6.001 s
matchSimpleClassAndMethodWithJavaExtWildcardPkg 0 s
- skipped -
negativeTest 4.702 s
shouldMatchExactClassAndMethodsWildcard 0 s
- skipped -
shouldMatchMultiplePatternsComplex 0 s
- skipped -
simpleNameTestAsParallel 5.884 s
matchSimpleClassAndMethodWithWildcardPkg 0 s
- skipped -
shouldMatchMultiplePatternsAsParallel 0 s
- skipped -
shouldNotRunExcludedClassesIfIncluded 6.336 s
shouldMatchSimpleClassNameAndMethod 0 s
- skipped -
shouldMatchExactClassAndMethodPostfix 0 s
- skipped -
shouldMatchMultiplePatternsComplexAsParallel 0 s
- skipped -
matchSimpleClassAndMethodWithJavaExt 0 s
- skipped -
testRegexSuccessTwo 0 s
- TestNG does not support regex method patterns -
regexClassAndMethod 0 s
- TestNG does not support regex method patterns -

Surefire1396CustomProviderClassPathIT

pluggableProviderClasspathCorrect 7.282 s

Surefire1028UnableToRunSingleIT

methodFilteringParallelExecution 2.666 s

Surefire3462TestNgSuiteListenerIT

testNgOnlyProjectScansWithoutWarning 2.909 s
suiteListenerIsNotInvokedOncePerScannedClass 3.028 s

Surefire3532MainModuleRequiresJUnitIT

junit5 3.041 s
junit6 3.378 s

ClasspathFilteringIT

additionalClasspath 3.414 s

Failure Details

[Summary] [Package List] [Test Cases]


test751
- skipped: Disable for now as runOrder is not implemented for TestNG in Surefire
test6143
- skipped: Disable for now as runOrder is not implemented for TestNG in Surefire
testPassesWhenFailuresLessThanSuccessPercentage
- skipped: FIXME percentage attribute looks to be sypported but is failing in this case
twoSpecifiedTestExecutionsInCorrectExecutionBlocks
- skipped: since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
singleTestInOneExecutionOfMultiExecutionProject
- skipped: since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
shouldNotRunExcludedClassesAndMethods
- skipped: skipped
shouldMatchExactClassAndMethodCharacters
- skipped: skipped
shouldMatchExactClassAndMethodWildcard
- skipped: skipped
testSuccessTwo
- skipped: skipped
shouldNotRunExcludedMethods
- skipped: skipped
shouldMatchMultiplePatterns
- skipped: skipped
shouldMatchExactClassAndMethodsPostfix
- skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod
- skipped: skipped
shouldMatchExactClassAndMultipleMethods
- skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg
- skipped: skipped
testRegexSuccessTwo
- skipped: skipped
shouldMatchExactClassAndMethodsWildcard
- skipped: skipped
shouldMatchMultiplePatternsComplex
- skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg
- skipped: skipped
shouldMatchMultiplePatternsAsParallel
- skipped: skipped
shouldMatchSimpleClassNameAndMethod
- skipped: skipped
shouldMatchExactClassAndMethodPostfix
- skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel
- skipped: skipped
matchSimpleClassAndMethodWithJavaExt
- skipped: skipped
regexClassAndMethod
- skipped: skipped
negativeTest
- skipped: skipped
testRegexSuccessTwo
- skipped: TestNG does not support regex method patterns
regexClassAndMethod
- skipped: TestNG does not support regex method patterns
shouldRunInSystemTmp
- skipped: skipped
unknownThreadCountClasses
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
threadCountSuites
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
unlimitedThreadsSuitesAndMethods1
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
unlimitedThreadsSuitesAndMethods2
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
unknownThreadCountMethods
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
threadCountClassesAndMethods
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
reusableThreadCountClassesAndMethodsOptimized
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
unknownThreadCountSuites
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
reusableThreadCountAll
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
forcedShutdown
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
unknownThreadCountAll
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
serial
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
reusableThreadCountAllOptimized
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
suites
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
unlimitedThreadsMethods1
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
unlimitedThreadsMethods2
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
unlimitedThreadsSuitesAndClasses1
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
unlimitedThreadsSuitesAndClasses2
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
threadCountAllOptimized
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
threadCountAll
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
everyThreadCountSuitesAndClasses
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
unknownThreadCountBoth
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
threadCountSuitesAndClassesOptimized
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
classesAndMethods
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
everyThreadCountSuitesAndMethods
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
unknownThreadCountSuitesAndClasses
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
reusableThreadCountSuitesAndClassesOptimized
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
unknownThreadCountSuitesAndMethods
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
suitesAndClasses
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
suitesAndMethods
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
shutdown
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
threadCountClassesAndMethodsOneCore
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
everyThreadCountClassesAndMethods
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
all
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
unknownThreadCountClassesAndMethods
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
threadCountSuitesAndMethodsOptimized
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
reusableThreadCountSuitesAndMethodsOptimized
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
unlimitedThreadsClasses1
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
unlimitedThreadsClasses2
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
threadCountClasses
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
everyThreadCountAll
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
threadCountMethods
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
unlimitedThreadsSuites1
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
unlimitedThreadsSuites2
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
threadCountSuitesAndClasses
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
unlimitedThreadsClassesAndMethods1
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
unlimitedThreadsClassesAndMethods2
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
threadCountSuitesAndMethods
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
classes
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
reusableThreadCountSuitesAndClasses
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
methods
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
reusableThreadCountSuitesAndMethods
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
timeoutAndForcedShutdown
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
threadCountClassesAndMethodsOptimized
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
unlimitedThreadsAll1
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
unlimitedThreadsAll2
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
forcedShutdownVerifyingLogs
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
threadCountClassesAndMethodsOneCoreOptimized
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
reusableThreadCountClassesAndMethods
- skipped: class org.apache.maven.surefire.its.JUnit447ParallelIT is @Disabled
testTestNgListenerReporter
- skipped: objectFactory not support by testng engine
shouldNotRunExcludedClassesAndMethods
- skipped: skipped
shouldMatchExactClassAndMethodCharacters
- skipped: skipped
shouldMatchExactClassAndMethodWildcard
- skipped: skipped
testSuccessTwo
- skipped: skipped
shouldNotRunExcludedMethods
- skipped: skipped
shouldMatchMultiplePatterns
- skipped: skipped
shouldMatchExactClassAndMethodsPostfix
- skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod
- skipped: skipped
shouldMatchExactClassAndMultipleMethods
- skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg
- skipped: skipped
testRegexSuccessTwo
- skipped: skipped
shouldMatchExactClassAndMethodsWildcard
- skipped: skipped
shouldMatchMultiplePatternsComplex
- skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg
- skipped: skipped
shouldMatchMultiplePatternsAsParallel
- skipped: skipped
shouldMatchSimpleClassNameAndMethod
- skipped: skipped
shouldMatchExactClassAndMethodPostfix
- skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel
- skipped: skipped
matchSimpleClassAndMethodWithJavaExt
- skipped: skipped
regexClassAndMethod
- skipped: skipped
shouldNotRunExcludedClassesAndMethods
- skipped: skipped
shouldMatchExactClassAndMethodCharacters
- skipped: skipped
shouldMatchExactClassAndMethodWildcard
- skipped: skipped
testSuccessTwo
- skipped: skipped
shouldNotRunExcludedMethods
- skipped: skipped
shouldMatchMultiplePatterns
- skipped: skipped
shouldMatchExactClassAndMethodsPostfix
- skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod
- skipped: skipped
shouldMatchExactClassAndMultipleMethods
- skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg
- skipped: skipped
shouldMatchExactClassAndMethodsWildcard
- skipped: skipped
shouldMatchMultiplePatternsComplex
- skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg
- skipped: skipped
shouldMatchMultiplePatternsAsParallel
- skipped: skipped
shouldMatchSimpleClassNameAndMethod
- skipped: skipped
shouldMatchExactClassAndMethodPostfix
- skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel
- skipped: skipped
matchSimpleClassAndMethodWithJavaExt
- skipped: skipped
testRegexSuccessTwo
- skipped: TestNG does not support regex method patterns
regexClassAndMethod
- skipped: TestNG does not support regex method patterns
warningIsNotEmittedWithJulToLog4j
- skipped: https://issues.apache.org/jira/browse/SUREFIRE-1659?focusedCommentId=17374005&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-17374005
test
- skipped: skipped
newerToolchainJdkAcrossMultipleForks
- skipped: skipped
shouldSeeLogsParallelInPlugin
- skipped: https://github.com/apache/maven-surefire/issues/3242
shouldSeeLogsParallelForked
- skipped: https://github.com/apache/maven-surefire/issues/3242
shouldNotRunExcludedClassesAndMethods
- skipped: skipped
shouldMatchExactClassAndMethodCharacters
- skipped: skipped
shouldMatchExactClassAndMethodWildcard
- skipped: skipped
testSuccessTwo
- skipped: skipped
shouldNotRunExcludedMethods
- skipped: skipped
shouldMatchMultiplePatterns
- skipped: skipped
shouldMatchExactClassAndMethodsPostfix
- skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod
- skipped: skipped
shouldMatchExactClassAndMultipleMethods
- skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg
- skipped: skipped
shouldMatchExactClassAndMethodsWildcard
- skipped: skipped
shouldMatchMultiplePatternsComplex
- skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg
- skipped: skipped
shouldMatchMultiplePatternsAsParallel
- skipped: skipped
shouldMatchSimpleClassNameAndMethod
- skipped: skipped
shouldMatchExactClassAndMethodPostfix
- skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel
- skipped: skipped
matchSimpleClassAndMethodWithJavaExt
- skipped: skipped
testRegexSuccessTwo
- skipped: TestNG does not support regex method patterns
regexClassAndMethod
- skipped: TestNG does not support regex method patterns