Fork me on GitHub
Built by Maven

Surefire Report

Summary

[Summary] [Package List] [Test Cases]


Tests Errors Failures Skipped Success Rate Time
779 0 0 138 82.285% 5,605.57

Note: failures are anticipated and checked for with assertions while errors are unanticipated.


Package List

[Summary] [Package List] [Test Cases]


Package Tests Errors Failures Skipped Success Rate Time
org.apache.maven.surefire.its 597 0 0 135 77.387% 3,967.821
org.apache.maven.surefire.its.jiras 182 0 0 3 98.352% 1,637.748

Note: package statistics are not computed recursively, they only sum up all of its testsuites numbers.

org.apache.maven.surefire.its

Class Tests Errors Failures Skipped Success Rate Time
PojoSimpleIT 1 0 0 0 100% 7.434
JUnit4ForkAlwaysStaticInitPollutionIT 1 0 0 0 100% 8.244
JUnit47ConcurrencyIT 1 0 0 0 100% 9.629
JUnitPlatformIT 5 0 0 0 100% 42.032
CheckSingleTestIT 4 0 0 0 100% 32.002
CheckTestNgListenerReporterIT 8 0 0 0 100% 91.557
JUnit47ParallelNotThreadSafeIT 1 0 0 0 100% 6.881
CheckTestNgSuiteXmlIT 3 0 0 0 100% 39.317
ForkModeMultiModuleIT 4 0 0 0 100% 46.246
ArgLineIT 1 0 0 0 100% 7.448
CheckTestNgListenersIT 1 0 0 0 100% 14.83
ConsoleOutputIT 4 0 0 0 100% 36.963
ClasspathFilteringIT 1 0 0 0 100% 7.14
JUnit47ParallelIT 59 0 0 0 100% 524.567
IncludesExcludesIT 3 0 0 0 100% 22.589
ForkConsoleOutputWithErrorsIT 1 0 0 0 100% 5.26
AggregateReportIT 1 0 0 0 100% 9.319
SystemPropertiesTestIT 2 0 0 0 100% 14.707
ArgLinePropertiesIT 1 0 0 0 100% 8.122
TestNgGroupsIT 5 0 0 0 100% 42.066
CheckTestNgSuiteXmlSingleIT 1 0 0 0 100% 10.179
TestMultipleMethodPatternsIT 180 0 0 87 51.667% 644.572
CheckTestNgCustomTestRunnerFactoryIT 1 0 0 0 100% 10.061
Java9FullApiIT 3 0 0 3 0% 0.004
TestMethodPatternIT 7 0 0 0 100% 55.395
EnvironmentVariableIT 1 0 0 0 100% 7.87
JUnit47RedirectOutputIT 2 0 0 0 100% 16.82
CheckTestNgJdk14IT 1 0 0 0 100% 10.655
ModulePathIT 1 0 0 1 0% 0
CrashDetectionIT 3 0 0 0 100% 15.976
TestMultipleMethodsIT 3 0 0 0 100% 23.174
AdditionalClasspathIT 1 0 0 0 100% 6.332
ReportersIT 1 0 0 0 100% 7.786
JUnit47RerunFailingTestWithCucumberIT 3 0 0 0 100% 23.491
ClasspathScopeFilteringIT 1 0 0 0 100% 6.579
NoRunnableTestsInClassIT 1 0 0 0 100% 7.438
LongWindowsPathIT 1 0 0 1 0% 0.005
AssumptionFailureReportIT 1 0 0 0 100% 6.55
JUnitPlatformEnginesIT 8 0 0 0 100% 32.797
JUnit4RunListenerIT 2 0 0 0 100% 16.127
UseIsolatedClassLoaderIT 1 0 0 0 100% 7.178
CheckTestNgBeforeMethodFailureIT 1 0 0 0 100% 7.45
TestNgParallelWithAnnotationsIT 1 0 0 0 100% 9.096
CheckTestNgGroupThreadParallelIT 1 0 0 0 100% 8.439
TestNgSuccessPercentageIT 1 0 0 0 100% 6.901
UmlautDirIT 2 0 0 0 100% 15.182
TwoTestCasesIT 4 0 0 0 100% 32.691
IncludesExcludesFromFileIT 6 0 0 0 100% 42.865
DefaultConfigurationIT 1 0 0 0 100% 6.373
JUnitDepIT 4 0 0 0 100% 32.076
RunOrderIT 4 0 0 0 100% 28.5
JUnit4IgnoreIT 2 0 0 0 100% 16.013
EnvironmentVariablesIT 2 0 0 0 100% 15.546
CheckTestNgReportTestIT 3 0 0 0 100% 54.306
JUnit48TestCategoriesIT 8 0 0 0 100% 73.54
JUnit47WithCucumberIT 2 0 0 0 100% 15.235
JUnit4VersionsIT 16 0 0 0 100% 120.255
TestSingleMethodIT 9 0 0 0 100% 71.77
FailFastJUnitIT 12 0 0 0 100% 65.211
JUnit47StaticInnerClassTestsIT 1 0 0 0 100% 6.836
SiblingAggregatorIT 1 0 0 0 100% 16.098
RunOrderParallelForksIT 4 0 0 0 100% 27.715
CheckTestNgPathWithSpacesIT 1 0 0 0 100% 16.71
TimeoutForkedTestIT 1 0 0 0 100% 8.627
JUnitPlatformStreamCorruptionIT 1 0 0 0 100% 7.871
PlexusConflictIT 2 0 0 0 100% 14.838
WorkingDirectoryMissingIT 1 0 0 0 100% 7.476
FailFastTestNgIT 6 0 0 0 100% 32.605
CheckTestNgBeforeMethodIT 1 0 0 0 100% 9.199
JUnit44HamcrestIT 1 0 0 0 100% 8.511
TestMultipleMethodPatternsTestNGIT 90 0 0 41 54.444% 342.536
CheckTestNgCustomObjectFactoryIT 1 0 0 0 100% 10.324
ClassPathOrderIT 1 0 0 0 100% 6.967
WorkingDirectoryIT 4 0 0 0 100% 27.845
ForkModeIT 12 0 0 0 100% 157.484
CheckTestFailIfNoTestsIT 3 0 0 0 100% 18.314
ForkConsoleOutputIT 4 0 0 0 100% 31.234
PlainOldJavaClasspathIT 1 0 0 0 100% 7.254
XmlReporterRunTimeIT 1 0 0 0 100% 30.264
SmartStackTraceIT 1 0 0 0 100% 7.628
CheckTestFailIfNoTestsForkModeIT 6 0 0 0 100% 49.716
ForkModeTestNGIT 12 0 0 0 100% 131.548
UnicodeTestNamesIT 1 0 0 0 100% 10.468
CheckTestNgExecuteErrorIT 1 0 0 0 100% 5.497
CheckTestNgVersionsIT 20 0 0 2 90% 270.075
JUnit4RerunFailingTestsIT 5 0 0 0 100% 160.285
WorkingDirectoryIsInvalidPropertyIT 1 0 0 0 100% 5.791
AbstractTestCaseIT 1 0 0 0 100% 6.299
ResultCountingIT 3 0 0 0 100% 25.016

org.apache.maven.surefire.its.jiras

Class Tests Errors Failures Skipped Success Rate Time
Surefire697NiceSummaryIT 1 0 0 0 100% 7.267
Surefire1490ReportTitleDescriptionIT 2 0 0 0 100% 31.138
Surefire621TestCountingJunit3InParallelIT 5 0 0 0 100% 43.563
Surefire828EmptyGroupExprIT 4 0 0 0 100% 32.304
Surefire44InnerClassTestIT 1 0 0 0 100% 7.139
Surefire733AllOverrridesCapturedIT 1 0 0 0 100% 7.432
Surefire747MethodParallelWithSuiteCountIT 2 0 0 0 100% 26.85
Surefire930TestNgSuiteXmlIT 1 0 0 0 100% 8.698
Surefire570MultipleReportDirectoriesIT 2 0 0 0 100% 37.937
Surefire818NpeIgnoresTestsIT 1 0 0 0 100% 7.977
Surefire1278GroupNameEndingIT 1 0 0 0 100% 8.103
Surefire1135ImproveIgnoreMessageForTestNGIT 2 0 0 0 100% 19.297
Surefire1265Java9IT 1 0 0 1 0% 0.001
Surefire634UnsettableSystemPropertiesWarningIT 1 0 0 0 100% 7.562
Surefire801ForkModeNoneClassLoaderIT 1 0 0 0 100% 6.179
Surefire1209RerunAndForkCountIT 4 0 0 0 100% 70.142
Surefire1136CwdPropagationInForkedModeIT 1 0 0 0 100% 7.446
Surefire855AllowFailsafeUseArtifactFileIT 4 0 0 0 100% 49.698
Surefire1028UnableToRunSingleIT 1 0 0 0 100% 7.061
Surefire1185DoNotSpawnTestsIT 1 0 0 0 100% 6.376
Surefire628ConsoleOutputBeforeAndAfterClassIT 1 0 0 0 100% 8.188
Surefire1036NonFilterableJUnitRunnerWithCategoriesIT 1 0 0 0 100% 6.898
Surefire772NoSurefireReportsIT 4 0 0 0 100% 21.897
Surefire1122ParallelAndFlakyTestsIT 3 0 0 0 100% 25.714
Surefire946KillMainProcessInReusableForkIT 3 0 0 0 100% 25.391
Surefire146ForkPerTestNoSetupIT 1 0 0 0 100% 7.69
Surefire1364SystemPropertiesIT 10 0 0 0 100% 82.909
Surefire408ManualProviderSelectionIT 1 0 0 0 100% 7.715
Surefire141PluggableProvidersIT 4 0 0 0 100% 41.154
Surefire1144XmlRunTimeIT 1 0 0 0 100% 7.739
Surefire1383ScanSessionDependenciesIT 1 0 0 0 100% 6.621
Surefire1211JUnitTestNgIT 2 0 0 0 100% 18.469
Surefire377TestNgAndJUnitTogetherIT 2 0 0 0 100% 15.249
Surefire674BuildFailingWhenFailsafeErrorsIT 1 0 0 0 100% 8.726
Surefire649EmptyStringSystemPropertiesIT 2 0 0 0 100% 12.443
Surefire772SpecifiedReportsIT 3 0 0 0 100% 16.805
Surefire806SpecifiedTestControlsIT 3 0 0 2 33.333% 7.212
Surefire1041FailingJUnitRunnerIT 1 0 0 0 100% 8.169
Surefire1295AttributeJvmCrashesToTestsIT 9 0 0 0 100% 106.894
Surefire1179IT 1 0 0 0 100% 12.222
Surefire162CharsetProviderIT 1 0 0 0 100% 7.242
Surefire907PerThreadWithoutThreadCountIT 1 0 0 0 100% 6.756
Surefire1055CorrectConcurrentTestCountIT 1 0 0 0 100% 8.075
Surefire975DefaultVMEncodingIT 1 0 0 0 100% 7.375
Surefire685CommaSeparatedIncludesIT 1 0 0 0 100% 9.625
Surefire1367AssumptionLogsIT 4 0 0 0 100% 29.179
Surefire943ReportContentIT 2 0 0 0 100% 26.351
Surefire569RunTestFromDependencyJarsIT 1 0 0 0 100% 6.851
Surefire839TestWithoutCategoriesIT 2 0 0 0 100% 17.229
Surefire985ParameterizedRunnerAndCategoriesIT 1 0 0 0 100% 7.282
Surefire809GroupExpressionsIT 6 0 0 0 100% 48.516
Surefire995CategoryInheritanceIT 5 0 0 0 100% 34.025
Surefire1264IT 2 0 0 0 100% 19.495
Surefire1177TestngParallelSuitesIT 2 0 0 0 100% 18.089
Surefire772BothReportsIT 3 0 0 0 100% 18.627
Surefire803MultiFailsafeExecsIT 2 0 0 0 100% 25.696
Surefire920TestFailureIgnoreWithTimeoutIT 2 0 0 0 100% 18.135
Surefire376TestNgAfterSuiteFailureIT 1 0 0 0 100% 7.829
Surefire847AdditionalFailureIT 1 0 0 0 100% 8.191
Surefire772NoFailsafeReportsIT 4 0 0 0 100% 23.399
Surefire1152RerunFailingTestsInSuiteIT 2 0 0 0 100% 15.826
Surefire705ParallelForkTimeoutIT 1 0 0 0 100% 10.156
Surefire260TestWithIdenticalNamesIT 1 0 0 0 100% 14.348
Surefire224WellFormedXmlFailuresIT 1 0 0 0 100% 7.637
Surefire510TestClassPathForkModesIT 2 0 0 0 100% 15.111
Surefire901MIssingResultfileWhenNoTestsIT 1 0 0 0 100% 6.71
Surefire1080ParallelForkDoubleTestIT 1 0 0 0 100% 8.825
Surefire674BuildFailingWhenErrorsIT 1 0 0 0 100% 7.433
Surefire1024VerifyFailsafeIfTestedIT 1 0 0 0 100% 7.217
Surefire257NotRerunningTestsIT 1 0 0 0 100% 12.319
Surefire500PuzzlingErrorIT 1 0 0 0 100% 7.385
Surefire1098BalancedRunOrderIT 1 0 0 0 100% 31.936
Surefire1396CustomProviderClassPathIT 1 0 0 0 100% 10.732
Surefire1158RemoveInfoLinesIT 6 0 0 0 100% 47.676
Surefire1053SystemPropertiesIT 2 0 0 0 100% 15.096
Surefire926FailureWith2ProvidersIT 1 0 0 0 100% 9.198
Surefire42NotExtendingTestCaseIT 1 0 0 0 100% 7.33
Surefire673MockitoIT 1 0 0 0 100% 7.417
Surefire1202RerunAndSkipIT 2 0 0 0 100% 41.108
Surefire740TruncatedCommaIT 1 0 0 0 100% 6.395
Surefire979WrongClassLoaderIT 1 0 0 0 100% 8.68
Surefire1153IncludesAndSpecifiedTestIT 2 0 0 0 100% 12.597
Surefire812Log4JClassLoaderIT 1 0 0 0 100% 7.46
Surefire735ForkFailWithRedirectConsoleOutputIT 2 0 0 0 100% 13.372
Surefire972BizarreNoClassDefIT 1 0 0 0 100% 9.157
Surefire1535TestNGParallelSuitesIT 4 0 0 0 100% 37.159
Surefire34SecurityManagerIT 2 0 0 0 100% 17.177
Surefire832ProviderSelectionIT 1 0 0 0 100% 8.417
Surefire613TestCountInParallelIT 1 0 0 0 100% 8.574
Surefire817SystemExitIT 1 0 0 0 100% 8.293
Surefire1082ParallelJUnitParameterizedIT 3 0 0 0 100% 28.765

Test Cases

[Summary] [Package List] [Test Cases]

PojoSimpleIT

testit 7.434

JUnit4ForkAlwaysStaticInitPollutionIT

testJunit4Ignore 8.244

JUnit47ConcurrencyIT

test47 9.629

Surefire697NiceSummaryIT

testBuildFailingWhenErrors 7.267

Surefire1490ReportTitleDescriptionIT

shouldHaveCustomizedReportTitleAndDescription 15.739
shouldHaveDefaultReportTitleAndDescription 15.399

JUnitPlatformIT

testVintageEngine 8.046
testTags 8.064
testJQwikEngine 8.027
testMultipleEngines 9.218
testJupiterEngine 8.677

Surefire621TestCountingJunit3InParallelIT

testJunit3ParallelBuildResultCount 8.926
testJunit3ParallelSuiteBuildResultCount 8.678
testJunit3AllParallelBuildResultCount 8.845
testJunit3BuildResultCount 8.637
testJunit3SuiteBuildResultCount 8.477

CheckSingleTestIT

singleTestDotJava 6.364
singleTestNonExistentOverride 6.648
singleTestNonExistent 7.375
singleTest 11.615

CheckTestNgListenerReporterIT

testNgListenerReporter[0: TestNG 5.6] 9.023
testNgListenerReporter[1: TestNG 5.7] 11.503
testNgListenerReporter[2: TestNG 5.10] 9.775
testNgListenerReporter[3: TestNG 5.13] 11.7
testNgListenerReporter[4: TestNG 5.14.6] 10.794
testNgListenerReporter[5: TestNG 5.14.9] 9.425
testNgListenerReporter[6: TestNG 6.0] 14.407
testNgListenerReporter[7: TestNG 6.9.9] 14.93

JUnit47ParallelNotThreadSafeIT

test 6.881

Surefire828EmptyGroupExprIT

testJUnitRunEmptyExcludeGroups 8.165
testJUnitRunEmptyGroups 8.136
testTestNGRunEmptyExcludeGroups 8.121
testTestNGRunEmptyGroups 7.882

CheckTestNgSuiteXmlIT

suiteXml 10.968
suiteXmlForkCountTwoReuse 14.219
suiteXmlForkModeAlways 14.13

Surefire44InnerClassTestIT

testInnerClass 7.139

ForkModeMultiModuleIT

testForkCountOneNoReuse 13.272
testForkCountTwoNoReuse 11.185
testForkCountTwoReuse 10.583
testForkCountOneReuse 11.206

ArgLineIT

argLine 7.448

CheckTestNgListenersIT

TestNgListenerReporter 14.83

ConsoleOutputIT

properNewlinesAndEncodingWithDifferentEncoding 8.309
properNewlinesAndEncodingWithDefaultEncodings 7.903
largerSoutThanMemory 13.629
properNewlinesAndEncodingWithoutFork 7.122

Surefire733AllOverrridesCapturedIT

testLogOutput 7.432

Surefire747MethodParallelWithSuiteCountIT

testMethodsParallelWithSuite 12.761
testClassesParallelWithSuite 14.089

ClasspathFilteringIT

additionalClasspath 7.14

Surefire930TestNgSuiteXmlIT

suiteXmlRun 8.698

JUnit47ParallelIT

unknownThreadCountClasses 6.351
threadCountSuites 10.653
unlimitedThreadsSuitesAndMethods1 8.405
unlimitedThreadsSuitesAndMethods2 8.566
unknownThreadCountMethods 5.866
threadCountClassesAndMethods 9.716
reusableThreadCountClassesAndMethodsOptimized 8.714
unknownThreadCountSuites 6.223
reusableThreadCountAll 7.699
forcedShutdown 9.31
unknownThreadCountAll 6.046
serial 13.826
reusableThreadCountAllOptimized 7.907
suites 10.779
unlimitedThreadsMethods1 9.751
unlimitedThreadsMethods2 9.687
unlimitedThreadsSuitesAndClasses1 7.886
unlimitedThreadsSuitesAndClasses2 7.95
threadCountAllOptimized 10.293
threadCountAll 10.265
everyThreadCountSuitesAndClasses 8.656
unknownThreadCountBoth 6.295
threadCountSuitesAndClassesOptimized 9.077
classesAndMethods 7.877
everyThreadCountSuitesAndMethods 8.97
unknownThreadCountSuitesAndClasses 6.07
reusableThreadCountSuitesAndClassesOptimized 8.87
unknownThreadCountSuitesAndMethods 5.962
suitesAndClasses 8.304
suitesAndMethods 9.007
shutdown 12.062
threadCountClassesAndMethodsOneCore 11.982
everyThreadCountClassesAndMethods 9.046
all 7.751
unknownThreadCountClassesAndMethods 7.501
threadCountSuitesAndMethodsOptimized 9.013
reusableThreadCountSuitesAndMethodsOptimized 9.81
unlimitedThreadsClasses1 9.24
unlimitedThreadsClasses2 9.055
threadCountClasses 9.408
everyThreadCountAll 9.304
threadCountMethods 9.83
unlimitedThreadsSuites1 10.898
unlimitedThreadsSuites2 11.109
threadCountSuitesAndClasses 8.898
unlimitedThreadsClassesAndMethods1 8.043
unlimitedThreadsClassesAndMethods2 8.026
threadCountSuitesAndMethods 9.187
classes 8.901
reusableThreadCountSuitesAndClasses 9.07
methods 9.213
reusableThreadCountSuitesAndMethods 9.033
timeoutAndForcedShutdown 9.158
threadCountClassesAndMethodsOptimized 9.61
unlimitedThreadsAll1 7.588
unlimitedThreadsAll2 7.678
forcedShutdownVerifyingLogs 8.02
threadCountClassesAndMethodsOneCoreOptimized 11.867
reusableThreadCountClassesAndMethods 9.285

IncludesExcludesIT

testPathBasedIncludesExcludes 7.45
testIncludesExcludes 7.381
testRegexIncludesExcludes 7.758

Surefire570MultipleReportDirectoriesIT

testReportWithAggregate 18.729
testReportWithoutAggregate 19.208

Surefire818NpeIgnoresTestsIT

testBuildFailingWhenErrors 7.977

ForkConsoleOutputWithErrorsIT

xmlFileContainsConsoleOutput 5.26

Surefire1278GroupNameEndingIT

testOnlyGroups 8.103

Surefire1135ImproveIgnoreMessageForTestNGIT

testNgReport57 9.592
testNgReport688 9.705

AggregateReportIT

aggregateReport 9.319

Surefire1265Java9IT

shouldRunInPluginJava9
+ [ Detail ]
 0.001
skipped

Surefire634UnsettableSystemPropertiesWarningIT

testJunit3ParallelBuildResultCount 7.562

Surefire801ForkModeNoneClassLoaderIT

testSHouldBeOkWithForkNever 6.179

SystemPropertiesTestIT

testSystemProperties 7.963
testSystemPropertiesNoFork 6.744

ArgLinePropertiesIT

argLine 8.122

Surefire1209RerunAndForkCountIT

notReusableForksJUnit47 17.145
reusableForksJUnit47 21.484
reusableForksJUnit4 15.187
notReusableForksJUnit4 16.326

Surefire1136CwdPropagationInForkedModeIT

testTestNgAndJUnitTogether 7.446

Surefire855AllowFailsafeUseArtifactFileIT

jarNotForkingShouldUseFile 11.921
jarShouldUseFile 11.715
warShouldUseClasses 12.494
osgiBundleShouldUseFile 13.568

Surefire1028UnableToRunSingleIT

methodFilteringParallelExecution 7.061

TestNgGroupsIT

testExclusion 8.118
testGroupsAndExclusion 8.368
groupsWithDash 8.036
testOnlyGroups 9.359
groupsBySimpleRegex 8.185

Surefire1185DoNotSpawnTestsIT

doNotSpawnUnwantedTests 6.376

Surefire628ConsoleOutputBeforeAndAfterClassIT

testJunit3ParallelBuildResultCount 8.188

Surefire1036NonFilterableJUnitRunnerWithCategoriesIT

test 6.898

Surefire772NoSurefireReportsIT

testOptionalSurefireReportGeneration 5.347
testSkippedSurefireReportGeneration 5.335
testSkipOptionalSurefireReportGeneration 5.463
testReportGeneration 5.752

Surefire1122ParallelAndFlakyTestsIT

parallelCreatesCorrectReportFork 10.254
nonParallelCreatesCorrectReport 8.129
parallelCreatesCorrectReport 7.331

Surefire946KillMainProcessInReusableForkIT

testExit 8.373
testHalt 8.684
testInterrupt 8.334

CheckTestNgSuiteXmlSingleIT

TestNgSuite 10.179

TestMultipleMethodPatternsIT

shouldNotRunExcludedClassesAndMethods[0] 6.751
shouldMatchExactClassAndMethodCharacters[0] 6.559
shouldMatchExactClassAndMethodWildcard[0] 6.748
testSuccessTwo[0] 6.899
simpleNameTest[0] 6.566
simpleNameTestWithJavaExt[0] 6.589
regexClass[0] 6.58
shouldNotRunExcludedClasses[0] 6.589
shouldNotRunExcludedMethods[0] 6.357
simpleNameTestWithJavaExtWildcardPkg[0] 6.529
shouldMatchMultiplePatterns[0] 6.57
shouldMatchExactClassAndMethodsPostfix[0] 6.816
simpleNameTestWithWildcardPkg[0] 6.344
shouldMatchWildcardPackageAndClassAndMethod[0] 6.612
shouldMatchExactClassAndMultipleMethods[0] 6.527
fullyQualifiedTest[0] 6.549
matchSimpleClassAndMethodWithJavaExtWildcardPkg[0] 6.565
negativeTest[0]
+ [ Detail ]
 0
skipped
testRegexSuccessTwo[0] 6.769
shouldMatchExactClassAndMethodsWildcard[0] 6.685
shouldMatchMultiplePatternsComplex[0] 6.523
simpleNameTestAsParallel[0]
+ [ Detail ]
 0.001
skipped
matchSimpleClassAndMethodWithWildcardPkg[0] 6.574
shouldMatchMultiplePatternsAsParallel[0]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[0] 6.707
shouldMatchSimpleClassNameAndMethod[0] 7.65
shouldMatchExactClassAndMethodPostfix[0] 6.904
shouldMatchMultiplePatternsComplexAsParallel[0]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[0] 6.6
regexClassAndMethod[0] 6.497
shouldNotRunExcludedClassesAndMethods[1] 7.161
shouldMatchExactClassAndMethodCharacters[1] 7.734
shouldMatchExactClassAndMethodWildcard[1] 7.436
testSuccessTwo[1] 7.556
simpleNameTest[1] 7.439
simpleNameTestWithJavaExt[1] 7.667
regexClass[1] 7.053
shouldNotRunExcludedClasses[1] 6.94
shouldNotRunExcludedMethods[1] 7.213
simpleNameTestWithJavaExtWildcardPkg[1] 7.066
shouldMatchMultiplePatterns[1] 7.37
shouldMatchExactClassAndMethodsPostfix[1] 7.236
simpleNameTestWithWildcardPkg[1] 6.891
shouldMatchWildcardPackageAndClassAndMethod[1] 7.36
shouldMatchExactClassAndMultipleMethods[1] 7.971
fullyQualifiedTest[1] 7.198
matchSimpleClassAndMethodWithJavaExtWildcardPkg[1] 7.026
negativeTest[1]
+ [ Detail ]
 0
skipped
testRegexSuccessTwo[1] 7.194
shouldMatchExactClassAndMethodsWildcard[1] 6.638
shouldMatchMultiplePatternsComplex[1] 7.201
simpleNameTestAsParallel[1] 6.854
matchSimpleClassAndMethodWithWildcardPkg[1] 7.316
shouldMatchMultiplePatternsAsParallel[1] 7.288
shouldNotRunExcludedClassesIfIncluded[1] 6.707
shouldMatchSimpleClassNameAndMethod[1] 7.188
shouldMatchExactClassAndMethodPostfix[1] 7.128
shouldMatchMultiplePatternsComplexAsParallel[1] 7.159
matchSimpleClassAndMethodWithJavaExt[1] 7.14
regexClassAndMethod[1] 7.354
shouldNotRunExcludedClassesAndMethods[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[2]
+ [ Detail ]
 0
skipped
testSuccessTwo[2]
+ [ Detail ]
 0
skipped
simpleNameTest[2] 6.499
simpleNameTestWithJavaExt[2] 6.367
regexClass[2] 6.554
shouldNotRunExcludedClasses[2] 6.33
shouldNotRunExcludedMethods[2]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[2] 6.545
shouldMatchMultiplePatterns[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[2]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[2] 6.439
shouldMatchWildcardPackageAndClassAndMethod[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[2]
+ [ Detail ]
 0.001
skipped
fullyQualifiedTest[2] 6.503
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2]
+ [ Detail ]
 0.001
skipped
negativeTest[2] 5.93
testRegexSuccessTwo[2]
+ [ Detail ]
 0.001
skipped
shouldMatchExactClassAndMethodsWildcard[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[2]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[2]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithWildcardPkg[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[2]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[2] 6.451
shouldMatchSimpleClassNameAndMethod[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[2]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[2]
+ [ Detail ]
 0
skipped
regexClassAndMethod[2]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesAndMethods[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[3]
+ [ Detail ]
 0
skipped
testSuccessTwo[3]
+ [ Detail ]
 0
skipped
simpleNameTest[3] 6.948
simpleNameTestWithJavaExt[3] 7.068
regexClass[3] 7.307
shouldNotRunExcludedClasses[3] 7.082
shouldNotRunExcludedMethods[3]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[3] 6.955
shouldMatchMultiplePatterns[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[3]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[3] 7.214
shouldMatchWildcardPackageAndClassAndMethod[3]
+ [ Detail ]
 0.001
skipped
shouldMatchExactClassAndMultipleMethods[3]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[3] 8.442
matchSimpleClassAndMethodWithJavaExtWildcardPkg[3]
+ [ Detail ]
 0
skipped
negativeTest[3] 6.571
testRegexSuccessTwo[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[3]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[3]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[3] 7.008
matchSimpleClassAndMethodWithWildcardPkg[3]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[3]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[3] 7.174
shouldMatchSimpleClassNameAndMethod[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[3]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[3]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[3]
+ [ Detail ]
 0
skipped
regexClassAndMethod[3]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesAndMethods[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[4]
+ [ Detail ]
 0
skipped
testSuccessTwo[4]
+ [ Detail ]
 0
skipped
simpleNameTest[4] 6.533
simpleNameTestWithJavaExt[4] 6.699
regexClass[4] 6.661
shouldNotRunExcludedClasses[4] 6.328
shouldNotRunExcludedMethods[4]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[4] 7.452
shouldMatchMultiplePatterns[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[4]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[4] 7.609
shouldMatchWildcardPackageAndClassAndMethod[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[4]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[4] 6.933
matchSimpleClassAndMethodWithJavaExtWildcardPkg[4]
+ [ Detail ]
 0
skipped
negativeTest[4] 6.095
testRegexSuccessTwo[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[4]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[4]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[4]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithWildcardPkg[4]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[4]
+ [ Detail ]
 0.001
skipped
shouldNotRunExcludedClassesIfIncluded[4] 6.673
shouldMatchSimpleClassNameAndMethod[4]
+ [ Detail ]
 0.001
skipped
shouldMatchExactClassAndMethodPostfix[4]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[4]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[4]
+ [ Detail ]
 0
skipped
regexClassAndMethod[4]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesAndMethods[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[5]
+ [ Detail ]
 0
skipped
testSuccessTwo[5]
+ [ Detail ]
 0
skipped
simpleNameTest[5] 7.151
simpleNameTestWithJavaExt[5] 6.831
regexClass[5] 6.791
shouldNotRunExcludedClasses[5] 7.193
shouldNotRunExcludedMethods[5]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[5] 6.96
shouldMatchMultiplePatterns[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[5]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[5] 7.08
shouldMatchWildcardPackageAndClassAndMethod[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[5]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[5] 6.906
matchSimpleClassAndMethodWithJavaExtWildcardPkg[5]
+ [ Detail ]
 0
skipped
negativeTest[5] 5.886
testRegexSuccessTwo[5]
+ [ Detail ]
 0.001
skipped
shouldMatchExactClassAndMethodsWildcard[5]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[5]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[5] 9.375
matchSimpleClassAndMethodWithWildcardPkg[5]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[5]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[5] 7.478
shouldMatchSimpleClassNameAndMethod[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[5]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[5]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[5]
+ [ Detail ]
 0
skipped
regexClassAndMethod[5]
+ [ Detail ]
 0
skipped

Surefire146ForkPerTestNoSetupIT

testForkPerTestNoSetup 7.69

Surefire1364SystemPropertiesIT

junit47InProcessParallel 8.908
junit47Forked 8.414
junit47InProcess 8.407
testNg 8.93
junit3Forked 7.665
junit47ForkedParallel 8.364
junit4Forked 7.926
testNgInProcess 8.74
junit4InProcess 7.76
junit3InProcess 7.795

CheckTestNgCustomTestRunnerFactoryIT

testTestNgListenerReporter 10.061

Java9FullApiIT

shouldLoadMultipleJavaModules_JavaHome
+ [ Detail ]
 0.003
skipped
shouldLoadMultipleJavaModules_ToolchainsXML
+ [ Detail ]
 0.001
skipped
shouldLoadMultipleJavaModules_JvmParameter
+ [ Detail ]
 0
skipped

Surefire408ManualProviderSelectionIT

testParallelBuildResultCount 7.715

TestMethodPatternIT

testJUnit48WithCategoryFilter 7.964
testJUnit48Provider47 8.184
testMethodPatternAfter 8.035
testTestNGMethodPattern 7.992
testJUnit48Provider4 7.782
testJUnit44 7.594
testTestNgMethodBefore 7.844

Surefire141PluggableProvidersIT

pluggableProviderPresent 10.131
invokeRuntimeException 9.749
invokeReporterException 10.761
constructorRuntimeException 10.513

EnvironmentVariableIT

environmentVariable 7.87

Surefire1144XmlRunTimeIT

testXmlRunTime 7.739

JUnit47RedirectOutputIT

testClassesParallel 8.51
testPrintSummaryTrueWithRedirect 8.31

CheckTestNgJdk14IT

TestNgJdk14 10.655

ModulePathIT

testModulePath
+ [ Detail ]
 0
skipped

CrashDetectionIT

hardCrashInReusableFork 5.286
crashInReusableFork 5.313
crashInFork 5.377

TestMultipleMethodsIT

testJunit48Provider4 7.909
testJunit44 6.532
testJunit48Provider47 8.733

AdditionalClasspathIT

additionalClasspath 6.332

Surefire1383ScanSessionDependenciesIT

test 6.621

Surefire1211JUnitTestNgIT

withoutJUnit 8.658
withJUnit 9.811

ReportersIT

testRedirectOutputTestNg 7.786

Surefire377TestNgAndJUnitTogetherIT

testTestNgAndJUnit4Together 7.171
testTestNgAndJUnitTogether 8.078

Surefire674BuildFailingWhenFailsafeErrorsIT

testBuildFailingWhenErrors 8.726

JUnit47RerunFailingTestWithCucumberIT

testRerunFailingErrorTestsFalse 7.625
testRerunFailingErrorTestsWithOneRetry 8.113
testRerunFailingErrorTestsTwoRetry 7.753

Surefire649EmptyStringSystemPropertiesIT

systemPropertyVariables 5.921
systemProperties 6.522

Surefire772SpecifiedReportsIT

testSkippedSurefireReportGeneration 5.578
testSkippedFailsafeReportGeneration 5.654
testReportGeneration 5.573

Surefire806SpecifiedTestControlsIT

singleTestInSingleExecutionProject 7.212
twoSpecifiedTestExecutionsInCorrectExecutionBlocks
+ [ Detail ]
 0
since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
singleTestInOneExecutionOfMultiExecutionProject
+ [ Detail ]
 0
since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution

ClasspathScopeFilteringIT

additionalClasspath 6.579

NoRunnableTestsInClassIT

testJunit3ParallelBuildResultCount 7.438

Surefire1041FailingJUnitRunnerIT

reportErrorInJUnitRunnerAsTestError 8.169

LongWindowsPathIT

shouldRunInSystemTmp
+ [ Detail ]
 0.005
skipped

AssumptionFailureReportIT

testWriteSkippedMessageToReport 6.55

JUnitPlatformEnginesIT

testToRegex[1.0.0] 0.003
platform[1.0.0] 8.182
testToRegex[1.1.1] 0
platform[1.1.1] 8.207
testToRegex[1.2.0] 0
platform[1.2.0] 8.188
testToRegex[1.3.1] 0
platform[1.3.1] 8.217

Surefire1295AttributeJvmCrashesToTestsIT

test[0] 9.497
test[1] 12.954
test[2] 10.752
test[3] 10.345
test[4] 15.935
test[5] 11.417
test[6] 12.028
test[7] 13.811
test[8] 10.155

Surefire1179IT

suiteXmlForkCountTwoReuse 12.222

JUnit4RunListenerIT

testJUnit4RunListener 7.955
testRunlistenerJunitCoreProvider 8.172

UseIsolatedClassLoaderIT

testUseSystemClassLoader 7.178

Surefire162CharsetProviderIT

testCharsetProvider 7.242

Surefire907PerThreadWithoutThreadCountIT

categoryAB 6.756

Surefire1055CorrectConcurrentTestCountIT

testTestNgAndJUnitTogether 8.075

CheckTestNgBeforeMethodFailureIT

TestNgBeforeMethodFailure 7.45

Surefire975DefaultVMEncodingIT

runWithRussian1251 7.375

Surefire685CommaSeparatedIncludesIT

testBuildFailingWhenErrors 9.625

Surefire1367AssumptionLogsIT

shouldSeeLogsInPlugin 5.989
shouldSeeLogsParallelInPlugin 7.284
shouldSeeLogsParallelForked 8.338
shouldSeeLogsForked 7.568

TestNgParallelWithAnnotationsIT

testTestNgGroupThreadParallel 9.096

Surefire943ReportContentIT

test_noParallel 15.991
test_parallelBoth 10.36

Surefire569RunTestFromDependencyJarsIT

shouldScanAndRunTestsInDependencyJars 6.851

CheckTestNgGroupThreadParallelIT

TestNgGroupThreadParallel 8.439

TestNgSuccessPercentageIT

testPassesWhenFailuresLessThanSuccessPercentage 6.901

UmlautDirIT

testUmlautIsolatedClassLoader 7.578
testUmlaut 7.604

Surefire839TestWithoutCategoriesIT

classWithoutCategoryForked 8.932
classWithoutCategory 8.297

Surefire985ParameterizedRunnerAndCategoriesIT

test 7.282

TwoTestCasesIT

testJunit4Suite 7.694
testTestNGSuite 7.48
testTwoTestCases 9.236
testTwoTestCaseSuite 8.281

Surefire809GroupExpressionsIT

testNGRunCategoryAB 8.466
testExcludedGroups 9.226
testJUnitRunCategoryNotC 8.094
incorrectJUnitVersions 5.71
categoryAB 8.529
testNGRunCategoryNotC 8.491

IncludesExcludesFromFileIT

testSimpleMixed 8.604
testMissingExcludes 5.883
testRegex 7.701
testPath 7.555
testMissingIncludes 5.84
testSimple 7.282

Surefire995CategoryInheritanceIT

junit411ShouldRunExplicitCategory 6.903
junit411ShouldExcludeExplicitCategory 6.875
junit412ShouldExcludeInheritedCategory 6.965
junit412ShouldRunInheritedCategory 6.726
negativeTestShouldRunAllCategories 6.556

DefaultConfigurationIT

defaultConfiguration 6.373

JUnitDepIT

testJUnit44DepWithSneaky381 7.9
testJUnit44Dep 7.66
testJUnit47Dep 8.216
testJUnit48Dep 8.3

RunOrderIT

testReverseAlphabetical 7.289
testNonExistingRunOrder 6.109
testHourly 7.241
testAlphabetical 7.861

JUnit4IgnoreIT

testJunit4Ignore 7.497
testJunit47ParallelIgnore 8.516

Surefire1264IT

positiveTests 10.056
negativeTests 9.439

EnvironmentVariablesIT

testWhenUseSystemClassLoader 7.847
testWhenDontUseSystemClassLoader 7.699

Surefire1177TestngParallelSuitesIT

twoSuitesInParallelForked 9.186
twoSuitesInParallel 8.903

CheckTestNgReportTestIT

testNgReport 26.174
shouldNotBeVerbose 13.953
shouldBeVerbose 14.179

Surefire772BothReportsIT

testSkippedSurefireReportGeneration 5.773
testSkippedFailsafeReportGeneration 6.886
testReportGeneration 5.968

JUnit48TestCategoriesIT

testCategoriesACFullyQualifiedClassName 8.87
testBadCategoryForkAlways 9.892
testCategoriesABForkAlways 10.252
testCategoriesBadCategory 8.319
testCategoriesACClassNameSuffix 7.745
testCategoriesACFullyQualifiedClassNameForkAlways 10.101
testCategoriesAB 8.252
testCategoriesACClassNameSuffixForkAlways 10.109

JUnit47WithCucumberIT

testWithParallelClasses 7.543
testWithoutParallel 7.692

JUnit4VersionsIT

testJunit[0: JUnit 4.0] 7.484
testJunit[1: JUnit 4.1] 7.364
testJunit[2: JUnit 4.2] 7.541
testJunit[3: JUnit 4.3] 7.309
testJunit[4: JUnit 4.3.1] 7.714
testJunit[5: JUnit 4.4] 7.829
testJunit[6: JUnit 4.5] 7.496
testJunit[7: JUnit 4.6] 7.515
testJunit[8: JUnit 4.7] 7.589
testJunit[9: JUnit 4.8] 7.277
testJunit[10: JUnit 4.8.1] 7.598
testJunit[11: JUnit 4.8.2] 7.604
testJunit[12: JUnit 4.9] 7.608
testJunit[13: JUnit 4.10] 7.379
testJunit[14: JUnit 4.11] 7.38
testJunit[15: JUnit 4.12] 7.568

Surefire803MultiFailsafeExecsIT

testOneExecutionRunInTwoBuilds 16.39
testSecondExecutionRunsAfterFirstExecutionFails 9.306

Surefire920TestFailureIgnoreWithTimeoutIT

timeoutInForkWithBuildFail 9.224
timeoutInForkWithNoBuildFail 8.911

TestSingleMethodIT

fullyQualifiedTestNg 8.124
testJunit48Provider4 7.828
testJunit44 7.256
testJunit48parallel 8.467
testJunit48Provider47 8.125
fullyQualifiedJunit48Provider47 8.207
fullyQualifiedJunit48Provider4 7.571
testTestNg5149 8.241
testTestNg 7.951

FailFastJUnitIT

test[junit4-oneFork-ff1] 5.323
test[junit47-oneFork-ff1] 5.432
test[junit4-oneFork-ff2] 5.393
test[junit47-oneFork-ff2] 5.575
test[junit4-twoForks-ff1] 5.346
test[junit47-twoForks-ff1] 5.243
test[junit4-twoForks-ff2] 5.508
test[junit47-twoForks-ff2] 5.383
test[junit4-oneFork-ff3] 5.315
test[junit47-oneFork-ff3] 5.726
test[junit4-twoForks-ff3] 5.36
test[junit47-twoForks-ff3] 5.607

JUnit47StaticInnerClassTestsIT

testStaticInnerClassTests 6.836

SiblingAggregatorIT

testSiblingAggregator 16.098

RunOrderParallelForksIT

testReverseAlphabetical 7.569
testNonExistingRunOrder 5.483
testHourly 7.353
testAlphabetical 7.31

CheckTestNgPathWithSpacesIT

TestWithSpaces 16.71

Surefire376TestNgAfterSuiteFailureIT

testAfterSuiteFailure 7.829

Surefire847AdditionalFailureIT

testJUnitRunCategoryAB 8.191

Surefire772NoFailsafeReportsIT

testSkippedFailsafeReportGeneration 5.551
testForcedFailsafeReportGeneration 6.68
testSkipForcedFailsafeReportGeneration 5.538
testReportGeneration 5.63

TimeoutForkedTestIT

testTimeoutForked 8.627

Surefire1152RerunFailingTestsInSuiteIT

testJUnit48Provider47 8.367
testJUnit48Provider4 7.459

Surefire705ParallelForkTimeoutIT

testTimeoutForked 10.156

JUnitPlatformStreamCorruptionIT

warningIsNotEmitted 7.871

PlexusConflictIT

testPlexusConflict 7.566
testPlexusConflictIsolatedClassLoader 7.272

Surefire260TestWithIdenticalNamesIT

testWithIdenticalNames 14.348

WorkingDirectoryMissingIT

testWorkingDirectory 7.476

FailFastTestNgIT

test[testng-oneFork-ff1] 5.903
test[testng-oneFork-ff2] 5.323
test[testng-twoForks-ff1] 5.257
test[testng-twoForks-ff2] 5.327
test[testng-oneFork-ff3] 5.384
test[testng-twoForks-ff3] 5.411

Surefire224WellFormedXmlFailuresIT

testWellFormedXmlFailures 7.637

CheckTestNgBeforeMethodIT

TestNgBeforeMethod 9.199

Surefire510TestClassPathForkModesIT

testForkOnce 7.504
testForkAlways 7.607

Surefire901MIssingResultfileWhenNoTestsIT

failsafeWithNoTests 6.71

Surefire1080ParallelForkDoubleTestIT

test 8.825

Surefire674BuildFailingWhenErrorsIT

testBuildFailingWhenErrors 7.433

JUnit44HamcrestIT

testJUnit44Hamcrest 8.511

Surefire1024VerifyFailsafeIfTestedIT

shouldScanAndRunTestsInDependencyJars 7.217

TestMultipleMethodPatternsTestNGIT

shouldNotRunExcludedClassesAndMethods[0] 6.982
shouldMatchExactClassAndMethodCharacters[0] 6.979
shouldMatchExactClassAndMethodWildcard[0] 6.945
testSuccessTwo[0] 7.067
simpleNameTest[0] 7.36
simpleNameTestWithJavaExt[0] 6.999
regexClass[0] 6.924
shouldNotRunExcludedClasses[0] 6.844
shouldNotRunExcludedMethods[0] 7.095
simpleNameTestWithJavaExtWildcardPkg[0] 8.596
shouldMatchMultiplePatterns[0] 6.983
shouldMatchExactClassAndMethodsPostfix[0] 6.87
simpleNameTestWithWildcardPkg[0] 6.814
shouldMatchWildcardPackageAndClassAndMethod[0] 6.738
shouldMatchExactClassAndMultipleMethods[0] 6.617
fullyQualifiedTest[0] 7.012
matchSimpleClassAndMethodWithJavaExtWildcardPkg[0] 6.909
negativeTest[0]
+ [ Detail ]
 0
skipped
testRegexSuccessTwo[0] 6.942
shouldMatchExactClassAndMethodsWildcard[0] 6.639
shouldMatchMultiplePatternsComplex[0] 6.903
simpleNameTestAsParallel[0] 6.784
matchSimpleClassAndMethodWithWildcardPkg[0] 6.997
shouldMatchMultiplePatternsAsParallel[0] 6.839
shouldNotRunExcludedClassesIfIncluded[0] 7.899
shouldMatchSimpleClassNameAndMethod[0] 6.908
shouldMatchExactClassAndMethodPostfix[0] 6.799
shouldMatchMultiplePatternsComplexAsParallel[0] 6.813
matchSimpleClassAndMethodWithJavaExt[0] 7.401
regexClassAndMethod[0] 6.889
shouldNotRunExcludedClassesAndMethods[1]
+ [ Detail ]
 0.001
skipped
shouldMatchExactClassAndMethodCharacters[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[1]
+ [ Detail ]
 0
skipped
testSuccessTwo[1]
+ [ Detail ]
 0
skipped
simpleNameTest[1] 6.929
simpleNameTestWithJavaExt[1] 6.928
regexClass[1] 6.696
shouldNotRunExcludedClasses[1] 6.723
shouldNotRunExcludedMethods[1]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[1] 6.779
shouldMatchMultiplePatterns[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[1]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[1] 7.127
shouldMatchWildcardPackageAndClassAndMethod[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[1]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[1] 6.954
matchSimpleClassAndMethodWithJavaExtWildcardPkg[1]
+ [ Detail ]
 0
skipped
negativeTest[1] 5.959
testRegexSuccessTwo[1]
+ [ Detail ]
 0.001
skipped
shouldMatchExactClassAndMethodsWildcard[1]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[1]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[1] 7.079
matchSimpleClassAndMethodWithWildcardPkg[1]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[1]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[1] 6.836
shouldMatchSimpleClassNameAndMethod[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[1]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[1]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[1]
+ [ Detail ]
 0
skipped
regexClassAndMethod[1]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesAndMethods[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[2]
+ [ Detail ]
 0.001
skipped
testSuccessTwo[2]
+ [ Detail ]
 0
skipped
simpleNameTest[2] 6.883
simpleNameTestWithJavaExt[2] 6.829
regexClass[2] 6.806
shouldNotRunExcludedClasses[2] 8.774
shouldNotRunExcludedMethods[2]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[2] 7.647
shouldMatchMultiplePatterns[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[2]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[2] 7.084
shouldMatchWildcardPackageAndClassAndMethod[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[2]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[2] 6.943
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2]
+ [ Detail ]
 0.001
skipped
negativeTest[2] 6.06
testRegexSuccessTwo[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[2]
+ [ Detail ]
 0.001
skipped
shouldMatchMultiplePatternsComplex[2]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[2] 7.147
matchSimpleClassAndMethodWithWildcardPkg[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[2]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[2] 6.801
shouldMatchSimpleClassNameAndMethod[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[2]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[2]
+ [ Detail ]
 0
skipped
regexClassAndMethod[2]
+ [ Detail ]
 0
skipped

Surefire257NotRerunningTestsIT

shouldNotRerun 12.319

Surefire500PuzzlingErrorIT

testBuildFailingWhenErrors 7.385

Surefire1098BalancedRunOrderIT

reorderedParallelClasses 31.936

Surefire1396CustomProviderClassPathIT

pluggableProviderClasspathCorrect 10.732

Surefire1158RemoveInfoLinesIT

shouldRunWithCliOption[junit-option-ff] 7.952
shouldRunWithCliOption[testng-option-ff] 8.008
shouldRunWithCliOption[junit-option-X] 7.716
shouldRunWithCliOption[testng-option-X] 7.823
shouldRunWithCliOption[junit-option-e] 8.136
shouldRunWithCliOption[testng-option-e] 8.041

CheckTestNgCustomObjectFactoryIT

testTestNgListenerReporter 10.324

Surefire1053SystemPropertiesIT

checkWarningsSysPropTwice 7.548
checkWarningsFileEncoding 7.548

Surefire926FailureWith2ProvidersIT

testBuildFailingWhenErrors 9.198

Surefire42NotExtendingTestCaseIT

testInnerClass 7.33

Surefire673MockitoIT

testBuildFailingWhenErrors 7.417

ClassPathOrderIT

classPathOrder 6.967

WorkingDirectoryIT

testWorkingDirectory 7.323
testWorkingDirectoryChildOnlyNoFork 6.868
testWorkingDirectoryNoFork 6.262
testWorkingDirectoryChildOnly 7.392

Surefire1202RerunAndSkipIT

junit47 20.746
junit4 20.362

ForkModeIT

testForkModeOncePerThreadSingleThread 9.662
testForkModePerTest 11.393
testForkCountZero 8.39
testForkCountOneNoReuse 11.234
testForkCountTwoNoReuse 23.249
testForkModeNever 8.866
testForkCountTwoReuse 22.337
testForkCountOneReuse 9.973
testForkModeOncePerThreadTwoThreads 22.348
testForkModeAlways 11.39
testForkModeNone 8.739
testForkModeOnce 9.903

CheckTestFailIfNoTestsIT

failIfNoTests 6.396
dontFailIfNoTests 5.724
jUnit48CategoriesFailWhenNoTests 6.194

Surefire740TruncatedCommaIT

testRussianLocaleReport 6.395

ForkConsoleOutputIT

printSummaryTrueWithRedirect 7.555
printSummaryFalseWithoutRedirect 7.769
printSummaryTrueWithoutRedirect 7.875
printSummaryFalseWithRedirect 8.035

PlainOldJavaClasspathIT

testPlainOldJavaClasspath 7.254

Surefire979WrongClassLoaderIT

wrongClassloaderUSedInSmartStacktraceparser 8.68

Surefire1153IncludesAndSpecifiedTestIT

testSpecifiedTestInIncludes 6.379
testSpecifiedTestNotInIncludes 6.218

XmlReporterRunTimeIT

testForkModeAlways 30.264

SmartStackTraceIT

misg 7.628

CheckTestFailIfNoTestsForkModeIT

dontFailIfNoTestsForkModeAlways 9.281
failIfNoTestsForkModeOnce 9.97
dontFailIfNoTestsForkModeNever 8.589
dontFailIfNoTestsForkModeOnce 7.522
failIfNoTestsForkModeNever 6.935
failIfNoTestsForkModeAlways 7.419

ForkModeTestNGIT

testForkModeOncePerThreadSingleThread 8.821
testForkModePerTest 11.08
testForkCountZero 7.541
testForkCountOneNoReuse 11.041
testForkCountTwoNoReuse 16.871
testForkModeNever 7.826
testForkCountTwoReuse 15.829
testForkCountOneReuse 8.565
testForkModeOncePerThreadTwoThreads 16.104
testForkModeAlways 10.836
testForkModeNone 7.786
testForkModeOnce 9.248

Surefire812Log4JClassLoaderIT

testJunit3ParallelBuildResultCount 7.46

UnicodeTestNamesIT

checkFileNamesWithUnicode 10.468

Surefire735ForkFailWithRedirectConsoleOutputIT

vmStartFail 6.583
vmStartFailShouldFailBuildk 6.789

CheckTestNgExecuteErrorIT

executionError 5.497

Surefire972BizarreNoClassDefIT

testJunit3ParallelBuildResultCount 9.157

Surefire1535TestNGParallelSuitesIT

forks0 8.757
forks2 9.894
forks0Redirected 8.735
forks2Redirected 9.773

Surefire34SecurityManagerIT

testSecurityManager 9.612
testSecurityManagerSuccessful 7.565

Surefire832ProviderSelectionIT

testJUnitRunCategoryAB 8.417

CheckTestNgVersionsIT

XXXtest50
+ [ Detail ]
 0
5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
test502 12.039
test510 12.32
test511 15.301
test512 17.766
test513 15.977
test514 12.352
test685 16.499
test5131 18.354
test5141 18.522
test5142 20.186
test47 18.44
test51 17.854
test55 14.728
test56 14.979
test57 11.867
test58 13.86
test59 10.031
test60 9
XXXtest501
+ [ Detail ]
 0
5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024

JUnit4RerunFailingTestsIT

testRerunFailingErrorTestsFalse 31.888
testRerunFailingErrorTestsWithOneRetry 31.848
testRerunFailingErrorTestsTwoRetry 32.246
testRerunOneTestMethod 32.169
testRerunOneTestClass 32.134

WorkingDirectoryIsInvalidPropertyIT

testWorkingDirectory 5.791

AbstractTestCaseIT

abstractTestCase 6.299

ResultCountingIT

testCountingWithJunit481ForkAlways 10.745
testCountingWithJunit481ForkOnce 7.76
testCountingWithJunit481ForkNever 6.511

Surefire613TestCountInParallelIT

testParallelBuildResultCount 8.574

Surefire817SystemExitIT

systemExit1 8.293

Surefire1082ParallelJUnitParameterizedIT

checkClassesRunParallel 9.411
shouldRunTwo 10.317
checkOutFileClassesRunParallel 9.037

Failure Details

[Summary] [Package List] [Test Cases]


shouldRunInPluginJava9
skipped: skipped
negativeTest[0]
skipped: skipped
simpleNameTestAsParallel[0]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[0]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[0]
skipped: skipped
negativeTest[1]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[2]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[2]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[2]
skipped: skipped
testSuccessTwo[2]
skipped: skipped
shouldNotRunExcludedMethods[2]
skipped: skipped
shouldMatchMultiplePatterns[2]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[2]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[2]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2]
skipped: skipped
testRegexSuccessTwo[2]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[2]
skipped: skipped
shouldMatchMultiplePatternsComplex[2]
skipped: skipped
simpleNameTestAsParallel[2]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[2]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[2]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[2]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[2]
skipped: skipped
regexClassAndMethod[2]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[3]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[3]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[3]
skipped: skipped
testSuccessTwo[3]
skipped: skipped
shouldNotRunExcludedMethods[3]
skipped: skipped
shouldMatchMultiplePatterns[3]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[3]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[3]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[3]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[3]
skipped: skipped
testRegexSuccessTwo[3]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[3]
skipped: skipped
shouldMatchMultiplePatternsComplex[3]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[3]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[3]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[3]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[3]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[3]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[3]
skipped: skipped
regexClassAndMethod[3]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[4]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[4]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[4]
skipped: skipped
testSuccessTwo[4]
skipped: skipped
shouldNotRunExcludedMethods[4]
skipped: skipped
shouldMatchMultiplePatterns[4]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[4]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[4]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[4]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[4]
skipped: skipped
testRegexSuccessTwo[4]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[4]
skipped: skipped
shouldMatchMultiplePatternsComplex[4]
skipped: skipped
simpleNameTestAsParallel[4]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[4]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[4]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[4]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[4]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[4]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[4]
skipped: skipped
regexClassAndMethod[4]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[5]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[5]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[5]
skipped: skipped
testSuccessTwo[5]
skipped: skipped
shouldNotRunExcludedMethods[5]
skipped: skipped
shouldMatchMultiplePatterns[5]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[5]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[5]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[5]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[5]
skipped: skipped
testRegexSuccessTwo[5]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[5]
skipped: skipped
shouldMatchMultiplePatternsComplex[5]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[5]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[5]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[5]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[5]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[5]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[5]
skipped: skipped
regexClassAndMethod[5]
skipped: skipped
shouldLoadMultipleJavaModules_JavaHome
skipped: skipped
shouldLoadMultipleJavaModules_ToolchainsXML
skipped: skipped
shouldLoadMultipleJavaModules_JvmParameter
skipped: skipped
testModulePath
skipped: skipped
twoSpecifiedTestExecutionsInCorrectExecutionBlocks
skipped: since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
singleTestInOneExecutionOfMultiExecutionProject
skipped: since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
shouldRunInSystemTmp
skipped: skipped
negativeTest[0]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[1]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[1]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[1]
skipped: skipped
testSuccessTwo[1]
skipped: skipped
shouldNotRunExcludedMethods[1]
skipped: skipped
shouldMatchMultiplePatterns[1]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[1]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[1]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[1]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[1]
skipped: skipped
testRegexSuccessTwo[1]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[1]
skipped: skipped
shouldMatchMultiplePatternsComplex[1]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[1]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[1]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[1]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[1]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[1]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[1]
skipped: skipped
regexClassAndMethod[1]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[2]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[2]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[2]
skipped: skipped
testSuccessTwo[2]
skipped: skipped
shouldNotRunExcludedMethods[2]
skipped: skipped
shouldMatchMultiplePatterns[2]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[2]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[2]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2]
skipped: skipped
testRegexSuccessTwo[2]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[2]
skipped: skipped
shouldMatchMultiplePatternsComplex[2]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[2]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[2]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[2]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[2]
skipped: skipped
regexClassAndMethod[2]
skipped: skipped
XXXtest50
skipped: 5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
XXXtest501
skipped: 5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024