Fork me on GitHub

Failsafe Report

Summary

[Summary] [Package List] [Test Cases]


Tests Errors Failures Skipped Success Rate Time
1004 0 0 143 85.757% 9,193.602

Note: failures are anticipated and checked for with assertions while errors are unanticipated.


Package List

[Summary] [Package List] [Test Cases]


Package Tests Errors Failures Skipped Success Rate Time
org.apache.maven.surefire.its 771 0 0 137 82.231% 6,872.676
org.apache.maven.surefire.its.jiras 233 0 0 6 97.425% 2,320.924

Note: package statistics are not computed recursively, they only sum up all of its testsuites numbers.

org.apache.maven.surefire.its

Class Tests Errors Failures Skipped Success Rate Time
AbstractTestCaseIT 1 0 0 0 100% 8.452
AdditionalClasspathIT 1 0 0 0 100% 8.094
AggregateReportIT 1 0 0 0 100% 10.921
ArgLineIT 1 0 0 0 100% 8.354
ArgLinePropertiesIT 1 0 0 0 100% 7.569
AssumptionFailureReportIT 1 0 0 0 100% 6.632
CheckSingleTestIT 4 0 0 0 100% 27.868
CheckTestFailIfNoTestsForkModeIT 6 0 0 0 100% 44.283
CheckTestFailIfNoTestsIT 3 0 0 0 100% 16.189
CheckTestNg740ParallelIT 1 0 0 0 100% 11.206
CheckTestNgBeforeMethodFailureIT 1 0 0 0 100% 8.893
CheckTestNgBeforeMethodIT 1 0 0 0 100% 8.547
CheckTestNgCustomObjectFactoryIT 1 0 0 0 100% 7.39
CheckTestNgCustomTestRunnerFactoryIT 1 0 0 0 100% 7.477
CheckTestNgExecuteErrorIT 1 0 0 0 100% 7.803
CheckTestNgGroupThreadParallelIT 1 0 0 0 100% 8.563
CheckTestNgJdk14IT 1 0 0 0 100% 9.577
CheckTestNgListenerReporterIT 9 0 0 1 88.889% 89.383
CheckTestNgListenersIT 1 0 0 0 100% 11.251
CheckTestNgPathWithSpacesIT 1 0 0 0 100% 8.728
CheckTestNgReportTestIT 3 0 0 0 100% 32.339
CheckTestNgSuiteXmlIT 3 0 0 0 100% 26.491
CheckTestNgSuiteXmlSingleIT 1 0 0 0 100% 8.504
CheckTestNgVersionsIT 20 0 0 2 90% 200.515
ClasspathFilteringIT 1 0 0 0 100% 8.308
ClassPathOrderIT 1 0 0 0 100% 9.222
ClasspathScopeFilteringIT 1 0 0 0 100% 8.486
ConsoleOutputIT 8 0 0 0 100% 97.678
CrashDetectionIT 3 0 0 0 100% 25.183
DefaultConfigurationIT 1 0 0 0 100% 6.657
EnvironmentVariableIT 1 0 0 0 100% 8.419
EnvironmentVariablesIT 3 0 0 0 100% 28.281
FailFastJUnitIT 14 0 0 0 100% 410.623
FailFastTestNgIT 8 0 0 0 100% 233.784
ForkConsoleOutputIT 4 0 0 0 100% 47.456
ForkConsoleOutputWithErrorsIT 1 0 0 0 100% 22.333
ForkModeIT 12 0 0 0 100% 171.774
ForkModeMultiModuleIT 4 0 0 0 100% 60.889
ForkModeTestNGIT 12 0 0 0 100% 146.26
IncludesExcludesFromFileIT 6 0 0 0 100% 53.226
IncludesExcludesIT 3 0 0 0 100% 24.591
Java9FullApiIT 3 0 0 0 100% 39.039
JUnit44HamcrestIT 1 0 0 0 100% 7.653
JUnit47ConcurrencyIT 1 0 0 0 100% 9.172
JUnit47ParallelIT 59 0 0 0 100% 671.62
JUnit47ParallelNotThreadSafeIT 1 0 0 0 100% 8.845
JUnit47RedirectOutputIT 2 0 0 0 100% 18.205
JUnit47RerunFailingTestWithCucumberIT 6 0 0 0 100% 78.222
JUnit47StaticInnerClassTestsIT 1 0 0 0 100% 10.38
JUnit47WithCucumberIT 2 0 0 0 100% 20.54
JUnit48TestCategoriesIT 8 0 0 0 100% 91.101
JUnit4ForkAlwaysStaticInitPollutionIT 1 0 0 0 100% 10.522
JUnit4IgnoreIT 2 0 0 0 100% 17.509
JUnit4RerunFailingTestsIT 5 0 0 0 100% 177.364
JUnit4RunListenerIT 2 0 0 0 100% 16.48
JUnit4VersionsIT 17 0 0 0 100% 154.718
Junit5ModulePathIT 2 0 0 0 100% 27.312
JUnitDepIT 4 0 0 0 100% 37.642
JUnitPlatformEnginesIT 119 0 0 3 97.479% 1,032.896
JUnitPlatformIT 18 0 0 0 100% 170.947
JUnitPlatformRerunFailingTestsIT 7 0 0 0 100% 238.923
JUnitPlatformStreamCorruptionIT 3 0 0 1 66.667% 21.334
LongWindowsPathIT 1 0 0 0 100% 11.667
ModulePathIT 2 0 0 0 100% 21.508
MultiModuleProjectWithJPMSIT 1 0 0 0 100% 15.494
NoRunnableTestsInClassIT 1 0 0 0 100% 9.656
PlainOldJavaClasspathIT 1 0 0 0 100% 8.605
PlexusConflictIT 2 0 0 0 100% 14.813
PojoSimpleIT 1 0 0 0 100% 8.133
ReportersIT 1 0 0 0 100% 7.97
ResultCountingIT 3 0 0 0 100% 29
RunOrderIT 10 0 0 0 100% 138.15
RunOrderParallelForksIT 10 0 0 0 100% 134.617
SiblingAggregatorIT 1 0 0 0 100% 8.017
SmartStackTraceIT 1 0 0 0 100% 9.285
Surefire1602IT 1 0 0 0 100% 18.648
SystemPropertiesTestIT 2 0 0 0 100% 23.501
TestMethodPatternIT 14 0 0 0 100% 132.978
TestMultipleMethodPatternsIT 180 0 0 87 51.667% 763.733
TestMultipleMethodPatternsTestNGIT 90 0 0 41 54.444% 380.73
TestMultipleMethodsIT 3 0 0 0 100% 24.742
TestNgGroupsIT 5 0 0 0 100% 44
TestNgParallelWithAnnotationsIT 1 0 0 0 100% 14.443
TestNgSuccessPercentageIT 1 0 0 0 100% 7.003
TestSingleMethodIT 9 0 0 0 100% 76.523
TimeoutForkedTestIT 1 0 0 0 100% 18.398
TwoTestCasesIT 4 0 0 0 100% 29.332
UmlautDirIT 4 0 0 2 50% 17.854
UnicodeTestNamesIT 1 0 0 0 100% 13.802
UseIsolatedClassLoaderIT 1 0 0 0 100% 7.059
WorkingDirectoryIsInvalidPropertyIT 1 0 0 0 100% 6.693
WorkingDirectoryIT 4 0 0 0 100% 27.238
WorkingDirectoryMissingIT 1 0 0 0 100% 8.704
XmlReporterRunTimeIT 1 0 0 0 100% 31.758

org.apache.maven.surefire.its.jiras

Class Tests Errors Failures Skipped Success Rate Time
SpockIT 1 0 0 1 0% 0
Surefire1004RunTestFromDependencyJarsTypeAndClassifierIT 1 0 0 0 100% 8.138
Surefire1024VerifyFailsafeIfTestedIT 1 0 0 0 100% 8.762
Surefire1028UnableToRunSingleIT 1 0 0 0 100% 9.921
Surefire1036NonFilterableJUnitRunnerWithCategoriesIT 1 0 0 0 100% 9
Surefire1041FailingJUnitRunnerIT 1 0 0 0 100% 9.682
Surefire1053SystemPropertiesIT 2 0 0 0 100% 14.957
Surefire1055CorrectConcurrentTestCountIT 1 0 0 0 100% 9.23
Surefire1080ParallelForkDoubleTestIT 1 0 0 0 100% 10.974
Surefire1082ParallelJUnitParameterizedIT 3 0 0 0 100% 32.254
Surefire1095NpeInRunListenerIT 3 0 0 0 100% 21.133
Surefire1098BalancedRunOrderIT 1 0 0 0 100% 19.686
Surefire1122ParallelAndFlakyTestsIT 3 0 0 0 100% 24.932
Surefire1135ImproveIgnoreMessageForTestNGIT 2 0 0 0 100% 20.924
Surefire1136CwdPropagationInForkedModeIT 1 0 0 0 100% 8.454
Surefire1144XmlRunTimeIT 1 0 0 0 100% 8.485
Surefire1146RerunFailedAndParameterizedIT 1 0 0 0 100% 7.069
Surefire1152RerunFailingTestsInSuiteIT 2 0 0 0 100% 16.959
Surefire1153IncludesAndSpecifiedTestIT 2 0 0 0 100% 14.793
Surefire1158RemoveInfoLinesIT 6 0 0 0 100% 54.123
Surefire1177TestngParallelSuitesIT 2 0 0 0 100% 20.805
Surefire1179IT 1 0 0 0 100% 14.192
Surefire1185DoNotSpawnTestsIT 1 0 0 0 100% 6.835
Surefire1202RerunAndSkipIT 2 0 0 0 100% 41.889
Surefire1209RerunAndForkCountIT 4 0 0 0 100% 66.811
Surefire1211JUnitTestNgIT 2 0 0 0 100% 18.258
Surefire1264IT 2 0 0 0 100% 21.888
Surefire1265Java9IT 1 0 0 0 100% 6.895
Surefire1278GroupNameEndingIT 1 0 0 0 100% 8.025
Surefire1295AttributeJvmCrashesToTestsIT 9 0 0 0 100% 111.848
Surefire1364SystemPropertiesIT 10 0 0 0 100% 92.418
Surefire1367AssumptionLogsIT 4 0 0 0 100% 31.528
Surefire1383ScanSessionDependenciesIT 1 0 0 0 100% 16.684
Surefire1396CustomProviderClassPathIT 1 0 0 0 100% 15.339
Surefire141PluggableProvidersIT 4 0 0 0 100% 37.007
Surefire1426JvmCrashShouldNotBeIgnoredIT 1 0 0 0 100% 8.127
Surefire146ForkPerTestNoSetupIT 1 0 0 0 100% 7.6
Surefire1490ReportTitleDescriptionIT 2 0 0 0 100% 31.299
Surefire1534ReuseForksFalseWithJavaModuleIT 3 0 0 0 100% 31.542
Surefire1535TestNGParallelSuitesIT 4 0 0 0 100% 39.385
Surefire1570ModularFailsafeIT 1 0 0 0 100% 17.306
Surefire1585IT 2 0 0 0 100% 15.681
Surefire162CharsetProviderIT 1 0 0 0 100% 7.274
Surefire1712ExtractedModulenameWithoutASMIT 1 0 0 0 100% 8.511
Surefire1733JUnitIT 1 0 0 0 100% 12.082
Surefire1733TestngIT 1 0 0 0 100% 14.055
Surefire1744AlwaysIncludeOutputLogsIT 1 0 0 0 100% 6.689
Surefire1787JUnit5IT 10 0 0 0 100% 85.435
Surefire1881IT 1 0 0 0 100% 14.565
Surefire1914XmlReportingParameterizedTestIT 8 0 0 0 100% 78.538
Surefire1964IT 2 0 0 0 100% 14.272
Surefire1967CheckTestNgMethodParallelOrderingIT 4 0 0 1 75% 23.836
Surefire1993JpmsProvidingModulesIT 1 0 0 0 100% 14.26
Surefire2006ShadefireTransformersIT 1 0 0 0 100% 8.393
Surefire2036IT 1 0 0 0 100% 9.929
Surefire224WellFormedXmlFailuresIT 1 0 0 0 100% 7.002
Surefire257NotRerunningTestsIT 1 0 0 0 100% 9.753
Surefire260TestWithIdenticalNamesIT 1 0 0 0 100% 16.219
Surefire34SecurityManagerIT 3 0 0 2 33.333% 7.933
Surefire376TestNgAfterSuiteFailureIT 1 0 0 0 100% 7.818
Surefire377TestNgAndJUnitTogetherIT 2 0 0 0 100% 15.093
Surefire408ManualProviderSelectionIT 1 0 0 0 100% 7.243
Surefire42NotExtendingTestCaseIT 1 0 0 0 100% 6.898
Surefire44InnerClassTestIT 1 0 0 0 100% 8.74
Surefire500PuzzlingErrorIT 1 0 0 0 100% 8.66
Surefire510TestClassPathForkModesIT 2 0 0 0 100% 14.43
Surefire569RunTestFromDependencyJarsIT 1 0 0 0 100% 7.453
Surefire570MultipleReportDirectoriesIT 2 0 0 0 100% 39.277
Surefire613TestCountInParallelIT 1 0 0 0 100% 8.692
Surefire621TestCountingJunit3InParallelIT 5 0 0 0 100% 50.458
Surefire628ConsoleOutputBeforeAndAfterClassIT 1 0 0 0 100% 8.786
Surefire634UnsettableSystemPropertiesWarningIT 1 0 0 0 100% 7.352
Surefire649EmptyStringSystemPropertiesIT 2 0 0 0 100% 13.243
Surefire673MockitoIT 1 0 0 0 100% 8.407
Surefire674BuildFailingWhenErrorsIT 1 0 0 0 100% 8.077
Surefire674BuildFailingWhenFailsafeErrorsIT 1 0 0 0 100% 5.56
Surefire685CommaSeparatedIncludesIT 1 0 0 0 100% 8.648
Surefire697NiceSummaryIT 1 0 0 0 100% 7.123
Surefire705ParallelForkTimeoutIT 1 0 0 0 100% 11.492
Surefire733AllOverrridesCapturedIT 1 0 0 0 100% 7.021
Surefire735ForkFailWithRedirectConsoleOutputIT 2 0 0 0 100% 13.897
Surefire740TruncatedCommaIT 1 0 0 0 100% 7.687
Surefire747MethodParallelWithSuiteCountIT 2 0 0 0 100% 29.404
Surefire772BothReportsIT 3 0 0 0 100% 13.901
Surefire772NoFailsafeReportsIT 4 0 0 0 100% 20.68
Surefire772NoSurefireReportsIT 4 0 0 0 100% 19.454
Surefire772SpecifiedReportsIT 3 0 0 0 100% 13.764
Surefire801ForkModeNoneClassLoaderIT 1 0 0 0 100% 6.56
Surefire803MultiFailsafeExecsIT 2 0 0 0 100% 32.638
Surefire806SpecifiedTestControlsIT 3 0 0 2 33.333% 7.156
Surefire809GroupExpressionsIT 6 0 0 0 100% 50.225
Surefire812Log4JClassLoaderIT 1 0 0 0 100% 7.577
Surefire817SystemExitIT 1 0 0 0 100% 8.998
Surefire818NpeIgnoresTestsIT 1 0 0 0 100% 7.397
Surefire828EmptyGroupExprIT 4 0 0 0 100% 36.778
Surefire832ProviderSelectionIT 1 0 0 0 100% 8.781
Surefire839TestWithoutCategoriesIT 2 0 0 0 100% 18.834
Surefire847AdditionalFailureIT 1 0 0 0 100% 8.353
Surefire855AllowFailsafeUseArtifactFileIT 4 0 0 0 100% 56.927
Surefire901MIssingResultfileWhenNoTestsIT 1 0 0 0 100% 7.877
Surefire907PerThreadWithoutThreadCountIT 1 0 0 0 100% 7.213
Surefire920TestFailureIgnoreWithTimeoutIT 2 0 0 0 100% 31.548
Surefire926FailureWith2ProvidersIT 1 0 0 0 100% 4.774
Surefire930TestNgSuiteXmlIT 1 0 0 0 100% 9.617
Surefire943ReportContentIT 2 0 0 0 100% 36.158
Surefire946KillMainProcessInReusableForkIT 6 0 0 0 100% 191.889
Surefire972BizarreNoClassDefIT 1 0 0 0 100% 9.392
Surefire975DefaultVMEncodingIT 1 0 0 0 100% 7.221
Surefire979WrongClassLoaderIT 1 0 0 0 100% 7.633
Surefire985ParameterizedRunnerAndCategoriesIT 1 0 0 0 100% 8.253
Surefire995CategoryInheritanceIT 7 0 0 0 100% 60.283

Test Cases

[Summary] [Package List] [Test Cases]

AbstractTestCaseIT

abstractTestCase 8.415

AdditionalClasspathIT

additionalClasspath 8.079

AggregateReportIT

aggregateReport 10.908

ArgLineIT

argLine 8.346

ArgLinePropertiesIT

argLine 7.565

AssumptionFailureReportIT

testWriteSkippedMessageToReport 6.628

CheckSingleTestIT

singleTestDotJava 6.742
singleTestNonExistentOverride 6.779
singleTestNonExistent 6.166
singleTest 8.179

CheckTestFailIfNoTestsForkModeIT

dontFailIfNoTestsForkModeAlways 8.618
failIfNoTestsForkModeOnce 8.018
dontFailIfNoTestsForkModeNever 6.904
dontFailIfNoTestsForkModeOnce 7.609
failIfNoTestsForkModeNever 6.457
failIfNoTestsForkModeAlways 6.675

CheckTestFailIfNoTestsIT

failIfNoTests 5.037
dontFailIfNoTests 4.912
jUnit48CategoriesFailWhenNoTests 6.237

CheckTestNg740ParallelIT

withTestNG740AndParallelSet 11.203

CheckTestNgBeforeMethodFailureIT

testNgBeforeMethodFailure 8.891

CheckTestNgBeforeMethodIT

testNgBeforeMethod 8.545

CheckTestNgCustomObjectFactoryIT

testTestNgListenerReporter 7.388

CheckTestNgCustomTestRunnerFactoryIT

testTestNgListenerReporter 7.474

CheckTestNgExecuteErrorIT

executionError 7.799

CheckTestNgGroupThreadParallelIT

testNgGroupThreadParallel 8.558

CheckTestNgJdk14IT

testNgJdk14 9.57

CheckTestNgListenerReporterIT

testNgListenerReporter[0: TestNG 5.6] 9.064
testNgListenerReporter[1: TestNG 5.7] 8.459
testNgListenerReporter[2: TestNG 5.10] 8.482
testNgListenerReporter[3: TestNG 5.13] 0
java.specification.version: 18
testNgListenerReporter[4: TestNG 5.14.6] 8.973
testNgListenerReporter[5: TestNG 5.14.9] 13.726
testNgListenerReporter[6: TestNG 6.0] 14.643
testNgListenerReporter[7: TestNG 6.14.3] 12.492
testNgListenerReporter[8: TestNG 7.0.0] 13.535

CheckTestNgListenersIT

testNgListenerReporter 11.246

CheckTestNgPathWithSpacesIT

testWithSpaces 8.725

CheckTestNgReportTestIT

testNgReport 11.714
shouldNotBeVerbose 10.696
shouldBeVerbose 9.926

CheckTestNgSuiteXmlIT

suiteXml 8.915
suiteXmlForkCountTwoReuse 8.272
suiteXmlForkModeAlways 9.3

CheckTestNgSuiteXmlSingleIT

testNgSuite 8.501

CheckTestNgVersionsIT

test502 10.376
test510 10.168
test511 9.759
test512 9.338
test513 9.171
test514 10.128
test685 13.02
test5131 11.706
test5141 12.925
test5142 14.167
test47 12.19
test51 12.423
test55 11.307
test56 11.342
test57 10.781
test58 9.663
test59 10.925
test60 11.117
xXXtest501 0
5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
xXXtest50 0
5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024

ClasspathFilteringIT

additionalClasspath 8.303

ClassPathOrderIT

classPathOrder 9.206

ClasspathScopeFilteringIT

additionalClasspath 8.484

ConsoleOutputIT

properNewlinesAndEncodingWithDifferentEncoding[0] 9.888
properNewlinesAndEncodingWithDefaultEncodings[0] 9.082
largerSoutThanMemory[0] 24.178
properNewlinesAndEncodingWithoutFork[0] 8.068
properNewlinesAndEncodingWithDifferentEncoding[1] 8.651
properNewlinesAndEncodingWithDefaultEncodings[1] 8.248
largerSoutThanMemory[1] 21.588
properNewlinesAndEncodingWithoutFork[1] 7.971

CrashDetectionIT

hardCrashInReusableFork 9.161
crashInReusableFork 8.128
crashInFork 7.888

DefaultConfigurationIT

defaultConfiguration 6.649

EnvironmentVariableIT

environmentVariable 8.415

EnvironmentVariablesIT

testWhenUseSystemClassLoader 9.405
testExcludedEnv 9.657
testWhenDontUseSystemClassLoader 9.215

FailFastJUnitIT

test[junit4-oneFork-ff1] 12.852
test[junit47-oneFork-ff1] 15.522
test[junit4-oneFork-ff2] 26.352
test[junit47-oneFork-ff2] 26.66
test[junit4-twoForks-ff1] 21.647
test[junit47-twoForks-ff1] 22.82
test[junit4-twoForks-ff2] 25.948
test[junit4-twoForks-ff2-tcp] 30.136
test[junit47-twoForks-ff2] 27.281
test[junit4-oneFork-ff3] 48.823
test[junit47-oneFork-ff3] 50.601
test[junit4-twoForks-ff3] 32.271
test[junit47-twoForks-ff3] 34.98
test[junit47-twoForks-ff3-tcp] 34.726

FailFastTestNgIT

test[testng-oneFork-ff1] 13.274
test[testng-oneFork-ff2] 25.294
test[testng-twoForks-ff1] 22.382
test[testng-twoForks-ff2] 25.678
test[testng-twoForks-ff2-tcp] 26.73
test[testng-oneFork-ff3] 50.578
test[testng-twoForks-ff3] 33.701
test[testng-twoForks-ff3-tcp] 36.144

ForkConsoleOutputIT

printSummaryTrueWithRedirect 8.848
printSummaryFalseWithoutRedirect 9.591
printSummaryTrueWithoutRedirect 14.765
printSummaryFalseWithRedirect 14.247

ForkConsoleOutputWithErrorsIT

xmlFileContainsConsoleOutput 10.531

ForkModeIT

testForkModeOncePerThreadSingleThread 11.04
testForkModePerTest 12.435
testForkCountZero 10.622
testForkCountOneNoReuse 11.255
testForkCountTwoNoReuse 23.306
testForkModeNever 10.27
testForkCountTwoReuse 24.145
testForkCountOneReuse 10.572
testForkModeOncePerThreadTwoThreads 23.65
testForkModeAlways 14.168
testForkModeNone 9.791
testForkModeOnce 10.518

ForkModeMultiModuleIT

testForkCountOneNoReuse 15.203
testForkCountTwoNoReuse 13.712
testForkCountTwoReuse 11.362
testForkCountOneReuse 11.249

ForkModeTestNGIT

testForkModeOncePerThreadSingleThread 9.026
testForkModePerTest 14.301
testForkCountZero 9.357
testForkCountOneNoReuse 11.329
testForkCountTwoNoReuse 16.34
testForkModeNever 8.603
testForkCountTwoReuse 18.006
testForkCountOneReuse 9.778
testForkModeOncePerThreadTwoThreads 17.135
testForkModeAlways 11.206
testForkModeNone 10.291
testForkModeOnce 10.885

IncludesExcludesFromFileIT

testSimpleMixed 8.876
testMissingExcludes 8.58
testRegex 8.668
testPath 10.146
testMissingIncludes 7.519
testSimple 9.434

IncludesExcludesIT

testPathBasedIncludesExcludes 8.71
testIncludesExcludes 7.707
testRegexIncludesExcludes 8.17

Java9FullApiIT

shouldLoadMultipleJavaModules_JavaHome 13.907
shouldLoadMultipleJavaModules_ToolchainsXML 12.666
shouldLoadMultipleJavaModules_JvmParameter 12.46

SpockIT

test 0
java.specification.version: 18

Surefire1004RunTestFromDependencyJarsTypeAndClassifierIT

shouldScanAndRunTestsInDependencyJars 8.13

Surefire1024VerifyFailsafeIfTestedIT

shouldScanAndRunTestsInDependencyJars 8.757

Surefire1028UnableToRunSingleIT

methodFilteringParallelExecution 9.917

Surefire1036NonFilterableJUnitRunnerWithCategoriesIT

test 8.994

Surefire1041FailingJUnitRunnerIT

reportErrorInJUnitRunnerAsTestError 9.676

Surefire1053SystemPropertiesIT

checkWarningsSysPropTwice 7.472
checkWarningsFileEncoding 7.479

Surefire1055CorrectConcurrentTestCountIT

testTestNgAndJUnitTogether 9.225

Surefire1080ParallelForkDoubleTestIT

test 10.969

Surefire1082ParallelJUnitParameterizedIT

checkClassesRunParallel 11.481
shouldRunTwo 10.767
checkOutFileClassesRunParallel 10

Surefire1095NpeInRunListenerIT

testRunStartedWithJUnit40 6.795
testRunStartedWithJUnit45 6.542
testRunStartedWithJUnit47 7.792

Surefire1098BalancedRunOrderIT

reorderedParallelClasses 19.681

Surefire1122ParallelAndFlakyTestsIT

parallelCreatesCorrectReportFork 8.75
nonParallelCreatesCorrectReport 8.451
parallelCreatesCorrectReport 7.724

Surefire1135ImproveIgnoreMessageForTestNGIT

testNgReport57 9.193
testNgReport688 11.725

Surefire1136CwdPropagationInForkedModeIT

testTestNgAndJUnitTogether 8.449

Surefire1144XmlRunTimeIT

testXmlRunTime 8.48

Surefire1146RerunFailedAndParameterizedIT

testsAreRerun 7.065

Surefire1152RerunFailingTestsInSuiteIT

testJUnit48Provider47 9.225
testJUnit48Provider4 7.723

Surefire1153IncludesAndSpecifiedTestIT

testSpecifiedTestInIncludes 6.893
testSpecifiedTestNotInIncludes 7.874

Surefire1158RemoveInfoLinesIT

shouldRunWithCliOption[junit-option-ff] 10.667
shouldRunWithCliOption[testng-option-ff] 7.894
shouldRunWithCliOption[junit-option-X] 9.111
shouldRunWithCliOption[testng-option-X] 8.559
shouldRunWithCliOption[junit-option-e] 8.978
shouldRunWithCliOption[testng-option-e] 8.909

Surefire1177TestngParallelSuitesIT

twoSuitesInParallelForked 11.001
twoSuitesInParallel 9.801

Surefire1179IT

suiteXmlForkCountTwoReuse 14.189

Surefire1185DoNotSpawnTestsIT

doNotSpawnUnwantedTests 6.831

Surefire1202RerunAndSkipIT

junit47 21.564
junit4 20.323

Surefire1209RerunAndForkCountIT

notReusableForksJUnit47 17.26
reusableForksJUnit47 18.58
reusableForksJUnit4 14.919
notReusableForksJUnit4 16.048

Surefire1211JUnitTestNgIT

withoutJUnit 8.538
withJUnit 9.716

Surefire1264IT

positiveTests 11.323
negativeTests 10.561

Surefire1265Java9IT

shouldRunInPluginJava9 6.892

Surefire1278GroupNameEndingIT

testOnlyGroups 8.022

Surefire1295AttributeJvmCrashesToTestsIT

test[0] 10.25
test[1] 15.036
test[2] 10.499
test[3] 12.536
test[4] 15.371
test[5] 14.587
test[6] 10.189
test[7] 13.292
test[8] 10.083

Surefire1364SystemPropertiesIT

junit47InProcessParallel 9.904
junit47Forked 11.234
junit47InProcess 9.812
testNg 8.63
junit3Forked 7.737
junit47ForkedParallel 9.172
junit4Forked 8.062
testNgInProcess 10.171
junit4InProcess 9.695
junit3InProcess 7.997

Surefire1367AssumptionLogsIT

shouldSeeLogsInPlugin 6.583
shouldSeeLogsParallelInPlugin 8.113
shouldSeeLogsParallelForked 8.942
shouldSeeLogsForked 7.885

Surefire1383ScanSessionDependenciesIT

test 8.531

Surefire1396CustomProviderClassPathIT

pluggableProviderClasspathCorrect 8.816

Surefire141PluggableProvidersIT

pluggableProviderPresent 8.25
invokeRuntimeException 8.234
invokeReporterException 9.946
constructorRuntimeException 10.573

Surefire1426JvmCrashShouldNotBeIgnoredIT

mavenShouldFail 8.123

Surefire146ForkPerTestNoSetupIT

testForkPerTestNoSetup 7.598

Surefire1490ReportTitleDescriptionIT

shouldHaveCustomizedReportTitleAndDescription 16.304
shouldHaveDefaultReportTitleAndDescription 14.989

Surefire1534ReuseForksFalseWithJavaModuleIT

testExecuteWithReuseForksFalseWithJavaModule 10.394
testExecuteWithReuseForksFalseWithJavaModuleWithFilter 11.086
testExecuteWithZeroForkCountWithJavaModule 10.059

Surefire1535TestNGParallelSuitesIT

forks0 9.218
forks2 9.452
forks0Redirected 9.244
forks2Redirected 11.466

Surefire1570ModularFailsafeIT

shouldRunWithJupiterApi 17.303

Surefire1585IT

shouldRunWithJupiterApi 7.999
shouldRunWithVintage 7.679

Surefire162CharsetProviderIT

testCharsetProvider 7.269

Surefire1712ExtractedModulenameWithoutASMIT

test 8.508

Surefire1733JUnitIT

test 12.079

Surefire1733TestngIT

test 14.051

Surefire1744AlwaysIncludeOutputLogsIT

testAlwaysIncludeOutputLogs 6.686

Surefire1787JUnit5IT

apiAndEngine 8.058
testNgWithJupiterApi 8.743
testNg 8.258
junit5Suite 9.447
bothEngines 9.849
junit4Runner 8.505
selectJUnit4 7.901
selectJUnit5 7.74
testNgWithJupiterEngine 9.032
bothApis 7.899

Surefire1881IT

test 14.565

Surefire1914XmlReportingParameterizedTestIT

testXmlReport[1.0.3] 10.229
testXmlReport[1.1.1] 9.242
testXmlReport[1.2.0] 8.883
testXmlReport[1.3.2] 8.925
testXmlReport[1.4.2] 9.332
testXmlReport[1.5.2] 10.728
testXmlReport[1.6.2] 11.546
testXmlReport[1.7.1] 9.65

Surefire1964IT

shouldFilterTests 7.688
shouldFilterTestsInPluginProcess 6.581

Surefire1967CheckTestNgMethodParallelOrderingIT

testNgParallelOrderingWithEarlyVersion6 7.232
testNgParallelOrderingWithVersion5 0
java.specification.version: 18
testNgParallelOrderingWithVersion6 7.374
testNgParallelOrdering 9.226

Surefire1993JpmsProvidingModulesIT

verify 14.257

Surefire2006ShadefireTransformersIT

shadefireShouldBeUsed 8.389

Surefire2036IT

selectJUnit5UsingConfiguredProviderWithPlatformRunner 9.926

Surefire224WellFormedXmlFailuresIT

testWellFormedXmlFailures 6.998

Surefire257NotRerunningTestsIT

shouldNotRerun 9.75

Surefire260TestWithIdenticalNamesIT

testWithIdenticalNames 16.216

Surefire34SecurityManagerIT

testSecurityManager 0
java.specification.version: 18
shouldFailOnJDK 7.921
testSecurityManagerSuccessful 0
java.specification.version: 18

Surefire376TestNgAfterSuiteFailureIT

testAfterSuiteFailure 7.814

Surefire377TestNgAndJUnitTogetherIT

testTestNgAndJUnit4Together 7.489
testTestNgAndJUnitTogether 7.6

Surefire408ManualProviderSelectionIT

testParallelBuildResultCount 7.238

Surefire42NotExtendingTestCaseIT

testInnerClass 6.893

Surefire44InnerClassTestIT

testInnerClass 8.736

Surefire500PuzzlingErrorIT

testBuildFailingWhenErrors 8.658

Surefire510TestClassPathForkModesIT

testForkOnce 7.273
testForkAlways 7.154

Surefire569RunTestFromDependencyJarsIT

shouldScanAndRunTestsInDependencyJars 7.447

Surefire570MultipleReportDirectoriesIT

testReportWithAggregate 18.049
testReportWithoutAggregate 21.226

Surefire613TestCountInParallelIT

testParallelBuildResultCount 8.688

Surefire621TestCountingJunit3InParallelIT

testJunit3ParallelBuildResultCount 9.256
testJunit3ParallelSuiteBuildResultCount 9.003
testJunit3AllParallelBuildResultCount 9.108
testJunit3BuildResultCount 11.131
testJunit3SuiteBuildResultCount 11.957

Surefire628ConsoleOutputBeforeAndAfterClassIT

testJunit3ParallelBuildResultCount 8.783

Surefire634UnsettableSystemPropertiesWarningIT

testJunit3ParallelBuildResultCount 7.347

Surefire649EmptyStringSystemPropertiesIT

systemPropertyVariables 6.519
systemProperties 6.72

Surefire673MockitoIT

testBuildFailingWhenErrors 8.396

Surefire674BuildFailingWhenErrorsIT

testBuildFailingWhenErrors 8.074

Surefire674BuildFailingWhenFailsafeErrorsIT

testBuildFailingWhenErrors 5.558

Surefire685CommaSeparatedIncludesIT

testBuildFailingWhenErrors 8.646

Surefire697NiceSummaryIT

testBuildFailingWhenErrors 7.119

Surefire705ParallelForkTimeoutIT

testTimeoutForked 11.489

Surefire733AllOverrridesCapturedIT

testLogOutput 7.017

Surefire735ForkFailWithRedirectConsoleOutputIT

vmStartFail 6.827
vmStartFailShouldFailBuildk 7.067

Surefire740TruncatedCommaIT

testRussianLocaleReport 7.684

Surefire747MethodParallelWithSuiteCountIT

testMethodsParallelWithSuite 14.443
testClassesParallelWithSuite 14.958

Surefire772BothReportsIT

testSkippedSurefireReportGeneration 4.689
testSkippedFailsafeReportGeneration 4.485
testReportGeneration 4.723

Surefire772NoFailsafeReportsIT

testSkippedFailsafeReportGeneration 4.505
testForcedFailsafeReportGeneration 4.968
testSkipForcedFailsafeReportGeneration 5.747
testReportGeneration 5.455

Surefire772NoSurefireReportsIT

testOptionalSurefireReportGeneration 5.697
testSkippedSurefireReportGeneration 4.647
testSkipOptionalSurefireReportGeneration 4.546
testReportGeneration 4.562

Surefire772SpecifiedReportsIT

testSkippedSurefireReportGeneration 4.474
testSkippedFailsafeReportGeneration 4.603
testReportGeneration 4.683

Surefire801ForkModeNoneClassLoaderIT

testSHouldBeOkWithForkNever 6.556

Surefire803MultiFailsafeExecsIT

testOneExecutionRunInTwoBuilds 22.519
testSecondExecutionRunsAfterFirstExecutionFails 10.117

Surefire806SpecifiedTestControlsIT

singleTestInSingleExecutionProject 7.151
twoSpecifiedTestExecutionsInCorrectExecutionBlocks 0
since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
singleTestInOneExecutionOfMultiExecutionProject 0
since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution

Surefire809GroupExpressionsIT

testNGRunCategoryAB 7.862
testExcludedGroups 8.769
testJUnitRunCategoryNotC 8.535
incorrectJUnitVersions 5.689
categoryAB 10.48
testNGRunCategoryNotC 8.889

Surefire812Log4JClassLoaderIT

testJunit3ParallelBuildResultCount 7.575

Surefire817SystemExitIT

systemExit1 8.995

Surefire818NpeIgnoresTestsIT

testBuildFailingWhenErrors 7.395

Surefire828EmptyGroupExprIT

testJUnitRunEmptyExcludeGroups 8.807
testJUnitRunEmptyGroups 10.184
testTestNGRunEmptyExcludeGroups 9.462
testTestNGRunEmptyGroups 8.323

Surefire832ProviderSelectionIT

testJUnitRunCategoryAB 8.779

Surefire839TestWithoutCategoriesIT

classWithoutCategoryForked 10.09
classWithoutCategory 8.741

Surefire847AdditionalFailureIT

testJUnitRunCategoryAB 8.347

Surefire855AllowFailsafeUseArtifactFileIT

jarNotForkingShouldUseFile 14.913
jarShouldUseFile 13.391
warShouldUseClasses 14.02
osgiBundleShouldUseFile 14.6

Surefire901MIssingResultfileWhenNoTestsIT

failsafeWithNoTests 7.871

Surefire907PerThreadWithoutThreadCountIT

categoryAB 7.21

Surefire920TestFailureIgnoreWithTimeoutIT

timeoutInForkWithBuildFail 15.97
timeoutInForkWithNoBuildFail 15.574

Surefire926FailureWith2ProvidersIT

testBuildFailingWhenErrors 4.771

Surefire930TestNgSuiteXmlIT

suiteXmlRun 9.614

Surefire943ReportContentIT

test_noParallel 17.003
test_parallelBoth 9.931

Surefire946KillMainProcessInReusableForkIT

test[halt-exit] 31.883
test[halt-kill] 32.078
test[exit-exit] 32.718
test[exit-kill] 31.305
test[interrupt-exit] 32.656
test[interrupt-kill] 31.246

Surefire972BizarreNoClassDefIT

testJunit3ParallelBuildResultCount 9.389

Surefire975DefaultVMEncodingIT

runWithRussian1251 7.218

Surefire979WrongClassLoaderIT

wrongClassloaderUSedInSmartStacktraceparser 7.63

Surefire985ParameterizedRunnerAndCategoriesIT

test 8.249

Surefire995CategoryInheritanceIT

junit411ShouldIgnoreInheritedCategories 10.162
junit411ShouldRunExplicitCategory 10.073
junit412ShouldExecuteInheritedCategories 8.053
junit411ShouldExcludeExplicitCategory 8.439
junit412ShouldExcludeInheritedCategory 8.172
junit412ShouldRunInheritedCategory 8.312
negativeTestShouldRunAllCategories 7.069

JUnit44HamcrestIT

testJUnit44Hamcrest 7.65

JUnit47ConcurrencyIT

test47 9.167

JUnit47ParallelIT

unknownThreadCountClasses 6.795
threadCountSuites 13.907
unlimitedThreadsSuitesAndMethods1 9.917
unlimitedThreadsSuitesAndMethods2 10.639
unknownThreadCountMethods 6.137
threadCountClassesAndMethods 11.897
reusableThreadCountClassesAndMethodsOptimized 17.114
unknownThreadCountSuites 10.949
reusableThreadCountAll 13.909
forcedShutdown 12.494
unknownThreadCountAll 6.423
serial 15.547
reusableThreadCountAllOptimized 9.752
suites 12.103
unlimitedThreadsMethods1 10.898
unlimitedThreadsMethods2 11.245
unlimitedThreadsSuitesAndClasses1 13.497
unlimitedThreadsSuitesAndClasses2 11.567
threadCountAllOptimized 10.293
threadCountAll 9.607
everyThreadCountSuitesAndClasses 9.664
unknownThreadCountBoth 9.23
threadCountSuitesAndClassesOptimized 13.709
classesAndMethods 10.077
everyThreadCountSuitesAndMethods 10.526
unknownThreadCountSuitesAndClasses 6.16
reusableThreadCountSuitesAndClassesOptimized 10.646
unknownThreadCountSuitesAndMethods 8.132
suitesAndClasses 16.836
suitesAndMethods 15.619
shutdown 14.445
threadCountClassesAndMethodsOneCore 16.461
everyThreadCountClassesAndMethods 11.513
all 9.743
unknownThreadCountClassesAndMethods 6.559
threadCountSuitesAndMethodsOptimized 10.404
reusableThreadCountSuitesAndMethodsOptimized 11.635
unlimitedThreadsClasses1 12.283
unlimitedThreadsClasses2 15.18
threadCountClasses 11.066
everyThreadCountAll 10.702
threadCountMethods 11.854
unlimitedThreadsSuites1 18.394
unlimitedThreadsSuites2 13.183
threadCountSuitesAndClasses 9.374
unlimitedThreadsClassesAndMethods1 10.081
unlimitedThreadsClassesAndMethods2 8.974
threadCountSuitesAndMethods 10.897
classes 12.445
reusableThreadCountSuitesAndClasses 10.367
methods 11.464
reusableThreadCountSuitesAndMethods 10.897
timeoutAndForcedShutdown 11.827
threadCountClassesAndMethodsOptimized 11.786
unlimitedThreadsAll1 9.372
unlimitedThreadsAll2 9.152
forcedShutdownVerifyingLogs 9.849
threadCountClassesAndMethodsOneCoreOptimized 14.13
reusableThreadCountClassesAndMethods 12.284

JUnit47ParallelNotThreadSafeIT

test 8.841

JUnit47RedirectOutputIT

testClassesParallel 9.049
testPrintSummaryTrueWithRedirect 9.153

JUnit47RerunFailingTestWithCucumberIT

testRerunFailingErrorTestsFalse[0] 11.653
testRerunFailingErrorTestsWithOneRetry[0] 14.689
testRerunFailingErrorTestsTwoRetry[0] 16.217
testRerunFailingErrorTestsFalse[1] 11.554
testRerunFailingErrorTestsWithOneRetry[1] 11.165
testRerunFailingErrorTestsTwoRetry[1] 12.94

JUnit47StaticInnerClassTestsIT

testStaticInnerClassTests 10.374

JUnit47WithCucumberIT

testWithParallelClasses 10.437
testWithoutParallel 10.099

JUnit48TestCategoriesIT

testCategoriesACFullyQualifiedClassName 9.58
testBadCategoryForkAlways 11.272
testCategoriesABForkAlways 13.78
testCategoriesBadCategory 11.923
testCategoriesACClassNameSuffix 10.023
testCategoriesACFullyQualifiedClassNameForkAlways 12.678
testCategoriesAB 9.852
testCategoriesACClassNameSuffixForkAlways 11.989

JUnit4ForkAlwaysStaticInitPollutionIT

testJunit4Ignore 10.517

JUnit4IgnoreIT

testJunit4Ignore 8.162
testJunit47ParallelIgnore 9.344

JUnit4RerunFailingTestsIT

testRerunFailingErrorTestsFalse 34.806
testRerunFailingErrorTestsWithOneRetry 35.618
testRerunFailingErrorTestsTwoRetry 36.766
testRerunOneTestMethod 33.485
testRerunOneTestClass 36.682

JUnit4RunListenerIT

testJUnit4RunListener 7.658
testRunlistenerJunitCoreProvider 8.816

JUnit4VersionsIT

testJunit[0: JUnit 4.0] 7.218
testJunit[1: JUnit 4.1] 8.765
testJunit[2: JUnit 4.2] 8.828
testJunit[3: JUnit 4.3] 8.033
testJunit[4: JUnit 4.3.1] 8.313
testJunit[5: JUnit 4.4] 10.859
testJunit[6: JUnit 4.5] 10.104
testJunit[7: JUnit 4.6] 8.105
testJunit[8: JUnit 4.7] 9.72
testJunit[9: JUnit 4.8] 11.749
testJunit[10: JUnit 4.8.1] 11.349
testJunit[11: JUnit 4.8.2] 8.392
testJunit[12: JUnit 4.9] 8.148
testJunit[13: JUnit 4.10] 8.112
testJunit[14: JUnit 4.11] 9.036
testJunit[15: JUnit 4.12] 9.523
testJunit[16: JUnit 4.13] 8.457

Junit5ModulePathIT

testModulePathWithSpaces 15.527
testModulePath 11.774

JUnitDepIT

testJUnit44DepWithSneaky381 8.081
testJUnit44Dep 8.758
testJUnit47Dep 9.504
testJUnit48Dep 11.292

JUnitPlatformEnginesIT

testJupiterEngineWithAssertionsFailEmptyStringParameters[1.0.3] 11.386
testToRegex[1.0.3] 0.001
testJupiterEngineWithAssertionsFailNoParameters[1.0.3] 0
got: "5.0.3", expected: is not "5.0.3"
testJupiterEngineWithExceptionMessage[1.0.3] 9.489
testTags[1.0.3] 0
got: "5.0.3", expected: is not "5.0.3"
failingBeforeAllMethod[1.0.3] 9.262
testJupiterEngineWithAssertionsFailMessage[1.0.3] 7.973
errorInBeforeAllMethod[1.0.3] 8.042
testJupiterEngineWithFailureInParameterizedSource[1.0.3] 9.234
testJupiterEngineWithFailureInTestTemplateProvider[1.0.3] 10.442
testJupiterEngineWithErrorInParameterizedSource[1.0.3] 10.371
testJupiterEngine[1.0.3] 10.252
testJupiterEngineWithDisplayNames[1.0.3] 9.104
testJupiterEngineWithErrorInTestTemplateProvider[1.0.3] 11.712
testJupiterEngineWithFailureInTestFactory[1.0.3] 8.784
testJupiterEngineWithErrorInTestFactory[1.0.3] 10.414
platform[1.0.3] 11.126
testJupiterEngineWithAssertionsFailEmptyStringParameters[1.1.1] 12.028
testToRegex[1.1.1] 0
testJupiterEngineWithAssertionsFailNoParameters[1.1.1] 0
got: "5.1.1", expected: is not "5.1.1"
testJupiterEngineWithExceptionMessage[1.1.1] 8.475
testTags[1.1.1] 8.512
failingBeforeAllMethod[1.1.1] 8.58
testJupiterEngineWithAssertionsFailMessage[1.1.1] 8.682
errorInBeforeAllMethod[1.1.1] 10.736
testJupiterEngineWithFailureInParameterizedSource[1.1.1] 10.428
testJupiterEngineWithFailureInTestTemplateProvider[1.1.1] 8.271
testJupiterEngineWithErrorInParameterizedSource[1.1.1] 8.265
testJupiterEngine[1.1.1] 8.635
testJupiterEngineWithDisplayNames[1.1.1] 9.458
testJupiterEngineWithErrorInTestTemplateProvider[1.1.1] 9.919
testJupiterEngineWithFailureInTestFactory[1.1.1] 10.096
testJupiterEngineWithErrorInTestFactory[1.1.1] 9.307
platform[1.1.1] 7.813
testJupiterEngineWithAssertionsFailEmptyStringParameters[1.2.0] 8.398
testToRegex[1.2.0] 0
testJupiterEngineWithAssertionsFailNoParameters[1.2.0] 8.025
testJupiterEngineWithExceptionMessage[1.2.0] 7.843
testTags[1.2.0] 9.808
failingBeforeAllMethod[1.2.0] 9.875
testJupiterEngineWithAssertionsFailMessage[1.2.0] 8.24
errorInBeforeAllMethod[1.2.0] 8.169
testJupiterEngineWithFailureInParameterizedSource[1.2.0] 8.195
testJupiterEngineWithFailureInTestTemplateProvider[1.2.0] 8.346
testJupiterEngineWithErrorInParameterizedSource[1.2.0] 8.617
testJupiterEngine[1.2.0] 10.868
testJupiterEngineWithDisplayNames[1.2.0] 10.607
testJupiterEngineWithErrorInTestTemplateProvider[1.2.0] 8.343
testJupiterEngineWithFailureInTestFactory[1.2.0] 10.093
testJupiterEngineWithErrorInTestFactory[1.2.0] 9.126
platform[1.2.0] 8.328
testJupiterEngineWithAssertionsFailEmptyStringParameters[1.3.2] 9.846
testToRegex[1.3.2] 0
testJupiterEngineWithAssertionsFailNoParameters[1.3.2] 9.586
testJupiterEngineWithExceptionMessage[1.3.2] 7.945
testTags[1.3.2] 7.873
failingBeforeAllMethod[1.3.2] 8.05
testJupiterEngineWithAssertionsFailMessage[1.3.2] 8.561
errorInBeforeAllMethod[1.3.2] 8.538
testJupiterEngineWithFailureInParameterizedSource[1.3.2] 11.128
testJupiterEngineWithFailureInTestTemplateProvider[1.3.2] 9.603
testJupiterEngineWithErrorInParameterizedSource[1.3.2] 8.294
testJupiterEngine[1.3.2] 9.081
testJupiterEngineWithDisplayNames[1.3.2] 9.344
testJupiterEngineWithErrorInTestTemplateProvider[1.3.2] 8.475
testJupiterEngineWithFailureInTestFactory[1.3.2] 9.529
testJupiterEngineWithErrorInTestFactory[1.3.2] 9.903
platform[1.3.2] 8.398
testJupiterEngineWithAssertionsFailEmptyStringParameters[1.4.2] 8.228
testToRegex[1.4.2] 0
testJupiterEngineWithAssertionsFailNoParameters[1.4.2] 8.287
testJupiterEngineWithExceptionMessage[1.4.2] 8.232
testTags[1.4.2] 7.827
failingBeforeAllMethod[1.4.2] 9.643
testJupiterEngineWithAssertionsFailMessage[1.4.2] 10.193
errorInBeforeAllMethod[1.4.2] 8.374
testJupiterEngineWithFailureInParameterizedSource[1.4.2] 8.678
testJupiterEngineWithFailureInTestTemplateProvider[1.4.2] 10.964
testJupiterEngineWithErrorInParameterizedSource[1.4.2] 10.005
testJupiterEngine[1.4.2] 13.91
testJupiterEngineWithDisplayNames[1.4.2] 14.512
testJupiterEngineWithErrorInTestTemplateProvider[1.4.2] 8.882
testJupiterEngineWithFailureInTestFactory[1.4.2] 10.927
testJupiterEngineWithErrorInTestFactory[1.4.2] 10.711
platform[1.4.2] 8.255
testJupiterEngineWithAssertionsFailEmptyStringParameters[1.5.2] 9.663
testToRegex[1.5.2] 0
testJupiterEngineWithAssertionsFailNoParameters[1.5.2] 10.205
testJupiterEngineWithExceptionMessage[1.5.2] 11.098
testTags[1.5.2] 10.62
failingBeforeAllMethod[1.5.2] 8.494
testJupiterEngineWithAssertionsFailMessage[1.5.2] 8.472
errorInBeforeAllMethod[1.5.2] 10.529
testJupiterEngineWithFailureInParameterizedSource[1.5.2] 11.438
testJupiterEngineWithFailureInTestTemplateProvider[1.5.2] 11.059
testJupiterEngineWithErrorInParameterizedSource[1.5.2] 8.779
testJupiterEngine[1.5.2] 9.185
testJupiterEngineWithDisplayNames[1.5.2] 9.638
testJupiterEngineWithErrorInTestTemplateProvider[1.5.2] 9.995
testJupiterEngineWithFailureInTestFactory[1.5.2] 11.747
testJupiterEngineWithErrorInTestFactory[1.5.2] 9.983
platform[1.5.2] 8.235
testJupiterEngineWithAssertionsFailEmptyStringParameters[1.6.2] 8.491
testToRegex[1.6.2] 0
testJupiterEngineWithAssertionsFailNoParameters[1.6.2] 8.284
testJupiterEngineWithExceptionMessage[1.6.2] 8.919
testTags[1.6.2] 10.456
failingBeforeAllMethod[1.6.2] 9.976
testJupiterEngineWithAssertionsFailMessage[1.6.2] 8.146
errorInBeforeAllMethod[1.6.2] 8.281
testJupiterEngineWithFailureInParameterizedSource[1.6.2] 8.468
testJupiterEngineWithFailureInTestTemplateProvider[1.6.2] 8.682
testJupiterEngineWithErrorInParameterizedSource[1.6.2] 9.289
testJupiterEngine[1.6.2] 10.904
testJupiterEngineWithDisplayNames[1.6.2] 10.447
testJupiterEngineWithErrorInTestTemplateProvider[1.6.2] 8.527
testJupiterEngineWithFailureInTestFactory[1.6.2] 9.219
testJupiterEngineWithErrorInTestFactory[1.6.2] 12.268
platform[1.6.2] 11.921

JUnitPlatformIT

testVintageEngine[5.2.0] 11.484
testJQwikEngine[5.2.0] 11.635
testMultipleEngines[5.2.0] 11.239
testVintageEngine[5.3.2] 9.022
testJQwikEngine[5.3.2] 8.24
testMultipleEngines[5.3.2] 11.009
testVintageEngine[5.4.2] 9.742
testJQwikEngine[5.4.2] 8.994
testMultipleEngines[5.4.2] 9.216
testVintageEngine[5.5.2] 7.841
testJQwikEngine[5.5.2] 7.834
testMultipleEngines[5.5.2] 9.652
testVintageEngine[5.6.2] 10.011
testJQwikEngine[5.6.2] 9.516
testMultipleEngines[5.6.2] 9.302
testVintageEngine[5.7.1] 8.161
testJQwikEngine[5.7.1] 8.405
testMultipleEngines[5.7.1] 9.622

JUnitPlatformRerunFailingTestsIT

testRerunFailingErrorTestsFalse 39.328
testRerunFailingErrorTestsWithOneRetry 42.34
testParameterizedTest 8.813
testRerunFailingErrorTestsTwoRetry 43.157
testFailOnTooManyFlakes 11.326
testRerunOneTestMethod 50.528
testRerunOneTestClass 43.426

JUnitPlatformStreamCorruptionIT

warningIsNotEmitted 10.052
warningIsNotEmittedWithJulToLog4j 0
https://issues.apache.org/jira/browse/SUREFIRE-1659?focusedCommentId=17374005&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-17374005
warningIsNotEmittedWithJulToSlf4j 11.275

LongWindowsPathIT

shouldRunInSystemTmp 11.663

ModulePathIT

testModulePathWithSpaces 10.914
testModulePath 10.589

MultiModuleProjectWithJPMSIT

test 15.489

NoRunnableTestsInClassIT

testJunit3ParallelBuildResultCount 9.65

PlainOldJavaClasspathIT

testPlainOldJavaClasspath 8.595

PlexusConflictIT

testPlexusConflict 7.386
testPlexusConflictIsolatedClassLoader 7.42

PojoSimpleIT

twoTestsWithFixtures 8.084

ReportersIT

testRedirectOutputTestNg 7.961

ResultCountingIT

testCountingWithJunit481ForkAlways 11.288
testCountingWithJunit481ForkOnce 9.708
testCountingWithJunit481ForkNever 7.999

RunOrderIT

testRandomJUnit4DifferentSeed 23.146
testNonExistingRunOrderJUnit4 6.229
testNonExistingRunOrderJUnit5 6.261
testRandomJUnit4SameSeed 51.988
testHourlyJUnit4 7.61
testHourlyJUnit5 9.217
testReverseAlphabeticalJUnit4 9.302
testReverseAlphabeticalJUnit5 8.703
testAlphabeticalJUnit4 7.544
testAlphabeticalJUnit5 8.144

RunOrderParallelForksIT

testRandomJUnit4DifferentSeed 23.092
testNonExistingRunOrderJUnit4 7.501
testNonExistingRunOrderJUnit5 7.764
testRandomJUnit4SameSeed 46.545
testHourlyJUnit4 9.393
testHourlyJUnit5 8.884
testReverseAlphabeticalJUnit4 7.642
testReverseAlphabeticalJUnit5 8.169
testAlphabeticalJUnit4 7.449
testAlphabeticalJUnit5 8.173

SiblingAggregatorIT

testSiblingAggregator 8.01

SmartStackTraceIT

misg 9.28

Surefire1602IT

nonCanonicalPath 18.642

SystemPropertiesTestIT

testSystemProperties 13.337
testSystemPropertiesNoFork 10.158

TestMethodPatternIT

testJUnit48WithCategoryFilter[0] 12.366
testJUnit48Provider47[0] 12.291
testMethodPatternAfter[0] 9.099
testTestNGMethodPattern[0] 9.091
testJUnit48Provider4[0] 8.591
testJUnit44[0] 8.51
testTestNgMethodBefore[0] 9.677
testJUnit48WithCategoryFilter[1] 12.829
testJUnit48Provider47[1] 9.326
testMethodPatternAfter[1] 7.947
testTestNGMethodPattern[1] 7.988
testJUnit48Provider4[1] 8.1
testJUnit44[1] 7.393
testTestNgMethodBefore[1] 9.763

TestMultipleMethodPatternsIT

shouldNotRunExcludedClassesAndMethods[0] 8.36
shouldMatchExactClassAndMethodCharacters[0] 7.211
shouldMatchExactClassAndMethodWildcard[0] 6.941
testSuccessTwo[0] 7.16
simpleNameTest[0] 7.197
simpleNameTestWithJavaExt[0] 7.208
regexClass[0] 7.593
shouldNotRunExcludedClasses[0] 8.557
shouldNotRunExcludedMethods[0] 8.613
simpleNameTestWithJavaExtWildcardPkg[0] 7.306
shouldMatchMultiplePatterns[0] 7.007
shouldMatchExactClassAndMethodsPostfix[0] 6.97
simpleNameTestWithWildcardPkg[0] 7.042
shouldMatchWildcardPackageAndClassAndMethod[0] 6.882
shouldMatchExactClassAndMultipleMethods[0] 7.495
fullyQualifiedTest[0] 8.703
matchSimpleClassAndMethodWithJavaExtWildcardPkg[0] 8.245
negativeTest[0] 0
got: <TEST>, expected: (is <INCLUDES> or is <INCLUDES_EXCLUDES> or is <INCLUDES_FILE> or is <INCLUDES_EXCLUDES_FILE>)
testRegexSuccessTwo[0] 7.371
shouldMatchExactClassAndMethodsWildcard[0] 7.003
shouldMatchMultiplePatternsComplex[0] 7.08
simpleNameTestAsParallel[0] 0
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
matchSimpleClassAndMethodWithWildcardPkg[0] 7.255
shouldMatchMultiplePatternsAsParallel[0] 0
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
shouldNotRunExcludedClassesIfIncluded[0] 7.448
shouldMatchSimpleClassNameAndMethod[0] 7.827
shouldMatchExactClassAndMethodPostfix[0] 8.341
shouldMatchMultiplePatternsComplexAsParallel[0] 0
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
matchSimpleClassAndMethodWithJavaExt[0] 7.995
regexClassAndMethod[0] 6.935
shouldNotRunExcludedClassesAndMethods[1] 8.26
shouldMatchExactClassAndMethodCharacters[1] 8.243
shouldMatchExactClassAndMethodWildcard[1] 8.169
testSuccessTwo[1] 9.181
simpleNameTest[1] 10.183
simpleNameTestWithJavaExt[1] 9.235
regexClass[1] 8.165
shouldNotRunExcludedClasses[1] 8.193
shouldNotRunExcludedMethods[1] 8.244
simpleNameTestWithJavaExtWildcardPkg[1] 7.975
shouldMatchMultiplePatterns[1] 9.227
shouldMatchExactClassAndMethodsPostfix[1] 10.365
simpleNameTestWithWildcardPkg[1] 9.162
shouldMatchWildcardPackageAndClassAndMethod[1] 7.989
shouldMatchExactClassAndMultipleMethods[1] 8.181
fullyQualifiedTest[1] 8.398
matchSimpleClassAndMethodWithJavaExtWildcardPkg[1] 7.926
negativeTest[1] 0
got: <TEST>, expected: (is <INCLUDES> or is <INCLUDES_EXCLUDES> or is <INCLUDES_FILE> or is <INCLUDES_EXCLUDES_FILE>)
testRegexSuccessTwo[1] 9.222
shouldMatchExactClassAndMethodsWildcard[1] 10.105
shouldMatchMultiplePatternsComplex[1] 9.849
simpleNameTestAsParallel[1] 9.438
matchSimpleClassAndMethodWithWildcardPkg[1] 8.32
shouldMatchMultiplePatternsAsParallel[1] 8.444
shouldNotRunExcludedClassesIfIncluded[1] 8.124
shouldMatchSimpleClassNameAndMethod[1] 10.042
shouldMatchExactClassAndMethodPostfix[1] 10.151
shouldMatchMultiplePatternsComplexAsParallel[1] 8.367
matchSimpleClassAndMethodWithJavaExt[1] 8.57
regexClassAndMethod[1] 8.501
shouldNotRunExcludedClassesAndMethods[2] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodCharacters[2] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodWildcard[2] 0
got: <INCLUDES>, expected: is <TEST>
testSuccessTwo[2] 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTest[2] 7.019
simpleNameTestWithJavaExt[2] 7.639
regexClass[2] 10.391
shouldNotRunExcludedClasses[2] 10.728
shouldNotRunExcludedMethods[2] 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTestWithJavaExtWildcardPkg[2] 9.627
shouldMatchMultiplePatterns[2] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsPostfix[2] 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTestWithWildcardPkg[2] 7.164
shouldMatchWildcardPackageAndClassAndMethod[2] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMultipleMethods[2] 0
got: <INCLUDES>, expected: is <TEST>
fullyQualifiedTest[2] 6.938
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2] 0
got: <INCLUDES>, expected: is <TEST>
negativeTest[2] 6.298
testRegexSuccessTwo[2] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsWildcard[2] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplex[2] 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTestAsParallel[2] 0
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
matchSimpleClassAndMethodWithWildcardPkg[2] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsAsParallel[2] 0
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
shouldNotRunExcludedClassesIfIncluded[2] 6.945
shouldMatchSimpleClassNameAndMethod[2] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodPostfix[2] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplexAsParallel[2] 0
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
matchSimpleClassAndMethodWithJavaExt[2] 0
got: <INCLUDES>, expected: is <TEST>
regexClassAndMethod[2] 0
got: <INCLUDES>, expected: is <TEST>
shouldNotRunExcludedClassesAndMethods[3] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodCharacters[3] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodWildcard[3] 0
got: <INCLUDES>, expected: is <TEST>
testSuccessTwo[3] 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTest[3] 8.776
simpleNameTestWithJavaExt[3] 10.318
regexClass[3] 9.012
shouldNotRunExcludedClasses[3] 7.95
shouldNotRunExcludedMethods[3] 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTestWithJavaExtWildcardPkg[3] 8.126
shouldMatchMultiplePatterns[3] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsPostfix[3] 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTestWithWildcardPkg[3] 8.205
shouldMatchWildcardPackageAndClassAndMethod[3] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMultipleMethods[3] 0
got: <INCLUDES>, expected: is <TEST>
fullyQualifiedTest[3] 8.082
matchSimpleClassAndMethodWithJavaExtWildcardPkg[3] 0
got: <INCLUDES>, expected: is <TEST>
negativeTest[3] 6.191
testRegexSuccessTwo[3] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsWildcard[3] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplex[3] 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTestAsParallel[3] 10.059
matchSimpleClassAndMethodWithWildcardPkg[3] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsAsParallel[3] 0
got: <INCLUDES>, expected: is <TEST>
shouldNotRunExcludedClassesIfIncluded[3] 10.52
shouldMatchSimpleClassNameAndMethod[3] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodPostfix[3] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplexAsParallel[3] 0
got: <INCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithJavaExt[3] 0
got: <INCLUDES>, expected: is <TEST>
regexClassAndMethod[3] 0
got: <INCLUDES>, expected: is <TEST>
shouldNotRunExcludedClassesAndMethods[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodCharacters[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodWildcard[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
testSuccessTwo[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTest[4] 6.866
simpleNameTestWithJavaExt[4] 6.819
regexClass[4] 6.553
shouldNotRunExcludedClasses[4] 6.826
shouldNotRunExcludedMethods[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTestWithJavaExtWildcardPkg[4] 6.74
shouldMatchMultiplePatterns[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsPostfix[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTestWithWildcardPkg[4] 7.709
shouldMatchWildcardPackageAndClassAndMethod[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMultipleMethods[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
fullyQualifiedTest[4] 8.531
matchSimpleClassAndMethodWithJavaExtWildcardPkg[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
negativeTest[4] 7.194
testRegexSuccessTwo[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsWildcard[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplex[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTestAsParallel[4] 0
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
matchSimpleClassAndMethodWithWildcardPkg[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsAsParallel[4] 0
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
shouldNotRunExcludedClassesIfIncluded[4] 7.136
shouldMatchSimpleClassNameAndMethod[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodPostfix[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplexAsParallel[4] 0
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
matchSimpleClassAndMethodWithJavaExt[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
regexClassAndMethod[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldNotRunExcludedClassesAndMethods[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodCharacters[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodWildcard[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
testSuccessTwo[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTest[5] 8.017
simpleNameTestWithJavaExt[5] 8.12
regexClass[5] 8.229
shouldNotRunExcludedClasses[5] 8.899
shouldNotRunExcludedMethods[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTestWithJavaExtWildcardPkg[5] 10.558
shouldMatchMultiplePatterns[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsPostfix[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTestWithWildcardPkg[5] 11.734
shouldMatchWildcardPackageAndClassAndMethod[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMultipleMethods[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
fullyQualifiedTest[5] 8.887
matchSimpleClassAndMethodWithJavaExtWildcardPkg[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
negativeTest[5] 6.207
testRegexSuccessTwo[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsWildcard[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplex[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTestAsParallel[5] 8.194
matchSimpleClassAndMethodWithWildcardPkg[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsAsParallel[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldNotRunExcludedClassesIfIncluded[5] 8.511
shouldMatchSimpleClassNameAndMethod[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodPostfix[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplexAsParallel[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithJavaExt[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
regexClassAndMethod[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>

TestMultipleMethodPatternsTestNGIT

shouldNotRunExcludedClassesAndMethods[0] 7.699
shouldMatchExactClassAndMethodCharacters[0] 9.203
shouldMatchExactClassAndMethodWildcard[0] 8.896
testSuccessTwo[0] 8.092
simpleNameTest[0] 7.029
simpleNameTestWithJavaExt[0] 7.256
regexClass[0] 7.626
shouldNotRunExcludedClasses[0] 7.978
shouldNotRunExcludedMethods[0] 7.88
simpleNameTestWithJavaExtWildcardPkg[0] 8.76
shouldMatchMultiplePatterns[0] 7.748
shouldMatchExactClassAndMethodsPostfix[0] 7.233
simpleNameTestWithWildcardPkg[0] 6.948
shouldMatchWildcardPackageAndClassAndMethod[0] 7.177
shouldMatchExactClassAndMultipleMethods[0] 7.235
fullyQualifiedTest[0] 7.022
matchSimpleClassAndMethodWithJavaExtWildcardPkg[0] 8.009
negativeTest[0] 0
got: <TEST>, expected: (is <INCLUDES> or is <INCLUDES_EXCLUDES> or is <INCLUDES_FILE> or is <INCLUDES_EXCLUDES_FILE>)
testRegexSuccessTwo[0] 8.995
shouldMatchExactClassAndMethodsWildcard[0] 7.769
shouldMatchMultiplePatternsComplex[0] 7.049
simpleNameTestAsParallel[0] 6.916
matchSimpleClassAndMethodWithWildcardPkg[0] 7.002
shouldMatchMultiplePatternsAsParallel[0] 9.84
shouldNotRunExcludedClassesIfIncluded[0] 10.157
shouldMatchSimpleClassNameAndMethod[0] 10.752
shouldMatchExactClassAndMethodPostfix[0] 9.133
shouldMatchMultiplePatternsComplexAsParallel[0] 7.615
matchSimpleClassAndMethodWithJavaExt[0] 7.056
regexClassAndMethod[0] 7.051
shouldNotRunExcludedClassesAndMethods[1] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodCharacters[1] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodWildcard[1] 0
got: <INCLUDES>, expected: is <TEST>
testSuccessTwo[1] 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTest[1] 7.125
simpleNameTestWithJavaExt[1] 7.014
regexClass[1] 8.148
shouldNotRunExcludedClasses[1] 8.573
shouldNotRunExcludedMethods[1] 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTestWithJavaExtWildcardPkg[1] 7.795
shouldMatchMultiplePatterns[1] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsPostfix[1] 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTestWithWildcardPkg[1] 7.118
shouldMatchWildcardPackageAndClassAndMethod[1] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMultipleMethods[1] 0
got: <INCLUDES>, expected: is <TEST>
fullyQualifiedTest[1] 7.028
matchSimpleClassAndMethodWithJavaExtWildcardPkg[1] 0
got: <INCLUDES>, expected: is <TEST>
negativeTest[1] 5.978
testRegexSuccessTwo[1] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsWildcard[1] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplex[1] 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTestAsParallel[1] 7.068
matchSimpleClassAndMethodWithWildcardPkg[1] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsAsParallel[1] 0
got: <INCLUDES>, expected: is <TEST>
shouldNotRunExcludedClassesIfIncluded[1] 7.29
shouldMatchSimpleClassNameAndMethod[1] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodPostfix[1] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplexAsParallel[1] 0
got: <INCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithJavaExt[1] 0
got: <INCLUDES>, expected: is <TEST>
regexClassAndMethod[1] 0
got: <INCLUDES>, expected: is <TEST>
shouldNotRunExcludedClassesAndMethods[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodCharacters[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodWildcard[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
testSuccessTwo[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTest[2] 8.182
simpleNameTestWithJavaExt[2] 8.965
regexClass[2] 8.829
shouldNotRunExcludedClasses[2] 7.066
shouldNotRunExcludedMethods[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTestWithJavaExtWildcardPkg[2] 7.126
shouldMatchMultiplePatterns[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsPostfix[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTestWithWildcardPkg[2] 7.005
shouldMatchWildcardPackageAndClassAndMethod[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMultipleMethods[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
fullyQualifiedTest[2] 6.888
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
negativeTest[2] 5.957
testRegexSuccessTwo[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsWildcard[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplex[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTestAsParallel[2] 7.911
matchSimpleClassAndMethodWithWildcardPkg[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsAsParallel[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldNotRunExcludedClassesIfIncluded[2] 8.525
shouldMatchSimpleClassNameAndMethod[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodPostfix[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplexAsParallel[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithJavaExt[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
regexClassAndMethod[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>

TestMultipleMethodsIT

testJunit48Provider4 8.842
testJunit44 6.875
testJunit48Provider47 9.02

TestNgGroupsIT

testExclusion 8.055
testGroupsAndExclusion 8.15
groupsWithDash 8.663
testOnlyGroups 10.07
groupsBySimpleRegex 9.056

TestNgParallelWithAnnotationsIT

testTestNgGroupThreadParallel 14.438

TestNgSuccessPercentageIT

testPassesWhenFailuresLessThanSuccessPercentage 6.998

TestSingleMethodIT

fullyQualifiedTestNg 7.707
testJunit48Provider4 7.579
testJunit44 8.931
testJunit48parallel 10.303
testJunit48Provider47 8.641
fullyQualifiedJunit48Provider47 9.309
fullyQualifiedJunit48Provider4 7.622
testTestNg5149 8.297
testTestNg 8.129

TimeoutForkedTestIT

testTimeoutForked 18.391

TwoTestCasesIT

testJunit4Suite 7.161
testTestNGSuite 7.667
testTwoTestCases 7.314
testTwoTestCaseSuite 7.185

UmlautDirIT

surefire1617WithColonInLocalRepo 0
got: <false>, expected: is <true>
surefire1617WithColonInProjectDir 0
got: <false>, expected: is <true>
testUmlautIsolatedClassLoader 8.344
testUmlaut 9.504

UnicodeTestNamesIT

checkFileNamesWithUnicode 13.778

UseIsolatedClassLoaderIT

testUseSystemClassLoader 7.053

WorkingDirectoryIsInvalidPropertyIT

testWorkingDirectory 6.687

WorkingDirectoryIT

testWorkingDirectory 7.174
testWorkingDirectoryChildOnlyNoFork 6.371
testWorkingDirectoryNoFork 6.397
testWorkingDirectoryChildOnly 7.29

WorkingDirectoryMissingIT

testWorkingDirectory 8.697

XmlReporterRunTimeIT

testForkModeAlways 31.753

Failure Details

[Summary] [Package List] [Test Cases]


testNgListenerReporter[3: TestNG 5.13]
skipped: java.specification.version: 18
xXXtest501
skipped: 5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
xXXtest50
skipped: 5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
test
skipped: java.specification.version: 18
testNgParallelOrderingWithVersion5
skipped: java.specification.version: 18
testSecurityManager
skipped: java.specification.version: 18
testSecurityManagerSuccessful
skipped: java.specification.version: 18
twoSpecifiedTestExecutionsInCorrectExecutionBlocks
skipped: since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
singleTestInOneExecutionOfMultiExecutionProject
skipped: since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
testJupiterEngineWithAssertionsFailNoParameters[1.0.3]
skipped: got: "5.0.3", expected: is not "5.0.3"
testTags[1.0.3]
skipped: got: "5.0.3", expected: is not "5.0.3"
testJupiterEngineWithAssertionsFailNoParameters[1.1.1]
skipped: got: "5.1.1", expected: is not "5.1.1"
warningIsNotEmittedWithJulToLog4j
skipped: https://issues.apache.org/jira/browse/SUREFIRE-1659?focusedCommentId=17374005&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-17374005
negativeTest[0]
skipped: got: <TEST>, expected: (is <INCLUDES> or is <INCLUDES_EXCLUDES> or is <INCLUDES_FILE> or is <INCLUDES_EXCLUDES_FILE>)
simpleNameTestAsParallel[0]
skipped: got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
shouldMatchMultiplePatternsAsParallel[0]
skipped: got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
shouldMatchMultiplePatternsComplexAsParallel[0]
skipped: got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
negativeTest[1]
skipped: got: <TEST>, expected: (is <INCLUDES> or is <INCLUDES_EXCLUDES> or is <INCLUDES_FILE> or is <INCLUDES_EXCLUDES_FILE>)
shouldNotRunExcludedClassesAndMethods[2]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodCharacters[2]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodWildcard[2]
skipped: got: <INCLUDES>, expected: is <TEST>
testSuccessTwo[2]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldNotRunExcludedMethods[2]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatterns[2]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsPostfix[2]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchWildcardPackageAndClassAndMethod[2]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMultipleMethods[2]
skipped: got: <INCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2]
skipped: got: <INCLUDES>, expected: is <TEST>
testRegexSuccessTwo[2]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsWildcard[2]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplex[2]
skipped: got: <INCLUDES>, expected: is <TEST>
simpleNameTestAsParallel[2]
skipped: got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
matchSimpleClassAndMethodWithWildcardPkg[2]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsAsParallel[2]
skipped: got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
shouldMatchSimpleClassNameAndMethod[2]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodPostfix[2]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplexAsParallel[2]
skipped: got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
matchSimpleClassAndMethodWithJavaExt[2]
skipped: got: <INCLUDES>, expected: is <TEST>
regexClassAndMethod[2]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldNotRunExcludedClassesAndMethods[3]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodCharacters[3]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodWildcard[3]
skipped: got: <INCLUDES>, expected: is <TEST>
testSuccessTwo[3]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldNotRunExcludedMethods[3]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatterns[3]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsPostfix[3]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchWildcardPackageAndClassAndMethod[3]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMultipleMethods[3]
skipped: got: <INCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithJavaExtWildcardPkg[3]
skipped: got: <INCLUDES>, expected: is <TEST>
testRegexSuccessTwo[3]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsWildcard[3]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplex[3]
skipped: got: <INCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithWildcardPkg[3]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsAsParallel[3]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchSimpleClassNameAndMethod[3]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodPostfix[3]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplexAsParallel[3]
skipped: got: <INCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithJavaExt[3]
skipped: got: <INCLUDES>, expected: is <TEST>
regexClassAndMethod[3]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldNotRunExcludedClassesAndMethods[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodCharacters[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodWildcard[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
testSuccessTwo[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldNotRunExcludedMethods[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatterns[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsPostfix[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchWildcardPackageAndClassAndMethod[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMultipleMethods[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithJavaExtWildcardPkg[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
testRegexSuccessTwo[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsWildcard[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplex[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTestAsParallel[4]
skipped: got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
matchSimpleClassAndMethodWithWildcardPkg[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsAsParallel[4]
skipped: got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
shouldMatchSimpleClassNameAndMethod[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodPostfix[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplexAsParallel[4]
skipped: got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
matchSimpleClassAndMethodWithJavaExt[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
regexClassAndMethod[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldNotRunExcludedClassesAndMethods[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodCharacters[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodWildcard[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
testSuccessTwo[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldNotRunExcludedMethods[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatterns[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsPostfix[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchWildcardPackageAndClassAndMethod[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMultipleMethods[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithJavaExtWildcardPkg[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
testRegexSuccessTwo[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsWildcard[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplex[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithWildcardPkg[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsAsParallel[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchSimpleClassNameAndMethod[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodPostfix[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplexAsParallel[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithJavaExt[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
regexClassAndMethod[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
negativeTest[0]
skipped: got: <TEST>, expected: (is <INCLUDES> or is <INCLUDES_EXCLUDES> or is <INCLUDES_FILE> or is <INCLUDES_EXCLUDES_FILE>)
shouldNotRunExcludedClassesAndMethods[1]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodCharacters[1]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodWildcard[1]
skipped: got: <INCLUDES>, expected: is <TEST>
testSuccessTwo[1]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldNotRunExcludedMethods[1]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatterns[1]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsPostfix[1]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchWildcardPackageAndClassAndMethod[1]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMultipleMethods[1]
skipped: got: <INCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithJavaExtWildcardPkg[1]
skipped: got: <INCLUDES>, expected: is <TEST>
testRegexSuccessTwo[1]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsWildcard[1]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplex[1]
skipped: got: <INCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithWildcardPkg[1]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsAsParallel[1]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchSimpleClassNameAndMethod[1]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodPostfix[1]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplexAsParallel[1]
skipped: got: <INCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithJavaExt[1]
skipped: got: <INCLUDES>, expected: is <TEST>
regexClassAndMethod[1]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldNotRunExcludedClassesAndMethods[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodCharacters[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodWildcard[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
testSuccessTwo[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldNotRunExcludedMethods[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatterns[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsPostfix[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchWildcardPackageAndClassAndMethod[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMultipleMethods[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
testRegexSuccessTwo[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsWildcard[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplex[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithWildcardPkg[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsAsParallel[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchSimpleClassNameAndMethod[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodPostfix[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplexAsParallel[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithJavaExt[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
regexClassAndMethod[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
surefire1617WithColonInLocalRepo
skipped: got: <false>, expected: is <true>
surefire1617WithColonInProjectDir
skipped: got: <false>, expected: is <true>