Fork me on GitHub
Built by Maven

Failsafe Report

Summary

[Summary] [Package List] [Test Cases]


Tests Errors Failures Skipped Success Rate Time
1023 0 0 153 85.044% 4,732.923

Note: failures are anticipated and checked for with assertions while errors are unanticipated.


Package List

[Summary] [Package List] [Test Cases]


Package Tests Errors Failures Skipped Success Rate Time
org.apache.maven.surefire.its 793 0 0 141 82.219% 3,596.744
org.apache.maven.surefire.its.jiras 230 0 0 12 94.783% 1,136.18

Note: package statistics are not computed recursively, they only sum up all of its testsuites numbers.

org.apache.maven.surefire.its

Class Tests Errors Failures Skipped Success Rate Time
 AbstractTestCaseIT 1 0 0 0 100% 3.389
 AdditionalClasspathIT 1 0 0 0 100% 3.227
 AggregateReportIT 1 0 0 0 100% 4.26
 ArgLineIT 1 0 0 0 100% 3.255
 ArgLinePropertiesIT 1 0 0 0 100% 3.506
 AssumptionFailureReportIT 1 0 0 0 100% 3.214
 CheckSingleTestIT 4 0 0 0 100% 11.58
 CheckTestFailIfNoTestsForkCountIT 6 0 0 0 100% 18.153
 CheckTestFailIfNoTestsIT 3 0 0 0 100% 6.36
 CheckTestNg740ParallelIT 2 0 0 0 100% 7.822
 CheckTestNgBeforeMethodFailureIT 1 0 0 0 100% 4.039
 CheckTestNgBeforeMethodIT 1 0 0 0 100% 3.364
 CheckTestNgCustomObjectFactoryIT 1 0 0 0 100% 3.573
 CheckTestNgCustomTestRunnerFactoryIT 1 0 0 0 100% 3.506
 CheckTestNgExecuteErrorIT 1 0 0 0 100% 3.426
 CheckTestNgGroupThreadParallelIT 1 0 0 0 100% 2.982
 CheckTestNgJdk14IT 1 0 0 0 100% 4.061
 CheckTestNgListenerReporterIT 9 0 0 0 100% 36.601
 CheckTestNgListenersIT 1 0 0 0 100% 3.67
 CheckTestNgPathWithSpacesIT 1 0 0 0 100% 3.397
 CheckTestNgReportTestIT 3 0 0 0 100% 11.95
 CheckTestNgSuiteXmlIT 3 0 0 0 100% 10.751
 CheckTestNgSuiteXmlSingleIT 1 0 0 0 100% 3.411
 CheckTestNgVersionsIT 20 0 0 2 90% 76.846
 ClasspathFilteringIT 1 0 0 0 100% 3.939
 ClassPathOrderIT 1 0 0 0 100% 3.588
 ClasspathScopeFilteringIT 1 0 0 0 100% 3.91
 ConsoleOutputIT 8 0 0 0 100% 37.617
 CrashDetectionIT 3 0 0 0 100% 11.941
 DefaultConfigurationIT 1 0 0 0 100% 3.264
 EnvironmentVariableIT 1 0 0 0 100% 3.267
 EnvironmentVariablesIT 3 0 0 0 100% 9.958
 FailFastJUnitIT 14 0 0 0 100% 327.618
 FailFastTestNgIT 8 0 0 0 100% 195.638
 ForkConsoleOutputIT 4 0 0 0 100% 17.586
 ForkConsoleOutputWithErrorsIT 1 0 0 0 100% 9.524
 ForkCountIT 8 0 0 0 100% 89.648
 ForkCountMultiModuleIT 4 0 0 0 100% 31.147
 ForkCountTestNGIT 8 0 0 0 100% 61.003
 IncludesExcludesFromFileIT 6 0 0 0 100% 20.953
 IncludesExcludesIT 3 0 0 0 100% 9.827
 Java9FullApiIT 3 0 0 3 0% 0.001
 JUnit44HamcrestIT 1 0 0 0 100% 3.448
 JUnit47ConcurrencyIT 1 0 0 0 100% 5.102
 JUnit47ParallelIT 59 0 0 0 100% 366.352
 JUnit47ParallelNotThreadSafeIT 1 0 0 0 100% 3.855
 JUnit47RedirectOutputIT 2 0 0 0 100% 7.616
 JUnit47RerunFailingTestWithCucumberIT 6 0 0 0 100% 32.764
 JUnit47StaticInnerClassTestsIT 1 0 0 0 100% 3.239
 JUnit47WithCucumberIT 2 0 0 0 100% 7.533
 JUnit48TestCategoriesIT 8 0 0 0 100% 33.228
 JUnit4ForkAlwaysStaticInitPollutionIT 1 0 0 0 100% 4.176
 JUnit4IgnoreIT 2 0 0 0 100% 7.037
 JUnit4RerunFailingTestsIT 5 0 0 0 100% 72.309
 JUnit4RunListenerIT 2 0 0 0 100% 7.152
 JUnit4VersionsIT 19 0 0 0 100% 66.383
 Junit5ModulePathIT 2 0 0 2 0% 0.001
 JUnitDepIT 4 0 0 0 100% 16.219
 JUnitPlatformEnginesIT 136 0 0 0 100% 547.102
 JUnitPlatformIT 24 0 0 0 100% 123.847
 JUnitPlatformRerunFailingTestsIT 7 0 0 0 100% 93.063
 JUnitPlatformStreamCorruptionIT 3 0 0 1 66.667% 7.368
 LongWindowsPathIT 1 0 0 0 100% 3.625
 ModulePathIT 2 0 0 2 0% 0
 MultiModuleProjectWithJPMSIT 1 0 0 1 0% 0
 NoRunnableTestsInClassIT 1 0 0 0 100% 4.037
 PlainOldJavaClasspathIT 1 0 0 0 100% 5.129
 PlexusConflictIT 2 0 0 0 100% 13.219
 PojoSimpleIT 1 0 0 0 100% 4.149
 ReportersIT 1 0 0 0 100% 4.223
 ResultCountingIT 3 0 0 0 100% 15.935
 RunOrderIT 12 0 0 0 100% 78.608
 RunOrderParallelForksIT 12 0 0 0 100% 81.945
 SiblingAggregatorIT 1 0 0 0 100% 3.172
 SmartStackTraceIT 1 0 0 0 100% 3.2
 Surefire1602IT 1 0 0 0 100% 7.64
 SystemPropertiesTestIT 2 0 0 0 100% 7.048
 TestMethodPatternIT 14 0 0 0 100% 77.82
 TestMultipleMethodPatternsIT 180 0 0 87 51.667% 365.058
 TestMultipleMethodPatternsTestNGIT 90 0 0 41 54.444% 229.998
 TestMultipleMethodsIT 3 0 0 0 100% 13.803
 TestNgGroupsIT 5 0 0 0 100% 25.268
 TestNgParallelWithAnnotationsIT 1 0 0 0 100% 11.193
 TestNgSuccessPercentageIT 1 0 0 0 100% 4.552
 TestSingleMethodIT 9 0 0 0 100% 43.111
 TimeoutForkedTestIT 1 0 0 0 100% 13.874
 TwoTestCasesIT 4 0 0 0 100% 26.697
 UmlautDirIT 4 0 0 2 50% 12.049
 UnicodeTestNamesIT 1 0 0 0 100% 5.234
 UseIsolatedClassLoaderIT 1 0 0 0 100% 3.657
 WorkingDirectoryIsInvalidPropertyIT 1 0 0 0 100% 3.758
 WorkingDirectoryIT 4 0 0 0 100% 15.69
 WorkingDirectoryMissingIT 1 0 0 0 100% 5.279
 XmlReporterRunTimeIT 1 0 0 0 100% 23.207

org.apache.maven.surefire.its.jiras

Class Tests Errors Failures Skipped Success Rate Time
 SpockIT 1 0 0 0 100% 11.644
 Surefire1004RunTestFromDependencyJarsTypeAndClassifierIT 1 0 0 0 100% 5.089
 Surefire1024VerifyFailsafeIfTestedIT 1 0 0 0 100% 4.407
 Surefire1028UnableToRunSingleIT 1 0 0 0 100% 4.051
 Surefire1036NonFilterableJUnitRunnerWithCategoriesIT 1 0 0 0 100% 4.775
 Surefire1041FailingJUnitRunnerIT 1 0 0 0 100% 3.725
 Surefire1053SystemPropertiesIT 2 0 0 0 100% 6.721
 Surefire1055CorrectConcurrentTestCountIT 1 0 0 0 100% 3.852
 Surefire1080ParallelForkDoubleTestIT 1 0 0 0 100% 3.852
 Surefire1082ParallelJUnitParameterizedIT 3 0 0 0 100% 15.497
 Surefire1095NpeInRunListenerIT 3 0 0 0 100% 9.785
 Surefire1098BalancedRunOrderIT 1 0 0 0 100% 8.046
 Surefire1122ParallelAndFlakyTestsIT 3 0 0 0 100% 13.915
 Surefire1135ImproveIgnoreMessageForTestNGIT 2 0 0 0 100% 9.142
 Surefire1136CwdPropagationInForkedModeIT 1 0 0 0 100% 3.324
 Surefire1144XmlRunTimeIT 1 0 0 0 100% 5.24
 Surefire1146RerunFailedAndParameterizedIT 1 0 0 0 100% 3.663
 Surefire1152RerunFailingTestsInSuiteIT 2 0 0 0 100% 10.012
 Surefire1153IncludesAndSpecifiedTestIT 2 0 0 0 100% 6.687
 Surefire1158RemoveInfoLinesIT 6 0 0 0 100% 22.627
 Surefire1177TestngParallelSuitesIT 2 0 0 0 100% 11.665
 Surefire1179IT 1 0 0 0 100% 10.284
 Surefire1185DoNotSpawnTestsIT 1 0 0 0 100% 3.48
 Surefire1202RerunAndSkipIT 2 0 0 0 100% 33.025
 Surefire1209RerunAndForkCountIT 4 0 0 0 100% 44.474
 Surefire1211JUnitTestNgIT 2 0 0 0 100% 7.917
 Surefire1264IT 2 0 0 0 100% 10.001
 Surefire1265Java9IT 1 0 0 1 0% 0
 Surefire1278GroupNameEndingIT 1 0 0 0 100% 3.585
 Surefire1295AttributeJvmCrashesToTestsIT 9 0 0 0 100% 66.682
 Surefire1364SystemPropertiesIT 10 0 0 0 100% 36.847
 Surefire1367AssumptionLogsIT 4 0 0 0 100% 13.457
 Surefire1383ScanSessionDependenciesIT 1 0 0 0 100% 6.981
 Surefire1396CustomProviderClassPathIT 1 0 0 0 100% 6.816
 Surefire141PluggableProvidersIT 4 0 0 0 100% 14.516
 Surefire1426JvmCrashShouldNotBeIgnoredIT 1 0 0 0 100% 2.982
 Surefire146ForkPerTestNoSetupIT 1 0 0 0 100% 3.201
 Surefire1490ReportTitleDescriptionIT 2 0 0 0 100% 14.562
 Surefire1534ReuseForksFalseWithJavaModuleIT 3 0 0 3 0% 0
 Surefire1535TestNGParallelSuitesIT 4 0 0 0 100% 20.976
 Surefire1570ModularFailsafeIT 1 0 0 1 0% 0
 Surefire1585IT 2 0 0 0 100% 7.166
 Surefire162CharsetProviderIT 1 0 0 0 100% 3.349
 Surefire1712ExtractedModulenameWithoutASMIT 1 0 0 1 0% 0.001
 Surefire1733JUnitIT 1 0 0 1 0% 0
 Surefire1733TestngIT 1 0 0 1 0% 0.001
 Surefire1744AlwaysIncludeOutputLogsIT 1 0 0 0 100% 3.401
 Surefire1787JUnit5IT 10 0 0 0 100% 39.307
 Surefire1881IT 1 0 0 0 100% 6.44
 Surefire1914XmlReportingParameterizedTestIT 3 0 0 0 100% 14.049
 Surefire1964IT 2 0 0 0 100% 6.209
 Surefire1967CheckTestNgMethodParallelOrderingIT 4 0 0 0 100% 20.176
 Surefire1993JpmsProvidingModulesIT 1 0 0 1 0% 0
 Surefire2006ShadefireTransformersIT 1 0 0 0 100% 3.05
 Surefire2036IT 1 0 0 0 100% 3.666
 Surefire2117XmlReportingNestedIT 3 0 0 0 100% 12.531
 Surefire224WellFormedXmlFailuresIT 1 0 0 0 100% 3.187
 Surefire257NotRerunningTestsIT 1 0 0 0 100% 4.316
 Surefire260TestWithIdenticalNamesIT 1 0 0 0 100% 6.5
 Surefire34SecurityManagerIT 3 0 0 1 66.667% 6.481
 Surefire376TestNgAfterSuiteFailureIT 1 0 0 0 100% 3.385
 Surefire377TestNgAndJUnitTogetherIT 2 0 0 0 100% 7.052
 Surefire408ManualProviderSelectionIT 1 0 0 0 100% 3.263
 Surefire42NotExtendingTestCaseIT 1 0 0 0 100% 3.238
 Surefire44InnerClassTestIT 1 0 0 0 100% 3.147
 Surefire500PuzzlingErrorIT 1 0 0 0 100% 3.248
 Surefire510TestClassPathForkModesIT 2 0 0 0 100% 6.433
 Surefire569RunTestFromDependencyJarsIT 1 0 0 0 100% 3.747
 Surefire570MultipleReportDirectoriesIT 2 0 0 0 100% 15.935
 Surefire613TestCountInParallelIT 1 0 0 0 100% 3.791
 Surefire621TestCountingJunit3InParallelIT 5 0 0 0 100% 19.919
 Surefire628ConsoleOutputBeforeAndAfterClassIT 1 0 0 0 100% 3.729
 Surefire634UnsettableSystemPropertiesWarningIT 1 0 0 0 100% 3.266
 Surefire649EmptyStringSystemPropertiesIT 2 0 0 0 100% 6.666
 Surefire673MockitoIT 1 0 0 0 100% 3.668
 Surefire674BuildFailingWhenErrorsIT 1 0 0 0 100% 3.305
 Surefire674BuildFailingWhenFailsafeErrorsIT 1 0 0 0 100% 3.902
 Surefire685CommaSeparatedIncludesIT 1 0 0 0 100% 3.278
 Surefire697NiceSummaryIT 1 0 0 0 100% 3.321
 Surefire705ParallelForkTimeoutIT 1 0 0 0 100% 6.537
 Surefire733AllOverrridesCapturedIT 1 0 0 0 100% 3.535
 Surefire735ForkFailWithRedirectConsoleOutputIT 2 0 0 0 100% 6.606
 Surefire740TruncatedCommaIT 1 0 0 0 100% 2.903
 Surefire747MethodParallelWithSuiteCountIT 2 0 0 0 100% 18.165
 Surefire772BothReportsIT 3 0 0 0 100% 6.475
 Surefire772NoFailsafeReportsIT 4 0 0 0 100% 8.689
 Surefire772NoSurefireReportsIT 4 0 0 0 100% 8.54
 Surefire772SpecifiedReportsIT 3 0 0 0 100% 6.634
 Surefire801ForkNeverClassLoaderIT 1 0 0 0 100% 3.586
 Surefire803MultiFailsafeExecsIT 2 0 0 0 100% 13.334
 Surefire806SpecifiedTestControlsIT 3 0 0 2 33.333% 3.246
 Surefire809GroupExpressionsIT 6 0 0 0 100% 20.543
 Surefire812Log4JClassLoaderIT 1 0 0 0 100% 3.289
 Surefire817SystemExitIT 1 0 0 0 100% 4.314
 Surefire818NpeIgnoresTestsIT 1 0 0 0 100% 3.831
 Surefire828EmptyGroupExprIT 4 0 0 0 100% 14.435
 Surefire832ProviderSelectionIT 1 0 0 0 100% 3.756
 Surefire839TestWithoutCategoriesIT 2 0 0 0 100% 7.628
 Surefire847AdditionalFailureIT 1 0 0 0 100% 4.124
 Surefire855AllowFailsafeUseArtifactFileIT 4 0 0 0 100% 23.262
 Surefire901MIssingResultfileWhenNoTestsIT 1 0 0 0 100% 2.74
 Surefire920TestFailureIgnoreWithTimeoutIT 2 0 0 0 100% 21.265
 Surefire926FailureWith2ProvidersIT 1 0 0 0 100% 5.231
 Surefire930TestNgSuiteXmlIT 1 0 0 0 100% 3.951
 Surefire943ReportContentIT 2 0 0 0 100% 18.326
 Surefire946KillMainProcessInReusableForkIT 6 0 0 0 100% 156.655
 Surefire972BizarreNoClassDefIT 1 0 0 0 100% 4.965
 Surefire975DefaultVMEncodingIT 1 0 0 0 100% 3.18
 Surefire979WrongClassLoaderIT 1 0 0 0 100% 3.596
 Surefire985ParameterizedRunnerAndCategoriesIT 1 0 0 0 100% 4.381
 Surefire995CategoryInheritanceIT 7 0 0 0 100% 26.83

Test Cases

[Summary] [Package List] [Test Cases]

AbstractTestCaseIT

 abstractTestCase 3.376

AdditionalClasspathIT

 additionalClasspath 3.222

AggregateReportIT

 aggregateReport 4.258

ArgLineIT

 argLine 3.254

ArgLinePropertiesIT

 argLine 3.505

AssumptionFailureReportIT

 testWriteSkippedMessageToReport 3.213

CheckSingleTestIT

 singleTestDotJava 3.371
 singleTestNonExistentOverride 2.471
 singleTestNonExistent 2.491
 singleTest 3.245

CheckTestFailIfNoTestsForkCountIT

 dontFailIfNoTestsForkAlways 3.251
 failIfNoTestsForkNever 2.685
 failIfNoTestsForkAlways 3.19
 failIfNoTestsForkOnce 3.156
 dontFailIfNoTestsForkNever 2.673
 dontFailIfNoTestsForkOnce 3.196

CheckTestFailIfNoTestsIT

 failIfNoTests 2.132
 dontFailIfNoTests 2.124
 jUnit48CategoriesFailWhenNoTests 2.104

CheckTestNg740ParallelIT

 withTestNG740AndParallelSetWithoutThreadCount 3.922
 withTestNG740AndParallelSet 3.899

CheckTestNgBeforeMethodFailureIT

 testNgBeforeMethodFailure 4.038

CheckTestNgBeforeMethodIT

 testNgBeforeMethod 3.362

CheckTestNgCustomObjectFactoryIT

 testTestNgListenerReporter 3.572

CheckTestNgCustomTestRunnerFactoryIT

 testTestNgListenerReporter 3.505

CheckTestNgExecuteErrorIT

 executionError 3.425

CheckTestNgGroupThreadParallelIT

 testNgGroupThreadParallel 2.981

CheckTestNgJdk14IT

 testNgJdk14 4.06

CheckTestNgListenerReporterIT

 testNgListenerReporter[0: TestNG 5.6] 4.374
 testNgListenerReporter[1: TestNG 5.7] 3.384
 testNgListenerReporter[2: TestNG 5.10] 3.405
 testNgListenerReporter[3: TestNG 5.13] 4.43
 testNgListenerReporter[4: TestNG 5.14.6] 4.163
 testNgListenerReporter[5: TestNG 5.14.9] 4.333
 testNgListenerReporter[6: TestNG 6.0] 4.029
 testNgListenerReporter[7: TestNG 6.14.3] 4.217
 testNgListenerReporter[8: TestNG 7.0.0] 4.265

CheckTestNgListenersIT

 testNgListenerReporter 3.67

CheckTestNgPathWithSpacesIT

 testWithSpaces 3.396

CheckTestNgReportTestIT

 testNgReport 4.307
 shouldNotBeVerbose 3.728
 shouldBeVerbose 3.914

CheckTestNgSuiteXmlIT

 suiteXmlForkAlways 3.941
 suiteXml 3.425
 suiteXmlForkCountTwoReuse 3.383

CheckTestNgSuiteXmlSingleIT

 testNgSuite 3.411

CheckTestNgVersionsIT

 test502 4.564
 test510 3.713
 test511 4.266
 test512 4.723
 test513 3.843
 test514 4.51
 test685 4.582
 test5131 4.417
 test5141 4.535
 test5142 4.554
 test47 4.454
 test51 4.267
 test55 4.407
 test56 3.679
 test57 3.72
 test58 4.399
 test59 4.481
 test60 3.73
 xXXtest501
+ [ Detail ]
 0
5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
xXXtest50
+ [ Detail ]
 0
5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024

ClasspathFilteringIT

 additionalClasspath 3.937

ClassPathOrderIT

 classPathOrder 3.587

ClasspathScopeFilteringIT

 additionalClasspath 3.909

ConsoleOutputIT

 properNewlinesAndEncodingWithDifferentEncoding[0] 5.091
 properNewlinesAndEncodingWithDefaultEncodings[0] 4.428
 largerSoutThanMemory[0] 8.213
 properNewlinesAndEncodingWithoutFork[0] 2.857
 properNewlinesAndEncodingWithDifferentEncoding[1] 3.557
 properNewlinesAndEncodingWithDefaultEncodings[1] 3.519
 largerSoutThanMemory[1] 7.043
 properNewlinesAndEncodingWithoutFork[1] 2.909

CrashDetectionIT

 hardCrashInReusableFork 4.467
 crashInReusableFork 3.735
 crashInFork 3.738

DefaultConfigurationIT

 defaultConfiguration 3.264

EnvironmentVariableIT

 environmentVariable 3.267

EnvironmentVariablesIT

 testWhenUseSystemClassLoader 3.324
 testExcludedEnv 3.316
 testWhenDontUseSystemClassLoader 3.318

FailFastJUnitIT

 test[junit4-oneFork-ff1] 8.319
 test[junit47-oneFork-ff1] 8.755
 test[junit4-oneFork-ff2] 20.276
 test[junit47-oneFork-ff2] 20.673
 test[junit4-twoForks-ff1] 15.807
 test[junit47-twoForks-ff1] 16.269
 test[junit4-twoForks-ff2] 20.524
 test[junit4-twoForks-ff2-tcp] 21.362
 test[junit47-twoForks-ff2] 20.787
 test[junit4-oneFork-ff3] 44.37
 test[junit47-oneFork-ff3] 44.641
 test[junit4-twoForks-ff3] 27.645
 test[junit47-twoForks-ff3] 28.393
 test[junit47-twoForks-ff3-tcp] 29.797

FailFastTestNgIT

 test[testng-oneFork-ff1] 9.166
 test[testng-oneFork-ff2] 20.857
 test[testng-twoForks-ff1] 18.199
 test[testng-twoForks-ff2] 22.06
 test[testng-twoForks-ff2-tcp] 22.328
 test[testng-oneFork-ff3] 45.127
 test[testng-twoForks-ff3] 28.404
 test[testng-twoForks-ff3-tcp] 29.49

ForkConsoleOutputIT

 printSummaryTrueWithRedirect 3.946
 printSummaryFalseWithoutRedirect 4.763
 printSummaryTrueWithoutRedirect 3.838
 printSummaryFalseWithRedirect 5.038

ForkConsoleOutputWithErrorsIT

 xmlFileContainsConsoleOutput 4.565

ForkCountIT

 testForkNever 6.421
 testForkOncePerThreadSingleThread 6.083
 testForkCountOneNoReuse 7.977
 testForkCountTwoNoReuse 19.152
 testForkCountTwoReuse 18.145
 testForkOncePerThreadTwoThreads 18.426
 testForkCountOneReuse 6.949
 testForkOnce 6.495

ForkCountMultiModuleIT

 testForkCountOneNoReuse 8.251
 testForkCountTwoNoReuse 6.599
 testForkCountTwoReuse 5.403
 testForkCountOneReuse 6.834

ForkCountTestNGIT

 testForkNever 4.124
 testForkOncePerThreadSingleThread 4.7
 testForkCountOneNoReuse 5.929
 testForkCountTwoNoReuse 12.647
 testForkCountTwoReuse 12.242
 testForkOncePerThreadTwoThreads 11.97
 testForkCountOneReuse 4.659
 testForkOnce 4.731

IncludesExcludesFromFileIT

 testSimpleMixed 4.759
 testMissingExcludes 2.808
 testRegex 3.601
 testPath 3.465
 testMissingIncludes 2.925
 testSimple 3.395

IncludesExcludesIT

 testPathBasedIncludesExcludes 3.187
 testIncludesExcludes 3.241
 testRegexIncludesExcludes 3.398

Java9FullApiIT

 shouldLoadMultipleJavaModules_JavaHome
+ [ Detail ]
 0
There's no JDK 9 provided.
shouldLoadMultipleJavaModules_ToolchainsXML
+ [ Detail ]
 0
There's no JDK 9 provided.
shouldLoadMultipleJavaModules_JvmParameter
+ [ Detail ]
 0
There's no JDK 9 provided.

SpockIT

 test 11.643

Surefire1004RunTestFromDependencyJarsTypeAndClassifierIT

 shouldScanAndRunTestsInDependencyJars 5.088

Surefire1024VerifyFailsafeIfTestedIT

 shouldScanAndRunTestsInDependencyJars 4.406

Surefire1028UnableToRunSingleIT

 methodFilteringParallelExecution 4.049

Surefire1036NonFilterableJUnitRunnerWithCategoriesIT

 test 4.774

Surefire1041FailingJUnitRunnerIT

 reportErrorInJUnitRunnerAsTestError 3.723

Surefire1053SystemPropertiesIT

 checkWarningsSysPropTwice 3.406
 checkWarningsFileEncoding 3.315

Surefire1055CorrectConcurrentTestCountIT

 testTestNgAndJUnitTogether 3.851

Surefire1080ParallelForkDoubleTestIT

 test 3.851

Surefire1082ParallelJUnitParameterizedIT

 checkClassesRunParallel 4.791
 shouldRunTwo 5.829
 checkOutFileClassesRunParallel 4.876

Surefire1095NpeInRunListenerIT

 testRunStartedWithJUnit40 3.224
 testRunStartedWithJUnit45 3.298
 testRunStartedWithJUnit47 3.263

Surefire1098BalancedRunOrderIT

 reorderedParallelClasses 8.045

Surefire1122ParallelAndFlakyTestsIT

 parallelCreatesCorrectReportFork 4.163
 nonParallelCreatesCorrectReport 3.956
 parallelCreatesCorrectReport 5.795

Surefire1135ImproveIgnoreMessageForTestNGIT

 testNgReport57 4.69
 testNgReport688 4.449

Surefire1136CwdPropagationInForkedModeIT

 testTestNgAndJUnitTogether 3.323

Surefire1144XmlRunTimeIT

 testXmlRunTime 5.239

Surefire1146RerunFailedAndParameterizedIT

 testsAreRerun 3.662

Surefire1152RerunFailingTestsInSuiteIT

 testJUnit48Provider47 5.556
 testJUnit48Provider4 4.455

Surefire1153IncludesAndSpecifiedTestIT

 testSpecifiedTestInIncludes 3.276
 testSpecifiedTestNotInIncludes 3.41

Surefire1158RemoveInfoLinesIT

 shouldRunWithCliOption[junit-option-ff] 3.978
 shouldRunWithCliOption[testng-option-ff] 3.697
 shouldRunWithCliOption[junit-option-X] 3.972
 shouldRunWithCliOption[testng-option-X] 3.695
 shouldRunWithCliOption[junit-option-e] 3.763
 shouldRunWithCliOption[testng-option-e] 3.522

Surefire1177TestngParallelSuitesIT

 twoSuitesInParallelForked 6.38
 twoSuitesInParallel 5.284

Surefire1179IT

 suiteXmlForkCountTwoReuse 10.283

Surefire1185DoNotSpawnTestsIT

 doNotSpawnUnwantedTests 3.479

Surefire1202RerunAndSkipIT

 junit47 16.434
 junit4 16.59

Surefire1209RerunAndForkCountIT

 notReusableForksJUnit47 11.486
 reusableForksJUnit47 11.605
 reusableForksJUnit4 10.479
 notReusableForksJUnit4 10.903

Surefire1211JUnitTestNgIT

 withoutJUnit 4.305
 withJUnit 3.611

Surefire1264IT

 positiveTests 4.967
 negativeTests 5.033

Surefire1265Java9IT

 shouldRunInPluginJava9
+ [ Detail ]
 0
There's no JDK 9 provided.

Surefire1278GroupNameEndingIT

 testOnlyGroups 3.584

Surefire1295AttributeJvmCrashesToTestsIT

 test[0] 6.744
 test[1] 8.358
 test[2] 6.065
 test[3] 7.899
 test[4] 9.68
 test[5] 7.349
 test[6] 6.062
 test[7] 8.419
 test[8] 6.104

Surefire1364SystemPropertiesIT

 junit47InProcessParallel 3.602
 junit47Forked 4.06
 junit47InProcess 3.455
 testNg 4.764
 junit3Forked 3.51
 junit47ForkedParallel 4.03
 junit4Forked 3.531
 testNgInProcess 3.618
 junit4InProcess 3.314
 junit3InProcess 2.962

Surefire1367AssumptionLogsIT

 shouldSeeLogsInPlugin 2.765
 shouldSeeLogsParallelInPlugin 3.427
 shouldSeeLogsParallelForked 3.862
 shouldSeeLogsForked 3.403

Surefire1383ScanSessionDependenciesIT

 test 4.219

Surefire1396CustomProviderClassPathIT

 pluggableProviderClasspathCorrect 3.889

Surefire141PluggableProvidersIT

 pluggableProviderPresent 3.636
 invokeRuntimeException 3.623
 invokeReporterException 3.702
 constructorRuntimeException 3.554

Surefire1426JvmCrashShouldNotBeIgnoredIT

 mavenShouldFail 2.98

Surefire146ForkPerTestNoSetupIT

 testForkPerTestNoSetup 3.2

Surefire1490ReportTitleDescriptionIT

 shouldHaveCustomizedReportTitleAndDescription 7.416
 shouldHaveDefaultReportTitleAndDescription 7.146

Surefire1534ReuseForksFalseWithJavaModuleIT

 testExecuteWithReuseForksFalseWithJavaModule
+ [ Detail ]
 0
There's no JDK 9 provided.
testExecuteWithReuseForksFalseWithJavaModuleWithFilter
+ [ Detail ]
 0
There's no JDK 9 provided.
testExecuteWithZeroForkCountWithJavaModule
+ [ Detail ]
 0
There's no JDK 9 provided.

Surefire1535TestNGParallelSuitesIT

 forks0 6.035
 forks2 4.846
 forks0Redirected 5.17
 forks2Redirected 4.923

Surefire1570ModularFailsafeIT

 shouldRunWithJupiterApi
+ [ Detail ]
 0
There's no JDK 9 provided.

Surefire1585IT

 shouldRunWithJupiterApi 3.619
 shouldRunWithVintage 3.545

Surefire162CharsetProviderIT

 testCharsetProvider 3.348

Surefire1712ExtractedModulenameWithoutASMIT

 test
+ [ Detail ]
 0
There's no JDK 9 provided.

Surefire1733JUnitIT

 test
+ [ Detail ]
 0
There's no JDK 9 provided.

Surefire1733TestngIT

 test
+ [ Detail ]
 0
There's no JDK 9 provided.

Surefire1744AlwaysIncludeOutputLogsIT

 testAlwaysIncludeOutputLogs 3.4

Surefire1787JUnit5IT

 apiAndEngine 3.674
 testNgWithJupiterApi 4.567
 testNg 3.719
 junit5Suite 4.598
 bothEngines 3.749
 junit4Runner 4.242
 selectJUnit4 3.539
 selectJUnit5 3.665
 testNgWithJupiterEngine 3.843
 bothApis 3.711

Surefire1881IT

 test 6.438

Surefire1914XmlReportingParameterizedTestIT

 testXmlReport[5.2.0] 4.005
 testXmlReport[5.8.2] 5.113
 testXmlReport[5.9.1] 4.93

Surefire1964IT

 shouldFilterTests 3.388
 shouldFilterTestsInPluginProcess 2.821

Surefire1967CheckTestNgMethodParallelOrderingIT

 testNgParallelOrderingWithEarlyVersion6 6.615
 testNgParallelOrderingWithVersion5 4.045
 testNgParallelOrderingWithVersion6 4.43
 testNgParallelOrdering 5.085

Surefire1993JpmsProvidingModulesIT

 verify
+ [ Detail ]
 0
java.specification.version: 1.8

Surefire2006ShadefireTransformersIT

 shadefireShouldBeUsed 3.05

Surefire2036IT

 selectJUnit5UsingConfiguredProviderWithPlatformRunner 3.665

Surefire2117XmlReportingNestedIT

 testXmlReport[5.2.0] 4.025
 testXmlReport[5.8.2] 4.234
 testXmlReport[5.9.1] 4.271

Surefire224WellFormedXmlFailuresIT

 testWellFormedXmlFailures 3.186

Surefire257NotRerunningTestsIT

 shouldNotRerun 4.315

Surefire260TestWithIdenticalNamesIT

 testWithIdenticalNames 6.498

Surefire34SecurityManagerIT

 testSecurityManager 3.261
 shouldFailOnJDK
+ [ Detail ]
 0
java.specification.version: 1.8
testSecurityManagerSuccessful 3.219

Surefire376TestNgAfterSuiteFailureIT

 testAfterSuiteFailure 3.384

Surefire377TestNgAndJUnitTogetherIT

 testTestNgAndJUnit4Together 3.614
 testTestNgAndJUnitTogether 3.437

Surefire408ManualProviderSelectionIT

 testParallelBuildResultCount 3.262

Surefire42NotExtendingTestCaseIT

 testInnerClass 3.238

Surefire44InnerClassTestIT

 testInnerClass 3.146

Surefire500PuzzlingErrorIT

 testBuildFailingWhenErrors 3.247

Surefire510TestClassPathForkModesIT

 testForkOnce 3.207
 testForkAlways 3.225

Surefire569RunTestFromDependencyJarsIT

 shouldScanAndRunTestsInDependencyJars 3.746

Surefire570MultipleReportDirectoriesIT

 testReportWithAggregate 7.965
 testReportWithoutAggregate 7.969

Surefire613TestCountInParallelIT

 testParallelBuildResultCount 3.79

Surefire621TestCountingJunit3InParallelIT

 testJunit3ParallelBuildResultCount 3.994
 testJunit3ParallelSuiteBuildResultCount 3.931
 testJunit3AllParallelBuildResultCount 3.992
 testJunit3BuildResultCount 3.878
 testJunit3SuiteBuildResultCount 4.123

Surefire628ConsoleOutputBeforeAndAfterClassIT

 testJunit3ParallelBuildResultCount 3.728

Surefire634UnsettableSystemPropertiesWarningIT

 testJunit3ParallelBuildResultCount 3.265

Surefire649EmptyStringSystemPropertiesIT

 systemPropertyVariables 3.407
 systemProperties 3.259

Surefire673MockitoIT

 testBuildFailingWhenErrors 3.667

Surefire674BuildFailingWhenErrorsIT

 testBuildFailingWhenErrors 3.304

Surefire674BuildFailingWhenFailsafeErrorsIT

 testBuildFailingWhenErrors 3.902

Surefire685CommaSeparatedIncludesIT

 testBuildFailingWhenErrors 3.277

Surefire697NiceSummaryIT

 testBuildFailingWhenErrors 3.321

Surefire705ParallelForkTimeoutIT

 testTimeoutForked 6.537

Surefire733AllOverrridesCapturedIT

 testLogOutput 3.535

Surefire735ForkFailWithRedirectConsoleOutputIT

 vmStartFail 3.301
 vmStartFailShouldFailBuildk 3.304

Surefire740TruncatedCommaIT

 testRussianLocaleReport 2.903

Surefire747MethodParallelWithSuiteCountIT

 testMethodsParallelWithSuite 8.14
 testClassesParallelWithSuite 10.025

Surefire772BothReportsIT

 testSkippedSurefireReportGeneration 2.149
 testSkippedFailsafeReportGeneration 2.131
 testReportGeneration 2.195

Surefire772NoFailsafeReportsIT

 testSkippedFailsafeReportGeneration 2.205
 testForcedFailsafeReportGeneration 2.202
 testSkipForcedFailsafeReportGeneration 2.126
 testReportGeneration 2.155

Surefire772NoSurefireReportsIT

 testOptionalSurefireReportGeneration 2.129
 testSkippedSurefireReportGeneration 2.123
 testSkipOptionalSurefireReportGeneration 2.106
 testReportGeneration 2.182

Surefire772SpecifiedReportsIT

 testSkippedSurefireReportGeneration 2.095
 testSkippedFailsafeReportGeneration 2.27
 testReportGeneration 2.269

Surefire801ForkNeverClassLoaderIT

 testShouldBeOkWithForkNever 3.585

Surefire803MultiFailsafeExecsIT

 testOneExecutionRunInTwoBuilds 8.217
 testSecondExecutionRunsAfterFirstExecutionFails 5.116

Surefire806SpecifiedTestControlsIT

 singleTestInSingleExecutionProject 3.245
 twoSpecifiedTestExecutionsInCorrectExecutionBlocks
+ [ Detail ]
 0
since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
singleTestInOneExecutionOfMultiExecutionProject
+ [ Detail ]
 0
since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution

Surefire809GroupExpressionsIT

 testNGRunCategoryAB 3.522
 testExcludedGroups 3.716
 testJUnitRunCategoryNotC 3.811
 incorrectJUnitVersions 2.276
 categoryAB 3.751
 testNGRunCategoryNotC 3.466

Surefire812Log4JClassLoaderIT

 testJunit3ParallelBuildResultCount 3.289

Surefire817SystemExitIT

 systemExit1 4.313

Surefire818NpeIgnoresTestsIT

 testBuildFailingWhenErrors 3.831

Surefire828EmptyGroupExprIT

 testJUnitRunEmptyExcludeGroups 3.779
 testJUnitRunEmptyGroups 3.792
 testTestNGRunEmptyExcludeGroups 3.43
 testTestNGRunEmptyGroups 3.434

Surefire832ProviderSelectionIT

 testJUnitRunCategoryAB 3.756

Surefire839TestWithoutCategoriesIT

 classWithoutCategoryForked 3.853
 classWithoutCategory 3.774

Surefire847AdditionalFailureIT

 testJUnitRunCategoryAB 4.123

Surefire855AllowFailsafeUseArtifactFileIT

 jarNotForkingShouldUseFile 6.194
 jarShouldUseFile 5.55
 warShouldUseClasses 5.63
 osgiBundleShouldUseFile 5.887

Surefire901MIssingResultfileWhenNoTestsIT

 failsafeWithNoTests 2.739

Surefire920TestFailureIgnoreWithTimeoutIT

 timeoutInForkWithBuildFail 10.638
 timeoutInForkWithNoBuildFail 10.626

Surefire926FailureWith2ProvidersIT

 testBuildFailingWhenErrors 5.231

Surefire930TestNgSuiteXmlIT

 suiteXmlRun 3.951

Surefire943ReportContentIT

 test_noParallel 9.849
 test_parallelBoth 4.818

Surefire946KillMainProcessInReusableForkIT

 test[halt-exit] 26.588
 test[halt-kill] 26.017
 test[exit-exit] 25.617
 test[exit-kill] 25.522
 test[interrupt-exit] 25.567
 test[interrupt-kill] 27.342

Surefire972BizarreNoClassDefIT

 testJunit3ParallelBuildResultCount 4.964

Surefire975DefaultVMEncodingIT

 runWithRussian1251 3.18

Surefire979WrongClassLoaderIT

 wrongClassloaderUSedInSmartStacktraceparser 3.594

Surefire985ParameterizedRunnerAndCategoriesIT

 test 4.378

Surefire995CategoryInheritanceIT

 junit411ShouldIgnoreInheritedCategories 4.112
 junit411ShouldRunExplicitCategory 3.778
 junit412ShouldExecuteInheritedCategories 3.973
 junit411ShouldExcludeExplicitCategory 3.873
 junit412ShouldExcludeInheritedCategory 3.905
 junit412ShouldRunInheritedCategory 3.736
 negativeTestShouldRunAllCategories 3.452

JUnit44HamcrestIT

 testJUnit44Hamcrest 3.447

JUnit47ConcurrencyIT

 test47 5.102

JUnit47ParallelIT

 unknownThreadCountClasses 3.168
 threadCountSuites 10.152
 unlimitedThreadsSuitesAndMethods1 6.386
 unlimitedThreadsSuitesAndMethods2 5.885
 unknownThreadCountMethods 2.872
 threadCountClassesAndMethods 5.805
 reusableThreadCountClassesAndMethodsOptimized 6.336
 unknownThreadCountSuites 3.545
 reusableThreadCountAll 5.383
 forcedShutdown 6.894
 unknownThreadCountAll 2.632
 serial 11.274
 reusableThreadCountAllOptimized 5.498
 suites 8.576
 unlimitedThreadsMethods1 7.215
 unlimitedThreadsMethods2 7.195
 unlimitedThreadsSuitesAndClasses1 6.098
 unlimitedThreadsSuitesAndClasses2 5.715
 threadCountAllOptimized 5.964
 threadCountAll 5.927
 everyThreadCountSuitesAndClasses 5.744
 unknownThreadCountBoth 2.965
 threadCountSuitesAndClassesOptimized 5.704
 classesAndMethods 5.114
 everyThreadCountSuitesAndMethods 6.432
 unknownThreadCountSuitesAndClasses 2.925
 reusableThreadCountSuitesAndClassesOptimized 6.654
 unknownThreadCountSuitesAndMethods 2.909
 suitesAndClasses 5.783
 suitesAndMethods 7.942
 shutdown 11.717
 threadCountClassesAndMethodsOneCore 10.603
 everyThreadCountClassesAndMethods 6.035
 all 6.036
 unknownThreadCountClassesAndMethods 2.819
 threadCountSuitesAndMethodsOptimized 6.747
 reusableThreadCountSuitesAndMethodsOptimized 6.769
 unlimitedThreadsClasses1 6.29
 unlimitedThreadsClasses2 6.157
 threadCountClasses 6.497
 everyThreadCountAll 5.66
 threadCountMethods 7
 unlimitedThreadsSuites1 8.69
 unlimitedThreadsSuites2 8.492
 threadCountSuitesAndClasses 5.994
 unlimitedThreadsClassesAndMethods1 5.257
 unlimitedThreadsClassesAndMethods2 5.05
 threadCountSuitesAndMethods 5.724
 classes 6.444
 reusableThreadCountSuitesAndClasses 6.155
 methods 7.049
 reusableThreadCountSuitesAndMethods 7.207
 timeoutAndForcedShutdown 7.205
 threadCountClassesAndMethodsOptimized 5.873
 unlimitedThreadsAll1 4.579
 unlimitedThreadsAll2 4.663
 forcedShutdownVerifyingLogs 5.399
 threadCountClassesAndMethodsOneCoreOptimized 9.296
 reusableThreadCountClassesAndMethods 6.252

JUnit47ParallelNotThreadSafeIT

 test 3.855

JUnit47RedirectOutputIT

 testClassesParallel 3.823
 testPrintSummaryTrueWithRedirect 3.792

JUnit47RerunFailingTestWithCucumberIT

 testRerunFailingErrorTestsFalse[0] 8.338
 testRerunFailingErrorTestsWithOneRetry[0] 5.587
 testRerunFailingErrorTestsTwoRetry[0] 5.514
 testRerunFailingErrorTestsFalse[1] 4.435
 testRerunFailingErrorTestsWithOneRetry[1] 4.425
 testRerunFailingErrorTestsTwoRetry[1] 4.464

JUnit47StaticInnerClassTestsIT

 testStaticInnerClassTests 3.239

JUnit47WithCucumberIT

 testWithParallelClasses 3.783
 testWithoutParallel 3.75

JUnit48TestCategoriesIT

 testCategoriesACFullyQualifiedClassName 3.836
 testBadCategoryForkAlways 4.581
 testCategoriesABForkAlways 4.509
 testCategoriesBadCategory 3.662
 testCategoriesACClassNameSuffix 3.781
 testCategoriesACFullyQualifiedClassNameForkAlways 4.561
 testCategoriesAB 3.766
 testCategoriesACClassNameSuffixForkAlways 4.53

JUnit4ForkAlwaysStaticInitPollutionIT

 testJunit4Ignore 4.176

JUnit4IgnoreIT

 testJunit4Ignore 3.284
 testJunit47ParallelIgnore 3.753

JUnit4RerunFailingTestsIT

 testRerunFailingErrorTestsFalse 14.472
 testRerunFailingErrorTestsWithOneRetry 14.526
 testRerunFailingErrorTestsTwoRetry 14.442
 testRerunOneTestMethod 14.436
 testRerunOneTestClass 14.432

JUnit4RunListenerIT

 testJUnit4RunListener 3.353
 testRunlistenerJunitCoreProvider 3.798

JUnit4VersionsIT

 testJunit[0: JUnit 4.0] 3.232
 testJunit[1: JUnit 4.1] 3.825
 testJunit[2: JUnit 4.2] 3.797
 testJunit[3: JUnit 4.3] 3.834
 testJunit[4: JUnit 4.3.1] 3.753
 testJunit[5: JUnit 4.4] 3.215
 testJunit[6: JUnit 4.5] 3.231
 testJunit[7: JUnit 4.6] 3.762
 testJunit[8: JUnit 4.7] 3.256
 testJunit[9: JUnit 4.8] 3.807
 testJunit[10: JUnit 4.8.1] 3.295
 testJunit[11: JUnit 4.8.2] 3.287
 testJunit[12: JUnit 4.9] 3.856
 testJunit[13: JUnit 4.10] 3.831
 testJunit[14: JUnit 4.11] 3.253
 testJunit[15: JUnit 4.12] 3.273
 testJunit[16: JUnit 4.13] 3.272
 testJunit[17: JUnit 4.13.1] 3.273
 testJunit[18: JUnit 4.13.2] 3.329

Junit5ModulePathIT

 testModulePathWithSpaces
+ [ Detail ]
 0
There's no JDK 9 provided.
testModulePath
+ [ Detail ]
 0
There's no JDK 9 provided.

JUnitDepIT

 testJUnit44DepWithSneaky381 3.838
 testJUnit44Dep 3.283
 testJUnit47Dep 4.417
 testJUnit48Dep 4.68

JUnitPlatformEnginesIT

 testJupiterEngineWithAssertionsFailEmptyStringParameters[1.2.0] 4.306
 testToRegex[1.2.0] 0
 testJupiterEngineWithAssertionsFailNoParameters[1.2.0] 3.757
 testJupiterEngineWithExceptionMessage[1.2.0] 3.657
 testTags[1.2.0] 3.58
 failingBeforeAllMethod[1.2.0] 3.548
 testJupiterEngineWithAssertionsFailMessage[1.2.0] 3.703
 errorInBeforeAllMethod[1.2.0] 3.955
 testJupiterEngineWithFailureInParameterizedSource[1.2.0] 4.987
 testJupiterEngineWithFailureInTestTemplateProvider[1.2.0] 5.415
 testJupiterEngineWithErrorInParameterizedSource[1.2.0] 4.55
 testJupiterEngine[1.2.0] 9.266
 testJupiterEngineWithDisplayNames[1.2.0] 5.802
 testJupiterEngineWithErrorInTestTemplateProvider[1.2.0] 5.678
 testJupiterEngineWithFailureInTestFactory[1.2.0] 7.421
 testJupiterEngineWithErrorInTestFactory[1.2.0] 5.792
 platform[1.2.0] 5.275
 testJupiterEngineWithAssertionsFailEmptyStringParameters[1.3.2] 6.552
 testToRegex[1.3.2] 0
 testJupiterEngineWithAssertionsFailNoParameters[1.3.2] 5.258
 testJupiterEngineWithExceptionMessage[1.3.2] 6.076
 testTags[1.3.2] 6.051
 failingBeforeAllMethod[1.3.2] 5.537
 testJupiterEngineWithAssertionsFailMessage[1.3.2] 5.628
 errorInBeforeAllMethod[1.3.2] 6.171
 testJupiterEngineWithFailureInParameterizedSource[1.3.2] 5.018
 testJupiterEngineWithFailureInTestTemplateProvider[1.3.2] 7.198
 testJupiterEngineWithErrorInParameterizedSource[1.3.2] 7.662
 testJupiterEngine[1.3.2] 6.674
 testJupiterEngineWithDisplayNames[1.3.2] 4.814
 testJupiterEngineWithErrorInTestTemplateProvider[1.3.2] 3.864
 testJupiterEngineWithFailureInTestFactory[1.3.2] 3.977
 testJupiterEngineWithErrorInTestFactory[1.3.2] 4.353
 platform[1.3.2] 4.063
 testJupiterEngineWithAssertionsFailEmptyStringParameters[1.4.2] 7.84
 testToRegex[1.4.2] 0
 testJupiterEngineWithAssertionsFailNoParameters[1.4.2] 5.026
 testJupiterEngineWithExceptionMessage[1.4.2] 3.876
 testTags[1.4.2] 6.343
 failingBeforeAllMethod[1.4.2] 3.831
 testJupiterEngineWithAssertionsFailMessage[1.4.2] 4.068
 errorInBeforeAllMethod[1.4.2] 3.766
 testJupiterEngineWithFailureInParameterizedSource[1.4.2] 3.943
 testJupiterEngineWithFailureInTestTemplateProvider[1.4.2] 4.002
 testJupiterEngineWithErrorInParameterizedSource[1.4.2] 3.821
 testJupiterEngine[1.4.2] 3.971
 testJupiterEngineWithDisplayNames[1.4.2] 4.273
 testJupiterEngineWithErrorInTestTemplateProvider[1.4.2] 3.843
 testJupiterEngineWithFailureInTestFactory[1.4.2] 4.61
 testJupiterEngineWithErrorInTestFactory[1.4.2] 3.755
 platform[1.4.2] 4.36
 testJupiterEngineWithAssertionsFailEmptyStringParameters[1.5.2] 4.939
 testToRegex[1.5.2] 0
 testJupiterEngineWithAssertionsFailNoParameters[1.5.2] 3.714
 testJupiterEngineWithExceptionMessage[1.5.2] 3.686
 testTags[1.5.2] 3.73
 failingBeforeAllMethod[1.5.2] 4.23
 testJupiterEngineWithAssertionsFailMessage[1.5.2] 3.667
 errorInBeforeAllMethod[1.5.2] 4.193
 testJupiterEngineWithFailureInParameterizedSource[1.5.2] 3.737
 testJupiterEngineWithFailureInTestTemplateProvider[1.5.2] 3.691
 testJupiterEngineWithErrorInParameterizedSource[1.5.2] 3.675
 testJupiterEngine[1.5.2] 4.004
 testJupiterEngineWithDisplayNames[1.5.2] 4.218
 testJupiterEngineWithErrorInTestTemplateProvider[1.5.2] 3.684
 testJupiterEngineWithFailureInTestFactory[1.5.2] 3.725
 testJupiterEngineWithErrorInTestFactory[1.5.2] 3.822
 platform[1.5.2] 3.587
 testJupiterEngineWithAssertionsFailEmptyStringParameters[1.6.3] 4.665
 testToRegex[1.6.3] 0
 testJupiterEngineWithAssertionsFailNoParameters[1.6.3] 3.592
 testJupiterEngineWithExceptionMessage[1.6.3] 3.628
 testTags[1.6.3] 3.539
 failingBeforeAllMethod[1.6.3] 3.641
 testJupiterEngineWithAssertionsFailMessage[1.6.3] 3.646
 errorInBeforeAllMethod[1.6.3] 3.709
 testJupiterEngineWithFailureInParameterizedSource[1.6.3] 3.687
 testJupiterEngineWithFailureInTestTemplateProvider[1.6.3] 3.651
 testJupiterEngineWithErrorInParameterizedSource[1.6.3] 3.678
 testJupiterEngine[1.6.3] 4.06
 testJupiterEngineWithDisplayNames[1.6.3] 4.189
 testJupiterEngineWithErrorInTestTemplateProvider[1.6.3] 3.674
 testJupiterEngineWithFailureInTestFactory[1.6.3] 3.741
 testJupiterEngineWithErrorInTestFactory[1.6.3] 3.759
 platform[1.6.3] 3.589
 testJupiterEngineWithAssertionsFailEmptyStringParameters[1.7.2] 4.482
 testToRegex[1.7.2] 0
 testJupiterEngineWithAssertionsFailNoParameters[1.7.2] 3.662
 testJupiterEngineWithExceptionMessage[1.7.2] 3.632
 testTags[1.7.2] 3.641
 failingBeforeAllMethod[1.7.2] 3.666
 testJupiterEngineWithAssertionsFailMessage[1.7.2] 3.632
 errorInBeforeAllMethod[1.7.2] 3.67
 testJupiterEngineWithFailureInParameterizedSource[1.7.2] 3.703
 testJupiterEngineWithFailureInTestTemplateProvider[1.7.2] 3.632
 testJupiterEngineWithErrorInParameterizedSource[1.7.2] 3.713
 testJupiterEngine[1.7.2] 3.949
 testJupiterEngineWithDisplayNames[1.7.2] 4.266
 testJupiterEngineWithErrorInTestTemplateProvider[1.7.2] 3.664
 testJupiterEngineWithFailureInTestFactory[1.7.2] 3.626
 testJupiterEngineWithErrorInTestFactory[1.7.2] 3.709
 platform[1.7.2] 3.588
 testJupiterEngineWithAssertionsFailEmptyStringParameters[1.8.2] 3.703
 testToRegex[1.8.2] 0
 testJupiterEngineWithAssertionsFailNoParameters[1.8.2] 3.631
 testJupiterEngineWithExceptionMessage[1.8.2] 3.627
 testTags[1.8.2] 3.646
 failingBeforeAllMethod[1.8.2] 3.628
 testJupiterEngineWithAssertionsFailMessage[1.8.2] 3.67
 errorInBeforeAllMethod[1.8.2] 3.686
 testJupiterEngineWithFailureInParameterizedSource[1.8.2] 3.76
 testJupiterEngineWithFailureInTestTemplateProvider[1.8.2] 3.72
 testJupiterEngineWithErrorInParameterizedSource[1.8.2] 3.882
 testJupiterEngine[1.8.2] 4.374
 testJupiterEngineWithDisplayNames[1.8.2] 4.248
 testJupiterEngineWithErrorInTestTemplateProvider[1.8.2] 3.977
 testJupiterEngineWithFailureInTestFactory[1.8.2] 3.939
 testJupiterEngineWithErrorInTestFactory[1.8.2] 3.766
 platform[1.8.2] 3.618
 testJupiterEngineWithAssertionsFailEmptyStringParameters[1.9.1] 3.728
 testToRegex[1.9.1] 0
 testJupiterEngineWithAssertionsFailNoParameters[1.9.1] 3.868
 testJupiterEngineWithExceptionMessage[1.9.1] 3.671
 testTags[1.9.1] 3.623
 failingBeforeAllMethod[1.9.1] 3.743
 testJupiterEngineWithAssertionsFailMessage[1.9.1] 3.72
 errorInBeforeAllMethod[1.9.1] 4.36
 testJupiterEngineWithFailureInParameterizedSource[1.9.1] 4.026
 testJupiterEngineWithFailureInTestTemplateProvider[1.9.1] 4.06
 testJupiterEngineWithErrorInParameterizedSource[1.9.1] 3.802
 testJupiterEngine[1.9.1] 4.142
 testJupiterEngineWithDisplayNames[1.9.1] 4.257
 testJupiterEngineWithErrorInTestTemplateProvider[1.9.1] 3.689
 testJupiterEngineWithFailureInTestFactory[1.9.1] 3.788
 testJupiterEngineWithErrorInTestFactory[1.9.1] 3.837
 platform[1.9.1] 4.009

JUnitPlatformIT

 testVintageEngine[5.2.0] 4.593
 testJQwikEngine[5.2.0] 4.134
 testMultipleEngines[5.2.0] 3.98
 testVintageEngine[5.3.2] 5.294
 testJQwikEngine[5.3.2] 4.743
 testMultipleEngines[5.3.2] 4.502
 testVintageEngine[5.4.2] 5.405
 testJQwikEngine[5.4.2] 5.914
 testMultipleEngines[5.4.2] 4.099
 testVintageEngine[5.5.2] 4.714
 testJQwikEngine[5.5.2] 4.258
 testMultipleEngines[5.5.2] 4.157
 testVintageEngine[5.6.2] 6.406
 testJQwikEngine[5.6.2] 5.329
 testMultipleEngines[5.6.2] 6.618
 testVintageEngine[5.7.2] 5.272
 testJQwikEngine[5.7.2] 8.41
 testMultipleEngines[5.7.2] 5.286
 testVintageEngine[5.8.2] 5.151
 testJQwikEngine[5.8.2] 6.609
 testMultipleEngines[5.8.2] 4.815
 testVintageEngine[5.9.1] 4.809
 testJQwikEngine[5.9.1] 4.908
 testMultipleEngines[5.9.1] 4.435

JUnitPlatformRerunFailingTestsIT

 testRerunFailingErrorTestsFalse 19.461
 testRerunFailingErrorTestsWithOneRetry 16.925
 testParameterizedTest 3.964
 testRerunFailingErrorTestsTwoRetry 16.097
 testFailOnTooManyFlakes 4.045
 testRerunOneTestMethod 16.745
 testRerunOneTestClass 15.825

JUnitPlatformStreamCorruptionIT

 warningIsNotEmitted 3.563
 warningIsNotEmittedWithJulToLog4j
+ [ Detail ]
 0
https://issues.apache.org/jira/browse/SUREFIRE-1659?focusedCommentId=17374005&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-17374005
warningIsNotEmittedWithJulToSlf4j 3.803

LongWindowsPathIT

 shouldRunInSystemTmp 3.624

ModulePathIT

 testModulePathWithSpaces
+ [ Detail ]
 0
There's no JDK 9 provided.
testModulePath
+ [ Detail ]
 0
There's no JDK 9 provided.

MultiModuleProjectWithJPMSIT

 test
+ [ Detail ]
 0
There's no JDK 9 provided.

NoRunnableTestsInClassIT

 testJunit3ParallelBuildResultCount 4.036

PlainOldJavaClasspathIT

 testPlainOldJavaClasspath 5.128

PlexusConflictIT

 testPlexusConflict 6.668
 testPlexusConflictIsolatedClassLoader 6.551

PojoSimpleIT

 twoTestsWithFixtures 4.146

ReportersIT

 testRedirectOutputTestNg 4.22

ResultCountingIT

 testCountingWithJunit481ForkAlways 5.959
 testCountingWithJunit481ForkOnce 5.395
 testCountingWithJunit481ForkNever 4.581

RunOrderIT

 testRandomJUnit4PrintSeedWithNoGivenSeed 5.192
 testRandomJUnit4DifferentSeed 13.099
 testNonExistingRunOrderJUnit4 2.784
 testNonExistingRunOrderJUnit5 2.777
 testRandomJUnit4SameSeed 25.531
 testHourlyJUnit4 3.373
 testHourlyJUnit5 4.037
 testRandomJUnit4PrintSeedWithGivenSeed 3.515
 testReverseAlphabeticalJUnit4 3.327
 testReverseAlphabeticalJUnit5 6.507
 testAlphabeticalJUnit4 4.261
 testAlphabeticalJUnit5 4.204

RunOrderParallelForksIT

 testRandomJUnit4PrintSeedWithNoGivenSeed 4.19
 testRandomJUnit4DifferentSeed 15.739
 testNonExistingRunOrderJUnit4 3.313
 testNonExistingRunOrderJUnit5 2.684
 testRandomJUnit4SameSeed 24.575
 testHourlyJUnit4 3.984
 testHourlyJUnit5 4.808
 testRandomJUnit4PrintSeedWithGivenSeed 3.96
 testReverseAlphabeticalJUnit4 4.296
 testReverseAlphabeticalJUnit5 5.294
 testAlphabeticalJUnit4 4.324
 testAlphabeticalJUnit5 4.776

SiblingAggregatorIT

 testSiblingAggregator 3.172

SmartStackTraceIT

 misg 3.198

Surefire1602IT

 nonCanonicalPath 7.64

SystemPropertiesTestIT

 testSystemProperties 3.572
 testSystemPropertiesNoFork 3.475

TestMethodPatternIT

 testJUnit48WithCategoryFilter[0] 5.354
 testJUnit48Provider47[0] 5.111
 testMethodPatternAfter[0] 6.11
 testTestNGMethodPattern[0] 10.31
 testJUnit48Provider4[0] 6.007
 testJUnit44[0] 5.213
 testTestNgMethodBefore[0] 5.583
 testJUnit48WithCategoryFilter[1] 5.285
 testJUnit48Provider47[1] 5.529
 testMethodPatternAfter[1] 4.871
 testTestNGMethodPattern[1] 5.142
 testJUnit48Provider4[1] 4.378
 testJUnit44[1] 4.498
 testTestNgMethodBefore[1] 4.428

TestMultipleMethodPatternsIT

 shouldNotRunExcludedClassesAndMethods[0] 8.065
 shouldMatchExactClassAndMethodCharacters[0] 10.092
 shouldMatchExactClassAndMethodWildcard[0] 4.164
 testSuccessTwo[0] 7.394
 simpleNameTest[0] 4.513
 simpleNameTestWithJavaExt[0] 4.515
 regexClass[0] 4.935
 shouldNotRunExcludedClasses[0] 7.431
 shouldNotRunExcludedMethods[0] 4.223
 simpleNameTestWithJavaExtWildcardPkg[0] 4.138
 shouldMatchMultiplePatterns[0] 4.051
 shouldMatchExactClassAndMethodsPostfix[0] 4.051
 simpleNameTestWithWildcardPkg[0] 3.925
 shouldMatchWildcardPackageAndClassAndMethod[0] 3.599
 shouldMatchExactClassAndMultipleMethods[0] 3.889
 fullyQualifiedTest[0] 3.617
 matchSimpleClassAndMethodWithJavaExtWildcardPkg[0] 3.525
 negativeTest[0]
+ [ Detail ]
 0
got: <TEST>, expected: (is <INCLUDES> or is <INCLUDES_EXCLUDES> or is <INCLUDES_FILE> or is <INCLUDES_EXCLUDES_FILE>)
testRegexSuccessTwo[0] 3.455
 shouldMatchExactClassAndMethodsWildcard[0] 3.421
 shouldMatchMultiplePatternsComplex[0] 3.548
 simpleNameTestAsParallel[0]
+ [ Detail ]
 0
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
matchSimpleClassAndMethodWithWildcardPkg[0] 3.417
 shouldMatchMultiplePatternsAsParallel[0]
+ [ Detail ]
 0
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
shouldNotRunExcludedClassesIfIncluded[0] 3.546
 shouldMatchSimpleClassNameAndMethod[0] 3.439
 shouldMatchExactClassAndMethodPostfix[0] 3.404
 shouldMatchMultiplePatternsComplexAsParallel[0]
+ [ Detail ]
 0
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
matchSimpleClassAndMethodWithJavaExt[0] 3.383
 regexClassAndMethod[0] 3.372
 shouldNotRunExcludedClassesAndMethods[1] 3.912
 shouldMatchExactClassAndMethodCharacters[1] 3.821
 shouldMatchExactClassAndMethodWildcard[1] 3.823
 testSuccessTwo[1] 3.971
 simpleNameTest[1] 3.954
 simpleNameTestWithJavaExt[1] 3.813
 regexClass[1] 3.818
 shouldNotRunExcludedClasses[1] 3.844
 shouldNotRunExcludedMethods[1] 3.951
 simpleNameTestWithJavaExtWildcardPkg[1] 3.924
 shouldMatchMultiplePatterns[1] 4.073
 shouldMatchExactClassAndMethodsPostfix[1] 3.972
 simpleNameTestWithWildcardPkg[1] 3.796
 shouldMatchWildcardPackageAndClassAndMethod[1] 3.927
 shouldMatchExactClassAndMultipleMethods[1] 4.038
 fullyQualifiedTest[1] 3.864
 matchSimpleClassAndMethodWithJavaExtWildcardPkg[1] 3.856
 negativeTest[1]
+ [ Detail ]
 0
got: <TEST>, expected: (is <INCLUDES> or is <INCLUDES_EXCLUDES> or is <INCLUDES_FILE> or is <INCLUDES_EXCLUDES_FILE>)
testRegexSuccessTwo[1] 4.499
 shouldMatchExactClassAndMethodsWildcard[1] 3.93
 shouldMatchMultiplePatternsComplex[1] 4.134
 simpleNameTestAsParallel[1] 3.942
 matchSimpleClassAndMethodWithWildcardPkg[1] 3.696
 shouldMatchMultiplePatternsAsParallel[1] 3.986
 shouldNotRunExcludedClassesIfIncluded[1] 3.855
 shouldMatchSimpleClassNameAndMethod[1] 3.972
 shouldMatchExactClassAndMethodPostfix[1] 3.73
 shouldMatchMultiplePatternsComplexAsParallel[1] 4.093
 matchSimpleClassAndMethodWithJavaExt[1] 3.873
 regexClassAndMethod[1] 4.681
 shouldNotRunExcludedClassesAndMethods[2]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodCharacters[2]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodWildcard[2]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
testSuccessTwo[2]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTest[2] 3.304
 simpleNameTestWithJavaExt[2] 3.399
 regexClass[2] 3.326
 shouldNotRunExcludedClasses[2] 3.41
 shouldNotRunExcludedMethods[2]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTestWithJavaExtWildcardPkg[2] 3.379
 shouldMatchMultiplePatterns[2]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsPostfix[2]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTestWithWildcardPkg[2] 3.394
 shouldMatchWildcardPackageAndClassAndMethod[2]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMultipleMethods[2]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
fullyQualifiedTest[2] 3.374
 matchSimpleClassAndMethodWithJavaExtWildcardPkg[2]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
negativeTest[2] 2.554
 testRegexSuccessTwo[2]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsWildcard[2]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplex[2]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTestAsParallel[2]
+ [ Detail ]
 0
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
matchSimpleClassAndMethodWithWildcardPkg[2]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsAsParallel[2]
+ [ Detail ]
 0
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
shouldNotRunExcludedClassesIfIncluded[2] 3.407
 shouldMatchSimpleClassNameAndMethod[2]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodPostfix[2]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplexAsParallel[2]
+ [ Detail ]
 0
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
matchSimpleClassAndMethodWithJavaExt[2]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
regexClassAndMethod[2]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
shouldNotRunExcludedClassesAndMethods[3]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodCharacters[3]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodWildcard[3]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
testSuccessTwo[3]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTest[3] 3.882
 simpleNameTestWithJavaExt[3] 3.745
 regexClass[3] 3.805
 shouldNotRunExcludedClasses[3] 3.931
 shouldNotRunExcludedMethods[3]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTestWithJavaExtWildcardPkg[3] 3.921
 shouldMatchMultiplePatterns[3]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsPostfix[3]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTestWithWildcardPkg[3] 3.776
 shouldMatchWildcardPackageAndClassAndMethod[3]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMultipleMethods[3]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
fullyQualifiedTest[3] 3.747
 matchSimpleClassAndMethodWithJavaExtWildcardPkg[3]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
negativeTest[3] 2.637
 testRegexSuccessTwo[3]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsWildcard[3]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplex[3]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTestAsParallel[3] 3.975
 matchSimpleClassAndMethodWithWildcardPkg[3]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsAsParallel[3]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
shouldNotRunExcludedClassesIfIncluded[3] 3.776
 shouldMatchSimpleClassNameAndMethod[3]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodPostfix[3]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplexAsParallel[3]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithJavaExt[3]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
regexClassAndMethod[3]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
shouldNotRunExcludedClassesAndMethods[4]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodCharacters[4]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodWildcard[4]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
testSuccessTwo[4]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTest[4] 3.429
 simpleNameTestWithJavaExt[4] 3.356
 regexClass[4] 3.336
 shouldNotRunExcludedClasses[4] 3.355
 shouldNotRunExcludedMethods[4]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTestWithJavaExtWildcardPkg[4] 3.33
 shouldMatchMultiplePatterns[4]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsPostfix[4]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTestWithWildcardPkg[4] 3.358
 shouldMatchWildcardPackageAndClassAndMethod[4]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMultipleMethods[4]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
fullyQualifiedTest[4] 3.331
 matchSimpleClassAndMethodWithJavaExtWildcardPkg[4]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
negativeTest[4] 2.566
 testRegexSuccessTwo[4]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsWildcard[4]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplex[4]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTestAsParallel[4]
+ [ Detail ]
 0
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
matchSimpleClassAndMethodWithWildcardPkg[4]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsAsParallel[4]
+ [ Detail ]
 0
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
shouldNotRunExcludedClassesIfIncluded[4] 3.333
 shouldMatchSimpleClassNameAndMethod[4]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodPostfix[4]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplexAsParallel[4]
+ [ Detail ]
 0
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
matchSimpleClassAndMethodWithJavaExt[4]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
regexClassAndMethod[4]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldNotRunExcludedClassesAndMethods[5]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodCharacters[5]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodWildcard[5]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
testSuccessTwo[5]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTest[5] 3.757
 simpleNameTestWithJavaExt[5] 3.942
 regexClass[5] 3.848
 shouldNotRunExcludedClasses[5] 3.8
 shouldNotRunExcludedMethods[5]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTestWithJavaExtWildcardPkg[5] 3.724
 shouldMatchMultiplePatterns[5]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsPostfix[5]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTestWithWildcardPkg[5] 3.918
 shouldMatchWildcardPackageAndClassAndMethod[5]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMultipleMethods[5]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
fullyQualifiedTest[5] 3.85
 matchSimpleClassAndMethodWithJavaExtWildcardPkg[5]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
negativeTest[5] 2.572
 testRegexSuccessTwo[5]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsWildcard[5]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplex[5]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTestAsParallel[5] 3.872
 matchSimpleClassAndMethodWithWildcardPkg[5]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsAsParallel[5]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldNotRunExcludedClassesIfIncluded[5] 3.774
 shouldMatchSimpleClassNameAndMethod[5]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodPostfix[5]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplexAsParallel[5]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithJavaExt[5]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
regexClassAndMethod[5]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>

TestMultipleMethodPatternsTestNGIT

 shouldNotRunExcludedClassesAndMethods[0] 3.443
 shouldMatchExactClassAndMethodCharacters[0] 3.527
 shouldMatchExactClassAndMethodWildcard[0] 3.502
 testSuccessTwo[0] 3.559
 simpleNameTest[0] 4.479
 simpleNameTestWithJavaExt[0] 4.027
 regexClass[0] 4.228
 shouldNotRunExcludedClasses[0] 4.312
 shouldNotRunExcludedMethods[0] 7.192
 simpleNameTestWithJavaExtWildcardPkg[0] 5.109
 shouldMatchMultiplePatterns[0] 4.201
 shouldMatchExactClassAndMethodsPostfix[0] 4.987
 simpleNameTestWithWildcardPkg[0] 4.13
 shouldMatchWildcardPackageAndClassAndMethod[0] 3.69
 shouldMatchExactClassAndMultipleMethods[0] 3.924
 fullyQualifiedTest[0] 3.639
 matchSimpleClassAndMethodWithJavaExtWildcardPkg[0] 3.529
 negativeTest[0]
+ [ Detail ]
 0
got: <TEST>, expected: (is <INCLUDES> or is <INCLUDES_EXCLUDES> or is <INCLUDES_FILE> or is <INCLUDES_EXCLUDES_FILE>)
testRegexSuccessTwo[0] 3.566
 shouldMatchExactClassAndMethodsWildcard[0] 3.559
 shouldMatchMultiplePatternsComplex[0] 3.481
 simpleNameTestAsParallel[0] 3.857
 matchSimpleClassAndMethodWithWildcardPkg[0] 3.687
 shouldMatchMultiplePatternsAsParallel[0] 4.741
 shouldNotRunExcludedClassesIfIncluded[0] 5.223
 shouldMatchSimpleClassNameAndMethod[0] 4.763
 shouldMatchExactClassAndMethodPostfix[0] 4.133
 shouldMatchMultiplePatternsComplexAsParallel[0] 5.386
 matchSimpleClassAndMethodWithJavaExt[0] 5.225
 regexClassAndMethod[0] 4.779
 shouldNotRunExcludedClassesAndMethods[1]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodCharacters[1]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodWildcard[1]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
testSuccessTwo[1]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTest[1] 6.096
 simpleNameTestWithJavaExt[1] 5.358
 regexClass[1] 5.286
 shouldNotRunExcludedClasses[1] 5
 shouldNotRunExcludedMethods[1]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTestWithJavaExtWildcardPkg[1] 4.277
 shouldMatchMultiplePatterns[1]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsPostfix[1]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTestWithWildcardPkg[1] 5.6
 shouldMatchWildcardPackageAndClassAndMethod[1]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMultipleMethods[1]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
fullyQualifiedTest[1] 6.765
 matchSimpleClassAndMethodWithJavaExtWildcardPkg[1]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
negativeTest[1] 6.236
 testRegexSuccessTwo[1]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsWildcard[1]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplex[1]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTestAsParallel[1] 5.943
 matchSimpleClassAndMethodWithWildcardPkg[1]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsAsParallel[1]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
shouldNotRunExcludedClassesIfIncluded[1] 5.584
 shouldMatchSimpleClassNameAndMethod[1]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodPostfix[1]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplexAsParallel[1]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithJavaExt[1]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
regexClassAndMethod[1]
+ [ Detail ]
 0
got: <INCLUDES>, expected: is <TEST>
shouldNotRunExcludedClassesAndMethods[2]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodCharacters[2]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodWildcard[2]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
testSuccessTwo[2]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTest[2] 6.296
 simpleNameTestWithJavaExt[2] 4.3
 regexClass[2] 4.111
 shouldNotRunExcludedClasses[2] 4.917
 shouldNotRunExcludedMethods[2]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTestWithJavaExtWildcardPkg[2] 4.187
 shouldMatchMultiplePatterns[2]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsPostfix[2]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTestWithWildcardPkg[2] 5.748
 shouldMatchWildcardPackageAndClassAndMethod[2]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMultipleMethods[2]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
fullyQualifiedTest[2] 6.778
 matchSimpleClassAndMethodWithJavaExtWildcardPkg[2]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
negativeTest[2] 4.407
 testRegexSuccessTwo[2]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsWildcard[2]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplex[2]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTestAsParallel[2] 5.063
 matchSimpleClassAndMethodWithWildcardPkg[2]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsAsParallel[2]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldNotRunExcludedClassesIfIncluded[2] 4.164
 shouldMatchSimpleClassNameAndMethod[2]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodPostfix[2]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplexAsParallel[2]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithJavaExt[2]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
regexClassAndMethod[2]
+ [ Detail ]
 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>

TestMultipleMethodsIT

 testJunit48Provider4 4.169
 testJunit44 3.691
 testJunit48Provider47 5.942

TestNgGroupsIT

 testExclusion 5.621
 testGroupsAndExclusion 4.302
 groupsWithDash 4.262
 testOnlyGroups 4.691
 groupsBySimpleRegex 6.387

TestNgParallelWithAnnotationsIT

 testTestNgGroupThreadParallel 11.191

TestNgSuccessPercentageIT

 testPassesWhenFailuresLessThanSuccessPercentage 4.551

TestSingleMethodIT

 fullyQualifiedTestNg 4.98
 testJunit48Provider4 4.463
 testJunit44 4.218
 testJunit48parallel 4.9
 testJunit48Provider47 5.858
 fullyQualifiedJunit48Provider47 5.356
 fullyQualifiedJunit48Provider4 4.626
 testTestNg5149 4.78
 testTestNg 3.929

TimeoutForkedTestIT

 testTimeoutForked 13.874

TwoTestCasesIT

 testJunit4Suite 6.076
 testTestNGSuite 6.2
 testTwoTestCases 7.958
 testTwoTestCaseSuite 6.461

UmlautDirIT

 surefire1617WithColonInLocalRepo
+ [ Detail ]
 0
got: <false>, expected: is <true>
surefire1617WithColonInProjectDir
+ [ Detail ]
 0
got: <false>, expected: is <true>
testUmlautIsolatedClassLoader 7.184
 testUmlaut 4.863

UnicodeTestNamesIT

 checkFileNamesWithUnicode 5.232

UseIsolatedClassLoaderIT

 testUseSystemClassLoader 3.655

WorkingDirectoryIsInvalidPropertyIT

 testWorkingDirectory 3.755

WorkingDirectoryIT

 testWorkingDirectory 4.207
 testWorkingDirectoryChildOnlyNoFork 3.403
 testWorkingDirectoryNoFork 3.193
 testWorkingDirectoryChildOnly 4.882

WorkingDirectoryMissingIT

 testWorkingDirectory 5.278

XmlReporterRunTimeIT

 testForkAlways 23.205

Failure Details

[Summary] [Package List] [Test Cases]


 xXXtest501
skipped: 5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
 xXXtest50
skipped: 5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
 shouldLoadMultipleJavaModules_JavaHome
skipped: There's no JDK 9 provided.
 shouldLoadMultipleJavaModules_ToolchainsXML
skipped: There's no JDK 9 provided.
 shouldLoadMultipleJavaModules_JvmParameter
skipped: There's no JDK 9 provided.
 shouldRunInPluginJava9
skipped: There's no JDK 9 provided.
 testExecuteWithReuseForksFalseWithJavaModule
skipped: There's no JDK 9 provided.
 testExecuteWithReuseForksFalseWithJavaModuleWithFilter
skipped: There's no JDK 9 provided.
 testExecuteWithZeroForkCountWithJavaModule
skipped: There's no JDK 9 provided.
 shouldRunWithJupiterApi
skipped: There's no JDK 9 provided.
 test
skipped: There's no JDK 9 provided.
 test
skipped: There's no JDK 9 provided.
 test
skipped: There's no JDK 9 provided.
 verify
skipped: java.specification.version: 1.8
 shouldFailOnJDK
skipped: java.specification.version: 1.8
 twoSpecifiedTestExecutionsInCorrectExecutionBlocks
skipped: since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
 singleTestInOneExecutionOfMultiExecutionProject
skipped: since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
 testModulePathWithSpaces
skipped: There's no JDK 9 provided.
 testModulePath
skipped: There's no JDK 9 provided.
 warningIsNotEmittedWithJulToLog4j
skipped: https://issues.apache.org/jira/browse/SUREFIRE-1659?focusedCommentId=17374005&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-17374005
 testModulePathWithSpaces
skipped: There's no JDK 9 provided.
 testModulePath
skipped: There's no JDK 9 provided.
 test
skipped: There's no JDK 9 provided.
 negativeTest[0]
skipped: got: <TEST>, expected: (is <INCLUDES> or is <INCLUDES_EXCLUDES> or is <INCLUDES_FILE> or is <INCLUDES_EXCLUDES_FILE>)
 simpleNameTestAsParallel[0]
skipped: got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
 shouldMatchMultiplePatternsAsParallel[0]
skipped: got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
 shouldMatchMultiplePatternsComplexAsParallel[0]
skipped: got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
 negativeTest[1]
skipped: got: <TEST>, expected: (is <INCLUDES> or is <INCLUDES_EXCLUDES> or is <INCLUDES_FILE> or is <INCLUDES_EXCLUDES_FILE>)
 shouldNotRunExcludedClassesAndMethods[2]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMethodCharacters[2]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMethodWildcard[2]
skipped: got: <INCLUDES>, expected: is <TEST>
 testSuccessTwo[2]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldNotRunExcludedMethods[2]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchMultiplePatterns[2]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMethodsPostfix[2]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchWildcardPackageAndClassAndMethod[2]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMultipleMethods[2]
skipped: got: <INCLUDES>, expected: is <TEST>
 matchSimpleClassAndMethodWithJavaExtWildcardPkg[2]
skipped: got: <INCLUDES>, expected: is <TEST>
 testRegexSuccessTwo[2]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMethodsWildcard[2]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchMultiplePatternsComplex[2]
skipped: got: <INCLUDES>, expected: is <TEST>
 simpleNameTestAsParallel[2]
skipped: got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
 matchSimpleClassAndMethodWithWildcardPkg[2]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchMultiplePatternsAsParallel[2]
skipped: got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
 shouldMatchSimpleClassNameAndMethod[2]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMethodPostfix[2]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchMultiplePatternsComplexAsParallel[2]
skipped: got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
 matchSimpleClassAndMethodWithJavaExt[2]
skipped: got: <INCLUDES>, expected: is <TEST>
 regexClassAndMethod[2]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldNotRunExcludedClassesAndMethods[3]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMethodCharacters[3]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMethodWildcard[3]
skipped: got: <INCLUDES>, expected: is <TEST>
 testSuccessTwo[3]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldNotRunExcludedMethods[3]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchMultiplePatterns[3]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMethodsPostfix[3]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchWildcardPackageAndClassAndMethod[3]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMultipleMethods[3]
skipped: got: <INCLUDES>, expected: is <TEST>
 matchSimpleClassAndMethodWithJavaExtWildcardPkg[3]
skipped: got: <INCLUDES>, expected: is <TEST>
 testRegexSuccessTwo[3]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMethodsWildcard[3]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchMultiplePatternsComplex[3]
skipped: got: <INCLUDES>, expected: is <TEST>
 matchSimpleClassAndMethodWithWildcardPkg[3]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchMultiplePatternsAsParallel[3]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchSimpleClassNameAndMethod[3]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMethodPostfix[3]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchMultiplePatternsComplexAsParallel[3]
skipped: got: <INCLUDES>, expected: is <TEST>
 matchSimpleClassAndMethodWithJavaExt[3]
skipped: got: <INCLUDES>, expected: is <TEST>
 regexClassAndMethod[3]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldNotRunExcludedClassesAndMethods[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMethodCharacters[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMethodWildcard[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 testSuccessTwo[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldNotRunExcludedMethods[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchMultiplePatterns[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMethodsPostfix[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchWildcardPackageAndClassAndMethod[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMultipleMethods[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 matchSimpleClassAndMethodWithJavaExtWildcardPkg[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 testRegexSuccessTwo[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMethodsWildcard[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchMultiplePatternsComplex[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 simpleNameTestAsParallel[4]
skipped: got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
 matchSimpleClassAndMethodWithWildcardPkg[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchMultiplePatternsAsParallel[4]
skipped: got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
 shouldMatchSimpleClassNameAndMethod[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMethodPostfix[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchMultiplePatternsComplexAsParallel[4]
skipped: got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
 matchSimpleClassAndMethodWithJavaExt[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 regexClassAndMethod[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldNotRunExcludedClassesAndMethods[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMethodCharacters[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMethodWildcard[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 testSuccessTwo[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldNotRunExcludedMethods[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchMultiplePatterns[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMethodsPostfix[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchWildcardPackageAndClassAndMethod[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMultipleMethods[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 matchSimpleClassAndMethodWithJavaExtWildcardPkg[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 testRegexSuccessTwo[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMethodsWildcard[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchMultiplePatternsComplex[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 matchSimpleClassAndMethodWithWildcardPkg[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchMultiplePatternsAsParallel[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchSimpleClassNameAndMethod[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMethodPostfix[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchMultiplePatternsComplexAsParallel[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 matchSimpleClassAndMethodWithJavaExt[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 regexClassAndMethod[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 negativeTest[0]
skipped: got: <TEST>, expected: (is <INCLUDES> or is <INCLUDES_EXCLUDES> or is <INCLUDES_FILE> or is <INCLUDES_EXCLUDES_FILE>)
 shouldNotRunExcludedClassesAndMethods[1]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMethodCharacters[1]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMethodWildcard[1]
skipped: got: <INCLUDES>, expected: is <TEST>
 testSuccessTwo[1]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldNotRunExcludedMethods[1]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchMultiplePatterns[1]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMethodsPostfix[1]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchWildcardPackageAndClassAndMethod[1]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMultipleMethods[1]
skipped: got: <INCLUDES>, expected: is <TEST>
 matchSimpleClassAndMethodWithJavaExtWildcardPkg[1]
skipped: got: <INCLUDES>, expected: is <TEST>
 testRegexSuccessTwo[1]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMethodsWildcard[1]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchMultiplePatternsComplex[1]
skipped: got: <INCLUDES>, expected: is <TEST>
 matchSimpleClassAndMethodWithWildcardPkg[1]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchMultiplePatternsAsParallel[1]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchSimpleClassNameAndMethod[1]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMethodPostfix[1]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldMatchMultiplePatternsComplexAsParallel[1]
skipped: got: <INCLUDES>, expected: is <TEST>
 matchSimpleClassAndMethodWithJavaExt[1]
skipped: got: <INCLUDES>, expected: is <TEST>
 regexClassAndMethod[1]
skipped: got: <INCLUDES>, expected: is <TEST>
 shouldNotRunExcludedClassesAndMethods[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMethodCharacters[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMethodWildcard[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 testSuccessTwo[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldNotRunExcludedMethods[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchMultiplePatterns[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMethodsPostfix[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchWildcardPackageAndClassAndMethod[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMultipleMethods[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 matchSimpleClassAndMethodWithJavaExtWildcardPkg[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 testRegexSuccessTwo[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMethodsWildcard[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchMultiplePatternsComplex[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 matchSimpleClassAndMethodWithWildcardPkg[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchMultiplePatternsAsParallel[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchSimpleClassNameAndMethod[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchExactClassAndMethodPostfix[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 shouldMatchMultiplePatternsComplexAsParallel[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 matchSimpleClassAndMethodWithJavaExt[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 regexClassAndMethod[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
 surefire1617WithColonInLocalRepo
skipped: got: <false>, expected: is <true>
 surefire1617WithColonInProjectDir
skipped: got: <false>, expected: is <true>