Fork me on GitHub

Failsafe Report

Summary

[Summary] [Package List] [Test Cases]


Tests Errors Failures Skipped Success Rate Time
783 0 0 147 81.226% 5,003.214

Note: failures are anticipated and checked for with assertions while errors are unanticipated.


Package List

[Summary] [Package List] [Test Cases]


Package Tests Errors Failures Skipped Success Rate Time
org.apache.maven.surefire.its 601 0 0 135 77.537% 3,607.928
org.apache.maven.surefire.its.jiras 182 0 0 12 93.407% 1,395.287

Note: package statistics are not computed recursively, they only sum up all of its testsuites numbers.

org.apache.maven.surefire.its

Class Tests Errors Failures Skipped Success Rate Time
AbstractTestCaseIT 1 0 0 0 100% 10.681
AdditionalClasspathIT 1 0 0 0 100% 5.637
AggregateReportIT 1 0 0 0 100% 6.834
ArgLineIT 1 0 0 0 100% 6.695
ArgLinePropertiesIT 1 0 0 0 100% 7.994
AssumptionFailureReportIT 1 0 0 0 100% 5.613
CheckSingleTestIT 4 0 0 0 100% 19.193
CheckTestFailIfNoTestsForkModeIT 6 0 0 0 100% 30.968
CheckTestFailIfNoTestsIT 3 0 0 0 100% 11.541
CheckTestNgBeforeMethodFailureIT 1 0 0 0 100% 8.133
CheckTestNgBeforeMethodIT 1 0 0 0 100% 6.609
CheckTestNgCustomObjectFactoryIT 1 0 0 0 100% 5.5
CheckTestNgCustomTestRunnerFactoryIT 1 0 0 0 100% 5.486
CheckTestNgExecuteErrorIT 1 0 0 0 100% 6.615
CheckTestNgGroupThreadParallelIT 1 0 0 0 100% 5.828
CheckTestNgJdk14IT 1 0 0 0 100% 8.185
CheckTestNgListenerReporterIT 8 0 0 0 100% 63.187
CheckTestNgListenersIT 1 0 0 0 100% 7.157
CheckTestNgPathWithSpacesIT 1 0 0 0 100% 6.817
CheckTestNgReportTestIT 3 0 0 0 100% 21.177
CheckTestNgSuiteXmlIT 3 0 0 0 100% 21.587
CheckTestNgSuiteXmlSingleIT 1 0 0 0 100% 6.943
CheckTestNgVersionsIT 20 0 0 2 90% 143.101
ClasspathFilteringIT 1 0 0 0 100% 6.615
ClassPathOrderIT 1 0 0 0 100% 5.797
ClasspathScopeFilteringIT 1 0 0 0 100% 5.281
ConsoleOutputIT 4 0 0 0 100% 37.4
CrashDetectionIT 3 0 0 0 100% 20.425
DefaultConfigurationIT 1 0 0 0 100% 5.817
EnvironmentVariableIT 1 0 0 0 100% 6.72
EnvironmentVariablesIT 2 0 0 0 100% 13.344
FailFastJUnitIT 12 0 0 0 100% 259.154
FailFastTestNgIT 6 0 0 0 100% 128.758
ForkConsoleOutputIT 4 0 0 0 100% 26.633
ForkConsoleOutputWithErrorsIT 1 0 0 0 100% 15.35
ForkModeIT 12 0 0 0 100% 150.124
ForkModeMultiModuleIT 4 0 0 0 100% 48.156
ForkModeTestNGIT 12 0 0 0 100% 117.29
IncludesExcludesFromFileIT 6 0 0 0 100% 36.466
IncludesExcludesIT 3 0 0 0 100% 19.343
Java9FullApiIT 3 0 0 3 0% 0.004
JUnit44HamcrestIT 1 0 0 0 100% 6.631
JUnit47ConcurrencyIT 1 0 0 0 100% 6.358
JUnit47ParallelIT 59 0 0 0 100% 433.835
JUnit47ParallelNotThreadSafeIT 1 0 0 0 100% 5.689
JUnit47RedirectOutputIT 2 0 0 0 100% 14.326
JUnit47RerunFailingTestWithCucumberIT 3 0 0 0 100% 21.288
JUnit47StaticInnerClassTestsIT 1 0 0 0 100% 5.523
JUnit47WithCucumberIT 2 0 0 0 100% 13.798
JUnit48TestCategoriesIT 8 0 0 0 100% 66.334
JUnit4ForkAlwaysStaticInitPollutionIT 1 0 0 0 100% 8.78
JUnit4IgnoreIT 2 0 0 0 100% 13.161
JUnit4RerunFailingTestsIT 5 0 0 0 100% 139.937
JUnit4RunListenerIT 2 0 0 0 100% 13.651
JUnit4VersionsIT 16 0 0 0 100% 115.848
JUnitDepIT 4 0 0 0 100% 30.685
JUnitPlatformEnginesIT 10 0 0 0 100% 49.463
JUnitPlatformIT 5 0 0 0 100% 41.164
JUnitPlatformStreamCorruptionIT 1 0 0 0 100% 8.531
LongWindowsPathIT 1 0 0 0 100% 7.108
ModulePathIT 2 0 0 2 0% 0
NoRunnableTestsInClassIT 1 0 0 0 100% 7.418
PlainOldJavaClasspathIT 1 0 0 0 100% 6.743
PlexusConflictIT 2 0 0 0 100% 13.888
PojoSimpleIT 1 0 0 0 100% 6.301
ReportersIT 1 0 0 0 100% 7.4
ResultCountingIT 3 0 0 0 100% 22.847
RunOrderIT 4 0 0 0 100% 23.709
RunOrderParallelForksIT 4 0 0 0 100% 25.156
SiblingAggregatorIT 1 0 0 0 100% 6.453
SmartStackTraceIT 1 0 0 0 100% 6.783
Surefire1602IT 1 0 0 0 100% 15.134
SystemPropertiesTestIT 2 0 0 0 100% 13.761
TestMethodPatternIT 7 0 0 0 100% 48.137
TestMultipleMethodPatternsIT 180 0 0 87 51.667% 536.416
TestMultipleMethodPatternsTestNGIT 90 0 0 41 54.444% 283.801
TestMultipleMethodsIT 3 0 0 0 100% 19.191
TestNgGroupsIT 5 0 0 0 100% 38.075
TestNgParallelWithAnnotationsIT 1 0 0 0 100% 7.798
TestNgSuccessPercentageIT 1 0 0 0 100% 5.652
TestSingleMethodIT 9 0 0 0 100% 60.914
TimeoutForkedTestIT 1 0 0 0 100% 6.99
TwoTestCasesIT 4 0 0 0 100% 27.044
UmlautDirIT 2 0 0 0 100% 14.395
UnicodeTestNamesIT 1 0 0 0 100% 9.264
UseIsolatedClassLoaderIT 1 0 0 0 100% 6.513
WorkingDirectoryIsInvalidPropertyIT 1 0 0 0 100% 4.842
WorkingDirectoryIT 4 0 0 0 100% 24.298
WorkingDirectoryMissingIT 1 0 0 0 100% 6.089
XmlReporterRunTimeIT 1 0 0 0 100% 26.649

org.apache.maven.surefire.its.jiras

Class Tests Errors Failures Skipped Success Rate Time
Surefire1024VerifyFailsafeIfTestedIT 1 0 0 0 100% 6.453
Surefire1028UnableToRunSingleIT 1 0 0 0 100% 5.308
Surefire1036NonFilterableJUnitRunnerWithCategoriesIT 1 0 0 0 100% 7.363
Surefire1041FailingJUnitRunnerIT 1 0 0 0 100% 7.121
Surefire1053SystemPropertiesIT 2 0 0 0 100% 12.917
Surefire1055CorrectConcurrentTestCountIT 1 0 0 0 100% 6.916
Surefire1080ParallelForkDoubleTestIT 1 0 0 0 100% 7.104
Surefire1082ParallelJUnitParameterizedIT 3 0 0 0 100% 24.59
Surefire1098BalancedRunOrderIT 1 0 0 0 100% 29.837
Surefire1122ParallelAndFlakyTestsIT 3 0 0 0 100% 19.078
Surefire1135ImproveIgnoreMessageForTestNGIT 2 0 0 0 100% 17.113
Surefire1136CwdPropagationInForkedModeIT 1 0 0 0 100% 6.936
Surefire1144XmlRunTimeIT 1 0 0 0 100% 7.222
Surefire1152RerunFailingTestsInSuiteIT 2 0 0 0 100% 14.159
Surefire1153IncludesAndSpecifiedTestIT 2 0 0 0 100% 10.814
Surefire1158RemoveInfoLinesIT 6 0 0 0 100% 44.01
Surefire1177TestngParallelSuitesIT 2 0 0 0 100% 18.09
Surefire1179IT 1 0 0 0 100% 11.33
Surefire1185DoNotSpawnTestsIT 1 0 0 0 100% 5.542
Surefire1202RerunAndSkipIT 2 0 0 0 100% 39.498
Surefire1209RerunAndForkCountIT 4 0 0 0 100% 60.657
Surefire1211JUnitTestNgIT 2 0 0 0 100% 16.38
Surefire1264IT 2 0 0 0 100% 16.6
Surefire1265Java9IT 1 0 0 1 0% 0
Surefire1278GroupNameEndingIT 1 0 0 0 100% 7.476
Surefire1295AttributeJvmCrashesToTestsIT 9 0 0 9 0% 0
Surefire1364SystemPropertiesIT 10 0 0 0 100% 72.8
Surefire1367AssumptionLogsIT 4 0 0 0 100% 25.739
Surefire1383ScanSessionDependenciesIT 1 0 0 0 100% 13.216
Surefire1396CustomProviderClassPathIT 1 0 0 0 100% 14.79
Surefire141PluggableProvidersIT 4 0 0 0 100% 35.719
Surefire146ForkPerTestNoSetupIT 1 0 0 0 100% 6.957
Surefire1490ReportTitleDescriptionIT 2 0 0 0 100% 31.149
Surefire1535TestNGParallelSuitesIT 4 0 0 0 100% 34.956
Surefire162CharsetProviderIT 1 0 0 0 100% 6.689
Surefire224WellFormedXmlFailuresIT 1 0 0 0 100% 6.391
Surefire257NotRerunningTestsIT 1 0 0 0 100% 9.185
Surefire260TestWithIdenticalNamesIT 1 0 0 0 100% 15.76
Surefire34SecurityManagerIT 2 0 0 0 100% 13.637
Surefire376TestNgAfterSuiteFailureIT 1 0 0 0 100% 7.056
Surefire377TestNgAndJUnitTogetherIT 2 0 0 0 100% 13.278
Surefire408ManualProviderSelectionIT 1 0 0 0 100% 6.457
Surefire42NotExtendingTestCaseIT 1 0 0 0 100% 6.436
Surefire44InnerClassTestIT 1 0 0 0 100% 6.64
Surefire500PuzzlingErrorIT 1 0 0 0 100% 6.972
Surefire510TestClassPathForkModesIT 2 0 0 0 100% 13.121
Surefire569RunTestFromDependencyJarsIT 1 0 0 0 100% 6.157
Surefire570MultipleReportDirectoriesIT 2 0 0 0 100% 34.756
Surefire613TestCountInParallelIT 1 0 0 0 100% 7.107
Surefire621TestCountingJunit3InParallelIT 5 0 0 0 100% 36.986
Surefire628ConsoleOutputBeforeAndAfterClassIT 1 0 0 0 100% 6.573
Surefire634UnsettableSystemPropertiesWarningIT 1 0 0 0 100% 6.06
Surefire649EmptyStringSystemPropertiesIT 2 0 0 0 100% 11.107
Surefire673MockitoIT 1 0 0 0 100% 8.309
Surefire674BuildFailingWhenErrorsIT 1 0 0 0 100% 6.758
Surefire674BuildFailingWhenFailsafeErrorsIT 1 0 0 0 100% 9.53
Surefire685CommaSeparatedIncludesIT 1 0 0 0 100% 7.062
Surefire697NiceSummaryIT 1 0 0 0 100% 6.344
Surefire705ParallelForkTimeoutIT 1 0 0 0 100% 8.884
Surefire733AllOverrridesCapturedIT 1 0 0 0 100% 6.421
Surefire735ForkFailWithRedirectConsoleOutputIT 2 0 0 0 100% 11.768
Surefire740TruncatedCommaIT 1 0 0 0 100% 6.87
Surefire747MethodParallelWithSuiteCountIT 2 0 0 0 100% 24.565
Surefire772BothReportsIT 3 0 0 0 100% 12.851
Surefire772NoFailsafeReportsIT 4 0 0 0 100% 18.265
Surefire772NoSurefireReportsIT 4 0 0 0 100% 16.884
Surefire772SpecifiedReportsIT 3 0 0 0 100% 12.428
Surefire801ForkModeNoneClassLoaderIT 1 0 0 0 100% 5.78
Surefire803MultiFailsafeExecsIT 2 0 0 0 100% 24.012
Surefire806SpecifiedTestControlsIT 3 0 0 2 33.333% 6.701
Surefire809GroupExpressionsIT 6 0 0 0 100% 41.711
Surefire812Log4JClassLoaderIT 1 0 0 0 100% 8.187
Surefire817SystemExitIT 1 0 0 0 100% 6.88
Surefire818NpeIgnoresTestsIT 1 0 0 0 100% 8.295
Surefire828EmptyGroupExprIT 4 0 0 0 100% 30.134
Surefire832ProviderSelectionIT 1 0 0 0 100% 6.815
Surefire839TestWithoutCategoriesIT 2 0 0 0 100% 14.661
Surefire847AdditionalFailureIT 1 0 0 0 100% 8.204
Surefire855AllowFailsafeUseArtifactFileIT 4 0 0 0 100% 54.602
Surefire901MIssingResultfileWhenNoTestsIT 1 0 0 0 100% 5.221
Surefire907PerThreadWithoutThreadCountIT 1 0 0 0 100% 4.482
Surefire920TestFailureIgnoreWithTimeoutIT 2 0 0 0 100% 16.703
Surefire926FailureWith2ProvidersIT 1 0 0 0 100% 9.526
Surefire930TestNgSuiteXmlIT 1 0 0 0 100% 7.962
Surefire943ReportContentIT 2 0 0 0 100% 30.254
Surefire946KillMainProcessInReusableForkIT 3 0 0 0 100% 26.177
Surefire972BizarreNoClassDefIT 1 0 0 0 100% 10.213
Surefire975DefaultVMEncodingIT 1 0 0 0 100% 6.955
Surefire979WrongClassLoaderIT 1 0 0 0 100% 7.06
Surefire985ParameterizedRunnerAndCategoriesIT 1 0 0 0 100% 5.355
Surefire995CategoryInheritanceIT 5 0 0 0 100% 34.25

Test Cases

[Summary] [Package List] [Test Cases]

AbstractTestCaseIT

abstractTestCase 10.677

AdditionalClasspathIT

additionalClasspath 5.637

AggregateReportIT

aggregateReport 6.834

ArgLineIT

argLine 6.694

ArgLinePropertiesIT

argLine 7.994

AssumptionFailureReportIT

testWriteSkippedMessageToReport 5.612

CheckSingleTestIT

singleTestDotJava 4.836
singleTestNonExistentOverride 5.326
singleTestNonExistent 4.183
singleTest 4.848

CheckTestFailIfNoTestsForkModeIT

dontFailIfNoTestsForkModeAlways 4.703
failIfNoTestsForkModeOnce 5.18
dontFailIfNoTestsForkModeNever 4.865
dontFailIfNoTestsForkModeOnce 5.165
failIfNoTestsForkModeNever 5.792
failIfNoTestsForkModeAlways 5.261

CheckTestFailIfNoTestsIT

failIfNoTests 3.909
dontFailIfNoTests 3.719
jUnit48CategoriesFailWhenNoTests 3.913

CheckTestNgBeforeMethodFailureIT

TestNgBeforeMethodFailure 8.133

CheckTestNgBeforeMethodIT

TestNgBeforeMethod 6.609

CheckTestNgCustomObjectFactoryIT

testTestNgListenerReporter 5.499

CheckTestNgCustomTestRunnerFactoryIT

testTestNgListenerReporter 5.486

CheckTestNgExecuteErrorIT

executionError 6.615

CheckTestNgGroupThreadParallelIT

TestNgGroupThreadParallel 5.828

CheckTestNgJdk14IT

TestNgJdk14 8.183

CheckTestNgListenerReporterIT

testNgListenerReporter[0: TestNG 5.6] 7.834
testNgListenerReporter[1: TestNG 5.7] 7.174
testNgListenerReporter[2: TestNG 5.10] 6.497
testNgListenerReporter[3: TestNG 5.13] 8.935
testNgListenerReporter[4: TestNG 5.14.6] 7.868
testNgListenerReporter[5: TestNG 5.14.9] 8.123
testNgListenerReporter[6: TestNG 6.0] 8.017
testNgListenerReporter[7: TestNG 6.9.9] 8.738

CheckTestNgListenersIT

TestNgListenerReporter 7.157

CheckTestNgPathWithSpacesIT

TestWithSpaces 6.817

CheckTestNgReportTestIT

testNgReport 7.914
shouldNotBeVerbose 6.607
shouldBeVerbose 6.656

CheckTestNgSuiteXmlIT

suiteXml 6.766
suiteXmlForkCountTwoReuse 6.781
suiteXmlForkModeAlways 8.039

CheckTestNgSuiteXmlSingleIT

TestNgSuite 6.943

CheckTestNgVersionsIT

XXXtest50 0
5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
test502 7.992
test510 7.164
test511 8.33
test512 8.287
test513 7.583
test514 8.681
test685 8.27
test5131 8.556
test5141 8.731
test5142 8.84
test47 7.648
test51 8.015
test55 8.139
test56 6.488
test57 7.197
test58 8.304
test59 8.004
test60 6.871
XXXtest501 0
5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024

ClasspathFilteringIT

additionalClasspath 6.615

ClassPathOrderIT

classPathOrder 5.796

ClasspathScopeFilteringIT

additionalClasspath 5.279

ConsoleOutputIT

properNewlinesAndEncodingWithDifferentEncoding 6.995
properNewlinesAndEncodingWithDefaultEncodings 8.254
largerSoutThanMemory 16.488
properNewlinesAndEncodingWithoutFork 5.661

CrashDetectionIT

hardCrashInReusableFork 7.634
crashInReusableFork 6.727
crashInFork 6.064

DefaultConfigurationIT

defaultConfiguration 5.817

EnvironmentVariableIT

environmentVariable 6.719

EnvironmentVariablesIT

testWhenUseSystemClassLoader 6.925
testWhenDontUseSystemClassLoader 6.417

FailFastJUnitIT

test[junit4-oneFork-ff1] 10.385
test[junit47-oneFork-ff1] 10.409
test[junit4-oneFork-ff2] 19.837
test[junit47-oneFork-ff2] 20.169
test[junit4-twoForks-ff1] 16.191
test[junit47-twoForks-ff1] 15.994
test[junit4-twoForks-ff2] 20.236
test[junit47-twoForks-ff2] 20.277
test[junit4-oneFork-ff3] 37.525
test[junit47-oneFork-ff3] 37.775
test[junit4-twoForks-ff3] 25.305
test[junit47-twoForks-ff3] 25.049

FailFastTestNgIT

test[testng-oneFork-ff1] 10.322
test[testng-oneFork-ff2] 19.799
test[testng-twoForks-ff1] 15.606
test[testng-twoForks-ff2] 20.149
test[testng-oneFork-ff3] 37.704
test[testng-twoForks-ff3] 25.176

ForkConsoleOutputIT

printSummaryTrueWithRedirect 6.338
printSummaryFalseWithoutRedirect 6.766
printSummaryTrueWithoutRedirect 6.682
printSummaryFalseWithRedirect 6.847

ForkConsoleOutputWithErrorsIT

xmlFileContainsConsoleOutput 6.148

ForkModeIT

testForkModeOncePerThreadSingleThread 10.158
testForkModePerTest 10.827
testForkCountZero 7.69
testForkCountOneNoReuse 10.878
testForkCountTwoNoReuse 21.894
testForkModeNever 7.994
testForkCountTwoReuse 21.342
testForkCountOneReuse 8.789
testForkModeOncePerThreadTwoThreads 21.626
testForkModeAlways 11.169
testForkModeNone 7.874
testForkModeOnce 9.88

ForkModeMultiModuleIT

testForkCountOneNoReuse 12.25
testForkCountTwoNoReuse 9.657
testForkCountTwoReuse 9.4
testForkCountOneReuse 9.91

ForkModeTestNGIT

testForkModeOncePerThreadSingleThread 7.443
testForkModePerTest 10.452
testForkCountZero 6.538
testForkCountOneNoReuse 10.613
testForkCountTwoNoReuse 14.116
testForkModeNever 6.405
testForkCountTwoReuse 14.592
testForkCountOneReuse 7.76
testForkModeOncePerThreadTwoThreads 14.257
testForkModeAlways 10.441
testForkModeNone 6.746
testForkModeOnce 7.925

IncludesExcludesFromFileIT

testSimpleMixed 6.578
testMissingExcludes 4.966
testRegex 6.435
testPath 6.493
testMissingIncludes 5.51
testSimple 6.483

IncludesExcludesIT

testPathBasedIncludesExcludes 6.274
testIncludesExcludes 6.84
testRegexIncludesExcludes 6.229

Surefire1024VerifyFailsafeIfTestedIT

shouldScanAndRunTestsInDependencyJars 6.453

Surefire1028UnableToRunSingleIT

methodFilteringParallelExecution 5.308

Surefire1036NonFilterableJUnitRunnerWithCategoriesIT

test 7.363

Surefire1041FailingJUnitRunnerIT

reportErrorInJUnitRunnerAsTestError 7.121

Surefire1053SystemPropertiesIT

checkWarningsSysPropTwice 6.4
checkWarningsFileEncoding 6.517

Surefire1055CorrectConcurrentTestCountIT

testTestNgAndJUnitTogether 6.916

Surefire1080ParallelForkDoubleTestIT

test 7.103

Surefire1082ParallelJUnitParameterizedIT

checkClassesRunParallel 7.264
shouldRunTwo 8.791
checkOutFileClassesRunParallel 8.535

Surefire1098BalancedRunOrderIT

reorderedParallelClasses 29.837

Surefire1122ParallelAndFlakyTestsIT

parallelCreatesCorrectReportFork 6.692
nonParallelCreatesCorrectReport 6.649
parallelCreatesCorrectReport 5.736

Surefire1135ImproveIgnoreMessageForTestNGIT

testNgReport57 8.305
testNgReport688 8.808

Surefire1136CwdPropagationInForkedModeIT

testTestNgAndJUnitTogether 6.936

Surefire1144XmlRunTimeIT

testXmlRunTime 7.221

Surefire1152RerunFailingTestsInSuiteIT

testJUnit48Provider47 6.641
testJUnit48Provider4 7.518

Surefire1153IncludesAndSpecifiedTestIT

testSpecifiedTestInIncludes 5.128
testSpecifiedTestNotInIncludes 5.685

Surefire1158RemoveInfoLinesIT

shouldRunWithCliOption[junit-option-ff] 7.263
shouldRunWithCliOption[testng-option-ff] 7.604
shouldRunWithCliOption[junit-option-X] 7.006
shouldRunWithCliOption[testng-option-X] 7.772
shouldRunWithCliOption[junit-option-e] 7.142
shouldRunWithCliOption[testng-option-e] 7.223

Surefire1177TestngParallelSuitesIT

twoSuitesInParallelForked 9.438
twoSuitesInParallel 8.652

Surefire1179IT

suiteXmlForkCountTwoReuse 11.33

Surefire1185DoNotSpawnTestsIT

doNotSpawnUnwantedTests 5.54

Surefire1202RerunAndSkipIT

junit47 19.879
junit4 19.619

Surefire1209RerunAndForkCountIT

notReusableForksJUnit47 15.75
reusableForksJUnit47 14.949
reusableForksJUnit4 14.175
notReusableForksJUnit4 15.783

Surefire1211JUnitTestNgIT

withoutJUnit 8.747
withJUnit 7.633

Surefire1264IT

positiveTests 8.417
negativeTests 8.182

Surefire1265Java9IT

shouldRunInPluginJava9 0
There's no JDK 9 provided.

Surefire1278GroupNameEndingIT

testOnlyGroups 7.475

Surefire1295AttributeJvmCrashesToTestsIT

test[0] 0
got: <false>, expected: is <true>
test[1] 0
got: <false>, expected: is <true>
test[2] 0
got: <false>, expected: is <true>
test[3] 0
got: <false>, expected: is <true>
test[4] 0
got: <false>, expected: is <true>
test[5] 0
got: <false>, expected: is <true>
test[6] 0
got: <false>, expected: is <true>
test[7] 0
got: <false>, expected: is <true>
test[8] 0
got: <false>, expected: is <true>

Surefire1364SystemPropertiesIT

junit47InProcessParallel 7.493
junit47Forked 6.304
junit47InProcess 7.055
testNg 9.248
junit3Forked 6.83
junit47ForkedParallel 7.713
junit4Forked 7.112
testNgInProcess 7.554
junit4InProcess 7.092
junit3InProcess 6.399

Surefire1367AssumptionLogsIT

shouldSeeLogsInPlugin 5.726
shouldSeeLogsParallelInPlugin 5.839
shouldSeeLogsParallelForked 7.244
shouldSeeLogsForked 6.93

Surefire1383ScanSessionDependenciesIT

test 7.521

Surefire1396CustomProviderClassPathIT

pluggableProviderClasspathCorrect 9.331

Surefire141PluggableProvidersIT

pluggableProviderPresent 8.626
invokeRuntimeException 8.742
invokeReporterException 8.49
constructorRuntimeException 9.861

Surefire146ForkPerTestNoSetupIT

testForkPerTestNoSetup 6.957

Surefire1490ReportTitleDescriptionIT

shouldHaveCustomizedReportTitleAndDescription 17.962
shouldHaveDefaultReportTitleAndDescription 13.187

Surefire1535TestNGParallelSuitesIT

forks0 9.477
forks2 8.82
forks0Redirected 8.405
forks2Redirected 8.254

Surefire162CharsetProviderIT

testCharsetProvider 6.689

Surefire224WellFormedXmlFailuresIT

testWellFormedXmlFailures 6.391

Surefire257NotRerunningTestsIT

shouldNotRerun 9.185

Surefire260TestWithIdenticalNamesIT

testWithIdenticalNames 15.76

Surefire34SecurityManagerIT

testSecurityManager 7.158
testSecurityManagerSuccessful 6.479

Surefire376TestNgAfterSuiteFailureIT

testAfterSuiteFailure 7.056

Surefire377TestNgAndJUnitTogetherIT

testTestNgAndJUnit4Together 6.094
testTestNgAndJUnitTogether 7.184

Surefire408ManualProviderSelectionIT

testParallelBuildResultCount 6.457

Surefire42NotExtendingTestCaseIT

testInnerClass 6.436

Surefire44InnerClassTestIT

testInnerClass 6.639

Surefire500PuzzlingErrorIT

testBuildFailingWhenErrors 6.972

Surefire510TestClassPathForkModesIT

testForkOnce 6.214
testForkAlways 6.907

Surefire569RunTestFromDependencyJarsIT

shouldScanAndRunTestsInDependencyJars 6.157

Surefire570MultipleReportDirectoriesIT

testReportWithAggregate 17.591
testReportWithoutAggregate 17.165

Surefire613TestCountInParallelIT

testParallelBuildResultCount 7.094

Surefire621TestCountingJunit3InParallelIT

testJunit3ParallelBuildResultCount 7.651
testJunit3ParallelSuiteBuildResultCount 7.368
testJunit3AllParallelBuildResultCount 7.084
testJunit3BuildResultCount 7.584
testJunit3SuiteBuildResultCount 7.299

Surefire628ConsoleOutputBeforeAndAfterClassIT

testJunit3ParallelBuildResultCount 6.573

Surefire634UnsettableSystemPropertiesWarningIT

testJunit3ParallelBuildResultCount 6.06

Surefire649EmptyStringSystemPropertiesIT

systemPropertyVariables 5.615
systemProperties 5.492

Surefire673MockitoIT

testBuildFailingWhenErrors 8.309

Surefire674BuildFailingWhenErrorsIT

testBuildFailingWhenErrors 6.757

Surefire674BuildFailingWhenFailsafeErrorsIT

testBuildFailingWhenErrors 9.529

Surefire685CommaSeparatedIncludesIT

testBuildFailingWhenErrors 7.061

Surefire697NiceSummaryIT

testBuildFailingWhenErrors 6.344

Surefire705ParallelForkTimeoutIT

testTimeoutForked 8.884

Surefire733AllOverrridesCapturedIT

testLogOutput 6.42

Surefire735ForkFailWithRedirectConsoleOutputIT

vmStartFail 5.685
vmStartFailShouldFailBuildk 6.083

Surefire740TruncatedCommaIT

testRussianLocaleReport 6.87

Surefire747MethodParallelWithSuiteCountIT

testMethodsParallelWithSuite 10.9
testClassesParallelWithSuite 13.665

Surefire772BothReportsIT

testSkippedSurefireReportGeneration 4.192
testSkippedFailsafeReportGeneration 4.698
testReportGeneration 3.96

Surefire772NoFailsafeReportsIT

testSkippedFailsafeReportGeneration 4.26
testForcedFailsafeReportGeneration 4.682
testSkipForcedFailsafeReportGeneration 4.234
testReportGeneration 5.089

Surefire772NoSurefireReportsIT

testOptionalSurefireReportGeneration 4.226
testSkippedSurefireReportGeneration 4.276
testSkipOptionalSurefireReportGeneration 4.22
testReportGeneration 4.16

Surefire772SpecifiedReportsIT

testSkippedSurefireReportGeneration 4.434
testSkippedFailsafeReportGeneration 3.788
testReportGeneration 4.206

Surefire801ForkModeNoneClassLoaderIT

testSHouldBeOkWithForkNever 5.78

Surefire803MultiFailsafeExecsIT

testOneExecutionRunInTwoBuilds 15.309
testSecondExecutionRunsAfterFirstExecutionFails 8.701

Surefire806SpecifiedTestControlsIT

singleTestInSingleExecutionProject 6.701
twoSpecifiedTestExecutionsInCorrectExecutionBlocks 0
since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
singleTestInOneExecutionOfMultiExecutionProject 0
since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution

Surefire809GroupExpressionsIT

testNGRunCategoryAB 7.413
testExcludedGroups 7.126
testJUnitRunCategoryNotC 7.348
incorrectJUnitVersions 4.663
categoryAB 7.028
testNGRunCategoryNotC 8.131

Surefire812Log4JClassLoaderIT

testJunit3ParallelBuildResultCount 8.187

Surefire817SystemExitIT

systemExit1 6.88

Surefire818NpeIgnoresTestsIT

testBuildFailingWhenErrors 8.295

Surefire828EmptyGroupExprIT

testJUnitRunEmptyExcludeGroups 8.45
testJUnitRunEmptyGroups 7.332
testTestNGRunEmptyExcludeGroups 7.186
testTestNGRunEmptyGroups 7.166

Surefire832ProviderSelectionIT

testJUnitRunCategoryAB 6.814

Surefire839TestWithoutCategoriesIT

classWithoutCategoryForked 7.477
classWithoutCategory 7.184

Surefire847AdditionalFailureIT

testJUnitRunCategoryAB 8.204

Surefire855AllowFailsafeUseArtifactFileIT

jarNotForkingShouldUseFile 12.845
jarShouldUseFile 11.141
warShouldUseClasses 13.691
osgiBundleShouldUseFile 16.924

Surefire901MIssingResultfileWhenNoTestsIT

failsafeWithNoTests 5.221

Surefire907PerThreadWithoutThreadCountIT

categoryAB 4.482

Surefire920TestFailureIgnoreWithTimeoutIT

timeoutInForkWithBuildFail 7.711
timeoutInForkWithNoBuildFail 8.992

Surefire926FailureWith2ProvidersIT

testBuildFailingWhenErrors 9.526

Surefire930TestNgSuiteXmlIT

suiteXmlRun 7.961

Surefire943ReportContentIT

test_noParallel 13.127
test_parallelBoth 7.743

Surefire946KillMainProcessInReusableForkIT

testExit 8.5
testHalt 8.602
testInterrupt 9.074

Surefire972BizarreNoClassDefIT

testJunit3ParallelBuildResultCount 10.213

Surefire975DefaultVMEncodingIT

runWithRussian1251 6.955

Surefire979WrongClassLoaderIT

wrongClassloaderUSedInSmartStacktraceparser 7.06

Surefire985ParameterizedRunnerAndCategoriesIT

test 5.355

Surefire995CategoryInheritanceIT

junit411ShouldRunExplicitCategory 8.876
junit411ShouldExcludeExplicitCategory 5.481
junit412ShouldExcludeInheritedCategory 6.355
junit412ShouldRunInheritedCategory 7.544
negativeTestShouldRunAllCategories 5.992

JUnit44HamcrestIT

testJUnit44Hamcrest 6.628

JUnit47ConcurrencyIT

test47 6.357

JUnit47ParallelIT

unknownThreadCountClasses 4.592
threadCountSuites 9.506
unlimitedThreadsSuitesAndMethods1 6.75
unlimitedThreadsSuitesAndMethods2 6.655
unknownThreadCountMethods 5.022
threadCountClassesAndMethods 6.709
reusableThreadCountClassesAndMethodsOptimized 7.562
unknownThreadCountSuites 5.072
reusableThreadCountAll 6.756
forcedShutdown 8.309
unknownThreadCountAll 4.895
serial 12.908
reusableThreadCountAllOptimized 6.821
suites 9.315
unlimitedThreadsMethods1 8.197
unlimitedThreadsMethods2 8.383
unlimitedThreadsSuitesAndClasses1 6.698
unlimitedThreadsSuitesAndClasses2 6.988
threadCountAllOptimized 7.833
threadCountAll 6.992
everyThreadCountSuitesAndClasses 6.38
unknownThreadCountBoth 4.768
threadCountSuitesAndClassesOptimized 6.772
classesAndMethods 6.311
everyThreadCountSuitesAndMethods 7.029
unknownThreadCountSuitesAndClasses 5.006
reusableThreadCountSuitesAndClassesOptimized 7.954
unknownThreadCountSuitesAndMethods 5.104
suitesAndClasses 7.204
suitesAndMethods 7.027
shutdown 11.085
threadCountClassesAndMethodsOneCore 10.593
everyThreadCountClassesAndMethods 6.857
all 6.266
unknownThreadCountClassesAndMethods 5.287
threadCountSuitesAndMethodsOptimized 7.231
reusableThreadCountSuitesAndMethodsOptimized 7.906
unlimitedThreadsClasses1 7.837
unlimitedThreadsClasses2 7.687
threadCountClasses 7.327
everyThreadCountAll 7.379
threadCountMethods 8.064
unlimitedThreadsSuites1 9.435
unlimitedThreadsSuites2 9.481
threadCountSuitesAndClasses 7.076
unlimitedThreadsClassesAndMethods1 6.56
unlimitedThreadsClassesAndMethods2 6.239
threadCountSuitesAndMethods 7.038
classes 7.611
reusableThreadCountSuitesAndClasses 8.241
methods 8.59
reusableThreadCountSuitesAndMethods 7.982
timeoutAndForcedShutdown 8.335
threadCountClassesAndMethodsOptimized 6.978
unlimitedThreadsAll1 6.376
unlimitedThreadsAll2 5.874
forcedShutdownVerifyingLogs 6.699
threadCountClassesAndMethodsOneCoreOptimized 10.36
reusableThreadCountClassesAndMethods 7.917

JUnit47ParallelNotThreadSafeIT

test 5.689

JUnit47RedirectOutputIT

testClassesParallel 6.778
testPrintSummaryTrueWithRedirect 7.548

JUnit47RerunFailingTestWithCucumberIT

testRerunFailingErrorTestsFalse 8.315
testRerunFailingErrorTestsWithOneRetry 6.536
testRerunFailingErrorTestsTwoRetry 6.437

JUnit47StaticInnerClassTestsIT

testStaticInnerClassTests 5.523

JUnit47WithCucumberIT

testWithParallelClasses 7.65
testWithoutParallel 6.147

JUnit48TestCategoriesIT

testCategoriesACFullyQualifiedClassName 7.082
testBadCategoryForkAlways 8.868
testCategoriesABForkAlways 10.429
testCategoriesBadCategory 6.744
testCategoriesACClassNameSuffix 7.001
testCategoriesACFullyQualifiedClassNameForkAlways 9.229
testCategoriesAB 7.555
testCategoriesACClassNameSuffixForkAlways 9.426

JUnit4ForkAlwaysStaticInitPollutionIT

testJunit4Ignore 8.78

JUnit4IgnoreIT

testJunit4Ignore 7.007
testJunit47ParallelIgnore 6.154

JUnit4RerunFailingTestsIT

testRerunFailingErrorTestsFalse 27.584
testRerunFailingErrorTestsWithOneRetry 28.013
testRerunFailingErrorTestsTwoRetry 27.773
testRerunOneTestMethod 28.183
testRerunOneTestClass 28.384

JUnit4RunListenerIT

testJUnit4RunListener 6.649
testRunlistenerJunitCoreProvider 7.002

JUnit4VersionsIT

testJunit[0: JUnit 4.0] 7.218
testJunit[1: JUnit 4.1] 7.857
testJunit[2: JUnit 4.2] 7.944
testJunit[3: JUnit 4.3] 7.408
testJunit[4: JUnit 4.3.1] 7.892
testJunit[5: JUnit 4.4] 6.43
testJunit[6: JUnit 4.5] 6.484
testJunit[7: JUnit 4.6] 7.747
testJunit[8: JUnit 4.7] 6.675
testJunit[9: JUnit 4.8] 7.849
testJunit[10: JUnit 4.8.1] 6.949
testJunit[11: JUnit 4.8.2] 6.719
testJunit[12: JUnit 4.9] 8.013
testJunit[13: JUnit 4.10] 6.822
testJunit[14: JUnit 4.11] 6.966
testJunit[15: JUnit 4.12] 6.873

JUnitDepIT

testJUnit44DepWithSneaky381 7.667
testJUnit44Dep 6.812
testJUnit47Dep 7.718
testJUnit48Dep 8.488

JUnitPlatformEnginesIT

testToRegex[1.0.0] 0
platform[1.0.0] 10.396
testToRegex[1.1.1] 0
platform[1.1.1] 10.244
testToRegex[1.2.0] 0.001
platform[1.2.0] 10.697
testToRegex[1.3.1] 0
platform[1.3.1] 7.319
testToRegex[1.4.0-SNAPSHOT] 0
platform[1.4.0-SNAPSHOT] 10.804

JUnitPlatformIT

testVintageEngine 8.245
testTags 7.188
testJQwikEngine 8.396
testMultipleEngines 9.652
testJupiterEngine 7.682

JUnitPlatformStreamCorruptionIT

warningIsNotEmitted 8.53

LongWindowsPathIT

shouldRunInSystemTmp 7.108

ModulePathIT

testModulePathWithSpaces 0
There's no JDK 9 provided.
testModulePath 0
There's no JDK 9 provided.

NoRunnableTestsInClassIT

testJunit3ParallelBuildResultCount 7.418

PlainOldJavaClasspathIT

testPlainOldJavaClasspath 6.743

PlexusConflictIT

testPlexusConflict 7.384
testPlexusConflictIsolatedClassLoader 6.504

PojoSimpleIT

testit 6.301

ReportersIT

testRedirectOutputTestNg 7.4

ResultCountingIT

testCountingWithJunit481ForkAlways 10.397
testCountingWithJunit481ForkOnce 6.941
testCountingWithJunit481ForkNever 5.509

RunOrderIT

testReverseAlphabetical 6.593
testNonExistingRunOrder 4.88
testHourly 6.299
testAlphabetical 5.937

RunOrderParallelForksIT

testReverseAlphabetical 6.547
testNonExistingRunOrder 5.017
testHourly 7.097
testAlphabetical 6.493

SiblingAggregatorIT

testSiblingAggregator 6.453

SmartStackTraceIT

misg 6.782

Surefire1602IT

nonCanonicalPath 15.133

SystemPropertiesTestIT

testSystemProperties 8.047
testSystemPropertiesNoFork 5.714

TestMethodPatternIT

testJUnit48WithCategoryFilter 6.666
testJUnit48Provider47 7.275
testMethodPatternAfter 7.183
testTestNGMethodPattern 7.057
testJUnit48Provider4 6.755
testJUnit44 6.476
testTestNgMethodBefore 6.725

TestMultipleMethodPatternsIT

shouldNotRunExcludedClassesAndMethods[0] 5.531
shouldMatchExactClassAndMethodCharacters[0] 5.8
shouldMatchExactClassAndMethodWildcard[0] 5.504
testSuccessTwo[0] 5.821
simpleNameTest[0] 5.596
simpleNameTestWithJavaExt[0] 5.696
regexClass[0] 5.922
shouldNotRunExcludedClasses[0] 5.817
shouldNotRunExcludedMethods[0] 5.815
simpleNameTestWithJavaExtWildcardPkg[0] 5.134
shouldMatchMultiplePatterns[0] 5.895
shouldMatchExactClassAndMethodsPostfix[0] 5.7
simpleNameTestWithWildcardPkg[0] 6.376
shouldMatchWildcardPackageAndClassAndMethod[0] 5.987
shouldMatchExactClassAndMultipleMethods[0] 5.976
fullyQualifiedTest[0] 5.888
matchSimpleClassAndMethodWithJavaExtWildcardPkg[0] 5.751
negativeTest[0] 0
got: <TEST>, expected: (is <INCLUDES> or is <INCLUDES_EXCLUDES> or is <INCLUDES_FILE> or is <INCLUDES_EXCLUDES_FILE>)
testRegexSuccessTwo[0] 6.04
shouldMatchExactClassAndMethodsWildcard[0] 5.657
shouldMatchMultiplePatternsComplex[0] 5.585
simpleNameTestAsParallel[0] 0
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
matchSimpleClassAndMethodWithWildcardPkg[0] 5.807
shouldMatchMultiplePatternsAsParallel[0] 0
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
shouldNotRunExcludedClassesIfIncluded[0] 5.625
shouldMatchSimpleClassNameAndMethod[0] 5.499
shouldMatchExactClassAndMethodPostfix[0] 5.42
shouldMatchMultiplePatternsComplexAsParallel[0] 0
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
matchSimpleClassAndMethodWithJavaExt[0] 6.048
regexClassAndMethod[0] 6.002
shouldNotRunExcludedClassesAndMethods[1] 5.848
shouldMatchExactClassAndMethodCharacters[1] 6.038
shouldMatchExactClassAndMethodWildcard[1] 6.02
testSuccessTwo[1] 6.118
simpleNameTest[1] 5.365
simpleNameTestWithJavaExt[1] 6.032
regexClass[1] 6.103
shouldNotRunExcludedClasses[1] 5.495
shouldNotRunExcludedMethods[1] 5.616
simpleNameTestWithJavaExtWildcardPkg[1] 5.902
shouldMatchMultiplePatterns[1] 6.213
shouldMatchExactClassAndMethodsPostfix[1] 5.846
simpleNameTestWithWildcardPkg[1] 5.597
shouldMatchWildcardPackageAndClassAndMethod[1] 5.456
shouldMatchExactClassAndMultipleMethods[1] 5.8
fullyQualifiedTest[1] 6.053
matchSimpleClassAndMethodWithJavaExtWildcardPkg[1] 5.931
negativeTest[1] 0
got: <TEST>, expected: (is <INCLUDES> or is <INCLUDES_EXCLUDES> or is <INCLUDES_FILE> or is <INCLUDES_EXCLUDES_FILE>)
testRegexSuccessTwo[1] 5.854
shouldMatchExactClassAndMethodsWildcard[1] 5.723
shouldMatchMultiplePatternsComplex[1] 5.472
simpleNameTestAsParallel[1] 5.748
matchSimpleClassAndMethodWithWildcardPkg[1] 5.956
shouldMatchMultiplePatternsAsParallel[1] 6.072
shouldNotRunExcludedClassesIfIncluded[1] 5.779
shouldMatchSimpleClassNameAndMethod[1] 5.516
shouldMatchExactClassAndMethodPostfix[1] 5.893
shouldMatchMultiplePatternsComplexAsParallel[1] 5.75
matchSimpleClassAndMethodWithJavaExt[1] 5.909
regexClassAndMethod[1] 5.722
shouldNotRunExcludedClassesAndMethods[2] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodCharacters[2] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodWildcard[2] 0
got: <INCLUDES>, expected: is <TEST>
testSuccessTwo[2] 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTest[2] 5.62
simpleNameTestWithJavaExt[2] 5.95
regexClass[2] 5.948
shouldNotRunExcludedClasses[2] 5.53
shouldNotRunExcludedMethods[2] 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTestWithJavaExtWildcardPkg[2] 5.281
shouldMatchMultiplePatterns[2] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsPostfix[2] 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTestWithWildcardPkg[2] 5.747
shouldMatchWildcardPackageAndClassAndMethod[2] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMultipleMethods[2] 0
got: <INCLUDES>, expected: is <TEST>
fullyQualifiedTest[2] 5.722
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2] 0
got: <INCLUDES>, expected: is <TEST>
negativeTest[2] 6.036
testRegexSuccessTwo[2] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsWildcard[2] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplex[2] 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTestAsParallel[2] 0
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
matchSimpleClassAndMethodWithWildcardPkg[2] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsAsParallel[2] 0
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
shouldNotRunExcludedClassesIfIncluded[2] 6.058
shouldMatchSimpleClassNameAndMethod[2] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodPostfix[2] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplexAsParallel[2] 0
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
matchSimpleClassAndMethodWithJavaExt[2] 0
got: <INCLUDES>, expected: is <TEST>
regexClassAndMethod[2] 0
got: <INCLUDES>, expected: is <TEST>
shouldNotRunExcludedClassesAndMethods[3] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodCharacters[3] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodWildcard[3] 0
got: <INCLUDES>, expected: is <TEST>
testSuccessTwo[3] 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTest[3] 5.782
simpleNameTestWithJavaExt[3] 5.95
regexClass[3] 5.735
shouldNotRunExcludedClasses[3] 5.983
shouldNotRunExcludedMethods[3] 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTestWithJavaExtWildcardPkg[3] 5.541
shouldMatchMultiplePatterns[3] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsPostfix[3] 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTestWithWildcardPkg[3] 5.967
shouldMatchWildcardPackageAndClassAndMethod[3] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMultipleMethods[3] 0
got: <INCLUDES>, expected: is <TEST>
fullyQualifiedTest[3] 5.987
matchSimpleClassAndMethodWithJavaExtWildcardPkg[3] 0
got: <INCLUDES>, expected: is <TEST>
negativeTest[3] 5.139
testRegexSuccessTwo[3] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsWildcard[3] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplex[3] 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTestAsParallel[3] 5.588
matchSimpleClassAndMethodWithWildcardPkg[3] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsAsParallel[3] 0
got: <INCLUDES>, expected: is <TEST>
shouldNotRunExcludedClassesIfIncluded[3] 5.678
shouldMatchSimpleClassNameAndMethod[3] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodPostfix[3] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplexAsParallel[3] 0
got: <INCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithJavaExt[3] 0
got: <INCLUDES>, expected: is <TEST>
regexClassAndMethod[3] 0
got: <INCLUDES>, expected: is <TEST>
shouldNotRunExcludedClassesAndMethods[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodCharacters[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodWildcard[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
testSuccessTwo[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTest[4] 5.683
simpleNameTestWithJavaExt[4] 5.441
regexClass[4] 5.663
shouldNotRunExcludedClasses[4] 5.892
shouldNotRunExcludedMethods[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTestWithJavaExtWildcardPkg[4] 5.424
shouldMatchMultiplePatterns[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsPostfix[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTestWithWildcardPkg[4] 5.559
shouldMatchWildcardPackageAndClassAndMethod[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMultipleMethods[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
fullyQualifiedTest[4] 5.762
matchSimpleClassAndMethodWithJavaExtWildcardPkg[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
negativeTest[4] 5.346
testRegexSuccessTwo[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsWildcard[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplex[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTestAsParallel[4] 0
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
matchSimpleClassAndMethodWithWildcardPkg[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsAsParallel[4] 0
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
shouldNotRunExcludedClassesIfIncluded[4] 5.671
shouldMatchSimpleClassNameAndMethod[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodPostfix[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplexAsParallel[4] 0
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
matchSimpleClassAndMethodWithJavaExt[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
regexClassAndMethod[4] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldNotRunExcludedClassesAndMethods[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodCharacters[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodWildcard[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
testSuccessTwo[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTest[5] 5.744
simpleNameTestWithJavaExt[5] 5.99
regexClass[5] 5.608
shouldNotRunExcludedClasses[5] 5.592
shouldNotRunExcludedMethods[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTestWithJavaExtWildcardPkg[5] 6.143
shouldMatchMultiplePatterns[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsPostfix[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTestWithWildcardPkg[5] 5.943
shouldMatchWildcardPackageAndClassAndMethod[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMultipleMethods[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
fullyQualifiedTest[5] 5.79
matchSimpleClassAndMethodWithJavaExtWildcardPkg[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
negativeTest[5] 5.269
testRegexSuccessTwo[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsWildcard[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplex[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTestAsParallel[5] 6.197
matchSimpleClassAndMethodWithWildcardPkg[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsAsParallel[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldNotRunExcludedClassesIfIncluded[5] 5.709
shouldMatchSimpleClassNameAndMethod[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodPostfix[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplexAsParallel[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithJavaExt[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
regexClassAndMethod[5] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>

TestMultipleMethodPatternsTestNGIT

shouldNotRunExcludedClassesAndMethods[0] 5.664
shouldMatchExactClassAndMethodCharacters[0] 5.835
shouldMatchExactClassAndMethodWildcard[0] 5.937
testSuccessTwo[0] 6.126
simpleNameTest[0] 5.417
simpleNameTestWithJavaExt[0] 5.556
regexClass[0] 5.714
shouldNotRunExcludedClasses[0] 5.751
shouldNotRunExcludedMethods[0] 5.982
simpleNameTestWithJavaExtWildcardPkg[0] 5.392
shouldMatchMultiplePatterns[0] 5.946
shouldMatchExactClassAndMethodsPostfix[0] 5.924
simpleNameTestWithWildcardPkg[0] 5.981
shouldMatchWildcardPackageAndClassAndMethod[0] 5.588
shouldMatchExactClassAndMultipleMethods[0] 5.883
fullyQualifiedTest[0] 5.479
matchSimpleClassAndMethodWithJavaExtWildcardPkg[0] 5.939
negativeTest[0] 0
got: <TEST>, expected: (is <INCLUDES> or is <INCLUDES_EXCLUDES> or is <INCLUDES_FILE> or is <INCLUDES_EXCLUDES_FILE>)
testRegexSuccessTwo[0] 6.065
shouldMatchExactClassAndMethodsWildcard[0] 5.971
shouldMatchMultiplePatternsComplex[0] 5.573
simpleNameTestAsParallel[0] 5.564
matchSimpleClassAndMethodWithWildcardPkg[0] 6.47
shouldMatchMultiplePatternsAsParallel[0] 6.098
shouldNotRunExcludedClassesIfIncluded[0] 5.965
shouldMatchSimpleClassNameAndMethod[0] 6.088
shouldMatchExactClassAndMethodPostfix[0] 6.006
shouldMatchMultiplePatternsComplexAsParallel[0] 5.694
matchSimpleClassAndMethodWithJavaExt[0] 5.989
regexClassAndMethod[0] 5.519
shouldNotRunExcludedClassesAndMethods[1] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodCharacters[1] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodWildcard[1] 0
got: <INCLUDES>, expected: is <TEST>
testSuccessTwo[1] 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTest[1] 5.792
simpleNameTestWithJavaExt[1] 5.212
regexClass[1] 6.057
shouldNotRunExcludedClasses[1] 5.706
shouldNotRunExcludedMethods[1] 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTestWithJavaExtWildcardPkg[1] 5.959
shouldMatchMultiplePatterns[1] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsPostfix[1] 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTestWithWildcardPkg[1] 6.054
shouldMatchWildcardPackageAndClassAndMethod[1] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMultipleMethods[1] 0
got: <INCLUDES>, expected: is <TEST>
fullyQualifiedTest[1] 5.728
matchSimpleClassAndMethodWithJavaExtWildcardPkg[1] 0
got: <INCLUDES>, expected: is <TEST>
negativeTest[1] 5.04
testRegexSuccessTwo[1] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsWildcard[1] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplex[1] 0
got: <INCLUDES>, expected: is <TEST>
simpleNameTestAsParallel[1] 6.102
matchSimpleClassAndMethodWithWildcardPkg[1] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsAsParallel[1] 0
got: <INCLUDES>, expected: is <TEST>
shouldNotRunExcludedClassesIfIncluded[1] 5.929
shouldMatchSimpleClassNameAndMethod[1] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodPostfix[1] 0
got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplexAsParallel[1] 0
got: <INCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithJavaExt[1] 0
got: <INCLUDES>, expected: is <TEST>
regexClassAndMethod[1] 0
got: <INCLUDES>, expected: is <TEST>
shouldNotRunExcludedClassesAndMethods[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodCharacters[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodWildcard[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
testSuccessTwo[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTest[2] 5.414
simpleNameTestWithJavaExt[2] 5.985
regexClass[2] 6.01
shouldNotRunExcludedClasses[2] 5.845
shouldNotRunExcludedMethods[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTestWithJavaExtWildcardPkg[2] 5.918
shouldMatchMultiplePatterns[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsPostfix[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTestWithWildcardPkg[2] 5.757
shouldMatchWildcardPackageAndClassAndMethod[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMultipleMethods[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
fullyQualifiedTest[2] 5.452
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
negativeTest[2] 5.124
testRegexSuccessTwo[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsWildcard[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplex[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTestAsParallel[2] 5.964
matchSimpleClassAndMethodWithWildcardPkg[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsAsParallel[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldNotRunExcludedClassesIfIncluded[2] 5.619
shouldMatchSimpleClassNameAndMethod[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodPostfix[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplexAsParallel[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithJavaExt[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>
regexClassAndMethod[2] 0
got: <INCLUDES_EXCLUDES>, expected: is <TEST>

TestMultipleMethodsIT

testJunit48Provider4 6.731
testJunit44 5.34
testJunit48Provider47 7.12

TestNgGroupsIT

testExclusion 8.359
testGroupsAndExclusion 7.314
groupsWithDash 7.215
testOnlyGroups 7.454
groupsBySimpleRegex 7.733

TestNgParallelWithAnnotationsIT

testTestNgGroupThreadParallel 7.798

TestNgSuccessPercentageIT

testPassesWhenFailuresLessThanSuccessPercentage 5.651

TestSingleMethodIT

fullyQualifiedTestNg 6.457
testJunit48Provider4 6.743
testJunit44 6.164
testJunit48parallel 6.663
testJunit48Provider47 6.643
fullyQualifiedJunit48Provider47 7.87
fullyQualifiedJunit48Provider4 6.629
testTestNg5149 7.289
testTestNg 6.455

TimeoutForkedTestIT

testTimeoutForked 6.99

TwoTestCasesIT

testJunit4Suite 6.75
testTestNGSuite 6.611
testTwoTestCases 6.689
testTwoTestCaseSuite 6.994

UmlautDirIT

testUmlautIsolatedClassLoader 7.901
testUmlaut 6.493

UnicodeTestNamesIT

checkFileNamesWithUnicode 9.263

UseIsolatedClassLoaderIT

testUseSystemClassLoader 6.513

WorkingDirectoryIsInvalidPropertyIT

testWorkingDirectory 4.842

WorkingDirectoryIT

testWorkingDirectory 6.624
testWorkingDirectoryChildOnlyNoFork 5.302
testWorkingDirectoryNoFork 5.429
testWorkingDirectoryChildOnly 6.942

WorkingDirectoryMissingIT

testWorkingDirectory 6.089

XmlReporterRunTimeIT

testForkModeAlways 26.649

Failure Details

[Summary] [Package List] [Test Cases]


XXXtest50
skipped: 5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
XXXtest501
skipped: 5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
shouldLoadMultipleJavaModules_JavaHome
skipped: There's no JDK 9 provided.
shouldLoadMultipleJavaModules_ToolchainsXML
skipped: There's no JDK 9 provided.
shouldLoadMultipleJavaModules_JvmParameter
skipped: There's no JDK 9 provided.
shouldRunInPluginJava9
skipped: There's no JDK 9 provided.
test[0]
skipped: got: <false>, expected: is <true>
test[1]
skipped: got: <false>, expected: is <true>
test[2]
skipped: got: <false>, expected: is <true>
test[3]
skipped: got: <false>, expected: is <true>
test[4]
skipped: got: <false>, expected: is <true>
test[5]
skipped: got: <false>, expected: is <true>
test[6]
skipped: got: <false>, expected: is <true>
test[7]
skipped: got: <false>, expected: is <true>
test[8]
skipped: got: <false>, expected: is <true>
twoSpecifiedTestExecutionsInCorrectExecutionBlocks
skipped: since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
singleTestInOneExecutionOfMultiExecutionProject
skipped: since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
testModulePathWithSpaces
skipped: There's no JDK 9 provided.
testModulePath
skipped: There's no JDK 9 provided.
negativeTest[0]
skipped: got: <TEST>, expected: (is <INCLUDES> or is <INCLUDES_EXCLUDES> or is <INCLUDES_FILE> or is <INCLUDES_EXCLUDES_FILE>)
simpleNameTestAsParallel[0]
skipped: got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
shouldMatchMultiplePatternsAsParallel[0]
skipped: got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
shouldMatchMultiplePatternsComplexAsParallel[0]
skipped: got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
negativeTest[1]
skipped: got: <TEST>, expected: (is <INCLUDES> or is <INCLUDES_EXCLUDES> or is <INCLUDES_FILE> or is <INCLUDES_EXCLUDES_FILE>)
shouldNotRunExcludedClassesAndMethods[2]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodCharacters[2]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodWildcard[2]
skipped: got: <INCLUDES>, expected: is <TEST>
testSuccessTwo[2]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldNotRunExcludedMethods[2]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatterns[2]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsPostfix[2]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchWildcardPackageAndClassAndMethod[2]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMultipleMethods[2]
skipped: got: <INCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2]
skipped: got: <INCLUDES>, expected: is <TEST>
testRegexSuccessTwo[2]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsWildcard[2]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplex[2]
skipped: got: <INCLUDES>, expected: is <TEST>
simpleNameTestAsParallel[2]
skipped: got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
matchSimpleClassAndMethodWithWildcardPkg[2]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsAsParallel[2]
skipped: got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
shouldMatchSimpleClassNameAndMethod[2]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodPostfix[2]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplexAsParallel[2]
skipped: got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
matchSimpleClassAndMethodWithJavaExt[2]
skipped: got: <INCLUDES>, expected: is <TEST>
regexClassAndMethod[2]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldNotRunExcludedClassesAndMethods[3]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodCharacters[3]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodWildcard[3]
skipped: got: <INCLUDES>, expected: is <TEST>
testSuccessTwo[3]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldNotRunExcludedMethods[3]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatterns[3]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsPostfix[3]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchWildcardPackageAndClassAndMethod[3]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMultipleMethods[3]
skipped: got: <INCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithJavaExtWildcardPkg[3]
skipped: got: <INCLUDES>, expected: is <TEST>
testRegexSuccessTwo[3]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsWildcard[3]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplex[3]
skipped: got: <INCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithWildcardPkg[3]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsAsParallel[3]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchSimpleClassNameAndMethod[3]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodPostfix[3]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplexAsParallel[3]
skipped: got: <INCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithJavaExt[3]
skipped: got: <INCLUDES>, expected: is <TEST>
regexClassAndMethod[3]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldNotRunExcludedClassesAndMethods[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodCharacters[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodWildcard[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
testSuccessTwo[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldNotRunExcludedMethods[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatterns[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsPostfix[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchWildcardPackageAndClassAndMethod[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMultipleMethods[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithJavaExtWildcardPkg[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
testRegexSuccessTwo[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsWildcard[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplex[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
simpleNameTestAsParallel[4]
skipped: got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
matchSimpleClassAndMethodWithWildcardPkg[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsAsParallel[4]
skipped: got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
shouldMatchSimpleClassNameAndMethod[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodPostfix[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplexAsParallel[4]
skipped: got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>)
matchSimpleClassAndMethodWithJavaExt[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
regexClassAndMethod[4]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldNotRunExcludedClassesAndMethods[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodCharacters[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodWildcard[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
testSuccessTwo[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldNotRunExcludedMethods[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatterns[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsPostfix[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchWildcardPackageAndClassAndMethod[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMultipleMethods[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithJavaExtWildcardPkg[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
testRegexSuccessTwo[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsWildcard[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplex[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithWildcardPkg[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsAsParallel[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchSimpleClassNameAndMethod[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodPostfix[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplexAsParallel[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithJavaExt[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
regexClassAndMethod[5]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
negativeTest[0]
skipped: got: <TEST>, expected: (is <INCLUDES> or is <INCLUDES_EXCLUDES> or is <INCLUDES_FILE> or is <INCLUDES_EXCLUDES_FILE>)
shouldNotRunExcludedClassesAndMethods[1]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodCharacters[1]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodWildcard[1]
skipped: got: <INCLUDES>, expected: is <TEST>
testSuccessTwo[1]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldNotRunExcludedMethods[1]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatterns[1]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsPostfix[1]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchWildcardPackageAndClassAndMethod[1]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMultipleMethods[1]
skipped: got: <INCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithJavaExtWildcardPkg[1]
skipped: got: <INCLUDES>, expected: is <TEST>
testRegexSuccessTwo[1]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsWildcard[1]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplex[1]
skipped: got: <INCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithWildcardPkg[1]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsAsParallel[1]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchSimpleClassNameAndMethod[1]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodPostfix[1]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplexAsParallel[1]
skipped: got: <INCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithJavaExt[1]
skipped: got: <INCLUDES>, expected: is <TEST>
regexClassAndMethod[1]
skipped: got: <INCLUDES>, expected: is <TEST>
shouldNotRunExcludedClassesAndMethods[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodCharacters[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodWildcard[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
testSuccessTwo[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldNotRunExcludedMethods[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatterns[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsPostfix[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchWildcardPackageAndClassAndMethod[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMultipleMethods[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
testRegexSuccessTwo[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodsWildcard[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplex[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithWildcardPkg[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsAsParallel[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchSimpleClassNameAndMethod[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchExactClassAndMethodPostfix[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
shouldMatchMultiplePatternsComplexAsParallel[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
matchSimpleClassAndMethodWithJavaExt[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>
regexClassAndMethod[2]
skipped: got: <INCLUDES_EXCLUDES>, expected: is <TEST>