Fork me on GitHub
Built by Maven

Surefire Report

Summary

[Summary] [Package List] [Test Cases]


Tests Errors Failures Skipped Success Rate Time
780 0 0 137 82.436% 3,994.541

Note: failures are anticipated and checked for with assertions while errors are unanticipated.


Package List

[Summary] [Package List] [Test Cases]


Package Tests Errors Failures Skipped Success Rate Time
org.apache.maven.surefire.its 598 0 0 134 77.592% 2,799.318
org.apache.maven.surefire.its.jiras 182 0 0 3 98.352% 1,195.223

Note: package statistics are not computed recursively, they only sum up all of its testsuites numbers.

org.apache.maven.surefire.its

Class Tests Errors Failures Skipped Success Rate Time
AbstractTestCaseIT 1 0 0 0 100% 3.987
AdditionalClasspathIT 1 0 0 0 100% 5.184
AggregateReportIT 1 0 0 0 100% 6.538
ArgLineIT 1 0 0 0 100% 4.782
ArgLinePropertiesIT 1 0 0 0 100% 4.976
AssumptionFailureReportIT 1 0 0 0 100% 3.872
CheckSingleTestIT 4 0 0 0 100% 14.682
CheckTestFailIfNoTestsForkModeIT 6 0 0 0 100% 25.58
CheckTestFailIfNoTestsIT 3 0 0 0 100% 8.748
CheckTestNgBeforeMethodFailureIT 1 0 0 0 100% 5.332
CheckTestNgBeforeMethodIT 1 0 0 0 100% 5.314
CheckTestNgCustomObjectFactoryIT 1 0 0 0 100% 4.217
CheckTestNgCustomTestRunnerFactoryIT 1 0 0 0 100% 4.329
CheckTestNgExecuteErrorIT 1 0 0 0 100% 5.204
CheckTestNgGroupThreadParallelIT 1 0 0 0 100% 4.111
CheckTestNgJdk14IT 1 0 0 0 100% 5.356
CheckTestNgListenerReporterIT 8 0 0 0 100% 43.534
CheckTestNgListenersIT 1 0 0 0 100% 5.228
CheckTestNgPathWithSpacesIT 1 0 0 0 100% 5.439
CheckTestNgReportTestIT 3 0 0 0 100% 19.043
CheckTestNgSuiteXmlIT 3 0 0 0 100% 17.052
CheckTestNgSuiteXmlSingleIT 1 0 0 0 100% 5.259
CheckTestNgVersionsIT 20 0 0 2 90% 112.36
ClasspathFilteringIT 1 0 0 0 100% 3.833
ClassPathOrderIT 1 0 0 0 100% 4.511
ClasspathScopeFilteringIT 1 0 0 0 100% 3.819
ConsoleOutputIT 4 0 0 0 100% 28.149
CrashDetectionIT 3 0 0 0 100% 14.683
DefaultConfigurationIT 1 0 0 0 100% 3.75
EnvironmentVariableIT 1 0 0 0 100% 5.17
EnvironmentVariablesIT 2 0 0 0 100% 9.927
FailFastJUnitIT 12 0 0 0 100% 280.815
FailFastTestNgIT 6 0 0 0 100% 68.185
ForkConsoleOutputIT 4 0 0 0 100% 19.174
ForkConsoleOutputWithErrorsIT 1 0 0 0 100% 4.716
ForkModeIT 12 0 0 0 100% 122.598
ForkModeMultiModuleIT 4 0 0 0 100% 32.775
ForkModeTestNGIT 12 0 0 0 100% 93.561
IncludesExcludesFromFileIT 6 0 0 0 100% 28.203
IncludesExcludesIT 3 0 0 0 100% 14.506
Java9FullApiIT 3 0 0 3 0% 0.007
JUnit44HamcrestIT 1 0 0 0 100% 4.829
JUnit47ConcurrencyIT 1 0 0 0 100% 5.08
JUnit47ParallelIT 59 0 0 0 100% 360.916
JUnit47ParallelNotThreadSafeIT 1 0 0 0 100% 4.188
JUnit47RedirectOutputIT 2 0 0 0 100% 10.826
JUnit47RerunFailingTestWithCucumberIT 3 0 0 0 100% 14.652
JUnit47StaticInnerClassTestsIT 1 0 0 0 100% 4.281
JUnit47WithCucumberIT 2 0 0 0 100% 9.402
JUnit48TestCategoriesIT 8 0 0 0 100% 59.817
JUnit4ForkAlwaysStaticInitPollutionIT 1 0 0 0 100% 5.674
JUnit4IgnoreIT 2 0 0 0 100% 11.859
JUnit4RerunFailingTestsIT 5 0 0 0 100% 114.228
JUnit4RunListenerIT 2 0 0 0 100% 10.954
JUnit4VersionsIT 16 0 0 0 100% 84.19
JUnitDepIT 4 0 0 0 100% 22.637
JUnitPlatformEnginesIT 10 0 0 0 100% 34.062
JUnitPlatformIT 5 0 0 0 100% 28.205
LongWindowsPathIT 1 0 0 0 100% 4.969
ModulePathIT 1 0 0 1 0% 0.001
NoRunnableTestsInClassIT 1 0 0 0 100% 5.25
PlainOldJavaClasspathIT 1 0 0 0 100% 4.909
PlexusConflictIT 2 0 0 0 100% 10.09
PojoSimpleIT 1 0 0 0 100% 5.175
ReportersIT 1 0 0 0 100% 5.239
ResultCountingIT 3 0 0 0 100% 17.493
RunOrderIT 4 0 0 0 100% 19.13
RunOrderParallelForksIT 4 0 0 0 100% 19.052
SiblingAggregatorIT 1 0 0 0 100% 4.418
SmartStackTraceIT 1 0 0 0 100% 4.941
SystemPropertiesTestIT 2 0 0 0 100% 9.205
TestMethodPatternIT 7 0 0 0 100% 36.66
TestMultipleMethodPatternsIT 180 0 0 87 51.667% 413.066
TestMultipleMethodPatternsTestNGIT 90 0 0 41 54.444% 204.433
TestMultipleMethodsIT 3 0 0 0 100% 14.312
TestNgGroupsIT 5 0 0 0 100% 27.317
TestNgParallelWithAnnotationsIT 1 0 0 0 100% 5.964
TestNgSuccessPercentageIT 1 0 0 0 100% 4.005
TestSingleMethodIT 9 0 0 0 100% 45.247
TimeoutForkedTestIT 1 0 0 0 100% 5.34
TwoTestCasesIT 4 0 0 0 100% 19.393
UmlautDirIT 2 0 0 0 100% 9.932
UnicodeTestNamesIT 1 0 0 0 100% 7.668
UseIsolatedClassLoaderIT 1 0 0 0 100% 4.505
WorkingDirectoryIsInvalidPropertyIT 1 0 0 0 100% 3.221
WorkingDirectoryIT 4 0 0 0 100% 16.669
WorkingDirectoryMissingIT 1 0 0 0 100% 4.536
XmlReporterRunTimeIT 1 0 0 0 100% 22.869

org.apache.maven.surefire.its.jiras

Class Tests Errors Failures Skipped Success Rate Time
Surefire1024VerifyFailsafeIfTestedIT 1 0 0 0 100% 4.15
Surefire1028UnableToRunSingleIT 1 0 0 0 100% 4.369
Surefire1036NonFilterableJUnitRunnerWithCategoriesIT 1 0 0 0 100% 4.712
Surefire1041FailingJUnitRunnerIT 1 0 0 0 100% 5.609
Surefire1053SystemPropertiesIT 2 0 0 0 100% 9.296
Surefire1055CorrectConcurrentTestCountIT 1 0 0 0 100% 5.126
Surefire1080ParallelForkDoubleTestIT 1 0 0 0 100% 5.318
Surefire1082ParallelJUnitParameterizedIT 3 0 0 0 100% 19.817
Surefire1098BalancedRunOrderIT 1 0 0 0 100% 26.163
Surefire1122ParallelAndFlakyTestsIT 3 0 0 0 100% 13.6
Surefire1135ImproveIgnoreMessageForTestNGIT 2 0 0 0 100% 12.027
Surefire1136CwdPropagationInForkedModeIT 1 0 0 0 100% 4.604
Surefire1144XmlRunTimeIT 1 0 0 0 100% 5.132
Surefire1152RerunFailingTestsInSuiteIT 2 0 0 0 100% 9.316
Surefire1153IncludesAndSpecifiedTestIT 2 0 0 0 100% 7.211
Surefire1158RemoveInfoLinesIT 6 0 0 0 100% 30.848
Surefire1177TestngParallelSuitesIT 2 0 0 0 100% 12.89
Surefire1179IT 1 0 0 0 100% 9.155
Surefire1185DoNotSpawnTestsIT 1 0 0 0 100% 3.746
Surefire1202RerunAndSkipIT 2 0 0 0 100% 35.001
Surefire1209RerunAndForkCountIT 4 0 0 0 100% 55.195
Surefire1211JUnitTestNgIT 2 0 0 0 100% 12.314
Surefire1264IT 2 0 0 0 100% 13.702
Surefire1265Java9IT 1 0 0 1 0% 0.001
Surefire1278GroupNameEndingIT 1 0 0 0 100% 7.605
Surefire1295AttributeJvmCrashesToTestsIT 9 0 0 0 100% 82.7
Surefire1364SystemPropertiesIT 10 0 0 0 100% 58.526
Surefire1367AssumptionLogsIT 4 0 0 0 100% 19.825
Surefire1383ScanSessionDependenciesIT 1 0 0 0 100% 4.967
Surefire1396CustomProviderClassPathIT 1 0 0 0 100% 8.383
Surefire141PluggableProvidersIT 4 0 0 0 100% 29.933
Surefire146ForkPerTestNoSetupIT 1 0 0 0 100% 5.247
Surefire1490ReportTitleDescriptionIT 2 0 0 0 100% 21.682
Surefire1535TestNGParallelSuitesIT 4 0 0 0 100% 28.299
Surefire162CharsetProviderIT 1 0 0 0 100% 5.536
Surefire224WellFormedXmlFailuresIT 1 0 0 0 100% 5.486
Surefire257NotRerunningTestsIT 1 0 0 0 100% 7.783
Surefire260TestWithIdenticalNamesIT 1 0 0 0 100% 9.928
Surefire34SecurityManagerIT 2 0 0 0 100% 10.234
Surefire376TestNgAfterSuiteFailureIT 1 0 0 0 100% 5.3
Surefire377TestNgAndJUnitTogetherIT 2 0 0 0 100% 10.547
Surefire408ManualProviderSelectionIT 1 0 0 0 100% 5.642
Surefire42NotExtendingTestCaseIT 1 0 0 0 100% 6.926
Surefire44InnerClassTestIT 1 0 0 0 100% 5.959
Surefire500PuzzlingErrorIT 1 0 0 0 100% 5.754
Surefire510TestClassPathForkModesIT 2 0 0 0 100% 11.043
Surefire569RunTestFromDependencyJarsIT 1 0 0 0 100% 5.116
Surefire570MultipleReportDirectoriesIT 2 0 0 0 100% 29.435
Surefire613TestCountInParallelIT 1 0 0 0 100% 6.234
Surefire621TestCountingJunit3InParallelIT 5 0 0 0 100% 34.034
Surefire628ConsoleOutputBeforeAndAfterClassIT 1 0 0 0 100% 6.992
Surefire634UnsettableSystemPropertiesWarningIT 1 0 0 0 100% 5.614
Surefire649EmptyStringSystemPropertiesIT 2 0 0 0 100% 9.199
Surefire673MockitoIT 1 0 0 0 100% 6.054
Surefire674BuildFailingWhenErrorsIT 1 0 0 0 100% 5.674
Surefire674BuildFailingWhenFailsafeErrorsIT 1 0 0 0 100% 6.771
Surefire685CommaSeparatedIncludesIT 1 0 0 0 100% 6.047
Surefire697NiceSummaryIT 1 0 0 0 100% 7.143
Surefire705ParallelForkTimeoutIT 1 0 0 0 100% 8.976
Surefire733AllOverrridesCapturedIT 1 0 0 0 100% 8.121
Surefire735ForkFailWithRedirectConsoleOutputIT 2 0 0 0 100% 10.598
Surefire740TruncatedCommaIT 1 0 0 0 100% 4.897
Surefire747MethodParallelWithSuiteCountIT 2 0 0 0 100% 23.24
Surefire772BothReportsIT 3 0 0 0 100% 11.275
Surefire772NoFailsafeReportsIT 4 0 0 0 100% 14.17
Surefire772NoSurefireReportsIT 4 0 0 0 100% 17.116
Surefire772SpecifiedReportsIT 3 0 0 0 100% 15.158
Surefire801ForkModeNoneClassLoaderIT 1 0 0 0 100% 5.948
Surefire803MultiFailsafeExecsIT 2 0 0 0 100% 21.694
Surefire806SpecifiedTestControlsIT 3 0 0 2 33.333% 5.243
Surefire809GroupExpressionsIT 6 0 0 0 100% 38.316
Surefire812Log4JClassLoaderIT 1 0 0 0 100% 5.203
Surefire817SystemExitIT 1 0 0 0 100% 6.44
Surefire818NpeIgnoresTestsIT 1 0 0 0 100% 5.579
Surefire828EmptyGroupExprIT 4 0 0 0 100% 25.82
Surefire832ProviderSelectionIT 1 0 0 0 100% 5.923
Surefire839TestWithoutCategoriesIT 2 0 0 0 100% 11.56
Surefire847AdditionalFailureIT 1 0 0 0 100% 5.47
Surefire855AllowFailsafeUseArtifactFileIT 4 0 0 0 100% 35.985
Surefire901MIssingResultfileWhenNoTestsIT 1 0 0 0 100% 3.903
Surefire907PerThreadWithoutThreadCountIT 1 0 0 0 100% 3.734
Surefire920TestFailureIgnoreWithTimeoutIT 2 0 0 0 100% 12.546
Surefire926FailureWith2ProvidersIT 1 0 0 0 100% 6.527
Surefire930TestNgSuiteXmlIT 1 0 0 0 100% 6.196
Surefire943ReportContentIT 2 0 0 0 100% 18.414
Surefire946KillMainProcessInReusableForkIT 3 0 0 0 100% 21.101
Surefire972BizarreNoClassDefIT 1 0 0 0 100% 5.817
Surefire975DefaultVMEncodingIT 1 0 0 0 100% 4.593
Surefire979WrongClassLoaderIT 1 0 0 0 100% 6.232
Surefire985ParameterizedRunnerAndCategoriesIT 1 0 0 0 100% 4.349
Surefire995CategoryInheritanceIT 5 0 0 0 100% 20.159

Test Cases

[Summary] [Package List] [Test Cases]

AbstractTestCaseIT

abstractTestCase 3.987

AdditionalClasspathIT

additionalClasspath 5.184

AggregateReportIT

aggregateReport 6.538

ArgLineIT

argLine 4.782

ArgLinePropertiesIT

argLine 4.976

AssumptionFailureReportIT

testWriteSkippedMessageToReport 3.872

CheckSingleTestIT

singleTestDotJava 3.945
singleTestNonExistentOverride 3.502
singleTestNonExistent 3.469
singleTest 3.766

CheckTestFailIfNoTestsForkModeIT

dontFailIfNoTestsForkModeAlways 3.931
failIfNoTestsForkModeOnce 3.852
dontFailIfNoTestsForkModeNever 5.024
dontFailIfNoTestsForkModeOnce 4.547
failIfNoTestsForkModeNever 4.008
failIfNoTestsForkModeAlways 4.218

CheckTestFailIfNoTestsIT

failIfNoTests 2.933
dontFailIfNoTests 2.923
jUnit48CategoriesFailWhenNoTests 2.892

CheckTestNgBeforeMethodFailureIT

TestNgBeforeMethodFailure 5.332

CheckTestNgBeforeMethodIT

TestNgBeforeMethod 5.314

CheckTestNgCustomObjectFactoryIT

testTestNgListenerReporter 4.217

CheckTestNgCustomTestRunnerFactoryIT

testTestNgListenerReporter 4.329

CheckTestNgExecuteErrorIT

executionError 5.204

CheckTestNgGroupThreadParallelIT

TestNgGroupThreadParallel 4.111

CheckTestNgJdk14IT

TestNgJdk14 5.356

CheckTestNgListenerReporterIT

testNgListenerReporter[0: TestNG 5.6] 5.225
testNgListenerReporter[1: TestNG 5.7] 5.152
testNgListenerReporter[2: TestNG 5.10] 5.573
testNgListenerReporter[3: TestNG 5.13] 5.656
testNgListenerReporter[4: TestNG 5.14.6] 5.299
testNgListenerReporter[5: TestNG 5.14.9] 5.228
testNgListenerReporter[6: TestNG 6.0] 5.424
testNgListenerReporter[7: TestNG 6.9.9] 5.977

CheckTestNgListenersIT

TestNgListenerReporter 5.228

CheckTestNgPathWithSpacesIT

TestWithSpaces 5.439

CheckTestNgReportTestIT

testNgReport 7.192
shouldNotBeVerbose 5.929
shouldBeVerbose 5.922

CheckTestNgSuiteXmlIT

suiteXml 5.339
suiteXmlForkCountTwoReuse 5.434
suiteXmlForkModeAlways 6.279

CheckTestNgSuiteXmlSingleIT

TestNgSuite 5.259

CheckTestNgVersionsIT

XXXtest50
+ [ Detail ]
 0
5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
test502 5.765
test510 5.916
test511 5.902
test512 6.4
test513 5.888
test514 7.862
test685 8.152
test5131 6.994
test5141 6.453
test5142 6.11
test47 5.702
test51 5.828
test55 5.919
test56 5.677
test57 5.603
test58 5.987
test59 5.95
test60 6.252
XXXtest501
+ [ Detail ]
 0
5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024

ClasspathFilteringIT

additionalClasspath 3.833

ClassPathOrderIT

classPathOrder 4.511

ClasspathScopeFilteringIT

additionalClasspath 3.819

ConsoleOutputIT

properNewlinesAndEncodingWithDifferentEncoding 5.099
properNewlinesAndEncodingWithDefaultEncodings 5.004
largerSoutThanMemory 13.935
properNewlinesAndEncodingWithoutFork 4.111

CrashDetectionIT

hardCrashInReusableFork 4.902
crashInReusableFork 4.996
crashInFork 4.785

DefaultConfigurationIT

defaultConfiguration 3.75

EnvironmentVariableIT

environmentVariable 5.17

EnvironmentVariablesIT

testWhenUseSystemClassLoader 4.986
testWhenDontUseSystemClassLoader 4.941

FailFastJUnitIT

test[junit4-oneFork-ff1] 9.367
test[junit47-oneFork-ff1] 9.811
test[junit4-oneFork-ff2] 20.829
test[junit47-oneFork-ff2] 20.876
test[junit4-twoForks-ff1] 16.734
test[junit47-twoForks-ff1] 16.643
test[junit4-twoForks-ff2] 21.849
test[junit47-twoForks-ff2] 21.67
test[junit4-oneFork-ff3] 43.135
test[junit47-oneFork-ff3] 43.554
test[junit4-twoForks-ff3] 27.952
test[junit47-twoForks-ff3] 28.395

FailFastTestNgIT

test[testng-oneFork-ff1] 6.518
test[testng-oneFork-ff2] 10.402
test[testng-twoForks-ff1] 9.496
test[testng-twoForks-ff2] 10.74
test[testng-oneFork-ff3] 17.945
test[testng-twoForks-ff3] 13.084

ForkConsoleOutputIT

printSummaryTrueWithRedirect 4.904
printSummaryFalseWithoutRedirect 4.69
printSummaryTrueWithoutRedirect 4.785
printSummaryFalseWithRedirect 4.795

ForkConsoleOutputWithErrorsIT

xmlFileContainsConsoleOutput 4.716

ForkModeIT

testForkModeOncePerThreadSingleThread 6.982
testForkModePerTest 8.471
testForkCountZero 6.176
testForkCountOneNoReuse 8.379
testForkCountTwoNoReuse 19.534
testForkModeNever 6.024
testForkCountTwoReuse 19.35
testForkCountOneReuse 7.034
testForkModeOncePerThreadTwoThreads 19.271
testForkModeAlways 8.392
testForkModeNone 5.941
testForkModeOnce 7.044

ForkModeMultiModuleIT

testForkCountOneNoReuse 9.764
testForkCountTwoNoReuse 7.877
testForkCountTwoReuse 7.129
testForkCountOneReuse 8.005

ForkModeTestNGIT

testForkModeOncePerThreadSingleThread 5.875
testForkModePerTest 7.557
testForkCountZero 4.899
testForkCountOneNoReuse 7.598
testForkCountTwoNoReuse 12.517
testForkModeNever 4.842
testForkCountTwoReuse 12.557
testForkCountOneReuse 6.166
testForkModeOncePerThreadTwoThreads 13.111
testForkModeAlways 7.59
testForkModeNone 4.98
testForkModeOnce 5.869

IncludesExcludesFromFileIT

testSimpleMixed 4.833
testMissingExcludes 3.455
testRegex 5.966
testPath 5.426
testMissingIncludes 3.49
testSimple 5.033

IncludesExcludesIT

testPathBasedIncludesExcludes 4.968
testIncludesExcludes 4.775
testRegexIncludesExcludes 4.763

Java9FullApiIT

shouldLoadMultipleJavaModules_JavaHome
+ [ Detail ]
 0.007
skipped
shouldLoadMultipleJavaModules_ToolchainsXML
+ [ Detail ]
 0
skipped
shouldLoadMultipleJavaModules_JvmParameter
+ [ Detail ]
 0
skipped

Surefire1024VerifyFailsafeIfTestedIT

shouldScanAndRunTestsInDependencyJars 4.15

Surefire1028UnableToRunSingleIT

methodFilteringParallelExecution 4.369

Surefire1036NonFilterableJUnitRunnerWithCategoriesIT

test 4.712

Surefire1041FailingJUnitRunnerIT

reportErrorInJUnitRunnerAsTestError 5.609

Surefire1053SystemPropertiesIT

checkWarningsSysPropTwice 4.557
checkWarningsFileEncoding 4.739

Surefire1055CorrectConcurrentTestCountIT

testTestNgAndJUnitTogether 5.126

Surefire1080ParallelForkDoubleTestIT

test 5.318

Surefire1082ParallelJUnitParameterizedIT

checkClassesRunParallel 6.149
shouldRunTwo 7.242
checkOutFileClassesRunParallel 6.426

Surefire1098BalancedRunOrderIT

reorderedParallelClasses 26.163

Surefire1122ParallelAndFlakyTestsIT

parallelCreatesCorrectReportFork 4.825
nonParallelCreatesCorrectReport 4.909
parallelCreatesCorrectReport 3.866

Surefire1135ImproveIgnoreMessageForTestNGIT

testNgReport57 5.836
testNgReport688 6.191

Surefire1136CwdPropagationInForkedModeIT

testTestNgAndJUnitTogether 4.604

Surefire1144XmlRunTimeIT

testXmlRunTime 5.132

Surefire1152RerunFailingTestsInSuiteIT

testJUnit48Provider47 4.842
testJUnit48Provider4 4.474

Surefire1153IncludesAndSpecifiedTestIT

testSpecifiedTestInIncludes 3.497
testSpecifiedTestNotInIncludes 3.714

Surefire1158RemoveInfoLinesIT

shouldRunWithCliOption[junit-option-ff] 5.112
shouldRunWithCliOption[testng-option-ff] 5.088
shouldRunWithCliOption[junit-option-X] 5.285
shouldRunWithCliOption[testng-option-X] 5.142
shouldRunWithCliOption[junit-option-e] 5.243
shouldRunWithCliOption[testng-option-e] 4.978

Surefire1177TestngParallelSuitesIT

twoSuitesInParallelForked 6.501
twoSuitesInParallel 6.389

Surefire1179IT

suiteXmlForkCountTwoReuse 9.155

Surefire1185DoNotSpawnTestsIT

doNotSpawnUnwantedTests 3.746

Surefire1202RerunAndSkipIT

junit47 17.769
junit4 17.232

Surefire1209RerunAndForkCountIT

notReusableForksJUnit47 13.86
reusableForksJUnit47 14.335
reusableForksJUnit4 13.012
notReusableForksJUnit4 13.988

Surefire1211JUnitTestNgIT

withoutJUnit 6.111
withJUnit 6.203

Surefire1264IT

positiveTests 6.856
negativeTests 6.846

Surefire1265Java9IT

shouldRunInPluginJava9
+ [ Detail ]
 0.001
skipped

Surefire1278GroupNameEndingIT

testOnlyGroups 7.605

Surefire1295AttributeJvmCrashesToTestsIT

test[0] 7.707
test[1] 10.45
test[2] 7.709
test[3] 9.745
test[4] 11.684
test[5] 9.03
test[6] 7.29
test[7] 11.536
test[8] 7.549

Surefire1364SystemPropertiesIT

junit47InProcessParallel 5.66
junit47Forked 5.818
junit47InProcess 5.646
testNg 6.384
junit3Forked 5.604
junit47ForkedParallel 5.966
junit4Forked 5.429
testNgInProcess 6.781
junit4InProcess 5.553
junit3InProcess 5.685

Surefire1367AssumptionLogsIT

shouldSeeLogsInPlugin 4.02
shouldSeeLogsParallelInPlugin 4.509
shouldSeeLogsParallelForked 5.911
shouldSeeLogsForked 5.385

Surefire1383ScanSessionDependenciesIT

test 4.967

Surefire1396CustomProviderClassPathIT

pluggableProviderClasspathCorrect 8.383

Surefire141PluggableProvidersIT

pluggableProviderPresent 7.642
invokeRuntimeException 7.315
invokeReporterException 7.387
constructorRuntimeException 7.589

Surefire146ForkPerTestNoSetupIT

testForkPerTestNoSetup 5.247

Surefire1490ReportTitleDescriptionIT

shouldHaveCustomizedReportTitleAndDescription 11.496
shouldHaveDefaultReportTitleAndDescription 10.186

Surefire1535TestNGParallelSuitesIT

forks0 6.507
forks2 8.27
forks0Redirected 6.437
forks2Redirected 7.085

Surefire162CharsetProviderIT

testCharsetProvider 5.536

Surefire224WellFormedXmlFailuresIT

testWellFormedXmlFailures 5.486

Surefire257NotRerunningTestsIT

shouldNotRerun 7.783

Surefire260TestWithIdenticalNamesIT

testWithIdenticalNames 9.928

Surefire34SecurityManagerIT

testSecurityManager 5.145
testSecurityManagerSuccessful 5.089

Surefire376TestNgAfterSuiteFailureIT

testAfterSuiteFailure 5.3

Surefire377TestNgAndJUnitTogetherIT

testTestNgAndJUnit4Together 4.758
testTestNgAndJUnitTogether 5.789

Surefire408ManualProviderSelectionIT

testParallelBuildResultCount 5.642

Surefire42NotExtendingTestCaseIT

testInnerClass 6.926

Surefire44InnerClassTestIT

testInnerClass 5.959

Surefire500PuzzlingErrorIT

testBuildFailingWhenErrors 5.754

Surefire510TestClassPathForkModesIT

testForkOnce 5.488
testForkAlways 5.555

Surefire569RunTestFromDependencyJarsIT

shouldScanAndRunTestsInDependencyJars 5.116

Surefire570MultipleReportDirectoriesIT

testReportWithAggregate 14.816
testReportWithoutAggregate 14.619

Surefire613TestCountInParallelIT

testParallelBuildResultCount 6.234

Surefire621TestCountingJunit3InParallelIT

testJunit3ParallelBuildResultCount 7.001
testJunit3ParallelSuiteBuildResultCount 7.132
testJunit3AllParallelBuildResultCount 6.401
testJunit3BuildResultCount 7.024
testJunit3SuiteBuildResultCount 6.476

Surefire628ConsoleOutputBeforeAndAfterClassIT

testJunit3ParallelBuildResultCount 6.992

Surefire634UnsettableSystemPropertiesWarningIT

testJunit3ParallelBuildResultCount 5.614

Surefire649EmptyStringSystemPropertiesIT

systemPropertyVariables 4.379
systemProperties 4.82

Surefire673MockitoIT

testBuildFailingWhenErrors 6.054

Surefire674BuildFailingWhenErrorsIT

testBuildFailingWhenErrors 5.674

Surefire674BuildFailingWhenFailsafeErrorsIT

testBuildFailingWhenErrors 6.771

Surefire685CommaSeparatedIncludesIT

testBuildFailingWhenErrors 6.047

Surefire697NiceSummaryIT

testBuildFailingWhenErrors 7.143

Surefire705ParallelForkTimeoutIT

testTimeoutForked 8.976

Surefire733AllOverrridesCapturedIT

testLogOutput 8.121

Surefire735ForkFailWithRedirectConsoleOutputIT

vmStartFail 5.516
vmStartFailShouldFailBuildk 5.082

Surefire740TruncatedCommaIT

testRussianLocaleReport 4.897

Surefire747MethodParallelWithSuiteCountIT

testMethodsParallelWithSuite 10.67
testClassesParallelWithSuite 12.57

Surefire772BothReportsIT

testSkippedSurefireReportGeneration 3.874
testSkippedFailsafeReportGeneration 3.609
testReportGeneration 3.792

Surefire772NoFailsafeReportsIT

testSkippedFailsafeReportGeneration 3.448
testForcedFailsafeReportGeneration 3.655
testSkipForcedFailsafeReportGeneration 3.454
testReportGeneration 3.613

Surefire772NoSurefireReportsIT

testOptionalSurefireReportGeneration 3.623
testSkippedSurefireReportGeneration 3.651
testSkipOptionalSurefireReportGeneration 4.919
testReportGeneration 4.923

Surefire772SpecifiedReportsIT

testSkippedSurefireReportGeneration 5.223
testSkippedFailsafeReportGeneration 4.29
testReportGeneration 5.645

Surefire801ForkModeNoneClassLoaderIT

testSHouldBeOkWithForkNever 5.948

Surefire803MultiFailsafeExecsIT

testOneExecutionRunInTwoBuilds 14.468
testSecondExecutionRunsAfterFirstExecutionFails 7.226

Surefire806SpecifiedTestControlsIT

singleTestInSingleExecutionProject 5.243
twoSpecifiedTestExecutionsInCorrectExecutionBlocks
+ [ Detail ]
 0
since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
singleTestInOneExecutionOfMultiExecutionProject
+ [ Detail ]
 0
since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution

Surefire809GroupExpressionsIT

testNGRunCategoryAB 7.757
testExcludedGroups 6.575
testJUnitRunCategoryNotC 6.458
incorrectJUnitVersions 3.366
categoryAB 6.409
testNGRunCategoryNotC 7.751

Surefire812Log4JClassLoaderIT

testJunit3ParallelBuildResultCount 5.203

Surefire817SystemExitIT

systemExit1 6.44

Surefire818NpeIgnoresTestsIT

testBuildFailingWhenErrors 5.579

Surefire828EmptyGroupExprIT

testJUnitRunEmptyExcludeGroups 6.059
testJUnitRunEmptyGroups 6.371
testTestNGRunEmptyExcludeGroups 6.986
testTestNGRunEmptyGroups 6.404

Surefire832ProviderSelectionIT

testJUnitRunCategoryAB 5.923

Surefire839TestWithoutCategoriesIT

classWithoutCategoryForked 5.991
classWithoutCategory 5.569

Surefire847AdditionalFailureIT

testJUnitRunCategoryAB 5.47

Surefire855AllowFailsafeUseArtifactFileIT

jarNotForkingShouldUseFile 9.892
jarShouldUseFile 8.222
warShouldUseClasses 8.735
osgiBundleShouldUseFile 9.136

Surefire901MIssingResultfileWhenNoTestsIT

failsafeWithNoTests 3.903

Surefire907PerThreadWithoutThreadCountIT

categoryAB 3.734

Surefire920TestFailureIgnoreWithTimeoutIT

timeoutInForkWithBuildFail 6.631
timeoutInForkWithNoBuildFail 5.915

Surefire926FailureWith2ProvidersIT

testBuildFailingWhenErrors 6.527

Surefire930TestNgSuiteXmlIT

suiteXmlRun 6.196

Surefire943ReportContentIT

test_noParallel 12.155
test_parallelBoth 6.259

Surefire946KillMainProcessInReusableForkIT

testExit 7.01
testHalt 7.03
testInterrupt 7.061

Surefire972BizarreNoClassDefIT

testJunit3ParallelBuildResultCount 5.817

Surefire975DefaultVMEncodingIT

runWithRussian1251 4.593

Surefire979WrongClassLoaderIT

wrongClassloaderUSedInSmartStacktraceparser 6.232

Surefire985ParameterizedRunnerAndCategoriesIT

test 4.349

Surefire995CategoryInheritanceIT

junit411ShouldRunExplicitCategory 4.02
junit411ShouldExcludeExplicitCategory 4.217
junit412ShouldExcludeInheritedCategory 4.062
junit412ShouldRunInheritedCategory 4.184
negativeTestShouldRunAllCategories 3.676

JUnit44HamcrestIT

testJUnit44Hamcrest 4.829

JUnit47ConcurrencyIT

test47 5.08

JUnit47ParallelIT

unknownThreadCountClasses 3.603
threadCountSuites 8.05
unlimitedThreadsSuitesAndMethods1 5.628
unlimitedThreadsSuitesAndMethods2 5.579
unknownThreadCountMethods 3.54
threadCountClassesAndMethods 5.71
reusableThreadCountClassesAndMethodsOptimized 6.577
unknownThreadCountSuites 3.523
reusableThreadCountAll 5.324
forcedShutdown 6.83
unknownThreadCountAll 3.478
serial 11.086
reusableThreadCountAllOptimized 5.51
suites 7.984
unlimitedThreadsMethods1 6.965
unlimitedThreadsMethods2 6.891
unlimitedThreadsSuitesAndClasses1 5.266
unlimitedThreadsSuitesAndClasses2 5.425
threadCountAllOptimized 5.589
threadCountAll 5.729
everyThreadCountSuitesAndClasses 5.361
unknownThreadCountBoth 3.539
threadCountSuitesAndClassesOptimized 5.429
classesAndMethods 5.335
everyThreadCountSuitesAndMethods 5.642
unknownThreadCountSuitesAndClasses 3.686
reusableThreadCountSuitesAndClassesOptimized 6.214
unknownThreadCountSuitesAndMethods 3.549
suitesAndClasses 5.46
suitesAndMethods 5.672
shutdown 9.168
threadCountClassesAndMethodsOneCore 9.349
everyThreadCountClassesAndMethods 5.782
all 4.904
unknownThreadCountClassesAndMethods 4.078
threadCountSuitesAndMethodsOptimized 6.73
reusableThreadCountSuitesAndMethodsOptimized 6.255
unlimitedThreadsClasses1 6.818
unlimitedThreadsClasses2 6.875
threadCountClasses 6.779
everyThreadCountAll 6.277
threadCountMethods 7.196
unlimitedThreadsSuites1 9.012
unlimitedThreadsSuites2 8.386
threadCountSuitesAndClasses 5.672
unlimitedThreadsClassesAndMethods1 5.671
unlimitedThreadsClassesAndMethods2 5.289
threadCountSuitesAndMethods 5.914
classes 6.508
reusableThreadCountSuitesAndClasses 6.563
methods 7.19
reusableThreadCountSuitesAndMethods 7.433
timeoutAndForcedShutdown 7.166
threadCountClassesAndMethodsOptimized 6.07
unlimitedThreadsAll1 5.215
unlimitedThreadsAll2 5.119
forcedShutdownVerifyingLogs 5.596
threadCountClassesAndMethodsOneCoreOptimized 9.42
reusableThreadCountClassesAndMethods 6.307

JUnit47ParallelNotThreadSafeIT

test 4.188

JUnit47RedirectOutputIT

testClassesParallel 5.385
testPrintSummaryTrueWithRedirect 5.441

JUnit47RerunFailingTestWithCucumberIT

testRerunFailingErrorTestsFalse 5.044
testRerunFailingErrorTestsWithOneRetry 4.848
testRerunFailingErrorTestsTwoRetry 4.76

JUnit47StaticInnerClassTestsIT

testStaticInnerClassTests 4.281

JUnit47WithCucumberIT

testWithParallelClasses 4.815
testWithoutParallel 4.587

JUnit48TestCategoriesIT

testCategoriesACFullyQualifiedClassName 5.55
testBadCategoryForkAlways 7.49
testCategoriesABForkAlways 8.536
testCategoriesBadCategory 7.805
testCategoriesACClassNameSuffix 7.753
testCategoriesACFullyQualifiedClassNameForkAlways 9.769
testCategoriesAB 5.565
testCategoriesACClassNameSuffixForkAlways 7.349

JUnit4ForkAlwaysStaticInitPollutionIT

testJunit4Ignore 5.674

JUnit4IgnoreIT

testJunit4Ignore 5.669
testJunit47ParallelIgnore 6.19

JUnit4RerunFailingTestsIT

testRerunFailingErrorTestsFalse 25.626
testRerunFailingErrorTestsWithOneRetry 22.264
testRerunFailingErrorTestsTwoRetry 22.443
testRerunOneTestMethod 21.812
testRerunOneTestClass 22.083

JUnit4RunListenerIT

testJUnit4RunListener 5.299
testRunlistenerJunitCoreProvider 5.655

JUnit4VersionsIT

testJunit[0: JUnit 4.0] 5.179
testJunit[1: JUnit 4.1] 5.21
testJunit[2: JUnit 4.2] 5.069
testJunit[3: JUnit 4.3] 5.061
testJunit[4: JUnit 4.3.1] 5.948
testJunit[5: JUnit 4.4] 5.601
testJunit[6: JUnit 4.5] 5.008
testJunit[7: JUnit 4.6] 5.016
testJunit[8: JUnit 4.7] 5.326
testJunit[9: JUnit 4.8] 5.192
testJunit[10: JUnit 4.8.1] 5.438
testJunit[11: JUnit 4.8.2] 5.021
testJunit[12: JUnit 4.9] 5.588
testJunit[13: JUnit 4.10] 5.095
testJunit[14: JUnit 4.11] 5.129
testJunit[15: JUnit 4.12] 5.309

JUnitDepIT

testJUnit44DepWithSneaky381 5.753
testJUnit44Dep 5.307
testJUnit47Dep 5.859
testJUnit48Dep 5.718

JUnitPlatformEnginesIT

testToRegex[1.0.0] 0.003
platform[1.0.0] 6.052
testToRegex[1.1.1] 0
platform[1.1.1] 7.029
testToRegex[1.2.0] 0
platform[1.2.0] 6.009
testToRegex[1.3.1] 0
platform[1.3.1] 5.932
testToRegex[1.4.0-SNAPSHOT] 0
platform[1.4.0-SNAPSHOT] 9.037

JUnitPlatformIT

testVintageEngine 5.478
testTags 5.496
testJQwikEngine 5.637
testMultipleEngines 6.04
testJupiterEngine 5.554

LongWindowsPathIT

shouldRunInSystemTmp 4.969

ModulePathIT

testModulePath
+ [ Detail ]
 0.001
skipped

NoRunnableTestsInClassIT

testJunit3ParallelBuildResultCount 5.25

PlainOldJavaClasspathIT

testPlainOldJavaClasspath 4.909

PlexusConflictIT

testPlexusConflict 5.184
testPlexusConflictIsolatedClassLoader 4.906

PojoSimpleIT

testit 5.175

ReportersIT

testRedirectOutputTestNg 5.239

ResultCountingIT

testCountingWithJunit481ForkAlways 8.134
testCountingWithJunit481ForkOnce 5.179
testCountingWithJunit481ForkNever 4.18

RunOrderIT

testReverseAlphabetical 4.966
testNonExistingRunOrder 3.822
testHourly 5.182
testAlphabetical 5.16

RunOrderParallelForksIT

testReverseAlphabetical 5.219
testNonExistingRunOrder 3.542
testHourly 5.069
testAlphabetical 5.222

SiblingAggregatorIT

testSiblingAggregator 4.418

SmartStackTraceIT

misg 4.941

SystemPropertiesTestIT

testSystemProperties 5.056
testSystemPropertiesNoFork 4.149

TestMethodPatternIT

testJUnit48WithCategoryFilter 5.372
testJUnit48Provider47 5.455
testMethodPatternAfter 5.224
testTestNGMethodPattern 5.327
testJUnit48Provider4 5.177
testJUnit44 4.75
testTestNgMethodBefore 5.355

TestMultipleMethodPatternsIT

shouldNotRunExcludedClassesAndMethods[0] 4.31
shouldMatchExactClassAndMethodCharacters[0] 3.941
shouldMatchExactClassAndMethodWildcard[0] 3.962
testSuccessTwo[0] 4.542
simpleNameTest[0] 4.989
simpleNameTestWithJavaExt[0] 4.187
regexClass[0] 4.219
shouldNotRunExcludedClasses[0] 4.343
shouldNotRunExcludedMethods[0] 4.289
simpleNameTestWithJavaExtWildcardPkg[0] 4.264
shouldMatchMultiplePatterns[0] 4.337
shouldMatchExactClassAndMethodsPostfix[0] 4.014
simpleNameTestWithWildcardPkg[0] 4.232
shouldMatchWildcardPackageAndClassAndMethod[0] 3.967
shouldMatchExactClassAndMultipleMethods[0] 4.239
fullyQualifiedTest[0] 4.531
matchSimpleClassAndMethodWithJavaExtWildcardPkg[0] 4.041
negativeTest[0]
+ [ Detail ]
 0
skipped
testRegexSuccessTwo[0] 4.266
shouldMatchExactClassAndMethodsWildcard[0] 4.2
shouldMatchMultiplePatternsComplex[0] 4.079
simpleNameTestAsParallel[0]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithWildcardPkg[0] 3.943
shouldMatchMultiplePatternsAsParallel[0]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[0] 3.961
shouldMatchSimpleClassNameAndMethod[0] 4.048
shouldMatchExactClassAndMethodPostfix[0] 3.967
shouldMatchMultiplePatternsComplexAsParallel[0]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[0] 3.97
regexClassAndMethod[0] 4.336
shouldNotRunExcludedClassesAndMethods[1] 4.978
shouldMatchExactClassAndMethodCharacters[1] 4.493
shouldMatchExactClassAndMethodWildcard[1] 4.613
testSuccessTwo[1] 4.695
simpleNameTest[1] 4.397
simpleNameTestWithJavaExt[1] 4.435
regexClass[1] 4.467
shouldNotRunExcludedClasses[1] 4.678
shouldNotRunExcludedMethods[1] 5.301
simpleNameTestWithJavaExtWildcardPkg[1] 4.62
shouldMatchMultiplePatterns[1] 4.691
shouldMatchExactClassAndMethodsPostfix[1] 4.529
simpleNameTestWithWildcardPkg[1] 4.597
shouldMatchWildcardPackageAndClassAndMethod[1] 4.469
shouldMatchExactClassAndMultipleMethods[1] 4.574
fullyQualifiedTest[1] 4.472
matchSimpleClassAndMethodWithJavaExtWildcardPkg[1] 5.262
negativeTest[1]
+ [ Detail ]
 0.001
skipped
testRegexSuccessTwo[1] 4.76
shouldMatchExactClassAndMethodsWildcard[1] 4.531
shouldMatchMultiplePatternsComplex[1] 5.124
simpleNameTestAsParallel[1] 6.008
matchSimpleClassAndMethodWithWildcardPkg[1] 4.671
shouldMatchMultiplePatternsAsParallel[1] 4.724
shouldNotRunExcludedClassesIfIncluded[1] 4.441
shouldMatchSimpleClassNameAndMethod[1] 4.424
shouldMatchExactClassAndMethodPostfix[1] 4.589
shouldMatchMultiplePatternsComplexAsParallel[1] 4.697
matchSimpleClassAndMethodWithJavaExt[1] 4.45
regexClassAndMethod[1] 4.623
shouldNotRunExcludedClassesAndMethods[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[2]
+ [ Detail ]
 0.001
skipped
shouldMatchExactClassAndMethodWildcard[2]
+ [ Detail ]
 0
skipped
testSuccessTwo[2]
+ [ Detail ]
 0
skipped
simpleNameTest[2] 4.317
simpleNameTestWithJavaExt[2] 4.029
regexClass[2] 4.025
shouldNotRunExcludedClasses[2] 4.017
shouldNotRunExcludedMethods[2]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[2] 4.109
shouldMatchMultiplePatterns[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[2]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[2] 3.997
shouldMatchWildcardPackageAndClassAndMethod[2]
+ [ Detail ]
 0.001
skipped
shouldMatchExactClassAndMultipleMethods[2]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[2] 4.112
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2]
+ [ Detail ]
 0
skipped
negativeTest[2] 3.629
testRegexSuccessTwo[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[2]
+ [ Detail ]
 0.001
skipped
simpleNameTestAsParallel[2]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithWildcardPkg[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[2]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[2] 4.177
shouldMatchSimpleClassNameAndMethod[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[2]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[2]
+ [ Detail ]
 0
skipped
regexClassAndMethod[2]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesAndMethods[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[3]
+ [ Detail ]
 0
skipped
testSuccessTwo[3]
+ [ Detail ]
 0
skipped
simpleNameTest[3] 4.608
simpleNameTestWithJavaExt[3] 4.497
regexClass[3] 4.445
shouldNotRunExcludedClasses[3] 4.454
shouldNotRunExcludedMethods[3]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[3] 4.378
shouldMatchMultiplePatterns[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[3]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[3] 4.515
shouldMatchWildcardPackageAndClassAndMethod[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[3]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[3] 4.635
matchSimpleClassAndMethodWithJavaExtWildcardPkg[3]
+ [ Detail ]
 0
skipped
negativeTest[3] 4.441
testRegexSuccessTwo[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[3]
+ [ Detail ]
 0.001
skipped
shouldMatchMultiplePatternsComplex[3]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[3] 5.029
matchSimpleClassAndMethodWithWildcardPkg[3]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[3]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[3] 5.506
shouldMatchSimpleClassNameAndMethod[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[3]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[3]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[3]
+ [ Detail ]
 0
skipped
regexClassAndMethod[3]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesAndMethods[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[4]
+ [ Detail ]
 0.001
skipped
shouldMatchExactClassAndMethodWildcard[4]
+ [ Detail ]
 0
skipped
testSuccessTwo[4]
+ [ Detail ]
 0
skipped
simpleNameTest[4] 5.381
simpleNameTestWithJavaExt[4] 4.698
regexClass[4] 3.858
shouldNotRunExcludedClasses[4] 4.041
shouldNotRunExcludedMethods[4]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[4] 5.598
shouldMatchMultiplePatterns[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[4]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[4] 5.779
shouldMatchWildcardPackageAndClassAndMethod[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[4]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[4] 4.917
matchSimpleClassAndMethodWithJavaExtWildcardPkg[4]
+ [ Detail ]
 0
skipped
negativeTest[4] 4.322
testRegexSuccessTwo[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[4]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[4]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[4]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithWildcardPkg[4]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[4]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[4] 4.085
shouldMatchSimpleClassNameAndMethod[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[4]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[4]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[4]
+ [ Detail ]
 0
skipped
regexClassAndMethod[4]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesAndMethods[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[5]
+ [ Detail ]
 0
skipped
testSuccessTwo[5]
+ [ Detail ]
 0
skipped
simpleNameTest[5] 4.289
simpleNameTestWithJavaExt[5] 4.359
regexClass[5] 4.313
shouldNotRunExcludedClasses[5] 4.288
shouldNotRunExcludedMethods[5]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[5] 4.198
shouldMatchMultiplePatterns[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[5]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[5] 4.295
shouldMatchWildcardPackageAndClassAndMethod[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[5]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[5] 4.155
matchSimpleClassAndMethodWithJavaExtWildcardPkg[5]
+ [ Detail ]
 0
skipped
negativeTest[5] 3.56
testRegexSuccessTwo[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[5]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[5]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[5] 4.269
matchSimpleClassAndMethodWithWildcardPkg[5]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[5]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[5] 4.245
shouldMatchSimpleClassNameAndMethod[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[5]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[5]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[5]
+ [ Detail ]
 0
skipped
regexClassAndMethod[5]
+ [ Detail ]
 0
skipped

TestMultipleMethodPatternsTestNGIT

shouldNotRunExcludedClassesAndMethods[0] 4.25
shouldMatchExactClassAndMethodCharacters[0] 4.133
shouldMatchExactClassAndMethodWildcard[0] 4.112
testSuccessTwo[0] 4.381
simpleNameTest[0] 3.993
simpleNameTestWithJavaExt[0] 4.132
regexClass[0] 4.141
shouldNotRunExcludedClasses[0] 4.112
shouldNotRunExcludedMethods[0] 4.24
simpleNameTestWithJavaExtWildcardPkg[0] 4.379
shouldMatchMultiplePatterns[0] 4.083
shouldMatchExactClassAndMethodsPostfix[0] 4.044
simpleNameTestWithWildcardPkg[0] 4.038
shouldMatchWildcardPackageAndClassAndMethod[0] 4.064
shouldMatchExactClassAndMultipleMethods[0] 4.079
fullyQualifiedTest[0] 4.074
matchSimpleClassAndMethodWithJavaExtWildcardPkg[0] 4.05
negativeTest[0]
+ [ Detail ]
 0
skipped
testRegexSuccessTwo[0] 4.327
shouldMatchExactClassAndMethodsWildcard[0] 4.118
shouldMatchMultiplePatternsComplex[0] 4.565
simpleNameTestAsParallel[0] 4.211
matchSimpleClassAndMethodWithWildcardPkg[0] 4.248
shouldMatchMultiplePatternsAsParallel[0] 5.397
shouldNotRunExcludedClassesIfIncluded[0] 5.675
shouldMatchSimpleClassNameAndMethod[0] 4.451
shouldMatchExactClassAndMethodPostfix[0] 4.163
shouldMatchMultiplePatternsComplexAsParallel[0] 4.308
matchSimpleClassAndMethodWithJavaExt[0] 4.087
regexClassAndMethod[0] 4.035
shouldNotRunExcludedClassesAndMethods[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[1]
+ [ Detail ]
 0
skipped
testSuccessTwo[1]
+ [ Detail ]
 0
skipped
simpleNameTest[1] 4.036
simpleNameTestWithJavaExt[1] 4.125
regexClass[1] 4.027
shouldNotRunExcludedClasses[1] 4.193
shouldNotRunExcludedMethods[1]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[1] 4.197
shouldMatchMultiplePatterns[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[1]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[1] 4.095
shouldMatchWildcardPackageAndClassAndMethod[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[1]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[1] 4.072
matchSimpleClassAndMethodWithJavaExtWildcardPkg[1]
+ [ Detail ]
 0.001
skipped
negativeTest[1] 3.59
testRegexSuccessTwo[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[1]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[1]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[1] 4.131
matchSimpleClassAndMethodWithWildcardPkg[1]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[1]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[1] 4.066
shouldMatchSimpleClassNameAndMethod[1]
+ [ Detail ]
 0.001
skipped
shouldMatchExactClassAndMethodPostfix[1]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[1]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[1]
+ [ Detail ]
 0
skipped
regexClassAndMethod[1]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesAndMethods[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[2]
+ [ Detail ]
 0
skipped
testSuccessTwo[2]
+ [ Detail ]
 0
skipped
simpleNameTest[2] 3.972
simpleNameTestWithJavaExt[2] 4.023
regexClass[2] 3.988
shouldNotRunExcludedClasses[2] 4.12
shouldNotRunExcludedMethods[2]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[2] 4.007
shouldMatchMultiplePatterns[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[2]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[2] 4.103
shouldMatchWildcardPackageAndClassAndMethod[2]
+ [ Detail ]
 0.001
skipped
shouldMatchExactClassAndMultipleMethods[2]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[2] 4.038
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2]
+ [ Detail ]
 0
skipped
negativeTest[2] 3.602
testRegexSuccessTwo[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[2]
+ [ Detail ]
 0.001
skipped
simpleNameTestAsParallel[2] 3.992
matchSimpleClassAndMethodWithWildcardPkg[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[2]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[2] 4.162
shouldMatchSimpleClassNameAndMethod[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[2]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[2]
+ [ Detail ]
 0
skipped
regexClassAndMethod[2]
+ [ Detail ]
 0
skipped

TestMultipleMethodsIT

testJunit48Provider4 4.917
testJunit44 3.82
testJunit48Provider47 5.575

TestNgGroupsIT

testExclusion 5.558
testGroupsAndExclusion 5.42
groupsWithDash 5.387
testOnlyGroups 5.543
groupsBySimpleRegex 5.409

TestNgParallelWithAnnotationsIT

testTestNgGroupThreadParallel 5.964

TestNgSuccessPercentageIT

testPassesWhenFailuresLessThanSuccessPercentage 4.005

TestSingleMethodIT

fullyQualifiedTestNg 5.013
testJunit48Provider4 4.884
testJunit44 4.795
testJunit48parallel 5.128
testJunit48Provider47 5.146
fullyQualifiedJunit48Provider47 5.26
fullyQualifiedJunit48Provider4 4.729
testTestNg5149 5.148
testTestNg 5.144

TimeoutForkedTestIT

testTimeoutForked 5.34

TwoTestCasesIT

testJunit4Suite 4.786
testTestNGSuite 5.111
testTwoTestCases 4.768
testTwoTestCaseSuite 4.728

UmlautDirIT

testUmlautIsolatedClassLoader 4.908
testUmlaut 5.024

UnicodeTestNamesIT

checkFileNamesWithUnicode 7.668

UseIsolatedClassLoaderIT

testUseSystemClassLoader 4.505

WorkingDirectoryIsInvalidPropertyIT

testWorkingDirectory 3.221

WorkingDirectoryIT

testWorkingDirectory 4.626
testWorkingDirectoryChildOnlyNoFork 3.635
testWorkingDirectoryNoFork 3.583
testWorkingDirectoryChildOnly 4.825

WorkingDirectoryMissingIT

testWorkingDirectory 4.536

XmlReporterRunTimeIT

testForkModeAlways 22.869

Failure Details

[Summary] [Package List] [Test Cases]


XXXtest50
skipped: 5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
XXXtest501
skipped: 5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
shouldLoadMultipleJavaModules_JavaHome
skipped: skipped
shouldLoadMultipleJavaModules_ToolchainsXML
skipped: skipped
shouldLoadMultipleJavaModules_JvmParameter
skipped: skipped
shouldRunInPluginJava9
skipped: skipped
twoSpecifiedTestExecutionsInCorrectExecutionBlocks
skipped: since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
singleTestInOneExecutionOfMultiExecutionProject
skipped: since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
testModulePath
skipped: skipped
negativeTest[0]
skipped: skipped
simpleNameTestAsParallel[0]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[0]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[0]
skipped: skipped
negativeTest[1]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[2]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[2]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[2]
skipped: skipped
testSuccessTwo[2]
skipped: skipped
shouldNotRunExcludedMethods[2]
skipped: skipped
shouldMatchMultiplePatterns[2]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[2]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[2]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2]
skipped: skipped
testRegexSuccessTwo[2]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[2]
skipped: skipped
shouldMatchMultiplePatternsComplex[2]
skipped: skipped
simpleNameTestAsParallel[2]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[2]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[2]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[2]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[2]
skipped: skipped
regexClassAndMethod[2]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[3]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[3]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[3]
skipped: skipped
testSuccessTwo[3]
skipped: skipped
shouldNotRunExcludedMethods[3]
skipped: skipped
shouldMatchMultiplePatterns[3]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[3]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[3]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[3]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[3]
skipped: skipped
testRegexSuccessTwo[3]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[3]
skipped: skipped
shouldMatchMultiplePatternsComplex[3]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[3]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[3]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[3]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[3]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[3]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[3]
skipped: skipped
regexClassAndMethod[3]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[4]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[4]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[4]
skipped: skipped
testSuccessTwo[4]
skipped: skipped
shouldNotRunExcludedMethods[4]
skipped: skipped
shouldMatchMultiplePatterns[4]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[4]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[4]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[4]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[4]
skipped: skipped
testRegexSuccessTwo[4]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[4]
skipped: skipped
shouldMatchMultiplePatternsComplex[4]
skipped: skipped
simpleNameTestAsParallel[4]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[4]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[4]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[4]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[4]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[4]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[4]
skipped: skipped
regexClassAndMethod[4]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[5]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[5]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[5]
skipped: skipped
testSuccessTwo[5]
skipped: skipped
shouldNotRunExcludedMethods[5]
skipped: skipped
shouldMatchMultiplePatterns[5]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[5]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[5]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[5]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[5]
skipped: skipped
testRegexSuccessTwo[5]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[5]
skipped: skipped
shouldMatchMultiplePatternsComplex[5]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[5]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[5]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[5]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[5]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[5]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[5]
skipped: skipped
regexClassAndMethod[5]
skipped: skipped
negativeTest[0]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[1]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[1]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[1]
skipped: skipped
testSuccessTwo[1]
skipped: skipped
shouldNotRunExcludedMethods[1]
skipped: skipped
shouldMatchMultiplePatterns[1]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[1]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[1]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[1]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[1]
skipped: skipped
testRegexSuccessTwo[1]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[1]
skipped: skipped
shouldMatchMultiplePatternsComplex[1]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[1]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[1]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[1]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[1]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[1]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[1]
skipped: skipped
regexClassAndMethod[1]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[2]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[2]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[2]
skipped: skipped
testSuccessTwo[2]
skipped: skipped
shouldNotRunExcludedMethods[2]
skipped: skipped
shouldMatchMultiplePatterns[2]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[2]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[2]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2]
skipped: skipped
testRegexSuccessTwo[2]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[2]
skipped: skipped
shouldMatchMultiplePatternsComplex[2]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[2]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[2]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[2]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[2]
skipped: skipped
regexClassAndMethod[2]
skipped: skipped