Fork me on GitHub
Built by Maven

Surefire Report

Summary

[Summary] [Package List] [Test Cases]


Tests Errors Failures Skipped Success Rate Time
782 0 0 141 81.969% 4,575.863

Note: failures are anticipated and checked for with assertions while errors are unanticipated.


Package List

[Summary] [Package List] [Test Cases]


Package Tests Errors Failures Skipped Success Rate Time
org.apache.maven.surefire.its 600 0 0 130 78.333% 3,340.604
org.apache.maven.surefire.its.jiras 182 0 0 11 93.956% 1,235.26

Note: package statistics are not computed recursively, they only sum up all of its testsuites numbers.

org.apache.maven.surefire.its

Class Tests Errors Failures Skipped Success Rate Time
AbstractTestCaseIT 1 0 0 0 100% 7.215
AdditionalClasspathIT 1 0 0 0 100% 5.047
AggregateReportIT 1 0 0 0 100% 6.425
ArgLineIT 1 0 0 0 100% 5.925
ArgLinePropertiesIT 1 0 0 0 100% 7.326
AssumptionFailureReportIT 1 0 0 0 100% 5.271
CheckSingleTestIT 4 0 0 0 100% 18.733
CheckTestFailIfNoTestsForkModeIT 6 0 0 0 100% 29.105
CheckTestFailIfNoTestsIT 3 0 0 0 100% 10.718
CheckTestNgBeforeMethodFailureIT 1 0 0 0 100% 7.132
CheckTestNgBeforeMethodIT 1 0 0 0 100% 6.438
CheckTestNgCustomObjectFactoryIT 1 0 0 0 100% 5.216
CheckTestNgCustomTestRunnerFactoryIT 1 0 0 0 100% 5.327
CheckTestNgExecuteErrorIT 1 0 0 0 100% 6.332
CheckTestNgGroupThreadParallelIT 1 0 0 0 100% 5.351
CheckTestNgJdk14IT 1 0 0 0 100% 7.05
CheckTestNgListenerReporterIT 8 0 0 0 100% 57.739
CheckTestNgListenersIT 1 0 0 0 100% 6.397
CheckTestNgPathWithSpacesIT 1 0 0 0 100% 6.301
CheckTestNgReportTestIT 3 0 0 0 100% 19.863
CheckTestNgSuiteXmlIT 3 0 0 0 100% 20.651
CheckTestNgSuiteXmlSingleIT 1 0 0 0 100% 6.69
CheckTestNgVersionsIT 20 0 0 2 90% 128.491
ClasspathFilteringIT 1 0 0 0 100% 6.004
ClassPathOrderIT 1 0 0 0 100% 5.382
ClasspathScopeFilteringIT 1 0 0 0 100% 5.003
ConsoleOutputIT 4 0 0 0 100% 31.366
CrashDetectionIT 3 0 0 0 100% 19.417
DefaultConfigurationIT 1 0 0 0 100% 4.76
EnvironmentVariableIT 1 0 0 0 100% 6.405
EnvironmentVariablesIT 2 0 0 0 100% 12.392
FailFastJUnitIT 12 0 0 0 100% 248.848
FailFastTestNgIT 6 0 0 0 100% 125.626
ForkConsoleOutputIT 4 0 0 0 100% 25.647
ForkConsoleOutputWithErrorsIT 1 0 0 0 100% 6.506
ForkModeIT 12 0 0 0 100% 145.715
ForkModeMultiModuleIT 4 0 0 0 100% 38.988
ForkModeTestNGIT 12 0 0 0 100% 114.304
IncludesExcludesFromFileIT 6 0 0 0 100% 34.636
IncludesExcludesIT 3 0 0 0 100% 17.765
Java9FullApiIT 3 0 0 0 100% 27.082
JUnit44HamcrestIT 1 0 0 0 100% 6
JUnit47ConcurrencyIT 1 0 0 0 100% 6.301
JUnit47ParallelIT 59 0 0 0 100% 396.232
JUnit47ParallelNotThreadSafeIT 1 0 0 0 100% 5.24
JUnit47RedirectOutputIT 2 0 0 0 100% 13.16
JUnit47RerunFailingTestWithCucumberIT 3 0 0 0 100% 19.892
JUnit47StaticInnerClassTestsIT 1 0 0 0 100% 5.296
JUnit47WithCucumberIT 2 0 0 0 100% 12.92
JUnit48TestCategoriesIT 8 0 0 0 100% 60.885
JUnit4ForkAlwaysStaticInitPollutionIT 1 0 0 0 100% 8.264
JUnit4IgnoreIT 2 0 0 0 100% 12.632
JUnit4RerunFailingTestsIT 5 0 0 0 100% 128.857
JUnit4RunListenerIT 2 0 0 0 100% 12.927
JUnit4VersionsIT 16 0 0 0 100% 102.791
JUnitDepIT 4 0 0 0 100% 27.375
JUnitPlatformEnginesIT 10 0 0 0 100% 43.423
JUnitPlatformIT 5 0 0 0 100% 35.306
LongWindowsPathIT 1 0 0 0 100% 6.315
ModulePathIT 2 0 0 0 100% 16.785
NoRunnableTestsInClassIT 1 0 0 0 100% 6.375
PlainOldJavaClasspathIT 1 0 0 0 100% 5.953
PlexusConflictIT 2 0 0 0 100% 12.767
PojoSimpleIT 1 0 0 0 100% 6.114
ReportersIT 1 0 0 0 100% 6.374
ResultCountingIT 3 0 0 0 100% 22.653
RunOrderIT 4 0 0 0 100% 22.413
RunOrderParallelForksIT 4 0 0 0 100% 22.425
SiblingAggregatorIT 1 0 0 0 100% 6.166
SmartStackTraceIT 1 0 0 0 100% 6.217
Surefire1602IT 1 0 0 0 100% 14.391
SystemPropertiesTestIT 2 0 0 0 100% 12.238
TestMethodPatternIT 7 0 0 0 100% 44.209
TestMultipleMethodPatternsIT 180 0 0 87 51.667% 474.455
TestMultipleMethodPatternsTestNGIT 90 0 0 41 54.444% 256.765
TestMultipleMethodsIT 3 0 0 0 100% 17.808
TestNgGroupsIT 5 0 0 0 100% 34.102
TestNgParallelWithAnnotationsIT 1 0 0 0 100% 7.608
TestNgSuccessPercentageIT 1 0 0 0 100% 4.966
TestSingleMethodIT 9 0 0 0 100% 57.483
TimeoutForkedTestIT 1 0 0 0 100% 7.556
TwoTestCasesIT 4 0 0 0 100% 25.012
UmlautDirIT 2 0 0 0 100% 12.605
UnicodeTestNamesIT 1 0 0 0 100% 8.713
UseIsolatedClassLoaderIT 1 0 0 0 100% 5.733
WorkingDirectoryIsInvalidPropertyIT 1 0 0 0 100% 4.392
WorkingDirectoryIT 4 0 0 0 100% 22.37
WorkingDirectoryMissingIT 1 0 0 0 100% 5.987
XmlReporterRunTimeIT 1 0 0 0 100% 25.563

org.apache.maven.surefire.its.jiras

Class Tests Errors Failures Skipped Success Rate Time
Surefire1024VerifyFailsafeIfTestedIT 1 0 0 0 100% 5.895
Surefire1028UnableToRunSingleIT 1 0 0 0 100% 5.189
Surefire1036NonFilterableJUnitRunnerWithCategoriesIT 1 0 0 0 100% 6.205
Surefire1041FailingJUnitRunnerIT 1 0 0 0 100% 6.192
Surefire1053SystemPropertiesIT 2 0 0 0 100% 12.072
Surefire1055CorrectConcurrentTestCountIT 1 0 0 0 100% 6.271
Surefire1080ParallelForkDoubleTestIT 1 0 0 0 100% 6.592
Surefire1082ParallelJUnitParameterizedIT 3 0 0 0 100% 22.535
Surefire1098BalancedRunOrderIT 1 0 0 0 100% 28.038
Surefire1122ParallelAndFlakyTestsIT 3 0 0 0 100% 17.193
Surefire1135ImproveIgnoreMessageForTestNGIT 2 0 0 0 100% 14.215
Surefire1136CwdPropagationInForkedModeIT 1 0 0 0 100% 6.144
Surefire1144XmlRunTimeIT 1 0 0 0 100% 6.49
Surefire1152RerunFailingTestsInSuiteIT 2 0 0 0 100% 11.452
Surefire1153IncludesAndSpecifiedTestIT 2 0 0 0 100% 9.751
Surefire1158RemoveInfoLinesIT 6 0 0 0 100% 37.351
Surefire1177TestngParallelSuitesIT 2 0 0 0 100% 16.257
Surefire1179IT 1 0 0 0 100% 10.007
Surefire1185DoNotSpawnTestsIT 1 0 0 0 100% 4.87
Surefire1202RerunAndSkipIT 2 0 0 0 100% 37.748
Surefire1209RerunAndForkCountIT 4 0 0 0 100% 58.411
Surefire1211JUnitTestNgIT 2 0 0 0 100% 14.227
Surefire1264IT 2 0 0 0 100% 15.639
Surefire1265Java9IT 1 0 0 0 100% 4.963
Surefire1278GroupNameEndingIT 1 0 0 0 100% 6.485
Surefire1295AttributeJvmCrashesToTestsIT 9 0 0 9 0% 0
Surefire1364SystemPropertiesIT 10 0 0 0 100% 67.012
Surefire1367AssumptionLogsIT 4 0 0 0 100% 23.09
Surefire1383ScanSessionDependenciesIT 1 0 0 0 100% 6.146
Surefire1396CustomProviderClassPathIT 1 0 0 0 100% 8.291
Surefire141PluggableProvidersIT 4 0 0 0 100% 32.322
Surefire146ForkPerTestNoSetupIT 1 0 0 0 100% 6.422
Surefire1490ReportTitleDescriptionIT 2 0 0 0 100% 28.483
Surefire1535TestNGParallelSuitesIT 4 0 0 0 100% 30.047
Surefire162CharsetProviderIT 1 0 0 0 100% 6.256
Surefire224WellFormedXmlFailuresIT 1 0 0 0 100% 5.859
Surefire257NotRerunningTestsIT 1 0 0 0 100% 8.156
Surefire260TestWithIdenticalNamesIT 1 0 0 0 100% 13.969
Surefire34SecurityManagerIT 2 0 0 0 100% 12.3
Surefire376TestNgAfterSuiteFailureIT 1 0 0 0 100% 6.568
Surefire377TestNgAndJUnitTogetherIT 2 0 0 0 100% 11.644
Surefire408ManualProviderSelectionIT 1 0 0 0 100% 5.954
Surefire42NotExtendingTestCaseIT 1 0 0 0 100% 6.197
Surefire44InnerClassTestIT 1 0 0 0 100% 5.761
Surefire500PuzzlingErrorIT 1 0 0 0 100% 6.361
Surefire510TestClassPathForkModesIT 2 0 0 0 100% 12.329
Surefire569RunTestFromDependencyJarsIT 1 0 0 0 100% 5.633
Surefire570MultipleReportDirectoriesIT 2 0 0 0 100% 31.527
Surefire613TestCountInParallelIT 1 0 0 0 100% 6.824
Surefire621TestCountingJunit3InParallelIT 5 0 0 0 100% 32.635
Surefire628ConsoleOutputBeforeAndAfterClassIT 1 0 0 0 100% 6.372
Surefire634UnsettableSystemPropertiesWarningIT 1 0 0 0 100% 5.985
Surefire649EmptyStringSystemPropertiesIT 2 0 0 0 100% 9.939
Surefire673MockitoIT 1 0 0 0 100% 7.86
Surefire674BuildFailingWhenErrorsIT 1 0 0 0 100% 6.316
Surefire674BuildFailingWhenFailsafeErrorsIT 1 0 0 0 100% 3.869
Surefire685CommaSeparatedIncludesIT 1 0 0 0 100% 6.283
Surefire697NiceSummaryIT 1 0 0 0 100% 6
Surefire705ParallelForkTimeoutIT 1 0 0 0 100% 7.926
Surefire733AllOverrridesCapturedIT 1 0 0 0 100% 6.123
Surefire735ForkFailWithRedirectConsoleOutputIT 2 0 0 0 100% 10.191
Surefire740TruncatedCommaIT 1 0 0 0 100% 4.961
Surefire747MethodParallelWithSuiteCountIT 2 0 0 0 100% 23.169
Surefire772BothReportsIT 3 0 0 0 100% 11.556
Surefire772NoFailsafeReportsIT 4 0 0 0 100% 14.911
Surefire772NoSurefireReportsIT 4 0 0 0 100% 15.537
Surefire772SpecifiedReportsIT 3 0 0 0 100% 10.987
Surefire801ForkModeNoneClassLoaderIT 1 0 0 0 100% 4.989
Surefire803MultiFailsafeExecsIT 2 0 0 0 100% 21.883
Surefire806SpecifiedTestControlsIT 3 0 0 2 33.333% 5.867
Surefire809GroupExpressionsIT 6 0 0 0 100% 36.884
Surefire812Log4JClassLoaderIT 1 0 0 0 100% 7.369
Surefire817SystemExitIT 1 0 0 0 100% 6.269
Surefire818NpeIgnoresTestsIT 1 0 0 0 100% 7.047
Surefire828EmptyGroupExprIT 4 0 0 0 100% 26.908
Surefire832ProviderSelectionIT 1 0 0 0 100% 6.464
Surefire839TestWithoutCategoriesIT 2 0 0 0 100% 13.373
Surefire847AdditionalFailureIT 1 0 0 0 100% 7.312
Surefire855AllowFailsafeUseArtifactFileIT 4 0 0 0 100% 52.389
Surefire901MIssingResultfileWhenNoTestsIT 1 0 0 0 100% 4.933
Surefire907PerThreadWithoutThreadCountIT 1 0 0 0 100% 4.58
Surefire920TestFailureIgnoreWithTimeoutIT 2 0 0 0 100% 13.882
Surefire926FailureWith2ProvidersIT 1 0 0 0 100% 5.067
Surefire930TestNgSuiteXmlIT 1 0 0 0 100% 7.146
Surefire943ReportContentIT 2 0 0 0 100% 20.065
Surefire946KillMainProcessInReusableForkIT 3 0 0 0 100% 24.095
Surefire972BizarreNoClassDefIT 1 0 0 0 100% 8.069
Surefire975DefaultVMEncodingIT 1 0 0 0 100% 6.355
Surefire979WrongClassLoaderIT 1 0 0 0 100% 6.09
Surefire985ParameterizedRunnerAndCategoriesIT 1 0 0 0 100% 5.208
Surefire995CategoryInheritanceIT 5 0 0 0 100% 25.053

Test Cases

[Summary] [Package List] [Test Cases]

AbstractTestCaseIT

abstractTestCase 7.215

AdditionalClasspathIT

additionalClasspath 5.047

AggregateReportIT

aggregateReport 6.425

ArgLineIT

argLine 5.925

ArgLinePropertiesIT

argLine 7.326

AssumptionFailureReportIT

testWriteSkippedMessageToReport 5.271

CheckSingleTestIT

singleTestDotJava 4.803
singleTestNonExistentOverride 4.536
singleTestNonExistent 4.487
singleTest 4.907

CheckTestFailIfNoTestsForkModeIT

dontFailIfNoTestsForkModeAlways 4.669
failIfNoTestsForkModeOnce 5.022
dontFailIfNoTestsForkModeNever 5.049
dontFailIfNoTestsForkModeOnce 4.795
failIfNoTestsForkModeNever 4.632
failIfNoTestsForkModeAlways 4.938

CheckTestFailIfNoTestsIT

failIfNoTests 3.404
dontFailIfNoTests 3.775
jUnit48CategoriesFailWhenNoTests 3.539

CheckTestNgBeforeMethodFailureIT

TestNgBeforeMethodFailure 7.132

CheckTestNgBeforeMethodIT

TestNgBeforeMethod 6.438

CheckTestNgCustomObjectFactoryIT

testTestNgListenerReporter 5.216

CheckTestNgCustomTestRunnerFactoryIT

testTestNgListenerReporter 5.327

CheckTestNgExecuteErrorIT

executionError 6.332

CheckTestNgGroupThreadParallelIT

TestNgGroupThreadParallel 5.351

CheckTestNgJdk14IT

TestNgJdk14 7.05

CheckTestNgListenerReporterIT

testNgListenerReporter[0: TestNG 5.6] 7.353
testNgListenerReporter[1: TestNG 5.7] 6.485
testNgListenerReporter[2: TestNG 5.10] 6.31
testNgListenerReporter[3: TestNG 5.13] 7.752
testNgListenerReporter[4: TestNG 5.14.6] 7.108
testNgListenerReporter[5: TestNG 5.14.9] 7.481
testNgListenerReporter[6: TestNG 6.0] 7.189
testNgListenerReporter[7: TestNG 6.9.9] 8.061

CheckTestNgListenersIT

TestNgListenerReporter 6.397

CheckTestNgPathWithSpacesIT

TestWithSpaces 6.301

CheckTestNgReportTestIT

testNgReport 7.021
shouldNotBeVerbose 6.466
shouldBeVerbose 6.376

CheckTestNgSuiteXmlIT

suiteXml 6.34
suiteXmlForkCountTwoReuse 6.723
suiteXmlForkModeAlways 7.588

CheckTestNgSuiteXmlSingleIT

TestNgSuite 6.69

CheckTestNgVersionsIT

XXXtest50
+ [ Detail ]
 0
5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
test502 6.983
test510 6.419
test511 7.171
test512 7.55
test513 6.543
test514 7.467
test685 7.453
test5131 7.658
test5141 7.564
test5142 7.927
test47 7.443
test51 7.335
test55 7.433
test56 6.36
test57 6.084
test58 7.452
test59 7.283
test60 6.366
XXXtest501
+ [ Detail ]
 0
5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024

ClasspathFilteringIT

additionalClasspath 6.004

ClassPathOrderIT

classPathOrder 5.382

ClasspathScopeFilteringIT

additionalClasspath 5.003

ConsoleOutputIT

properNewlinesAndEncodingWithDifferentEncoding 6.431
properNewlinesAndEncodingWithDefaultEncodings 7.527
largerSoutThanMemory 12.21
properNewlinesAndEncodingWithoutFork 5.198

CrashDetectionIT

hardCrashInReusableFork 7.054
crashInReusableFork 6.285
crashInFork 6.078

DefaultConfigurationIT

defaultConfiguration 4.76

EnvironmentVariableIT

environmentVariable 6.405

EnvironmentVariablesIT

testWhenUseSystemClassLoader 6.306
testWhenDontUseSystemClassLoader 6.086

FailFastJUnitIT

test[junit4-oneFork-ff1] 10.082
test[junit47-oneFork-ff1] 9.999
test[junit4-oneFork-ff2] 18.623
test[junit47-oneFork-ff2] 18.832
test[junit4-twoForks-ff1] 15.367
test[junit47-twoForks-ff1] 15.127
test[junit4-twoForks-ff2] 19.09
test[junit47-twoForks-ff2] 19.011
test[junit4-oneFork-ff3] 37.058
test[junit47-oneFork-ff3] 37.003
test[junit4-twoForks-ff3] 24.227
test[junit47-twoForks-ff3] 24.429

FailFastTestNgIT

test[testng-oneFork-ff1] 9.955
test[testng-oneFork-ff2] 18.987
test[testng-twoForks-ff1] 15.713
test[testng-twoForks-ff2] 19.416
test[testng-oneFork-ff3] 36.859
test[testng-twoForks-ff3] 24.696

ForkConsoleOutputIT

printSummaryTrueWithRedirect 6.558
printSummaryFalseWithoutRedirect 6.363
printSummaryTrueWithoutRedirect 6.279
printSummaryFalseWithRedirect 6.447

ForkConsoleOutputWithErrorsIT

xmlFileContainsConsoleOutput 6.506

ForkModeIT

testForkModeOncePerThreadSingleThread 9.2
testForkModePerTest 11.245
testForkCountZero 7.268
testForkCountOneNoReuse 11.105
testForkCountTwoNoReuse 21.567
testForkModeNever 7.234
testForkCountTwoReuse 21.065
testForkCountOneReuse 8.511
testForkModeOncePerThreadTwoThreads 20.914
testForkModeAlways 10.961
testForkModeNone 7.39
testForkModeOnce 9.255

ForkModeMultiModuleIT

testForkCountOneNoReuse 11.614
testForkCountTwoNoReuse 9.495
testForkCountTwoReuse 8.46
testForkCountOneReuse 9.419

ForkModeTestNGIT

testForkModeOncePerThreadSingleThread 7.498
testForkModePerTest 10.282
testForkCountZero 5.904
testForkCountOneNoReuse 9.859
testForkCountTwoNoReuse 14.177
testForkModeNever 6.032
testForkCountTwoReuse 14.25
testForkCountOneReuse 8.251
testForkModeOncePerThreadTwoThreads 14.377
testForkModeAlways 10.175
testForkModeNone 5.977
testForkModeOnce 7.522

IncludesExcludesFromFileIT

testSimpleMixed 6.356
testMissingExcludes 4.67
testRegex 6.248
testPath 6.324
testMissingIncludes 4.719
testSimple 6.319

IncludesExcludesIT

testPathBasedIncludesExcludes 6.029
testIncludesExcludes 5.791
testRegexIncludesExcludes 5.945

Java9FullApiIT

shouldLoadMultipleJavaModules_JavaHome 9.136
shouldLoadMultipleJavaModules_ToolchainsXML 9.693
shouldLoadMultipleJavaModules_JvmParameter 8.253

Surefire1024VerifyFailsafeIfTestedIT

shouldScanAndRunTestsInDependencyJars 5.895

Surefire1028UnableToRunSingleIT

methodFilteringParallelExecution 5.189

Surefire1036NonFilterableJUnitRunnerWithCategoriesIT

test 6.205

Surefire1041FailingJUnitRunnerIT

reportErrorInJUnitRunnerAsTestError 6.192

Surefire1053SystemPropertiesIT

checkWarningsSysPropTwice 6.026
checkWarningsFileEncoding 6.046

Surefire1055CorrectConcurrentTestCountIT

testTestNgAndJUnitTogether 6.271

Surefire1080ParallelForkDoubleTestIT

test 6.592

Surefire1082ParallelJUnitParameterizedIT

checkClassesRunParallel 7.16
shouldRunTwo 8.129
checkOutFileClassesRunParallel 7.246

Surefire1098BalancedRunOrderIT

reorderedParallelClasses 28.038

Surefire1122ParallelAndFlakyTestsIT

parallelCreatesCorrectReportFork 6.095
nonParallelCreatesCorrectReport 5.905
parallelCreatesCorrectReport 5.193

Surefire1135ImproveIgnoreMessageForTestNGIT

testNgReport57 6.762
testNgReport688 7.453

Surefire1136CwdPropagationInForkedModeIT

testTestNgAndJUnitTogether 6.144

Surefire1144XmlRunTimeIT

testXmlRunTime 6.49

Surefire1152RerunFailingTestsInSuiteIT

testJUnit48Provider47 5.845
testJUnit48Provider4 5.607

Surefire1153IncludesAndSpecifiedTestIT

testSpecifiedTestInIncludes 4.917
testSpecifiedTestNotInIncludes 4.834

Surefire1158RemoveInfoLinesIT

shouldRunWithCliOption[junit-option-ff] 6.27
shouldRunWithCliOption[testng-option-ff] 6.264
shouldRunWithCliOption[junit-option-X] 6.189
shouldRunWithCliOption[testng-option-X] 6.255
shouldRunWithCliOption[junit-option-e] 6.128
shouldRunWithCliOption[testng-option-e] 6.245

Surefire1177TestngParallelSuitesIT

twoSuitesInParallelForked 8.677
twoSuitesInParallel 7.58

Surefire1179IT

suiteXmlForkCountTwoReuse 10.007

Surefire1185DoNotSpawnTestsIT

doNotSpawnUnwantedTests 4.87

Surefire1202RerunAndSkipIT

junit47 18.987
junit4 18.761

Surefire1209RerunAndForkCountIT

notReusableForksJUnit47 15.2
reusableForksJUnit47 14.111
reusableForksJUnit4 13.678
notReusableForksJUnit4 15.422

Surefire1211JUnitTestNgIT

withoutJUnit 7.587
withJUnit 6.64

Surefire1264IT

positiveTests 7.752
negativeTests 7.887

Surefire1265Java9IT

shouldRunInPluginJava9 4.963

Surefire1278GroupNameEndingIT

testOnlyGroups 6.485

Surefire1295AttributeJvmCrashesToTestsIT

test[0]
+ [ Detail ]
 0
skipped
test[1]
+ [ Detail ]
 0
skipped
test[2]
+ [ Detail ]
 0
skipped
test[3]
+ [ Detail ]
 0
skipped
test[4]
+ [ Detail ]
 0
skipped
test[5]
+ [ Detail ]
 0
skipped
test[6]
+ [ Detail ]
 0
skipped
test[7]
+ [ Detail ]
 0
skipped
test[8]
+ [ Detail ]
 0
skipped

Surefire1364SystemPropertiesIT

junit47InProcessParallel 6.329
junit47Forked 6.768
junit47InProcess 6.561
testNg 7.771
junit3Forked 6.325
junit47ForkedParallel 6.823
junit4Forked 6.438
testNgInProcess 7.359
junit4InProcess 6.52
junit3InProcess 6.118

Surefire1367AssumptionLogsIT

shouldSeeLogsInPlugin 4.986
shouldSeeLogsParallelInPlugin 5.499
shouldSeeLogsParallelForked 6.345
shouldSeeLogsForked 6.26

Surefire1383ScanSessionDependenciesIT

test 6.146

Surefire1396CustomProviderClassPathIT

pluggableProviderClasspathCorrect 8.291

Surefire141PluggableProvidersIT

pluggableProviderPresent 8.182
invokeRuntimeException 7.998
invokeReporterException 8.24
constructorRuntimeException 7.902

Surefire146ForkPerTestNoSetupIT

testForkPerTestNoSetup 6.422

Surefire1490ReportTitleDescriptionIT

shouldHaveCustomizedReportTitleAndDescription 16.755
shouldHaveDefaultReportTitleAndDescription 11.728

Surefire1535TestNGParallelSuitesIT

forks0 7.193
forks2 7.953
forks0Redirected 7.32
forks2Redirected 7.581

Surefire162CharsetProviderIT

testCharsetProvider 6.256

Surefire224WellFormedXmlFailuresIT

testWellFormedXmlFailures 5.859

Surefire257NotRerunningTestsIT

shouldNotRerun 8.156

Surefire260TestWithIdenticalNamesIT

testWithIdenticalNames 13.969

Surefire34SecurityManagerIT

testSecurityManager 6.257
testSecurityManagerSuccessful 6.043

Surefire376TestNgAfterSuiteFailureIT

testAfterSuiteFailure 6.568

Surefire377TestNgAndJUnitTogetherIT

testTestNgAndJUnit4Together 5.476
testTestNgAndJUnitTogether 6.168

Surefire408ManualProviderSelectionIT

testParallelBuildResultCount 5.954

Surefire42NotExtendingTestCaseIT

testInnerClass 6.197

Surefire44InnerClassTestIT

testInnerClass 5.761

Surefire500PuzzlingErrorIT

testBuildFailingWhenErrors 6.361

Surefire510TestClassPathForkModesIT

testForkOnce 6.15
testForkAlways 6.179

Surefire569RunTestFromDependencyJarsIT

shouldScanAndRunTestsInDependencyJars 5.633

Surefire570MultipleReportDirectoriesIT

testReportWithAggregate 16.258
testReportWithoutAggregate 15.269

Surefire613TestCountInParallelIT

testParallelBuildResultCount 6.824

Surefire621TestCountingJunit3InParallelIT

testJunit3ParallelBuildResultCount 6.674
testJunit3ParallelSuiteBuildResultCount 6.677
testJunit3AllParallelBuildResultCount 6.479
testJunit3BuildResultCount 6.367
testJunit3SuiteBuildResultCount 6.438

Surefire628ConsoleOutputBeforeAndAfterClassIT

testJunit3ParallelBuildResultCount 6.372

Surefire634UnsettableSystemPropertiesWarningIT

testJunit3ParallelBuildResultCount 5.985

Surefire649EmptyStringSystemPropertiesIT

systemPropertyVariables 4.913
systemProperties 5.026

Surefire673MockitoIT

testBuildFailingWhenErrors 7.86

Surefire674BuildFailingWhenErrorsIT

testBuildFailingWhenErrors 6.316

Surefire674BuildFailingWhenFailsafeErrorsIT

testBuildFailingWhenErrors 3.869

Surefire685CommaSeparatedIncludesIT

testBuildFailingWhenErrors 6.283

Surefire697NiceSummaryIT

testBuildFailingWhenErrors 6

Surefire705ParallelForkTimeoutIT

testTimeoutForked 7.926

Surefire733AllOverrridesCapturedIT

testLogOutput 6.123

Surefire735ForkFailWithRedirectConsoleOutputIT

vmStartFail 5.106
vmStartFailShouldFailBuildk 5.085

Surefire740TruncatedCommaIT

testRussianLocaleReport 4.961

Surefire747MethodParallelWithSuiteCountIT

testMethodsParallelWithSuite 10.249
testClassesParallelWithSuite 12.92

Surefire772BothReportsIT

testSkippedSurefireReportGeneration 3.782
testSkippedFailsafeReportGeneration 3.781
testReportGeneration 3.993

Surefire772NoFailsafeReportsIT

testSkippedFailsafeReportGeneration 3.84
testForcedFailsafeReportGeneration 3.856
testSkipForcedFailsafeReportGeneration 3.665
testReportGeneration 3.55

Surefire772NoSurefireReportsIT

testOptionalSurefireReportGeneration 3.944
testSkippedSurefireReportGeneration 3.934
testSkipOptionalSurefireReportGeneration 3.864
testReportGeneration 3.795

Surefire772SpecifiedReportsIT

testSkippedSurefireReportGeneration 3.503
testSkippedFailsafeReportGeneration 3.724
testReportGeneration 3.76

Surefire801ForkModeNoneClassLoaderIT

testSHouldBeOkWithForkNever 4.989

Surefire803MultiFailsafeExecsIT

testOneExecutionRunInTwoBuilds 13.973
testSecondExecutionRunsAfterFirstExecutionFails 7.91

Surefire806SpecifiedTestControlsIT

singleTestInSingleExecutionProject 5.867
twoSpecifiedTestExecutionsInCorrectExecutionBlocks
+ [ Detail ]
 0
since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
singleTestInOneExecutionOfMultiExecutionProject
+ [ Detail ]
 0
since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution

Surefire809GroupExpressionsIT

testNGRunCategoryAB 6.299
testExcludedGroups 6.392
testJUnitRunCategoryNotC 6.829
incorrectJUnitVersions 4.179
categoryAB 6.594
testNGRunCategoryNotC 6.591

Surefire812Log4JClassLoaderIT

testJunit3ParallelBuildResultCount 7.369

Surefire817SystemExitIT

systemExit1 6.269

Surefire818NpeIgnoresTestsIT

testBuildFailingWhenErrors 7.047

Surefire828EmptyGroupExprIT

testJUnitRunEmptyExcludeGroups 6.703
testJUnitRunEmptyGroups 6.969
testTestNGRunEmptyExcludeGroups 6.844
testTestNGRunEmptyGroups 6.392

Surefire832ProviderSelectionIT

testJUnitRunCategoryAB 6.464

Surefire839TestWithoutCategoriesIT

classWithoutCategoryForked 6.925
classWithoutCategory 6.448

Surefire847AdditionalFailureIT

testJUnitRunCategoryAB 7.312

Surefire855AllowFailsafeUseArtifactFileIT

jarNotForkingShouldUseFile 10.858
jarShouldUseFile 10.326
warShouldUseClasses 15.44
osgiBundleShouldUseFile 15.765

Surefire901MIssingResultfileWhenNoTestsIT

failsafeWithNoTests 4.933

Surefire907PerThreadWithoutThreadCountIT

categoryAB 4.58

Surefire920TestFailureIgnoreWithTimeoutIT

timeoutInForkWithBuildFail 6.9
timeoutInForkWithNoBuildFail 6.982

Surefire926FailureWith2ProvidersIT

testBuildFailingWhenErrors 5.067

Surefire930TestNgSuiteXmlIT

suiteXmlRun 7.146

Surefire943ReportContentIT

test_noParallel 12.615
test_parallelBoth 7.45

Surefire946KillMainProcessInReusableForkIT

testExit 7.986
testHalt 8.041
testInterrupt 8.068

Surefire972BizarreNoClassDefIT

testJunit3ParallelBuildResultCount 8.069

Surefire975DefaultVMEncodingIT

runWithRussian1251 6.355

Surefire979WrongClassLoaderIT

wrongClassloaderUSedInSmartStacktraceparser 6.09

Surefire985ParameterizedRunnerAndCategoriesIT

test 5.208

Surefire995CategoryInheritanceIT

junit411ShouldRunExplicitCategory 5.252
junit411ShouldExcludeExplicitCategory 5.144
junit412ShouldExcludeInheritedCategory 4.995
junit412ShouldRunInheritedCategory 5.218
negativeTestShouldRunAllCategories 4.444

JUnit44HamcrestIT

testJUnit44Hamcrest 6

JUnit47ConcurrencyIT

test47 6.301

JUnit47ParallelIT

unknownThreadCountClasses 4.616
threadCountSuites 9.051
unlimitedThreadsSuitesAndMethods1 6.605
unlimitedThreadsSuitesAndMethods2 6.436
unknownThreadCountMethods 4.282
threadCountClassesAndMethods 6.48
reusableThreadCountClassesAndMethodsOptimized 7.038
unknownThreadCountSuites 4.164
reusableThreadCountAll 6.116
forcedShutdown 7.446
unknownThreadCountAll 4.416
serial 12.337
reusableThreadCountAllOptimized 6.008
suites 8.79
unlimitedThreadsMethods1 7.632
unlimitedThreadsMethods2 7.726
unlimitedThreadsSuitesAndClasses1 6.039
unlimitedThreadsSuitesAndClasses2 6.044
threadCountAllOptimized 6.41
threadCountAll 6.425
everyThreadCountSuitesAndClasses 6.097
unknownThreadCountBoth 4.66
threadCountSuitesAndClassesOptimized 6.116
classesAndMethods 5.768
everyThreadCountSuitesAndMethods 6.261
unknownThreadCountSuitesAndClasses 4.465
reusableThreadCountSuitesAndClassesOptimized 6.951
unknownThreadCountSuitesAndMethods 4.528
suitesAndClasses 6.068
suitesAndMethods 6.32
shutdown 10.082
threadCountClassesAndMethodsOneCore 9.972
everyThreadCountClassesAndMethods 6.51
all 5.539
unknownThreadCountClassesAndMethods 4.509
threadCountSuitesAndMethodsOptimized 6.421
reusableThreadCountSuitesAndMethodsOptimized 7.014
unlimitedThreadsClasses1 6.927
unlimitedThreadsClasses2 6.827
threadCountClasses 7.134
everyThreadCountAll 6.406
threadCountMethods 7.705
unlimitedThreadsSuites1 9.028
unlimitedThreadsSuites2 8.964
threadCountSuitesAndClasses 5.982
unlimitedThreadsClassesAndMethods1 5.616
unlimitedThreadsClassesAndMethods2 5.813
threadCountSuitesAndMethods 6.297
classes 7.031
reusableThreadCountSuitesAndClasses 7.033
methods 7.598
reusableThreadCountSuitesAndMethods 6.481
timeoutAndForcedShutdown 7.736
threadCountClassesAndMethodsOptimized 6.557
unlimitedThreadsAll1 5.775
unlimitedThreadsAll2 5.715
forcedShutdownVerifyingLogs 6.791
threadCountClassesAndMethodsOneCoreOptimized 9.974
reusableThreadCountClassesAndMethods 7.5

JUnit47ParallelNotThreadSafeIT

test 5.24

JUnit47RedirectOutputIT

testClassesParallel 6.721
testPrintSummaryTrueWithRedirect 6.439

JUnit47RerunFailingTestWithCucumberIT

testRerunFailingErrorTestsFalse 7.418
testRerunFailingErrorTestsWithOneRetry 6.431
testRerunFailingErrorTestsTwoRetry 6.043

JUnit47StaticInnerClassTestsIT

testStaticInnerClassTests 5.296

JUnit47WithCucumberIT

testWithParallelClasses 7.093
testWithoutParallel 5.827

JUnit48TestCategoriesIT

testCategoriesACFullyQualifiedClassName 6.458
testBadCategoryForkAlways 8.556
testCategoriesABForkAlways 8.618
testCategoriesBadCategory 6.677
testCategoriesACClassNameSuffix 6.43
testCategoriesACFullyQualifiedClassNameForkAlways 8.919
testCategoriesAB 6.486
testCategoriesACClassNameSuffixForkAlways 8.741

JUnit4ForkAlwaysStaticInitPollutionIT

testJunit4Ignore 8.264

JUnit4IgnoreIT

testJunit4Ignore 6.116
testJunit47ParallelIgnore 6.516

JUnit4RerunFailingTestsIT

testRerunFailingErrorTestsFalse 25.943
testRerunFailingErrorTestsWithOneRetry 25.713
testRerunFailingErrorTestsTwoRetry 25.761
testRerunOneTestMethod 26.036
testRerunOneTestClass 25.404

JUnit4RunListenerIT

testJUnit4RunListener 6.31
testRunlistenerJunitCoreProvider 6.617

JUnit4VersionsIT

testJunit[0: JUnit 4.0] 6.211
testJunit[1: JUnit 4.1] 6.826
testJunit[2: JUnit 4.2] 6.897
testJunit[3: JUnit 4.3] 6.827
testJunit[4: JUnit 4.3.1] 6.777
testJunit[5: JUnit 4.4] 5.98
testJunit[6: JUnit 4.5] 5.941
testJunit[7: JUnit 4.6] 6.667
testJunit[8: JUnit 4.7] 6.031
testJunit[9: JUnit 4.8] 7.054
testJunit[10: JUnit 4.8.1] 5.977
testJunit[11: JUnit 4.8.2] 6.047
testJunit[12: JUnit 4.9] 7.187
testJunit[13: JUnit 4.10] 5.981
testJunit[14: JUnit 4.11] 6.065
testJunit[15: JUnit 4.12] 6.323

JUnitDepIT

testJUnit44DepWithSneaky381 7.05
testJUnit44Dep 6.13
testJUnit47Dep 7.048
testJUnit48Dep 7.147

JUnitPlatformEnginesIT

testToRegex[1.0.0] 0.002
platform[1.0.0] 9.259
testToRegex[1.1.1] 0
platform[1.1.1] 8.782
testToRegex[1.2.0] 0
platform[1.2.0] 9.243
testToRegex[1.3.1] 0
platform[1.3.1] 6.282
testToRegex[1.4.0-SNAPSHOT] 0
platform[1.4.0-SNAPSHOT] 9.855

JUnitPlatformIT

testVintageEngine 7.093
testTags 6.523
testJQwikEngine 7.338
testMultipleEngines 7.74
testJupiterEngine 6.612

LongWindowsPathIT

shouldRunInSystemTmp 6.315

ModulePathIT

testModulePathWithSpaces 9.056
testModulePath 7.729

NoRunnableTestsInClassIT

testJunit3ParallelBuildResultCount 6.375

PlainOldJavaClasspathIT

testPlainOldJavaClasspath 5.953

PlexusConflictIT

testPlexusConflict 6.793
testPlexusConflictIsolatedClassLoader 5.974

PojoSimpleIT

testit 6.114

ReportersIT

testRedirectOutputTestNg 6.374

ResultCountingIT

testCountingWithJunit481ForkAlways 11.032
testCountingWithJunit481ForkOnce 6.339
testCountingWithJunit481ForkNever 5.282

RunOrderIT

testReverseAlphabetical 6.305
testNonExistingRunOrder 4.345
testHourly 6.049
testAlphabetical 5.714

RunOrderParallelForksIT

testReverseAlphabetical 6.224
testNonExistingRunOrder 4.393
testHourly 6.064
testAlphabetical 5.744

SiblingAggregatorIT

testSiblingAggregator 6.166

SmartStackTraceIT

misg 6.217

Surefire1602IT

nonCanonicalPath 14.391

SystemPropertiesTestIT

testSystemProperties 7.314
testSystemPropertiesNoFork 4.924

TestMethodPatternIT

testJUnit48WithCategoryFilter 6.216
testJUnit48Provider47 6.547
testMethodPatternAfter 6.225
testTestNGMethodPattern 6.206
testJUnit48Provider4 6.082
testJUnit44 6.357
testTestNgMethodBefore 6.576

TestMultipleMethodPatternsIT

shouldNotRunExcludedClassesAndMethods[0] 5.112
shouldMatchExactClassAndMethodCharacters[0] 4.878
shouldMatchExactClassAndMethodWildcard[0] 5.086
testSuccessTwo[0] 5.06
simpleNameTest[0] 5.059
simpleNameTestWithJavaExt[0] 5.049
regexClass[0] 5.261
shouldNotRunExcludedClasses[0] 5.006
shouldNotRunExcludedMethods[0] 5.117
simpleNameTestWithJavaExtWildcardPkg[0] 5.13
shouldMatchMultiplePatterns[0] 5.117
shouldMatchExactClassAndMethodsPostfix[0] 5.303
simpleNameTestWithWildcardPkg[0] 4.861
shouldMatchWildcardPackageAndClassAndMethod[0] 5.021
shouldMatchExactClassAndMultipleMethods[0] 5.3
fullyQualifiedTest[0] 5.101
matchSimpleClassAndMethodWithJavaExtWildcardPkg[0] 5.054
negativeTest[0]
+ [ Detail ]
 0.001
skipped
testRegexSuccessTwo[0] 4.983
shouldMatchExactClassAndMethodsWildcard[0] 5.04
shouldMatchMultiplePatternsComplex[0] 5.215
simpleNameTestAsParallel[0]
+ [ Detail ]
 0.001
skipped
matchSimpleClassAndMethodWithWildcardPkg[0] 5.188
shouldMatchMultiplePatternsAsParallel[0]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[0] 4.909
shouldMatchSimpleClassNameAndMethod[0] 5.02
shouldMatchExactClassAndMethodPostfix[0] 4.904
shouldMatchMultiplePatternsComplexAsParallel[0]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[0] 4.933
regexClassAndMethod[0] 5.068
shouldNotRunExcludedClassesAndMethods[1] 5.105
shouldMatchExactClassAndMethodCharacters[1] 5.044
shouldMatchExactClassAndMethodWildcard[1] 5.142
testSuccessTwo[1] 5.036
simpleNameTest[1] 5.623
simpleNameTestWithJavaExt[1] 5.547
regexClass[1] 5.052
shouldNotRunExcludedClasses[1] 5.051
shouldNotRunExcludedMethods[1] 5.107
simpleNameTestWithJavaExtWildcardPkg[1] 5.099
shouldMatchMultiplePatterns[1] 5.308
shouldMatchExactClassAndMethodsPostfix[1] 5.102
simpleNameTestWithWildcardPkg[1] 5.125
shouldMatchWildcardPackageAndClassAndMethod[1] 5.356
shouldMatchExactClassAndMultipleMethods[1] 5.059
fullyQualifiedTest[1] 5.17
matchSimpleClassAndMethodWithJavaExtWildcardPkg[1] 4.958
negativeTest[1]
+ [ Detail ]
 0
skipped
testRegexSuccessTwo[1] 4.712
shouldMatchExactClassAndMethodsWildcard[1] 4.985
shouldMatchMultiplePatternsComplex[1] 4.861
simpleNameTestAsParallel[1] 4.858
matchSimpleClassAndMethodWithWildcardPkg[1] 5.069
shouldMatchMultiplePatternsAsParallel[1] 5.387
shouldNotRunExcludedClassesIfIncluded[1] 5.034
shouldMatchSimpleClassNameAndMethod[1] 5.31
shouldMatchExactClassAndMethodPostfix[1] 5.32
shouldMatchMultiplePatternsComplexAsParallel[1] 5.29
matchSimpleClassAndMethodWithJavaExt[1] 5.281
regexClassAndMethod[1] 5.028
shouldNotRunExcludedClassesAndMethods[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[2]
+ [ Detail ]
 0
skipped
testSuccessTwo[2]
+ [ Detail ]
 0
skipped
simpleNameTest[2] 5.161
simpleNameTestWithJavaExt[2] 5.04
regexClass[2] 5.111
shouldNotRunExcludedClasses[2] 5.029
shouldNotRunExcludedMethods[2]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[2] 4.96
shouldMatchMultiplePatterns[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[2]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[2] 4.947
shouldMatchWildcardPackageAndClassAndMethod[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[2]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[2] 4.96
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2]
+ [ Detail ]
 0
skipped
negativeTest[2] 4.518
testRegexSuccessTwo[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[2]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[2]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithWildcardPkg[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[2]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[2] 5.073
shouldMatchSimpleClassNameAndMethod[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[2]
+ [ Detail ]
 0.001
skipped
shouldMatchMultiplePatternsComplexAsParallel[2]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[2]
+ [ Detail ]
 0
skipped
regexClassAndMethod[2]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesAndMethods[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[3]
+ [ Detail ]
 0
skipped
testSuccessTwo[3]
+ [ Detail ]
 0
skipped
simpleNameTest[3] 4.971
simpleNameTestWithJavaExt[3] 5.267
regexClass[3] 5.203
shouldNotRunExcludedClasses[3] 4.964
shouldNotRunExcludedMethods[3]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[3] 5.055
shouldMatchMultiplePatterns[3]
+ [ Detail ]
 0.001
skipped
shouldMatchExactClassAndMethodsPostfix[3]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[3] 5.126
shouldMatchWildcardPackageAndClassAndMethod[3]
+ [ Detail ]
 0.001
skipped
shouldMatchExactClassAndMultipleMethods[3]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[3] 5.198
matchSimpleClassAndMethodWithJavaExtWildcardPkg[3]
+ [ Detail ]
 0
skipped
negativeTest[3] 4.53
testRegexSuccessTwo[3]
+ [ Detail ]
 0.001
skipped
shouldMatchExactClassAndMethodsWildcard[3]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[3]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[3] 5.247
matchSimpleClassAndMethodWithWildcardPkg[3]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[3]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[3] 5.366
shouldMatchSimpleClassNameAndMethod[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[3]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[3]
+ [ Detail ]
 0.001
skipped
matchSimpleClassAndMethodWithJavaExt[3]
+ [ Detail ]
 0
skipped
regexClassAndMethod[3]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesAndMethods[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[4]
+ [ Detail ]
 0
skipped
testSuccessTwo[4]
+ [ Detail ]
 0.001
skipped
simpleNameTest[4] 5.228
simpleNameTestWithJavaExt[4] 5.289
regexClass[4] 5.336
shouldNotRunExcludedClasses[4] 5.075
shouldNotRunExcludedMethods[4]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[4] 5.33
shouldMatchMultiplePatterns[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[4]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[4] 5.219
shouldMatchWildcardPackageAndClassAndMethod[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[4]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[4] 5.159
matchSimpleClassAndMethodWithJavaExtWildcardPkg[4]
+ [ Detail ]
 0
skipped
negativeTest[4] 4.392
testRegexSuccessTwo[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[4]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[4]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[4]
+ [ Detail ]
 0.001
skipped
matchSimpleClassAndMethodWithWildcardPkg[4]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[4]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[4] 4.851
shouldMatchSimpleClassNameAndMethod[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[4]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[4]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[4]
+ [ Detail ]
 0.001
skipped
regexClassAndMethod[4]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesAndMethods[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[5]
+ [ Detail ]
 0
skipped
testSuccessTwo[5]
+ [ Detail ]
 0
skipped
simpleNameTest[5] 5.096
simpleNameTestWithJavaExt[5] 5.331
regexClass[5] 5.232
shouldNotRunExcludedClasses[5] 5.47
shouldNotRunExcludedMethods[5]
+ [ Detail ]
 0.001
skipped
simpleNameTestWithJavaExtWildcardPkg[5] 5.185
shouldMatchMultiplePatterns[5]
+ [ Detail ]
 0.001
skipped
shouldMatchExactClassAndMethodsPostfix[5]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[5] 5.289
shouldMatchWildcardPackageAndClassAndMethod[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[5]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[5] 5.116
matchSimpleClassAndMethodWithJavaExtWildcardPkg[5]
+ [ Detail ]
 0
skipped
negativeTest[5] 4.702
testRegexSuccessTwo[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[5]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[5]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[5] 5.319
matchSimpleClassAndMethodWithWildcardPkg[5]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[5]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[5] 5.304
shouldMatchSimpleClassNameAndMethod[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[5]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[5]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[5]
+ [ Detail ]
 0
skipped
regexClassAndMethod[5]
+ [ Detail ]
 0
skipped

TestMultipleMethodPatternsTestNGIT

shouldNotRunExcludedClassesAndMethods[0] 5.345
shouldMatchExactClassAndMethodCharacters[0] 5.22
shouldMatchExactClassAndMethodWildcard[0] 5.392
testSuccessTwo[0] 5.31
simpleNameTest[0] 5.087
simpleNameTestWithJavaExt[0] 5.28
regexClass[0] 5.378
shouldNotRunExcludedClasses[0] 5.346
shouldNotRunExcludedMethods[0] 5.139
simpleNameTestWithJavaExtWildcardPkg[0] 5.583
shouldMatchMultiplePatterns[0] 5.246
shouldMatchExactClassAndMethodsPostfix[0] 5.259
simpleNameTestWithWildcardPkg[0] 5.071
shouldMatchWildcardPackageAndClassAndMethod[0] 5.203
shouldMatchExactClassAndMultipleMethods[0] 5.166
fullyQualifiedTest[0] 5.372
matchSimpleClassAndMethodWithJavaExtWildcardPkg[0] 5.205
negativeTest[0]
+ [ Detail ]
 0
skipped
testRegexSuccessTwo[0] 5.337
shouldMatchExactClassAndMethodsWildcard[0] 5.25
shouldMatchMultiplePatternsComplex[0] 5.175
simpleNameTestAsParallel[0] 5.306
matchSimpleClassAndMethodWithWildcardPkg[0] 5.47
shouldMatchMultiplePatternsAsParallel[0] 5.132
shouldNotRunExcludedClassesIfIncluded[0] 5.434
shouldMatchSimpleClassNameAndMethod[0] 5.274
shouldMatchExactClassAndMethodPostfix[0] 5.09
shouldMatchMultiplePatternsComplexAsParallel[0] 5.381
matchSimpleClassAndMethodWithJavaExt[0] 5.203
regexClassAndMethod[0] 5.292
shouldNotRunExcludedClassesAndMethods[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[1]
+ [ Detail ]
 0
skipped
testSuccessTwo[1]
+ [ Detail ]
 0
skipped
simpleNameTest[1] 5.006
simpleNameTestWithJavaExt[1] 5.324
regexClass[1] 5.651
shouldNotRunExcludedClasses[1] 5.294
shouldNotRunExcludedMethods[1]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[1] 5.111
shouldMatchMultiplePatterns[1]
+ [ Detail ]
 0.001
skipped
shouldMatchExactClassAndMethodsPostfix[1]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[1] 5.12
shouldMatchWildcardPackageAndClassAndMethod[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[1]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[1] 5.206
matchSimpleClassAndMethodWithJavaExtWildcardPkg[1]
+ [ Detail ]
 0
skipped
negativeTest[1] 4.649
testRegexSuccessTwo[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[1]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[1]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[1] 5.206
matchSimpleClassAndMethodWithWildcardPkg[1]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[1]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[1] 5.253
shouldMatchSimpleClassNameAndMethod[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[1]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[1]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[1]
+ [ Detail ]
 0.001
skipped
regexClassAndMethod[1]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesAndMethods[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[2]
+ [ Detail ]
 0
skipped
testSuccessTwo[2]
+ [ Detail ]
 0
skipped
simpleNameTest[2] 5.25
simpleNameTestWithJavaExt[2] 5.418
regexClass[2] 5.128
shouldNotRunExcludedClasses[2] 5.436
shouldNotRunExcludedMethods[2]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[2] 5.431
shouldMatchMultiplePatterns[2]
+ [ Detail ]
 0.001
skipped
shouldMatchExactClassAndMethodsPostfix[2]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[2] 5.291
shouldMatchWildcardPackageAndClassAndMethod[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[2]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[2] 4.982
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2]
+ [ Detail ]
 0
skipped
negativeTest[2] 4.699
testRegexSuccessTwo[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[2]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[2] 5.081
matchSimpleClassAndMethodWithWildcardPkg[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[2]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[2] 5.28
shouldMatchSimpleClassNameAndMethod[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[2]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[2]
+ [ Detail ]
 0
skipped
regexClassAndMethod[2]
+ [ Detail ]
 0
skipped

TestMultipleMethodsIT

testJunit48Provider4 6.389
testJunit44 4.972
testJunit48Provider47 6.447

TestNgGroupsIT

testExclusion 7.504
testGroupsAndExclusion 6.574
groupsWithDash 6.81
testOnlyGroups 6.632
groupsBySimpleRegex 6.582

TestNgParallelWithAnnotationsIT

testTestNgGroupThreadParallel 7.608

TestNgSuccessPercentageIT

testPassesWhenFailuresLessThanSuccessPercentage 4.966

TestSingleMethodIT

fullyQualifiedTestNg 6.24
testJunit48Provider4 6.484
testJunit44 6.318
testJunit48parallel 6.548
testJunit48Provider47 6.383
fullyQualifiedJunit48Provider47 6.571
fullyQualifiedJunit48Provider4 6.276
testTestNg5149 6.325
testTestNg 6.338

TimeoutForkedTestIT

testTimeoutForked 7.556

TwoTestCasesIT

testJunit4Suite 6.544
testTestNGSuite 6.463
testTwoTestCases 5.894
testTwoTestCaseSuite 6.111

UmlautDirIT

testUmlautIsolatedClassLoader 6.806
testUmlaut 5.799

UnicodeTestNamesIT

checkFileNamesWithUnicode 8.713

UseIsolatedClassLoaderIT

testUseSystemClassLoader 5.733

WorkingDirectoryIsInvalidPropertyIT

testWorkingDirectory 4.392

WorkingDirectoryIT

testWorkingDirectory 6.213
testWorkingDirectoryChildOnlyNoFork 5.002
testWorkingDirectoryNoFork 5.021
testWorkingDirectoryChildOnly 6.134

WorkingDirectoryMissingIT

testWorkingDirectory 5.987

XmlReporterRunTimeIT

testForkModeAlways 25.563

Failure Details

[Summary] [Package List] [Test Cases]


XXXtest50
skipped: 5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
XXXtest501
skipped: 5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
test[0]
skipped: skipped
test[1]
skipped: skipped
test[2]
skipped: skipped
test[3]
skipped: skipped
test[4]
skipped: skipped
test[5]
skipped: skipped
test[6]
skipped: skipped
test[7]
skipped: skipped
test[8]
skipped: skipped
twoSpecifiedTestExecutionsInCorrectExecutionBlocks
skipped: since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
singleTestInOneExecutionOfMultiExecutionProject
skipped: since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
negativeTest[0]
skipped: skipped
simpleNameTestAsParallel[0]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[0]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[0]
skipped: skipped
negativeTest[1]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[2]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[2]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[2]
skipped: skipped
testSuccessTwo[2]
skipped: skipped
shouldNotRunExcludedMethods[2]
skipped: skipped
shouldMatchMultiplePatterns[2]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[2]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[2]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2]
skipped: skipped
testRegexSuccessTwo[2]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[2]
skipped: skipped
shouldMatchMultiplePatternsComplex[2]
skipped: skipped
simpleNameTestAsParallel[2]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[2]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[2]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[2]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[2]
skipped: skipped
regexClassAndMethod[2]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[3]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[3]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[3]
skipped: skipped
testSuccessTwo[3]
skipped: skipped
shouldNotRunExcludedMethods[3]
skipped: skipped
shouldMatchMultiplePatterns[3]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[3]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[3]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[3]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[3]
skipped: skipped
testRegexSuccessTwo[3]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[3]
skipped: skipped
shouldMatchMultiplePatternsComplex[3]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[3]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[3]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[3]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[3]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[3]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[3]
skipped: skipped
regexClassAndMethod[3]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[4]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[4]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[4]
skipped: skipped
testSuccessTwo[4]
skipped: skipped
shouldNotRunExcludedMethods[4]
skipped: skipped
shouldMatchMultiplePatterns[4]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[4]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[4]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[4]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[4]
skipped: skipped
testRegexSuccessTwo[4]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[4]
skipped: skipped
shouldMatchMultiplePatternsComplex[4]
skipped: skipped
simpleNameTestAsParallel[4]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[4]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[4]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[4]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[4]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[4]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[4]
skipped: skipped
regexClassAndMethod[4]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[5]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[5]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[5]
skipped: skipped
testSuccessTwo[5]
skipped: skipped
shouldNotRunExcludedMethods[5]
skipped: skipped
shouldMatchMultiplePatterns[5]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[5]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[5]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[5]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[5]
skipped: skipped
testRegexSuccessTwo[5]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[5]
skipped: skipped
shouldMatchMultiplePatternsComplex[5]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[5]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[5]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[5]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[5]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[5]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[5]
skipped: skipped
regexClassAndMethod[5]
skipped: skipped
negativeTest[0]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[1]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[1]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[1]
skipped: skipped
testSuccessTwo[1]
skipped: skipped
shouldNotRunExcludedMethods[1]
skipped: skipped
shouldMatchMultiplePatterns[1]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[1]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[1]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[1]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[1]
skipped: skipped
testRegexSuccessTwo[1]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[1]
skipped: skipped
shouldMatchMultiplePatternsComplex[1]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[1]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[1]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[1]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[1]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[1]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[1]
skipped: skipped
regexClassAndMethod[1]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[2]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[2]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[2]
skipped: skipped
testSuccessTwo[2]
skipped: skipped
shouldNotRunExcludedMethods[2]
skipped: skipped
shouldMatchMultiplePatterns[2]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[2]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[2]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2]
skipped: skipped
testRegexSuccessTwo[2]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[2]
skipped: skipped
shouldMatchMultiplePatternsComplex[2]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[2]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[2]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[2]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[2]
skipped: skipped
regexClassAndMethod[2]
skipped: skipped