Fork me on GitHub

Surefire Report

Summary

[Summary] [Package List] [Test Cases]


Tests Errors Failures Skipped Success Rate Time
701 0 0 133 81.027% 2,282.447

Note: failures are anticipated and checked for with assertions while errors are unanticipated.


Package List

[Summary] [Package List] [Test Cases]


Package Tests Errors Failures Skipped Success Rate Time
org.apache.maven.surefire.its.jiras 137 0 0 2 98.54% 612.062
org.apache.maven.surefire.its 564 0 0 131 76.773% 1,670.385

Note: package statistics are not computed recursively, they only sum up all of its testsuites numbers.

org.apache.maven.surefire.its.jiras

Class Tests Errors Failures Skipped Success Rate Time
Surefire1024VerifyFailsafeIfTestedIT 1 0 0 0 100% 3.191
Surefire1036NonFilterableJUnitRunnerWithCategoriesIT 1 0 0 0 100% 4.523
Surefire1041FailingJUnitRunnerIT 1 0 0 0 100% 3.703
Surefire1053SystemPropertiesIT 2 0 0 0 100% 6.938
Surefire1055CorrectConcurrentTestCountIT 1 0 0 0 100% 3.708
Surefire1080ParallelForkDoubleTestIT 1 0 0 0 100% 3.036
Surefire1082ParallelJUnitParameterizedIT 1 0 0 0 100% 4.038
Surefire1098BalancedRunOrderIT 1 0 0 0 100% 24.016
Surefire1122ParallelAndFlakyTestsIT 2 0 0 0 100% 6.151
Surefire1135ImproveIgnoreMessageForTestNGIT 2 0 0 0 100% 9.348
Surefire1136CwdPropagationInForkedModeIT 1 0 0 0 100% 3.598
Surefire1144XmlRunTimeIT 1 0 0 0 100% 4.48
Surefire1152RerunFailingTestsInSuiteIT 2 0 0 0 100% 7.159
Surefire1153IncludesAndSpecifiedTestIT 2 0 0 0 100% 5.687
Surefire1158RemoveInfoLinesIT 6 0 0 0 100% 22.514
Surefire1177TestngParallelSuitesIT 1 0 0 0 100% 6.366
Surefire1185DoNotSpawnTestsIT 1 0 0 0 100% 2.864
Surefire1202RerunAndSkipIT 2 0 0 0 100% 32.139
Surefire1209RerunAndForkCountIT 4 0 0 0 100% 43.634
Surefire1211JUnitTestNgIT 2 0 0 0 100% 8.745
Surefire141PluggableProvidersIT 4 0 0 0 100% 17.041
Surefire146ForkPerTestNoSetupIT 1 0 0 0 100% 3.305
Surefire162CharsetProviderIT 1 0 0 0 100% 3.313
Surefire224WellFormedXmlFailuresIT 1 0 0 0 100% 3.293
Surefire257NotRerunningTestsIT 1 0 0 0 100% 6.276
Surefire260TestWithIdenticalNamesIT 1 0 0 0 100% 8.637
Surefire34SecurityManagerIT 2 0 0 0 100% 6.613
Surefire376TestNgAfterSuiteFailureIT 1 0 0 0 100% 3.475
Surefire377TestNgAndJUnitTogetherIT 2 0 0 0 100% 6.934
Surefire408ManualProviderSelectionIT 1 0 0 0 100% 3.421
Surefire42NotExtendingTestCaseIT 1 0 0 0 100% 3.285
Surefire44InnerClassTestIT 1 0 0 0 100% 3.299
Surefire500PuzzlingErrorIT 1 0 0 0 100% 3.335
Surefire510TestClassPathForkModesIT 2 0 0 0 100% 6.583
Surefire569RunTestFromDependencyJarsIT 1 0 0 0 100% 3.153
Surefire570MultipleReportDirectoriesIT 2 0 0 0 100% 22.065
Surefire613TestCountInParallelIT 1 0 0 0 100% 3.58
Surefire621TestCountingJunit3InParallelIT 1 0 0 0 100% 3.76
Surefire628ConsoleOutputBeforeAndAfterClassIT 1 0 0 0 100% 3.491
Surefire634UnsettableSystemPropertiesWarningIT 1 0 0 0 100% 3.296
Surefire649EmptyStringSystemPropertiesIT 2 0 0 0 100% 5.677
Surefire673MockitoIT 1 0 0 0 100% 3.411
Surefire674BuildFailingWhenErrorsIT 1 0 0 0 100% 3.269
Surefire674BuildFailingWhenFailsafeErrorsIT 1 0 0 0 100% 4.371
Surefire685CommaSeparatedIncludesIT 1 0 0 0 100% 3.322
Surefire697NiceSummaryIT 1 0 0 0 100% 3.296
Surefire705ParallelForkTimeoutIT 1 0 0 0 100% 5.308
Surefire733AllOverrridesCapturedIT 1 0 0 0 100% 3.259
Surefire735ForkFailWithRedirectConsoleOutputIT 2 0 0 0 100% 5.745
Surefire740TruncatedCommaIT 1 0 0 0 100% 3.68
Surefire747MethodParallelWithSuiteCountIT 2 0 0 0 100% 9.662
Surefire772BothReportsIT 3 0 0 0 100% 8.465
Surefire772NoFailsafeReportsIT 4 0 0 0 100% 11.257
Surefire772NoSurefireReportsIT 4 0 0 0 100% 11.087
Surefire772SpecifiedReportsIT 3 0 0 0 100% 8.489
Surefire801ForkModeNoneClassLoaderIT 1 0 0 0 100% 2.712
Surefire803MultiFailsafeExecsIT 2 0 0 0 100% 12.194
Surefire806SpecifiedTestControlsIT 3 0 0 2 33.333% 3.232
Surefire809GroupExpressionsIT 6 0 0 0 100% 20.431
Surefire812Log4JClassLoaderIT 1 0 0 0 100% 3.463
Surefire817SystemExitIT 1 0 0 0 100% 3.681
Surefire818NpeIgnoresTestsIT 1 0 0 0 100% 4.192
Surefire828EmptyGroupExprIT 4 0 0 0 100% 14.527
Surefire832ProviderSelectionIT 1 0 0 0 100% 3.593
Surefire839TestWithoutCategoriesIT 2 0 0 0 100% 6.97
Surefire847AdditionalFailureIT 1 0 0 0 100% 3.737
Surefire855AllowFailsafeUseArtifactFileIT 4 0 0 0 100% 35.53
Surefire901MIssingResultfileWhenNoTestsIT 1 0 0 0 100% 3.242
Surefire907PerThreadWithoutThreadCountIT 1 0 0 0 100% 2.559
Surefire920TestFailureIgnoreWithTimeoutIT 2 0 0 0 100% 8.515
Surefire926FailureWith2ProvidersIT 1 0 0 0 100% 5.218
Surefire930TestNgSuiteXmlIT 1 0 0 0 100% 4.613
Surefire943ReportContentIT 2 0 0 0 100% 8.588
Surefire946KillMainProcessInReusableForkIT 3 0 0 0 100% 20.491
Surefire972BizarreNoClassDefIT 1 0 0 0 100% 5.218
Surefire975DefaultVMEncodingIT 1 0 0 0 100% 3.516
Surefire979WrongClassLoaderIT 1 0 0 0 100% 3.591
Surefire985ParameterizedRunnerAndCategoriesIT 1 0 0 0 100% 3.064
Surefire995CategoryInheritanceIT 5 0 0 0 100% 14.894

org.apache.maven.surefire.its

Class Tests Errors Failures Skipped Success Rate Time
AbstractTestCaseIT 1 0 0 0 100% 4.036
AdditionalClasspathIT 1 0 0 0 100% 2.861
AggregateReportIT 1 0 0 0 100% 6.522
ArgLineIT 1 0 0 0 100% 3.421
ArgLinePropertiesIT 1 0 0 0 100% 4.351
CheckSingleTestIT 4 0 0 0 100% 11.076
CheckTestFailIfNoTestsForkModeIT 6 0 0 0 100% 16.713
CheckTestFailIfNoTestsIT 3 0 0 0 100% 6.82
CheckTestNgBeforeMethodFailureIT 1 0 0 0 100% 3.538
CheckTestNgBeforeMethodIT 1 0 0 0 100% 3.525
CheckTestNgCustomObjectFactoryIT 1 0 0 0 100% 3.005
CheckTestNgCustomTestRunnerFactoryIT 1 0 0 0 100% 3.044
CheckTestNgExecuteErrorIT 1 0 0 0 100% 3.385
CheckTestNgGroupThreadParallelIT 1 0 0 0 100% 3.01
CheckTestNgJdk14IT 1 0 0 0 100% 3.505
CheckTestNgListenerReporterIT 8 0 0 0 100% 30.935
CheckTestNgListenersIT 1 0 0 0 100% 4.119
CheckTestNgPathWithSpacesIT 1 0 0 0 100% 3.544
CheckTestNgReportTestIT 3 0 0 0 100% 11.634
CheckTestNgSuiteXmlIT 3 0 0 1 66.667% 7.162
CheckTestNgSuiteXmlSingleIT 1 0 0 0 100% 3.565
CheckTestNgVersionsIT 20 0 0 2 90% 65.133
ClasspathFilteringIT 1 0 0 0 100% 2.923
ClassPathOrderIT 1 0 0 0 100% 4.383
ClasspathScopeFilteringIT 1 0 0 0 100% 2.884
ConsoleOutputIT 4 0 0 0 100% 23.421
CrashDetectionIT 3 0 0 0 100% 10.293
DefaultConfigurationIT 1 0 0 0 100% 2.873
EnvironmentVariableIT 1 0 0 0 100% 3.295
EnvironmentVariablesIT 2 0 0 0 100% 6.612
FailFastJUnitIT 12 0 0 0 100% 67.149
FailFastTestNgIT 6 0 0 0 100% 34.221
ForkConsoleOutputIT 4 0 0 0 100% 13.182
ForkConsoleOutputWithErrorsIT 1 0 0 0 100% 3.301
ForkModeIT 12 0 0 0 100% 52.428
ForkModeMultiModuleIT 4 0 0 0 100% 25.292
ForkModeTestNGIT 12 0 0 0 100% 45.766
IncludesExcludesFromFileIT 6 0 0 0 100% 18.172
IncludesExcludesIT 3 0 0 0 100% 9.874
JUnit44HamcrestIT 1 0 0 0 100% 3.27
Junit47concurrencyIT 1 0 0 0 100% 4.031
JUnit47ParallelIT 59 0 0 0 100% 284.196
JUnit47ParallelNotThreadSafeIT 1 0 0 0 100% 3.711
JUnit47RedirectOutputIT 2 0 0 0 100% 7.111
Junit47StaticInnerClassTestsIT 1 0 0 0 100% 2.947
Junit47WithCucumberIT 2 0 0 0 100% 9.022
JUnit48TestCategoriesIT 4 0 0 0 100% 15.561
JUnit4ForkAlwaysStaticInitPollutionIT 1 0 0 0 100% 4.309
Junit4IgnoreIT 2 0 0 0 100% 6.955
JUnit4RerunFailingTestsIT 5 0 0 0 100% 65.901
JUnit4RunListenerIT 2 0 0 0 100% 6.925
Junit4VersionsIT 9 0 0 0 100% 29.829
JUnitDepIT 4 0 0 0 100% 13.941
NoRunnableTestsInClassIT 1 0 0 0 100% 3.247
PlainOldJavaClasspathIT 1 0 0 0 100% 3.262
PlexusConflictIT 2 0 0 0 100% 7.272
PojoSimpleIT 1 0 0 0 100% 3.211
ReportersIT 1 0 0 0 100% 3.44
ResultCountingIT 3 0 0 0 100% 11.744
RunOrderIT 4 0 0 0 100% 12.498
RunOrderParallelForksIT 4 0 0 0 100% 12.516
SiblingAggregatorIT 1 0 0 0 100% 3.324
SmartStackTraceIT 1 0 0 0 100% 3.296
Surefire1179IT 1 0 0 0 100% 8.056
SystemPropertiesTestIT 2 0 0 0 100% 6.622
TestMethodPatternIT 7 0 0 0 100% 25.616
TestMultipleMethodPatternsIT 180 0 0 87 51.667% 296.225
TestMultipleMethodPatternsTestNGIT 90 0 0 41 54.444% 151.534
TestMultipleMethodsIT 3 0 0 0 100% 10.36
TestNgGroupsIT 5 0 0 0 100% 20.235
TestNgParallelWithAnnotationsIT 1 0 0 0 100% 4.613
TestNgSuccessPercentageIT 1 0 0 0 100% 3.107
TestSingleMethodIT 9 0 0 0 100% 32.544
TimeoutForkedTestIT 1 0 0 0 100% 4.071
TwoTestCasesIT 4 0 0 0 100% 13.552
UmlautDirIT 2 0 0 0 100% 6.57
UnicodeTestNamesIT 1 0 0 0 100% 3.493
UseIsolatedClassLoaderIT 1 0 0 0 100% 3.375
WorkingDirectoryIsInvalidPropertyIT 1 0 0 0 100% 2.516
WorkingDirectoryIT 4 0 0 0 100% 12.72
WorkingDirectoryMissingIT 1 0 0 0 100% 3.448
XmlReporterRunTimeIT 1 0 0 0 100% 9.236

Test Cases

[Summary] [Package List] [Test Cases]

AbstractTestCaseIT

abstractTestCase 4.036

AdditionalClasspathIT

additionalClasspath 2.861

AggregateReportIT

aggregateReport 6.522

ArgLineIT

argLine 3.421

ArgLinePropertiesIT

argLine 4.351

CheckSingleTestIT

singleTestDotJava 2.873
singleTestNonExistentOverride 2.695
singleTestNonExistent 2.71
singleTest 2.798

CheckTestFailIfNoTestsForkModeIT

dontFailIfNoTestsForkModeAlways 2.803
failIfNoTestsForkModeOnce 2.786
dontFailIfNoTestsForkModeNever 2.774
dontFailIfNoTestsForkModeOnce 2.787
failIfNoTestsForkModeNever 2.791
failIfNoTestsForkModeAlways 2.772

CheckTestFailIfNoTestsIT

failIfNoTests 2.194
dontFailIfNoTests 2.242
jUnit48CategoriesFailWhenNoTests 2.384

CheckTestNgBeforeMethodFailureIT

TestNgBeforeMethodFailure 3.538

CheckTestNgBeforeMethodIT

TestNgBeforeMethod 3.525

CheckTestNgCustomObjectFactoryIT

testTestNgListenerReporter 3.005

CheckTestNgCustomTestRunnerFactoryIT

testTestNgListenerReporter 3.044

CheckTestNgExecuteErrorIT

executionError 3.385

CheckTestNgGroupThreadParallelIT

TestNgGroupThreadParallel 3.01

CheckTestNgJdk14IT

TestNgJdk14 3.505

CheckTestNgListenerReporterIT

testNgListenerReporter[0: TestNG 5.6] 3.474
testNgListenerReporter[1: TestNG 5.7] 3.549
testNgListenerReporter[2: TestNG 5.10] 3.476
testNgListenerReporter[3: TestNG 5.13] 3.737
testNgListenerReporter[4: TestNG 5.14.6] 4.262
testNgListenerReporter[5: TestNG 5.14.9] 3.561
testNgListenerReporter[6: TestNG 6.0] 3.545
testNgListenerReporter[7: TestNG 6.9.9] 5.331

CheckTestNgListenersIT

TestNgListenerReporter 4.119

CheckTestNgPathWithSpacesIT

TestWithSpaces 3.544

CheckTestNgReportTestIT

testNgReport 4.641
shouldNotBeVerbose 3.438
shouldBeVerbose 3.555

CheckTestNgSuiteXmlIT

suiteXml 3.562
suiteXmlForkCountTwoReuse 3.6
suiteXmlForkModeAlways 0
Fails - see SUREFIRE-1123

CheckTestNgSuiteXmlSingleIT

TestNgSuite 3.565

CheckTestNgVersionsIT

XXXtest50 0
5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
test502 3.41
test510 3.535
test511 3.522
test512 3.684
test513 3.68
test514 3.712
test685 4.461
test5131 3.745
test5141 3.8
test5142 3.709
test47 3.385
test51 3.433
test55 3.598
test56 3.439
test57 3.481
test58 3.502
test59 3.476
test60 3.561
XXXtest501 0
5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024

ClasspathFilteringIT

additionalClasspath 2.923

ClassPathOrderIT

classPathOrder 4.383

ClasspathScopeFilteringIT

additionalClasspath 2.884

ConsoleOutputIT

properNewlinesAndEncodingWithDifferentEncoding 3.49
properNewlinesAndEncodingWithDefaultEncodings 3.455
largerSoutThanMemory 13.65
properNewlinesAndEncodingWithoutFork 2.826

CrashDetectionIT

hardCrashInReusableFork 3.456
crashInReusableFork 3.403
crashInFork 3.434

DefaultConfigurationIT

defaultConfiguration 2.873

EnvironmentVariableIT

environmentVariable 3.295

EnvironmentVariablesIT

testWhenUseSystemClassLoader 3.298
testWhenDontUseSystemClassLoader 3.314

FailFastJUnitIT

test[junit4-oneFork-ff1] 4.542
test[junit47-oneFork-ff1] 4.275
test[junit4-oneFork-ff2] 5.382
test[junit47-oneFork-ff2] 5.516
test[junit4-twoForks-ff1] 4.552
test[junit47-twoForks-ff1] 4.837
test[junit4-twoForks-ff2] 5.054
test[junit47-twoForks-ff2] 5.294
test[junit4-oneFork-ff3] 7.748
test[junit47-oneFork-ff3] 7.991
test[junit4-twoForks-ff3] 5.875
test[junit47-twoForks-ff3] 6.083

FailFastTestNgIT

test[testng-oneFork-ff1] 4.233
test[testng-oneFork-ff2] 5.542
test[testng-twoForks-ff1] 4.816
test[testng-twoForks-ff2] 5.45
test[testng-oneFork-ff3] 8.067
test[testng-twoForks-ff3] 6.113

ForkConsoleOutputIT

printSummaryTrueWithRedirect 3.345
printSummaryFalseWithoutRedirect 3.232
printSummaryTrueWithoutRedirect 3.247
printSummaryFalseWithRedirect 3.358

ForkConsoleOutputWithErrorsIT

xmlFileContainsConsoleOutput 3.301

ForkModeIT

testForkModeOncePerThreadSingleThread 4.642
testForkModePerTest 5.158
testForkCountZero 3.561
testForkCountOneNoReuse 5.143
testForkCountTwoNoReuse 4.649
testForkModeNever 3.568
testForkCountTwoReuse 4.359
testForkCountOneReuse 4.129
testForkModeOncePerThreadTwoThreads 4.346
testForkModeAlways 5.135
testForkModeNone 3.567
testForkModeOnce 4.171

ForkModeMultiModuleIT

testForkCountOneNoReuse 7.815
testForkCountTwoNoReuse 5.773
testForkCountTwoReuse 5.078
testForkCountOneReuse 6.626

ForkModeTestNGIT

testForkModeOncePerThreadSingleThread 3.606
testForkModePerTest 4.84
testForkCountZero 2.991
testForkCountOneNoReuse 4.88
testForkCountTwoNoReuse 4.338
testForkModeNever 3.016
testForkCountTwoReuse 3.492
testForkCountOneReuse 3.595
testForkModeOncePerThreadTwoThreads 3.472
testForkModeAlways 4.91
testForkModeNone 2.953
testForkModeOnce 3.673

IncludesExcludesFromFileIT

testSimpleMixed 3.344
testMissingExcludes 2.485
testRegex 3.263
testPath 3.275
testMissingIncludes 2.503
testSimple 3.302

IncludesExcludesIT

testPathBasedIncludesExcludes 3.19
testIncludesExcludes 3.373
testRegexIncludesExcludes 3.311

Surefire1024VerifyFailsafeIfTestedIT

shouldScanAndRunTestsInDependencyJars 3.191

Surefire1036NonFilterableJUnitRunnerWithCategoriesIT

test 4.523

Surefire1041FailingJUnitRunnerIT

reportErrorInJUnitRunnerAsTestError 3.703

Surefire1053SystemPropertiesIT

checkWarningsSysPropTwice 3.432
checkWarningsFileEncoding 3.506

Surefire1055CorrectConcurrentTestCountIT

testTestNgAndJUnitTogether 3.708

Surefire1080ParallelForkDoubleTestIT

test 3.036

Surefire1082ParallelJUnitParameterizedIT

test 4.038

Surefire1098BalancedRunOrderIT

reorderedParallelClasses 24.016

Surefire1122ParallelAndFlakyTestsIT

nonParallelCreatesCorrectReport 3.096
parallelCreatesCorrectReport 3.055

Surefire1135ImproveIgnoreMessageForTestNGIT

testNgReport57 4.581
testNgReport688 4.767

Surefire1136CwdPropagationInForkedModeIT

testTestNgAndJUnitTogether 3.598

Surefire1144XmlRunTimeIT

testXmlRunTime 4.48

Surefire1152RerunFailingTestsInSuiteIT

testJUnit48Provider47 3.682
testJUnit48Provider4 3.477

Surefire1153IncludesAndSpecifiedTestIT

testSpecifiedTestInIncludes 2.846
testSpecifiedTestNotInIncludes 2.841

Surefire1158RemoveInfoLinesIT

shouldRunWithCliOption[junit-option-ff] 3.747
shouldRunWithCliOption[testng-option-ff] 3.743
shouldRunWithCliOption[junit-option-X] 3.761
shouldRunWithCliOption[testng-option-X] 3.792
shouldRunWithCliOption[junit-option-e] 3.785
shouldRunWithCliOption[testng-option-e] 3.686

Surefire1177TestngParallelSuitesIT

shouldRunTwoSuitesInParallel 6.366

Surefire1185DoNotSpawnTestsIT

doNotSpawnUnwantedTests 2.864

Surefire1202RerunAndSkipIT

junit47 16.13
junit4 16.009

Surefire1209RerunAndForkCountIT

notReusableForksJUnit47 11.38
reusableForksJUnit47 10.935
reusableForksJUnit4 10.231
notReusableForksJUnit4 11.088

Surefire1211JUnitTestNgIT

withoutJUnit 4.751
withJUnit 3.994

Surefire141PluggableProvidersIT

pluggableProviderPresent 5.15
invokeRuntimeException 3.947
invokeReporterException 3.966
constructorRuntimeException 3.978

Surefire146ForkPerTestNoSetupIT

testForkPerTestNoSetup 3.305

Surefire162CharsetProviderIT

testCharsetProvider 3.313

Surefire224WellFormedXmlFailuresIT

testWellFormedXmlFailures 3.293

Surefire257NotRerunningTestsIT

shouldNotRerun 6.276

Surefire260TestWithIdenticalNamesIT

testWithIdenticalNames 8.637

Surefire34SecurityManagerIT

testSecurityManager 3.294
testSecurityManagerSuccessful 3.319

Surefire376TestNgAfterSuiteFailureIT

testAfterSuiteFailure 3.475

Surefire377TestNgAndJUnitTogetherIT

testTestNgAndJUnit4Together 3.319
testTestNgAndJUnitTogether 3.615

Surefire408ManualProviderSelectionIT

testParallelBuildResultCount 3.421

Surefire42NotExtendingTestCaseIT

testInnerClass 3.285

Surefire44InnerClassTestIT

testInnerClass 3.299

Surefire500PuzzlingErrorIT

testBuildFailingWhenErrors 3.335

Surefire510TestClassPathForkModesIT

testForkOnce 3.336
testForkAlways 3.247

Surefire569RunTestFromDependencyJarsIT

shouldScanAndRunTestsInDependencyJars 3.153

Surefire570MultipleReportDirectoriesIT

testReportWithAggregate 11.134
testReportWithoutAggregate 10.931

Surefire613TestCountInParallelIT

testParallelBuildResultCount 3.58

Surefire621TestCountingJunit3InParallelIT

testJunit3ParallelBuildResultCount 3.76

Surefire628ConsoleOutputBeforeAndAfterClassIT

testJunit3ParallelBuildResultCount 3.491

Surefire634UnsettableSystemPropertiesWarningIT

testJunit3ParallelBuildResultCount 3.296

Surefire649EmptyStringSystemPropertiesIT

systemPropertyVariables 2.838
systemProperties 2.839

Surefire673MockitoIT

testBuildFailingWhenErrors 3.411

Surefire674BuildFailingWhenErrorsIT

testBuildFailingWhenErrors 3.269

Surefire674BuildFailingWhenFailsafeErrorsIT

testBuildFailingWhenErrors 4.371

Surefire685CommaSeparatedIncludesIT

testBuildFailingWhenErrors 3.322

Surefire697NiceSummaryIT

testBuildFailingWhenErrors 3.296

Surefire705ParallelForkTimeoutIT

testTimeoutForked 5.308

Surefire733AllOverrridesCapturedIT

testLogOutput 3.259

Surefire735ForkFailWithRedirectConsoleOutputIT

vmStartFail 2.85
vmStartFailShouldFailBuildk 2.895

Surefire740TruncatedCommaIT

testRussianLocaleReport 3.68

Surefire747MethodParallelWithSuiteCountIT

testMethodsParallelWithSuite 4.569
testClassesParallelWithSuite 5.093

Surefire772BothReportsIT

testSkippedSurefireReportGeneration 2.756
testSkippedFailsafeReportGeneration 2.77
testReportGeneration 2.939

Surefire772NoFailsafeReportsIT

testSkippedFailsafeReportGeneration 2.712
testForcedFailsafeReportGeneration 2.909
testSkipForcedFailsafeReportGeneration 2.779
testReportGeneration 2.857

Surefire772NoSurefireReportsIT

testOptionalSurefireReportGeneration 2.676
testSkippedSurefireReportGeneration 2.749
testSkipOptionalSurefireReportGeneration 2.726
testReportGeneration 2.936

Surefire772SpecifiedReportsIT

testSkippedSurefireReportGeneration 2.737
testSkippedFailsafeReportGeneration 2.726
testReportGeneration 3.026

Surefire801ForkModeNoneClassLoaderIT

testSHouldBeOkWithForkNever 2.712

Surefire803MultiFailsafeExecsIT

testOneExecutionRunInTwoBuilds 7.711
testSecondExecutionRunsAfterFirstExecutionFails 4.483

Surefire806SpecifiedTestControlsIT

singleTestInSingleExecutionProject 3.232
twoSpecifiedTestExecutionsInCorrectExecutionBlocks 0
since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
singleTestInOneExecutionOfMultiExecutionProject 0
since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution

Surefire809GroupExpressionsIT

testNGRunCategoryAB 3.703
testExcludedGroups 3.629
testJUnitRunCategoryNotC 3.555
incorrectJUnitVersions 2.262
categoryAB 3.616
testNGRunCategoryNotC 3.666

Surefire812Log4JClassLoaderIT

testJunit3ParallelBuildResultCount 3.463

Surefire817SystemExitIT

systemExit1 3.681

Surefire818NpeIgnoresTestsIT

testBuildFailingWhenErrors 4.192

Surefire828EmptyGroupExprIT

testJUnitRunEmptyExcludeGroups 3.682
testJUnitRunEmptyGroups 3.633
testTestNGRunEmptyExcludeGroups 3.597
testTestNGRunEmptyGroups 3.615

Surefire832ProviderSelectionIT

testJUnitRunCategoryAB 3.593

Surefire839TestWithoutCategoriesIT

classWithoutCategoryForked 3.4
classWithoutCategory 3.57

Surefire847AdditionalFailureIT

testJUnitRunCategoryAB 3.737

Surefire855AllowFailsafeUseArtifactFileIT

jarNotForkingShouldUseFile 11.987
jarShouldUseFile 5.777
warShouldUseClasses 7.61
osgiBundleShouldUseFile 10.156

Surefire901MIssingResultfileWhenNoTestsIT

failsafeWithNoTests 3.242

Surefire907PerThreadWithoutThreadCountIT

categoryAB 2.559

Surefire920TestFailureIgnoreWithTimeoutIT

timeoutInForkWithBuildFail 4.279
timeoutInForkWithNoBuildFail 4.236

Surefire926FailureWith2ProvidersIT

testBuildFailingWhenErrors 5.218

Surefire930TestNgSuiteXmlIT

suiteXmlRun 4.613

Surefire943ReportContentIT

test_noParallel 4.655
test_parallelBoth 3.933

Surefire946KillMainProcessInReusableForkIT

testExit 6.951
testHalt 6.754
testInterrupt 6.786

Surefire972BizarreNoClassDefIT

testJunit3ParallelBuildResultCount 5.218

Surefire975DefaultVMEncodingIT

runWithRussian1251 3.516

Surefire979WrongClassLoaderIT

wrongClassloaderUSedInSmartStacktraceparser 3.591

Surefire985ParameterizedRunnerAndCategoriesIT

test 3.064

Surefire995CategoryInheritanceIT

junit411ShouldRunExplicitCategory 2.97
junit411ShouldExcludeExplicitCategory 2.978
junit412ShouldExcludeInheritedCategory 2.999
junit412ShouldRunInheritedCategory 2.997
negativeTestShouldRunAllCategories 2.95

JUnit44HamcrestIT

testJUnit44Hamcrest 3.27

Junit47concurrencyIT

test47 4.031

JUnit47ParallelIT

unknownThreadCountClasses 2.68
threadCountSuites 6.812
unlimitedThreadsSuitesAndMethods1 4.433
unlimitedThreadsSuitesAndMethods2 4.523
unknownThreadCountMethods 2.7
threadCountClassesAndMethods 4.507
reusableThreadCountClassesAndMethodsOptimized 5.015
unknownThreadCountSuites 2.749
reusableThreadCountAll 4.185
forcedShutdown 5.53
unknownThreadCountAll 2.679
serial 10.203
reusableThreadCountAllOptimized 4.111
suites 6.774
unlimitedThreadsMethods1 6.769
unlimitedThreadsMethods2 5.77
unlimitedThreadsSuitesAndClasses1 4.122
unlimitedThreadsSuitesAndClasses2 4.161
threadCountAllOptimized 4.63
threadCountAll 4.716
everyThreadCountSuitesAndClasses 4.214
unknownThreadCountBoth 2.897
threadCountSuitesAndClassesOptimized 4.453
classesAndMethods 4.054
everyThreadCountSuitesAndMethods 4.493
unknownThreadCountSuitesAndClasses 2.735
reusableThreadCountSuitesAndClassesOptimized 5.118
unknownThreadCountSuitesAndMethods 2.764
suitesAndClasses 4.236
suitesAndMethods 4.433
shutdown 8.038
threadCountClassesAndMethodsOneCore 7.922
everyThreadCountClassesAndMethods 4.483
all 3.559
unknownThreadCountClassesAndMethods 2.797
threadCountSuitesAndMethodsOptimized 4.538
reusableThreadCountSuitesAndMethodsOptimized 5.134
unlimitedThreadsClasses1 4.953
unlimitedThreadsClasses2 5.137
threadCountClasses 5.064
everyThreadCountAll 4.43
threadCountMethods 5.755
unlimitedThreadsSuites1 6.864
unlimitedThreadsSuites2 6.943
threadCountSuitesAndClasses 4.184
unlimitedThreadsClassesAndMethods1 3.8
unlimitedThreadsClassesAndMethods2 3.908
threadCountSuitesAndMethods 4.527
classes 5.125
reusableThreadCountSuitesAndClasses 5.056
methods 5.705
reusableThreadCountSuitesAndMethods 5.078
timeoutAndForcedShutdown 5.548
threadCountClassesAndMethodsOptimized 4.47
unlimitedThreadsAll1 3.601
unlimitedThreadsAll2 3.601
forcedShutdownVerifyingLogs 4.09
threadCountClassesAndMethodsOneCoreOptimized 8.066
reusableThreadCountClassesAndMethods 5.354

JUnit47ParallelNotThreadSafeIT

test 3.711

JUnit47RedirectOutputIT

testClassesParallel 3.558
testPrintSummaryTrueWithRedirect 3.553

Junit47StaticInnerClassTestsIT

testStaticInnerClassTests 2.947

Junit47WithCucumberIT

testWithParallelClasses 5.428
testWithoutParallel 3.594

JUnit48TestCategoriesIT

testCategoriesABForkAlways 3.636
testCategoriesAB 3.664
testCategoriesAC 3.58
testCategoriesACForkAlways 4.681

JUnit4ForkAlwaysStaticInitPollutionIT

testJunit4Ignore 4.309

Junit4IgnoreIT

testJunit4Ignore 3.375
testJunit47ParallelIgnore 3.58

JUnit4RerunFailingTestsIT

testRerunFailingErrorTestsFalse 13.19
testRerunFailingErrorTestsWithOneRetry 13.078
testRerunFailingErrorTestsTwoRetry 13.205
testRerunOneTestMethod 13.224
testRerunOneTestClass 13.204

JUnit4RunListenerIT

testJUnit4RunListener 3.354
testRunlistenerJunitCoreProvider 3.571

Junit4VersionsIT

test431 3.327
test40 3.272
test41 3.35
test42 3.355
test43 3.287
test44 3.271
test45 3.32
test46 3.294
test47 3.353

JUnitDepIT

testJUnit44DepWithSneaky381 3.407
testJUnit44Dep 3.394
testJUnit47Dep 3.585
testJUnit48Dep 3.555

NoRunnableTestsInClassIT

testJunit3ParallelBuildResultCount 3.247

PlainOldJavaClasspathIT

testPlainOldJavaClasspath 3.262

PlexusConflictIT

testPlexusConflict 3.674
testPlexusConflictIsolatedClassLoader 3.598

PojoSimpleIT

testit 3.211

ReportersIT

testRedirectOutputTestNg 3.44

ResultCountingIT

testCountingWithJunit481ForkAlways 5.494
testCountingWithJunit481ForkOnce 3.444
testCountingWithJunit481ForkNever 2.806

RunOrderIT

testReverseAlphabetical 3.397
testNonExistingRunOrder 2.467
testHourly 3.344
testAlphabetical 3.29

RunOrderParallelForksIT

testReverseAlphabetical 3.258
testNonExistingRunOrder 2.566
testHourly 3.331
testAlphabetical 3.361

SiblingAggregatorIT

testSiblingAggregator 3.324

SmartStackTraceIT

misg 3.296

Surefire1179IT

suiteXmlForkCountTwoReuse 8.056

SystemPropertiesTestIT

testSystemProperties 3.924
testSystemPropertiesNoFork 2.698

TestMethodPatternIT

testJUnit48WithCategoryFilter 3.636
testJUnit48Provider47 3.741
testMethodPatternAfter 3.487
testTestNGMethodPattern 3.715
testJUnit48Provider4 3.931
testJUnit44 3.503
testTestNgMethodBefore 3.603

TestMultipleMethodPatternsIT

shouldNotRunExcludedClassesAndMethods[0] 3.009
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[0] 2.997
shouldMatchExactClassAndMethodCharacters[0] 3.096
shouldMatchExactClassAndMethodWildcard[0] 2.964
testSuccessTwo[0] 3.089
simpleNameTest[0] 2.973
simpleNameTestWithJavaExt[0] 3.067
regexClass[0] 3.037
shouldNotRunExcludedClasses[0] 2.987
shouldNotRunExcludedMethods[0] 3.023
simpleNameTestWithJavaExtWildcardPkg[0] 2.959
shouldMatchMultiplePatterns[0] 3.098
shouldMatchExactClassAndMethodsPostfix[0] 3.024
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[0] 2.985
simpleNameTestWithWildcardPkg[0] 2.972
shouldMatchWildcardPackageAndClassAndMethod[0] 2.933
shouldMatchExactClassAndMultipleMethods[0] 2.982
fullyQualifiedTest[0] 3.007
negativeTest[0] 0.001
skipped
testRegexSuccessTwo[0] 3.041
shouldMatchSimpleClassNameAndMethodWithJavaExt[0] 2.971
shouldMatchExactClassAndMethodsWildcard[0] 2.982
shouldMatchMultiplePatternsComplex[0] 3.088
simpleNameTestAsParallel[0] 0.001
skipped
shouldMatchMultiplePatternsAsParallel[0] 0
skipped
shouldNotRunExcludedClassesIfIncluded[0] 3.253
shouldMatchSimpleClassNameAndMethod[0] 3.098
shouldMatchExactClassAndMethodPostfix[0] 3.181
shouldMatchMultiplePatternsComplexAsParallel[0] 0
skipped
regexClassAndMethod[0] 3.177
shouldNotRunExcludedClassesAndMethods[1] 3.701
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[1] 3.503
shouldMatchExactClassAndMethodCharacters[1] 3.296
shouldMatchExactClassAndMethodWildcard[1] 3.427
testSuccessTwo[1] 3.447
simpleNameTest[1] 3.284
simpleNameTestWithJavaExt[1] 3.305
regexClass[1] 3.16
shouldNotRunExcludedClasses[1] 3.135
shouldNotRunExcludedMethods[1] 3.216
simpleNameTestWithJavaExtWildcardPkg[1] 3.109
shouldMatchMultiplePatterns[1] 3.449
shouldMatchExactClassAndMethodsPostfix[1] 3.112
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[1] 3.059
simpleNameTestWithWildcardPkg[1] 3.05
shouldMatchWildcardPackageAndClassAndMethod[1] 3.122
shouldMatchExactClassAndMultipleMethods[1] 3.169
fullyQualifiedTest[1] 3.089
negativeTest[1] 0
skipped
testRegexSuccessTwo[1] 3.82
shouldMatchSimpleClassNameAndMethodWithJavaExt[1] 3.214
shouldMatchExactClassAndMethodsWildcard[1] 3.158
shouldMatchMultiplePatternsComplex[1] 3.546
simpleNameTestAsParallel[1] 3.298
shouldMatchMultiplePatternsAsParallel[1] 3.763
shouldNotRunExcludedClassesIfIncluded[1] 3.501
shouldMatchSimpleClassNameAndMethod[1] 3.261
shouldMatchExactClassAndMethodPostfix[1] 3.386
shouldMatchMultiplePatternsComplexAsParallel[1] 3.671
regexClassAndMethod[1] 3.178
shouldNotRunExcludedClassesAndMethods[2] 0.001
skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[2] 0
skipped
shouldMatchExactClassAndMethodCharacters[2] 0
skipped
shouldMatchExactClassAndMethodWildcard[2] 0
skipped
testSuccessTwo[2] 0
skipped
simpleNameTest[2] 3.024
simpleNameTestWithJavaExt[2] 3.067
regexClass[2] 3.161
shouldNotRunExcludedClasses[2] 3.171
shouldNotRunExcludedMethods[2] 0
skipped
simpleNameTestWithJavaExtWildcardPkg[2] 2.931
shouldMatchMultiplePatterns[2] 0
skipped
shouldMatchExactClassAndMethodsPostfix[2] 0
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[2] 0
skipped
simpleNameTestWithWildcardPkg[2] 3.114
shouldMatchWildcardPackageAndClassAndMethod[2] 0
skipped
shouldMatchExactClassAndMultipleMethods[2] 0
skipped
fullyQualifiedTest[2] 3.421
negativeTest[2] 3.068
testRegexSuccessTwo[2] 0
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[2] 0
skipped
shouldMatchExactClassAndMethodsWildcard[2] 0
skipped
shouldMatchMultiplePatternsComplex[2] 0
skipped
simpleNameTestAsParallel[2] 0
skipped
shouldMatchMultiplePatternsAsParallel[2] 0
skipped
shouldNotRunExcludedClassesIfIncluded[2] 2.909
shouldMatchSimpleClassNameAndMethod[2] 0
skipped
shouldMatchExactClassAndMethodPostfix[2] 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[2] 0
skipped
regexClassAndMethod[2] 0
skipped
shouldNotRunExcludedClassesAndMethods[3] 0
skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[3] 0
skipped
shouldMatchExactClassAndMethodCharacters[3] 0
skipped
shouldMatchExactClassAndMethodWildcard[3] 0
skipped
testSuccessTwo[3] 0
skipped
simpleNameTest[3] 3.128
simpleNameTestWithJavaExt[3] 3.168
regexClass[3] 3.14
shouldNotRunExcludedClasses[3] 3.118
shouldNotRunExcludedMethods[3] 0
skipped
simpleNameTestWithJavaExtWildcardPkg[3] 3.24
shouldMatchMultiplePatterns[3] 0
skipped
shouldMatchExactClassAndMethodsPostfix[3] 0
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[3] 0
skipped
simpleNameTestWithWildcardPkg[3] 3.203
shouldMatchWildcardPackageAndClassAndMethod[3] 0
skipped
shouldMatchExactClassAndMultipleMethods[3] 0
skipped
fullyQualifiedTest[3] 3.336
negativeTest[3] 3.213
testRegexSuccessTwo[3] 0
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[3] 0
skipped
shouldMatchExactClassAndMethodsWildcard[3] 0
skipped
shouldMatchMultiplePatternsComplex[3] 0
skipped
simpleNameTestAsParallel[3] 3.539
shouldMatchMultiplePatternsAsParallel[3] 0
skipped
shouldNotRunExcludedClassesIfIncluded[3] 3.456
shouldMatchSimpleClassNameAndMethod[3] 0
skipped
shouldMatchExactClassAndMethodPostfix[3] 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[3] 0
skipped
regexClassAndMethod[3] 0
skipped
shouldNotRunExcludedClassesAndMethods[4] 0
skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[4] 0
skipped
shouldMatchExactClassAndMethodCharacters[4] 0
skipped
shouldMatchExactClassAndMethodWildcard[4] 0
skipped
testSuccessTwo[4] 0
skipped
simpleNameTest[4] 3.2
simpleNameTestWithJavaExt[4] 3.188
regexClass[4] 3.237
shouldNotRunExcludedClasses[4] 3.188
shouldNotRunExcludedMethods[4] 0
skipped
simpleNameTestWithJavaExtWildcardPkg[4] 2.961
shouldMatchMultiplePatterns[4] 0
skipped
shouldMatchExactClassAndMethodsPostfix[4] 0
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[4] 0
skipped
simpleNameTestWithWildcardPkg[4] 3.02
shouldMatchWildcardPackageAndClassAndMethod[4] 0
skipped
shouldMatchExactClassAndMultipleMethods[4] 0
skipped
fullyQualifiedTest[4] 3.151
negativeTest[4] 2.988
testRegexSuccessTwo[4] 0
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[4] 0
skipped
shouldMatchExactClassAndMethodsWildcard[4] 0
skipped
shouldMatchMultiplePatternsComplex[4] 0
skipped
simpleNameTestAsParallel[4] 0
skipped
shouldMatchMultiplePatternsAsParallel[4] 0
skipped
shouldNotRunExcludedClassesIfIncluded[4] 3.072
shouldMatchSimpleClassNameAndMethod[4] 0
skipped
shouldMatchExactClassAndMethodPostfix[4] 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[4] 0.001
skipped
regexClassAndMethod[4] 0
skipped
shouldNotRunExcludedClassesAndMethods[5] 0
skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[5] 0
skipped
shouldMatchExactClassAndMethodCharacters[5] 0
skipped
shouldMatchExactClassAndMethodWildcard[5] 0
skipped
testSuccessTwo[5] 0
skipped
simpleNameTest[5] 3.139
simpleNameTestWithJavaExt[5] 3.349
regexClass[5] 3.453
shouldNotRunExcludedClasses[5] 3.402
shouldNotRunExcludedMethods[5] 0
skipped
simpleNameTestWithJavaExtWildcardPkg[5] 3.388
shouldMatchMultiplePatterns[5] 0
skipped
shouldMatchExactClassAndMethodsPostfix[5] 0
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[5] 0
skipped
simpleNameTestWithWildcardPkg[5] 3.212
shouldMatchWildcardPackageAndClassAndMethod[5] 0
skipped
shouldMatchExactClassAndMultipleMethods[5] 0
skipped
fullyQualifiedTest[5] 3.065
negativeTest[5] 2.886
testRegexSuccessTwo[5] 0
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[5] 0
skipped
shouldMatchExactClassAndMethodsWildcard[5] 0
skipped
shouldMatchMultiplePatternsComplex[5] 0
skipped
simpleNameTestAsParallel[5] 3.236
shouldMatchMultiplePatternsAsParallel[5] 0
skipped
shouldNotRunExcludedClassesIfIncluded[5] 3.257
shouldMatchSimpleClassNameAndMethod[5] 0
skipped
shouldMatchExactClassAndMethodPostfix[5] 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[5] 0
skipped
regexClassAndMethod[5] 0
skipped

TestMultipleMethodPatternsTestNGIT

shouldNotRunExcludedClassesAndMethods[0] 3.217
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[0] 3.087
shouldMatchExactClassAndMethodCharacters[0] 3.086
shouldMatchExactClassAndMethodWildcard[0] 3.091
testSuccessTwo[0] 3.272
simpleNameTest[0] 3.107
simpleNameTestWithJavaExt[0] 3.113
regexClass[0] 3.028
shouldNotRunExcludedClasses[0] 3.155
shouldNotRunExcludedMethods[0] 3.134
simpleNameTestWithJavaExtWildcardPkg[0] 3.061
shouldMatchMultiplePatterns[0] 3.08
shouldMatchExactClassAndMethodsPostfix[0] 3.096
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[0] 2.983
simpleNameTestWithWildcardPkg[0] 3.053
shouldMatchWildcardPackageAndClassAndMethod[0] 3.075
shouldMatchExactClassAndMultipleMethods[0] 3.111
fullyQualifiedTest[0] 3.11
negativeTest[0] 0
skipped
testRegexSuccessTwo[0] 3.102
shouldMatchSimpleClassNameAndMethodWithJavaExt[0] 3.1
shouldMatchExactClassAndMethodsWildcard[0] 3.241
shouldMatchMultiplePatternsComplex[0] 3.316
simpleNameTestAsParallel[0] 3.168
shouldMatchMultiplePatternsAsParallel[0] 3.184
shouldNotRunExcludedClassesIfIncluded[0] 3.076
shouldMatchSimpleClassNameAndMethod[0] 3.125
shouldMatchExactClassAndMethodPostfix[0] 3.108
shouldMatchMultiplePatternsComplexAsParallel[0] 3.069
regexClassAndMethod[0] 3.085
shouldNotRunExcludedClassesAndMethods[1] 0
skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[1] 0
skipped
shouldMatchExactClassAndMethodCharacters[1] 0
skipped
shouldMatchExactClassAndMethodWildcard[1] 0
skipped
testSuccessTwo[1] 0
skipped
simpleNameTest[1] 3.034
simpleNameTestWithJavaExt[1] 3.117
regexClass[1] 3.077
shouldNotRunExcludedClasses[1] 3.124
shouldNotRunExcludedMethods[1] 0
skipped
simpleNameTestWithJavaExtWildcardPkg[1] 3.041
shouldMatchMultiplePatterns[1] 0
skipped
shouldMatchExactClassAndMethodsPostfix[1] 0
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[1] 0
skipped
simpleNameTestWithWildcardPkg[1] 3.062
shouldMatchWildcardPackageAndClassAndMethod[1] 0
skipped
shouldMatchExactClassAndMultipleMethods[1] 0
skipped
fullyQualifiedTest[1] 3.115
negativeTest[1] 2.803
testRegexSuccessTwo[1] 0
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[1] 0
skipped
shouldMatchExactClassAndMethodsWildcard[1] 0
skipped
shouldMatchMultiplePatternsComplex[1] 0
skipped
simpleNameTestAsParallel[1] 3.079
shouldMatchMultiplePatternsAsParallel[1] 0
skipped
shouldNotRunExcludedClassesIfIncluded[1] 3.067
shouldMatchSimpleClassNameAndMethod[1] 0
skipped
shouldMatchExactClassAndMethodPostfix[1] 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[1] 0
skipped
regexClassAndMethod[1] 0
skipped
shouldNotRunExcludedClassesAndMethods[2] 0
skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[2] 0
skipped
shouldMatchExactClassAndMethodCharacters[2] 0
skipped
shouldMatchExactClassAndMethodWildcard[2] 0
skipped
testSuccessTwo[2] 0
skipped
simpleNameTest[2] 3.073
simpleNameTestWithJavaExt[2] 3.102
regexClass[2] 3.092
shouldNotRunExcludedClasses[2] 3.051
shouldNotRunExcludedMethods[2] 0
skipped
simpleNameTestWithJavaExtWildcardPkg[2] 3.102
shouldMatchMultiplePatterns[2] 0
skipped
shouldMatchExactClassAndMethodsPostfix[2] 0
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[2] 0
skipped
simpleNameTestWithWildcardPkg[2] 3.058
shouldMatchWildcardPackageAndClassAndMethod[2] 0
skipped
shouldMatchExactClassAndMultipleMethods[2] 0
skipped
fullyQualifiedTest[2] 3.093
negativeTest[2] 2.824
testRegexSuccessTwo[2] 0
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[2] 0
skipped
shouldMatchExactClassAndMethodsWildcard[2] 0.001
skipped
shouldMatchMultiplePatternsComplex[2] 0
skipped
simpleNameTestAsParallel[2] 3.109
shouldMatchMultiplePatternsAsParallel[2] 0
skipped
shouldNotRunExcludedClassesIfIncluded[2] 3.077
shouldMatchSimpleClassNameAndMethod[2] 0
skipped
shouldMatchExactClassAndMethodPostfix[2] 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[2] 0
skipped
regexClassAndMethod[2] 0
skipped

TestMultipleMethodsIT

testJunit48Provider4 3.539
testJunit44 3.005
testJunit48Provider47 3.816

TestNgGroupsIT

testExclusion 4.816
testGroupsAndExclusion 3.847
groupsWithDash 3.883
testOnlyGroups 3.85
groupsBySimpleRegex 3.839

TestNgParallelWithAnnotationsIT

testTestNgGroupThreadParallel 4.613

TestNgSuccessPercentageIT

testPassesWhenFailuresLessThanSuccessPercentage 3.107

TestSingleMethodIT

fullyQualifiedTestNg 3.745
testJunit48Provider4 3.617
testJunit44 3.348
testJunit48parallel 3.638
testJunit48Provider47 3.74
fullyQualifiedJunit48Provider47 3.675
fullyQualifiedJunit48Provider4 3.542
testTestNg5149 3.635
testTestNg 3.604

TimeoutForkedTestIT

testTimeoutForked 4.071

TwoTestCasesIT

testJunit4Suite 3.322
testTestNGSuite 3.529
testTwoTestCases 3.342
testTwoTestCaseSuite 3.359

UmlautDirIT

testUmlautIsolatedClassLoader 3.247
testUmlaut 3.323

UnicodeTestNamesIT

checkFileNamesWithUnicode 3.493

UseIsolatedClassLoaderIT

testUseSystemClassLoader 3.375

WorkingDirectoryIsInvalidPropertyIT

testWorkingDirectory 2.516

WorkingDirectoryIT

testWorkingDirectory 3.514
testWorkingDirectoryChildOnlyNoFork 2.892
testWorkingDirectoryNoFork 3.03
testWorkingDirectoryChildOnly 3.284

WorkingDirectoryMissingIT

testWorkingDirectory 3.448

XmlReporterRunTimeIT

testForkModeAlways 9.236

Failure Details

[Summary] [Package List] [Test Cases]


suiteXmlForkModeAlways
skipped: Fails - see SUREFIRE-1123
XXXtest50
skipped: 5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
XXXtest501
skipped: 5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
twoSpecifiedTestExecutionsInCorrectExecutionBlocks
skipped: since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
singleTestInOneExecutionOfMultiExecutionProject
skipped: since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
negativeTest[0]
skipped: skipped
simpleNameTestAsParallel[0]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[0]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[0]
skipped: skipped
negativeTest[1]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[2]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[2]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[2]
skipped: skipped
testSuccessTwo[2]
skipped: skipped
shouldNotRunExcludedMethods[2]
skipped: skipped
shouldMatchMultiplePatterns[2]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[2]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[2]
skipped: skipped
testRegexSuccessTwo[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[2]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[2]
skipped: skipped
shouldMatchMultiplePatternsComplex[2]
skipped: skipped
simpleNameTestAsParallel[2]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[2]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[2]
skipped: skipped
regexClassAndMethod[2]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[3]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[3]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[3]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[3]
skipped: skipped
testSuccessTwo[3]
skipped: skipped
shouldNotRunExcludedMethods[3]
skipped: skipped
shouldMatchMultiplePatterns[3]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[3]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[3]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[3]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[3]
skipped: skipped
testRegexSuccessTwo[3]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[3]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[3]
skipped: skipped
shouldMatchMultiplePatternsComplex[3]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[3]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[3]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[3]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[3]
skipped: skipped
regexClassAndMethod[3]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[4]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[4]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[4]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[4]
skipped: skipped
testSuccessTwo[4]
skipped: skipped
shouldNotRunExcludedMethods[4]
skipped: skipped
shouldMatchMultiplePatterns[4]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[4]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[4]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[4]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[4]
skipped: skipped
testRegexSuccessTwo[4]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[4]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[4]
skipped: skipped
shouldMatchMultiplePatternsComplex[4]
skipped: skipped
simpleNameTestAsParallel[4]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[4]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[4]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[4]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[4]
skipped: skipped
regexClassAndMethod[4]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[5]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[5]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[5]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[5]
skipped: skipped
testSuccessTwo[5]
skipped: skipped
shouldNotRunExcludedMethods[5]
skipped: skipped
shouldMatchMultiplePatterns[5]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[5]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[5]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[5]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[5]
skipped: skipped
testRegexSuccessTwo[5]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[5]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[5]
skipped: skipped
shouldMatchMultiplePatternsComplex[5]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[5]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[5]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[5]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[5]
skipped: skipped
regexClassAndMethod[5]
skipped: skipped
negativeTest[0]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[1]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[1]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[1]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[1]
skipped: skipped
testSuccessTwo[1]
skipped: skipped
shouldNotRunExcludedMethods[1]
skipped: skipped
shouldMatchMultiplePatterns[1]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[1]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[1]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[1]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[1]
skipped: skipped
testRegexSuccessTwo[1]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[1]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[1]
skipped: skipped
shouldMatchMultiplePatternsComplex[1]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[1]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[1]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[1]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[1]
skipped: skipped
regexClassAndMethod[1]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[2]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[2]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[2]
skipped: skipped
testSuccessTwo[2]
skipped: skipped
shouldNotRunExcludedMethods[2]
skipped: skipped
shouldMatchMultiplePatterns[2]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[2]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[2]
skipped: skipped
testRegexSuccessTwo[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[2]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[2]
skipped: skipped
shouldMatchMultiplePatternsComplex[2]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[2]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[2]
skipped: skipped
regexClassAndMethod[2]
skipped: skipped