Fork me on GitHub

Surefire Report

Summary

[Summary] [Package List] [Test Cases]


Tests Errors Failures Skipped Success Rate Time
714 0 0 136 80.952% 2,907.645

Note: failures are anticipated and checked for with assertions while errors are unanticipated.


Package List

[Summary] [Package List] [Test Cases]


Package Tests Errors Failures Skipped Success Rate Time
org.apache.maven.surefire.its.jiras 143 0 0 5 96.503% 778.162
org.apache.maven.surefire.its 571 0 0 131 77.058% 2,129.483

Note: package statistics are not computed recursively, they only sum up all of its testsuites numbers.

org.apache.maven.surefire.its.jiras

Class Tests Errors Failures Skipped Success Rate Time
Surefire1024VerifyFailsafeIfTestedIT 1 0 0 0 100% 3.844
Surefire1028UnableToRunSingleIT 1 0 0 0 100% 3.412
Surefire1036NonFilterableJUnitRunnerWithCategoriesIT 1 0 0 0 100% 4.863
Surefire1041FailingJUnitRunnerIT 1 0 0 0 100% 4.296
Surefire1053SystemPropertiesIT 2 0 0 0 100% 8.076
Surefire1055CorrectConcurrentTestCountIT 1 0 0 0 100% 4.395
Surefire1080ParallelForkDoubleTestIT 1 0 0 0 100% 4.357
Surefire1082ParallelJUnitParameterizedIT 1 0 0 0 100% 5.177
Surefire1098BalancedRunOrderIT 1 0 0 0 100% 25.235
Surefire1122ParallelAndFlakyTestsIT 2 0 0 0 100% 8.277
Surefire1135ImproveIgnoreMessageForTestNGIT 2 0 0 0 100% 12.198
Surefire1136CwdPropagationInForkedModeIT 1 0 0 0 100% 4.122
Surefire1144XmlRunTimeIT 1 0 0 0 100% 4.963
Surefire1152RerunFailingTestsInSuiteIT 2 0 0 0 100% 8.199
Surefire1153IncludesAndSpecifiedTestIT 2 0 0 0 100% 6.558
Surefire1158RemoveInfoLinesIT 6 0 0 0 100% 28.534
Surefire1177TestngParallelSuitesIT 1 0 0 0 100% 7.319
Surefire1179IT 1 0 0 0 100% 9.16
Surefire1185DoNotSpawnTestsIT 1 0 0 0 100% 3.608
Surefire1202RerunAndSkipIT 2 0 0 0 100% 33.598
Surefire1209RerunAndForkCountIT 4 0 0 0 100% 48.274
Surefire1211JUnitTestNgIT 2 0 0 0 100% 10.883
Surefire1278GroupNameEndingIT 1 0 0 0 100% 4.696
Surefire1295AttributeJvmCrashesToTestsIT 3 0 0 3 0% 0.002
Surefire141PluggableProvidersIT 4 0 0 0 100% 23.247
Surefire146ForkPerTestNoSetupIT 1 0 0 0 100% 3.996
Surefire162CharsetProviderIT 1 0 0 0 100% 4.082
Surefire224WellFormedXmlFailuresIT 1 0 0 0 100% 4.001
Surefire257NotRerunningTestsIT 1 0 0 0 100% 6.514
Surefire260TestWithIdenticalNamesIT 1 0 0 0 100% 10.356
Surefire34SecurityManagerIT 2 0 0 0 100% 8.777
Surefire376TestNgAfterSuiteFailureIT 1 0 0 0 100% 4.539
Surefire377TestNgAndJUnitTogetherIT 2 0 0 0 100% 8.911
Surefire408ManualProviderSelectionIT 1 0 0 0 100% 4.427
Surefire42NotExtendingTestCaseIT 1 0 0 0 100% 4.324
Surefire44InnerClassTestIT 1 0 0 0 100% 4.004
Surefire500PuzzlingErrorIT 1 0 0 0 100% 4.203
Surefire510TestClassPathForkModesIT 2 0 0 0 100% 8.016
Surefire569RunTestFromDependencyJarsIT 1 0 0 0 100% 3.807
Surefire570MultipleReportDirectoriesIT 2 0 0 0 100% 22.978
Surefire613TestCountInParallelIT 1 0 0 0 100% 4.765
Surefire621TestCountingJunit3InParallelIT 1 0 0 0 100% 5.037
Surefire628ConsoleOutputBeforeAndAfterClassIT 1 0 0 0 100% 5
Surefire634UnsettableSystemPropertiesWarningIT 1 0 0 0 100% 4.488
Surefire649EmptyStringSystemPropertiesIT 2 0 0 0 100% 7.001
Surefire673MockitoIT 1 0 0 0 100% 4.547
Surefire674BuildFailingWhenErrorsIT 1 0 0 0 100% 4.467
Surefire674BuildFailingWhenFailsafeErrorsIT 1 0 0 0 100% 5.644
Surefire685CommaSeparatedIncludesIT 1 0 0 0 100% 4.278
Surefire697NiceSummaryIT 1 0 0 0 100% 5.482
Surefire705ParallelForkTimeoutIT 1 0 0 0 100% 7.325
Surefire733AllOverrridesCapturedIT 1 0 0 0 100% 4.464
Surefire735ForkFailWithRedirectConsoleOutputIT 2 0 0 0 100% 7.862
Surefire740TruncatedCommaIT 1 0 0 0 100% 4.259
Surefire747MethodParallelWithSuiteCountIT 2 0 0 0 100% 19.375
Surefire772BothReportsIT 3 0 0 0 100% 11.193
Surefire772NoFailsafeReportsIT 4 0 0 0 100% 14.568
Surefire772NoSurefireReportsIT 4 0 0 0 100% 15.321
Surefire772SpecifiedReportsIT 3 0 0 0 100% 12.007
Surefire801ForkModeNoneClassLoaderIT 1 0 0 0 100% 4.51
Surefire803MultiFailsafeExecsIT 2 0 0 0 100% 16.144
Surefire806SpecifiedTestControlsIT 3 0 0 2 33.333% 4.275
Surefire809GroupExpressionsIT 6 0 0 0 100% 26.418
Surefire812Log4JClassLoaderIT 1 0 0 0 100% 4.534
Surefire817SystemExitIT 1 0 0 0 100% 5.129
Surefire818NpeIgnoresTestsIT 1 0 0 0 100% 6.114
Surefire828EmptyGroupExprIT 4 0 0 0 100% 19.109
Surefire832ProviderSelectionIT 1 0 0 0 100% 4.414
Surefire839TestWithoutCategoriesIT 2 0 0 0 100% 8.953
Surefire847AdditionalFailureIT 1 0 0 0 100% 4.526
Surefire855AllowFailsafeUseArtifactFileIT 4 0 0 0 100% 44.912
Surefire901MIssingResultfileWhenNoTestsIT 1 0 0 0 100% 3.561
Surefire907PerThreadWithoutThreadCountIT 1 0 0 0 100% 3.193
Surefire920TestFailureIgnoreWithTimeoutIT 2 0 0 0 100% 9.671
Surefire926FailureWith2ProvidersIT 1 0 0 0 100% 6.021
Surefire930TestNgSuiteXmlIT 1 0 0 0 100% 5.385
Surefire943ReportContentIT 2 0 0 0 100% 15.831
Surefire946KillMainProcessInReusableForkIT 3 0 0 0 100% 21.631
Surefire972BizarreNoClassDefIT 1 0 0 0 100% 7.315
Surefire975DefaultVMEncodingIT 1 0 0 0 100% 4.164
Surefire979WrongClassLoaderIT 1 0 0 0 100% 4.211
Surefire985ParameterizedRunnerAndCategoriesIT 1 0 0 0 100% 3.576
Surefire995CategoryInheritanceIT 5 0 0 0 100% 17.254

org.apache.maven.surefire.its

Class Tests Errors Failures Skipped Success Rate Time
AbstractTestCaseIT 1 0 0 0 100% 5.5
AdditionalClasspathIT 1 0 0 0 100% 3.582
AggregateReportIT 1 0 0 0 100% 7.834
ArgLineIT 1 0 0 0 100% 4.096
ArgLinePropertiesIT 1 0 0 0 100% 5.583
AssumptionFailureReportIT 1 0 0 0 100% 4.192
CheckSingleTestIT 4 0 0 0 100% 14.283
CheckTestFailIfNoTestsForkModeIT 6 0 0 0 100% 19.636
CheckTestFailIfNoTestsIT 3 0 0 0 100% 7.553
CheckTestNgBeforeMethodFailureIT 1 0 0 0 100% 4.296
CheckTestNgBeforeMethodIT 1 0 0 0 100% 4.462
CheckTestNgCustomObjectFactoryIT 1 0 0 0 100% 3.742
CheckTestNgCustomTestRunnerFactoryIT 1 0 0 0 100% 3.805
CheckTestNgExecuteErrorIT 1 0 0 0 100% 4.507
CheckTestNgGroupThreadParallelIT 1 0 0 0 100% 3.755
CheckTestNgJdk14IT 1 0 0 0 100% 4.619
CheckTestNgListenerReporterIT 8 0 0 0 100% 37.554
CheckTestNgListenersIT 1 0 0 0 100% 4.415
CheckTestNgPathWithSpacesIT 1 0 0 0 100% 4.224
CheckTestNgReportTestIT 3 0 0 0 100% 13.993
CheckTestNgSuiteXmlIT 3 0 0 1 66.667% 8.853
CheckTestNgSuiteXmlSingleIT 1 0 0 0 100% 4.684
CheckTestNgVersionsIT 20 0 0 2 90% 82.825
ClasspathFilteringIT 1 0 0 0 100% 3.591
ClassPathOrderIT 1 0 0 0 100% 5.318
ClasspathScopeFilteringIT 1 0 0 0 100% 3.502
ConsoleOutputIT 4 0 0 0 100% 31.113
CrashDetectionIT 3 0 0 0 100% 12.848
DefaultConfigurationIT 1 0 0 0 100% 3.416
EnvironmentVariableIT 1 0 0 0 100% 4.43
EnvironmentVariablesIT 2 0 0 0 100% 8.64
FailFastJUnitIT 12 0 0 0 100% 126.445
FailFastTestNgIT 6 0 0 0 100% 64.333
ForkConsoleOutputIT 4 0 0 0 100% 16.665
ForkConsoleOutputWithErrorsIT 1 0 0 0 100% 4.371
ForkModeIT 12 0 0 0 100% 62.874
ForkModeMultiModuleIT 4 0 0 0 100% 28.782
ForkModeTestNGIT 12 0 0 0 100% 69.715
IncludesExcludesFromFileIT 6 0 0 0 100% 22.452
IncludesExcludesIT 3 0 0 0 100% 12.357
JUnit44HamcrestIT 1 0 0 0 100% 4.115
JUnit47ConcurrencyIT 1 0 0 0 100% 4.441
JUnit47ParallelIT 59 0 0 0 100% 320.726
JUnit47ParallelNotThreadSafeIT 1 0 0 0 100% 4.261
JUnit47RedirectOutputIT 2 0 0 0 100% 8.687
JUnit47StaticInnerClassTestsIT 1 0 0 0 100% 3.515
JUnit47WithCucumberIT 2 0 0 0 100% 10.033
JUnit48TestCategoriesIT 4 0 0 0 100% 20.68
JUnit4ForkAlwaysStaticInitPollutionIT 1 0 0 0 100% 5.348
JUnit4IgnoreIT 2 0 0 0 100% 10.389
JUnit4RerunFailingTestsIT 5 0 0 0 100% 92.987
JUnit4RunListenerIT 2 0 0 0 100% 8.937
JUnit4VersionsIT 16 0 0 0 100% 74.518
JUnitDepIT 4 0 0 0 100% 17.731
NoRunnableTestsInClassIT 1 0 0 0 100% 4.468
PlainOldJavaClasspathIT 1 0 0 0 100% 4.37
PlexusConflictIT 2 0 0 0 100% 8.855
PojoSimpleIT 1 0 0 0 100% 4.372
ReportersIT 1 0 0 0 100% 4.462
ResultCountingIT 3 0 0 0 100% 14.391
RunOrderIT 4 0 0 0 100% 15.231
RunOrderParallelForksIT 4 0 0 0 100% 15.583
SiblingAggregatorIT 1 0 0 0 100% 4.072
SmartStackTraceIT 1 0 0 0 100% 4.037
SystemPropertiesTestIT 2 0 0 0 100% 8.003
TestMethodPatternIT 7 0 0 0 100% 31.929
TestMultipleMethodPatternsIT 180 0 0 87 51.667% 336.319
TestMultipleMethodPatternsTestNGIT 90 0 0 41 54.444% 178.835
TestMultipleMethodsIT 3 0 0 0 100% 11.789
TestNgGroupsIT 5 0 0 0 100% 24.201
TestNgParallelWithAnnotationsIT 1 0 0 0 100% 5.558
TestNgSuccessPercentageIT 1 0 0 0 100% 3.808
TestSingleMethodIT 9 0 0 0 100% 39.578
TimeoutForkedTestIT 1 0 0 0 100% 4.827
TwoTestCasesIT 4 0 0 0 100% 16.457
UmlautDirIT 2 0 0 0 100% 8.27
UnicodeTestNamesIT 1 0 0 0 100% 4.117
UseIsolatedClassLoaderIT 1 0 0 0 100% 4.728
WorkingDirectoryIsInvalidPropertyIT 1 0 0 0 100% 3.294
WorkingDirectoryIT 4 0 0 0 100% 16.468
WorkingDirectoryMissingIT 1 0 0 0 100% 4.286
XmlReporterRunTimeIT 1 0 0 0 100% 21.962

Test Cases

[Summary] [Package List] [Test Cases]

AbstractTestCaseIT

abstractTestCase 5.5

AdditionalClasspathIT

additionalClasspath 3.582

AggregateReportIT

aggregateReport 7.834

ArgLineIT

argLine 4.096

ArgLinePropertiesIT

argLine 5.583

AssumptionFailureReportIT

testWriteSkippedMessageToReport 4.192

CheckSingleTestIT

singleTestDotJava 4.097
singleTestNonExistentOverride 3.407
singleTestNonExistent 3.228
singleTest 3.551

CheckTestFailIfNoTestsForkModeIT

dontFailIfNoTestsForkModeAlways 3.346
failIfNoTestsForkModeOnce 3.423
dontFailIfNoTestsForkModeNever 3.345
dontFailIfNoTestsForkModeOnce 3.149
failIfNoTestsForkModeNever 3.216
failIfNoTestsForkModeAlways 3.157

CheckTestFailIfNoTestsIT

failIfNoTests 2.519
dontFailIfNoTests 2.459
jUnit48CategoriesFailWhenNoTests 2.575

CheckTestNgBeforeMethodFailureIT

TestNgBeforeMethodFailure 4.296

CheckTestNgBeforeMethodIT

TestNgBeforeMethod 4.462

CheckTestNgCustomObjectFactoryIT

testTestNgListenerReporter 3.742

CheckTestNgCustomTestRunnerFactoryIT

testTestNgListenerReporter 3.805

CheckTestNgExecuteErrorIT

executionError 4.507

CheckTestNgGroupThreadParallelIT

TestNgGroupThreadParallel 3.755

CheckTestNgJdk14IT

TestNgJdk14 4.619

CheckTestNgListenerReporterIT

testNgListenerReporter[0: TestNG 5.6] 4.714
testNgListenerReporter[1: TestNG 5.7] 4.436
testNgListenerReporter[2: TestNG 5.10] 4.202
testNgListenerReporter[3: TestNG 5.13] 4.495
testNgListenerReporter[4: TestNG 5.14.6] 5.124
testNgListenerReporter[5: TestNG 5.14.9] 4.333
testNgListenerReporter[6: TestNG 6.0] 4.351
testNgListenerReporter[7: TestNG 6.9.9] 5.899

CheckTestNgListenersIT

TestNgListenerReporter 4.415

CheckTestNgPathWithSpacesIT

TestWithSpaces 4.224

CheckTestNgReportTestIT

testNgReport 5.496
shouldNotBeVerbose 4.32
shouldBeVerbose 4.177

CheckTestNgSuiteXmlIT

suiteXml 4.335
suiteXmlForkCountTwoReuse 4.518
suiteXmlForkModeAlways 0
Fails - see SUREFIRE-1123

CheckTestNgSuiteXmlSingleIT

TestNgSuite 4.684

CheckTestNgVersionsIT

XXXtest50 0
5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
test502 4.537
test510 4.645
test511 5.559
test512 5.69
test513 4.774
test514 4.584
test685 5.405
test5131 4.517
test5141 4.524
test5142 4.536
test47 4.217
test51 4.22
test55 4.309
test56 4.182
test57 4.322
test58 4.203
test59 4.246
test60 4.355
XXXtest501 0
5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024

ClasspathFilteringIT

additionalClasspath 3.591

ClassPathOrderIT

classPathOrder 5.318

ClasspathScopeFilteringIT

additionalClasspath 3.502

ConsoleOutputIT

properNewlinesAndEncodingWithDifferentEncoding 4.428
properNewlinesAndEncodingWithDefaultEncodings 4.36
largerSoutThanMemory 19.029
properNewlinesAndEncodingWithoutFork 3.296

CrashDetectionIT

hardCrashInReusableFork 4.296
crashInReusableFork 4.364
crashInFork 4.188

DefaultConfigurationIT

defaultConfiguration 3.416

EnvironmentVariableIT

environmentVariable 4.43

EnvironmentVariablesIT

testWhenUseSystemClassLoader 4.26
testWhenDontUseSystemClassLoader 4.38

FailFastJUnitIT

test[junit4-oneFork-ff1] 6.455
test[junit47-oneFork-ff1] 5.859
test[junit4-oneFork-ff2] 10.349
test[junit47-oneFork-ff2] 9.808
test[junit4-twoForks-ff1] 8.27
test[junit47-twoForks-ff1] 8.47
test[junit4-twoForks-ff2] 9.561
test[junit47-twoForks-ff2] 9.699
test[junit4-oneFork-ff3] 16.848
test[junit47-oneFork-ff3] 17.071
test[junit4-twoForks-ff3] 11.763
test[junit47-twoForks-ff3] 12.292

FailFastTestNgIT

test[testng-oneFork-ff1] 6.538
test[testng-oneFork-ff2] 10.047
test[testng-twoForks-ff1] 8.479
test[testng-twoForks-ff2] 9.779
test[testng-oneFork-ff3] 17.31
test[testng-twoForks-ff3] 12.18

ForkConsoleOutputIT

printSummaryTrueWithRedirect 4.059
printSummaryFalseWithoutRedirect 4.05
printSummaryTrueWithoutRedirect 4.169
printSummaryFalseWithRedirect 4.387

ForkConsoleOutputWithErrorsIT

xmlFileContainsConsoleOutput 4.371

ForkModeIT

testForkModeOncePerThreadSingleThread 5.742
testForkModePerTest 6.179
testForkCountZero 4.355
testForkCountOneNoReuse 5.993
testForkCountTwoNoReuse 5.495
testForkModeNever 4.157
testForkCountTwoReuse 5.474
testForkCountOneReuse 4.915
testForkModeOncePerThreadTwoThreads 5.408
testForkModeAlways 5.985
testForkModeNone 4.174
testForkModeOnce 4.997

ForkModeMultiModuleIT

testForkCountOneNoReuse 8.668
testForkCountTwoNoReuse 6.716
testForkCountTwoReuse 6.085
testForkCountOneReuse 7.313

ForkModeTestNGIT

testForkModeOncePerThreadSingleThread 5.144
testForkModePerTest 6.802
testForkCountZero 5.188
testForkCountOneNoReuse 7.185
testForkCountTwoNoReuse 5.726
testForkModeNever 4.568
testForkCountTwoReuse 6.062
testForkCountOneReuse 5.745
testForkModeOncePerThreadTwoThreads 6.133
testForkModeAlways 7.226
testForkModeNone 4.647
testForkModeOnce 5.289

IncludesExcludesFromFileIT

testSimpleMixed 4.146
testMissingExcludes 3.11
testRegex 4.027
testPath 4.081
testMissingIncludes 3.034
testSimple 4.054

IncludesExcludesIT

testPathBasedIncludesExcludes 4.236
testIncludesExcludes 4.099
testRegexIncludesExcludes 4.022

Surefire1024VerifyFailsafeIfTestedIT

shouldScanAndRunTestsInDependencyJars 3.844

Surefire1028UnableToRunSingleIT

methodFilteringParallelExecution 3.412

Surefire1036NonFilterableJUnitRunnerWithCategoriesIT

test 4.863

Surefire1041FailingJUnitRunnerIT

reportErrorInJUnitRunnerAsTestError 4.296

Surefire1053SystemPropertiesIT

checkWarningsSysPropTwice 4.071
checkWarningsFileEncoding 4.005

Surefire1055CorrectConcurrentTestCountIT

testTestNgAndJUnitTogether 4.395

Surefire1080ParallelForkDoubleTestIT

test 4.357

Surefire1082ParallelJUnitParameterizedIT

test 5.177

Surefire1098BalancedRunOrderIT

reorderedParallelClasses 25.235

Surefire1122ParallelAndFlakyTestsIT

nonParallelCreatesCorrectReport 4.588
parallelCreatesCorrectReport 3.689

Surefire1135ImproveIgnoreMessageForTestNGIT

testNgReport57 5.974
testNgReport688 6.224

Surefire1136CwdPropagationInForkedModeIT

testTestNgAndJUnitTogether 4.122

Surefire1144XmlRunTimeIT

testXmlRunTime 4.963

Surefire1152RerunFailingTestsInSuiteIT

testJUnit48Provider47 4.192
testJUnit48Provider4 4.007

Surefire1153IncludesAndSpecifiedTestIT

testSpecifiedTestInIncludes 3.325
testSpecifiedTestNotInIncludes 3.233

Surefire1158RemoveInfoLinesIT

shouldRunWithCliOption[junit-option-ff] 4.87
shouldRunWithCliOption[testng-option-ff] 5.3
shouldRunWithCliOption[junit-option-X] 4.719
shouldRunWithCliOption[testng-option-X] 4.479
shouldRunWithCliOption[junit-option-e] 4.577
shouldRunWithCliOption[testng-option-e] 4.589

Surefire1177TestngParallelSuitesIT

shouldRunTwoSuitesInParallel 7.319

Surefire1179IT

suiteXmlForkCountTwoReuse 9.16

Surefire1185DoNotSpawnTestsIT

doNotSpawnUnwantedTests 3.608

Surefire1202RerunAndSkipIT

junit47 16.898
junit4 16.7

Surefire1209RerunAndForkCountIT

notReusableForksJUnit47 12.256
reusableForksJUnit47 12.188
reusableForksJUnit4 11.444
notReusableForksJUnit4 12.386

Surefire1211JUnitTestNgIT

withoutJUnit 5.909
withJUnit 4.974

Surefire1278GroupNameEndingIT

testOnlyGroups 4.696

Surefire1295AttributeJvmCrashesToTestsIT

crashInSingleUseFork 0.002
skipped
crashInReusableFork 0
skipped
crashInFork 0
skipped

Surefire141PluggableProvidersIT

pluggableProviderPresent 5.818
invokeRuntimeException 5.214
invokeReporterException 6.114
constructorRuntimeException 6.101

Surefire146ForkPerTestNoSetupIT

testForkPerTestNoSetup 3.996

Surefire162CharsetProviderIT

testCharsetProvider 4.082

Surefire224WellFormedXmlFailuresIT

testWellFormedXmlFailures 4.001

Surefire257NotRerunningTestsIT

shouldNotRerun 6.514

Surefire260TestWithIdenticalNamesIT

testWithIdenticalNames 10.356

Surefire34SecurityManagerIT

testSecurityManager 4.49
testSecurityManagerSuccessful 4.287

Surefire376TestNgAfterSuiteFailureIT

testAfterSuiteFailure 4.539

Surefire377TestNgAndJUnitTogetherIT

testTestNgAndJUnit4Together 4.219
testTestNgAndJUnitTogether 4.692

Surefire408ManualProviderSelectionIT

testParallelBuildResultCount 4.427

Surefire42NotExtendingTestCaseIT

testInnerClass 4.324

Surefire44InnerClassTestIT

testInnerClass 4.004

Surefire500PuzzlingErrorIT

testBuildFailingWhenErrors 4.203

Surefire510TestClassPathForkModesIT

testForkOnce 4.001
testForkAlways 4.015

Surefire569RunTestFromDependencyJarsIT

shouldScanAndRunTestsInDependencyJars 3.807

Surefire570MultipleReportDirectoriesIT

testReportWithAggregate 11.684
testReportWithoutAggregate 11.294

Surefire613TestCountInParallelIT

testParallelBuildResultCount 4.765

Surefire621TestCountingJunit3InParallelIT

testJunit3ParallelBuildResultCount 5.037

Surefire628ConsoleOutputBeforeAndAfterClassIT

testJunit3ParallelBuildResultCount 5

Surefire634UnsettableSystemPropertiesWarningIT

testJunit3ParallelBuildResultCount 4.488

Surefire649EmptyStringSystemPropertiesIT

systemPropertyVariables 3.513
systemProperties 3.488

Surefire673MockitoIT

testBuildFailingWhenErrors 4.547

Surefire674BuildFailingWhenErrorsIT

testBuildFailingWhenErrors 4.467

Surefire674BuildFailingWhenFailsafeErrorsIT

testBuildFailingWhenErrors 5.644

Surefire685CommaSeparatedIncludesIT

testBuildFailingWhenErrors 4.278

Surefire697NiceSummaryIT

testBuildFailingWhenErrors 5.482

Surefire705ParallelForkTimeoutIT

testTimeoutForked 7.325

Surefire733AllOverrridesCapturedIT

testLogOutput 4.464

Surefire735ForkFailWithRedirectConsoleOutputIT

vmStartFail 3.98
vmStartFailShouldFailBuildk 3.882

Surefire740TruncatedCommaIT

testRussianLocaleReport 4.259

Surefire747MethodParallelWithSuiteCountIT

testMethodsParallelWithSuite 8.686
testClassesParallelWithSuite 10.689

Surefire772BothReportsIT

testSkippedSurefireReportGeneration 3.711
testSkippedFailsafeReportGeneration 3.629
testReportGeneration 3.853

Surefire772NoFailsafeReportsIT

testSkippedFailsafeReportGeneration 3.852
testForcedFailsafeReportGeneration 3.859
testSkipForcedFailsafeReportGeneration 3.476
testReportGeneration 3.381

Surefire772NoSurefireReportsIT

testOptionalSurefireReportGeneration 3.661
testSkippedSurefireReportGeneration 3.875
testSkipOptionalSurefireReportGeneration 3.688
testReportGeneration 4.097

Surefire772SpecifiedReportsIT

testSkippedSurefireReportGeneration 3.802
testSkippedFailsafeReportGeneration 3.665
testReportGeneration 4.54

Surefire801ForkModeNoneClassLoaderIT

testSHouldBeOkWithForkNever 4.51

Surefire803MultiFailsafeExecsIT

testOneExecutionRunInTwoBuilds 10.333
testSecondExecutionRunsAfterFirstExecutionFails 5.811

Surefire806SpecifiedTestControlsIT

singleTestInSingleExecutionProject 4.275
twoSpecifiedTestExecutionsInCorrectExecutionBlocks 0
since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
singleTestInOneExecutionOfMultiExecutionProject 0
since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution

Surefire809GroupExpressionsIT

testNGRunCategoryAB 4.722
testExcludedGroups 4.751
testJUnitRunCategoryNotC 4.672
incorrectJUnitVersions 3.117
categoryAB 4.621
testNGRunCategoryNotC 4.535

Surefire812Log4JClassLoaderIT

testJunit3ParallelBuildResultCount 4.534

Surefire817SystemExitIT

systemExit1 5.129

Surefire818NpeIgnoresTestsIT

testBuildFailingWhenErrors 6.114

Surefire828EmptyGroupExprIT

testJUnitRunEmptyExcludeGroups 5.179
testJUnitRunEmptyGroups 4.873
testTestNGRunEmptyExcludeGroups 4.654
testTestNGRunEmptyGroups 4.403

Surefire832ProviderSelectionIT

testJUnitRunCategoryAB 4.414

Surefire839TestWithoutCategoriesIT

classWithoutCategoryForked 4.543
classWithoutCategory 4.41

Surefire847AdditionalFailureIT

testJUnitRunCategoryAB 4.526

Surefire855AllowFailsafeUseArtifactFileIT

jarNotForkingShouldUseFile 12.573
jarShouldUseFile 7.588
warShouldUseClasses 9.892
osgiBundleShouldUseFile 14.859

Surefire901MIssingResultfileWhenNoTestsIT

failsafeWithNoTests 3.561

Surefire907PerThreadWithoutThreadCountIT

categoryAB 3.193

Surefire920TestFailureIgnoreWithTimeoutIT

timeoutInForkWithBuildFail 4.868
timeoutInForkWithNoBuildFail 4.803

Surefire926FailureWith2ProvidersIT

testBuildFailingWhenErrors 6.021

Surefire930TestNgSuiteXmlIT

suiteXmlRun 5.385

Surefire943ReportContentIT

test_noParallel 10.39
test_parallelBoth 5.441

Surefire946KillMainProcessInReusableForkIT

testExit 7.247
testHalt 7.163
testInterrupt 7.221

Surefire972BizarreNoClassDefIT

testJunit3ParallelBuildResultCount 7.315

Surefire975DefaultVMEncodingIT

runWithRussian1251 4.164

Surefire979WrongClassLoaderIT

wrongClassloaderUSedInSmartStacktraceparser 4.211

Surefire985ParameterizedRunnerAndCategoriesIT

test 3.576

Surefire995CategoryInheritanceIT

junit411ShouldRunExplicitCategory 3.516
junit411ShouldExcludeExplicitCategory 3.461
junit412ShouldExcludeInheritedCategory 3.494
junit412ShouldRunInheritedCategory 3.434
negativeTestShouldRunAllCategories 3.349

JUnit44HamcrestIT

testJUnit44Hamcrest 4.115

JUnit47ConcurrencyIT

test47 4.441

JUnit47ParallelIT

unknownThreadCountClasses 3.176
threadCountSuites 7.443
unlimitedThreadsSuitesAndMethods1 5.263
unlimitedThreadsSuitesAndMethods2 5.441
unknownThreadCountMethods 3.472
threadCountClassesAndMethods 5.324
reusableThreadCountClassesAndMethodsOptimized 6.017
unknownThreadCountSuites 3.54
reusableThreadCountAll 4.788
forcedShutdown 6.026
unknownThreadCountAll 3.24
serial 10.643
reusableThreadCountAllOptimized 4.74
suites 7.349
unlimitedThreadsMethods1 6.227
unlimitedThreadsMethods2 6.173
unlimitedThreadsSuitesAndClasses1 4.725
unlimitedThreadsSuitesAndClasses2 4.69
threadCountAllOptimized 5.223
threadCountAll 5.423
everyThreadCountSuitesAndClasses 5.147
unknownThreadCountBoth 3.465
threadCountSuitesAndClassesOptimized 5.078
classesAndMethods 4.78
everyThreadCountSuitesAndMethods 5.393
unknownThreadCountSuitesAndClasses 3.235
reusableThreadCountSuitesAndClassesOptimized 5.731
unknownThreadCountSuitesAndMethods 3.174
suitesAndClasses 4.757
suitesAndMethods 4.994
shutdown 8.516
threadCountClassesAndMethodsOneCore 8.733
everyThreadCountClassesAndMethods 5.077
all 4.119
unknownThreadCountClassesAndMethods 3.119
threadCountSuitesAndMethodsOptimized 5.003
reusableThreadCountSuitesAndMethodsOptimized 5.795
unlimitedThreadsClasses1 6.054
unlimitedThreadsClasses2 6.016
threadCountClasses 5.941
everyThreadCountAll 5.637
threadCountMethods 7.329
unlimitedThreadsSuites1 7.397
unlimitedThreadsSuites2 7.413
threadCountSuitesAndClasses 4.722
unlimitedThreadsClassesAndMethods1 4.411
unlimitedThreadsClassesAndMethods2 4.373
threadCountSuitesAndMethods 5.032
classes 5.577
reusableThreadCountSuitesAndClasses 5.642
methods 6.178
reusableThreadCountSuitesAndMethods 5.753
timeoutAndForcedShutdown 6.085
threadCountClassesAndMethodsOptimized 5.009
unlimitedThreadsAll1 4.113
unlimitedThreadsAll2 4.151
forcedShutdownVerifyingLogs 4.6
threadCountClassesAndMethodsOneCoreOptimized 8.679
reusableThreadCountClassesAndMethods 5.575

JUnit47ParallelNotThreadSafeIT

test 4.261

JUnit47RedirectOutputIT

testClassesParallel 4.401
testPrintSummaryTrueWithRedirect 4.286

JUnit47StaticInnerClassTestsIT

testStaticInnerClassTests 3.515

JUnit47WithCucumberIT

testWithParallelClasses 5.79
testWithoutParallel 4.243

JUnit48TestCategoriesIT

testCategoriesABForkAlways 4.866
testCategoriesAB 4.755
testCategoriesAC 4.926
testCategoriesACForkAlways 6.133

JUnit4ForkAlwaysStaticInitPollutionIT

testJunit4Ignore 5.348

JUnit4IgnoreIT

testJunit4Ignore 5.022
testJunit47ParallelIgnore 5.367

JUnit4RerunFailingTestsIT

testRerunFailingErrorTestsFalse 18.132
testRerunFailingErrorTestsWithOneRetry 19.025
testRerunFailingErrorTestsTwoRetry 19.993
testRerunOneTestMethod 17.721
testRerunOneTestClass 18.116

JUnit4RunListenerIT

testJUnit4RunListener 4.611
testRunlistenerJunitCoreProvider 4.326

JUnit4VersionsIT

testJunit[0: JUnit 4.0] 4.349
testJunit[1: JUnit 4.1] 4.799
testJunit[2: JUnit 4.2] 4.87
testJunit[3: JUnit 4.3] 5.372
testJunit[4: JUnit 4.3.1] 5.077
testJunit[5: JUnit 4.4] 4.36
testJunit[6: JUnit 4.5] 4.382
testJunit[7: JUnit 4.6] 5.044
testJunit[8: JUnit 4.7] 4.368
testJunit[9: JUnit 4.8] 4.991
testJunit[10: JUnit 4.8.1] 4.576
testJunit[11: JUnit 4.8.2] 5.013
testJunit[12: JUnit 4.9] 5.124
testJunit[13: JUnit 4.10] 4.101
testJunit[14: JUnit 4.11] 4.038
testJunit[15: JUnit 4.12] 4.054

JUnitDepIT

testJUnit44DepWithSneaky381 4.396
testJUnit44Dep 4.194
testJUnit47Dep 4.427
testJUnit48Dep 4.714

NoRunnableTestsInClassIT

testJunit3ParallelBuildResultCount 4.468

PlainOldJavaClasspathIT

testPlainOldJavaClasspath 4.37

PlexusConflictIT

testPlexusConflict 4.397
testPlexusConflictIsolatedClassLoader 4.458

PojoSimpleIT

testit 4.372

ReportersIT

testRedirectOutputTestNg 4.462

ResultCountingIT

testCountingWithJunit481ForkAlways 6.577
testCountingWithJunit481ForkOnce 4.299
testCountingWithJunit481ForkNever 3.515

RunOrderIT

testReverseAlphabetical 4.067
testNonExistingRunOrder 3.038
testHourly 4.103
testAlphabetical 4.023

RunOrderParallelForksIT

testReverseAlphabetical 4.227
testNonExistingRunOrder 3.115
testHourly 4.152
testAlphabetical 4.089

SiblingAggregatorIT

testSiblingAggregator 4.072

SmartStackTraceIT

misg 4.037

SystemPropertiesTestIT

testSystemProperties 4.458
testSystemPropertiesNoFork 3.545

TestMethodPatternIT

testJUnit48WithCategoryFilter 4.687
testJUnit48Provider47 4.635
testMethodPatternAfter 4.399
testTestNGMethodPattern 4.462
testJUnit48Provider4 4.49
testJUnit44 4.492
testTestNgMethodBefore 4.764

TestMultipleMethodPatternsIT

shouldNotRunExcludedClassesAndMethods[0] 4.247
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[0] 3.955
shouldMatchExactClassAndMethodCharacters[0] 3.299
shouldMatchExactClassAndMethodWildcard[0] 3.339
testSuccessTwo[0] 3.412
simpleNameTest[0] 3.295
simpleNameTestWithJavaExt[0] 3.286
regexClass[0] 3.343
shouldNotRunExcludedClasses[0] 3.354
shouldNotRunExcludedMethods[0] 3.444
simpleNameTestWithJavaExtWildcardPkg[0] 3.265
shouldMatchMultiplePatterns[0] 3.396
shouldMatchExactClassAndMethodsPostfix[0] 3.368
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[0] 3.293
simpleNameTestWithWildcardPkg[0] 3.243
shouldMatchWildcardPackageAndClassAndMethod[0] 3.296
shouldMatchExactClassAndMultipleMethods[0] 3.424
fullyQualifiedTest[0] 3.629
negativeTest[0] 0.001
skipped
testRegexSuccessTwo[0] 3.702
shouldMatchSimpleClassNameAndMethodWithJavaExt[0] 3.649
shouldMatchExactClassAndMethodsWildcard[0] 3.573
shouldMatchMultiplePatternsComplex[0] 3.753
simpleNameTestAsParallel[0] 0
skipped
shouldMatchMultiplePatternsAsParallel[0] 0
skipped
shouldNotRunExcludedClassesIfIncluded[0] 3.619
shouldMatchSimpleClassNameAndMethod[0] 3.641
shouldMatchExactClassAndMethodPostfix[0] 3.73
shouldMatchMultiplePatternsComplexAsParallel[0] 0
skipped
regexClassAndMethod[0] 3.348
shouldNotRunExcludedClassesAndMethods[1] 3.793
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[1] 3.524
shouldMatchExactClassAndMethodCharacters[1] 3.531
shouldMatchExactClassAndMethodWildcard[1] 3.55
testSuccessTwo[1] 3.584
simpleNameTest[1] 3.558
simpleNameTestWithJavaExt[1] 3.465
regexClass[1] 3.503
shouldNotRunExcludedClasses[1] 3.615
shouldNotRunExcludedMethods[1] 3.679
simpleNameTestWithJavaExtWildcardPkg[1] 3.511
shouldMatchMultiplePatterns[1] 3.734
shouldMatchExactClassAndMethodsPostfix[1] 3.449
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[1] 3.53
simpleNameTestWithWildcardPkg[1] 3.42
shouldMatchWildcardPackageAndClassAndMethod[1] 3.649
shouldMatchExactClassAndMultipleMethods[1] 3.872
fullyQualifiedTest[1] 4.053
negativeTest[1] 0
skipped
testRegexSuccessTwo[1] 4.655
shouldMatchSimpleClassNameAndMethodWithJavaExt[1] 4.613
shouldMatchExactClassAndMethodsWildcard[1] 4.454
shouldMatchMultiplePatternsComplex[1] 4.053
simpleNameTestAsParallel[1] 3.852
shouldMatchMultiplePatternsAsParallel[1] 3.829
shouldNotRunExcludedClassesIfIncluded[1] 3.529
shouldMatchSimpleClassNameAndMethod[1] 3.529
shouldMatchExactClassAndMethodPostfix[1] 3.47
shouldMatchMultiplePatternsComplexAsParallel[1] 3.995
regexClassAndMethod[1] 3.816
shouldNotRunExcludedClassesAndMethods[2] 0
skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[2] 0
skipped
shouldMatchExactClassAndMethodCharacters[2] 0
skipped
shouldMatchExactClassAndMethodWildcard[2] 0
skipped
testSuccessTwo[2] 0
skipped
simpleNameTest[2] 3.624
simpleNameTestWithJavaExt[2] 3.567
regexClass[2] 3.583
shouldNotRunExcludedClasses[2] 3.676
shouldNotRunExcludedMethods[2] 0
skipped
simpleNameTestWithJavaExtWildcardPkg[2] 3.652
shouldMatchMultiplePatterns[2] 0
skipped
shouldMatchExactClassAndMethodsPostfix[2] 0
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[2] 0
skipped
simpleNameTestWithWildcardPkg[2] 3.573
shouldMatchWildcardPackageAndClassAndMethod[2] 0
skipped
shouldMatchExactClassAndMultipleMethods[2] 0
skipped
fullyQualifiedTest[2] 3.879
negativeTest[2] 3.543
testRegexSuccessTwo[2] 0
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[2] 0
skipped
shouldMatchExactClassAndMethodsWildcard[2] 0
skipped
shouldMatchMultiplePatternsComplex[2] 0
skipped
simpleNameTestAsParallel[2] 0
skipped
shouldMatchMultiplePatternsAsParallel[2] 0
skipped
shouldNotRunExcludedClassesIfIncluded[2] 3.359
shouldMatchSimpleClassNameAndMethod[2] 0
skipped
shouldMatchExactClassAndMethodPostfix[2] 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[2] 0
skipped
regexClassAndMethod[2] 0
skipped
shouldNotRunExcludedClassesAndMethods[3] 0
skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[3] 0.001
skipped
shouldMatchExactClassAndMethodCharacters[3] 0
skipped
shouldMatchExactClassAndMethodWildcard[3] 0
skipped
testSuccessTwo[3] 0
skipped
simpleNameTest[3] 3.582
simpleNameTestWithJavaExt[3] 3.528
regexClass[3] 3.527
shouldNotRunExcludedClasses[3] 3.592
shouldNotRunExcludedMethods[3] 0
skipped
simpleNameTestWithJavaExtWildcardPkg[3] 3.44
shouldMatchMultiplePatterns[3] 0.001
skipped
shouldMatchExactClassAndMethodsPostfix[3] 0
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[3] 0
skipped
simpleNameTestWithWildcardPkg[3] 3.535
shouldMatchWildcardPackageAndClassAndMethod[3] 0
skipped
shouldMatchExactClassAndMultipleMethods[3] 0
skipped
fullyQualifiedTest[3] 3.491
negativeTest[3] 3.217
testRegexSuccessTwo[3] 0
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[3] 0
skipped
shouldMatchExactClassAndMethodsWildcard[3] 0
skipped
shouldMatchMultiplePatternsComplex[3] 0
skipped
simpleNameTestAsParallel[3] 3.468
shouldMatchMultiplePatternsAsParallel[3] 0
skipped
shouldNotRunExcludedClassesIfIncluded[3] 3.508
shouldMatchSimpleClassNameAndMethod[3] 0
skipped
shouldMatchExactClassAndMethodPostfix[3] 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[3] 0
skipped
regexClassAndMethod[3] 0
skipped
shouldNotRunExcludedClassesAndMethods[4] 0
skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[4] 0
skipped
shouldMatchExactClassAndMethodCharacters[4] 0
skipped
shouldMatchExactClassAndMethodWildcard[4] 0
skipped
testSuccessTwo[4] 0
skipped
simpleNameTest[4] 3.302
simpleNameTestWithJavaExt[4] 3.358
regexClass[4] 3.293
shouldNotRunExcludedClasses[4] 3.33
shouldNotRunExcludedMethods[4] 0
skipped
simpleNameTestWithJavaExtWildcardPkg[4] 3.267
shouldMatchMultiplePatterns[4] 0
skipped
shouldMatchExactClassAndMethodsPostfix[4] 0
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[4] 0
skipped
simpleNameTestWithWildcardPkg[4] 3.398
shouldMatchWildcardPackageAndClassAndMethod[4] 0
skipped
shouldMatchExactClassAndMultipleMethods[4] 0
skipped
fullyQualifiedTest[4] 3.301
negativeTest[4] 3.131
testRegexSuccessTwo[4] 0
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[4] 0
skipped
shouldMatchExactClassAndMethodsWildcard[4] 0
skipped
shouldMatchMultiplePatternsComplex[4] 0
skipped
simpleNameTestAsParallel[4] 0
skipped
shouldMatchMultiplePatternsAsParallel[4] 0
skipped
shouldNotRunExcludedClassesIfIncluded[4] 3.38
shouldMatchSimpleClassNameAndMethod[4] 0
skipped
shouldMatchExactClassAndMethodPostfix[4] 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[4] 0
skipped
regexClassAndMethod[4] 0
skipped
shouldNotRunExcludedClassesAndMethods[5] 0
skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[5] 0
skipped
shouldMatchExactClassAndMethodCharacters[5] 0
skipped
shouldMatchExactClassAndMethodWildcard[5] 0
skipped
testSuccessTwo[5] 0
skipped
simpleNameTest[5] 3.83
simpleNameTestWithJavaExt[5] 3.772
regexClass[5] 3.809
shouldNotRunExcludedClasses[5] 3.88
shouldNotRunExcludedMethods[5] 0
skipped
simpleNameTestWithJavaExtWildcardPkg[5] 3.746
shouldMatchMultiplePatterns[5] 0
skipped
shouldMatchExactClassAndMethodsPostfix[5] 0
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[5] 0.001
skipped
simpleNameTestWithWildcardPkg[5] 4.69
shouldMatchWildcardPackageAndClassAndMethod[5] 0
skipped
shouldMatchExactClassAndMultipleMethods[5] 0
skipped
fullyQualifiedTest[5] 4.723
negativeTest[5] 3.887
testRegexSuccessTwo[5] 0
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[5] 0
skipped
shouldMatchExactClassAndMethodsWildcard[5] 0
skipped
shouldMatchMultiplePatternsComplex[5] 0
skipped
simpleNameTestAsParallel[5] 3.565
shouldMatchMultiplePatternsAsParallel[5] 0
skipped
shouldNotRunExcludedClassesIfIncluded[5] 3.591
shouldMatchSimpleClassNameAndMethod[5] 0
skipped
shouldMatchExactClassAndMethodPostfix[5] 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[5] 0
skipped
regexClassAndMethod[5] 0
skipped

TestMultipleMethodPatternsTestNGIT

shouldNotRunExcludedClassesAndMethods[0] 3.6
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[0] 3.506
shouldMatchExactClassAndMethodCharacters[0] 3.483
shouldMatchExactClassAndMethodWildcard[0] 3.467
testSuccessTwo[0] 3.606
simpleNameTest[0] 3.504
simpleNameTestWithJavaExt[0] 3.471
regexClass[0] 3.524
shouldNotRunExcludedClasses[0] 3.536
shouldNotRunExcludedMethods[0] 3.581
simpleNameTestWithJavaExtWildcardPkg[0] 3.697
shouldMatchMultiplePatterns[0] 3.882
shouldMatchExactClassAndMethodsPostfix[0] 3.825
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[0] 3.868
simpleNameTestWithWildcardPkg[0] 3.87
shouldMatchWildcardPackageAndClassAndMethod[0] 3.832
shouldMatchExactClassAndMultipleMethods[0] 3.903
fullyQualifiedTest[0] 3.713
negativeTest[0] 0
skipped
testRegexSuccessTwo[0] 3.725
shouldMatchSimpleClassNameAndMethodWithJavaExt[0] 3.493
shouldMatchExactClassAndMethodsWildcard[0] 3.537
shouldMatchMultiplePatternsComplex[0] 3.5
simpleNameTestAsParallel[0] 3.527
shouldMatchMultiplePatternsAsParallel[0] 3.615
shouldNotRunExcludedClassesIfIncluded[0] 3.531
shouldMatchSimpleClassNameAndMethod[0] 3.597
shouldMatchExactClassAndMethodPostfix[0] 3.511
shouldMatchMultiplePatternsComplexAsParallel[0] 3.477
regexClassAndMethod[0] 3.59
shouldNotRunExcludedClassesAndMethods[1] 0
skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[1] 0
skipped
shouldMatchExactClassAndMethodCharacters[1] 0
skipped
shouldMatchExactClassAndMethodWildcard[1] 0
skipped
testSuccessTwo[1] 0
skipped
simpleNameTest[1] 3.474
simpleNameTestWithJavaExt[1] 3.577
regexClass[1] 3.461
shouldNotRunExcludedClasses[1] 3.499
shouldNotRunExcludedMethods[1] 0
skipped
simpleNameTestWithJavaExtWildcardPkg[1] 3.631
shouldMatchMultiplePatterns[1] 0
skipped
shouldMatchExactClassAndMethodsPostfix[1] 0
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[1] 0
skipped
simpleNameTestWithWildcardPkg[1] 3.473
shouldMatchWildcardPackageAndClassAndMethod[1] 0
skipped
shouldMatchExactClassAndMultipleMethods[1] 0
skipped
fullyQualifiedTest[1] 3.635
negativeTest[1] 3.417
testRegexSuccessTwo[1] 0
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[1] 0
skipped
shouldMatchExactClassAndMethodsWildcard[1] 0
skipped
shouldMatchMultiplePatternsComplex[1] 0
skipped
simpleNameTestAsParallel[1] 3.771
shouldMatchMultiplePatternsAsParallel[1] 0
skipped
shouldNotRunExcludedClassesIfIncluded[1] 4.133
shouldMatchSimpleClassNameAndMethod[1] 0
skipped
shouldMatchExactClassAndMethodPostfix[1] 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[1] 0
skipped
regexClassAndMethod[1] 0
skipped
shouldNotRunExcludedClassesAndMethods[2] 0
skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[2] 0.001
skipped
shouldMatchExactClassAndMethodCharacters[2] 0
skipped
shouldMatchExactClassAndMethodWildcard[2] 0
skipped
testSuccessTwo[2] 0
skipped
simpleNameTest[2] 4.522
simpleNameTestWithJavaExt[2] 4.489
regexClass[2] 4.101
shouldNotRunExcludedClasses[2] 3.905
shouldNotRunExcludedMethods[2] 0
skipped
simpleNameTestWithJavaExtWildcardPkg[2] 3.503
shouldMatchMultiplePatterns[2] 0
skipped
shouldMatchExactClassAndMethodsPostfix[2] 0
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[2] 0
skipped
simpleNameTestWithWildcardPkg[2] 3.546
shouldMatchWildcardPackageAndClassAndMethod[2] 0
skipped
shouldMatchExactClassAndMultipleMethods[2] 0
skipped
fullyQualifiedTest[2] 3.536
negativeTest[2] 3.14
testRegexSuccessTwo[2] 0
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[2] 0
skipped
shouldMatchExactClassAndMethodsWildcard[2] 0
skipped
shouldMatchMultiplePatternsComplex[2] 0
skipped
simpleNameTestAsParallel[2] 3.489
shouldMatchMultiplePatternsAsParallel[2] 0.001
skipped
shouldNotRunExcludedClassesIfIncluded[2] 3.56
shouldMatchSimpleClassNameAndMethod[2] 0
skipped
shouldMatchExactClassAndMethodPostfix[2] 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[2] 0
skipped
regexClassAndMethod[2] 0
skipped

TestMultipleMethodsIT

testJunit48Provider4 4.107
testJunit44 3.339
testJunit48Provider47 4.343

TestNgGroupsIT

testExclusion 5.54
testGroupsAndExclusion 4.687
groupsWithDash 4.629
testOnlyGroups 4.673
groupsBySimpleRegex 4.672

TestNgParallelWithAnnotationsIT

testTestNgGroupThreadParallel 5.558

TestNgSuccessPercentageIT

testPassesWhenFailuresLessThanSuccessPercentage 3.808

TestSingleMethodIT

fullyQualifiedTestNg 4.496
testJunit48Provider4 4.41
testJunit44 4.443
testJunit48parallel 4.545
testJunit48Provider47 4.637
fullyQualifiedJunit48Provider47 4.592
fullyQualifiedJunit48Provider4 4.132
testTestNg5149 4.219
testTestNg 4.104

TimeoutForkedTestIT

testTimeoutForked 4.827

TwoTestCasesIT

testJunit4Suite 4.126
testTestNGSuite 4.245
testTwoTestCases 4.025
testTwoTestCaseSuite 4.061

UmlautDirIT

testUmlautIsolatedClassLoader 4.113
testUmlaut 4.157

UnicodeTestNamesIT

checkFileNamesWithUnicode 4.117

UseIsolatedClassLoaderIT

testUseSystemClassLoader 4.728

WorkingDirectoryIsInvalidPropertyIT

testWorkingDirectory 3.294

WorkingDirectoryIT

testWorkingDirectory 5.022
testWorkingDirectoryChildOnlyNoFork 3.655
testWorkingDirectoryNoFork 3.443
testWorkingDirectoryChildOnly 4.348

WorkingDirectoryMissingIT

testWorkingDirectory 4.286

XmlReporterRunTimeIT

testForkModeAlways 21.962

Failure Details

[Summary] [Package List] [Test Cases]


suiteXmlForkModeAlways
skipped: Fails - see SUREFIRE-1123
XXXtest50
skipped: 5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
XXXtest501
skipped: 5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
crashInSingleUseFork
skipped: skipped
crashInReusableFork
skipped: skipped
crashInFork
skipped: skipped
twoSpecifiedTestExecutionsInCorrectExecutionBlocks
skipped: since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
singleTestInOneExecutionOfMultiExecutionProject
skipped: since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
negativeTest[0]
skipped: skipped
simpleNameTestAsParallel[0]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[0]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[0]
skipped: skipped
negativeTest[1]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[2]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[2]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[2]
skipped: skipped
testSuccessTwo[2]
skipped: skipped
shouldNotRunExcludedMethods[2]
skipped: skipped
shouldMatchMultiplePatterns[2]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[2]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[2]
skipped: skipped
testRegexSuccessTwo[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[2]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[2]
skipped: skipped
shouldMatchMultiplePatternsComplex[2]
skipped: skipped
simpleNameTestAsParallel[2]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[2]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[2]
skipped: skipped
regexClassAndMethod[2]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[3]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[3]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[3]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[3]
skipped: skipped
testSuccessTwo[3]
skipped: skipped
shouldNotRunExcludedMethods[3]
skipped: skipped
shouldMatchMultiplePatterns[3]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[3]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[3]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[3]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[3]
skipped: skipped
testRegexSuccessTwo[3]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[3]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[3]
skipped: skipped
shouldMatchMultiplePatternsComplex[3]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[3]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[3]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[3]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[3]
skipped: skipped
regexClassAndMethod[3]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[4]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[4]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[4]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[4]
skipped: skipped
testSuccessTwo[4]
skipped: skipped
shouldNotRunExcludedMethods[4]
skipped: skipped
shouldMatchMultiplePatterns[4]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[4]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[4]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[4]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[4]
skipped: skipped
testRegexSuccessTwo[4]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[4]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[4]
skipped: skipped
shouldMatchMultiplePatternsComplex[4]
skipped: skipped
simpleNameTestAsParallel[4]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[4]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[4]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[4]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[4]
skipped: skipped
regexClassAndMethod[4]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[5]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[5]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[5]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[5]
skipped: skipped
testSuccessTwo[5]
skipped: skipped
shouldNotRunExcludedMethods[5]
skipped: skipped
shouldMatchMultiplePatterns[5]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[5]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[5]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[5]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[5]
skipped: skipped
testRegexSuccessTwo[5]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[5]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[5]
skipped: skipped
shouldMatchMultiplePatternsComplex[5]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[5]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[5]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[5]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[5]
skipped: skipped
regexClassAndMethod[5]
skipped: skipped
negativeTest[0]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[1]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[1]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[1]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[1]
skipped: skipped
testSuccessTwo[1]
skipped: skipped
shouldNotRunExcludedMethods[1]
skipped: skipped
shouldMatchMultiplePatterns[1]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[1]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[1]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[1]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[1]
skipped: skipped
testRegexSuccessTwo[1]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[1]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[1]
skipped: skipped
shouldMatchMultiplePatternsComplex[1]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[1]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[1]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[1]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[1]
skipped: skipped
regexClassAndMethod[1]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[2]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[2]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[2]
skipped: skipped
testSuccessTwo[2]
skipped: skipped
shouldNotRunExcludedMethods[2]
skipped: skipped
shouldMatchMultiplePatterns[2]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[2]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[2]
skipped: skipped
testRegexSuccessTwo[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[2]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[2]
skipped: skipped
shouldMatchMultiplePatternsComplex[2]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[2]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[2]
skipped: skipped
regexClassAndMethod[2]
skipped: skipped