Fork me on GitHub

Surefire Report

Summary

[Summary] [Package List] [Test Cases]


Tests Errors Failures Skipped Success Rate Time
753 0 0 133 82.337% 3,898.651

Note: failures are anticipated and checked for with assertions while errors are unanticipated.


Package List

[Summary] [Package List] [Test Cases]


Package Tests Errors Failures Skipped Success Rate Time
org.apache.maven.surefire.its 583 0 0 131 77.53% 2,753.941
org.apache.maven.surefire.its.jiras 170 0 0 2 98.824% 1,144.71

Note: package statistics are not computed recursively, they only sum up all of its testsuites numbers.

org.apache.maven.surefire.its

Class Tests Errors Failures Skipped Success Rate Time
AbstractTestCaseIT 1 0 0 0 100% 9.557
AdditionalClasspathIT 1 0 0 0 100% 4.5
AggregateReportIT 1 0 0 0 100% 9.737
ArgLineIT 1 0 0 0 100% 6.076
ArgLinePropertiesIT 1 0 0 0 100% 7.888
AssumptionFailureReportIT 1 0 0 0 100% 5.222
CheckSingleTestIT 4 0 0 0 100% 18.213
CheckTestFailIfNoTestsForkModeIT 6 0 0 0 100% 27.53
CheckTestFailIfNoTestsIT 3 0 0 0 100% 11.01
CheckTestNgBeforeMethodFailureIT 1 0 0 0 100% 8.098
CheckTestNgBeforeMethodIT 1 0 0 0 100% 7.984
CheckTestNgCustomObjectFactoryIT 1 0 0 0 100% 7.419
CheckTestNgCustomTestRunnerFactoryIT 1 0 0 0 100% 5.304
CheckTestNgExecuteErrorIT 1 0 0 0 100% 6.857
CheckTestNgGroupThreadParallelIT 1 0 0 0 100% 8.188
CheckTestNgJdk14IT 1 0 0 0 100% 7.126
CheckTestNgListenerReporterIT 8 0 0 0 100% 62.882
CheckTestNgListenersIT 1 0 0 0 100% 6.287
CheckTestNgPathWithSpacesIT 1 0 0 0 100% 6.174
CheckTestNgReportTestIT 3 0 0 0 100% 23.845
CheckTestNgSuiteXmlIT 3 0 0 1 66.667% 16.251
CheckTestNgSuiteXmlSingleIT 1 0 0 0 100% 6.208
CheckTestNgVersionsIT 20 0 0 2 90% 116.111
ClasspathFilteringIT 1 0 0 0 100% 3.965
ClassPathOrderIT 1 0 0 0 100% 6.858
ClasspathScopeFilteringIT 1 0 0 0 100% 4.201
ConsoleOutputIT 4 0 0 0 100% 30.576
CrashDetectionIT 3 0 0 0 100% 16.739
DefaultConfigurationIT 1 0 0 0 100% 4.374
EnvironmentVariableIT 1 0 0 0 100% 4.969
EnvironmentVariablesIT 2 0 0 0 100% 11.628
FailFastJUnitIT 12 0 0 0 100% 142.338
FailFastTestNgIT 6 0 0 0 100% 72.117
ForkConsoleOutputIT 4 0 0 0 100% 22.662
ForkConsoleOutputWithErrorsIT 1 0 0 0 100% 6.244
ForkModeIT 12 0 0 0 100% 81.983
ForkModeMultiModuleIT 4 0 0 0 100% 39.777
ForkModeTestNGIT 12 0 0 0 100% 88.503
IncludesExcludesFromFileIT 6 0 0 0 100% 29.804
IncludesExcludesIT 3 0 0 0 100% 17.409
Java9FullApiIT 3 0 0 0 100% 25.907
JUnit44HamcrestIT 1 0 0 0 100% 5.799
JUnit47ConcurrencyIT 1 0 0 0 100% 6.228
JUnit47ParallelIT 59 0 0 0 100% 355.62
JUnit47ParallelNotThreadSafeIT 1 0 0 0 100% 5.312
JUnit47RedirectOutputIT 2 0 0 0 100% 12.082
JUnit47RerunFailingTestWithCucumberIT 3 0 0 0 100% 18.009
JUnit47StaticInnerClassTestsIT 1 0 0 0 100% 4.297
JUnit47WithCucumberIT 2 0 0 0 100% 12.162
JUnit48TestCategoriesIT 8 0 0 0 100% 57.53
JUnit4ForkAlwaysStaticInitPollutionIT 1 0 0 0 100% 6.849
JUnit4IgnoreIT 2 0 0 0 100% 12.129
JUnit4RerunFailingTestsIT 5 0 0 0 100% 124.079
JUnit4RunListenerIT 2 0 0 0 100% 12.352
JUnit4VersionsIT 16 0 0 0 100% 96.689
JUnitDepIT 4 0 0 0 100% 24.794
LongWindowsPathIT 1 0 0 0 100% 6.017
ModulePathIT 1 0 0 0 100% 11.402
NoRunnableTestsInClassIT 1 0 0 0 100% 5.685
PlainOldJavaClasspathIT 1 0 0 0 100% 5.675
PlexusConflictIT 2 0 0 0 100% 10.983
PojoSimpleIT 1 0 0 0 100% 5.63
ReportersIT 1 0 0 0 100% 5.945
ResultCountingIT 3 0 0 0 100% 20.153
RunOrderIT 4 0 0 0 100% 19.853
RunOrderParallelForksIT 4 0 0 0 100% 21.014
SiblingAggregatorIT 1 0 0 0 100% 5.95
SmartStackTraceIT 1 0 0 0 100% 4.866
SystemPropertiesTestIT 2 0 0 0 100% 10.976
TestMethodPatternIT 7 0 0 0 100% 41.926
TestMultipleMethodPatternsIT 180 0 0 87 51.667% 391.742
TestMultipleMethodPatternsTestNGIT 90 0 0 41 54.444% 207.316
TestMultipleMethodsIT 3 0 0 0 100% 15.292
TestNgGroupsIT 5 0 0 0 100% 33.903
TestNgParallelWithAnnotationsIT 1 0 0 0 100% 7.495
TestNgSuccessPercentageIT 1 0 0 0 100% 4.79
TestSingleMethodIT 9 0 0 0 100% 54.118
TimeoutForkedTestIT 1 0 0 0 100% 6.856
TwoTestCasesIT 4 0 0 0 100% 23.209
UmlautDirIT 2 0 0 0 100% 13.689
UnicodeTestNamesIT 1 0 0 0 100% 7.7
UseIsolatedClassLoaderIT 1 0 0 0 100% 5.668
WorkingDirectoryIsInvalidPropertyIT 1 0 0 0 100% 4.052
WorkingDirectoryIT 4 0 0 0 100% 19.607
WorkingDirectoryMissingIT 1 0 0 0 100% 5.171
XmlReporterRunTimeIT 1 0 0 0 100% 24.806

org.apache.maven.surefire.its.jiras

Class Tests Errors Failures Skipped Success Rate Time
Surefire1024VerifyFailsafeIfTestedIT 1 0 0 0 100% 4.861
Surefire1028UnableToRunSingleIT 1 0 0 0 100% 4.249
Surefire1036NonFilterableJUnitRunnerWithCategoriesIT 1 0 0 0 100% 5.866
Surefire1041FailingJUnitRunnerIT 1 0 0 0 100% 5.389
Surefire1053SystemPropertiesIT 2 0 0 0 100% 11.289
Surefire1055CorrectConcurrentTestCountIT 1 0 0 0 100% 6.393
Surefire1080ParallelForkDoubleTestIT 1 0 0 0 100% 6.55
Surefire1082ParallelJUnitParameterizedIT 3 0 0 0 100% 23.378
Surefire1098BalancedRunOrderIT 1 0 0 0 100% 27.118
Surefire1122ParallelAndFlakyTestsIT 2 0 0 0 100% 10.548
Surefire1135ImproveIgnoreMessageForTestNGIT 2 0 0 0 100% 15.095
Surefire1136CwdPropagationInForkedModeIT 1 0 0 0 100% 5.587
Surefire1144XmlRunTimeIT 1 0 0 0 100% 6.654
Surefire1152RerunFailingTestsInSuiteIT 2 0 0 0 100% 9.866
Surefire1153IncludesAndSpecifiedTestIT 2 0 0 0 100% 7.668
Surefire1158RemoveInfoLinesIT 6 0 0 0 100% 37.147
Surefire1177TestngParallelSuitesIT 1 0 0 0 100% 8.601
Surefire1179IT 1 0 0 0 100% 9.183
Surefire1185DoNotSpawnTestsIT 1 0 0 0 100% 3.881
Surefire1202RerunAndSkipIT 2 0 0 0 100% 35.842
Surefire1209RerunAndForkCountIT 4 0 0 0 100% 54.96
Surefire1211JUnitTestNgIT 2 0 0 0 100% 14.276
Surefire1264IT 2 0 0 0 100% 15.21
Surefire1265Java9IT 1 0 0 0 100% 4.355
Surefire1278GroupNameEndingIT 1 0 0 0 100% 5.928
Surefire1295AttributeJvmCrashesToTestsIT 6 0 0 0 100% 49.969
Surefire1364SystemPropertiesIT 10 0 0 0 100% 65.26
Surefire1367AssumptionLogsIT 4 0 0 0 100% 20.342
Surefire1396CustomProviderClassPathIT 1 0 0 0 100% 8.167
Surefire141PluggableProvidersIT 4 0 0 0 100% 30.659
Surefire146ForkPerTestNoSetupIT 1 0 0 0 100% 6.209
Surefire162CharsetProviderIT 1 0 0 0 100% 5.775
Surefire224WellFormedXmlFailuresIT 1 0 0 0 100% 4.962
Surefire257NotRerunningTestsIT 1 0 0 0 100% 8.865
Surefire260TestWithIdenticalNamesIT 1 0 0 0 100% 13.644
Surefire34SecurityManagerIT 2 0 0 0 100% 11.032
Surefire376TestNgAfterSuiteFailureIT 1 0 0 0 100% 6.395
Surefire377TestNgAndJUnitTogetherIT 2 0 0 0 100% 11.003
Surefire408ManualProviderSelectionIT 1 0 0 0 100% 5.623
Surefire42NotExtendingTestCaseIT 1 0 0 0 100% 5.767
Surefire44InnerClassTestIT 1 0 0 0 100% 5.697
Surefire500PuzzlingErrorIT 1 0 0 0 100% 5.988
Surefire510TestClassPathForkModesIT 2 0 0 0 100% 11.53
Surefire569RunTestFromDependencyJarsIT 1 0 0 0 100% 5.052
Surefire570MultipleReportDirectoriesIT 2 0 0 0 100% 30.434
Surefire613TestCountInParallelIT 1 0 0 0 100% 6.537
Surefire621TestCountingJunit3InParallelIT 5 0 0 0 100% 32.849
Surefire628ConsoleOutputBeforeAndAfterClassIT 1 0 0 0 100% 6.22
Surefire634UnsettableSystemPropertiesWarningIT 1 0 0 0 100% 5.888
Surefire649EmptyStringSystemPropertiesIT 2 0 0 0 100% 8.562
Surefire673MockitoIT 1 0 0 0 100% 5.047
Surefire674BuildFailingWhenErrorsIT 1 0 0 0 100% 5.943
Surefire674BuildFailingWhenFailsafeErrorsIT 1 0 0 0 100% 3.657
Surefire685CommaSeparatedIncludesIT 1 0 0 0 100% 5.081
Surefire697NiceSummaryIT 1 0 0 0 100% 5.642
Surefire705ParallelForkTimeoutIT 1 0 0 0 100% 8.306
Surefire733AllOverrridesCapturedIT 1 0 0 0 100% 5.271
Surefire735ForkFailWithRedirectConsoleOutputIT 2 0 0 0 100% 8.751
Surefire740TruncatedCommaIT 1 0 0 0 100% 4.295
Surefire747MethodParallelWithSuiteCountIT 2 0 0 0 100% 21.195
Surefire772BothReportsIT 3 0 0 0 100% 10.76
Surefire772NoFailsafeReportsIT 4 0 0 0 100% 13.882
Surefire772NoSurefireReportsIT 4 0 0 0 100% 15.971
Surefire772SpecifiedReportsIT 3 0 0 0 100% 10.496
Surefire801ForkModeNoneClassLoaderIT 1 0 0 0 100% 3.852
Surefire803MultiFailsafeExecsIT 2 0 0 0 100% 19.584
Surefire806SpecifiedTestControlsIT 3 0 0 2 33.333% 6.039
Surefire809GroupExpressionsIT 6 0 0 0 100% 33.856
Surefire812Log4JClassLoaderIT 1 0 0 0 100% 5.88
Surefire817SystemExitIT 1 0 0 0 100% 6.054
Surefire818NpeIgnoresTestsIT 1 0 0 0 100% 6.666
Surefire828EmptyGroupExprIT 4 0 0 0 100% 25.669
Surefire832ProviderSelectionIT 1 0 0 0 100% 6.398
Surefire839TestWithoutCategoriesIT 2 0 0 0 100% 13.928
Surefire847AdditionalFailureIT 1 0 0 0 100% 6.603
Surefire855AllowFailsafeUseArtifactFileIT 4 0 0 0 100% 50.937
Surefire901MIssingResultfileWhenNoTestsIT 1 0 0 0 100% 5.148
Surefire907PerThreadWithoutThreadCountIT 1 0 0 0 100% 3.697
Surefire920TestFailureIgnoreWithTimeoutIT 2 0 0 0 100% 13.605
Surefire926FailureWith2ProvidersIT 1 0 0 0 100% 4.758
Surefire930TestNgSuiteXmlIT 1 0 0 0 100% 6.442
Surefire943ReportContentIT 2 0 0 0 100% 19.578
Surefire946KillMainProcessInReusableForkIT 3 0 0 0 100% 22.787
Surefire972BizarreNoClassDefIT 1 0 0 0 100% 8.42
Surefire975DefaultVMEncodingIT 1 0 0 0 100% 5.776
Surefire979WrongClassLoaderIT 1 0 0 0 100% 6.327
Surefire985ParameterizedRunnerAndCategoriesIT 1 0 0 0 100% 5.086
Surefire995CategoryInheritanceIT 5 0 0 0 100% 21

Test Cases

[Summary] [Package List] [Test Cases]

AbstractTestCaseIT

abstractTestCase 9.557

AdditionalClasspathIT

additionalClasspath 4.5

AggregateReportIT

aggregateReport 9.737

ArgLineIT

argLine 6.076

ArgLinePropertiesIT

argLine 7.888

AssumptionFailureReportIT

testWriteSkippedMessageToReport 5.222

CheckSingleTestIT

singleTestDotJava 5.052
singleTestNonExistentOverride 4.428
singleTestNonExistent 4.039
singleTest 4.694

CheckTestFailIfNoTestsForkModeIT

dontFailIfNoTestsForkModeAlways 4.398
failIfNoTestsForkModeOnce 4.751
dontFailIfNoTestsForkModeNever 4.499
dontFailIfNoTestsForkModeOnce 4.738
failIfNoTestsForkModeNever 4.442
failIfNoTestsForkModeAlways 4.702

CheckTestFailIfNoTestsIT

failIfNoTests 3.587
dontFailIfNoTests 3.191
jUnit48CategoriesFailWhenNoTests 4.232

CheckTestNgBeforeMethodFailureIT

TestNgBeforeMethodFailure 8.098

CheckTestNgBeforeMethodIT

TestNgBeforeMethod 7.984

CheckTestNgCustomObjectFactoryIT

testTestNgListenerReporter 7.419

CheckTestNgCustomTestRunnerFactoryIT

testTestNgListenerReporter 5.304

CheckTestNgExecuteErrorIT

executionError 6.857

CheckTestNgGroupThreadParallelIT

TestNgGroupThreadParallel 8.188

CheckTestNgJdk14IT

TestNgJdk14 7.126

CheckTestNgListenerReporterIT

testNgListenerReporter[0: TestNG 5.6] 7.354
testNgListenerReporter[1: TestNG 5.7] 8.62
testNgListenerReporter[2: TestNG 5.10] 6.986
testNgListenerReporter[3: TestNG 5.13] 7.929
testNgListenerReporter[4: TestNG 5.14.6] 7.953
testNgListenerReporter[5: TestNG 5.14.9] 7.987
testNgListenerReporter[6: TestNG 6.0] 6.967
testNgListenerReporter[7: TestNG 6.9.9] 9.086

CheckTestNgListenersIT

TestNgListenerReporter 6.287

CheckTestNgPathWithSpacesIT

TestWithSpaces 6.174

CheckTestNgReportTestIT

testNgReport 9.194
shouldNotBeVerbose 7.179
shouldBeVerbose 7.472

CheckTestNgSuiteXmlIT

suiteXml 7.458
suiteXmlForkCountTwoReuse 8.793
suiteXmlForkModeAlways
+ [ Detail ]
 0
Fails - see SUREFIRE-1123

CheckTestNgSuiteXmlSingleIT

TestNgSuite 6.208

CheckTestNgVersionsIT

XXXtest50
+ [ Detail ]
 0
5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
test502 6.439
test510 6.116
test511 7.873
test512 6.517
test513 6.511
test514 6.435
test685 7.446
test5131 6.307
test5141 6.692
test5142 6.3
test47 6.335
test51 6.103
test55 6.379
test56 5.927
test57 6.493
test58 5.989
test59 6.032
test60 6.217
XXXtest501
+ [ Detail ]
 0
5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024

ClasspathFilteringIT

additionalClasspath 3.965

ClassPathOrderIT

classPathOrder 6.858

ClasspathScopeFilteringIT

additionalClasspath 4.201

ConsoleOutputIT

properNewlinesAndEncodingWithDifferentEncoding 5.114
properNewlinesAndEncodingWithDefaultEncodings 6.148
largerSoutThanMemory 15.047
properNewlinesAndEncodingWithoutFork 4.267

CrashDetectionIT

hardCrashInReusableFork 4.811
crashInReusableFork 5.853
crashInFork 6.075

DefaultConfigurationIT

defaultConfiguration 4.374

EnvironmentVariableIT

environmentVariable 4.969

EnvironmentVariablesIT

testWhenUseSystemClassLoader 5.702
testWhenDontUseSystemClassLoader 5.926

FailFastJUnitIT

test[junit4-oneFork-ff1] 8.147
test[junit47-oneFork-ff1] 7.502
test[junit4-oneFork-ff2] 10.644
test[junit47-oneFork-ff2] 11.365
test[junit4-twoForks-ff1] 9.99
test[junit47-twoForks-ff1] 9.54
test[junit4-twoForks-ff2] 10.415
test[junit47-twoForks-ff2] 11.845
test[junit4-oneFork-ff3] 18.439
test[junit47-oneFork-ff3] 18.333
test[junit4-twoForks-ff3] 12.763
test[junit47-twoForks-ff3] 13.355

FailFastTestNgIT

test[testng-oneFork-ff1] 7.15
test[testng-oneFork-ff2] 11.131
test[testng-twoForks-ff1] 10.273
test[testng-twoForks-ff2] 11.131
test[testng-oneFork-ff3] 19.08
test[testng-twoForks-ff3] 13.352

ForkConsoleOutputIT

printSummaryTrueWithRedirect 5.242
printSummaryFalseWithoutRedirect 5.665
printSummaryTrueWithoutRedirect 5.789
printSummaryFalseWithRedirect 5.966

ForkConsoleOutputWithErrorsIT

xmlFileContainsConsoleOutput 6.244

ForkModeIT

testForkModeOncePerThreadSingleThread 6.58
testForkModePerTest 8.334
testForkCountZero 5.617
testForkCountOneNoReuse 7.688
testForkCountTwoNoReuse 7.457
testForkModeNever 5.433
testForkCountTwoReuse 6.6
testForkCountOneReuse 6.968
testForkModeOncePerThreadTwoThreads 7.286
testForkModeAlways 8.489
testForkModeNone 5.655
testForkModeOnce 5.876

ForkModeMultiModuleIT

testForkCountOneNoReuse 11.307
testForkCountTwoNoReuse 10.392
testForkCountTwoReuse 8.716
testForkCountOneReuse 9.362

ForkModeTestNGIT

testForkModeOncePerThreadSingleThread 6.431
testForkModePerTest 9.221
testForkCountZero 5.993
testForkCountOneNoReuse 8.715
testForkCountTwoNoReuse 8.196
testForkModeNever 5.975
testForkCountTwoReuse 7.109
testForkCountOneReuse 7.15
testForkModeOncePerThreadTwoThreads 7.674
testForkModeAlways 9.447
testForkModeNone 6.26
testForkModeOnce 6.332

IncludesExcludesFromFileIT

testSimpleMixed 5.715
testMissingExcludes 4.105
testRegex 5.084
testPath 5.596
testMissingIncludes 4.345
testSimple 4.959

IncludesExcludesIT

testPathBasedIncludesExcludes 6.058
testIncludesExcludes 5.601
testRegexIncludesExcludes 5.75

Java9FullApiIT

shouldLoadMultipleJavaModules_JavaHome 8.637
shouldLoadMultipleJavaModules_ToolchainsXML 9.06
shouldLoadMultipleJavaModules_JvmParameter 8.21

Surefire1024VerifyFailsafeIfTestedIT

shouldScanAndRunTestsInDependencyJars 4.861

Surefire1028UnableToRunSingleIT

methodFilteringParallelExecution 4.249

Surefire1036NonFilterableJUnitRunnerWithCategoriesIT

test 5.866

Surefire1041FailingJUnitRunnerIT

reportErrorInJUnitRunnerAsTestError 5.389

Surefire1053SystemPropertiesIT

checkWarningsSysPropTwice 5.592
checkWarningsFileEncoding 5.697

Surefire1055CorrectConcurrentTestCountIT

testTestNgAndJUnitTogether 6.393

Surefire1080ParallelForkDoubleTestIT

test 6.55

Surefire1082ParallelJUnitParameterizedIT

checkClassesRunParallel 8.295
shouldRunTwo 8.23
checkOutFileClassesRunParallel 6.853

Surefire1098BalancedRunOrderIT

reorderedParallelClasses 27.118

Surefire1122ParallelAndFlakyTestsIT

nonParallelCreatesCorrectReport 5.407
parallelCreatesCorrectReport 5.141

Surefire1135ImproveIgnoreMessageForTestNGIT

testNgReport57 7.068
testNgReport688 8.027

Surefire1136CwdPropagationInForkedModeIT

testTestNgAndJUnitTogether 5.587

Surefire1144XmlRunTimeIT

testXmlRunTime 6.654

Surefire1152RerunFailingTestsInSuiteIT

testJUnit48Provider47 5.177
testJUnit48Provider4 4.689

Surefire1153IncludesAndSpecifiedTestIT

testSpecifiedTestInIncludes 3.818
testSpecifiedTestNotInIncludes 3.85

Surefire1158RemoveInfoLinesIT

shouldRunWithCliOption[junit-option-ff] 5.533
shouldRunWithCliOption[testng-option-ff] 6.413
shouldRunWithCliOption[junit-option-X] 6.363
shouldRunWithCliOption[testng-option-X] 6.508
shouldRunWithCliOption[junit-option-e] 6.169
shouldRunWithCliOption[testng-option-e] 6.161

Surefire1177TestngParallelSuitesIT

shouldRunTwoSuitesInParallel 8.601

Surefire1179IT

suiteXmlForkCountTwoReuse 9.183

Surefire1185DoNotSpawnTestsIT

doNotSpawnUnwantedTests 3.881

Surefire1202RerunAndSkipIT

junit47 18.11
junit4 17.732

Surefire1209RerunAndForkCountIT

notReusableForksJUnit47 14.119
reusableForksJUnit47 14.13
reusableForksJUnit4 12.704
notReusableForksJUnit4 14.007

Surefire1211JUnitTestNgIT

withoutJUnit 7.693
withJUnit 6.583

Surefire1264IT

positiveTests 7.959
negativeTests 7.251

Surefire1265Java9IT

shouldRunInPluginJava9 4.355

Surefire1278GroupNameEndingIT

testOnlyGroups 5.928

Surefire1295AttributeJvmCrashesToTestsIT

test[0] 8.931
test[1] 10.572
test[2] 7.357
test[3] 6.41
test[4] 9.817
test[5] 6.882

Surefire1364SystemPropertiesIT

junit47InProcessParallel 7.057
junit47Forked 6.492
junit47InProcess 6.539
testNg 7.389
junit3Forked 5.974
junit47ForkedParallel 6.629
junit4Forked 5.954
testNgInProcess 7.143
junit4InProcess 5.874
junit3InProcess 6.209

Surefire1367AssumptionLogsIT

shouldSeeLogsInPlugin 4.683
shouldSeeLogsParallelInPlugin 4.344
shouldSeeLogsParallelForked 5.483
shouldSeeLogsForked 5.832

Surefire1396CustomProviderClassPathIT

pluggableProviderClasspathCorrect 8.167

Surefire141PluggableProvidersIT

pluggableProviderPresent 7.123
invokeRuntimeException 7.605
invokeReporterException 8.227
constructorRuntimeException 7.704

Surefire146ForkPerTestNoSetupIT

testForkPerTestNoSetup 6.209

Surefire162CharsetProviderIT

testCharsetProvider 5.775

Surefire224WellFormedXmlFailuresIT

testWellFormedXmlFailures 4.962

Surefire257NotRerunningTestsIT

shouldNotRerun 8.865

Surefire260TestWithIdenticalNamesIT

testWithIdenticalNames 13.644

Surefire34SecurityManagerIT

testSecurityManager 5.428
testSecurityManagerSuccessful 5.604

Surefire376TestNgAfterSuiteFailureIT

testAfterSuiteFailure 6.395

Surefire377TestNgAndJUnitTogetherIT

testTestNgAndJUnit4Together 5.512
testTestNgAndJUnitTogether 5.491

Surefire408ManualProviderSelectionIT

testParallelBuildResultCount 5.623

Surefire42NotExtendingTestCaseIT

testInnerClass 5.767

Surefire44InnerClassTestIT

testInnerClass 5.697

Surefire500PuzzlingErrorIT

testBuildFailingWhenErrors 5.988

Surefire510TestClassPathForkModesIT

testForkOnce 5.723
testForkAlways 5.807

Surefire569RunTestFromDependencyJarsIT

shouldScanAndRunTestsInDependencyJars 5.052

Surefire570MultipleReportDirectoriesIT

testReportWithAggregate 14.877
testReportWithoutAggregate 15.557

Surefire613TestCountInParallelIT

testParallelBuildResultCount 6.537

Surefire621TestCountingJunit3InParallelIT

testJunit3ParallelBuildResultCount 6.734
testJunit3ParallelSuiteBuildResultCount 6.495
testJunit3AllParallelBuildResultCount 6.591
testJunit3BuildResultCount 6.456
testJunit3SuiteBuildResultCount 6.573

Surefire628ConsoleOutputBeforeAndAfterClassIT

testJunit3ParallelBuildResultCount 6.22

Surefire634UnsettableSystemPropertiesWarningIT

testJunit3ParallelBuildResultCount 5.888

Surefire649EmptyStringSystemPropertiesIT

systemPropertyVariables 4.629
systemProperties 3.933

Surefire673MockitoIT

testBuildFailingWhenErrors 5.047

Surefire674BuildFailingWhenErrorsIT

testBuildFailingWhenErrors 5.943

Surefire674BuildFailingWhenFailsafeErrorsIT

testBuildFailingWhenErrors 3.657

Surefire685CommaSeparatedIncludesIT

testBuildFailingWhenErrors 5.081

Surefire697NiceSummaryIT

testBuildFailingWhenErrors 5.642

Surefire705ParallelForkTimeoutIT

testTimeoutForked 8.306

Surefire733AllOverrridesCapturedIT

testLogOutput 5.271

Surefire735ForkFailWithRedirectConsoleOutputIT

vmStartFail 4.294
vmStartFailShouldFailBuildk 4.457

Surefire740TruncatedCommaIT

testRussianLocaleReport 4.295

Surefire747MethodParallelWithSuiteCountIT

testMethodsParallelWithSuite 9.599
testClassesParallelWithSuite 11.596

Surefire772BothReportsIT

testSkippedSurefireReportGeneration 3.884
testSkippedFailsafeReportGeneration 3.359
testReportGeneration 3.517

Surefire772NoFailsafeReportsIT

testSkippedFailsafeReportGeneration 3.485
testForcedFailsafeReportGeneration 3.51
testSkipForcedFailsafeReportGeneration 3.423
testReportGeneration 3.464

Surefire772NoSurefireReportsIT

testOptionalSurefireReportGeneration 3.549
testSkippedSurefireReportGeneration 3.996
testSkipOptionalSurefireReportGeneration 4.188
testReportGeneration 4.238

Surefire772SpecifiedReportsIT

testSkippedSurefireReportGeneration 3.494
testSkippedFailsafeReportGeneration 3.458
testReportGeneration 3.544

Surefire801ForkModeNoneClassLoaderIT

testSHouldBeOkWithForkNever 3.852

Surefire803MultiFailsafeExecsIT

testOneExecutionRunInTwoBuilds 12.127
testSecondExecutionRunsAfterFirstExecutionFails 7.457

Surefire806SpecifiedTestControlsIT

singleTestInSingleExecutionProject 6.039
twoSpecifiedTestExecutionsInCorrectExecutionBlocks
+ [ Detail ]
 0
since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
singleTestInOneExecutionOfMultiExecutionProject
+ [ Detail ]
 0
since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution

Surefire809GroupExpressionsIT

testNGRunCategoryAB 5.591
testExcludedGroups 6.198
testJUnitRunCategoryNotC 6.065
incorrectJUnitVersions 3.834
categoryAB 5.709
testNGRunCategoryNotC 6.459

Surefire812Log4JClassLoaderIT

testJunit3ParallelBuildResultCount 5.88

Surefire817SystemExitIT

systemExit1 6.054

Surefire818NpeIgnoresTestsIT

testBuildFailingWhenErrors 6.666

Surefire828EmptyGroupExprIT

testJUnitRunEmptyExcludeGroups 6.483
testJUnitRunEmptyGroups 6.732
testTestNGRunEmptyExcludeGroups 6.353
testTestNGRunEmptyGroups 6.101

Surefire832ProviderSelectionIT

testJUnitRunCategoryAB 6.398

Surefire839TestWithoutCategoriesIT

classWithoutCategoryForked 7.094
classWithoutCategory 6.834

Surefire847AdditionalFailureIT

testJUnitRunCategoryAB 6.603

Surefire855AllowFailsafeUseArtifactFileIT

jarNotForkingShouldUseFile 15.026
jarShouldUseFile 9.044
warShouldUseClasses 11.535
osgiBundleShouldUseFile 15.332

Surefire901MIssingResultfileWhenNoTestsIT

failsafeWithNoTests 5.148

Surefire907PerThreadWithoutThreadCountIT

categoryAB 3.697

Surefire920TestFailureIgnoreWithTimeoutIT

timeoutInForkWithBuildFail 6.57
timeoutInForkWithNoBuildFail 7.035

Surefire926FailureWith2ProvidersIT

testBuildFailingWhenErrors 4.758

Surefire930TestNgSuiteXmlIT

suiteXmlRun 6.442

Surefire943ReportContentIT

test_noParallel 12.378
test_parallelBoth 7.2

Surefire946KillMainProcessInReusableForkIT

testExit 7.436
testHalt 7.582
testInterrupt 7.769

Surefire972BizarreNoClassDefIT

testJunit3ParallelBuildResultCount 8.42

Surefire975DefaultVMEncodingIT

runWithRussian1251 5.776

Surefire979WrongClassLoaderIT

wrongClassloaderUSedInSmartStacktraceparser 6.327

Surefire985ParameterizedRunnerAndCategoriesIT

test 5.086

Surefire995CategoryInheritanceIT

junit411ShouldRunExplicitCategory 4.331
junit411ShouldExcludeExplicitCategory 4.259
junit412ShouldExcludeInheritedCategory 4.31
junit412ShouldRunInheritedCategory 4.245
negativeTestShouldRunAllCategories 3.855

JUnit44HamcrestIT

testJUnit44Hamcrest 5.799

JUnit47ConcurrencyIT

test47 6.228

JUnit47ParallelIT

unknownThreadCountClasses 3.67
threadCountSuites 8.172
unlimitedThreadsSuitesAndMethods1 5.773
unlimitedThreadsSuitesAndMethods2 5.89
unknownThreadCountMethods 3.604
threadCountClassesAndMethods 5.734
reusableThreadCountClassesAndMethodsOptimized 6.488
unknownThreadCountSuites 3.614
reusableThreadCountAll 5.52
forcedShutdown 6.83
unknownThreadCountAll 3.689
serial 11.456
reusableThreadCountAllOptimized 5.543
suites 8.126
unlimitedThreadsMethods1 6.908
unlimitedThreadsMethods2 6.989
unlimitedThreadsSuitesAndClasses1 5.429
unlimitedThreadsSuitesAndClasses2 5.422
threadCountAllOptimized 5.798
threadCountAll 5.778
everyThreadCountSuitesAndClasses 5.56
unknownThreadCountBoth 3.671
threadCountSuitesAndClassesOptimized 5.496
classesAndMethods 5.191
everyThreadCountSuitesAndMethods 5.727
unknownThreadCountSuitesAndClasses 3.608
reusableThreadCountSuitesAndClassesOptimized 6.431
unknownThreadCountSuitesAndMethods 3.686
suitesAndClasses 5.423
suitesAndMethods 5.81
shutdown 9.435
threadCountClassesAndMethodsOneCore 9.35
everyThreadCountClassesAndMethods 5.786
all 4.809
unknownThreadCountClassesAndMethods 3.648
threadCountSuitesAndMethodsOptimized 5.757
reusableThreadCountSuitesAndMethodsOptimized 6.52
unlimitedThreadsClasses1 6.306
unlimitedThreadsClasses2 6.372
threadCountClasses 6.41
everyThreadCountAll 5.729
threadCountMethods 6.949
unlimitedThreadsSuites1 8.09
unlimitedThreadsSuites2 8.144
threadCountSuitesAndClasses 5.424
unlimitedThreadsClassesAndMethods1 5.289
unlimitedThreadsClassesAndMethods2 5.218
threadCountSuitesAndMethods 5.725
classes 6.363
reusableThreadCountSuitesAndClasses 6.392
methods 6.914
reusableThreadCountSuitesAndMethods 6.394
timeoutAndForcedShutdown 6.83
threadCountClassesAndMethodsOptimized 5.664
unlimitedThreadsAll1 4.882
unlimitedThreadsAll2 4.991
forcedShutdownVerifyingLogs 5.495
threadCountClassesAndMethodsOneCoreOptimized 9.312
reusableThreadCountClassesAndMethods 6.386

JUnit47ParallelNotThreadSafeIT

test 5.312

JUnit47RedirectOutputIT

testClassesParallel 5.576
testPrintSummaryTrueWithRedirect 6.506

JUnit47RerunFailingTestWithCucumberIT

testRerunFailingErrorTestsFalse 7.882
testRerunFailingErrorTestsWithOneRetry 5.07
testRerunFailingErrorTestsTwoRetry 5.057

JUnit47StaticInnerClassTestsIT

testStaticInnerClassTests 4.297

JUnit47WithCucumberIT

testWithParallelClasses 7.134
testWithoutParallel 5.028

JUnit48TestCategoriesIT

testCategoriesACFullyQualifiedClassName 5.643
testBadCategoryForkAlways 8.048
testCategoriesABForkAlways 8.035
testCategoriesBadCategory 6.561
testCategoriesACClassNameSuffix 6.427
testCategoriesACFullyQualifiedClassNameForkAlways 8.478
testCategoriesAB 6.336
testCategoriesACClassNameSuffixForkAlways 8.002

JUnit4ForkAlwaysStaticInitPollutionIT

testJunit4Ignore 6.849

JUnit4IgnoreIT

testJunit4Ignore 5.686
testJunit47ParallelIgnore 6.443

JUnit4RerunFailingTestsIT

testRerunFailingErrorTestsFalse 25.019
testRerunFailingErrorTestsWithOneRetry 25.016
testRerunFailingErrorTestsTwoRetry 24.891
testRerunOneTestMethod 24.848
testRerunOneTestClass 24.305

JUnit4RunListenerIT

testJUnit4RunListener 5.985
testRunlistenerJunitCoreProvider 6.367

JUnit4VersionsIT

testJunit[0: JUnit 4.0] 5.64
testJunit[1: JUnit 4.1] 6.371
testJunit[2: JUnit 4.2] 6.448
testJunit[3: JUnit 4.3] 6.436
testJunit[4: JUnit 4.3.1] 6.484
testJunit[5: JUnit 4.4] 5.67
testJunit[6: JUnit 4.5] 5.922
testJunit[7: JUnit 4.6] 6.373
testJunit[8: JUnit 4.7] 5.676
testJunit[9: JUnit 4.8] 6.283
testJunit[10: JUnit 4.8.1] 6.035
testJunit[11: JUnit 4.8.2] 5.602
testJunit[12: JUnit 4.9] 6.431
testJunit[13: JUnit 4.10] 5.745
testJunit[14: JUnit 4.11] 5.795
testJunit[15: JUnit 4.12] 5.778

JUnitDepIT

testJUnit44DepWithSneaky381 5.785
testJUnit44Dep 6.023
testJUnit47Dep 6.437
testJUnit48Dep 6.549

LongWindowsPathIT

shouldRunInSystemTmp 6.017

ModulePathIT

testModulePath 11.402

NoRunnableTestsInClassIT

testJunit3ParallelBuildResultCount 5.685

PlainOldJavaClasspathIT

testPlainOldJavaClasspath 5.675

PlexusConflictIT

testPlexusConflict 5.904
testPlexusConflictIsolatedClassLoader 5.079

PojoSimpleIT

testit 5.63

ReportersIT

testRedirectOutputTestNg 5.945

ResultCountingIT

testCountingWithJunit481ForkAlways 9.136
testCountingWithJunit481ForkOnce 6.316
testCountingWithJunit481ForkNever 4.701

RunOrderIT

testReverseAlphabetical 5.014
testNonExistingRunOrder 3.969
testHourly 5.308
testAlphabetical 5.562

RunOrderParallelForksIT

testReverseAlphabetical 6.04
testNonExistingRunOrder 4.091
testHourly 5.216
testAlphabetical 5.667

SiblingAggregatorIT

testSiblingAggregator 5.95

SmartStackTraceIT

misg 4.866

SystemPropertiesTestIT

testSystemProperties 5.973
testSystemPropertiesNoFork 5.003

TestMethodPatternIT

testJUnit48WithCategoryFilter 5.354
testJUnit48Provider47 6.338
testMethodPatternAfter 5.985
testTestNGMethodPattern 6.358
testJUnit48Provider4 5.789
testJUnit44 5.833
testTestNgMethodBefore 6.269

TestMultipleMethodPatternsIT

shouldNotRunExcludedClassesAndMethods[0] 5.232
shouldMatchExactClassAndMethodCharacters[0] 3.971
shouldMatchExactClassAndMethodWildcard[0] 3.999
testSuccessTwo[0] 4.097
simpleNameTest[0] 3.941
simpleNameTestWithJavaExt[0] 3.972
regexClass[0] 3.969
shouldNotRunExcludedClasses[0] 4.057
shouldNotRunExcludedMethods[0] 4.025
simpleNameTestWithJavaExtWildcardPkg[0] 3.941
shouldMatchMultiplePatterns[0] 4.109
shouldMatchExactClassAndMethodsPostfix[0] 3.968
simpleNameTestWithWildcardPkg[0] 4.019
shouldMatchWildcardPackageAndClassAndMethod[0] 3.962
shouldMatchExactClassAndMultipleMethods[0] 3.967
fullyQualifiedTest[0] 3.944
matchSimpleClassAndMethodWithJavaExtWildcardPkg[0] 4.041
negativeTest[0]
+ [ Detail ]
 0.001
skipped
testRegexSuccessTwo[0] 4.136
shouldMatchExactClassAndMethodsWildcard[0] 4.036
shouldMatchMultiplePatternsComplex[0] 4.027
simpleNameTestAsParallel[0]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithWildcardPkg[0] 4.009
shouldMatchMultiplePatternsAsParallel[0]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[0] 4.082
shouldMatchSimpleClassNameAndMethod[0] 4.06
shouldMatchExactClassAndMethodPostfix[0] 4.079
shouldMatchMultiplePatternsComplexAsParallel[0]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[0] 4.061
regexClassAndMethod[0] 3.964
shouldNotRunExcludedClassesAndMethods[1] 4.52
shouldMatchExactClassAndMethodCharacters[1] 4.39
shouldMatchExactClassAndMethodWildcard[1] 4.306
testSuccessTwo[1] 4.43
simpleNameTest[1] 4.476
simpleNameTestWithJavaExt[1] 4.4
regexClass[1] 4.342
shouldNotRunExcludedClasses[1] 4.416
shouldNotRunExcludedMethods[1] 4.468
simpleNameTestWithJavaExtWildcardPkg[1] 4.37
shouldMatchMultiplePatterns[1] 4.641
shouldMatchExactClassAndMethodsPostfix[1] 4.399
simpleNameTestWithWildcardPkg[1] 4.353
shouldMatchWildcardPackageAndClassAndMethod[1] 4.42
shouldMatchExactClassAndMultipleMethods[1] 4.339
fullyQualifiedTest[1] 4.466
matchSimpleClassAndMethodWithJavaExtWildcardPkg[1] 4.337
negativeTest[1]
+ [ Detail ]
 0
skipped
testRegexSuccessTwo[1] 4.455
shouldMatchExactClassAndMethodsWildcard[1] 4.499
shouldMatchMultiplePatternsComplex[1] 4.483
simpleNameTestAsParallel[1] 4.426
matchSimpleClassAndMethodWithWildcardPkg[1] 4.342
shouldMatchMultiplePatternsAsParallel[1] 4.503
shouldNotRunExcludedClassesIfIncluded[1] 4.469
shouldMatchSimpleClassNameAndMethod[1] 4.411
shouldMatchExactClassAndMethodPostfix[1] 4.449
shouldMatchMultiplePatternsComplexAsParallel[1] 4.594
matchSimpleClassAndMethodWithJavaExt[1] 4.438
regexClassAndMethod[1] 4.644
shouldNotRunExcludedClassesAndMethods[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[2]
+ [ Detail ]
 0
skipped
testSuccessTwo[2]
+ [ Detail ]
 0
skipped
simpleNameTest[2] 3.976
simpleNameTestWithJavaExt[2] 4.046
regexClass[2] 3.969
shouldNotRunExcludedClasses[2] 3.982
shouldNotRunExcludedMethods[2]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[2] 3.909
shouldMatchMultiplePatterns[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[2]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[2] 3.985
shouldMatchWildcardPackageAndClassAndMethod[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[2]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[2] 3.864
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2]
+ [ Detail ]
 0
skipped
negativeTest[2] 3.692
testRegexSuccessTwo[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[2]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[2]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithWildcardPkg[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[2]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[2] 4.044
shouldMatchSimpleClassNameAndMethod[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[2]
+ [ Detail ]
 0.001
skipped
matchSimpleClassAndMethodWithJavaExt[2]
+ [ Detail ]
 0
skipped
regexClassAndMethod[2]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesAndMethods[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[3]
+ [ Detail ]
 0
skipped
testSuccessTwo[3]
+ [ Detail ]
 0
skipped
simpleNameTest[3] 4.437
simpleNameTestWithJavaExt[3] 4.392
regexClass[3] 4.347
shouldNotRunExcludedClasses[3] 4.4
shouldNotRunExcludedMethods[3]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[3] 4.386
shouldMatchMultiplePatterns[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[3]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[3] 4.336
shouldMatchWildcardPackageAndClassAndMethod[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[3]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[3] 4.393
matchSimpleClassAndMethodWithJavaExtWildcardPkg[3]
+ [ Detail ]
 0
skipped
negativeTest[3] 3.805
testRegexSuccessTwo[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[3]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[3]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[3] 4.408
matchSimpleClassAndMethodWithWildcardPkg[3]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[3]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[3] 4.308
shouldMatchSimpleClassNameAndMethod[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[3]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[3]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[3]
+ [ Detail ]
 0
skipped
regexClassAndMethod[3]
+ [ Detail ]
 0.001
skipped
shouldNotRunExcludedClassesAndMethods[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[4]
+ [ Detail ]
 0
skipped
testSuccessTwo[4]
+ [ Detail ]
 0
skipped
simpleNameTest[4] 4.029
simpleNameTestWithJavaExt[4] 3.975
regexClass[4] 3.962
shouldNotRunExcludedClasses[4] 3.962
shouldNotRunExcludedMethods[4]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[4] 3.878
shouldMatchMultiplePatterns[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[4]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[4] 3.975
shouldMatchWildcardPackageAndClassAndMethod[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[4]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[4] 4.041
matchSimpleClassAndMethodWithJavaExtWildcardPkg[4]
+ [ Detail ]
 0
skipped
negativeTest[4] 3.585
testRegexSuccessTwo[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[4]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[4]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[4]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithWildcardPkg[4]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[4]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[4] 4.037
shouldMatchSimpleClassNameAndMethod[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[4]
+ [ Detail ]
 0.001
skipped
shouldMatchMultiplePatternsComplexAsParallel[4]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[4]
+ [ Detail ]
 0
skipped
regexClassAndMethod[4]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesAndMethods[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[5]
+ [ Detail ]
 0
skipped
testSuccessTwo[5]
+ [ Detail ]
 0
skipped
simpleNameTest[5] 4.319
simpleNameTestWithJavaExt[5] 4.396
regexClass[5] 4.251
shouldNotRunExcludedClasses[5] 4.408
shouldNotRunExcludedMethods[5]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[5] 4.371
shouldMatchMultiplePatterns[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[5]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[5] 4.367
shouldMatchWildcardPackageAndClassAndMethod[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[5]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[5] 4.495
matchSimpleClassAndMethodWithJavaExtWildcardPkg[5]
+ [ Detail ]
 0
skipped
negativeTest[5] 3.758
testRegexSuccessTwo[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[5]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[5]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[5] 4.373
matchSimpleClassAndMethodWithWildcardPkg[5]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[5]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[5] 4.423
shouldMatchSimpleClassNameAndMethod[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[5]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[5]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[5]
+ [ Detail ]
 0
skipped
regexClassAndMethod[5]
+ [ Detail ]
 0
skipped

TestMultipleMethodPatternsTestNGIT

shouldNotRunExcludedClassesAndMethods[0] 4.313
shouldMatchExactClassAndMethodCharacters[0] 4.323
shouldMatchExactClassAndMethodWildcard[0] 4.269
testSuccessTwo[0] 4.382
simpleNameTest[0] 4.257
simpleNameTestWithJavaExt[0] 4.227
regexClass[0] 4.21
shouldNotRunExcludedClasses[0] 4.252
shouldNotRunExcludedMethods[0] 4.306
simpleNameTestWithJavaExtWildcardPkg[0] 4.253
shouldMatchMultiplePatterns[0] 4.331
shouldMatchExactClassAndMethodsPostfix[0] 4.269
simpleNameTestWithWildcardPkg[0] 4.203
shouldMatchWildcardPackageAndClassAndMethod[0] 4.255
shouldMatchExactClassAndMultipleMethods[0] 4.193
fullyQualifiedTest[0] 4.251
matchSimpleClassAndMethodWithJavaExtWildcardPkg[0] 4.218
negativeTest[0]
+ [ Detail ]
 0
skipped
testRegexSuccessTwo[0] 4.259
shouldMatchExactClassAndMethodsWildcard[0] 4.234
shouldMatchMultiplePatternsComplex[0] 4.335
simpleNameTestAsParallel[0] 4.199
matchSimpleClassAndMethodWithWildcardPkg[0] 4.241
shouldMatchMultiplePatternsAsParallel[0] 4.361
shouldNotRunExcludedClassesIfIncluded[0] 4.134
shouldMatchSimpleClassNameAndMethod[0] 4.229
shouldMatchExactClassAndMethodPostfix[0] 4.249
shouldMatchMultiplePatternsComplexAsParallel[0] 4.337
matchSimpleClassAndMethodWithJavaExt[0] 4.18
regexClassAndMethod[0] 4.211
shouldNotRunExcludedClassesAndMethods[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[1]
+ [ Detail ]
 0
skipped
testSuccessTwo[1]
+ [ Detail ]
 0
skipped
simpleNameTest[1] 4.258
simpleNameTestWithJavaExt[1] 4.259
regexClass[1] 4.198
shouldNotRunExcludedClasses[1] 4.267
shouldNotRunExcludedMethods[1]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[1] 4.173
shouldMatchMultiplePatterns[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[1]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[1] 4.195
shouldMatchWildcardPackageAndClassAndMethod[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[1]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[1] 4.29
matchSimpleClassAndMethodWithJavaExtWildcardPkg[1]
+ [ Detail ]
 0
skipped
negativeTest[1] 3.691
testRegexSuccessTwo[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[1]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[1]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[1] 4.169
matchSimpleClassAndMethodWithWildcardPkg[1]
+ [ Detail ]
 0.001
skipped
shouldMatchMultiplePatternsAsParallel[1]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[1] 4.201
shouldMatchSimpleClassNameAndMethod[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[1]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[1]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[1]
+ [ Detail ]
 0
skipped
regexClassAndMethod[1]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesAndMethods[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[2]
+ [ Detail ]
 0
skipped
testSuccessTwo[2]
+ [ Detail ]
 0
skipped
simpleNameTest[2] 4.311
simpleNameTestWithJavaExt[2] 4.263
regexClass[2] 4.246
shouldNotRunExcludedClasses[2] 4.22
shouldNotRunExcludedMethods[2]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[2] 4.235
shouldMatchMultiplePatterns[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[2]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[2] 4.231
shouldMatchWildcardPackageAndClassAndMethod[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[2]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[2] 4.174
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2]
+ [ Detail ]
 0
skipped
negativeTest[2] 3.805
testRegexSuccessTwo[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[2]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[2] 4.438
matchSimpleClassAndMethodWithWildcardPkg[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[2]
+ [ Detail ]
 0.001
skipped
shouldNotRunExcludedClassesIfIncluded[2] 4.208
shouldMatchSimpleClassNameAndMethod[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[2]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[2]
+ [ Detail ]
 0.001
skipped
regexClassAndMethod[2]
+ [ Detail ]
 0
skipped

TestMultipleMethodsIT

testJunit48Provider4 5.217
testJunit44 4.51
testJunit48Provider47 5.565

TestNgGroupsIT

testExclusion 7.519
testGroupsAndExclusion 6.664
groupsWithDash 6.507
testOnlyGroups 6.61
groupsBySimpleRegex 6.603

TestNgParallelWithAnnotationsIT

testTestNgGroupThreadParallel 7.495

TestNgSuccessPercentageIT

testPassesWhenFailuresLessThanSuccessPercentage 4.79

TestSingleMethodIT

fullyQualifiedTestNg 5.448
testJunit48Provider4 5.875
testJunit44 5.582
testJunit48parallel 6.054
testJunit48Provider47 6.302
fullyQualifiedJunit48Provider47 6.446
fullyQualifiedJunit48Provider4 5.906
testTestNg5149 6.11
testTestNg 6.395

TimeoutForkedTestIT

testTimeoutForked 6.856

TwoTestCasesIT

testJunit4Suite 5.623
testTestNGSuite 6.201
testTwoTestCases 5.778
testTwoTestCaseSuite 5.607

UmlautDirIT

testUmlautIsolatedClassLoader 7.832
testUmlaut 5.857

UnicodeTestNamesIT

checkFileNamesWithUnicode 7.7

UseIsolatedClassLoaderIT

testUseSystemClassLoader 5.668

WorkingDirectoryIsInvalidPropertyIT

testWorkingDirectory 4.052

WorkingDirectoryIT

testWorkingDirectory 5.959
testWorkingDirectoryChildOnlyNoFork 4.664
testWorkingDirectoryNoFork 3.952
testWorkingDirectoryChildOnly 5.032

WorkingDirectoryMissingIT

testWorkingDirectory 5.171

XmlReporterRunTimeIT

testForkModeAlways 24.806

Failure Details

[Summary] [Package List] [Test Cases]


suiteXmlForkModeAlways
skipped: Fails - see SUREFIRE-1123
XXXtest50
skipped: 5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
XXXtest501
skipped: 5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
twoSpecifiedTestExecutionsInCorrectExecutionBlocks
skipped: since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
singleTestInOneExecutionOfMultiExecutionProject
skipped: since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
negativeTest[0]
skipped: skipped
simpleNameTestAsParallel[0]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[0]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[0]
skipped: skipped
negativeTest[1]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[2]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[2]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[2]
skipped: skipped
testSuccessTwo[2]
skipped: skipped
shouldNotRunExcludedMethods[2]
skipped: skipped
shouldMatchMultiplePatterns[2]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[2]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[2]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2]
skipped: skipped
testRegexSuccessTwo[2]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[2]
skipped: skipped
shouldMatchMultiplePatternsComplex[2]
skipped: skipped
simpleNameTestAsParallel[2]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[2]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[2]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[2]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[2]
skipped: skipped
regexClassAndMethod[2]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[3]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[3]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[3]
skipped: skipped
testSuccessTwo[3]
skipped: skipped
shouldNotRunExcludedMethods[3]
skipped: skipped
shouldMatchMultiplePatterns[3]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[3]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[3]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[3]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[3]
skipped: skipped
testRegexSuccessTwo[3]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[3]
skipped: skipped
shouldMatchMultiplePatternsComplex[3]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[3]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[3]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[3]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[3]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[3]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[3]
skipped: skipped
regexClassAndMethod[3]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[4]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[4]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[4]
skipped: skipped
testSuccessTwo[4]
skipped: skipped
shouldNotRunExcludedMethods[4]
skipped: skipped
shouldMatchMultiplePatterns[4]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[4]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[4]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[4]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[4]
skipped: skipped
testRegexSuccessTwo[4]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[4]
skipped: skipped
shouldMatchMultiplePatternsComplex[4]
skipped: skipped
simpleNameTestAsParallel[4]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[4]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[4]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[4]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[4]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[4]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[4]
skipped: skipped
regexClassAndMethod[4]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[5]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[5]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[5]
skipped: skipped
testSuccessTwo[5]
skipped: skipped
shouldNotRunExcludedMethods[5]
skipped: skipped
shouldMatchMultiplePatterns[5]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[5]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[5]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[5]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[5]
skipped: skipped
testRegexSuccessTwo[5]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[5]
skipped: skipped
shouldMatchMultiplePatternsComplex[5]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[5]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[5]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[5]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[5]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[5]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[5]
skipped: skipped
regexClassAndMethod[5]
skipped: skipped
negativeTest[0]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[1]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[1]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[1]
skipped: skipped
testSuccessTwo[1]
skipped: skipped
shouldNotRunExcludedMethods[1]
skipped: skipped
shouldMatchMultiplePatterns[1]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[1]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[1]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[1]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[1]
skipped: skipped
testRegexSuccessTwo[1]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[1]
skipped: skipped
shouldMatchMultiplePatternsComplex[1]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[1]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[1]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[1]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[1]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[1]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[1]
skipped: skipped
regexClassAndMethod[1]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[2]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[2]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[2]
skipped: skipped
testSuccessTwo[2]
skipped: skipped
shouldNotRunExcludedMethods[2]
skipped: skipped
shouldMatchMultiplePatterns[2]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[2]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[2]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2]
skipped: skipped
testRegexSuccessTwo[2]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[2]
skipped: skipped
shouldMatchMultiplePatternsComplex[2]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[2]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[2]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[2]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[2]
skipped: skipped
regexClassAndMethod[2]
skipped: skipped