Fork me on GitHub

Surefire Report

Summary

[Summary] [Package List] [Test Cases]


Tests Errors Failures Skipped Success Rate Time
742 0 0 140 81.132% 3,356.926

Note: failures are anticipated and checked for with assertions while errors are unanticipated.


Package List

[Summary] [Package List] [Test Cases]


Package Tests Errors Failures Skipped Success Rate Time
org.apache.maven.surefire.its 575 0 0 134 76.696% 2,288.886
org.apache.maven.surefire.its.jiras 167 0 0 6 96.407% 1,068.04

Note: package statistics are not computed recursively, they only sum up all of its testsuites numbers.

org.apache.maven.surefire.its

Class Tests Errors Failures Skipped Success Rate Time
AbstractTestCaseIT 1 0 0 0 100% 4.982
AdditionalClasspathIT 1 0 0 0 100% 3.075
AggregateReportIT 1 0 0 0 100% 7.104
ArgLineIT 1 0 0 0 100% 3.818
ArgLinePropertiesIT 1 0 0 0 100% 5.18
AssumptionFailureReportIT 1 0 0 0 100% 3.027
CheckSingleTestIT 4 0 0 0 100% 12.64
CheckTestFailIfNoTestsForkModeIT 6 0 0 0 100% 19.847
CheckTestFailIfNoTestsIT 3 0 0 0 100% 6.856
CheckTestNgBeforeMethodFailureIT 1 0 0 0 100% 4.196
CheckTestNgBeforeMethodIT 1 0 0 0 100% 4.18
CheckTestNgCustomObjectFactoryIT 1 0 0 0 100% 3.173
CheckTestNgCustomTestRunnerFactoryIT 1 0 0 0 100% 3.552
CheckTestNgExecuteErrorIT 1 0 0 0 100% 4.047
CheckTestNgGroupThreadParallelIT 1 0 0 0 100% 3.414
CheckTestNgJdk14IT 1 0 0 0 100% 4.298
CheckTestNgListenerReporterIT 8 0 0 0 100% 39.332
CheckTestNgListenersIT 1 0 0 0 100% 7.348
CheckTestNgPathWithSpacesIT 1 0 0 0 100% 4.383
CheckTestNgReportTestIT 3 0 0 0 100% 17.493
CheckTestNgSuiteXmlIT 3 0 0 1 66.667% 11.618
CheckTestNgSuiteXmlSingleIT 1 0 0 0 100% 4.718
CheckTestNgVersionsIT 20 0 0 2 90% 88.635
ClasspathFilteringIT 1 0 0 0 100% 3.486
ClassPathOrderIT 1 0 0 0 100% 5.513
ClasspathScopeFilteringIT 1 0 0 0 100% 3.178
ConsoleOutputIT 4 0 0 0 100% 24.429
CrashDetectionIT 3 0 0 0 100% 12.036
DefaultConfigurationIT 1 0 0 0 100% 3.121
EnvironmentVariableIT 1 0 0 0 100% 4.526
EnvironmentVariablesIT 2 0 0 0 100% 8.584
FailFastJUnitIT 12 0 0 0 100% 130.001
FailFastTestNgIT 6 0 0 0 100% 65.115
ForkConsoleOutputIT 4 0 0 0 100% 18.873
ForkConsoleOutputWithErrorsIT 1 0 0 0 100% 4.387
ForkModeIT 12 0 0 0 100% 64.117
ForkModeMultiModuleIT 4 0 0 0 100% 29.425
ForkModeTestNGIT 12 0 0 0 100% 72.426
IncludesExcludesFromFileIT 6 0 0 0 100% 22.353
IncludesExcludesIT 3 0 0 0 100% 13.093
Java9FullApiIT 3 0 0 3 0% 0.008
JUnit44HamcrestIT 1 0 0 0 100% 4.896
JUnit47ConcurrencyIT 1 0 0 0 100% 4.632
JUnit47ParallelIT 59 0 0 0 100% 325.179
JUnit47ParallelNotThreadSafeIT 1 0 0 0 100% 5.37
JUnit47RedirectOutputIT 2 0 0 0 100% 10.243
JUnit47StaticInnerClassTestsIT 1 0 0 0 100% 3.719
JUnit47WithCucumberIT 2 0 0 0 100% 10.149
JUnit48TestCategoriesIT 4 0 0 0 100% 20.702
JUnit4ForkAlwaysStaticInitPollutionIT 1 0 0 0 100% 5.83
JUnit4IgnoreIT 2 0 0 0 100% 10.763
JUnit4RerunFailingTestsIT 5 0 0 0 100% 91.439
JUnit4RunListenerIT 2 0 0 0 100% 9.284
JUnit4VersionsIT 16 0 0 0 100% 83.599
JUnitDepIT 4 0 0 0 100% 19.86
LongWindowsPathIT 1 0 0 0 100% 4.318
NoRunnableTestsInClassIT 1 0 0 0 100% 4.879
PlainOldJavaClasspathIT 1 0 0 0 100% 4.915
PlexusConflictIT 2 0 0 0 100% 9.86
PojoSimpleIT 1 0 0 0 100% 5.074
ReportersIT 1 0 0 0 100% 5.343
ResultCountingIT 3 0 0 0 100% 18.979
RunOrderIT 4 0 0 0 100% 16.554
RunOrderParallelForksIT 4 0 0 0 100% 16.346
SiblingAggregatorIT 1 0 0 0 100% 4.46
SmartStackTraceIT 1 0 0 0 100% 4.179
SystemPropertiesTestIT 2 0 0 0 100% 8.248
TestMethodPatternIT 7 0 0 0 100% 33.49
TestMultipleMethodPatternsIT 180 0 0 87 51.667% 386.337
TestMultipleMethodPatternsTestNGIT 90 0 0 41 54.444% 213.291
TestMultipleMethodsIT 3 0 0 0 100% 14.961
TestNgGroupsIT 5 0 0 0 100% 31.002
TestNgParallelWithAnnotationsIT 1 0 0 0 100% 5.947
TestNgSuccessPercentageIT 1 0 0 0 100% 4.21
TestSingleMethodIT 9 0 0 0 100% 44.423
TimeoutForkedTestIT 1 0 0 0 100% 5.7
TwoTestCasesIT 4 0 0 0 100% 20.037
UmlautDirIT 2 0 0 0 100% 9.765
UnicodeTestNamesIT 1 0 0 0 100% 4.628
UseIsolatedClassLoaderIT 1 0 0 0 100% 4.725
WorkingDirectoryIsInvalidPropertyIT 1 0 0 0 100% 3.506
WorkingDirectoryIT 4 0 0 0 100% 17.518
WorkingDirectoryMissingIT 1 0 0 0 100% 5.042
XmlReporterRunTimeIT 1 0 0 0 100% 23.897

org.apache.maven.surefire.its.jiras

Class Tests Errors Failures Skipped Success Rate Time
Surefire1024VerifyFailsafeIfTestedIT 1 0 0 0 100% 4.164
Surefire1028UnableToRunSingleIT 1 0 0 0 100% 4.176
Surefire1036NonFilterableJUnitRunnerWithCategoriesIT 1 0 0 0 100% 5.519
Surefire1041FailingJUnitRunnerIT 1 0 0 0 100% 5.201
Surefire1053SystemPropertiesIT 2 0 0 0 100% 9.575
Surefire1055CorrectConcurrentTestCountIT 1 0 0 0 100% 5.248
Surefire1080ParallelForkDoubleTestIT 1 0 0 0 100% 5.598
Surefire1082ParallelJUnitParameterizedIT 3 0 0 0 100% 19.146
Surefire1098BalancedRunOrderIT 1 0 0 0 100% 26.021
Surefire1122ParallelAndFlakyTestsIT 2 0 0 0 100% 8.361
Surefire1135ImproveIgnoreMessageForTestNGIT 2 0 0 0 100% 13.178
Surefire1136CwdPropagationInForkedModeIT 1 0 0 0 100% 5.038
Surefire1144XmlRunTimeIT 1 0 0 0 100% 5.241
Surefire1152RerunFailingTestsInSuiteIT 2 0 0 0 100% 9.462
Surefire1153IncludesAndSpecifiedTestIT 2 0 0 0 100% 7.653
Surefire1158RemoveInfoLinesIT 6 0 0 0 100% 34.613
Surefire1177TestngParallelSuitesIT 1 0 0 0 100% 7.753
Surefire1179IT 1 0 0 0 100% 9.103
Surefire1185DoNotSpawnTestsIT 1 0 0 0 100% 3.804
Surefire1202RerunAndSkipIT 2 0 0 0 100% 35.209
Surefire1209RerunAndForkCountIT 4 0 0 0 100% 52.529
Surefire1211JUnitTestNgIT 2 0 0 0 100% 12.187
Surefire1264IT 2 0 0 0 100% 13.959
Surefire1265Java9IT 1 0 0 1 0% 0.004
Surefire1278GroupNameEndingIT 1 0 0 0 100% 6.633
Surefire1295AttributeJvmCrashesToTestsIT 3 0 0 3 0% 0.006
Surefire1364SystemPropertiesIT 10 0 0 0 100% 54.534
Surefire1367AssumptionLogsIT 4 0 0 0 100% 18.057
Surefire1396CustomProviderClassPathIT 1 0 0 0 100% 7.915
Surefire141PluggableProvidersIT 4 0 0 0 100% 25.109
Surefire146ForkPerTestNoSetupIT 1 0 0 0 100% 4.869
Surefire162CharsetProviderIT 1 0 0 0 100% 4.918
Surefire224WellFormedXmlFailuresIT 1 0 0 0 100% 4.78
Surefire257NotRerunningTestsIT 1 0 0 0 100% 7.896
Surefire260TestWithIdenticalNamesIT 1 0 0 0 100% 12.823
Surefire34SecurityManagerIT 2 0 0 0 100% 11.159
Surefire376TestNgAfterSuiteFailureIT 1 0 0 0 100% 5.806
Surefire377TestNgAndJUnitTogetherIT 2 0 0 0 100% 10.52
Surefire408ManualProviderSelectionIT 1 0 0 0 100% 5.028
Surefire42NotExtendingTestCaseIT 1 0 0 0 100% 4.651
Surefire44InnerClassTestIT 1 0 0 0 100% 5.497
Surefire500PuzzlingErrorIT 1 0 0 0 100% 5.431
Surefire510TestClassPathForkModesIT 2 0 0 0 100% 10.817
Surefire569RunTestFromDependencyJarsIT 1 0 0 0 100% 6.767
Surefire570MultipleReportDirectoriesIT 2 0 0 0 100% 31.312
Surefire613TestCountInParallelIT 1 0 0 0 100% 6.593
Surefire621TestCountingJunit3InParallelIT 5 0 0 0 100% 33.429
Surefire628ConsoleOutputBeforeAndAfterClassIT 1 0 0 0 100% 6.06
Surefire634UnsettableSystemPropertiesWarningIT 1 0 0 0 100% 6.279
Surefire649EmptyStringSystemPropertiesIT 2 0 0 0 100% 8.565
Surefire673MockitoIT 1 0 0 0 100% 6.338
Surefire674BuildFailingWhenErrorsIT 1 0 0 0 100% 6.075
Surefire674BuildFailingWhenFailsafeErrorsIT 1 0 0 0 100% 7.157
Surefire685CommaSeparatedIncludesIT 1 0 0 0 100% 6.064
Surefire697NiceSummaryIT 1 0 0 0 100% 5.947
Surefire705ParallelForkTimeoutIT 1 0 0 0 100% 7.049
Surefire733AllOverrridesCapturedIT 1 0 0 0 100% 5.126
Surefire735ForkFailWithRedirectConsoleOutputIT 2 0 0 0 100% 9.48
Surefire740TruncatedCommaIT 1 0 0 0 100% 4.691
Surefire747MethodParallelWithSuiteCountIT 2 0 0 0 100% 21.943
Surefire772BothReportsIT 3 0 0 0 100% 11.827
Surefire772NoFailsafeReportsIT 4 0 0 0 100% 15.353
Surefire772NoSurefireReportsIT 4 0 0 0 100% 15.285
Surefire772SpecifiedReportsIT 3 0 0 0 100% 11.438
Surefire801ForkModeNoneClassLoaderIT 1 0 0 0 100% 4.334
Surefire803MultiFailsafeExecsIT 2 0 0 0 100% 21.527
Surefire806SpecifiedTestControlsIT 3 0 0 2 33.333% 5.806
Surefire809GroupExpressionsIT 6 0 0 0 100% 37.431
Surefire812Log4JClassLoaderIT 1 0 0 0 100% 5.807
Surefire817SystemExitIT 1 0 0 0 100% 5.867
Surefire818NpeIgnoresTestsIT 1 0 0 0 100% 6.836
Surefire828EmptyGroupExprIT 4 0 0 0 100% 24.441
Surefire832ProviderSelectionIT 1 0 0 0 100% 6.258
Surefire839TestWithoutCategoriesIT 2 0 0 0 100% 12.915
Surefire847AdditionalFailureIT 1 0 0 0 100% 6.205
Surefire855AllowFailsafeUseArtifactFileIT 4 0 0 0 100% 58.248
Surefire901MIssingResultfileWhenNoTestsIT 1 0 0 0 100% 5.024
Surefire907PerThreadWithoutThreadCountIT 1 0 0 0 100% 5.056
Surefire920TestFailureIgnoreWithTimeoutIT 2 0 0 0 100% 14.312
Surefire926FailureWith2ProvidersIT 1 0 0 0 100% 9.33
Surefire930TestNgSuiteXmlIT 1 0 0 0 100% 7.506
Surefire943ReportContentIT 2 0 0 0 100% 18.32
Surefire946KillMainProcessInReusableForkIT 3 0 0 0 100% 22.785
Surefire972BizarreNoClassDefIT 1 0 0 0 100% 8.267
Surefire975DefaultVMEncodingIT 1 0 0 0 100% 6.041
Surefire979WrongClassLoaderIT 1 0 0 0 100% 5.767
Surefire985ParameterizedRunnerAndCategoriesIT 1 0 0 0 100% 5.172
Surefire995CategoryInheritanceIT 5 0 0 0 100% 22.816

Test Cases

[Summary] [Package List] [Test Cases]

AbstractTestCaseIT

abstractTestCase 4.982

AdditionalClasspathIT

additionalClasspath 3.075

AggregateReportIT

aggregateReport 7.104

ArgLineIT

argLine 3.818

ArgLinePropertiesIT

argLine 5.18

AssumptionFailureReportIT

testWriteSkippedMessageToReport 3.027

CheckSingleTestIT

singleTestDotJava 3.061
singleTestNonExistentOverride 2.849
singleTestNonExistent 3.012
singleTest 3.718

CheckTestFailIfNoTestsForkModeIT

dontFailIfNoTestsForkModeAlways 3.624
failIfNoTestsForkModeOnce 3.54
dontFailIfNoTestsForkModeNever 3.518
dontFailIfNoTestsForkModeOnce 3.236
failIfNoTestsForkModeNever 2.95
failIfNoTestsForkModeAlways 2.979

CheckTestFailIfNoTestsIT

failIfNoTests 2.363
dontFailIfNoTests 2.204
jUnit48CategoriesFailWhenNoTests 2.289

CheckTestNgBeforeMethodFailureIT

TestNgBeforeMethodFailure 4.196

CheckTestNgBeforeMethodIT

TestNgBeforeMethod 4.18

CheckTestNgCustomObjectFactoryIT

testTestNgListenerReporter 3.173

CheckTestNgCustomTestRunnerFactoryIT

testTestNgListenerReporter 3.552

CheckTestNgExecuteErrorIT

executionError 4.047

CheckTestNgGroupThreadParallelIT

TestNgGroupThreadParallel 3.414

CheckTestNgJdk14IT

TestNgJdk14 4.298

CheckTestNgListenerReporterIT

testNgListenerReporter[0: TestNG 5.6] 4.199
testNgListenerReporter[1: TestNG 5.7] 4.306
testNgListenerReporter[2: TestNG 5.10] 4.178
testNgListenerReporter[3: TestNG 5.13] 4.339
testNgListenerReporter[4: TestNG 5.14.6] 5.075
testNgListenerReporter[5: TestNG 5.14.9] 4.373
testNgListenerReporter[6: TestNG 6.0] 5.16
testNgListenerReporter[7: TestNG 6.9.9] 7.702

CheckTestNgListenersIT

TestNgListenerReporter 7.348

CheckTestNgPathWithSpacesIT

TestWithSpaces 4.383

CheckTestNgReportTestIT

testNgReport 6.047
shouldNotBeVerbose 5.006
shouldBeVerbose 6.44

CheckTestNgSuiteXmlIT

suiteXml 6.493
suiteXmlForkCountTwoReuse 5.125
suiteXmlForkModeAlways
+ [ Detail ]
 0
Fails - see SUREFIRE-1123

CheckTestNgSuiteXmlSingleIT

TestNgSuite 4.718

CheckTestNgVersionsIT

XXXtest50
+ [ Detail ]
 0
5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
test502 4.615
test510 4.277
test511 5.242
test512 5.013
test513 5.993
test514 5.396
test685 6.206
test5131 4.497
test5141 4.793
test5142 4.734
test47 4.449
test51 4.399
test55 4.539
test56 4.56
test57 4.806
test58 4.758
test59 5.256
test60 5.102
XXXtest501
+ [ Detail ]
 0
5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024

ClasspathFilteringIT

additionalClasspath 3.486

ClassPathOrderIT

classPathOrder 5.513

ClasspathScopeFilteringIT

additionalClasspath 3.178

ConsoleOutputIT

properNewlinesAndEncodingWithDifferentEncoding 4.717
properNewlinesAndEncodingWithDefaultEncodings 4.167
largerSoutThanMemory 12.34
properNewlinesAndEncodingWithoutFork 3.205

CrashDetectionIT

hardCrashInReusableFork 4.08
crashInReusableFork 3.943
crashInFork 4.013

DefaultConfigurationIT

defaultConfiguration 3.121

EnvironmentVariableIT

environmentVariable 4.526

EnvironmentVariablesIT

testWhenUseSystemClassLoader 4.431
testWhenDontUseSystemClassLoader 4.153

FailFastJUnitIT

test[junit4-oneFork-ff1] 6.606
test[junit47-oneFork-ff1] 6.823
test[junit4-oneFork-ff2] 9.909
test[junit47-oneFork-ff2] 10.79
test[junit4-twoForks-ff1] 8.648
test[junit47-twoForks-ff1] 8.627
test[junit4-twoForks-ff2] 9.907
test[junit47-twoForks-ff2] 9.687
test[junit4-oneFork-ff3] 16.84
test[junit47-oneFork-ff3] 17.151
test[junit4-twoForks-ff3] 12.654
test[junit47-twoForks-ff3] 12.359

FailFastTestNgIT

test[testng-oneFork-ff1] 5.677
test[testng-oneFork-ff2] 9.678
test[testng-twoForks-ff1] 8.449
test[testng-twoForks-ff2] 10.048
test[testng-oneFork-ff3] 17.409
test[testng-twoForks-ff3] 13.854

ForkConsoleOutputIT

printSummaryTrueWithRedirect 4.644
printSummaryFalseWithoutRedirect 5.181
printSummaryTrueWithoutRedirect 4.642
printSummaryFalseWithRedirect 4.406

ForkConsoleOutputWithErrorsIT

xmlFileContainsConsoleOutput 4.387

ForkModeIT

testForkModeOncePerThreadSingleThread 5.906
testForkModePerTest 6.063
testForkCountZero 3.934
testForkCountOneNoReuse 6.087
testForkCountTwoNoReuse 5.506
testForkModeNever 4.022
testForkCountTwoReuse 5.453
testForkCountOneReuse 5.123
testForkModeOncePerThreadTwoThreads 5.837
testForkModeAlways 6.685
testForkModeNone 4.25
testForkModeOnce 5.251

ForkModeMultiModuleIT

testForkCountOneNoReuse 9.13
testForkCountTwoNoReuse 6.593
testForkCountTwoReuse 6.532
testForkCountOneReuse 7.17

ForkModeTestNGIT

testForkModeOncePerThreadSingleThread 5.192
testForkModePerTest 6.855
testForkCountZero 5.182
testForkCountOneNoReuse 7.695
testForkCountTwoNoReuse 6.381
testForkModeNever 4.299
testForkCountTwoReuse 6.343
testForkCountOneReuse 5.815
testForkModeOncePerThreadTwoThreads 6.527
testForkModeAlways 7.62
testForkModeNone 4.991
testForkModeOnce 5.526

IncludesExcludesFromFileIT

testSimpleMixed 4.23
testMissingExcludes 3.08
testRegex 3.993
testPath 4.111
testMissingIncludes 2.981
testSimple 3.958

IncludesExcludesIT

testPathBasedIncludesExcludes 4.12
testIncludesExcludes 4.546
testRegexIncludesExcludes 4.427

Java9FullApiIT

shouldLoadMultipleJavaModules_JavaHome
+ [ Detail ]
 0.008
skipped
shouldLoadMultipleJavaModules_ToolchainsXML
+ [ Detail ]
 0
skipped
shouldLoadMultipleJavaModules_JvmParameter
+ [ Detail ]
 0
skipped

Surefire1024VerifyFailsafeIfTestedIT

shouldScanAndRunTestsInDependencyJars 4.164

Surefire1028UnableToRunSingleIT

methodFilteringParallelExecution 4.176

Surefire1036NonFilterableJUnitRunnerWithCategoriesIT

test 5.519

Surefire1041FailingJUnitRunnerIT

reportErrorInJUnitRunnerAsTestError 5.201

Surefire1053SystemPropertiesIT

checkWarningsSysPropTwice 4.766
checkWarningsFileEncoding 4.809

Surefire1055CorrectConcurrentTestCountIT

testTestNgAndJUnitTogether 5.248

Surefire1080ParallelForkDoubleTestIT

test 5.598

Surefire1082ParallelJUnitParameterizedIT

checkClassesRunParallel 6.262
shouldRunTwo 6.824
checkOutFileClassesRunParallel 6.06

Surefire1098BalancedRunOrderIT

reorderedParallelClasses 26.021

Surefire1122ParallelAndFlakyTestsIT

nonParallelCreatesCorrectReport 4.771
parallelCreatesCorrectReport 3.59

Surefire1135ImproveIgnoreMessageForTestNGIT

testNgReport57 6.567
testNgReport688 6.611

Surefire1136CwdPropagationInForkedModeIT

testTestNgAndJUnitTogether 5.038

Surefire1144XmlRunTimeIT

testXmlRunTime 5.241

Surefire1152RerunFailingTestsInSuiteIT

testJUnit48Provider47 5.045
testJUnit48Provider4 4.417

Surefire1153IncludesAndSpecifiedTestIT

testSpecifiedTestInIncludes 3.903
testSpecifiedTestNotInIncludes 3.75

Surefire1158RemoveInfoLinesIT

shouldRunWithCliOption[junit-option-ff] 6.072
shouldRunWithCliOption[testng-option-ff] 5.891
shouldRunWithCliOption[junit-option-X] 6.229
shouldRunWithCliOption[testng-option-X] 5.754
shouldRunWithCliOption[junit-option-e] 5.582
shouldRunWithCliOption[testng-option-e] 5.085

Surefire1177TestngParallelSuitesIT

shouldRunTwoSuitesInParallel 7.753

Surefire1179IT

suiteXmlForkCountTwoReuse 9.103

Surefire1185DoNotSpawnTestsIT

doNotSpawnUnwantedTests 3.804

Surefire1202RerunAndSkipIT

junit47 17.758
junit4 17.451

Surefire1209RerunAndForkCountIT

notReusableForksJUnit47 13.565
reusableForksJUnit47 13.148
reusableForksJUnit4 12.457
notReusableForksJUnit4 13.359

Surefire1211JUnitTestNgIT

withoutJUnit 6.519
withJUnit 5.668

Surefire1264IT

positiveTests 6.773
negativeTests 7.186

Surefire1265Java9IT

shouldRunInPluginJava9
+ [ Detail ]
 0.004
skipped

Surefire1278GroupNameEndingIT

testOnlyGroups 6.633

Surefire1295AttributeJvmCrashesToTestsIT

crashInSingleUseFork
+ [ Detail ]
 0.005
skipped
crashInReusableFork
+ [ Detail ]
 0
skipped
crashInFork
+ [ Detail ]
 0.001
skipped

Surefire1364SystemPropertiesIT

junit47InProcessParallel 6.056
junit47Forked 5.417
junit47InProcess 5.112
testNg 6.193
junit3Forked 5.303
junit47ForkedParallel 5.468
junit4Forked 4.919
testNgInProcess 6.073
junit4InProcess 4.914
junit3InProcess 5.079

Surefire1367AssumptionLogsIT

shouldSeeLogsInPlugin 3.733
shouldSeeLogsParallelInPlugin 4.089
shouldSeeLogsParallelForked 5.288
shouldSeeLogsForked 4.947

Surefire1396CustomProviderClassPathIT

pluggableProviderClasspathCorrect 7.915

Surefire141PluggableProvidersIT

pluggableProviderPresent 6.208
invokeRuntimeException 6.208
invokeReporterException 6.395
constructorRuntimeException 6.298

Surefire146ForkPerTestNoSetupIT

testForkPerTestNoSetup 4.869

Surefire162CharsetProviderIT

testCharsetProvider 4.918

Surefire224WellFormedXmlFailuresIT

testWellFormedXmlFailures 4.78

Surefire257NotRerunningTestsIT

shouldNotRerun 7.896

Surefire260TestWithIdenticalNamesIT

testWithIdenticalNames 12.823

Surefire34SecurityManagerIT

testSecurityManager 5.554
testSecurityManagerSuccessful 5.605

Surefire376TestNgAfterSuiteFailureIT

testAfterSuiteFailure 5.806

Surefire377TestNgAndJUnitTogetherIT

testTestNgAndJUnit4Together 5.166
testTestNgAndJUnitTogether 5.354

Surefire408ManualProviderSelectionIT

testParallelBuildResultCount 5.028

Surefire42NotExtendingTestCaseIT

testInnerClass 4.651

Surefire44InnerClassTestIT

testInnerClass 5.497

Surefire500PuzzlingErrorIT

testBuildFailingWhenErrors 5.431

Surefire510TestClassPathForkModesIT

testForkOnce 5.493
testForkAlways 5.324

Surefire569RunTestFromDependencyJarsIT

shouldScanAndRunTestsInDependencyJars 6.767

Surefire570MultipleReportDirectoriesIT

testReportWithAggregate 16.237
testReportWithoutAggregate 15.075

Surefire613TestCountInParallelIT

testParallelBuildResultCount 6.593

Surefire621TestCountingJunit3InParallelIT

testJunit3ParallelBuildResultCount 6.825
testJunit3ParallelSuiteBuildResultCount 6.383
testJunit3AllParallelBuildResultCount 6.882
testJunit3BuildResultCount 6.072
testJunit3SuiteBuildResultCount 7.267

Surefire628ConsoleOutputBeforeAndAfterClassIT

testJunit3ParallelBuildResultCount 6.06

Surefire634UnsettableSystemPropertiesWarningIT

testJunit3ParallelBuildResultCount 6.279

Surefire649EmptyStringSystemPropertiesIT

systemPropertyVariables 4.01
systemProperties 4.555

Surefire673MockitoIT

testBuildFailingWhenErrors 6.338

Surefire674BuildFailingWhenErrorsIT

testBuildFailingWhenErrors 6.075

Surefire674BuildFailingWhenFailsafeErrorsIT

testBuildFailingWhenErrors 7.157

Surefire685CommaSeparatedIncludesIT

testBuildFailingWhenErrors 6.064

Surefire697NiceSummaryIT

testBuildFailingWhenErrors 5.947

Surefire705ParallelForkTimeoutIT

testTimeoutForked 7.049

Surefire733AllOverrridesCapturedIT

testLogOutput 5.126

Surefire735ForkFailWithRedirectConsoleOutputIT

vmStartFail 4.854
vmStartFailShouldFailBuildk 4.626

Surefire740TruncatedCommaIT

testRussianLocaleReport 4.691

Surefire747MethodParallelWithSuiteCountIT

testMethodsParallelWithSuite 9.879
testClassesParallelWithSuite 12.064

Surefire772BothReportsIT

testSkippedSurefireReportGeneration 3.76
testSkippedFailsafeReportGeneration 3.899
testReportGeneration 4.168

Surefire772NoFailsafeReportsIT

testSkippedFailsafeReportGeneration 4.091
testForcedFailsafeReportGeneration 3.724
testSkipForcedFailsafeReportGeneration 3.669
testReportGeneration 3.869

Surefire772NoSurefireReportsIT

testOptionalSurefireReportGeneration 4.366
testSkippedSurefireReportGeneration 3.564
testSkipOptionalSurefireReportGeneration 3.567
testReportGeneration 3.788

Surefire772SpecifiedReportsIT

testSkippedSurefireReportGeneration 3.9
testSkippedFailsafeReportGeneration 3.544
testReportGeneration 3.994

Surefire801ForkModeNoneClassLoaderIT

testSHouldBeOkWithForkNever 4.334

Surefire803MultiFailsafeExecsIT

testOneExecutionRunInTwoBuilds 13.463
testSecondExecutionRunsAfterFirstExecutionFails 8.064

Surefire806SpecifiedTestControlsIT

singleTestInSingleExecutionProject 5.806
twoSpecifiedTestExecutionsInCorrectExecutionBlocks
+ [ Detail ]
 0
since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
singleTestInOneExecutionOfMultiExecutionProject
+ [ Detail ]
 0
since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution

Surefire809GroupExpressionsIT

testNGRunCategoryAB 7.514
testExcludedGroups 6.634
testJUnitRunCategoryNotC 6.688
incorrectJUnitVersions 4.026
categoryAB 6.736
testNGRunCategoryNotC 5.833

Surefire812Log4JClassLoaderIT

testJunit3ParallelBuildResultCount 5.807

Surefire817SystemExitIT

systemExit1 5.867

Surefire818NpeIgnoresTestsIT

testBuildFailingWhenErrors 6.836

Surefire828EmptyGroupExprIT

testJUnitRunEmptyExcludeGroups 6.066
testJUnitRunEmptyGroups 6.144
testTestNGRunEmptyExcludeGroups 6.305
testTestNGRunEmptyGroups 5.926

Surefire832ProviderSelectionIT

testJUnitRunCategoryAB 6.258

Surefire839TestWithoutCategoriesIT

classWithoutCategoryForked 6.736
classWithoutCategory 6.179

Surefire847AdditionalFailureIT

testJUnitRunCategoryAB 6.205

Surefire855AllowFailsafeUseArtifactFileIT

jarNotForkingShouldUseFile 16.083
jarShouldUseFile 10.483
warShouldUseClasses 12.385
osgiBundleShouldUseFile 19.297

Surefire901MIssingResultfileWhenNoTestsIT

failsafeWithNoTests 5.024

Surefire907PerThreadWithoutThreadCountIT

categoryAB 5.056

Surefire920TestFailureIgnoreWithTimeoutIT

timeoutInForkWithBuildFail 6.873
timeoutInForkWithNoBuildFail 7.439

Surefire926FailureWith2ProvidersIT

testBuildFailingWhenErrors 9.33

Surefire930TestNgSuiteXmlIT

suiteXmlRun 7.506

Surefire943ReportContentIT

test_noParallel 11.496
test_parallelBoth 6.824

Surefire946KillMainProcessInReusableForkIT

testExit 7.792
testHalt 7.441
testInterrupt 7.552

Surefire972BizarreNoClassDefIT

testJunit3ParallelBuildResultCount 8.267

Surefire975DefaultVMEncodingIT

runWithRussian1251 6.041

Surefire979WrongClassLoaderIT

wrongClassloaderUSedInSmartStacktraceparser 5.767

Surefire985ParameterizedRunnerAndCategoriesIT

test 5.172

Surefire995CategoryInheritanceIT

junit411ShouldRunExplicitCategory 4.754
junit411ShouldExcludeExplicitCategory 4.813
junit412ShouldExcludeInheritedCategory 4.324
junit412ShouldRunInheritedCategory 4.667
negativeTestShouldRunAllCategories 4.258

JUnit44HamcrestIT

testJUnit44Hamcrest 4.896

JUnit47ConcurrencyIT

test47 4.632

JUnit47ParallelIT

unknownThreadCountClasses 3.227
threadCountSuites 7.562
unlimitedThreadsSuitesAndMethods1 5.572
unlimitedThreadsSuitesAndMethods2 4.799
unknownThreadCountMethods 3.064
threadCountClassesAndMethods 4.668
reusableThreadCountClassesAndMethodsOptimized 5.478
unknownThreadCountSuites 2.962
reusableThreadCountAll 4.42
forcedShutdown 5.878
unknownThreadCountAll 2.992
serial 10.529
reusableThreadCountAllOptimized 5.163
suites 7.23
unlimitedThreadsMethods1 6.286
unlimitedThreadsMethods2 6.351
unlimitedThreadsSuitesAndClasses1 4.967
unlimitedThreadsSuitesAndClasses2 5.118
threadCountAllOptimized 5.536
threadCountAll 5.516
everyThreadCountSuitesAndClasses 4.496
unknownThreadCountBoth 3.21
threadCountSuitesAndClassesOptimized 4.669
classesAndMethods 4.418
everyThreadCountSuitesAndMethods 4.908
unknownThreadCountSuitesAndClasses 2.923
reusableThreadCountSuitesAndClassesOptimized 5.642
unknownThreadCountSuitesAndMethods 3.002
suitesAndClasses 4.731
suitesAndMethods 5.074
shutdown 8.381
threadCountClassesAndMethodsOneCore 8.31
everyThreadCountClassesAndMethods 5.203
all 4.763
unknownThreadCountClassesAndMethods 3.299
threadCountSuitesAndMethodsOptimized 5.193
reusableThreadCountSuitesAndMethodsOptimized 5.806
unlimitedThreadsClasses1 5.846
unlimitedThreadsClasses2 5.474
threadCountClasses 5.439
everyThreadCountAll 5.041
threadCountMethods 6.627
unlimitedThreadsSuites1 7.896
unlimitedThreadsSuites2 7.927
threadCountSuitesAndClasses 5.835
unlimitedThreadsClassesAndMethods1 5.568
unlimitedThreadsClassesAndMethods2 5.8
threadCountSuitesAndMethods 6.342
classes 7.28
reusableThreadCountSuitesAndClasses 7.127
methods 6.253
reusableThreadCountSuitesAndMethods 6.26
timeoutAndForcedShutdown 6.165
threadCountClassesAndMethodsOptimized 5.177
unlimitedThreadsAll1 4.291
unlimitedThreadsAll2 4.398
forcedShutdownVerifyingLogs 5.207
threadCountClassesAndMethodsOneCoreOptimized 8.372
reusableThreadCountClassesAndMethods 5.508

JUnit47ParallelNotThreadSafeIT

test 5.37

JUnit47RedirectOutputIT

testClassesParallel 5.193
testPrintSummaryTrueWithRedirect 5.05

JUnit47StaticInnerClassTestsIT

testStaticInnerClassTests 3.719

JUnit47WithCucumberIT

testWithParallelClasses 6.118
testWithoutParallel 4.031

JUnit48TestCategoriesIT

testCategoriesABForkAlways 4.795
testCategoriesAB 5.071
testCategoriesAC 4.424
testCategoriesACForkAlways 6.412

JUnit4ForkAlwaysStaticInitPollutionIT

testJunit4Ignore 5.83

JUnit4IgnoreIT

testJunit4Ignore 4.933
testJunit47ParallelIgnore 5.83

JUnit4RerunFailingTestsIT

testRerunFailingErrorTestsFalse 19.059
testRerunFailingErrorTestsWithOneRetry 17.759
testRerunFailingErrorTestsTwoRetry 17.406
testRerunOneTestMethod 18.351
testRerunOneTestClass 18.864

JUnit4RunListenerIT

testJUnit4RunListener 4.487
testRunlistenerJunitCoreProvider 4.797

JUnit4VersionsIT

testJunit[0: JUnit 4.0] 4.336
testJunit[1: JUnit 4.1] 5.521
testJunit[2: JUnit 4.2] 5.296
testJunit[3: JUnit 4.3] 5.083
testJunit[4: JUnit 4.3.1] 5.555
testJunit[5: JUnit 4.4] 4.19
testJunit[6: JUnit 4.5] 4.485
testJunit[7: JUnit 4.6] 5.9
testJunit[8: JUnit 4.7] 5.165
testJunit[9: JUnit 4.8] 7.077
testJunit[10: JUnit 4.8.1] 5.683
testJunit[11: JUnit 4.8.2] 5.66
testJunit[12: JUnit 4.9] 5.625
testJunit[13: JUnit 4.10] 4.525
testJunit[14: JUnit 4.11] 4.707
testJunit[15: JUnit 4.12] 4.791

JUnitDepIT

testJUnit44DepWithSneaky381 4.8
testJUnit44Dep 4.915
testJUnit47Dep 5.331
testJUnit48Dep 4.814

LongWindowsPathIT

shouldRunInSystemTmp 4.318

NoRunnableTestsInClassIT

testJunit3ParallelBuildResultCount 4.879

PlainOldJavaClasspathIT

testPlainOldJavaClasspath 4.915

PlexusConflictIT

testPlexusConflict 4.997
testPlexusConflictIsolatedClassLoader 4.863

PojoSimpleIT

testit 5.074

ReportersIT

testRedirectOutputTestNg 5.343

ResultCountingIT

testCountingWithJunit481ForkAlways 10.699
testCountingWithJunit481ForkOnce 4.542
testCountingWithJunit481ForkNever 3.738

RunOrderIT

testReverseAlphabetical 4.605
testNonExistingRunOrder 3.13
testHourly 4.493
testAlphabetical 4.326

RunOrderParallelForksIT

testReverseAlphabetical 4.566
testNonExistingRunOrder 3.366
testHourly 4.227
testAlphabetical 4.187

SiblingAggregatorIT

testSiblingAggregator 4.46

SmartStackTraceIT

misg 4.179

SystemPropertiesTestIT

testSystemProperties 4.291
testSystemPropertiesNoFork 3.957

TestMethodPatternIT

testJUnit48WithCategoryFilter 5.594
testJUnit48Provider47 5.575
testMethodPatternAfter 4.566
testTestNGMethodPattern 4.338
testJUnit48Provider4 4.411
testJUnit44 4.447
testTestNgMethodBefore 4.559

TestMultipleMethodPatternsIT

shouldNotRunExcludedClassesAndMethods[0] 3.963
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[0] 3.78
shouldMatchExactClassAndMethodCharacters[0] 3.996
shouldMatchExactClassAndMethodWildcard[0] 3.222
testSuccessTwo[0] 3.816
simpleNameTest[0] 3.603
simpleNameTestWithJavaExt[0] 4.217
regexClass[0] 4.049
shouldNotRunExcludedClasses[0] 4.16
shouldNotRunExcludedMethods[0] 4.287
simpleNameTestWithJavaExtWildcardPkg[0] 4.318
shouldMatchMultiplePatterns[0] 4.389
shouldMatchExactClassAndMethodsPostfix[0] 4.507
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[0] 3.915
simpleNameTestWithWildcardPkg[0] 3.998
shouldMatchWildcardPackageAndClassAndMethod[0] 4.381
shouldMatchExactClassAndMultipleMethods[0] 4.06
fullyQualifiedTest[0] 3.8
negativeTest[0]
+ [ Detail ]
 0
skipped
testRegexSuccessTwo[0] 4.16
shouldMatchSimpleClassNameAndMethodWithJavaExt[0] 3.754
shouldMatchExactClassAndMethodsWildcard[0] 3.992
shouldMatchMultiplePatternsComplex[0] 4.197
simpleNameTestAsParallel[0]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[0]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[0] 3.537
shouldMatchSimpleClassNameAndMethod[0] 3.34
shouldMatchExactClassAndMethodPostfix[0] 3.367
shouldMatchMultiplePatternsComplexAsParallel[0]
+ [ Detail ]
 0.001
skipped
regexClassAndMethod[0] 3.482
shouldNotRunExcludedClassesAndMethods[1] 4.618
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[1] 4.275
shouldMatchExactClassAndMethodCharacters[1] 4.864
shouldMatchExactClassAndMethodWildcard[1] 4.241
testSuccessTwo[1] 5.343
simpleNameTest[1] 5.084
simpleNameTestWithJavaExt[1] 4.68
regexClass[1] 4.373
shouldNotRunExcludedClasses[1] 5.19
shouldNotRunExcludedMethods[1] 4.924
simpleNameTestWithJavaExtWildcardPkg[1] 4.555
shouldMatchMultiplePatterns[1] 4.496
shouldMatchExactClassAndMethodsPostfix[1] 4.577
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[1] 4.263
simpleNameTestWithWildcardPkg[1] 3.898
shouldMatchWildcardPackageAndClassAndMethod[1] 3.559
shouldMatchExactClassAndMultipleMethods[1] 4.26
fullyQualifiedTest[1] 4.329
negativeTest[1]
+ [ Detail ]
 0
skipped
testRegexSuccessTwo[1] 4.414
shouldMatchSimpleClassNameAndMethodWithJavaExt[1] 3.691
shouldMatchExactClassAndMethodsWildcard[1] 4.288
shouldMatchMultiplePatternsComplex[1] 4.274
simpleNameTestAsParallel[1] 4.568
shouldMatchMultiplePatternsAsParallel[1] 4.697
shouldNotRunExcludedClassesIfIncluded[1] 4.65
shouldMatchSimpleClassNameAndMethod[1] 3.71
shouldMatchExactClassAndMethodPostfix[1] 3.812
shouldMatchMultiplePatternsComplexAsParallel[1] 3.773
regexClassAndMethod[1] 3.806
shouldNotRunExcludedClassesAndMethods[2]
+ [ Detail ]
 0
skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[2]
+ [ Detail ]
 0
skipped
testSuccessTwo[2]
+ [ Detail ]
 0
skipped
simpleNameTest[2] 3.386
simpleNameTestWithJavaExt[2] 3.451
regexClass[2] 3.418
shouldNotRunExcludedClasses[2] 3.842
shouldNotRunExcludedMethods[2]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[2] 3.324
shouldMatchMultiplePatterns[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[2]
+ [ Detail ]
 0
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[2]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[2] 3.502
shouldMatchWildcardPackageAndClassAndMethod[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[2]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[2] 3.767
negativeTest[2] 3.317
testRegexSuccessTwo[2]
+ [ Detail ]
 0
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[2]
+ [ Detail ]
 0.001
skipped
shouldMatchMultiplePatternsComplex[2]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[2]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[2] 4.289
shouldMatchSimpleClassNameAndMethod[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[2]
+ [ Detail ]
 0
skipped
regexClassAndMethod[2]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesAndMethods[3]
+ [ Detail ]
 0
skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[3]
+ [ Detail ]
 0
skipped
testSuccessTwo[3]
+ [ Detail ]
 0
skipped
simpleNameTest[3] 4.593
simpleNameTestWithJavaExt[3] 4.591
regexClass[3] 4.505
shouldNotRunExcludedClasses[3] 4.799
shouldNotRunExcludedMethods[3]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[3] 4.098
shouldMatchMultiplePatterns[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[3]
+ [ Detail ]
 0.001
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[3]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[3] 4.642
shouldMatchWildcardPackageAndClassAndMethod[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[3]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[3] 4.706
negativeTest[3] 4.461
testRegexSuccessTwo[3]
+ [ Detail ]
 0.001
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[3]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[3]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[3] 4.903
shouldMatchMultiplePatternsAsParallel[3]
+ [ Detail ]
 0.001
skipped
shouldNotRunExcludedClassesIfIncluded[3] 4.893
shouldMatchSimpleClassNameAndMethod[3]
+ [ Detail ]
 0.001
skipped
shouldMatchExactClassAndMethodPostfix[3]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[3]
+ [ Detail ]
 0
skipped
regexClassAndMethod[3]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesAndMethods[4]
+ [ Detail ]
 0
skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[4]
+ [ Detail ]
 0
skipped
testSuccessTwo[4]
+ [ Detail ]
 0
skipped
simpleNameTest[4] 4.453
simpleNameTestWithJavaExt[4] 4.586
regexClass[4] 3.942
shouldNotRunExcludedClasses[4] 4.244
shouldNotRunExcludedMethods[4]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[4] 3.576
shouldMatchMultiplePatterns[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[4]
+ [ Detail ]
 0
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[4]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[4] 3.298
shouldMatchWildcardPackageAndClassAndMethod[4]
+ [ Detail ]
 0.001
skipped
shouldMatchExactClassAndMultipleMethods[4]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[4] 3.829
negativeTest[4] 3.802
testRegexSuccessTwo[4]
+ [ Detail ]
 0
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[4]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[4]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[4]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[4]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[4] 3.692
shouldMatchSimpleClassNameAndMethod[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[4]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[4]
+ [ Detail ]
 0
skipped
regexClassAndMethod[4]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesAndMethods[5]
+ [ Detail ]
 0
skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[5]
+ [ Detail ]
 0
skipped
testSuccessTwo[5]
+ [ Detail ]
 0
skipped
simpleNameTest[5] 4.112
simpleNameTestWithJavaExt[5] 4.031
regexClass[5] 3.935
shouldNotRunExcludedClasses[5] 4.595
shouldNotRunExcludedMethods[5]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[5] 4.65
shouldMatchMultiplePatterns[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[5]
+ [ Detail ]
 0
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[5]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[5] 4.165
shouldMatchWildcardPackageAndClassAndMethod[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[5]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[5] 4.543
negativeTest[5] 4.191
testRegexSuccessTwo[5]
+ [ Detail ]
 0
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[5]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[5]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[5] 4.515
shouldMatchMultiplePatternsAsParallel[5]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[5] 4.182
shouldMatchSimpleClassNameAndMethod[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[5]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[5]
+ [ Detail ]
 0
skipped
regexClassAndMethod[5]
+ [ Detail ]
 0
skipped

TestMultipleMethodPatternsTestNGIT

shouldNotRunExcludedClassesAndMethods[0] 4.734
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[0] 4.629
shouldMatchExactClassAndMethodCharacters[0] 4.463
shouldMatchExactClassAndMethodWildcard[0] 4.182
testSuccessTwo[0] 4.923
simpleNameTest[0] 4.59
simpleNameTestWithJavaExt[0] 4.531
regexClass[0] 4.242
shouldNotRunExcludedClasses[0] 4.365
shouldNotRunExcludedMethods[0] 4.438
simpleNameTestWithJavaExtWildcardPkg[0] 4.96
shouldMatchMultiplePatterns[0] 4.382
shouldMatchExactClassAndMethodsPostfix[0] 4.547
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[0] 4.132
simpleNameTestWithWildcardPkg[0] 5.188
shouldMatchWildcardPackageAndClassAndMethod[0] 4.718
shouldMatchExactClassAndMultipleMethods[0] 5.1
fullyQualifiedTest[0] 4.773
negativeTest[0]
+ [ Detail ]
 0
skipped
testRegexSuccessTwo[0] 5.4
shouldMatchSimpleClassNameAndMethodWithJavaExt[0] 4.367
shouldMatchExactClassAndMethodsWildcard[0] 4.491
shouldMatchMultiplePatternsComplex[0] 4.291
simpleNameTestAsParallel[0] 4.797
shouldMatchMultiplePatternsAsParallel[0] 4.348
shouldNotRunExcludedClassesIfIncluded[0] 4.435
shouldMatchSimpleClassNameAndMethod[0] 4.043
shouldMatchExactClassAndMethodPostfix[0] 4.326
shouldMatchMultiplePatternsComplexAsParallel[0] 4.169
regexClassAndMethod[0] 4.195
shouldNotRunExcludedClassesAndMethods[1]
+ [ Detail ]
 0
skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[1]
+ [ Detail ]
 0
skipped
testSuccessTwo[1]
+ [ Detail ]
 0
skipped
simpleNameTest[1] 3.998
simpleNameTestWithJavaExt[1] 4.129
regexClass[1] 4.144
shouldNotRunExcludedClasses[1] 4.24
shouldNotRunExcludedMethods[1]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[1] 3.942
shouldMatchMultiplePatterns[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[1]
+ [ Detail ]
 0
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[1]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[1] 4.113
shouldMatchWildcardPackageAndClassAndMethod[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[1]
+ [ Detail ]
 0.001
skipped
fullyQualifiedTest[1] 4.035
negativeTest[1] 3.664
testRegexSuccessTwo[1]
+ [ Detail ]
 0
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[1]
+ [ Detail ]
 0.001
skipped
shouldMatchMultiplePatternsComplex[1]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[1] 3.977
shouldMatchMultiplePatternsAsParallel[1]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[1] 4.088
shouldMatchSimpleClassNameAndMethod[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[1]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[1]
+ [ Detail ]
 0
skipped
regexClassAndMethod[1]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesAndMethods[2]
+ [ Detail ]
 0
skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[2]
+ [ Detail ]
 0
skipped
testSuccessTwo[2]
+ [ Detail ]
 0
skipped
simpleNameTest[2] 4.099
simpleNameTestWithJavaExt[2] 4.108
regexClass[2] 4.071
shouldNotRunExcludedClasses[2] 4.273
shouldNotRunExcludedMethods[2]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[2] 4.08
shouldMatchMultiplePatterns[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[2]
+ [ Detail ]
 0
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[2]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[2] 4.383
shouldMatchWildcardPackageAndClassAndMethod[2]
+ [ Detail ]
 0.001
skipped
shouldMatchExactClassAndMultipleMethods[2]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[2] 4.1
negativeTest[2] 3.7
testRegexSuccessTwo[2]
+ [ Detail ]
 0
skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[2]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[2] 4.196
shouldMatchMultiplePatternsAsParallel[2]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[2] 4.189
shouldMatchSimpleClassNameAndMethod[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[2]
+ [ Detail ]
 0
skipped
regexClassAndMethod[2]
+ [ Detail ]
 0
skipped

TestMultipleMethodsIT

testJunit48Provider4 4.983
testJunit44 3.908
testJunit48Provider47 6.07

TestNgGroupsIT

testExclusion 7.93
testGroupsAndExclusion 6.272
groupsWithDash 5.843
testOnlyGroups 5.404
groupsBySimpleRegex 5.553

TestNgParallelWithAnnotationsIT

testTestNgGroupThreadParallel 5.947

TestNgSuccessPercentageIT

testPassesWhenFailuresLessThanSuccessPercentage 4.21

TestSingleMethodIT

fullyQualifiedTestNg 4.776
testJunit48Provider4 4.941
testJunit44 4.79
testJunit48parallel 5.251
testJunit48Provider47 4.96
fullyQualifiedJunit48Provider47 5.176
fullyQualifiedJunit48Provider4 4.85
testTestNg5149 4.949
testTestNg 4.73

TimeoutForkedTestIT

testTimeoutForked 5.7

TwoTestCasesIT

testJunit4Suite 4.941
testTestNGSuite 5.228
testTwoTestCases 4.827
testTwoTestCaseSuite 5.041

UmlautDirIT

testUmlautIsolatedClassLoader 4.964
testUmlaut 4.801

UnicodeTestNamesIT

checkFileNamesWithUnicode 4.628

UseIsolatedClassLoaderIT

testUseSystemClassLoader 4.725

WorkingDirectoryIsInvalidPropertyIT

testWorkingDirectory 3.506

WorkingDirectoryIT

testWorkingDirectory 4.909
testWorkingDirectoryChildOnlyNoFork 3.973
testWorkingDirectoryNoFork 3.803
testWorkingDirectoryChildOnly 4.833

WorkingDirectoryMissingIT

testWorkingDirectory 5.042

XmlReporterRunTimeIT

testForkModeAlways 23.897

Failure Details

[Summary] [Package List] [Test Cases]


suiteXmlForkModeAlways
skipped: Fails - see SUREFIRE-1123
XXXtest50
skipped: 5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
XXXtest501
skipped: 5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
shouldLoadMultipleJavaModules_JavaHome
skipped: skipped
shouldLoadMultipleJavaModules_ToolchainsXML
skipped: skipped
shouldLoadMultipleJavaModules_JvmParameter
skipped: skipped
shouldRunInPluginJava9
skipped: skipped
crashInSingleUseFork
skipped: skipped
crashInReusableFork
skipped: skipped
crashInFork
skipped: skipped
twoSpecifiedTestExecutionsInCorrectExecutionBlocks
skipped: since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
singleTestInOneExecutionOfMultiExecutionProject
skipped: since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
negativeTest[0]
skipped: skipped
simpleNameTestAsParallel[0]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[0]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[0]
skipped: skipped
negativeTest[1]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[2]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[2]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[2]
skipped: skipped
testSuccessTwo[2]
skipped: skipped
shouldNotRunExcludedMethods[2]
skipped: skipped
shouldMatchMultiplePatterns[2]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[2]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[2]
skipped: skipped
testRegexSuccessTwo[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[2]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[2]
skipped: skipped
shouldMatchMultiplePatternsComplex[2]
skipped: skipped
simpleNameTestAsParallel[2]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[2]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[2]
skipped: skipped
regexClassAndMethod[2]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[3]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[3]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[3]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[3]
skipped: skipped
testSuccessTwo[3]
skipped: skipped
shouldNotRunExcludedMethods[3]
skipped: skipped
shouldMatchMultiplePatterns[3]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[3]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[3]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[3]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[3]
skipped: skipped
testRegexSuccessTwo[3]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[3]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[3]
skipped: skipped
shouldMatchMultiplePatternsComplex[3]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[3]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[3]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[3]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[3]
skipped: skipped
regexClassAndMethod[3]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[4]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[4]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[4]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[4]
skipped: skipped
testSuccessTwo[4]
skipped: skipped
shouldNotRunExcludedMethods[4]
skipped: skipped
shouldMatchMultiplePatterns[4]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[4]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[4]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[4]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[4]
skipped: skipped
testRegexSuccessTwo[4]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[4]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[4]
skipped: skipped
shouldMatchMultiplePatternsComplex[4]
skipped: skipped
simpleNameTestAsParallel[4]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[4]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[4]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[4]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[4]
skipped: skipped
regexClassAndMethod[4]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[5]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[5]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[5]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[5]
skipped: skipped
testSuccessTwo[5]
skipped: skipped
shouldNotRunExcludedMethods[5]
skipped: skipped
shouldMatchMultiplePatterns[5]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[5]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[5]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[5]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[5]
skipped: skipped
testRegexSuccessTwo[5]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[5]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[5]
skipped: skipped
shouldMatchMultiplePatternsComplex[5]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[5]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[5]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[5]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[5]
skipped: skipped
regexClassAndMethod[5]
skipped: skipped
negativeTest[0]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[1]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[1]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[1]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[1]
skipped: skipped
testSuccessTwo[1]
skipped: skipped
shouldNotRunExcludedMethods[1]
skipped: skipped
shouldMatchMultiplePatterns[1]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[1]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[1]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[1]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[1]
skipped: skipped
testRegexSuccessTwo[1]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[1]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[1]
skipped: skipped
shouldMatchMultiplePatternsComplex[1]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[1]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[1]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[1]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[1]
skipped: skipped
regexClassAndMethod[1]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithWildcardPkg[2]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[2]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[2]
skipped: skipped
testSuccessTwo[2]
skipped: skipped
shouldNotRunExcludedMethods[2]
skipped: skipped
shouldMatchMultiplePatterns[2]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExtWildcardPkg[2]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[2]
skipped: skipped
testRegexSuccessTwo[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethodWithJavaExt[2]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[2]
skipped: skipped
shouldMatchMultiplePatternsComplex[2]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[2]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[2]
skipped: skipped
regexClassAndMethod[2]
skipped: skipped