Fork me on GitHub
Built by Maven

Surefire Report

Summary

[Summary] [Package List] [Test Cases]


Tests Errors Failures Skipped Success Rate Time
780 0 0 132 83.077% 4,305.705

Note: failures are anticipated and checked for with assertions while errors are unanticipated.


Package List

[Summary] [Package List] [Test Cases]


Package Tests Errors Failures Skipped Success Rate Time
org.apache.maven.surefire.its 598 0 0 130 78.261% 3,077.985
org.apache.maven.surefire.its.jiras 182 0 0 2 98.901% 1,227.721

Note: package statistics are not computed recursively, they only sum up all of its testsuites numbers.

org.apache.maven.surefire.its

Class Tests Errors Failures Skipped Success Rate Time
AbstractTestCaseIT 1 0 0 0 100% 4.655
AdditionalClasspathIT 1 0 0 0 100% 4.195
AggregateReportIT 1 0 0 0 100% 5.568
ArgLineIT 1 0 0 0 100% 5.396
ArgLinePropertiesIT 1 0 0 0 100% 5.564
AssumptionFailureReportIT 1 0 0 0 100% 4.546
CheckSingleTestIT 4 0 0 0 100% 16.291
CheckTestFailIfNoTestsForkModeIT 6 0 0 0 100% 25.343
CheckTestFailIfNoTestsIT 3 0 0 0 100% 9.852
CheckTestNgBeforeMethodFailureIT 1 0 0 0 100% 5.767
CheckTestNgBeforeMethodIT 1 0 0 0 100% 5.759
CheckTestNgCustomObjectFactoryIT 1 0 0 0 100% 4.757
CheckTestNgCustomTestRunnerFactoryIT 1 0 0 0 100% 4.898
CheckTestNgExecuteErrorIT 1 0 0 0 100% 6.108
CheckTestNgGroupThreadParallelIT 1 0 0 0 100% 4.641
CheckTestNgJdk14IT 1 0 0 0 100% 5.616
CheckTestNgListenerReporterIT 8 0 0 0 100% 47.897
CheckTestNgListenersIT 1 0 0 0 100% 4.987
CheckTestNgPathWithSpacesIT 1 0 0 0 100% 5.983
CheckTestNgReportTestIT 3 0 0 0 100% 20.337
CheckTestNgSuiteXmlIT 3 0 0 0 100% 18.795
CheckTestNgSuiteXmlSingleIT 1 0 0 0 100% 5.836
CheckTestNgVersionsIT 20 0 0 2 90% 121.34
ClasspathFilteringIT 1 0 0 0 100% 4.838
ClassPathOrderIT 1 0 0 0 100% 5.197
ClasspathScopeFilteringIT 1 0 0 0 100% 4.405
ConsoleOutputIT 4 0 0 0 100% 30.939
CrashDetectionIT 3 0 0 0 100% 17.189
DefaultConfigurationIT 1 0 0 0 100% 4.096
EnvironmentVariableIT 1 0 0 0 100% 5.715
EnvironmentVariablesIT 2 0 0 0 100% 11.556
FailFastJUnitIT 12 0 0 0 100% 246.101
FailFastTestNgIT 6 0 0 0 100% 123.695
ForkConsoleOutputIT 4 0 0 0 100% 23.496
ForkConsoleOutputWithErrorsIT 1 0 0 0 100% 5.872
ForkModeIT 12 0 0 0 100% 136.254
ForkModeMultiModuleIT 4 0 0 0 100% 37.164
ForkModeTestNGIT 12 0 0 0 100% 106.669
IncludesExcludesFromFileIT 6 0 0 0 100% 29.742
IncludesExcludesIT 3 0 0 0 100% 16.148
Java9FullApiIT 3 0 0 0 100% 24.402
JUnit44HamcrestIT 1 0 0 0 100% 5.65
JUnit47ConcurrencyIT 1 0 0 0 100% 5.616
JUnit47ParallelIT 59 0 0 0 100% 381.02
JUnit47ParallelNotThreadSafeIT 1 0 0 0 100% 4.753
JUnit47RedirectOutputIT 2 0 0 0 100% 12.284
JUnit47RerunFailingTestWithCucumberIT 3 0 0 0 100% 16.756
JUnit47StaticInnerClassTestsIT 1 0 0 0 100% 4.645
JUnit47WithCucumberIT 2 0 0 0 100% 10.714
JUnit48TestCategoriesIT 8 0 0 0 100% 54.576
JUnit4ForkAlwaysStaticInitPollutionIT 1 0 0 0 100% 6.495
JUnit4IgnoreIT 2 0 0 0 100% 11.576
JUnit4RerunFailingTestsIT 5 0 0 0 100% 118.842
JUnit4RunListenerIT 2 0 0 0 100% 11.793
JUnit4VersionsIT 16 0 0 0 100% 90.065
JUnitDepIT 4 0 0 0 100% 23.72
JUnitPlatformEnginesIT 10 0 0 0 100% 31.89
JUnitPlatformIT 5 0 0 0 100% 29.908
LongWindowsPathIT 1 0 0 0 100% 5.737
ModulePathIT 1 0 0 0 100% 7.473
NoRunnableTestsInClassIT 1 0 0 0 100% 5.644
PlainOldJavaClasspathIT 1 0 0 0 100% 5.408
PlexusConflictIT 2 0 0 0 100% 11.133
PojoSimpleIT 1 0 0 0 100% 5.358
ReportersIT 1 0 0 0 100% 5.93
ResultCountingIT 3 0 0 0 100% 19.753
RunOrderIT 4 0 0 0 100% 20.84
RunOrderParallelForksIT 4 0 0 0 100% 20.89
SiblingAggregatorIT 1 0 0 0 100% 4.516
SmartStackTraceIT 1 0 0 0 100% 5.689
SystemPropertiesTestIT 2 0 0 0 100% 10.291
TestMethodPatternIT 7 0 0 0 100% 42.765
TestMultipleMethodPatternsIT 180 0 0 87 51.667% 449.432
TestMultipleMethodPatternsTestNGIT 90 0 0 41 54.444% 235.929
TestMultipleMethodsIT 3 0 0 0 100% 17.36
TestNgGroupsIT 5 0 0 0 100% 32.108
TestNgParallelWithAnnotationsIT 1 0 0 0 100% 7.053
TestNgSuccessPercentageIT 1 0 0 0 100% 4.798
TestSingleMethodIT 9 0 0 0 100% 54.953
TimeoutForkedTestIT 1 0 0 0 100% 6.306
TwoTestCasesIT 4 0 0 0 100% 22.718
UmlautDirIT 2 0 0 0 100% 11.182
UnicodeTestNamesIT 1 0 0 0 100% 7.694
UseIsolatedClassLoaderIT 1 0 0 0 100% 5.531
WorkingDirectoryIsInvalidPropertyIT 1 0 0 0 100% 4.155
WorkingDirectoryIT 4 0 0 0 100% 19.862
WorkingDirectoryMissingIT 1 0 0 0 100% 5.132
XmlReporterRunTimeIT 1 0 0 0 100% 24.433

org.apache.maven.surefire.its.jiras

Class Tests Errors Failures Skipped Success Rate Time
Surefire1024VerifyFailsafeIfTestedIT 1 0 0 0 100% 4.943
Surefire1028UnableToRunSingleIT 1 0 0 0 100% 4.759
Surefire1036NonFilterableJUnitRunnerWithCategoriesIT 1 0 0 0 100% 4.762
Surefire1041FailingJUnitRunnerIT 1 0 0 0 100% 6.068
Surefire1053SystemPropertiesIT 2 0 0 0 100% 11.29
Surefire1055CorrectConcurrentTestCountIT 1 0 0 0 100% 6.147
Surefire1080ParallelForkDoubleTestIT 1 0 0 0 100% 6.214
Surefire1082ParallelJUnitParameterizedIT 3 0 0 0 100% 22.288
Surefire1098BalancedRunOrderIT 1 0 0 0 100% 27.328
Surefire1122ParallelAndFlakyTestsIT 3 0 0 0 100% 16.457
Surefire1135ImproveIgnoreMessageForTestNGIT 2 0 0 0 100% 13.78
Surefire1136CwdPropagationInForkedModeIT 1 0 0 0 100% 5.702
Surefire1144XmlRunTimeIT 1 0 0 0 100% 6.155
Surefire1152RerunFailingTestsInSuiteIT 2 0 0 0 100% 11.887
Surefire1153IncludesAndSpecifiedTestIT 2 0 0 0 100% 9.112
Surefire1158RemoveInfoLinesIT 6 0 0 0 100% 36.616
Surefire1177TestngParallelSuitesIT 2 0 0 0 100% 14.57
Surefire1179IT 1 0 0 0 100% 9.807
Surefire1185DoNotSpawnTestsIT 1 0 0 0 100% 4.659
Surefire1202RerunAndSkipIT 2 0 0 0 100% 37.006
Surefire1209RerunAndForkCountIT 4 0 0 0 100% 55.929
Surefire1211JUnitTestNgIT 2 0 0 0 100% 13.013
Surefire1264IT 2 0 0 0 100% 14.676
Surefire1265Java9IT 1 0 0 0 100% 4.533
Surefire1278GroupNameEndingIT 1 0 0 0 100% 6.24
Surefire1295AttributeJvmCrashesToTestsIT 9 0 0 0 100% 90.987
Surefire1364SystemPropertiesIT 10 0 0 0 100% 60.944
Surefire1367AssumptionLogsIT 4 0 0 0 100% 20.474
Surefire1383ScanSessionDependenciesIT 1 0 0 0 100% 5.132
Surefire1396CustomProviderClassPathIT 1 0 0 0 100% 8.264
Surefire141PluggableProvidersIT 4 0 0 0 100% 30.973
Surefire146ForkPerTestNoSetupIT 1 0 0 0 100% 5.474
Surefire1490ReportTitleDescriptionIT 2 0 0 0 100% 22.353
Surefire1535TestNGParallelSuitesIT 4 0 0 0 100% 28.909
Surefire162CharsetProviderIT 1 0 0 0 100% 5.716
Surefire224WellFormedXmlFailuresIT 1 0 0 0 100% 5.433
Surefire257NotRerunningTestsIT 1 0 0 0 100% 7.804
Surefire260TestWithIdenticalNamesIT 1 0 0 0 100% 10.35
Surefire34SecurityManagerIT 2 0 0 0 100% 11.143
Surefire376TestNgAfterSuiteFailureIT 1 0 0 0 100% 5.768
Surefire377TestNgAndJUnitTogetherIT 2 0 0 0 100% 11.27
Surefire408ManualProviderSelectionIT 1 0 0 0 100% 6.177
Surefire42NotExtendingTestCaseIT 1 0 0 0 100% 5.501
Surefire44InnerClassTestIT 1 0 0 0 100% 5.256
Surefire500PuzzlingErrorIT 1 0 0 0 100% 5.75
Surefire510TestClassPathForkModesIT 2 0 0 0 100% 10.77
Surefire569RunTestFromDependencyJarsIT 1 0 0 0 100% 5.35
Surefire570MultipleReportDirectoriesIT 2 0 0 0 100% 28.826
Surefire613TestCountInParallelIT 1 0 0 0 100% 6.467
Surefire621TestCountingJunit3InParallelIT 5 0 0 0 100% 31.499
Surefire628ConsoleOutputBeforeAndAfterClassIT 1 0 0 0 100% 6.104
Surefire634UnsettableSystemPropertiesWarningIT 1 0 0 0 100% 5.509
Surefire649EmptyStringSystemPropertiesIT 2 0 0 0 100% 9.077
Surefire673MockitoIT 1 0 0 0 100% 5.754
Surefire674BuildFailingWhenErrorsIT 1 0 0 0 100% 5.669
Surefire674BuildFailingWhenFailsafeErrorsIT 1 0 0 0 100% 3.345
Surefire685CommaSeparatedIncludesIT 1 0 0 0 100% 5.778
Surefire697NiceSummaryIT 1 0 0 0 100% 5.585
Surefire705ParallelForkTimeoutIT 1 0 0 0 100% 7.757
Surefire733AllOverrridesCapturedIT 1 0 0 0 100% 5.678
Surefire735ForkFailWithRedirectConsoleOutputIT 2 0 0 0 100% 9.862
Surefire740TruncatedCommaIT 1 0 0 0 100% 4.098
Surefire747MethodParallelWithSuiteCountIT 2 0 0 0 100% 22.119
Surefire772BothReportsIT 3 0 0 0 100% 10.071
Surefire772NoFailsafeReportsIT 4 0 0 0 100% 12.892
Surefire772NoSurefireReportsIT 4 0 0 0 100% 12.936
Surefire772SpecifiedReportsIT 3 0 0 0 100% 9.721
Surefire801ForkModeNoneClassLoaderIT 1 0 0 0 100% 4.446
Surefire803MultiFailsafeExecsIT 2 0 0 0 100% 20.096
Surefire806SpecifiedTestControlsIT 3 0 0 2 33.333% 5.603
Surefire809GroupExpressionsIT 6 0 0 0 100% 34.147
Surefire812Log4JClassLoaderIT 1 0 0 0 100% 5.886
Surefire817SystemExitIT 1 0 0 0 100% 5.928
Surefire818NpeIgnoresTestsIT 1 0 0 0 100% 6.162
Surefire828EmptyGroupExprIT 4 0 0 0 100% 24.482
Surefire832ProviderSelectionIT 1 0 0 0 100% 6.072
Surefire839TestWithoutCategoriesIT 2 0 0 0 100% 12.382
Surefire847AdditionalFailureIT 1 0 0 0 100% 6.329
Surefire855AllowFailsafeUseArtifactFileIT 4 0 0 0 100% 42.177
Surefire901MIssingResultfileWhenNoTestsIT 1 0 0 0 100% 4.343
Surefire907PerThreadWithoutThreadCountIT 1 0 0 0 100% 4.099
Surefire920TestFailureIgnoreWithTimeoutIT 2 0 0 0 100% 13.216
Surefire926FailureWith2ProvidersIT 1 0 0 0 100% 3.305
Surefire930TestNgSuiteXmlIT 1 0 0 0 100% 7.041
Surefire943ReportContentIT 2 0 0 0 100% 19.362
Surefire946KillMainProcessInReusableForkIT 3 0 0 0 100% 22.762
Surefire972BizarreNoClassDefIT 1 0 0 0 100% 6.961
Surefire975DefaultVMEncodingIT 1 0 0 0 100% 5.639
Surefire979WrongClassLoaderIT 1 0 0 0 100% 5.894
Surefire985ParameterizedRunnerAndCategoriesIT 1 0 0 0 100% 5.144
Surefire995CategoryInheritanceIT 5 0 0 0 100% 23.759

Test Cases

[Summary] [Package List] [Test Cases]

AbstractTestCaseIT

abstractTestCase 4.655

AdditionalClasspathIT

additionalClasspath 4.195

AggregateReportIT

aggregateReport 5.568

ArgLineIT

argLine 5.396

ArgLinePropertiesIT

argLine 5.564

AssumptionFailureReportIT

testWriteSkippedMessageToReport 4.546

CheckSingleTestIT

singleTestDotJava 4.226
singleTestNonExistentOverride 3.998
singleTestNonExistent 3.788
singleTest 4.279

CheckTestFailIfNoTestsForkModeIT

dontFailIfNoTestsForkModeAlways 4.138
failIfNoTestsForkModeOnce 4.396
dontFailIfNoTestsForkModeNever 4.2
dontFailIfNoTestsForkModeOnce 4.324
failIfNoTestsForkModeNever 4.031
failIfNoTestsForkModeAlways 4.254

CheckTestFailIfNoTestsIT

failIfNoTests 3.248
dontFailIfNoTests 3.262
jUnit48CategoriesFailWhenNoTests 3.342

CheckTestNgBeforeMethodFailureIT

TestNgBeforeMethodFailure 5.767

CheckTestNgBeforeMethodIT

TestNgBeforeMethod 5.759

CheckTestNgCustomObjectFactoryIT

testTestNgListenerReporter 4.757

CheckTestNgCustomTestRunnerFactoryIT

testTestNgListenerReporter 4.898

CheckTestNgExecuteErrorIT

executionError 6.108

CheckTestNgGroupThreadParallelIT

TestNgGroupThreadParallel 4.641

CheckTestNgJdk14IT

TestNgJdk14 5.616

CheckTestNgListenerReporterIT

testNgListenerReporter[0: TestNG 5.6] 5.866
testNgListenerReporter[1: TestNG 5.7] 5.893
testNgListenerReporter[2: TestNG 5.10] 5.923
testNgListenerReporter[3: TestNG 5.13] 6.193
testNgListenerReporter[4: TestNG 5.14.6] 5.987
testNgListenerReporter[5: TestNG 5.14.9] 5.918
testNgListenerReporter[6: TestNG 6.0] 5.919
testNgListenerReporter[7: TestNG 6.9.9] 6.198

CheckTestNgListenersIT

TestNgListenerReporter 4.987

CheckTestNgPathWithSpacesIT

TestWithSpaces 5.983

CheckTestNgReportTestIT

testNgReport 7.331
shouldNotBeVerbose 6.402
shouldBeVerbose 6.604

CheckTestNgSuiteXmlIT

suiteXml 5.89
suiteXmlForkCountTwoReuse 6.032
suiteXmlForkModeAlways 6.873

CheckTestNgSuiteXmlSingleIT

TestNgSuite 5.836

CheckTestNgVersionsIT

XXXtest50
+ [ Detail ]
 0
5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
test502 6.343
test510 6.531
test511 6.253
test512 6.628
test513 6.683
test514 6.873
test685 7.89
test5131 6.968
test5141 6.72
test5142 7.561
test47 6.512
test51 6.521
test55 6.474
test56 7.183
test57 6.551
test58 6.656
test59 6.553
test60 6.44
XXXtest501
+ [ Detail ]
 0
5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024

ClasspathFilteringIT

additionalClasspath 4.838

ClassPathOrderIT

classPathOrder 5.197

ClasspathScopeFilteringIT

additionalClasspath 4.405

ConsoleOutputIT

properNewlinesAndEncodingWithDifferentEncoding 5.71
properNewlinesAndEncodingWithDefaultEncodings 5.796
largerSoutThanMemory 14.756
properNewlinesAndEncodingWithoutFork 4.677

CrashDetectionIT

hardCrashInReusableFork 5.669
crashInReusableFork 5.76
crashInFork 5.76

DefaultConfigurationIT

defaultConfiguration 4.096

EnvironmentVariableIT

environmentVariable 5.715

EnvironmentVariablesIT

testWhenUseSystemClassLoader 5.952
testWhenDontUseSystemClassLoader 5.604

FailFastJUnitIT

test[junit4-oneFork-ff1] 9.493
test[junit47-oneFork-ff1] 9.421
test[junit4-oneFork-ff2] 18.443
test[junit47-oneFork-ff2] 18.75
test[junit4-twoForks-ff1] 15.193
test[junit47-twoForks-ff1] 15.875
test[junit4-twoForks-ff2] 18.573
test[junit47-twoForks-ff2] 18.792
test[junit4-oneFork-ff3] 36.47
test[junit47-oneFork-ff3] 36.618
test[junit4-twoForks-ff3] 24.251
test[junit47-twoForks-ff3] 24.222

FailFastTestNgIT

test[testng-oneFork-ff1] 9.682
test[testng-oneFork-ff2] 18.919
test[testng-twoForks-ff1] 15.197
test[testng-twoForks-ff2] 18.845
test[testng-oneFork-ff3] 36.771
test[testng-twoForks-ff3] 24.281

ForkConsoleOutputIT

printSummaryTrueWithRedirect 5.684
printSummaryFalseWithoutRedirect 6.239
printSummaryTrueWithoutRedirect 5.675
printSummaryFalseWithRedirect 5.898

ForkConsoleOutputWithErrorsIT

xmlFileContainsConsoleOutput 5.872

ForkModeIT

testForkModeOncePerThreadSingleThread 7.994
testForkModePerTest 9.366
testForkCountZero 6.884
testForkCountOneNoReuse 9.621
testForkCountTwoNoReuse 20.976
testForkModeNever 8.135
testForkCountTwoReuse 20.352
testForkCountOneReuse 7.968
testForkModeOncePerThreadTwoThreads 20.629
testForkModeAlways 9.556
testForkModeNone 6.943
testForkModeOnce 7.83

ForkModeMultiModuleIT

testForkCountOneNoReuse 11.031
testForkCountTwoNoReuse 9
testForkCountTwoReuse 8.108
testForkCountOneReuse 9.025

ForkModeTestNGIT

testForkModeOncePerThreadSingleThread 6.81
testForkModePerTest 8.967
testForkCountZero 5.747
testForkCountOneNoReuse 8.888
testForkCountTwoNoReuse 13.574
testForkModeNever 5.828
testForkCountTwoReuse 13.426
testForkCountOneReuse 7.049
testForkModeOncePerThreadTwoThreads 13.657
testForkModeAlways 9.113
testForkModeNone 6.337
testForkModeOnce 7.273

IncludesExcludesFromFileIT

testSimpleMixed 5.425
testMissingExcludes 4.173
testRegex 5.186
testPath 5.548
testMissingIncludes 3.914
testSimple 5.496

IncludesExcludesIT

testPathBasedIncludesExcludes 5.433
testIncludesExcludes 5.283
testRegexIncludesExcludes 5.432

Java9FullApiIT

shouldLoadMultipleJavaModules_JavaHome 7.908
shouldLoadMultipleJavaModules_ToolchainsXML 7.976
shouldLoadMultipleJavaModules_JvmParameter 8.518

Surefire1024VerifyFailsafeIfTestedIT

shouldScanAndRunTestsInDependencyJars 4.943

Surefire1028UnableToRunSingleIT

methodFilteringParallelExecution 4.759

Surefire1036NonFilterableJUnitRunnerWithCategoriesIT

test 4.762

Surefire1041FailingJUnitRunnerIT

reportErrorInJUnitRunnerAsTestError 6.068

Surefire1053SystemPropertiesIT

checkWarningsSysPropTwice 5.537
checkWarningsFileEncoding 5.753

Surefire1055CorrectConcurrentTestCountIT

testTestNgAndJUnitTogether 6.147

Surefire1080ParallelForkDoubleTestIT

test 6.214

Surefire1082ParallelJUnitParameterizedIT

checkClassesRunParallel 6.881
shouldRunTwo 8.361
checkOutFileClassesRunParallel 7.046

Surefire1098BalancedRunOrderIT

reorderedParallelClasses 27.328

Surefire1122ParallelAndFlakyTestsIT

parallelCreatesCorrectReportFork 5.969
nonParallelCreatesCorrectReport 5.93
parallelCreatesCorrectReport 4.558

Surefire1135ImproveIgnoreMessageForTestNGIT

testNgReport57 6.737
testNgReport688 7.043

Surefire1136CwdPropagationInForkedModeIT

testTestNgAndJUnitTogether 5.702

Surefire1144XmlRunTimeIT

testXmlRunTime 6.155

Surefire1152RerunFailingTestsInSuiteIT

testJUnit48Provider47 6.021
testJUnit48Provider4 5.866

Surefire1153IncludesAndSpecifiedTestIT

testSpecifiedTestInIncludes 4.411
testSpecifiedTestNotInIncludes 4.701

Surefire1158RemoveInfoLinesIT

shouldRunWithCliOption[junit-option-ff] 5.989
shouldRunWithCliOption[testng-option-ff] 5.938
shouldRunWithCliOption[junit-option-X] 6.237
shouldRunWithCliOption[testng-option-X] 6.516
shouldRunWithCliOption[junit-option-e] 6.033
shouldRunWithCliOption[testng-option-e] 5.903

Surefire1177TestngParallelSuitesIT

twoSuitesInParallelForked 7.348
twoSuitesInParallel 7.222

Surefire1179IT

suiteXmlForkCountTwoReuse 9.807

Surefire1185DoNotSpawnTestsIT

doNotSpawnUnwantedTests 4.659

Surefire1202RerunAndSkipIT

junit47 18.459
junit4 18.547

Surefire1209RerunAndForkCountIT

notReusableForksJUnit47 14.548
reusableForksJUnit47 13.875
reusableForksJUnit4 13.277
notReusableForksJUnit4 14.229

Surefire1211JUnitTestNgIT

withoutJUnit 6.522
withJUnit 6.491

Surefire1264IT

positiveTests 7.388
negativeTests 7.288

Surefire1265Java9IT

shouldRunInPluginJava9 4.533

Surefire1278GroupNameEndingIT

testOnlyGroups 6.24

Surefire1295AttributeJvmCrashesToTestsIT

test[0] 8.964
test[1] 11.81
test[2] 8.134
test[3] 12.608
test[4] 11.944
test[5] 8.888
test[6] 8.423
test[7] 11.532
test[8] 8.684

Surefire1364SystemPropertiesIT

junit47InProcessParallel 6.053
junit47Forked 6.097
junit47InProcess 5.936
testNg 6.775
junit3Forked 5.895
junit47ForkedParallel 6.022
junit4Forked 5.877
testNgInProcess 6.788
junit4InProcess 5.788
junit3InProcess 5.713

Surefire1367AssumptionLogsIT

shouldSeeLogsInPlugin 4.475
shouldSeeLogsParallelInPlugin 4.615
shouldSeeLogsParallelForked 5.742
shouldSeeLogsForked 5.642

Surefire1383ScanSessionDependenciesIT

test 5.132

Surefire1396CustomProviderClassPathIT

pluggableProviderClasspathCorrect 8.264

Surefire141PluggableProvidersIT

pluggableProviderPresent 8.01
invokeRuntimeException 7.795
invokeReporterException 7.769
constructorRuntimeException 7.399

Surefire146ForkPerTestNoSetupIT

testForkPerTestNoSetup 5.474

Surefire1490ReportTitleDescriptionIT

shouldHaveCustomizedReportTitleAndDescription 11.704
shouldHaveDefaultReportTitleAndDescription 10.649

Surefire1535TestNGParallelSuitesIT

forks0 6.757
forks2 7.643
forks0Redirected 7.079
forks2Redirected 7.43

Surefire162CharsetProviderIT

testCharsetProvider 5.716

Surefire224WellFormedXmlFailuresIT

testWellFormedXmlFailures 5.433

Surefire257NotRerunningTestsIT

shouldNotRerun 7.804

Surefire260TestWithIdenticalNamesIT

testWithIdenticalNames 10.35

Surefire34SecurityManagerIT

testSecurityManager 5.659
testSecurityManagerSuccessful 5.484

Surefire376TestNgAfterSuiteFailureIT

testAfterSuiteFailure 5.768

Surefire377TestNgAndJUnitTogetherIT

testTestNgAndJUnit4Together 5.373
testTestNgAndJUnitTogether 5.897

Surefire408ManualProviderSelectionIT

testParallelBuildResultCount 6.177

Surefire42NotExtendingTestCaseIT

testInnerClass 5.501

Surefire44InnerClassTestIT

testInnerClass 5.256

Surefire500PuzzlingErrorIT

testBuildFailingWhenErrors 5.75

Surefire510TestClassPathForkModesIT

testForkOnce 5.391
testForkAlways 5.379

Surefire569RunTestFromDependencyJarsIT

shouldScanAndRunTestsInDependencyJars 5.35

Surefire570MultipleReportDirectoriesIT

testReportWithAggregate 14.434
testReportWithoutAggregate 14.392

Surefire613TestCountInParallelIT

testParallelBuildResultCount 6.467

Surefire621TestCountingJunit3InParallelIT

testJunit3ParallelBuildResultCount 6.463
testJunit3ParallelSuiteBuildResultCount 6.216
testJunit3AllParallelBuildResultCount 6.156
testJunit3BuildResultCount 6.123
testJunit3SuiteBuildResultCount 6.541

Surefire628ConsoleOutputBeforeAndAfterClassIT

testJunit3ParallelBuildResultCount 6.104

Surefire634UnsettableSystemPropertiesWarningIT

testJunit3ParallelBuildResultCount 5.509

Surefire649EmptyStringSystemPropertiesIT

systemPropertyVariables 4.586
systemProperties 4.491

Surefire673MockitoIT

testBuildFailingWhenErrors 5.754

Surefire674BuildFailingWhenErrorsIT

testBuildFailingWhenErrors 5.669

Surefire674BuildFailingWhenFailsafeErrorsIT

testBuildFailingWhenErrors 3.345

Surefire685CommaSeparatedIncludesIT

testBuildFailingWhenErrors 5.778

Surefire697NiceSummaryIT

testBuildFailingWhenErrors 5.585

Surefire705ParallelForkTimeoutIT

testTimeoutForked 7.757

Surefire733AllOverrridesCapturedIT

testLogOutput 5.678

Surefire735ForkFailWithRedirectConsoleOutputIT

vmStartFail 5.01
vmStartFailShouldFailBuildk 4.852

Surefire740TruncatedCommaIT

testRussianLocaleReport 4.098

Surefire747MethodParallelWithSuiteCountIT

testMethodsParallelWithSuite 9.984
testClassesParallelWithSuite 12.135

Surefire772BothReportsIT

testSkippedSurefireReportGeneration 3.436
testSkippedFailsafeReportGeneration 3.199
testReportGeneration 3.436

Surefire772NoFailsafeReportsIT

testSkippedFailsafeReportGeneration 3.198
testForcedFailsafeReportGeneration 3.193
testSkipForcedFailsafeReportGeneration 3.201
testReportGeneration 3.3

Surefire772NoSurefireReportsIT

testOptionalSurefireReportGeneration 3.265
testSkippedSurefireReportGeneration 3.219
testSkipOptionalSurefireReportGeneration 3.165
testReportGeneration 3.287

Surefire772SpecifiedReportsIT

testSkippedSurefireReportGeneration 3.184
testSkippedFailsafeReportGeneration 3.138
testReportGeneration 3.399

Surefire801ForkModeNoneClassLoaderIT

testSHouldBeOkWithForkNever 4.446

Surefire803MultiFailsafeExecsIT

testOneExecutionRunInTwoBuilds 12.596
testSecondExecutionRunsAfterFirstExecutionFails 7.5

Surefire806SpecifiedTestControlsIT

singleTestInSingleExecutionProject 5.603
twoSpecifiedTestExecutionsInCorrectExecutionBlocks
+ [ Detail ]
 0
since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
singleTestInOneExecutionOfMultiExecutionProject
+ [ Detail ]
 0
since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution

Surefire809GroupExpressionsIT

testNGRunCategoryAB 6.182
testExcludedGroups 5.927
testJUnitRunCategoryNotC 6.104
incorrectJUnitVersions 3.591
categoryAB 6.066
testNGRunCategoryNotC 6.277

Surefire812Log4JClassLoaderIT

testJunit3ParallelBuildResultCount 5.886

Surefire817SystemExitIT

systemExit1 5.928

Surefire818NpeIgnoresTestsIT

testBuildFailingWhenErrors 6.162

Surefire828EmptyGroupExprIT

testJUnitRunEmptyExcludeGroups 6.169
testJUnitRunEmptyGroups 6.328
testTestNGRunEmptyExcludeGroups 6.087
testTestNGRunEmptyGroups 5.898

Surefire832ProviderSelectionIT

testJUnitRunCategoryAB 6.072

Surefire839TestWithoutCategoriesIT

classWithoutCategoryForked 6.377
classWithoutCategory 6.005

Surefire847AdditionalFailureIT

testJUnitRunCategoryAB 6.329

Surefire855AllowFailsafeUseArtifactFileIT

jarNotForkingShouldUseFile 9.495
jarShouldUseFile 9.973
warShouldUseClasses 10.944
osgiBundleShouldUseFile 11.765

Surefire901MIssingResultfileWhenNoTestsIT

failsafeWithNoTests 4.343

Surefire907PerThreadWithoutThreadCountIT

categoryAB 4.099

Surefire920TestFailureIgnoreWithTimeoutIT

timeoutInForkWithBuildFail 6.624
timeoutInForkWithNoBuildFail 6.592

Surefire926FailureWith2ProvidersIT

testBuildFailingWhenErrors 3.305

Surefire930TestNgSuiteXmlIT

suiteXmlRun 7.041

Surefire943ReportContentIT

test_noParallel 12.348
test_parallelBoth 7.014

Surefire946KillMainProcessInReusableForkIT

testExit 7.664
testHalt 7.528
testInterrupt 7.57

Surefire972BizarreNoClassDefIT

testJunit3ParallelBuildResultCount 6.961

Surefire975DefaultVMEncodingIT

runWithRussian1251 5.639

Surefire979WrongClassLoaderIT

wrongClassloaderUSedInSmartStacktraceparser 5.894

Surefire985ParameterizedRunnerAndCategoriesIT

test 5.144

Surefire995CategoryInheritanceIT

junit411ShouldRunExplicitCategory 4.638
junit411ShouldExcludeExplicitCategory 4.794
junit412ShouldExcludeInheritedCategory 4.858
junit412ShouldRunInheritedCategory 4.775
negativeTestShouldRunAllCategories 4.694

JUnit44HamcrestIT

testJUnit44Hamcrest 5.65

JUnit47ConcurrencyIT

test47 5.616

JUnit47ParallelIT

unknownThreadCountClasses 4.019
threadCountSuites 8.681
unlimitedThreadsSuitesAndMethods1 6.297
unlimitedThreadsSuitesAndMethods2 6.204
unknownThreadCountMethods 4.061
threadCountClassesAndMethods 6.447
reusableThreadCountClassesAndMethodsOptimized 6.711
unknownThreadCountSuites 3.973
reusableThreadCountAll 5.924
forcedShutdown 7.385
unknownThreadCountAll 4.113
serial 11.849
reusableThreadCountAllOptimized 5.988
suites 8.487
unlimitedThreadsMethods1 7.498
unlimitedThreadsMethods2 7.397
unlimitedThreadsSuitesAndClasses1 5.946
unlimitedThreadsSuitesAndClasses2 5.985
threadCountAllOptimized 6.283
threadCountAll 6.068
everyThreadCountSuitesAndClasses 5.981
unknownThreadCountBoth 3.914
threadCountSuitesAndClassesOptimized 5.949
classesAndMethods 5.607
everyThreadCountSuitesAndMethods 6.216
unknownThreadCountSuitesAndClasses 3.849
reusableThreadCountSuitesAndClassesOptimized 6.869
unknownThreadCountSuitesAndMethods 4.022
suitesAndClasses 6.178
suitesAndMethods 6.24
shutdown 9.954
threadCountClassesAndMethodsOneCore 9.66
everyThreadCountClassesAndMethods 6.052
all 5.151
unknownThreadCountClassesAndMethods 4.153
threadCountSuitesAndMethodsOptimized 6.27
reusableThreadCountSuitesAndMethodsOptimized 6.67
unlimitedThreadsClasses1 6.941
unlimitedThreadsClasses2 6.841
threadCountClasses 6.769
everyThreadCountAll 6.365
threadCountMethods 7.326
unlimitedThreadsSuites1 8.395
unlimitedThreadsSuites2 8.672
threadCountSuitesAndClasses 5.969
unlimitedThreadsClassesAndMethods1 5.642
unlimitedThreadsClassesAndMethods2 5.548
threadCountSuitesAndMethods 6.176
classes 6.983
reusableThreadCountSuitesAndClasses 6.713
methods 7.239
reusableThreadCountSuitesAndMethods 6.598
timeoutAndForcedShutdown 7.275
threadCountClassesAndMethodsOptimized 6.055
unlimitedThreadsAll1 5.438
unlimitedThreadsAll2 5.149
forcedShutdownVerifyingLogs 5.922
threadCountClassesAndMethodsOneCoreOptimized 9.895
reusableThreadCountClassesAndMethods 7.058

JUnit47ParallelNotThreadSafeIT

test 4.753

JUnit47RedirectOutputIT

testClassesParallel 6.129
testPrintSummaryTrueWithRedirect 6.155

JUnit47RerunFailingTestWithCucumberIT

testRerunFailingErrorTestsFalse 5.482
testRerunFailingErrorTestsWithOneRetry 5.483
testRerunFailingErrorTestsTwoRetry 5.791

JUnit47StaticInnerClassTestsIT

testStaticInnerClassTests 4.645

JUnit47WithCucumberIT

testWithParallelClasses 5.447
testWithoutParallel 5.267

JUnit48TestCategoriesIT

testCategoriesACFullyQualifiedClassName 5.82
testBadCategoryForkAlways 7.612
testCategoriesABForkAlways 7.694
testCategoriesBadCategory 5.736
testCategoriesACClassNameSuffix 5.98
testCategoriesACFullyQualifiedClassNameForkAlways 7.664
testCategoriesAB 6.318
testCategoriesACClassNameSuffixForkAlways 7.752

JUnit4ForkAlwaysStaticInitPollutionIT

testJunit4Ignore 6.495

JUnit4IgnoreIT

testJunit4Ignore 5.657
testJunit47ParallelIgnore 5.919

JUnit4RerunFailingTestsIT

testRerunFailingErrorTestsFalse 23.992
testRerunFailingErrorTestsWithOneRetry 23.884
testRerunFailingErrorTestsTwoRetry 23.743
testRerunOneTestMethod 23.426
testRerunOneTestClass 23.797

JUnit4RunListenerIT

testJUnit4RunListener 5.806
testRunlistenerJunitCoreProvider 5.987

JUnit4VersionsIT

testJunit[0: JUnit 4.0] 5.706
testJunit[1: JUnit 4.1] 5.657
testJunit[2: JUnit 4.2] 5.587
testJunit[3: JUnit 4.3] 5.609
testJunit[4: JUnit 4.3.1] 5.619
testJunit[5: JUnit 4.4] 5.533
testJunit[6: JUnit 4.5] 5.631
testJunit[7: JUnit 4.6] 5.55
testJunit[8: JUnit 4.7] 5.451
testJunit[9: JUnit 4.8] 5.567
testJunit[10: JUnit 4.8.1] 5.55
testJunit[11: JUnit 4.8.2] 5.689
testJunit[12: JUnit 4.9] 5.726
testJunit[13: JUnit 4.10] 5.604
testJunit[14: JUnit 4.11] 5.847
testJunit[15: JUnit 4.12] 5.739

JUnitDepIT

testJUnit44DepWithSneaky381 5.828
testJUnit44Dep 5.776
testJUnit47Dep 6.012
testJUnit48Dep 6.104

JUnitPlatformEnginesIT

testToRegex[1.0.0] 0.002
platform[1.0.0] 5.968
testToRegex[1.1.1] 0
platform[1.1.1] 6.412
testToRegex[1.2.0] 0
platform[1.2.0] 6.058
testToRegex[1.3.1] 0
platform[1.3.1] 6.071
testToRegex[1.4.0-SNAPSHOT] 0
platform[1.4.0-SNAPSHOT] 7.379

JUnitPlatformIT

testVintageEngine 5.896
testTags 5.682
testJQwikEngine 5.707
testMultipleEngines 6.514
testJupiterEngine 6.109

LongWindowsPathIT

shouldRunInSystemTmp 5.737

ModulePathIT

testModulePath 7.473

NoRunnableTestsInClassIT

testJunit3ParallelBuildResultCount 5.644

PlainOldJavaClasspathIT

testPlainOldJavaClasspath 5.408

PlexusConflictIT

testPlexusConflict 5.639
testPlexusConflictIsolatedClassLoader 5.494

PojoSimpleIT

testit 5.358

ReportersIT

testRedirectOutputTestNg 5.93

ResultCountingIT

testCountingWithJunit481ForkAlways 9.11
testCountingWithJunit481ForkOnce 5.961
testCountingWithJunit481ForkNever 4.682

RunOrderIT

testReverseAlphabetical 5.677
testNonExistingRunOrder 3.999
testHourly 5.475
testAlphabetical 5.689

RunOrderParallelForksIT

testReverseAlphabetical 5.596
testNonExistingRunOrder 3.806
testHourly 5.759
testAlphabetical 5.729

SiblingAggregatorIT

testSiblingAggregator 4.516

SmartStackTraceIT

misg 5.689

SystemPropertiesTestIT

testSystemProperties 5.801
testSystemPropertiesNoFork 4.49

TestMethodPatternIT

testJUnit48WithCategoryFilter 5.66
testJUnit48Provider47 6.149
testMethodPatternAfter 5.746
testTestNGMethodPattern 6.21
testJUnit48Provider4 6.759
testJUnit44 6.127
testTestNgMethodBefore 6.114

TestMultipleMethodPatternsIT

shouldNotRunExcludedClassesAndMethods[0] 4.944
shouldMatchExactClassAndMethodCharacters[0] 6.173
shouldMatchExactClassAndMethodWildcard[0] 5.392
testSuccessTwo[0] 5.549
simpleNameTest[0] 4.725
simpleNameTestWithJavaExt[0] 5.031
regexClass[0] 4.805
shouldNotRunExcludedClasses[0] 4.906
shouldNotRunExcludedMethods[0] 4.952
simpleNameTestWithJavaExtWildcardPkg[0] 4.83
shouldMatchMultiplePatterns[0] 4.877
shouldMatchExactClassAndMethodsPostfix[0] 4.824
simpleNameTestWithWildcardPkg[0] 4.717
shouldMatchWildcardPackageAndClassAndMethod[0] 4.76
shouldMatchExactClassAndMultipleMethods[0] 4.661
fullyQualifiedTest[0] 4.677
matchSimpleClassAndMethodWithJavaExtWildcardPkg[0] 4.75
negativeTest[0]
+ [ Detail ]
 0
skipped
testRegexSuccessTwo[0] 4.921
shouldMatchExactClassAndMethodsWildcard[0] 4.638
shouldMatchMultiplePatternsComplex[0] 5.074
simpleNameTestAsParallel[0]
+ [ Detail ]
 0.001
skipped
matchSimpleClassAndMethodWithWildcardPkg[0] 4.805
shouldMatchMultiplePatternsAsParallel[0]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[0] 4.784
shouldMatchSimpleClassNameAndMethod[0] 4.569
shouldMatchExactClassAndMethodPostfix[0] 4.752
shouldMatchMultiplePatternsComplexAsParallel[0]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[0] 4.684
regexClassAndMethod[0] 4.882
shouldNotRunExcludedClassesAndMethods[1] 4.933
shouldMatchExactClassAndMethodCharacters[1] 4.803
shouldMatchExactClassAndMethodWildcard[1] 4.763
testSuccessTwo[1] 5.205
simpleNameTest[1] 4.733
simpleNameTestWithJavaExt[1] 4.992
regexClass[1] 4.698
shouldNotRunExcludedClasses[1] 4.681
shouldNotRunExcludedMethods[1] 5.133
simpleNameTestWithJavaExtWildcardPkg[1] 4.695
shouldMatchMultiplePatterns[1] 4.908
shouldMatchExactClassAndMethodsPostfix[1] 5
simpleNameTestWithWildcardPkg[1] 4.877
shouldMatchWildcardPackageAndClassAndMethod[1] 4.911
shouldMatchExactClassAndMultipleMethods[1] 4.906
fullyQualifiedTest[1] 4.733
matchSimpleClassAndMethodWithJavaExtWildcardPkg[1] 4.817
negativeTest[1]
+ [ Detail ]
 0.001
skipped
testRegexSuccessTwo[1] 4.928
shouldMatchExactClassAndMethodsWildcard[1] 4.703
shouldMatchMultiplePatternsComplex[1] 4.94
simpleNameTestAsParallel[1] 4.812
matchSimpleClassAndMethodWithWildcardPkg[1] 4.836
shouldMatchMultiplePatternsAsParallel[1] 4.995
shouldNotRunExcludedClassesIfIncluded[1] 4.842
shouldMatchSimpleClassNameAndMethod[1] 4.939
shouldMatchExactClassAndMethodPostfix[1] 4.833
shouldMatchMultiplePatternsComplexAsParallel[1] 5.089
matchSimpleClassAndMethodWithJavaExt[1] 5.104
regexClassAndMethod[1] 4.8
shouldNotRunExcludedClassesAndMethods[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[2]
+ [ Detail ]
 0
skipped
testSuccessTwo[2]
+ [ Detail ]
 0
skipped
simpleNameTest[2] 4.73
simpleNameTestWithJavaExt[2] 4.51
regexClass[2] 4.746
shouldNotRunExcludedClasses[2] 4.575
shouldNotRunExcludedMethods[2]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[2] 4.839
shouldMatchMultiplePatterns[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[2]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[2] 4.52
shouldMatchWildcardPackageAndClassAndMethod[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[2]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[2] 4.526
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2]
+ [ Detail ]
 0
skipped
negativeTest[2] 4.069
testRegexSuccessTwo[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[2]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[2]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithWildcardPkg[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[2]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[2] 4.699
shouldMatchSimpleClassNameAndMethod[2]
+ [ Detail ]
 0.001
skipped
shouldMatchExactClassAndMethodPostfix[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[2]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[2]
+ [ Detail ]
 0
skipped
regexClassAndMethod[2]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesAndMethods[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[3]
+ [ Detail ]
 0
skipped
testSuccessTwo[3]
+ [ Detail ]
 0
skipped
simpleNameTest[3] 4.819
simpleNameTestWithJavaExt[3] 4.885
regexClass[3] 4.889
shouldNotRunExcludedClasses[3] 4.934
shouldNotRunExcludedMethods[3]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[3] 4.586
shouldMatchMultiplePatterns[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[3]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[3] 4.914
shouldMatchWildcardPackageAndClassAndMethod[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[3]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[3] 4.819
matchSimpleClassAndMethodWithJavaExtWildcardPkg[3]
+ [ Detail ]
 0
skipped
negativeTest[3] 4.084
testRegexSuccessTwo[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[3]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[3]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[3] 4.946
matchSimpleClassAndMethodWithWildcardPkg[3]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[3]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[3] 4.897
shouldMatchSimpleClassNameAndMethod[3]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[3]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[3]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[3]
+ [ Detail ]
 0
skipped
regexClassAndMethod[3]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesAndMethods[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[4]
+ [ Detail ]
 0
skipped
testSuccessTwo[4]
+ [ Detail ]
 0
skipped
simpleNameTest[4] 4.814
simpleNameTestWithJavaExt[4] 4.821
regexClass[4] 4.802
shouldNotRunExcludedClasses[4] 4.831
shouldNotRunExcludedMethods[4]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[4] 4.787
shouldMatchMultiplePatterns[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[4]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[4] 5.069
shouldMatchWildcardPackageAndClassAndMethod[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[4]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[4] 4.949
matchSimpleClassAndMethodWithJavaExtWildcardPkg[4]
+ [ Detail ]
 0
skipped
negativeTest[4] 4.139
testRegexSuccessTwo[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[4]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[4]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[4]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithWildcardPkg[4]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[4]
+ [ Detail ]
 0.001
skipped
shouldNotRunExcludedClassesIfIncluded[4] 4.797
shouldMatchSimpleClassNameAndMethod[4]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[4]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[4]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[4]
+ [ Detail ]
 0
skipped
regexClassAndMethod[4]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesAndMethods[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[5]
+ [ Detail ]
 0
skipped
testSuccessTwo[5]
+ [ Detail ]
 0
skipped
simpleNameTest[5] 4.957
simpleNameTestWithJavaExt[5] 4.949
regexClass[5] 4.825
shouldNotRunExcludedClasses[5] 4.873
shouldNotRunExcludedMethods[5]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[5] 4.896
shouldMatchMultiplePatterns[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[5]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[5] 4.771
shouldMatchWildcardPackageAndClassAndMethod[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[5]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[5] 4.881
matchSimpleClassAndMethodWithJavaExtWildcardPkg[5]
+ [ Detail ]
 0
skipped
negativeTest[5] 4.017
testRegexSuccessTwo[5]
+ [ Detail ]
 0.001
skipped
shouldMatchExactClassAndMethodsWildcard[5]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[5]
+ [ Detail ]
 0
skipped
simpleNameTestAsParallel[5] 5.111
matchSimpleClassAndMethodWithWildcardPkg[5]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[5]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[5] 4.86
shouldMatchSimpleClassNameAndMethod[5]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodPostfix[5]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[5]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[5]
+ [ Detail ]
 0
skipped
regexClassAndMethod[5]
+ [ Detail ]
 0
skipped

TestMultipleMethodPatternsTestNGIT

shouldNotRunExcludedClassesAndMethods[0] 4.768
shouldMatchExactClassAndMethodCharacters[0] 4.871
shouldMatchExactClassAndMethodWildcard[0] 4.935
testSuccessTwo[0] 5.271
simpleNameTest[0] 4.773
simpleNameTestWithJavaExt[0] 4.769
regexClass[0] 4.786
shouldNotRunExcludedClasses[0] 4.785
shouldNotRunExcludedMethods[0] 4.999
simpleNameTestWithJavaExtWildcardPkg[0] 5.232
shouldMatchMultiplePatterns[0] 4.841
shouldMatchExactClassAndMethodsPostfix[0] 4.711
simpleNameTestWithWildcardPkg[0] 4.811
shouldMatchWildcardPackageAndClassAndMethod[0] 4.719
shouldMatchExactClassAndMultipleMethods[0] 4.803
fullyQualifiedTest[0] 4.992
matchSimpleClassAndMethodWithJavaExtWildcardPkg[0] 4.696
negativeTest[0]
+ [ Detail ]
 0
skipped
testRegexSuccessTwo[0] 4.718
shouldMatchExactClassAndMethodsWildcard[0] 4.582
shouldMatchMultiplePatternsComplex[0] 4.797
simpleNameTestAsParallel[0] 4.638
matchSimpleClassAndMethodWithWildcardPkg[0] 4.843
shouldMatchMultiplePatternsAsParallel[0] 5.021
shouldNotRunExcludedClassesIfIncluded[0] 4.692
shouldMatchSimpleClassNameAndMethod[0] 4.958
shouldMatchExactClassAndMethodPostfix[0] 4.514
shouldMatchMultiplePatternsComplexAsParallel[0] 4.958
matchSimpleClassAndMethodWithJavaExt[0] 4.658
regexClassAndMethod[0] 4.731
shouldNotRunExcludedClassesAndMethods[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[1]
+ [ Detail ]
 0
skipped
testSuccessTwo[1]
+ [ Detail ]
 0
skipped
simpleNameTest[1] 5.022
simpleNameTestWithJavaExt[1] 4.894
regexClass[1] 4.691
shouldNotRunExcludedClasses[1] 4.94
shouldNotRunExcludedMethods[1]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[1] 4.888
shouldMatchMultiplePatterns[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[1]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[1] 4.919
shouldMatchWildcardPackageAndClassAndMethod[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[1]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[1] 4.844
matchSimpleClassAndMethodWithJavaExtWildcardPkg[1]
+ [ Detail ]
 0
skipped
negativeTest[1] 4.073
testRegexSuccessTwo[1]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[1]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[1]
+ [ Detail ]
 0.001
skipped
simpleNameTestAsParallel[1] 4.791
matchSimpleClassAndMethodWithWildcardPkg[1]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[1]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[1] 4.737
shouldMatchSimpleClassNameAndMethod[1]
+ [ Detail ]
 0.001
skipped
shouldMatchExactClassAndMethodPostfix[1]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[1]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[1]
+ [ Detail ]
 0
skipped
regexClassAndMethod[1]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesAndMethods[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodCharacters[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodWildcard[2]
+ [ Detail ]
 0
skipped
testSuccessTwo[2]
+ [ Detail ]
 0
skipped
simpleNameTest[2] 4.769
simpleNameTestWithJavaExt[2] 4.797
regexClass[2] 4.873
shouldNotRunExcludedClasses[2] 4.891
shouldNotRunExcludedMethods[2]
+ [ Detail ]
 0
skipped
simpleNameTestWithJavaExtWildcardPkg[2] 4.831
shouldMatchMultiplePatterns[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsPostfix[2]
+ [ Detail ]
 0
skipped
simpleNameTestWithWildcardPkg[2] 5.021
shouldMatchWildcardPackageAndClassAndMethod[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMultipleMethods[2]
+ [ Detail ]
 0
skipped
fullyQualifiedTest[2] 5.143
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2]
+ [ Detail ]
 0
skipped
negativeTest[2] 4.156
testRegexSuccessTwo[2]
+ [ Detail ]
 0
skipped
shouldMatchExactClassAndMethodsWildcard[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplex[2]
+ [ Detail ]
 0.001
skipped
simpleNameTestAsParallel[2] 4.868
matchSimpleClassAndMethodWithWildcardPkg[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsAsParallel[2]
+ [ Detail ]
 0
skipped
shouldNotRunExcludedClassesIfIncluded[2] 4.905
shouldMatchSimpleClassNameAndMethod[2]
+ [ Detail ]
 0.001
skipped
shouldMatchExactClassAndMethodPostfix[2]
+ [ Detail ]
 0
skipped
shouldMatchMultiplePatternsComplexAsParallel[2]
+ [ Detail ]
 0
skipped
matchSimpleClassAndMethodWithJavaExt[2]
+ [ Detail ]
 0
skipped
regexClassAndMethod[2]
+ [ Detail ]
 0
skipped

TestMultipleMethodsIT

testJunit48Provider4 6.104
testJunit44 4.847
testJunit48Provider47 6.409

TestNgGroupsIT

testExclusion 6.15
testGroupsAndExclusion 6.234
groupsWithDash 6.201
testOnlyGroups 7.04
groupsBySimpleRegex 6.483

TestNgParallelWithAnnotationsIT

testTestNgGroupThreadParallel 7.053

TestNgSuccessPercentageIT

testPassesWhenFailuresLessThanSuccessPercentage 4.798

TestSingleMethodIT

fullyQualifiedTestNg 6.093
testJunit48Provider4 6.167
testJunit44 5.787
testJunit48parallel 5.798
testJunit48Provider47 6.297
fullyQualifiedJunit48Provider47 6.124
fullyQualifiedJunit48Provider4 5.918
testTestNg5149 6.451
testTestNg 6.318

TimeoutForkedTestIT

testTimeoutForked 6.306

TwoTestCasesIT

testJunit4Suite 5.814
testTestNGSuite 5.885
testTwoTestCases 5.446
testTwoTestCaseSuite 5.573

UmlautDirIT

testUmlautIsolatedClassLoader 5.565
testUmlaut 5.617

UnicodeTestNamesIT

checkFileNamesWithUnicode 7.694

UseIsolatedClassLoaderIT

testUseSystemClassLoader 5.531

WorkingDirectoryIsInvalidPropertyIT

testWorkingDirectory 4.155

WorkingDirectoryIT

testWorkingDirectory 5.66
testWorkingDirectoryChildOnlyNoFork 4.372
testWorkingDirectoryNoFork 4.465
testWorkingDirectoryChildOnly 5.365

WorkingDirectoryMissingIT

testWorkingDirectory 5.132

XmlReporterRunTimeIT

testForkModeAlways 24.433

Failure Details

[Summary] [Package List] [Test Cases]


XXXtest50
skipped: 5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
XXXtest501
skipped: 5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
twoSpecifiedTestExecutionsInCorrectExecutionBlocks
skipped: since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
singleTestInOneExecutionOfMultiExecutionProject
skipped: since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution
negativeTest[0]
skipped: skipped
simpleNameTestAsParallel[0]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[0]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[0]
skipped: skipped
negativeTest[1]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[2]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[2]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[2]
skipped: skipped
testSuccessTwo[2]
skipped: skipped
shouldNotRunExcludedMethods[2]
skipped: skipped
shouldMatchMultiplePatterns[2]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[2]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[2]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2]
skipped: skipped
testRegexSuccessTwo[2]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[2]
skipped: skipped
shouldMatchMultiplePatternsComplex[2]
skipped: skipped
simpleNameTestAsParallel[2]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[2]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[2]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[2]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[2]
skipped: skipped
regexClassAndMethod[2]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[3]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[3]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[3]
skipped: skipped
testSuccessTwo[3]
skipped: skipped
shouldNotRunExcludedMethods[3]
skipped: skipped
shouldMatchMultiplePatterns[3]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[3]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[3]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[3]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[3]
skipped: skipped
testRegexSuccessTwo[3]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[3]
skipped: skipped
shouldMatchMultiplePatternsComplex[3]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[3]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[3]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[3]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[3]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[3]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[3]
skipped: skipped
regexClassAndMethod[3]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[4]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[4]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[4]
skipped: skipped
testSuccessTwo[4]
skipped: skipped
shouldNotRunExcludedMethods[4]
skipped: skipped
shouldMatchMultiplePatterns[4]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[4]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[4]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[4]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[4]
skipped: skipped
testRegexSuccessTwo[4]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[4]
skipped: skipped
shouldMatchMultiplePatternsComplex[4]
skipped: skipped
simpleNameTestAsParallel[4]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[4]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[4]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[4]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[4]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[4]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[4]
skipped: skipped
regexClassAndMethod[4]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[5]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[5]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[5]
skipped: skipped
testSuccessTwo[5]
skipped: skipped
shouldNotRunExcludedMethods[5]
skipped: skipped
shouldMatchMultiplePatterns[5]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[5]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[5]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[5]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[5]
skipped: skipped
testRegexSuccessTwo[5]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[5]
skipped: skipped
shouldMatchMultiplePatternsComplex[5]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[5]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[5]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[5]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[5]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[5]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[5]
skipped: skipped
regexClassAndMethod[5]
skipped: skipped
negativeTest[0]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[1]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[1]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[1]
skipped: skipped
testSuccessTwo[1]
skipped: skipped
shouldNotRunExcludedMethods[1]
skipped: skipped
shouldMatchMultiplePatterns[1]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[1]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[1]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[1]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[1]
skipped: skipped
testRegexSuccessTwo[1]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[1]
skipped: skipped
shouldMatchMultiplePatternsComplex[1]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[1]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[1]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[1]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[1]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[1]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[1]
skipped: skipped
regexClassAndMethod[1]
skipped: skipped
shouldNotRunExcludedClassesAndMethods[2]
skipped: skipped
shouldMatchExactClassAndMethodCharacters[2]
skipped: skipped
shouldMatchExactClassAndMethodWildcard[2]
skipped: skipped
testSuccessTwo[2]
skipped: skipped
shouldNotRunExcludedMethods[2]
skipped: skipped
shouldMatchMultiplePatterns[2]
skipped: skipped
shouldMatchExactClassAndMethodsPostfix[2]
skipped: skipped
shouldMatchWildcardPackageAndClassAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMultipleMethods[2]
skipped: skipped
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2]
skipped: skipped
testRegexSuccessTwo[2]
skipped: skipped
shouldMatchExactClassAndMethodsWildcard[2]
skipped: skipped
shouldMatchMultiplePatternsComplex[2]
skipped: skipped
matchSimpleClassAndMethodWithWildcardPkg[2]
skipped: skipped
shouldMatchMultiplePatternsAsParallel[2]
skipped: skipped
shouldMatchSimpleClassNameAndMethod[2]
skipped: skipped
shouldMatchExactClassAndMethodPostfix[2]
skipped: skipped
shouldMatchMultiplePatternsComplexAsParallel[2]
skipped: skipped
matchSimpleClassAndMethodWithJavaExt[2]
skipped: skipped
regexClassAndMethod[2]
skipped: skipped