Fork me on GitHub

Failsafe Report

Summary

[Summary] [Package List] [Test Cases]


Tests Errors Failures Skipped Success Rate Time
446 0 0 11 97.534% 5,427.483

Note: failures are anticipated and checked for with assertions while errors are unanticipated.


Package List

[Summary] [Package List] [Test Cases]


Package Tests Errors Failures Skipped Success Rate Time
org.apache.maven.surefire.its 446 0 0 11 97.534% 5,427.483

Note: package statistics are not computed recursively, they only sum up all of its testsuites numbers.

org.apache.maven.surefire.its

Class Tests Errors Failures Skipped Success Rate Time
AbstractTestCaseIT 1 0 0 0 100% 7.578
AdditionalClasspathIT 1 0 0 0 100% 7.507
AggregateReportIT 1 0 0 0 100% 9.734
ArgLineIT 1 0 0 0 100% 8.61
ArgLinePropertiesIT 1 0 0 0 100% 8.788
AssumptionFailureReportIT 1 0 0 0 100% 9.129
CheckSingleTestIT 4 0 0 0 100% 29.972
CheckTestFailIfNoTestsForkModeIT 6 0 0 0 100% 45.527
CheckTestFailIfNoTestsIT 3 0 0 0 100% 15.313
CheckTestNgBeforeMethodFailureIT 1 0 0 0 100% 9.223
CheckTestNgBeforeMethodIT 1 0 0 0 100% 8.944
CheckTestNgCustomObjectFactoryIT 1 0 0 0 100% 8.419
CheckTestNgCustomTestRunnerFactoryIT 1 0 0 0 100% 11.882
CheckTestNgExecuteErrorIT 1 0 0 0 100% 11.941
CheckTestNgGroupThreadParallelIT 1 0 0 0 100% 8.175
CheckTestNgJdk14IT 1 0 0 0 100% 9.67
CheckTestNgListenerReporterIT 9 0 0 0 100% 92.717
CheckTestNgListenersIT 1 0 0 0 100% 8.534
CheckTestNgPathWithSpacesIT 1 0 0 0 100% 9.251
CheckTestNgReportTestIT 3 0 0 0 100% 30.428
CheckTestNgSuiteXmlIT 3 0 0 0 100% 28.089
CheckTestNgSuiteXmlSingleIT 1 0 0 0 100% 8.868
CheckTestNgVersionsIT 20 0 0 2 90% 184.565
ClasspathFilteringIT 1 0 0 0 100% 9.348
ClassPathOrderIT 1 0 0 0 100% 10.686
ClasspathScopeFilteringIT 1 0 0 0 100% 7.873
ConsoleOutputIT 8 0 0 0 100% 182.446
CrashDetectionIT 3 0 0 0 100% 27.468
DefaultConfigurationIT 1 0 0 0 100% 10.741
EnvironmentVariableIT 1 0 0 0 100% 12.972
EnvironmentVariablesIT 3 0 0 0 100% 31.14
FailFastJUnitIT 14 0 0 0 100% 240.042
FailFastTestNgIT 8 0 0 0 100% 152.267
ForkConsoleOutputIT 4 0 0 0 100% 34.786
ForkConsoleOutputWithErrorsIT 1 0 0 0 100% 17.42
ForkModeIT 12 0 0 0 100% 183.332
ForkModeMultiModuleIT 4 0 0 0 100% 60.345
ForkModeTestNGIT 12 0 0 0 100% 148.019
IncludesExcludesFromFileIT 6 0 0 0 100% 47.329
IncludesExcludesIT 3 0 0 0 100% 25.514
Java9FullApiIT 3 0 0 3 0% 0.006
JUnit44HamcrestIT 1 0 0 0 100% 8.988
JUnit47ConcurrencyIT 1 0 0 0 100% 10.913
JUnit47ParallelIT 59 0 0 0 100% 657.924
JUnit47ParallelNotThreadSafeIT 1 0 0 0 100% 10.755
JUnit47RedirectOutputIT 2 0 0 0 100% 20.578
JUnit47RerunFailingTestWithCucumberIT 6 0 0 0 100% 69.57
JUnit47StaticInnerClassTestsIT 1 0 0 0 100% 9.845
JUnit47WithCucumberIT 2 0 0 0 100% 19.799
JUnit48TestCategoriesIT 8 0 0 0 100% 94.803
JUnit4ForkAlwaysStaticInitPollutionIT 1 0 0 0 100% 11.525
JUnit4IgnoreIT 2 0 0 0 100% 20.583
JUnit4RerunFailingTestsIT 5 0 0 0 100% 216.439
JUnit4RunListenerIT 2 0 0 0 100% 22.183
JUnit4VersionsIT 17 0 0 0 100% 186.687
JUnitDepIT 4 0 0 0 100% 49.269
JUnitPlatformEnginesIT 105 0 0 3 97.143% 1,165.464
JUnitPlatformIT 24 0 0 0 100% 287.011
JUnitPlatformRerunFailingTestsIT 6 0 0 0 100% 263.109
JUnitPlatformStreamCorruptionIT 1 0 0 0 100% 11.949
LongWindowsPathIT 1 0 0 0 100% 11.353
ModulePathIT 2 0 0 2 0% 0.006
MultiModuleProjectWithJPMSIT 1 0 0 1 0% 0.009
NoRunnableTestsInClassIT 1 0 0 0 100% 9.167
PlainOldJavaClasspathIT 1 0 0 0 100% 10.757
PlexusConflictIT 2 0 0 0 100% 19.129
PojoSimpleIT 1 0 0 0 100% 8.349
ReportersIT 1 0 0 0 100% 9.259
ResultCountingIT 3 0 0 0 100% 30.03
RunOrderIT 8 0 0 0 100% 95.244
RunOrderParallelForksIT 8 0 0 0 100% 98.747
SiblingAggregatorIT 1 0 0 0 100% 10.307
SmartStackTraceIT 1 0 0 0 100% 10.886
Surefire1602IT 1 0 0 0 100% 24.488
SystemPropertiesTestIT 2 0 0 0 100% 20.99
TestMethodPatternIT 14 0 0 0 100% 156.771

Test Cases

[Summary] [Package List] [Test Cases]

AbstractTestCaseIT

abstractTestCase 7.554

AdditionalClasspathIT

additionalClasspath 7.499

AggregateReportIT

aggregateReport 9.73

ArgLineIT

argLine 8.597

ArgLinePropertiesIT

argLine 8.785

AssumptionFailureReportIT

testWriteSkippedMessageToReport 9.124

CheckSingleTestIT

singleTestDotJava 9.414
singleTestNonExistentOverride 6.546
singleTestNonExistent 6.431
singleTest 7.578

CheckTestFailIfNoTestsForkModeIT

dontFailIfNoTestsForkModeAlways 7.498
failIfNoTestsForkModeOnce 7.605
dontFailIfNoTestsForkModeNever 7.513
dontFailIfNoTestsForkModeOnce 7.936
failIfNoTestsForkModeNever 7.622
failIfNoTestsForkModeAlways 7.348

CheckTestFailIfNoTestsIT

failIfNoTests 5.236
dontFailIfNoTests 5.129
jUnit48CategoriesFailWhenNoTests 4.938

CheckTestNgBeforeMethodFailureIT

testNgBeforeMethodFailure 9.22

CheckTestNgBeforeMethodIT

testNgBeforeMethod 8.943

CheckTestNgCustomObjectFactoryIT

testTestNgListenerReporter 8.408

CheckTestNgCustomTestRunnerFactoryIT

testTestNgListenerReporter 11.879

CheckTestNgExecuteErrorIT

executionError 11.939

CheckTestNgGroupThreadParallelIT

testNgGroupThreadParallel 8.172

CheckTestNgJdk14IT

testNgJdk14 9.591

CheckTestNgListenerReporterIT

testNgListenerReporter[0: TestNG 5.6] 11.032
testNgListenerReporter[1: TestNG 5.7] 10.287
testNgListenerReporter[2: TestNG 5.10] 11.4
testNgListenerReporter[3: TestNG 5.13] 12.174
testNgListenerReporter[4: TestNG 5.14.6] 9.597
testNgListenerReporter[5: TestNG 5.14.9] 9.46
testNgListenerReporter[6: TestNG 6.0] 9.004
testNgListenerReporter[7: TestNG 6.14.3] 9.547
testNgListenerReporter[8: TestNG 7.0.0] 10.213

CheckTestNgListenersIT

testNgListenerReporter 8.532

CheckTestNgPathWithSpacesIT

testWithSpaces 9.248

CheckTestNgReportTestIT

testNgReport 11.175
shouldNotBeVerbose 9.705
shouldBeVerbose 9.545

CheckTestNgSuiteXmlIT

suiteXml 9.395
suiteXmlForkCountTwoReuse 8.682
suiteXmlForkModeAlways 10.009

CheckTestNgSuiteXmlSingleIT

testNgSuite 8.865

CheckTestNgVersionsIT

test502 9.648
test510 9.337
test511 10.129
test512 10.116
test513 9.961
test514 9.898
test685 10.422
test5131 10.655
test5141 10.28
test5142 10.223
test47 11.543
test51 13.895
test55 10.001
test56 9.636
test57 9.954
test58 9.557
test59 9.442
test60 9.862
xXXtest501 0
5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
xXXtest50 0
5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024

ClasspathFilteringIT

additionalClasspath 9.346

ClassPathOrderIT

classPathOrder 10.685

ClasspathScopeFilteringIT

additionalClasspath 7.871

ConsoleOutputIT

properNewlinesAndEncodingWithDifferentEncoding[0] 9.443
properNewlinesAndEncodingWithDefaultEncodings[0] 10.127
largerSoutThanMemory[0] 60.741
properNewlinesAndEncodingWithoutFork[0] 8.448
properNewlinesAndEncodingWithDifferentEncoding[1] 8.661
properNewlinesAndEncodingWithDefaultEncodings[1] 9.105
largerSoutThanMemory[1] 66.513
properNewlinesAndEncodingWithoutFork[1] 9.404

CrashDetectionIT

hardCrashInReusableFork 9.169
crashInReusableFork 9.012
crashInFork 9.284

DefaultConfigurationIT

defaultConfiguration 10.739

EnvironmentVariableIT

environmentVariable 12.954

EnvironmentVariablesIT

testWhenUseSystemClassLoader 12.578
testExcludedEnv 9.884
testWhenDontUseSystemClassLoader 8.659

FailFastJUnitIT

test[junit4-oneFork-ff1] 20.398
test[junit47-oneFork-ff1] 1.253
test[junit4-oneFork-ff2] 30.425
test[junit47-oneFork-ff2] 3.018
test[junit4-twoForks-ff1] 22.549
test[junit47-twoForks-ff1] 6.171
test[junit4-twoForks-ff2] 22.227
test[junit4-twoForks-ff2-tcp] 9.078
test[junit47-twoForks-ff2] 20.001
test[junit4-oneFork-ff3] 32.987
test[junit47-oneFork-ff3] 18.866
test[junit4-twoForks-ff3] 15.243
test[junit47-twoForks-ff3] 21.123
test[junit47-twoForks-ff3-tcp] 37.821

FailFastTestNgIT

test[testng-oneFork-ff1] 21.302
test[testng-oneFork-ff2] 12.418
test[testng-twoForks-ff1] 11.655
test[testng-twoForks-ff2] 20.795
test[testng-twoForks-ff2-tcp] 15.788
test[testng-twoForks-ff3] 35.208
test[testng-oneFork-ff3] 1.937
test[testng-twoForks-ff3-tcp] 35.099

ForkConsoleOutputIT

printSummaryTrueWithRedirect 8.898
printSummaryFalseWithoutRedirect 8.9
printSummaryTrueWithoutRedirect 8.668
printSummaryFalseWithRedirect 8.31

ForkConsoleOutputWithErrorsIT

xmlFileContainsConsoleOutput 8.59

ForkModeIT

testForkModeOncePerThreadSingleThread 11.24
testForkModePerTest 12.033
testForkCountZero 10.785
testForkCountOneNoReuse 11.817
testForkCountTwoNoReuse 24.197
testForkModeNever 11.11
testForkCountTwoReuse 23.358
testForkCountOneReuse 13.61
testForkModeOncePerThreadTwoThreads 26.139
testForkModeAlways 12.106
testForkModeNone 13.375
testForkModeOnce 13.557

ForkModeMultiModuleIT

testForkCountOneNoReuse 14.004
testForkCountTwoNoReuse 12.868
testForkCountTwoReuse 11.781
testForkCountOneReuse 12.388

ForkModeTestNGIT

testForkModeOncePerThreadSingleThread 10.474
testForkModePerTest 11.728
testForkCountZero 9.41
testForkCountOneNoReuse 11.987
testForkCountTwoNoReuse 17.126
testForkModeNever 10.135
testForkCountTwoReuse 17.1
testForkCountOneReuse 10.664
testForkModeOncePerThreadTwoThreads 16.88
testForkModeAlways 11.924
testForkModeNone 9.753
testForkModeOnce 10.835

IncludesExcludesFromFileIT

testSimpleMixed 8.337
testMissingExcludes 6.501
testRegex 8.428
testPath 8.157
testMissingIncludes 6.714
testSimple 9.185

IncludesExcludesIT

testPathBasedIncludesExcludes 8.571
testIncludesExcludes 8.471
testRegexIncludesExcludes 8.47

Java9FullApiIT

shouldLoadMultipleJavaModules_JavaHome 0
There's no JDK 9 provided.
shouldLoadMultipleJavaModules_ToolchainsXML 0
There's no JDK 9 provided.
shouldLoadMultipleJavaModules_JvmParameter 0
There's no JDK 9 provided.

JUnit44HamcrestIT

testJUnit44Hamcrest 8.986

JUnit47ConcurrencyIT

test47 10.911

JUnit47ParallelIT

unknownThreadCountClasses 9.875
threadCountSuites 15.076
unlimitedThreadsSuitesAndMethods1 10.275
unlimitedThreadsSuitesAndMethods2 10.564
unknownThreadCountMethods 7.338
threadCountClassesAndMethods 10.79
reusableThreadCountClassesAndMethodsOptimized 10.864
unknownThreadCountSuites 7.045
reusableThreadCountAll 9.974
forcedShutdown 11.072
unknownThreadCountAll 7.029
serial 15.285
reusableThreadCountAllOptimized 10.41
suites 12.84
unlimitedThreadsMethods1 11.266
unlimitedThreadsMethods2 11.31
unlimitedThreadsSuitesAndClasses1 9.399
unlimitedThreadsSuitesAndClasses2 10.414
threadCountAllOptimized 10.64
threadCountAll 9.769
everyThreadCountSuitesAndClasses 10.649
unknownThreadCountBoth 7.132
threadCountSuitesAndClassesOptimized 9.873
classesAndMethods 10.75
everyThreadCountSuitesAndMethods 12.813
unknownThreadCountSuitesAndClasses 8.993
reusableThreadCountSuitesAndClassesOptimized 12.98
unknownThreadCountSuitesAndMethods 8.517
suitesAndClasses 12.603
suitesAndMethods 12.721
shutdown 19.534
threadCountClassesAndMethodsOneCore 17.344
everyThreadCountClassesAndMethods 12.961
all 12.005
unknownThreadCountClassesAndMethods 7.174
threadCountSuitesAndMethodsOptimized 10.518
reusableThreadCountSuitesAndMethodsOptimized 11.01
unlimitedThreadsClasses1 10.806
unlimitedThreadsClasses2 12.25
threadCountClasses 12.152
everyThreadCountAll 10.372
threadCountMethods 11.55
unlimitedThreadsSuites1 12.59
unlimitedThreadsSuites2 13.776
threadCountSuitesAndClasses 9.946
unlimitedThreadsClassesAndMethods1 10.172
unlimitedThreadsClassesAndMethods2 9.946
threadCountSuitesAndMethods 10.515
classes 11.928
reusableThreadCountSuitesAndClasses 10.865
methods 11.803
reusableThreadCountSuitesAndMethods 10.883
timeoutAndForcedShutdown 11.61
threadCountClassesAndMethodsOptimized 10.17
unlimitedThreadsAll1 9.367
unlimitedThreadsAll2 9.727
forcedShutdownVerifyingLogs 10.388
threadCountClassesAndMethodsOneCoreOptimized 14.244
reusableThreadCountClassesAndMethods 14.047

JUnit47ParallelNotThreadSafeIT

test 10.751

JUnit47RedirectOutputIT

testClassesParallel 10.543
testPrintSummaryTrueWithRedirect 10.031

JUnit47RerunFailingTestWithCucumberIT

testRerunFailingErrorTestsFalse[0] 11.956
testRerunFailingErrorTestsWithOneRetry[0] 11.752
testRerunFailingErrorTestsTwoRetry[0] 11.891
testRerunFailingErrorTestsFalse[1] 11.217
testRerunFailingErrorTestsWithOneRetry[1] 11.806
testRerunFailingErrorTestsTwoRetry[1] 10.945

JUnit47StaticInnerClassTestsIT

testStaticInnerClassTests 9.843

JUnit47WithCucumberIT

testWithParallelClasses 9.876
testWithoutParallel 9.921

JUnit48TestCategoriesIT

testCategoriesACFullyQualifiedClassName 10.362
testBadCategoryForkAlways 11.378
testCategoriesABForkAlways 11.342
testCategoriesBadCategory 11.901
testCategoriesACClassNameSuffix 10.275
testCategoriesACFullyQualifiedClassNameForkAlways 13.431
testCategoriesAB 12.389
testCategoriesACClassNameSuffixForkAlways 13.722

JUnit4ForkAlwaysStaticInitPollutionIT

testJunit4Ignore 11.522

JUnit4IgnoreIT

testJunit4Ignore 10.946
testJunit47ParallelIgnore 9.634

JUnit4RerunFailingTestsIT

testRerunFailingErrorTestsFalse 39.435
testRerunFailingErrorTestsWithOneRetry 44.506
testRerunFailingErrorTestsTwoRetry 46.855
testRerunOneTestMethod 41.314
testRerunOneTestClass 44.327

JUnit4RunListenerIT

testJUnit4RunListener 10.418
testRunlistenerJunitCoreProvider 11.763

JUnit4VersionsIT

testJunit[0: JUnit 4.0] 10.377
testJunit[1: JUnit 4.1] 10.159
testJunit[2: JUnit 4.2] 10.649
testJunit[3: JUnit 4.3] 13.512
testJunit[4: JUnit 4.3.1] 10.324
testJunit[5: JUnit 4.4] 12.645
testJunit[6: JUnit 4.5] 10.813
testJunit[7: JUnit 4.6] 9.826
testJunit[8: JUnit 4.7] 9.682
testJunit[9: JUnit 4.8] 10.053
testJunit[10: JUnit 4.8.1] 8.68
testJunit[11: JUnit 4.8.2] 9.096
testJunit[12: JUnit 4.9] 8.73
testJunit[13: JUnit 4.10] 12.466
testJunit[14: JUnit 4.11] 18.852
testJunit[15: JUnit 4.12] 11.443
testJunit[16: JUnit 4.13] 9.372

JUnitDepIT

testJUnit44DepWithSneaky381 9.622
testJUnit44Dep 10.384
testJUnit47Dep 13.494
testJUnit48Dep 15.767

JUnitPlatformEnginesIT

testJupiterEngineWithAssertionsFailEmptyStringParameters[1.0.3] 13.191
testToRegex[1.0.3] 0.003
testJupiterEngineWithAssertionsFailNoParameters[1.0.3] 0
got: "5.0.3", expected: is not "5.0.3"
testTags[1.0.3] 0
got: "5.0.3", expected: is not "5.0.3"
failingBeforeAllMethod[1.0.3] 16.36
errorInBeforeAllMethod[1.0.3] 14.808
testJupiterEngineWithFailureInParameterizedSource[1.0.3] 13.274
testJupiterEngineWithFailureInTestTemplateProvider[1.0.3] 13.647
testJupiterEngineWithErrorInParameterizedSource[1.0.3] 11.991
testJupiterEngine[1.0.3] 16.918
testJupiterEngineWithDisplayNames[1.0.3] 16.006
testJupiterEngineWithErrorInTestTemplateProvider[1.0.3] 15.039
testJupiterEngineWithFailureInTestFactory[1.0.3] 14.795
testJupiterEngineWithErrorInTestFactory[1.0.3] 15.554
platform[1.0.3] 14.322
testJupiterEngineWithAssertionsFailEmptyStringParameters[1.1.1] 11.215
testToRegex[1.1.1] 0
testJupiterEngineWithAssertionsFailNoParameters[1.1.1] 0
got: "5.1.1", expected: is not "5.1.1"
testTags[1.1.1] 10.266
failingBeforeAllMethod[1.1.1] 9.746
errorInBeforeAllMethod[1.1.1] 11.603
testJupiterEngineWithFailureInParameterizedSource[1.1.1] 14.424
testJupiterEngineWithFailureInTestTemplateProvider[1.1.1] 14.297
testJupiterEngineWithErrorInParameterizedSource[1.1.1] 10.816
testJupiterEngine[1.1.1] 10.743
testJupiterEngineWithDisplayNames[1.1.1] 10.716
testJupiterEngineWithErrorInTestTemplateProvider[1.1.1] 9.511
testJupiterEngineWithFailureInTestFactory[1.1.1] 9.889
testJupiterEngineWithErrorInTestFactory[1.1.1] 14.265
platform[1.1.1] 12.692
testJupiterEngineWithAssertionsFailEmptyStringParameters[1.2.0] 10.796
testToRegex[1.2.0] 0
testJupiterEngineWithAssertionsFailNoParameters[1.2.0] 10.034
testTags[1.2.0] 10.903
failingBeforeAllMethod[1.2.0] 10.168
errorInBeforeAllMethod[1.2.0] 10.131
testJupiterEngineWithFailureInParameterizedSource[1.2.0] 9.71
testJupiterEngineWithFailureInTestTemplateProvider[1.2.0] 10.012
testJupiterEngineWithErrorInParameterizedSource[1.2.0] 9.713
testJupiterEngine[1.2.0] 11.185
testJupiterEngineWithDisplayNames[1.2.0] 17.027
testJupiterEngineWithErrorInTestTemplateProvider[1.2.0] 10.362
testJupiterEngineWithFailureInTestFactory[1.2.0] 12.401
testJupiterEngineWithErrorInTestFactory[1.2.0] 11.674
platform[1.2.0] 10.909
testJupiterEngineWithAssertionsFailEmptyStringParameters[1.3.2] 11.004
testToRegex[1.3.2] 0
testJupiterEngineWithAssertionsFailNoParameters[1.3.2] 9.991
testTags[1.3.2] 10.804
failingBeforeAllMethod[1.3.2] 13.176
errorInBeforeAllMethod[1.3.2] 11.453
testJupiterEngineWithFailureInParameterizedSource[1.3.2] 11.754
testJupiterEngineWithFailureInTestTemplateProvider[1.3.2] 12.831
testJupiterEngineWithErrorInParameterizedSource[1.3.2] 14.136
testJupiterEngine[1.3.2] 11.185
testJupiterEngineWithDisplayNames[1.3.2] 11.233
testJupiterEngineWithErrorInTestTemplateProvider[1.3.2] 12.961
testJupiterEngineWithFailureInTestFactory[1.3.2] 13.222
testJupiterEngineWithErrorInTestFactory[1.3.2] 17.358
platform[1.3.2] 11.73
testJupiterEngineWithAssertionsFailEmptyStringParameters[1.4.2] 10.999
testToRegex[1.4.2] 0
testJupiterEngineWithAssertionsFailNoParameters[1.4.2] 10.635
testTags[1.4.2] 9.79
failingBeforeAllMethod[1.4.2] 11.079
errorInBeforeAllMethod[1.4.2] 11.48
testJupiterEngineWithFailureInParameterizedSource[1.4.2] 11.027
testJupiterEngineWithFailureInTestTemplateProvider[1.4.2] 11.181
testJupiterEngineWithErrorInParameterizedSource[1.4.2] 10.459
testJupiterEngine[1.4.2] 11.035
testJupiterEngineWithDisplayNames[1.4.2] 11.82
testJupiterEngineWithErrorInTestTemplateProvider[1.4.2] 10.781
testJupiterEngineWithFailureInTestFactory[1.4.2] 9.942
testJupiterEngineWithErrorInTestFactory[1.4.2] 11.075
platform[1.4.2] 10.755
testJupiterEngineWithAssertionsFailEmptyStringParameters[1.5.2] 12.1
testToRegex[1.5.2] 0
testJupiterEngineWithAssertionsFailNoParameters[1.5.2] 11.184
testTags[1.5.2] 11.754
failingBeforeAllMethod[1.5.2] 11.346
errorInBeforeAllMethod[1.5.2] 10.295
testJupiterEngineWithFailureInParameterizedSource[1.5.2] 10.761
testJupiterEngineWithFailureInTestTemplateProvider[1.5.2] 13.986
testJupiterEngineWithErrorInParameterizedSource[1.5.2] 14.193
testJupiterEngine[1.5.2] 16.667
testJupiterEngineWithDisplayNames[1.5.2] 13.657
testJupiterEngineWithErrorInTestTemplateProvider[1.5.2] 12.065
testJupiterEngineWithFailureInTestFactory[1.5.2] 14.092
testJupiterEngineWithErrorInTestFactory[1.5.2] 16.286
platform[1.5.2] 17.224
testJupiterEngineWithAssertionsFailEmptyStringParameters[1.6.2] 22.57
testToRegex[1.6.2] 0
testJupiterEngineWithAssertionsFailNoParameters[1.6.2] 15.508
testTags[1.6.2] 16.022
failingBeforeAllMethod[1.6.2] 11.138
errorInBeforeAllMethod[1.6.2] 10.177
testJupiterEngineWithFailureInParameterizedSource[1.6.2] 10.397
testJupiterEngineWithFailureInTestTemplateProvider[1.6.2] 9.409
testJupiterEngineWithErrorInParameterizedSource[1.6.2] 9.805
testJupiterEngine[1.6.2] 10.691
testJupiterEngineWithDisplayNames[1.6.2] 11.208
testJupiterEngineWithErrorInTestTemplateProvider[1.6.2] 9.769
testJupiterEngineWithFailureInTestFactory[1.6.2] 14.125
testJupiterEngineWithErrorInTestFactory[1.6.2] 12.621
platform[1.6.2] 10.384

JUnitPlatformIT

testVintageEngine[5.2.0] 10.351
testJQwikEngine[5.2.0] 10.934
testMultipleEngines[5.2.0] 11.189
testVintageEngine[5.3.0] 11.54
testJQwikEngine[5.3.0] 13.969
testMultipleEngines[5.3.0] 17.396
testVintageEngine[5.3.2] 14.345
testJQwikEngine[5.3.2] 11.589
testMultipleEngines[5.3.2] 10.25
testVintageEngine[5.4.0] 10.586
testJQwikEngine[5.4.0] 11.051
testMultipleEngines[5.4.0] 12.094
testVintageEngine[5.4.2] 13.834
testJQwikEngine[5.4.2] 10.195
testMultipleEngines[5.4.2] 15.652
testVintageEngine[5.5.0] 10.359
testJQwikEngine[5.5.0] 12.546
testMultipleEngines[5.5.0] 11.133
testVintageEngine[5.5.2] 12.565
testJQwikEngine[5.5.2] 10.044
testMultipleEngines[5.5.2] 10.994
testVintageEngine[5.6.2] 13.726
testJQwikEngine[5.6.2] 9.689
testMultipleEngines[5.6.2] 10.974

JUnitPlatformRerunFailingTestsIT

testRerunFailingErrorTestsFalse 39.893
testRerunFailingErrorTestsWithOneRetry 54.047
testParameterizedTest 18.959
testRerunFailingErrorTestsTwoRetry 50.408
testRerunOneTestMethod 50.465
testRerunOneTestClass 49.332

JUnitPlatformStreamCorruptionIT

warningIsNotEmitted 11.943

LongWindowsPathIT

shouldRunInSystemTmp 11.346

ModulePathIT

testModulePathWithSpaces 0
There's no JDK 9 provided.
testModulePath 0
There's no JDK 9 provided.

MultiModuleProjectWithJPMSIT

test 0
There's no JDK 9 provided.

NoRunnableTestsInClassIT

testJunit3ParallelBuildResultCount 9.152

PlainOldJavaClasspathIT

testPlainOldJavaClasspath 10.751

PlexusConflictIT

testPlexusConflict 9.923
testPlexusConflictIsolatedClassLoader 9.201

PojoSimpleIT

twoTestsWithFixtures 8.343

ReportersIT

testRedirectOutputTestNg 9.255

ResultCountingIT

testCountingWithJunit481ForkAlways 12.118
testCountingWithJunit481ForkOnce 9.123
testCountingWithJunit481ForkNever 8.787

RunOrderIT

testNonExistingRunOrderJUnit4 7.885
testNonExistingRunOrderJUnit5 8.859
testHourlyJUnit4 8.474
testHourlyJUnit5 12.518
testReverseAlphabeticalJUnit4 13.389
testReverseAlphabeticalJUnit5 18.288
testAlphabeticalJUnit4 11.649
testAlphabeticalJUnit5 14.176

RunOrderParallelForksIT

testNonExistingRunOrderJUnit4 12.335
testNonExistingRunOrderJUnit5 10.818
testHourlyJUnit4 11.08
testHourlyJUnit5 11.939
testReverseAlphabeticalJUnit4 11.593
testReverseAlphabeticalJUnit5 15.631
testAlphabeticalJUnit4 11.569
testAlphabeticalJUnit5 13.776

SiblingAggregatorIT

testSiblingAggregator 10.303

SmartStackTraceIT

misg 10.879

Surefire1602IT

nonCanonicalPath 24.485

SystemPropertiesTestIT

testSystemProperties 10.917
testSystemPropertiesNoFork 10.071

TestMethodPatternIT

testJUnit48WithCategoryFilter[0] 12.572
testJUnit48Provider47[0] 12.891
testMethodPatternAfter[0] 12.405
testTestNGMethodPattern[0] 14.064
testJUnit48Provider4[0] 11.292
testJUnit44[0] 9.736
testTestNgMethodBefore[0] 10.397
testJUnit48WithCategoryFilter[1] 9.821
testJUnit48Provider47[1] 12.241
testMethodPatternAfter[1] 12.71
testTestNGMethodPattern[1] 11.478
testJUnit48Provider4[1] 9.365
testJUnit44[1] 8.418
testTestNgMethodBefore[1] 9.376

Failure Details

[Summary] [Package List] [Test Cases]


xXXtest501
skipped: 5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
xXXtest50
skipped: 5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024
shouldLoadMultipleJavaModules_JavaHome
skipped: There's no JDK 9 provided.
shouldLoadMultipleJavaModules_ToolchainsXML
skipped: There's no JDK 9 provided.
shouldLoadMultipleJavaModules_JvmParameter
skipped: There's no JDK 9 provided.
testJupiterEngineWithAssertionsFailNoParameters[1.0.3]
skipped: got: "5.0.3", expected: is not "5.0.3"
testTags[1.0.3]
skipped: got: "5.0.3", expected: is not "5.0.3"
testJupiterEngineWithAssertionsFailNoParameters[1.1.1]
skipped: got: "5.1.1", expected: is not "5.1.1"
testModulePathWithSpaces
skipped: There's no JDK 9 provided.
testModulePath
skipped: There's no JDK 9 provided.
test
skipped: There's no JDK 9 provided.