Failsafe Report
Summary
[Summary] [Package List] [Test Cases]
Tests | Errors | Failures | Skipped | Success Rate | Time |
---|---|---|---|---|---|
1004 | 0 | 0 | 143 | 85.757% | 9,193.602 |
Note: failures are anticipated and checked for with assertions while errors are unanticipated.
Package List
[Summary] [Package List] [Test Cases]
Package | Tests | Errors | Failures | Skipped | Success Rate | Time |
---|---|---|---|---|---|---|
org.apache.maven.surefire.its | 771 | 0 | 0 | 137 | 82.231% | 6,872.676 |
org.apache.maven.surefire.its.jiras | 233 | 0 | 0 | 6 | 97.425% | 2,320.924 |
Note: package statistics are not computed recursively, they only sum up all of its testsuites numbers.
org.apache.maven.surefire.its
Class | Tests | Errors | Failures | Skipped | Success Rate | Time | |
---|---|---|---|---|---|---|---|
AbstractTestCaseIT | 1 | 0 | 0 | 0 | 100% | 8.452 | |
AdditionalClasspathIT | 1 | 0 | 0 | 0 | 100% | 8.094 | |
AggregateReportIT | 1 | 0 | 0 | 0 | 100% | 10.921 | |
ArgLineIT | 1 | 0 | 0 | 0 | 100% | 8.354 | |
ArgLinePropertiesIT | 1 | 0 | 0 | 0 | 100% | 7.569 | |
AssumptionFailureReportIT | 1 | 0 | 0 | 0 | 100% | 6.632 | |
CheckSingleTestIT | 4 | 0 | 0 | 0 | 100% | 27.868 | |
CheckTestFailIfNoTestsForkModeIT | 6 | 0 | 0 | 0 | 100% | 44.283 | |
CheckTestFailIfNoTestsIT | 3 | 0 | 0 | 0 | 100% | 16.189 | |
CheckTestNg740ParallelIT | 1 | 0 | 0 | 0 | 100% | 11.206 | |
CheckTestNgBeforeMethodFailureIT | 1 | 0 | 0 | 0 | 100% | 8.893 | |
CheckTestNgBeforeMethodIT | 1 | 0 | 0 | 0 | 100% | 8.547 | |
CheckTestNgCustomObjectFactoryIT | 1 | 0 | 0 | 0 | 100% | 7.39 | |
CheckTestNgCustomTestRunnerFactoryIT | 1 | 0 | 0 | 0 | 100% | 7.477 | |
CheckTestNgExecuteErrorIT | 1 | 0 | 0 | 0 | 100% | 7.803 | |
CheckTestNgGroupThreadParallelIT | 1 | 0 | 0 | 0 | 100% | 8.563 | |
CheckTestNgJdk14IT | 1 | 0 | 0 | 0 | 100% | 9.577 | |
CheckTestNgListenerReporterIT | 9 | 0 | 0 | 1 | 88.889% | 89.383 | |
CheckTestNgListenersIT | 1 | 0 | 0 | 0 | 100% | 11.251 | |
CheckTestNgPathWithSpacesIT | 1 | 0 | 0 | 0 | 100% | 8.728 | |
CheckTestNgReportTestIT | 3 | 0 | 0 | 0 | 100% | 32.339 | |
CheckTestNgSuiteXmlIT | 3 | 0 | 0 | 0 | 100% | 26.491 | |
CheckTestNgSuiteXmlSingleIT | 1 | 0 | 0 | 0 | 100% | 8.504 | |
CheckTestNgVersionsIT | 20 | 0 | 0 | 2 | 90% | 200.515 | |
ClasspathFilteringIT | 1 | 0 | 0 | 0 | 100% | 8.308 | |
ClassPathOrderIT | 1 | 0 | 0 | 0 | 100% | 9.222 | |
ClasspathScopeFilteringIT | 1 | 0 | 0 | 0 | 100% | 8.486 | |
ConsoleOutputIT | 8 | 0 | 0 | 0 | 100% | 97.678 | |
CrashDetectionIT | 3 | 0 | 0 | 0 | 100% | 25.183 | |
DefaultConfigurationIT | 1 | 0 | 0 | 0 | 100% | 6.657 | |
EnvironmentVariableIT | 1 | 0 | 0 | 0 | 100% | 8.419 | |
EnvironmentVariablesIT | 3 | 0 | 0 | 0 | 100% | 28.281 | |
FailFastJUnitIT | 14 | 0 | 0 | 0 | 100% | 410.623 | |
FailFastTestNgIT | 8 | 0 | 0 | 0 | 100% | 233.784 | |
ForkConsoleOutputIT | 4 | 0 | 0 | 0 | 100% | 47.456 | |
ForkConsoleOutputWithErrorsIT | 1 | 0 | 0 | 0 | 100% | 22.333 | |
ForkModeIT | 12 | 0 | 0 | 0 | 100% | 171.774 | |
ForkModeMultiModuleIT | 4 | 0 | 0 | 0 | 100% | 60.889 | |
ForkModeTestNGIT | 12 | 0 | 0 | 0 | 100% | 146.26 | |
IncludesExcludesFromFileIT | 6 | 0 | 0 | 0 | 100% | 53.226 | |
IncludesExcludesIT | 3 | 0 | 0 | 0 | 100% | 24.591 | |
Java9FullApiIT | 3 | 0 | 0 | 0 | 100% | 39.039 | |
JUnit44HamcrestIT | 1 | 0 | 0 | 0 | 100% | 7.653 | |
JUnit47ConcurrencyIT | 1 | 0 | 0 | 0 | 100% | 9.172 | |
JUnit47ParallelIT | 59 | 0 | 0 | 0 | 100% | 671.62 | |
JUnit47ParallelNotThreadSafeIT | 1 | 0 | 0 | 0 | 100% | 8.845 | |
JUnit47RedirectOutputIT | 2 | 0 | 0 | 0 | 100% | 18.205 | |
JUnit47RerunFailingTestWithCucumberIT | 6 | 0 | 0 | 0 | 100% | 78.222 | |
JUnit47StaticInnerClassTestsIT | 1 | 0 | 0 | 0 | 100% | 10.38 | |
JUnit47WithCucumberIT | 2 | 0 | 0 | 0 | 100% | 20.54 | |
JUnit48TestCategoriesIT | 8 | 0 | 0 | 0 | 100% | 91.101 | |
JUnit4ForkAlwaysStaticInitPollutionIT | 1 | 0 | 0 | 0 | 100% | 10.522 | |
JUnit4IgnoreIT | 2 | 0 | 0 | 0 | 100% | 17.509 | |
JUnit4RerunFailingTestsIT | 5 | 0 | 0 | 0 | 100% | 177.364 | |
JUnit4RunListenerIT | 2 | 0 | 0 | 0 | 100% | 16.48 | |
JUnit4VersionsIT | 17 | 0 | 0 | 0 | 100% | 154.718 | |
Junit5ModulePathIT | 2 | 0 | 0 | 0 | 100% | 27.312 | |
JUnitDepIT | 4 | 0 | 0 | 0 | 100% | 37.642 | |
JUnitPlatformEnginesIT | 119 | 0 | 0 | 3 | 97.479% | 1,032.896 | |
JUnitPlatformIT | 18 | 0 | 0 | 0 | 100% | 170.947 | |
JUnitPlatformRerunFailingTestsIT | 7 | 0 | 0 | 0 | 100% | 238.923 | |
JUnitPlatformStreamCorruptionIT | 3 | 0 | 0 | 1 | 66.667% | 21.334 | |
LongWindowsPathIT | 1 | 0 | 0 | 0 | 100% | 11.667 | |
ModulePathIT | 2 | 0 | 0 | 0 | 100% | 21.508 | |
MultiModuleProjectWithJPMSIT | 1 | 0 | 0 | 0 | 100% | 15.494 | |
NoRunnableTestsInClassIT | 1 | 0 | 0 | 0 | 100% | 9.656 | |
PlainOldJavaClasspathIT | 1 | 0 | 0 | 0 | 100% | 8.605 | |
PlexusConflictIT | 2 | 0 | 0 | 0 | 100% | 14.813 | |
PojoSimpleIT | 1 | 0 | 0 | 0 | 100% | 8.133 | |
ReportersIT | 1 | 0 | 0 | 0 | 100% | 7.97 | |
ResultCountingIT | 3 | 0 | 0 | 0 | 100% | 29 | |
RunOrderIT | 10 | 0 | 0 | 0 | 100% | 138.15 | |
RunOrderParallelForksIT | 10 | 0 | 0 | 0 | 100% | 134.617 | |
SiblingAggregatorIT | 1 | 0 | 0 | 0 | 100% | 8.017 | |
SmartStackTraceIT | 1 | 0 | 0 | 0 | 100% | 9.285 | |
Surefire1602IT | 1 | 0 | 0 | 0 | 100% | 18.648 | |
SystemPropertiesTestIT | 2 | 0 | 0 | 0 | 100% | 23.501 | |
TestMethodPatternIT | 14 | 0 | 0 | 0 | 100% | 132.978 | |
TestMultipleMethodPatternsIT | 180 | 0 | 0 | 87 | 51.667% | 763.733 | |
TestMultipleMethodPatternsTestNGIT | 90 | 0 | 0 | 41 | 54.444% | 380.73 | |
TestMultipleMethodsIT | 3 | 0 | 0 | 0 | 100% | 24.742 | |
TestNgGroupsIT | 5 | 0 | 0 | 0 | 100% | 44 | |
TestNgParallelWithAnnotationsIT | 1 | 0 | 0 | 0 | 100% | 14.443 | |
TestNgSuccessPercentageIT | 1 | 0 | 0 | 0 | 100% | 7.003 | |
TestSingleMethodIT | 9 | 0 | 0 | 0 | 100% | 76.523 | |
TimeoutForkedTestIT | 1 | 0 | 0 | 0 | 100% | 18.398 | |
TwoTestCasesIT | 4 | 0 | 0 | 0 | 100% | 29.332 | |
UmlautDirIT | 4 | 0 | 0 | 2 | 50% | 17.854 | |
UnicodeTestNamesIT | 1 | 0 | 0 | 0 | 100% | 13.802 | |
UseIsolatedClassLoaderIT | 1 | 0 | 0 | 0 | 100% | 7.059 | |
WorkingDirectoryIsInvalidPropertyIT | 1 | 0 | 0 | 0 | 100% | 6.693 | |
WorkingDirectoryIT | 4 | 0 | 0 | 0 | 100% | 27.238 | |
WorkingDirectoryMissingIT | 1 | 0 | 0 | 0 | 100% | 8.704 | |
XmlReporterRunTimeIT | 1 | 0 | 0 | 0 | 100% | 31.758 |
org.apache.maven.surefire.its.jiras
Test Cases
[Summary] [Package List] [Test Cases]
AbstractTestCaseIT
abstractTestCase | 8.415 |
AdditionalClasspathIT
additionalClasspath | 8.079 |
AggregateReportIT
aggregateReport | 10.908 |
ArgLineIT
argLine | 8.346 |
ArgLinePropertiesIT
argLine | 7.565 |
AssumptionFailureReportIT
testWriteSkippedMessageToReport | 6.628 |
CheckSingleTestIT
singleTestDotJava | 6.742 | |
singleTestNonExistentOverride | 6.779 | |
singleTestNonExistent | 6.166 | |
singleTest | 8.179 |
CheckTestFailIfNoTestsForkModeIT
CheckTestFailIfNoTestsIT
failIfNoTests | 5.037 | |
dontFailIfNoTests | 4.912 | |
jUnit48CategoriesFailWhenNoTests | 6.237 |
CheckTestNg740ParallelIT
withTestNG740AndParallelSet | 11.203 |
CheckTestNgBeforeMethodFailureIT
testNgBeforeMethodFailure | 8.891 |
CheckTestNgBeforeMethodIT
testNgBeforeMethod | 8.545 |
CheckTestNgCustomObjectFactoryIT
testTestNgListenerReporter | 7.388 |
CheckTestNgCustomTestRunnerFactoryIT
testTestNgListenerReporter | 7.474 |
CheckTestNgExecuteErrorIT
executionError | 7.799 |
CheckTestNgGroupThreadParallelIT
testNgGroupThreadParallel | 8.558 |
CheckTestNgJdk14IT
testNgJdk14 | 9.57 |
CheckTestNgListenerReporterIT
testNgListenerReporter[0: TestNG 5.6] | 9.064 | |
testNgListenerReporter[1: TestNG 5.7] | 8.459 | |
testNgListenerReporter[2: TestNG 5.10] | 8.482 | |
testNgListenerReporter[3: TestNG 5.13] | 0 | |
java.specification.version: 18 | ||
testNgListenerReporter[4: TestNG 5.14.6] | 8.973 | |
testNgListenerReporter[5: TestNG 5.14.9] | 13.726 | |
testNgListenerReporter[6: TestNG 6.0] | 14.643 | |
testNgListenerReporter[7: TestNG 6.14.3] | 12.492 | |
testNgListenerReporter[8: TestNG 7.0.0] | 13.535 |
CheckTestNgListenersIT
testNgListenerReporter | 11.246 |
CheckTestNgPathWithSpacesIT
testWithSpaces | 8.725 |
CheckTestNgReportTestIT
testNgReport | 11.714 | |
shouldNotBeVerbose | 10.696 | |
shouldBeVerbose | 9.926 |
CheckTestNgSuiteXmlIT
suiteXml | 8.915 | |
suiteXmlForkCountTwoReuse | 8.272 | |
suiteXmlForkModeAlways | 9.3 |
CheckTestNgSuiteXmlSingleIT
testNgSuite | 8.501 |
CheckTestNgVersionsIT
test502 | 10.376 | |
test510 | 10.168 | |
test511 | 9.759 | |
test512 | 9.338 | |
test513 | 9.171 | |
test514 | 10.128 | |
test685 | 13.02 | |
test5131 | 11.706 | |
test5141 | 12.925 | |
test5142 | 14.167 | |
test47 | 12.19 | |
test51 | 12.423 | |
test55 | 11.307 | |
test56 | 11.342 | |
test57 | 10.781 | |
test58 | 9.663 | |
test59 | 10.925 | |
test60 | 11.117 | |
xXXtest501 | 0 | |
5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024 | ||
xXXtest50 | 0 | |
5.0 and 5.0.1 jars on central are malformed SUREFIRE-375 + MAVENUPLOAD-1024 |
ClasspathFilteringIT
additionalClasspath | 8.303 |
ClassPathOrderIT
classPathOrder | 9.206 |
ClasspathScopeFilteringIT
additionalClasspath | 8.484 |
ConsoleOutputIT
CrashDetectionIT
hardCrashInReusableFork | 9.161 | |
crashInReusableFork | 8.128 | |
crashInFork | 7.888 |
DefaultConfigurationIT
defaultConfiguration | 6.649 |
EnvironmentVariableIT
environmentVariable | 8.415 |
EnvironmentVariablesIT
testWhenUseSystemClassLoader | 9.405 | |
testExcludedEnv | 9.657 | |
testWhenDontUseSystemClassLoader | 9.215 |
FailFastJUnitIT
FailFastTestNgIT
ForkConsoleOutputIT
printSummaryTrueWithRedirect | 8.848 | |
printSummaryFalseWithoutRedirect | 9.591 | |
printSummaryTrueWithoutRedirect | 14.765 | |
printSummaryFalseWithRedirect | 14.247 |
ForkConsoleOutputWithErrorsIT
xmlFileContainsConsoleOutput | 10.531 |
ForkModeIT
ForkModeMultiModuleIT
testForkCountOneNoReuse | 15.203 | |
testForkCountTwoNoReuse | 13.712 | |
testForkCountTwoReuse | 11.362 | |
testForkCountOneReuse | 11.249 |
ForkModeTestNGIT
IncludesExcludesFromFileIT
testSimpleMixed | 8.876 | |
testMissingExcludes | 8.58 | |
testRegex | 8.668 | |
testPath | 10.146 | |
testMissingIncludes | 7.519 | |
testSimple | 9.434 |
IncludesExcludesIT
testPathBasedIncludesExcludes | 8.71 | |
testIncludesExcludes | 7.707 | |
testRegexIncludesExcludes | 8.17 |
Java9FullApiIT
shouldLoadMultipleJavaModules_JavaHome | 13.907 | |
shouldLoadMultipleJavaModules_ToolchainsXML | 12.666 | |
shouldLoadMultipleJavaModules_JvmParameter | 12.46 |
SpockIT
test | 0 | |
java.specification.version: 18 |
Surefire1004RunTestFromDependencyJarsTypeAndClassifierIT
shouldScanAndRunTestsInDependencyJars | 8.13 |
Surefire1024VerifyFailsafeIfTestedIT
shouldScanAndRunTestsInDependencyJars | 8.757 |
Surefire1028UnableToRunSingleIT
methodFilteringParallelExecution | 9.917 |
Surefire1036NonFilterableJUnitRunnerWithCategoriesIT
test | 8.994 |
Surefire1041FailingJUnitRunnerIT
reportErrorInJUnitRunnerAsTestError | 9.676 |
Surefire1053SystemPropertiesIT
checkWarningsSysPropTwice | 7.472 | |
checkWarningsFileEncoding | 7.479 |
Surefire1055CorrectConcurrentTestCountIT
testTestNgAndJUnitTogether | 9.225 |
Surefire1080ParallelForkDoubleTestIT
test | 10.969 |
Surefire1082ParallelJUnitParameterizedIT
checkClassesRunParallel | 11.481 | |
shouldRunTwo | 10.767 | |
checkOutFileClassesRunParallel | 10 |
Surefire1095NpeInRunListenerIT
testRunStartedWithJUnit40 | 6.795 | |
testRunStartedWithJUnit45 | 6.542 | |
testRunStartedWithJUnit47 | 7.792 |
Surefire1098BalancedRunOrderIT
reorderedParallelClasses | 19.681 |
Surefire1122ParallelAndFlakyTestsIT
parallelCreatesCorrectReportFork | 8.75 | |
nonParallelCreatesCorrectReport | 8.451 | |
parallelCreatesCorrectReport | 7.724 |
Surefire1135ImproveIgnoreMessageForTestNGIT
testNgReport57 | 9.193 | |
testNgReport688 | 11.725 |
Surefire1136CwdPropagationInForkedModeIT
testTestNgAndJUnitTogether | 8.449 |
Surefire1144XmlRunTimeIT
testXmlRunTime | 8.48 |
Surefire1146RerunFailedAndParameterizedIT
testsAreRerun | 7.065 |
Surefire1152RerunFailingTestsInSuiteIT
testJUnit48Provider47 | 9.225 | |
testJUnit48Provider4 | 7.723 |
Surefire1153IncludesAndSpecifiedTestIT
testSpecifiedTestInIncludes | 6.893 | |
testSpecifiedTestNotInIncludes | 7.874 |
Surefire1158RemoveInfoLinesIT
Surefire1177TestngParallelSuitesIT
twoSuitesInParallelForked | 11.001 | |
twoSuitesInParallel | 9.801 |
Surefire1179IT
suiteXmlForkCountTwoReuse | 14.189 |
Surefire1185DoNotSpawnTestsIT
doNotSpawnUnwantedTests | 6.831 |
Surefire1202RerunAndSkipIT
junit47 | 21.564 | |
junit4 | 20.323 |
Surefire1209RerunAndForkCountIT
notReusableForksJUnit47 | 17.26 | |
reusableForksJUnit47 | 18.58 | |
reusableForksJUnit4 | 14.919 | |
notReusableForksJUnit4 | 16.048 |
Surefire1211JUnitTestNgIT
withoutJUnit | 8.538 | |
withJUnit | 9.716 |
Surefire1264IT
positiveTests | 11.323 | |
negativeTests | 10.561 |
Surefire1265Java9IT
shouldRunInPluginJava9 | 6.892 |
Surefire1278GroupNameEndingIT
testOnlyGroups | 8.022 |
Surefire1295AttributeJvmCrashesToTestsIT
test[0] | 10.25 | |
test[1] | 15.036 | |
test[2] | 10.499 | |
test[3] | 12.536 | |
test[4] | 15.371 | |
test[5] | 14.587 | |
test[6] | 10.189 | |
test[7] | 13.292 | |
test[8] | 10.083 |
Surefire1364SystemPropertiesIT
Surefire1367AssumptionLogsIT
shouldSeeLogsInPlugin | 6.583 | |
shouldSeeLogsParallelInPlugin | 8.113 | |
shouldSeeLogsParallelForked | 8.942 | |
shouldSeeLogsForked | 7.885 |
Surefire1383ScanSessionDependenciesIT
test | 8.531 |
Surefire1396CustomProviderClassPathIT
pluggableProviderClasspathCorrect | 8.816 |
Surefire141PluggableProvidersIT
pluggableProviderPresent | 8.25 | |
invokeRuntimeException | 8.234 | |
invokeReporterException | 9.946 | |
constructorRuntimeException | 10.573 |
Surefire1426JvmCrashShouldNotBeIgnoredIT
mavenShouldFail | 8.123 |
Surefire146ForkPerTestNoSetupIT
testForkPerTestNoSetup | 7.598 |
Surefire1490ReportTitleDescriptionIT
shouldHaveCustomizedReportTitleAndDescription | 16.304 | |
shouldHaveDefaultReportTitleAndDescription | 14.989 |
Surefire1534ReuseForksFalseWithJavaModuleIT
testExecuteWithReuseForksFalseWithJavaModule | 10.394 | |
testExecuteWithReuseForksFalseWithJavaModuleWithFilter | 11.086 | |
testExecuteWithZeroForkCountWithJavaModule | 10.059 |
Surefire1535TestNGParallelSuitesIT
forks0 | 9.218 | |
forks2 | 9.452 | |
forks0Redirected | 9.244 | |
forks2Redirected | 11.466 |
Surefire1570ModularFailsafeIT
shouldRunWithJupiterApi | 17.303 |
Surefire1585IT
shouldRunWithJupiterApi | 7.999 | |
shouldRunWithVintage | 7.679 |
Surefire162CharsetProviderIT
testCharsetProvider | 7.269 |
Surefire1712ExtractedModulenameWithoutASMIT
test | 8.508 |
Surefire1733JUnitIT
test | 12.079 |
Surefire1733TestngIT
test | 14.051 |
Surefire1744AlwaysIncludeOutputLogsIT
testAlwaysIncludeOutputLogs | 6.686 |
Surefire1787JUnit5IT
apiAndEngine | 8.058 | |
testNgWithJupiterApi | 8.743 | |
testNg | 8.258 | |
junit5Suite | 9.447 | |
bothEngines | 9.849 | |
junit4Runner | 8.505 | |
selectJUnit4 | 7.901 | |
selectJUnit5 | 7.74 | |
testNgWithJupiterEngine | 9.032 | |
bothApis | 7.899 |
Surefire1881IT
test | 14.565 |
Surefire1914XmlReportingParameterizedTestIT
Surefire1964IT
shouldFilterTests | 7.688 | |
shouldFilterTestsInPluginProcess | 6.581 |
Surefire1967CheckTestNgMethodParallelOrderingIT
testNgParallelOrderingWithEarlyVersion6 | 7.232 | |
testNgParallelOrderingWithVersion5 | 0 | |
java.specification.version: 18 | ||
testNgParallelOrderingWithVersion6 | 7.374 | |
testNgParallelOrdering | 9.226 |
Surefire1993JpmsProvidingModulesIT
verify | 14.257 |
Surefire2006ShadefireTransformersIT
shadefireShouldBeUsed | 8.389 |
Surefire2036IT
selectJUnit5UsingConfiguredProviderWithPlatformRunner | 9.926 |
Surefire224WellFormedXmlFailuresIT
testWellFormedXmlFailures | 6.998 |
Surefire257NotRerunningTestsIT
shouldNotRerun | 9.75 |
Surefire260TestWithIdenticalNamesIT
testWithIdenticalNames | 16.216 |
Surefire34SecurityManagerIT
testSecurityManager | 0 | |
java.specification.version: 18 | ||
shouldFailOnJDK | 7.921 | |
testSecurityManagerSuccessful | 0 | |
java.specification.version: 18 |
Surefire376TestNgAfterSuiteFailureIT
testAfterSuiteFailure | 7.814 |
Surefire377TestNgAndJUnitTogetherIT
testTestNgAndJUnit4Together | 7.489 | |
testTestNgAndJUnitTogether | 7.6 |
Surefire408ManualProviderSelectionIT
testParallelBuildResultCount | 7.238 |
Surefire42NotExtendingTestCaseIT
testInnerClass | 6.893 |
Surefire44InnerClassTestIT
testInnerClass | 8.736 |
Surefire500PuzzlingErrorIT
testBuildFailingWhenErrors | 8.658 |
Surefire510TestClassPathForkModesIT
testForkOnce | 7.273 | |
testForkAlways | 7.154 |
Surefire569RunTestFromDependencyJarsIT
shouldScanAndRunTestsInDependencyJars | 7.447 |
Surefire570MultipleReportDirectoriesIT
testReportWithAggregate | 18.049 | |
testReportWithoutAggregate | 21.226 |
Surefire613TestCountInParallelIT
testParallelBuildResultCount | 8.688 |
Surefire621TestCountingJunit3InParallelIT
Surefire628ConsoleOutputBeforeAndAfterClassIT
testJunit3ParallelBuildResultCount | 8.783 |
Surefire634UnsettableSystemPropertiesWarningIT
testJunit3ParallelBuildResultCount | 7.347 |
Surefire649EmptyStringSystemPropertiesIT
systemPropertyVariables | 6.519 | |
systemProperties | 6.72 |
Surefire673MockitoIT
testBuildFailingWhenErrors | 8.396 |
Surefire674BuildFailingWhenErrorsIT
testBuildFailingWhenErrors | 8.074 |
Surefire674BuildFailingWhenFailsafeErrorsIT
testBuildFailingWhenErrors | 5.558 |
Surefire685CommaSeparatedIncludesIT
testBuildFailingWhenErrors | 8.646 |
Surefire697NiceSummaryIT
testBuildFailingWhenErrors | 7.119 |
Surefire705ParallelForkTimeoutIT
testTimeoutForked | 11.489 |
Surefire733AllOverrridesCapturedIT
testLogOutput | 7.017 |
Surefire735ForkFailWithRedirectConsoleOutputIT
vmStartFail | 6.827 | |
vmStartFailShouldFailBuildk | 7.067 |
Surefire740TruncatedCommaIT
testRussianLocaleReport | 7.684 |
Surefire747MethodParallelWithSuiteCountIT
testMethodsParallelWithSuite | 14.443 | |
testClassesParallelWithSuite | 14.958 |
Surefire772BothReportsIT
testSkippedSurefireReportGeneration | 4.689 | |
testSkippedFailsafeReportGeneration | 4.485 | |
testReportGeneration | 4.723 |
Surefire772NoFailsafeReportsIT
testSkippedFailsafeReportGeneration | 4.505 | |
testForcedFailsafeReportGeneration | 4.968 | |
testSkipForcedFailsafeReportGeneration | 5.747 | |
testReportGeneration | 5.455 |
Surefire772NoSurefireReportsIT
testOptionalSurefireReportGeneration | 5.697 | |
testSkippedSurefireReportGeneration | 4.647 | |
testSkipOptionalSurefireReportGeneration | 4.546 | |
testReportGeneration | 4.562 |
Surefire772SpecifiedReportsIT
testSkippedSurefireReportGeneration | 4.474 | |
testSkippedFailsafeReportGeneration | 4.603 | |
testReportGeneration | 4.683 |
Surefire801ForkModeNoneClassLoaderIT
testSHouldBeOkWithForkNever | 6.556 |
Surefire803MultiFailsafeExecsIT
testOneExecutionRunInTwoBuilds | 22.519 | |
testSecondExecutionRunsAfterFirstExecutionFails | 10.117 |
Surefire806SpecifiedTestControlsIT
singleTestInSingleExecutionProject | 7.151 | |
twoSpecifiedTestExecutionsInCorrectExecutionBlocks | 0 | |
since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution | ||
singleTestInOneExecutionOfMultiExecutionProject | 0 | |
since SUREFIRE-1153 the includes/excludes are overridden by -Dtest or it.test for whatever execution |
Surefire809GroupExpressionsIT
testNGRunCategoryAB | 7.862 | |
testExcludedGroups | 8.769 | |
testJUnitRunCategoryNotC | 8.535 | |
incorrectJUnitVersions | 5.689 | |
categoryAB | 10.48 | |
testNGRunCategoryNotC | 8.889 |
Surefire812Log4JClassLoaderIT
testJunit3ParallelBuildResultCount | 7.575 |
Surefire817SystemExitIT
systemExit1 | 8.995 |
Surefire818NpeIgnoresTestsIT
testBuildFailingWhenErrors | 7.395 |
Surefire828EmptyGroupExprIT
testJUnitRunEmptyExcludeGroups | 8.807 | |
testJUnitRunEmptyGroups | 10.184 | |
testTestNGRunEmptyExcludeGroups | 9.462 | |
testTestNGRunEmptyGroups | 8.323 |
Surefire832ProviderSelectionIT
testJUnitRunCategoryAB | 8.779 |
Surefire839TestWithoutCategoriesIT
classWithoutCategoryForked | 10.09 | |
classWithoutCategory | 8.741 |
Surefire847AdditionalFailureIT
testJUnitRunCategoryAB | 8.347 |
Surefire855AllowFailsafeUseArtifactFileIT
jarNotForkingShouldUseFile | 14.913 | |
jarShouldUseFile | 13.391 | |
warShouldUseClasses | 14.02 | |
osgiBundleShouldUseFile | 14.6 |
Surefire901MIssingResultfileWhenNoTestsIT
failsafeWithNoTests | 7.871 |
Surefire907PerThreadWithoutThreadCountIT
categoryAB | 7.21 |
Surefire920TestFailureIgnoreWithTimeoutIT
timeoutInForkWithBuildFail | 15.97 | |
timeoutInForkWithNoBuildFail | 15.574 |
Surefire926FailureWith2ProvidersIT
testBuildFailingWhenErrors | 4.771 |
Surefire930TestNgSuiteXmlIT
suiteXmlRun | 9.614 |
Surefire943ReportContentIT
test_noParallel | 17.003 | |
test_parallelBoth | 9.931 |
Surefire946KillMainProcessInReusableForkIT
test[halt-exit] | 31.883 | |
test[halt-kill] | 32.078 | |
test[exit-exit] | 32.718 | |
test[exit-kill] | 31.305 | |
test[interrupt-exit] | 32.656 | |
test[interrupt-kill] | 31.246 |
Surefire972BizarreNoClassDefIT
testJunit3ParallelBuildResultCount | 9.389 |
Surefire975DefaultVMEncodingIT
runWithRussian1251 | 7.218 |
Surefire979WrongClassLoaderIT
wrongClassloaderUSedInSmartStacktraceparser | 7.63 |
Surefire985ParameterizedRunnerAndCategoriesIT
test | 8.249 |
Surefire995CategoryInheritanceIT
JUnit44HamcrestIT
testJUnit44Hamcrest | 7.65 |
JUnit47ConcurrencyIT
test47 | 9.167 |
JUnit47ParallelIT
JUnit47ParallelNotThreadSafeIT
test | 8.841 |
JUnit47RedirectOutputIT
testClassesParallel | 9.049 | |
testPrintSummaryTrueWithRedirect | 9.153 |
JUnit47RerunFailingTestWithCucumberIT
JUnit47StaticInnerClassTestsIT
testStaticInnerClassTests | 10.374 |
JUnit47WithCucumberIT
testWithParallelClasses | 10.437 | |
testWithoutParallel | 10.099 |
JUnit48TestCategoriesIT
JUnit4ForkAlwaysStaticInitPollutionIT
testJunit4Ignore | 10.517 |
JUnit4IgnoreIT
testJunit4Ignore | 8.162 | |
testJunit47ParallelIgnore | 9.344 |
JUnit4RerunFailingTestsIT
testRerunFailingErrorTestsFalse | 34.806 | |
testRerunFailingErrorTestsWithOneRetry | 35.618 | |
testRerunFailingErrorTestsTwoRetry | 36.766 | |
testRerunOneTestMethod | 33.485 | |
testRerunOneTestClass | 36.682 |
JUnit4RunListenerIT
testJUnit4RunListener | 7.658 | |
testRunlistenerJunitCoreProvider | 8.816 |
JUnit4VersionsIT
Junit5ModulePathIT
testModulePathWithSpaces | 15.527 | |
testModulePath | 11.774 |
JUnitDepIT
testJUnit44DepWithSneaky381 | 8.081 | |
testJUnit44Dep | 8.758 | |
testJUnit47Dep | 9.504 | |
testJUnit48Dep | 11.292 |
JUnitPlatformEnginesIT
testJupiterEngineWithAssertionsFailEmptyStringParameters[1.0.3] | 11.386 | |
testToRegex[1.0.3] | 0.001 | |
testJupiterEngineWithAssertionsFailNoParameters[1.0.3] | 0 | |
got: "5.0.3", expected: is not "5.0.3" | ||
testJupiterEngineWithExceptionMessage[1.0.3] | 9.489 | |
testTags[1.0.3] | 0 | |
got: "5.0.3", expected: is not "5.0.3" | ||
failingBeforeAllMethod[1.0.3] | 9.262 | |
testJupiterEngineWithAssertionsFailMessage[1.0.3] | 7.973 | |
errorInBeforeAllMethod[1.0.3] | 8.042 | |
testJupiterEngineWithFailureInParameterizedSource[1.0.3] | 9.234 | |
testJupiterEngineWithFailureInTestTemplateProvider[1.0.3] | 10.442 | |
testJupiterEngineWithErrorInParameterizedSource[1.0.3] | 10.371 | |
testJupiterEngine[1.0.3] | 10.252 | |
testJupiterEngineWithDisplayNames[1.0.3] | 9.104 | |
testJupiterEngineWithErrorInTestTemplateProvider[1.0.3] | 11.712 | |
testJupiterEngineWithFailureInTestFactory[1.0.3] | 8.784 | |
testJupiterEngineWithErrorInTestFactory[1.0.3] | 10.414 | |
platform[1.0.3] | 11.126 | |
testJupiterEngineWithAssertionsFailEmptyStringParameters[1.1.1] | 12.028 | |
testToRegex[1.1.1] | 0 | |
testJupiterEngineWithAssertionsFailNoParameters[1.1.1] | 0 | |
got: "5.1.1", expected: is not "5.1.1" | ||
testJupiterEngineWithExceptionMessage[1.1.1] | 8.475 | |
testTags[1.1.1] | 8.512 | |
failingBeforeAllMethod[1.1.1] | 8.58 | |
testJupiterEngineWithAssertionsFailMessage[1.1.1] | 8.682 | |
errorInBeforeAllMethod[1.1.1] | 10.736 | |
testJupiterEngineWithFailureInParameterizedSource[1.1.1] | 10.428 | |
testJupiterEngineWithFailureInTestTemplateProvider[1.1.1] | 8.271 | |
testJupiterEngineWithErrorInParameterizedSource[1.1.1] | 8.265 | |
testJupiterEngine[1.1.1] | 8.635 | |
testJupiterEngineWithDisplayNames[1.1.1] | 9.458 | |
testJupiterEngineWithErrorInTestTemplateProvider[1.1.1] | 9.919 | |
testJupiterEngineWithFailureInTestFactory[1.1.1] | 10.096 | |
testJupiterEngineWithErrorInTestFactory[1.1.1] | 9.307 | |
platform[1.1.1] | 7.813 | |
testJupiterEngineWithAssertionsFailEmptyStringParameters[1.2.0] | 8.398 | |
testToRegex[1.2.0] | 0 | |
testJupiterEngineWithAssertionsFailNoParameters[1.2.0] | 8.025 | |
testJupiterEngineWithExceptionMessage[1.2.0] | 7.843 | |
testTags[1.2.0] | 9.808 | |
failingBeforeAllMethod[1.2.0] | 9.875 | |
testJupiterEngineWithAssertionsFailMessage[1.2.0] | 8.24 | |
errorInBeforeAllMethod[1.2.0] | 8.169 | |
testJupiterEngineWithFailureInParameterizedSource[1.2.0] | 8.195 | |
testJupiterEngineWithFailureInTestTemplateProvider[1.2.0] | 8.346 | |
testJupiterEngineWithErrorInParameterizedSource[1.2.0] | 8.617 | |
testJupiterEngine[1.2.0] | 10.868 | |
testJupiterEngineWithDisplayNames[1.2.0] | 10.607 | |
testJupiterEngineWithErrorInTestTemplateProvider[1.2.0] | 8.343 | |
testJupiterEngineWithFailureInTestFactory[1.2.0] | 10.093 | |
testJupiterEngineWithErrorInTestFactory[1.2.0] | 9.126 | |
platform[1.2.0] | 8.328 | |
testJupiterEngineWithAssertionsFailEmptyStringParameters[1.3.2] | 9.846 | |
testToRegex[1.3.2] | 0 | |
testJupiterEngineWithAssertionsFailNoParameters[1.3.2] | 9.586 | |
testJupiterEngineWithExceptionMessage[1.3.2] | 7.945 | |
testTags[1.3.2] | 7.873 | |
failingBeforeAllMethod[1.3.2] | 8.05 | |
testJupiterEngineWithAssertionsFailMessage[1.3.2] | 8.561 | |
errorInBeforeAllMethod[1.3.2] | 8.538 | |
testJupiterEngineWithFailureInParameterizedSource[1.3.2] | 11.128 | |
testJupiterEngineWithFailureInTestTemplateProvider[1.3.2] | 9.603 | |
testJupiterEngineWithErrorInParameterizedSource[1.3.2] | 8.294 | |
testJupiterEngine[1.3.2] | 9.081 | |
testJupiterEngineWithDisplayNames[1.3.2] | 9.344 | |
testJupiterEngineWithErrorInTestTemplateProvider[1.3.2] | 8.475 | |
testJupiterEngineWithFailureInTestFactory[1.3.2] | 9.529 | |
testJupiterEngineWithErrorInTestFactory[1.3.2] | 9.903 | |
platform[1.3.2] | 8.398 | |
testJupiterEngineWithAssertionsFailEmptyStringParameters[1.4.2] | 8.228 | |
testToRegex[1.4.2] | 0 | |
testJupiterEngineWithAssertionsFailNoParameters[1.4.2] | 8.287 | |
testJupiterEngineWithExceptionMessage[1.4.2] | 8.232 | |
testTags[1.4.2] | 7.827 | |
failingBeforeAllMethod[1.4.2] | 9.643 | |
testJupiterEngineWithAssertionsFailMessage[1.4.2] | 10.193 | |
errorInBeforeAllMethod[1.4.2] | 8.374 | |
testJupiterEngineWithFailureInParameterizedSource[1.4.2] | 8.678 | |
testJupiterEngineWithFailureInTestTemplateProvider[1.4.2] | 10.964 | |
testJupiterEngineWithErrorInParameterizedSource[1.4.2] | 10.005 | |
testJupiterEngine[1.4.2] | 13.91 | |
testJupiterEngineWithDisplayNames[1.4.2] | 14.512 | |
testJupiterEngineWithErrorInTestTemplateProvider[1.4.2] | 8.882 | |
testJupiterEngineWithFailureInTestFactory[1.4.2] | 10.927 | |
testJupiterEngineWithErrorInTestFactory[1.4.2] | 10.711 | |
platform[1.4.2] | 8.255 | |
testJupiterEngineWithAssertionsFailEmptyStringParameters[1.5.2] | 9.663 | |
testToRegex[1.5.2] | 0 | |
testJupiterEngineWithAssertionsFailNoParameters[1.5.2] | 10.205 | |
testJupiterEngineWithExceptionMessage[1.5.2] | 11.098 | |
testTags[1.5.2] | 10.62 | |
failingBeforeAllMethod[1.5.2] | 8.494 | |
testJupiterEngineWithAssertionsFailMessage[1.5.2] | 8.472 | |
errorInBeforeAllMethod[1.5.2] | 10.529 | |
testJupiterEngineWithFailureInParameterizedSource[1.5.2] | 11.438 | |
testJupiterEngineWithFailureInTestTemplateProvider[1.5.2] | 11.059 | |
testJupiterEngineWithErrorInParameterizedSource[1.5.2] | 8.779 | |
testJupiterEngine[1.5.2] | 9.185 | |
testJupiterEngineWithDisplayNames[1.5.2] | 9.638 | |
testJupiterEngineWithErrorInTestTemplateProvider[1.5.2] | 9.995 | |
testJupiterEngineWithFailureInTestFactory[1.5.2] | 11.747 | |
testJupiterEngineWithErrorInTestFactory[1.5.2] | 9.983 | |
platform[1.5.2] | 8.235 | |
testJupiterEngineWithAssertionsFailEmptyStringParameters[1.6.2] | 8.491 | |
testToRegex[1.6.2] | 0 | |
testJupiterEngineWithAssertionsFailNoParameters[1.6.2] | 8.284 | |
testJupiterEngineWithExceptionMessage[1.6.2] | 8.919 | |
testTags[1.6.2] | 10.456 | |
failingBeforeAllMethod[1.6.2] | 9.976 | |
testJupiterEngineWithAssertionsFailMessage[1.6.2] | 8.146 | |
errorInBeforeAllMethod[1.6.2] | 8.281 | |
testJupiterEngineWithFailureInParameterizedSource[1.6.2] | 8.468 | |
testJupiterEngineWithFailureInTestTemplateProvider[1.6.2] | 8.682 | |
testJupiterEngineWithErrorInParameterizedSource[1.6.2] | 9.289 | |
testJupiterEngine[1.6.2] | 10.904 | |
testJupiterEngineWithDisplayNames[1.6.2] | 10.447 | |
testJupiterEngineWithErrorInTestTemplateProvider[1.6.2] | 8.527 | |
testJupiterEngineWithFailureInTestFactory[1.6.2] | 9.219 | |
testJupiterEngineWithErrorInTestFactory[1.6.2] | 12.268 | |
platform[1.6.2] | 11.921 |
JUnitPlatformIT
JUnitPlatformRerunFailingTestsIT
JUnitPlatformStreamCorruptionIT
warningIsNotEmitted | 10.052 | |
warningIsNotEmittedWithJulToLog4j | 0 | |
https://issues.apache.org/jira/browse/SUREFIRE-1659?focusedCommentId=17374005&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-17374005 | ||
warningIsNotEmittedWithJulToSlf4j | 11.275 |
LongWindowsPathIT
shouldRunInSystemTmp | 11.663 |
ModulePathIT
testModulePathWithSpaces | 10.914 | |
testModulePath | 10.589 |
MultiModuleProjectWithJPMSIT
test | 15.489 |
NoRunnableTestsInClassIT
testJunit3ParallelBuildResultCount | 9.65 |
PlainOldJavaClasspathIT
testPlainOldJavaClasspath | 8.595 |
PlexusConflictIT
testPlexusConflict | 7.386 | |
testPlexusConflictIsolatedClassLoader | 7.42 |
PojoSimpleIT
twoTestsWithFixtures | 8.084 |
ReportersIT
testRedirectOutputTestNg | 7.961 |
ResultCountingIT
testCountingWithJunit481ForkAlways | 11.288 | |
testCountingWithJunit481ForkOnce | 9.708 | |
testCountingWithJunit481ForkNever | 7.999 |
RunOrderIT
RunOrderParallelForksIT
SiblingAggregatorIT
testSiblingAggregator | 8.01 |
SmartStackTraceIT
misg | 9.28 |
Surefire1602IT
nonCanonicalPath | 18.642 |
SystemPropertiesTestIT
testSystemProperties | 13.337 | |
testSystemPropertiesNoFork | 10.158 |
TestMethodPatternIT
TestMultipleMethodPatternsIT
shouldNotRunExcludedClassesAndMethods[0] | 8.36 | |
shouldMatchExactClassAndMethodCharacters[0] | 7.211 | |
shouldMatchExactClassAndMethodWildcard[0] | 6.941 | |
testSuccessTwo[0] | 7.16 | |
simpleNameTest[0] | 7.197 | |
simpleNameTestWithJavaExt[0] | 7.208 | |
regexClass[0] | 7.593 | |
shouldNotRunExcludedClasses[0] | 8.557 | |
shouldNotRunExcludedMethods[0] | 8.613 | |
simpleNameTestWithJavaExtWildcardPkg[0] | 7.306 | |
shouldMatchMultiplePatterns[0] | 7.007 | |
shouldMatchExactClassAndMethodsPostfix[0] | 6.97 | |
simpleNameTestWithWildcardPkg[0] | 7.042 | |
shouldMatchWildcardPackageAndClassAndMethod[0] | 6.882 | |
shouldMatchExactClassAndMultipleMethods[0] | 7.495 | |
fullyQualifiedTest[0] | 8.703 | |
matchSimpleClassAndMethodWithJavaExtWildcardPkg[0] | 8.245 | |
negativeTest[0] | 0 | |
got: <TEST>, expected: (is <INCLUDES> or is <INCLUDES_EXCLUDES> or is <INCLUDES_FILE> or is <INCLUDES_EXCLUDES_FILE>) | ||
testRegexSuccessTwo[0] | 7.371 | |
shouldMatchExactClassAndMethodsWildcard[0] | 7.003 | |
shouldMatchMultiplePatternsComplex[0] | 7.08 | |
simpleNameTestAsParallel[0] | 0 | |
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>) | ||
matchSimpleClassAndMethodWithWildcardPkg[0] | 7.255 | |
shouldMatchMultiplePatternsAsParallel[0] | 0 | |
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>) | ||
shouldNotRunExcludedClassesIfIncluded[0] | 7.448 | |
shouldMatchSimpleClassNameAndMethod[0] | 7.827 | |
shouldMatchExactClassAndMethodPostfix[0] | 8.341 | |
shouldMatchMultiplePatternsComplexAsParallel[0] | 0 | |
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>) | ||
matchSimpleClassAndMethodWithJavaExt[0] | 7.995 | |
regexClassAndMethod[0] | 6.935 | |
shouldNotRunExcludedClassesAndMethods[1] | 8.26 | |
shouldMatchExactClassAndMethodCharacters[1] | 8.243 | |
shouldMatchExactClassAndMethodWildcard[1] | 8.169 | |
testSuccessTwo[1] | 9.181 | |
simpleNameTest[1] | 10.183 | |
simpleNameTestWithJavaExt[1] | 9.235 | |
regexClass[1] | 8.165 | |
shouldNotRunExcludedClasses[1] | 8.193 | |
shouldNotRunExcludedMethods[1] | 8.244 | |
simpleNameTestWithJavaExtWildcardPkg[1] | 7.975 | |
shouldMatchMultiplePatterns[1] | 9.227 | |
shouldMatchExactClassAndMethodsPostfix[1] | 10.365 | |
simpleNameTestWithWildcardPkg[1] | 9.162 | |
shouldMatchWildcardPackageAndClassAndMethod[1] | 7.989 | |
shouldMatchExactClassAndMultipleMethods[1] | 8.181 | |
fullyQualifiedTest[1] | 8.398 | |
matchSimpleClassAndMethodWithJavaExtWildcardPkg[1] | 7.926 | |
negativeTest[1] | 0 | |
got: <TEST>, expected: (is <INCLUDES> or is <INCLUDES_EXCLUDES> or is <INCLUDES_FILE> or is <INCLUDES_EXCLUDES_FILE>) | ||
testRegexSuccessTwo[1] | 9.222 | |
shouldMatchExactClassAndMethodsWildcard[1] | 10.105 | |
shouldMatchMultiplePatternsComplex[1] | 9.849 | |
simpleNameTestAsParallel[1] | 9.438 | |
matchSimpleClassAndMethodWithWildcardPkg[1] | 8.32 | |
shouldMatchMultiplePatternsAsParallel[1] | 8.444 | |
shouldNotRunExcludedClassesIfIncluded[1] | 8.124 | |
shouldMatchSimpleClassNameAndMethod[1] | 10.042 | |
shouldMatchExactClassAndMethodPostfix[1] | 10.151 | |
shouldMatchMultiplePatternsComplexAsParallel[1] | 8.367 | |
matchSimpleClassAndMethodWithJavaExt[1] | 8.57 | |
regexClassAndMethod[1] | 8.501 | |
shouldNotRunExcludedClassesAndMethods[2] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMethodCharacters[2] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMethodWildcard[2] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
testSuccessTwo[2] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
simpleNameTest[2] | 7.019 | |
simpleNameTestWithJavaExt[2] | 7.639 | |
regexClass[2] | 10.391 | |
shouldNotRunExcludedClasses[2] | 10.728 | |
shouldNotRunExcludedMethods[2] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
simpleNameTestWithJavaExtWildcardPkg[2] | 9.627 | |
shouldMatchMultiplePatterns[2] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMethodsPostfix[2] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
simpleNameTestWithWildcardPkg[2] | 7.164 | |
shouldMatchWildcardPackageAndClassAndMethod[2] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMultipleMethods[2] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
fullyQualifiedTest[2] | 6.938 | |
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
negativeTest[2] | 6.298 | |
testRegexSuccessTwo[2] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMethodsWildcard[2] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
shouldMatchMultiplePatternsComplex[2] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
simpleNameTestAsParallel[2] | 0 | |
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>) | ||
matchSimpleClassAndMethodWithWildcardPkg[2] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
shouldMatchMultiplePatternsAsParallel[2] | 0 | |
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>) | ||
shouldNotRunExcludedClassesIfIncluded[2] | 6.945 | |
shouldMatchSimpleClassNameAndMethod[2] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMethodPostfix[2] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
shouldMatchMultiplePatternsComplexAsParallel[2] | 0 | |
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>) | ||
matchSimpleClassAndMethodWithJavaExt[2] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
regexClassAndMethod[2] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
shouldNotRunExcludedClassesAndMethods[3] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMethodCharacters[3] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMethodWildcard[3] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
testSuccessTwo[3] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
simpleNameTest[3] | 8.776 | |
simpleNameTestWithJavaExt[3] | 10.318 | |
regexClass[3] | 9.012 | |
shouldNotRunExcludedClasses[3] | 7.95 | |
shouldNotRunExcludedMethods[3] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
simpleNameTestWithJavaExtWildcardPkg[3] | 8.126 | |
shouldMatchMultiplePatterns[3] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMethodsPostfix[3] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
simpleNameTestWithWildcardPkg[3] | 8.205 | |
shouldMatchWildcardPackageAndClassAndMethod[3] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMultipleMethods[3] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
fullyQualifiedTest[3] | 8.082 | |
matchSimpleClassAndMethodWithJavaExtWildcardPkg[3] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
negativeTest[3] | 6.191 | |
testRegexSuccessTwo[3] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMethodsWildcard[3] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
shouldMatchMultiplePatternsComplex[3] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
simpleNameTestAsParallel[3] | 10.059 | |
matchSimpleClassAndMethodWithWildcardPkg[3] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
shouldMatchMultiplePatternsAsParallel[3] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
shouldNotRunExcludedClassesIfIncluded[3] | 10.52 | |
shouldMatchSimpleClassNameAndMethod[3] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMethodPostfix[3] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
shouldMatchMultiplePatternsComplexAsParallel[3] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
matchSimpleClassAndMethodWithJavaExt[3] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
regexClassAndMethod[3] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
shouldNotRunExcludedClassesAndMethods[4] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMethodCharacters[4] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMethodWildcard[4] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
testSuccessTwo[4] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
simpleNameTest[4] | 6.866 | |
simpleNameTestWithJavaExt[4] | 6.819 | |
regexClass[4] | 6.553 | |
shouldNotRunExcludedClasses[4] | 6.826 | |
shouldNotRunExcludedMethods[4] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
simpleNameTestWithJavaExtWildcardPkg[4] | 6.74 | |
shouldMatchMultiplePatterns[4] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMethodsPostfix[4] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
simpleNameTestWithWildcardPkg[4] | 7.709 | |
shouldMatchWildcardPackageAndClassAndMethod[4] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMultipleMethods[4] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
fullyQualifiedTest[4] | 8.531 | |
matchSimpleClassAndMethodWithJavaExtWildcardPkg[4] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
negativeTest[4] | 7.194 | |
testRegexSuccessTwo[4] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMethodsWildcard[4] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
shouldMatchMultiplePatternsComplex[4] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
simpleNameTestAsParallel[4] | 0 | |
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>) | ||
matchSimpleClassAndMethodWithWildcardPkg[4] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
shouldMatchMultiplePatternsAsParallel[4] | 0 | |
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>) | ||
shouldNotRunExcludedClassesIfIncluded[4] | 7.136 | |
shouldMatchSimpleClassNameAndMethod[4] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMethodPostfix[4] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
shouldMatchMultiplePatternsComplexAsParallel[4] | 0 | |
got: <JUNIT4>, expected: (is <JUNIT47> or is <TestNG>) | ||
matchSimpleClassAndMethodWithJavaExt[4] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
regexClassAndMethod[4] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
shouldNotRunExcludedClassesAndMethods[5] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMethodCharacters[5] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMethodWildcard[5] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
testSuccessTwo[5] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
simpleNameTest[5] | 8.017 | |
simpleNameTestWithJavaExt[5] | 8.12 | |
regexClass[5] | 8.229 | |
shouldNotRunExcludedClasses[5] | 8.899 | |
shouldNotRunExcludedMethods[5] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
simpleNameTestWithJavaExtWildcardPkg[5] | 10.558 | |
shouldMatchMultiplePatterns[5] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMethodsPostfix[5] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
simpleNameTestWithWildcardPkg[5] | 11.734 | |
shouldMatchWildcardPackageAndClassAndMethod[5] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMultipleMethods[5] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
fullyQualifiedTest[5] | 8.887 | |
matchSimpleClassAndMethodWithJavaExtWildcardPkg[5] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
negativeTest[5] | 6.207 | |
testRegexSuccessTwo[5] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMethodsWildcard[5] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
shouldMatchMultiplePatternsComplex[5] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
simpleNameTestAsParallel[5] | 8.194 | |
matchSimpleClassAndMethodWithWildcardPkg[5] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
shouldMatchMultiplePatternsAsParallel[5] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
shouldNotRunExcludedClassesIfIncluded[5] | 8.511 | |
shouldMatchSimpleClassNameAndMethod[5] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMethodPostfix[5] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
shouldMatchMultiplePatternsComplexAsParallel[5] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
matchSimpleClassAndMethodWithJavaExt[5] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
regexClassAndMethod[5] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> |
TestMultipleMethodPatternsTestNGIT
shouldNotRunExcludedClassesAndMethods[0] | 7.699 | |
shouldMatchExactClassAndMethodCharacters[0] | 9.203 | |
shouldMatchExactClassAndMethodWildcard[0] | 8.896 | |
testSuccessTwo[0] | 8.092 | |
simpleNameTest[0] | 7.029 | |
simpleNameTestWithJavaExt[0] | 7.256 | |
regexClass[0] | 7.626 | |
shouldNotRunExcludedClasses[0] | 7.978 | |
shouldNotRunExcludedMethods[0] | 7.88 | |
simpleNameTestWithJavaExtWildcardPkg[0] | 8.76 | |
shouldMatchMultiplePatterns[0] | 7.748 | |
shouldMatchExactClassAndMethodsPostfix[0] | 7.233 | |
simpleNameTestWithWildcardPkg[0] | 6.948 | |
shouldMatchWildcardPackageAndClassAndMethod[0] | 7.177 | |
shouldMatchExactClassAndMultipleMethods[0] | 7.235 | |
fullyQualifiedTest[0] | 7.022 | |
matchSimpleClassAndMethodWithJavaExtWildcardPkg[0] | 8.009 | |
negativeTest[0] | 0 | |
got: <TEST>, expected: (is <INCLUDES> or is <INCLUDES_EXCLUDES> or is <INCLUDES_FILE> or is <INCLUDES_EXCLUDES_FILE>) | ||
testRegexSuccessTwo[0] | 8.995 | |
shouldMatchExactClassAndMethodsWildcard[0] | 7.769 | |
shouldMatchMultiplePatternsComplex[0] | 7.049 | |
simpleNameTestAsParallel[0] | 6.916 | |
matchSimpleClassAndMethodWithWildcardPkg[0] | 7.002 | |
shouldMatchMultiplePatternsAsParallel[0] | 9.84 | |
shouldNotRunExcludedClassesIfIncluded[0] | 10.157 | |
shouldMatchSimpleClassNameAndMethod[0] | 10.752 | |
shouldMatchExactClassAndMethodPostfix[0] | 9.133 | |
shouldMatchMultiplePatternsComplexAsParallel[0] | 7.615 | |
matchSimpleClassAndMethodWithJavaExt[0] | 7.056 | |
regexClassAndMethod[0] | 7.051 | |
shouldNotRunExcludedClassesAndMethods[1] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMethodCharacters[1] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMethodWildcard[1] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
testSuccessTwo[1] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
simpleNameTest[1] | 7.125 | |
simpleNameTestWithJavaExt[1] | 7.014 | |
regexClass[1] | 8.148 | |
shouldNotRunExcludedClasses[1] | 8.573 | |
shouldNotRunExcludedMethods[1] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
simpleNameTestWithJavaExtWildcardPkg[1] | 7.795 | |
shouldMatchMultiplePatterns[1] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMethodsPostfix[1] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
simpleNameTestWithWildcardPkg[1] | 7.118 | |
shouldMatchWildcardPackageAndClassAndMethod[1] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMultipleMethods[1] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
fullyQualifiedTest[1] | 7.028 | |
matchSimpleClassAndMethodWithJavaExtWildcardPkg[1] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
negativeTest[1] | 5.978 | |
testRegexSuccessTwo[1] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMethodsWildcard[1] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
shouldMatchMultiplePatternsComplex[1] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
simpleNameTestAsParallel[1] | 7.068 | |
matchSimpleClassAndMethodWithWildcardPkg[1] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
shouldMatchMultiplePatternsAsParallel[1] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
shouldNotRunExcludedClassesIfIncluded[1] | 7.29 | |
shouldMatchSimpleClassNameAndMethod[1] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMethodPostfix[1] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
shouldMatchMultiplePatternsComplexAsParallel[1] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
matchSimpleClassAndMethodWithJavaExt[1] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
regexClassAndMethod[1] | 0 | |
got: <INCLUDES>, expected: is <TEST> | ||
shouldNotRunExcludedClassesAndMethods[2] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMethodCharacters[2] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMethodWildcard[2] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
testSuccessTwo[2] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
simpleNameTest[2] | 8.182 | |
simpleNameTestWithJavaExt[2] | 8.965 | |
regexClass[2] | 8.829 | |
shouldNotRunExcludedClasses[2] | 7.066 | |
shouldNotRunExcludedMethods[2] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
simpleNameTestWithJavaExtWildcardPkg[2] | 7.126 | |
shouldMatchMultiplePatterns[2] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMethodsPostfix[2] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
simpleNameTestWithWildcardPkg[2] | 7.005 | |
shouldMatchWildcardPackageAndClassAndMethod[2] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMultipleMethods[2] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
fullyQualifiedTest[2] | 6.888 | |
matchSimpleClassAndMethodWithJavaExtWildcardPkg[2] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
negativeTest[2] | 5.957 | |
testRegexSuccessTwo[2] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMethodsWildcard[2] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
shouldMatchMultiplePatternsComplex[2] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
simpleNameTestAsParallel[2] | 7.911 | |
matchSimpleClassAndMethodWithWildcardPkg[2] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
shouldMatchMultiplePatternsAsParallel[2] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
shouldNotRunExcludedClassesIfIncluded[2] | 8.525 | |
shouldMatchSimpleClassNameAndMethod[2] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
shouldMatchExactClassAndMethodPostfix[2] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
shouldMatchMultiplePatternsComplexAsParallel[2] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
matchSimpleClassAndMethodWithJavaExt[2] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> | ||
regexClassAndMethod[2] | 0 | |
got: <INCLUDES_EXCLUDES>, expected: is <TEST> |
TestMultipleMethodsIT
testJunit48Provider4 | 8.842 | |
testJunit44 | 6.875 | |
testJunit48Provider47 | 9.02 |
TestNgGroupsIT
testExclusion | 8.055 | |
testGroupsAndExclusion | 8.15 | |
groupsWithDash | 8.663 | |
testOnlyGroups | 10.07 | |
groupsBySimpleRegex | 9.056 |
TestNgParallelWithAnnotationsIT
testTestNgGroupThreadParallel | 14.438 |
TestNgSuccessPercentageIT
testPassesWhenFailuresLessThanSuccessPercentage | 6.998 |
TestSingleMethodIT
TimeoutForkedTestIT
testTimeoutForked | 18.391 |
TwoTestCasesIT
testJunit4Suite | 7.161 | |
testTestNGSuite | 7.667 | |
testTwoTestCases | 7.314 | |
testTwoTestCaseSuite | 7.185 |
UmlautDirIT
surefire1617WithColonInLocalRepo | 0 | |
got: <false>, expected: is <true> | ||
surefire1617WithColonInProjectDir | 0 | |
got: <false>, expected: is <true> | ||
testUmlautIsolatedClassLoader | 8.344 | |
testUmlaut | 9.504 |
UnicodeTestNamesIT
checkFileNamesWithUnicode | 13.778 |
UseIsolatedClassLoaderIT
testUseSystemClassLoader | 7.053 |
WorkingDirectoryIsInvalidPropertyIT
testWorkingDirectory | 6.687 |
WorkingDirectoryIT
testWorkingDirectory | 7.174 | |
testWorkingDirectoryChildOnlyNoFork | 6.371 | |
testWorkingDirectoryNoFork | 6.397 | |
testWorkingDirectoryChildOnly | 7.29 |
WorkingDirectoryMissingIT
testWorkingDirectory | 8.697 |
XmlReporterRunTimeIT
testForkModeAlways | 31.753 |
Failure Details
[Summary] [Package List] [Test Cases]