Skip to content

Jakarta EE 11 TCK Tests

Jump to bottom
David Matějček edited this page Sep 4, 2024 · 30 revisions

Introduction

WARNING: This file is actually updated until I remove this message.

Watch these links:

All TCK tests can be executed directly from the GlassFish git repository (IN PROGRESS, MANY WILL FAIL). Prerequisities are:

  • JDK21
  • Maven 3.9.6+
  • Ant 1.10.14+
  • Docker host(s)

Or you can use precreated docker node for these builds: dmatej/glassfish-jenkins-node for builds on your Jenkins.

In 2024 the TCK team made a huge progress with the refactoring and moving TCK tests to standalone repositories. That means that we have to follow in this repository too. However the "tckrefactor" branch is not compilable as of 16th April 2024 and currently we don't know if tests in it will be yet useful with the release of TCK for Jakarta EE 11 or if everything will be moved to "standalone".

Parts of the TCK Set

Activation

  • TODO: antrun, still JEE10 based, however succeeds.
  • 93 tests, 1 minute.
mvn clean install -Ptck -pl :jakarta-activation-tck,:glassfish-external-tck-activation

Application Client

  • TODO: Still JEE10 Platform based, fails to start the server.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=ApplicationClientITest

Authentication

  • 162 tests, 9 minutes.
mvn clean install -Ptck -pl :jakarta-authentication-tck,:glassfish-external-tck-authentication

Authorization

  • ? tests, 6 minutes
mvn clean install -Ptck -pl :jakarta-authorization-tck,:glassfish-external-tck-authorization

CDI, Contexts and Dependency Injection

  • 1334 tests, 18 minutes.
mvn clean install -amd -fae -Ptck -pl :glassfish-external-tck-cdi-parent

Concurrency

  • 295 tests, 12 minutes.
  • Upgrade done.
mvn clean install -Ptck -pl :glassfish-external-tck-concurrency

Connectors

  • 133 tests, 7 minutes:
  • TODO: Still JEE10 based, 130 passed, 3 failures.
mvn clean install -Ptck -pl :jakarta-connectors-tck,:glassfish-external-tck-connectors

[INFO]      [exec] [javatest.batch] FAILED........com/sun/ts/tests/connector/permissiondd/Client.java#testValidateCustomPerm_from_connectorservlet
[INFO]      [exec] [javatest.batch] FAILED........com/sun/ts/tests/connector/permissiondd/Client.java#testValidateLocalGrantForCustomPerm_from_connectorservlet
[INFO]      [exec] [javatest.batch] FAILED........com/sun/ts/tests/connector/permissiondd/Client.java#testValidateLocalPermsInvalidName_from_connectorservlet

EJB, Enterprise Beans

  • This is a huge package, so we usually execute it per partes.
  • TODO: Still JEE10 Platform, waiting for a conversion.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=EjbITest # all EJB tests in one block.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=EjbITest#ejb # 1793 tests, 5-7 hours.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=EjbITest#ejb30LiteStatefulTimeout # 44 tests, 6.5 hours.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=EjbITest#ejb30BB # 1193 tests, 5-7 hours.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=EjbITest#ejb30LiteAppException # 365 tests, 33 minutes.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=EjbITest#ejb30LiteAsync # 300 tests, 30 minutes.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=EjbITest#ejb30LiteBasic # 105 tests, 16 minutes.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=EjbITest#ejb30LiteEjbContext # 50 tests, 7 minutes.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=EjbITest#ejb30LiteEnvEntry # 30 tests, 11 minutes.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=EjbITest#ejb30LiteLookup # 30 tests, 7 minutes.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=EjbITest#ejb30LiteNaming # 54 tests, 10 minutes.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=EjbITest#ejb30LiteNointerface # 60 tests, 12 minutes.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=EjbITest#ejb30LitePackaging # 211 tests, 20 minutes.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=EjbITest#ejb30LiteSingleton # 230 tests, 49 minutes.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=EjbITest#ejb30LiteStatefulConcurrency # 80 tests, 41 minutes.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=EjbITest#ejb30LiteTx # 358 tests, 30 minutes.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=EjbITest#ejb30LiteView # 95 tests, 15 minutes.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=EjbITest#ejb30LiteXmlOverride # 30 tests, 7 minutes.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=EjbITest#ejb30Assembly # 51 tests, 10 minutes.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=EjbITest#ejb30Misc # 95 tests, 19 minutes.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=EjbITest#ejb30Sec # 99 tests, 13 minutes.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=EjbITest#ejb30Timer # 178 tests, 68 minutes.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=EjbITest#ejb30Webservice # 3 tests, 8 minutes.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=EjbITest#ejb30Zombie # 1 tests, 7 minutes.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=EjbITest#ejb32 # 825 tests, 4-5 hours.

EL, Expression Language

  • 361 tests, 20 seconds
mvn clean install -Ptck -pl :jakarta-expression-language-tck,:glassfish-external-tck-expression-language

Faces

  • ? tests, need 3 hours to pass.
mvn clean install -Ptck -pl :jakarta-faces-tck,:glassfish-external-tck-faces

JDBC

  • TODO: Still based on JEE10 Platform.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=JdbcITest#appClient # 1231 tests, 150 minutes.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=JdbcITest#ejb # 1231 tests, 150 minutes.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=JdbcITest#jsp # 1231 tests, 120 minutes.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=JdbcITest#servlet # 1231 tests, 120 minutes.

JSON

  • TODO: Still based on JEE10 Platform.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=JSONITest#jsonb # 18 tests, 9 minutes.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=JSONITest#jsonp # 76 tests, 12 minutes.
mvn clean install -Ptck -pl :glassfish-external-tck-jsonp # 179 tests, 40 seconds.

The third line crashes with:

ClassSelector [className = 'ee.jakarta.tck.jsonp.api.jsonobjecttests.ClientTests', classLoader = null] resolution failed: jakarta/json/JsonValue: jakarta.json.JsonValue

Mail

  • TODO: Still based on JEE10 Platform.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=MailITest

Messaging

  • TODO: Still based on JEE10 Platform.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=MessagingITest

Microprofile

  • TODO: Fails due to OSGI error.
mvn clean install -amd -fae -Ptck -pl :glassfish-external-tck-microprofile

Pages

  • 682 tests, 6 minutes
mvn clean install -Ptck -pl :javatest,:jakarta-pages-tck,:glassfish-external-tck-pages

Pages - Tags

  • 542 tests, 19 minutes.
  • TODO: Still JEE10 based, uses antrun, 501 passed, 31 failed.
mvn clean install -Ptck -pl :jakarta-pages-tags-tck,:glassfish-external-tck-pages-tags

Persistence

  • TODO: Still based on JEE10 Platform.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=PersistenceITest#appManaged # 1749 tests, 5-6 hours.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=PersistenceITest#appManagedNoTx # 1887 tests, 5-6 hours.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=PersistenceITest#pmServlet # 1895 tests, 96 minutes.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=PersistenceITest#puServlet # 1885 tests, 2 hours.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=PersistenceITest#stateful3 # 1749 tests, 2-3 hours.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=PersistenceITest#stateless3 # 1897 tests, 160 minutes.

REST

  • 2796 tests, 7 minutes.
mvn clean install -Ptck -pl :jakarta-rest-tck,:glassfish-external-tck-rest

Servlet

  • Standalone variant, 1716 tests, 16 minutes.
  • Already updated to JEE11
mvn clean install -Ptck -pl :jakarta-servlet-tck,:glassfish-external-tck-servlet

SOAP Webservices

  • TODO: Still based on JEE10 Platform.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=WebservicesITest#webservices12 # 242 tests, 96 minutes.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=WebservicesITest#webservices13 # 53 tests, 27 minutes.

Transactions

  • TODO: Still based on JEE10 Platform
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=TransactionsITest#jta # 141 tests, 17 minutes.
mvn clean install -Ptck -pl :platform-tck-runner -Dit.test=TransactionsITest#xa # 66 tests, 10 minutes.

Validation

  • 1049 tests, 6 minutes.
mvn clean install -Ptck -pl :glassfish-external-tck-validation

WebSocket

  • 737 tests, 4 minutes.
mvn clean install -Ptck -pl :jakarta-websocket-tck,:glassfish-external-tck-websocket
Clone this wiki locally