Skip to content

TEZ-4688 TEZ-4648: Tez upgrade to Hadoop 3.5.0 and jersey 2.x#474

Open
maheshrajus wants to merge 11 commits into
apache:masterfrom
maheshrajus:TEZ-4688
Open

TEZ-4688 TEZ-4648: Tez upgrade to Hadoop 3.5.0 and jersey 2.x#474
maheshrajus wants to merge 11 commits into
apache:masterfrom
maheshrajus:TEZ-4688

Conversation

@maheshrajus

@maheshrajus maheshrajus commented Apr 6, 2026

Copy link
Copy Markdown
Contributor

What changes were proposed in this PR?

This PR upgrades Tez to support:

  • Hadoop 3.5.0
  • Jersey 2.x

As part of the upgrade, several ATS Timeline API response format differences were observed between older Hadoop versions and Hadoop 3.5.0. This PR adds compatibility handling for those schema variations.

Main updates include:

  • Migrated Jersey client usage from Jersey 1.x APIs to Jersey 2.x APIs
  • Added handling for ATS field name variations observed across versions
    Handled ATS compatibility differences including:
  • otherinfootherInfo
  • entityentityId
  • entitytypeentityType
  • domain / iddomainId

Additional fixes:

  • Handled nested Timeline domain JSON structures
  • Stabilized ATS-related unit tests after Jersey 2.x migration

How was this patch tested?

  • with existed UT and all unit tests are green.

jersey upgrade changes taken from PR : #429 by @abstractdog as they need for hadoop 3.5.0 upgrade.

@kokila-19

Copy link
Copy Markdown
Contributor

FYI,
https://issues.apache.org/jira/browse/TEZ-4648 Jersey upgrade is also required for hadoop upgrade

@tez-yetus

This comment was marked as outdated.

@maheshrajus maheshrajus changed the title TEZ-4688: Upgrade to Hadoop 3.5.0 TEZ-4688 TEZ-4648: [WIP] Tez upgrade to Hadoop 3.5.0 and jersey 2.x Apr 6, 2026
@tez-yetus

This comment was marked as outdated.

@tez-yetus

This comment was marked as outdated.

@maheshrajus maheshrajus changed the title TEZ-4688 TEZ-4648: [WIP] Tez upgrade to Hadoop 3.5.0 and jersey 2.x TEZ-4688 TEZ-4648: Tez upgrade to Hadoop 3.5.0 and jersey 2.x Apr 8, 2026
@tez-yetus

This comment was marked as outdated.

@tez-yetus

This comment was marked as outdated.

@maheshrajus

Copy link
Copy Markdown
Contributor Author

@abstractdog @ayushtkn Can you please review and provide comments if any. Thanks !

@Aggarwal-Raghav

Copy link
Copy Markdown
Contributor

@maheshrajus , can you please rebase this PR and resolve merge conflicts?

@maheshrajus

Copy link
Copy Markdown
Contributor Author

@Aggarwal-Raghav Hi, i rebased and pushed the commit just now. Could you please take a look at this? Thanks !

Comment thread pom.xml
Comment thread pom.xml Outdated
@Aggarwal-Raghav

Copy link
Copy Markdown
Contributor

The explicit dependency of org.codehaus.jettison should be removed from tez and moved to use fasterxml IMO, the question is whether it should be done in this JIRA scope or a separate JIRA.

Comment thread pom.xml
@tez-yetus

This comment was marked as outdated.

@maheshrajus

Copy link
Copy Markdown
Contributor Author

The explicit dependency of org.codehaus.jettison should be removed from tez and moved to use fasterxml IMO, the question is whether it should be done in this JIRA scope or a separate JIRA.

@Aggarwal-Raghav Better this we will handle separately. thanks !

@tez-yetus

Copy link
Copy Markdown

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 38s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+0 🆗 xmllint 0m 0s xmllint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 5 new or modified test files.
_ master Compile Tests _
+0 🆗 mvndep 0m 41s Maven dependency ordering for branch
+1 💚 mvninstall 4m 36s master passed
+1 💚 compile 7m 42s master passed
+1 💚 checkstyle 5m 45s master passed
+1 💚 javadoc 6m 13s master passed
+0 🆗 spotbugs 1m 32s tez-api in master has 545 extant spotbugs warnings.
+0 🆗 spotbugs 1m 47s tez-dag in master has 749 extant spotbugs warnings.
+0 🆗 spotbugs 0m 50s tez-tests in master has 6 extant spotbugs warnings.
+0 🆗 spotbugs 0m 47s tez-ext-service-tests in master has 62 extant spotbugs warnings.
+0 🆗 spotbugs 0m 46s tez-plugins/tez-protobuf-history-plugin in master has 26 extant spotbugs warnings.
+0 🆗 spotbugs 0m 43s tez-plugins/tez-yarn-timeline-history in master has 2 extant spotbugs warnings.
+0 🆗 spotbugs 0m 39s tez-plugins/tez-yarn-timeline-history-with-acls in master has 2 extant spotbugs warnings.
+0 🆗 spotbugs 0m 41s tez-plugins/tez-yarn-timeline-history-with-fs in master has 5 extant spotbugs warnings.
+0 🆗 spotbugs 0m 45s tez-plugins/tez-history-parser in master has 21 extant spotbugs warnings.
+0 🆗 spotbugs 0m 44s tez-plugins/tez-aux-services in master has 5 extant spotbugs warnings.
+0 🆗 spotbugs 6m 58s root in master has 1935 extant spotbugs warnings.
+0 🆗 spotbugs 0m 43s tez-tools/analyzers/job-analyzer in master has 20 extant spotbugs warnings.
_ Patch Compile Tests _
+0 🆗 mvndep 0m 22s Maven dependency ordering for patch
-1 ❌ mvninstall 0m 18s /patch-mvninstall-tez-tests.txt tez-tests in the patch failed.
+1 💚 codespell 1m 48s No new issues.
+1 💚 compile 7m 45s the patch passed
+1 💚 javac 7m 45s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
+1 💚 checkstyle 0m 27s tez-api: The patch generated 0 new + 34 unchanged - 4 fixed = 34 total (was 38)
+1 💚 checkstyle 0m 37s The patch passed checkstyle in tez-dag
+1 💚 checkstyle 0m 26s The patch passed checkstyle in tez-tests
+1 💚 checkstyle 0m 23s The patch passed checkstyle in tez-ext-service-tests
+1 💚 checkstyle 0m 23s The patch passed checkstyle in tez-protobuf-history-plugin
+1 💚 checkstyle 0m 24s The patch passed checkstyle in tez-yarn-timeline-history
+1 💚 checkstyle 0m 23s The patch passed checkstyle in tez-yarn-timeline-history-with-acls
+1 💚 checkstyle 0m 23s The patch passed checkstyle in tez-yarn-timeline-history-with-fs
-0 ⚠️ checkstyle 0m 25s /results-checkstyle-tez-plugins_tez-history-parser.txt tez-plugins/tez-history-parser: The patch generated 1 new + 186 unchanged - 1 fixed = 187 total (was 187)
+1 💚 checkstyle 0m 25s The patch passed checkstyle in tez-aux-services
+1 💚 checkstyle 0m 25s The patch passed checkstyle in job-analyzer
-0 ⚠️ checkstyle 1m 0s /results-checkstyle-root.txt root: The patch generated 1 new + 309 unchanged - 5 fixed = 310 total (was 314)
+1 💚 javadoc 6m 14s the patch passed
+1 💚 spotbugs 1m 44s tez-api generated 0 new + 544 unchanged - 1 fixed = 544 total (was 545)
+1 💚 spotbugs 2m 4s tez-dag in the patch passed.
+1 💚 spotbugs 1m 3s tez-tests in the patch passed.
+1 💚 spotbugs 1m 1s tez-ext-service-tests in the patch passed.
+1 💚 spotbugs 0m 59s tez-protobuf-history-plugin in the patch passed.
+1 💚 spotbugs 0m 57s tez-yarn-timeline-history in the patch passed.
+1 💚 spotbugs 0m 51s tez-yarn-timeline-history-with-acls in the patch passed.
+1 💚 spotbugs 0m 53s tez-yarn-timeline-history-with-fs in the patch passed.
+1 💚 spotbugs 0m 58s tez-history-parser in the patch passed.
+1 💚 spotbugs 0m 58s tez-aux-services in the patch passed.
+1 💚 spotbugs 1m 3s job-analyzer in the patch passed.
+1 💚 spotbugs 8m 6s root generated 0 new + 1934 unchanged - 1 fixed = 1934 total (was 1935)
_ Other Tests _
+1 💚 unit 2m 28s tez-api in the patch passed.
+1 💚 unit 5m 46s tez-dag in the patch passed.
+1 💚 unit 40m 59s tez-tests in the patch passed.
+1 💚 unit 4m 30s tez-ext-service-tests in the patch passed.
+1 💚 unit 0m 40s tez-protobuf-history-plugin in the patch passed.
+1 💚 unit 1m 49s tez-yarn-timeline-history in the patch passed.
+1 💚 unit 1m 57s tez-yarn-timeline-history-with-acls in the patch passed.
+1 💚 unit 1m 46s tez-yarn-timeline-history-with-fs in the patch passed.
+1 💚 unit 2m 34s tez-history-parser in the patch passed.
+1 💚 unit 3m 2s tez-aux-services in the patch passed.
+1 💚 unit 2m 54s job-analyzer in the patch passed.
+1 💚 unit 72m 35s root in the patch passed.
+1 💚 asflicense 5m 32s The patch does not generate ASF License warnings.
245m 48s
Subsystem Report/Notes
Docker ClientAPI=1.54 ServerAPI=1.54 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-474/7/artifact/out/Dockerfile
GITHUB PR #474
Optional Tests dupname asflicense javac javadoc unit codespell detsecrets xmllint compile spotbugs checkstyle
uname Linux 79a8c2db6e7b 5.15.0-173-generic #183-Ubuntu SMP Fri Mar 6 13:29:34 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-home/workspace/tez-multibranch_PR-474/src/.yetus/personality.sh
git revision master / 76a32cb
Default Java Ubuntu-21.0.10+7-Ubuntu-124.04
Test Results https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-474/7/testReport/
Max. process+thread count 1443 (vs. ulimit of 5500)
modules C: tez-api tez-dag tez-tests tez-ext-service-tests tez-plugins/tez-protobuf-history-plugin tez-plugins/tez-yarn-timeline-history tez-plugins/tez-yarn-timeline-history-with-acls tez-plugins/tez-yarn-timeline-history-with-fs tez-plugins/tez-history-parser tez-plugins/tez-aux-services tez-tools/analyzers/job-analyzer . U: .
Console output https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-474/7/console
versions git=2.43.0 maven=3.9.14 spotbugs=4.9.3 codespell=2.4.1
Powered by Apache Yetus 0.15.1 https://yetus.apache.org

This message was automatically generated.

@maheshrajus

Copy link
Copy Markdown
Contributor Author

@abstractdog @ayushtkn @Aggarwal-Raghav
Could you please review and approve the PR at your convenience?
Thank you !

@abstractdog abstractdog requested review from abstractdog and removed request for Aggarwal-Raghav May 18, 2026 06:53
@maheshrajus

Copy link
Copy Markdown
Contributor Author

@ayushtkn Could you please review and approve when you have a moment? Thank you !

@tez-yetus

Copy link
Copy Markdown

🎊 +1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 28s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+0 🆗 xmllint 0m 0s xmllint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 5 new or modified test files.
_ master Compile Tests _
+0 🆗 mvndep 0m 51s Maven dependency ordering for branch
+1 💚 mvninstall 4m 58s master passed
+1 💚 compile 4m 1s master passed
+1 💚 checkstyle 5m 34s master passed
+1 💚 javadoc 6m 5s master passed
+0 🆗 spotbugs 1m 25s tez-api in master has 92 extant spotbugs warnings.
+0 🆗 spotbugs 1m 39s tez-dag in master has 537 extant spotbugs warnings.
+0 🆗 spotbugs 0m 51s tez-tests in master has 6 extant spotbugs warnings.
+0 🆗 spotbugs 0m 48s tez-plugins/tez-protobuf-history-plugin in master has 7 extant spotbugs warnings.
+0 🆗 spotbugs 0m 43s tez-plugins/tez-yarn-timeline-history in master has 2 extant spotbugs warnings.
+0 🆗 spotbugs 0m 39s tez-plugins/tez-yarn-timeline-history-with-acls in master has 2 extant spotbugs warnings.
+0 🆗 spotbugs 0m 41s tez-plugins/tez-yarn-timeline-history-with-fs in master has 5 extant spotbugs warnings.
+0 🆗 spotbugs 0m 46s tez-plugins/tez-history-parser in master has 21 extant spotbugs warnings.
+0 🆗 spotbugs 0m 45s tez-plugins/tez-aux-services in master has 5 extant spotbugs warnings.
+0 🆗 spotbugs 6m 53s root in master has 1054 extant spotbugs warnings.
+0 🆗 spotbugs 0m 44s tez-tools/analyzers/job-analyzer in master has 20 extant spotbugs warnings.
_ Patch Compile Tests _
+0 🆗 mvndep 0m 23s Maven dependency ordering for patch
+1 💚 mvninstall 4m 8s the patch passed
+1 💚 codespell 1m 48s No new issues.
+1 💚 compile 4m 4s the patch passed
+1 💚 javac 4m 4s root generated 0 new + 738 unchanged - 4 fixed = 738 total (was 742)
+1 💚 blanks 0m 0s The patch has no blanks issues.
-0 ⚠️ checkstyle 0m 24s /results-checkstyle-tez-plugins_tez-history-parser.txt tez-plugins/tez-history-parser: The patch generated 1 new + 186 unchanged - 1 fixed = 187 total (was 187)
-0 ⚠️ checkstyle 1m 0s /results-checkstyle-root.txt root: The patch generated 1 new + 313 unchanged - 1 fixed = 314 total (was 314)
+1 💚 javadoc 6m 3s the patch passed
+1 💚 spotbugs 19m 21s the patch passed
_ Other Tests _
+1 💚 unit 71m 21s root in the patch passed.
+1 💚 asflicense 5m 35s The patch does not generate ASF License warnings.
163m 3s
Subsystem Report/Notes
Docker ClientAPI=1.54 ServerAPI=1.54 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-474/13/artifact/out/Dockerfile
Optional Tests dupname compile unit asflicense javac javadoc codespell detsecrets xmllint spotbugs checkstyle
uname Linux f2f7f53ddfa9 5.15.0-181-generic #191-Ubuntu SMP Fri May 22 19:09:02 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality tez-personality.sh
git revision master / cba5689
Default Java Eclipse Adoptium-21.0.11+10-LTS
Test Results https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-474/13/testReport/
Max. process+thread count 1468 (vs. ulimit of 5500)
modules C: tez-api tez-dag tez-tests tez-ext-service-tests tez-plugins/tez-protobuf-history-plugin tez-plugins/tez-yarn-timeline-history tez-plugins/tez-yarn-timeline-history-with-acls tez-plugins/tez-yarn-timeline-history-with-fs tez-plugins/tez-history-parser tez-plugins/tez-aux-services tez-tools/analyzers/job-analyzer . U: .
Console output https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-474/13/console
versions git=2.43.0 maven=3.9.15 spotbugs=4.9.3 codespell=2.4.1
Powered by Apache Yetus 0.15.1 https://yetus.apache.org

This message was automatically generated.

@maheshrajus

Copy link
Copy Markdown
Contributor Author

@abstractdog Look like the checkstyle task is catching incorrect one here. 'If' child has Indentation level 2. In this line i have not added any spaces except entityID string. Anything i am missing over here ?

./tez-plugins/tez-history-parser/src/main/java/org/apache/tez/history/parser/SimpleHistoryParser.java:258: userName = subEntity.getString(Constants.ENTITY_ID);:15: 'if' child has incorrect indentation level 14, expected level should be 16. [Indentation]

Code:

            if (subEntityType != null && subEntityType.equals(Constants.USER)) {
              userName = subEntity.getString(Constants.ENTITY_ID);
              break;
            }

Link: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-474/13/artifact/out/results-checkstyle-root.txt

@abstractdog

Copy link
Copy Markdown
Contributor

@abstractdog Look like the checkstyle task is catching incorrect one here. 'If' child has Indentation level 2. In this line i have not added any spaces except entityID string. Anything i am missing over here ?

./tez-plugins/tez-history-parser/src/main/java/org/apache/tez/history/parser/SimpleHistoryParser.java:258: userName = subEntity.getString(Constants.ENTITY_ID);:15: 'if' child has incorrect indentation level 14, expected level should be 16. [Indentation]

Code:

            if (subEntityType != null && subEntityType.equals(Constants.USER)) {
              userName = subEntity.getString(Constants.ENTITY_ID);
              break;
            }

Link: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-474/13/artifact/out/results-checkstyle-root.txt

we can ignore that checkstyle warning then, for me it's clearly a bug in checkstyle
we use 2 spaces, and it applies to branches of if/else too

@maheshrajus

Copy link
Copy Markdown
Contributor Author

we can ignore that checkstyle warning then, for me it's clearly a bug in checkstyle
we use 2 spaces, and it applies to branches of if/else too

@abstractdog Thank you for confirming the Checkstyle-related.
Could you please take a look and approve the PR when you have a moment? Thank you!

@abstractdog abstractdog left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@Aggarwal-Raghav

Copy link
Copy Markdown
Contributor

@abstractdog , please wait for some time before merging, I'm checking few things. Give me 1 hr.

@abstractdog

Copy link
Copy Markdown
Contributor

@abstractdog , please wait for some time before merging, I'm checking few things. Give me 1 hr.

absolutely! I'm not about to merge this immediately
thanks if you take another look at this

@Aggarwal-Raghav

Copy link
Copy Markdown
Contributor

I might be wrong, I was performing cluster testing of this change, and saw this error. In Hadoop jersery migration they have moved from javax.servlet-api -> jakarta.servlet-api, In tez we have direct dependency on javax.servlet-api.
Just checking if it valid or specific to my setup

Caused by: [CIRCULAR REFERENCE: java.lang.NoSuchMethodError: 'javax.servlet.Filter javax.servlet.ServletContext.createFilter(java.lang.Class)']
2026-06-10 18:24:47,042 [ERROR] [ServiceThread:org.apache.tez.dag.app.web.WebUIService] |web.WebUIService|: Tez UI WebService failed to start.
org.apache.hadoop.yarn.webapp.WebAppException: Error starting http server
	at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:504)
	at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:484)
	at org.apache.tez.dag.app.web.WebUIService.serviceStart(WebUIService.java:115)
	at org.apache.hadoop.service.AbstractService.start(AbstractService.java:195)
	at org.apache.tez.dag.app.DAGAppMaster$ServiceWithDependency.start(DAGAppMaster.java:1857)
	at org.apache.tez.dag.app.DAGAppMaster$ServiceThread.run(DAGAppMaster.java:1878)
Caused by: java.io.IOException: Problem starting http server
	at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:1489)
	at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:501)
	... 5 more

Attaching complete log.
logs.txt

Comment thread tez-api/src/main/java/org/apache/tez/common/ATSConstants.java
@Aggarwal-Raghav

Copy link
Copy Markdown
Contributor

I might be wrong, I was performing cluster testing of this change, and saw this error. In Hadoop jersery migration they have moved from javax.servlet-api -> jakarta.servlet-api, In tez we have direct dependency on javax.servlet-api. Just checking if it valid or specific to my setup

Caused by: [CIRCULAR REFERENCE: java.lang.NoSuchMethodError: 'javax.servlet.Filter javax.servlet.ServletContext.createFilter(java.lang.Class)']
2026-06-10 18:24:47,042 [ERROR] [ServiceThread:org.apache.tez.dag.app.web.WebUIService] |web.WebUIService|: Tez UI WebService failed to start.
org.apache.hadoop.yarn.webapp.WebAppException: Error starting http server
	at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:504)
	at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:484)
	at org.apache.tez.dag.app.web.WebUIService.serviceStart(WebUIService.java:115)
	at org.apache.hadoop.service.AbstractService.start(AbstractService.java:195)
	at org.apache.tez.dag.app.DAGAppMaster$ServiceWithDependency.start(DAGAppMaster.java:1857)
	at org.apache.tez.dag.app.DAGAppMaster$ServiceThread.run(DAGAppMaster.java:1878)
Caused by: java.io.IOException: Problem starting http server
	at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:1489)
	at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:501)
	... 5 more

Attaching complete log. logs.txt

@maheshrajus , did you face this in your env?

@maheshrajus

Copy link
Copy Markdown
Contributor Author

I might be wrong, I was performing cluster testing of this change, and saw this error. In Hadoop jersery migration they have moved from javax.servlet-api -> jakarta.servlet-api, In tez we have direct dependency on javax.servlet-api. Just checking if it valid or specific to my setup

Caused by: [CIRCULAR REFERENCE: java.lang.NoSuchMethodError: 'javax.servlet.Filter javax.servlet.ServletContext.createFilter(java.lang.Class)']
2026-06-10 18:24:47,042 [ERROR] [ServiceThread:org.apache.tez.dag.app.web.WebUIService] |web.WebUIService|: Tez UI WebService failed to start.
org.apache.hadoop.yarn.webapp.WebAppException: Error starting http server
	at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:504)
	at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:484)
	at org.apache.tez.dag.app.web.WebUIService.serviceStart(WebUIService.java:115)
	at org.apache.hadoop.service.AbstractService.start(AbstractService.java:195)
	at org.apache.tez.dag.app.DAGAppMaster$ServiceWithDependency.start(DAGAppMaster.java:1857)
	at org.apache.tez.dag.app.DAGAppMaster$ServiceThread.run(DAGAppMaster.java:1878)
Caused by: java.io.IOException: Problem starting http server
	at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:1489)
	at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:501)
	... 5 more

Attaching complete log. logs.txt

@Aggarwal-Raghav Could you please try executing the same steps with my latest changes and confirm? I have fixed the Tez UI-related ATS fields according to the new behavior in Hadoop 3.5.0. With these changes, I am able to submit a DAG and view its status in the Tez UI. I have attached the screenshots above for reference. Thank you !
cc: @abstractdog

@maheshrajus

maheshrajus commented Jun 11, 2026

Copy link
Copy Markdown
Contributor Author

@maheshrajus , did you face this in your env?

@Aggarwal-Raghav i got the below NoSuchMethodError(BufferRecycler.releaseToPool()) exception while testing tez-ui. Similar stack trace i found in attached logs.txt by you. With Latest code changes i cant find any exceptions and able to see the DAG status in tez UI. You also please verify once and confirm. Thank you !

BufferRecycler.releaseToPool() this method available only in jackson-core 2.18.x. We can find the fix changes in my latest pushed commit.

Stack trace:


Caused by: java.lang.NoSuchMethodError: 'void com.fasterxml.jackson.core.util.BufferRecycler.releaseToPool()'
	at com.fasterxml.jackson.databind.ObjectMapper.writeValueAsString(ObjectMapper.java:4075)
	at org.apache.hadoop.yarn.api.records.timeline.writer.TimelineDomainWriter.writeTo(TimelineDomainWriter.java:56)
	at org.apache.hadoop.yarn.api.records.timeline.writer.TimelineDomainWriter.writeTo(TimelineDomainWriter.java:40)
	at org.glassfish.jersey.message.internal.WriterInterceptorExecutor$TerminalWriterInterceptor.invokeWriteTo(WriterInterceptorExecutor.java:242)
	at org.glassfish.jersey.message.internal.WriterInterceptorExecutor$TerminalWriterInterceptor.aroundWriteTo(WriterInterceptorExecutor.java:227)
	at org.glassfish.jersey.message.internal.WriterInterceptorExecutor.proceed(WriterInterceptorExecutor.java:139)
	at org.glassfish.jersey.message.internal.MessageBodyFactory.writeTo(MessageBodyFactory.java:1116)
	at org.glassfish.jersey.client.ClientRequest.doWriteEntity(ClientRequest.java:468)
	at org.glassfish.jersey.client.ClientRequest.writeEntity(ClientRequest.java:450)
	at org.glassfish.jersey.client.internal.HttpUrlConnector._apply(HttpUrlConnector.java:444)
	at org.glassfish.jersey.client.internal.HttpUrlConnector.apply(HttpUrlConnector.java:286)
	at org.glassfish.jersey.client.ClientRuntime.invoke(ClientRuntime.java:300)

@maheshrajus

Copy link
Copy Markdown
Contributor Author

The DAG has been submitted and the status is visible in the Tez UI with the latest fixes.

@Aggarwal-Raghav Please review and confirm the changes so @abstractdog can merge them at his convenience. Thanks!

Screenshot 2026-06-11 at 12 42 27 PM Screenshot 2026-06-11 at 12 45 48 PM

@Aggarwal-Raghav

Copy link
Copy Markdown
Contributor

@maheshrajus , there are 2 things here.

  1. javax error, i think its valid as hadoop https://github.com/apache/hadoop/blame/9b71e5f0c0db40e498b6eb4a11f7fe531cadcc9a/hadoop-project/pom.xml#L954 updated this for jersey 2.x change and I think this patch will help: javax.patch logs from my run: logs.txt

  2. jackson issue, and the patch for it: jackson.patch logs: logs2_jackson.txt

The patch attached is how I would've handled it. Your jackson change is indeed required which was part of my future pr in hadoop-3.5.0, so I'm ok with that but exclusion from pig is required which is bringing jackson 1.8.8. This might also infer Pig might break but I think it should be ok as its legacy project: https://github.com/apache/tez/pull/490/changes#diff-9c5fb3d1b7e3b0f54bc5c4182965c4fe1f9023d449017cece3005d3f90e8e4d8R278
CC @abstractdog

I got both the issue in my run and post that attaching the clean logs as well clean_log.txt. I have verbose:class in the tez-opts to see from which jar the class is getting loaded. For javax it was servlet-2.x and jackson 2.14.3 coming from avro which is transitive in hadoop-common dependency as you mentioned in comments. Even after exclusion of avro from hadoop-common the avro jar is part of tarball which is good as we are not shipping less jars.

@Aggarwal-Raghav

Copy link
Copy Markdown
Contributor

If the patches I've attached is something you are not ok with as you have not seen them in your environement that is totally understandable. I'm happy to raise a separate PR by myself if more discussion/questions is required there.

@Aggarwal-Raghav

Copy link
Copy Markdown
Contributor

If the patches I've attached is something you are not ok with as you have not seen them in your environement that is totally understandable. I'm happy to raise a separate PR by myself if more discussion/questions is required there.

Other Changes LGTM

@tez-yetus

Copy link
Copy Markdown

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 30s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 detsecrets 0m 1s detect-secrets was not available.
+0 🆗 xmllint 0m 1s xmllint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 8 new or modified test files.
_ master Compile Tests _
+0 🆗 mvndep 0m 41s Maven dependency ordering for branch
+1 💚 mvninstall 4m 47s master passed
+1 💚 compile 3m 54s master passed
+1 💚 checkstyle 6m 3s master passed
+1 💚 javadoc 6m 32s master passed
+0 🆗 spotbugs 1m 23s tez-api in master has 92 extant spotbugs warnings.
+0 🆗 spotbugs 1m 39s tez-dag in master has 537 extant spotbugs warnings.
+0 🆗 spotbugs 0m 49s tez-tests in master has 6 extant spotbugs warnings.
+0 🆗 spotbugs 0m 49s branch/tez-ui no spotbugs output file (spotbugsXml.xml)
+0 🆗 spotbugs 0m 46s tez-plugins/tez-protobuf-history-plugin in master has 7 extant spotbugs warnings.
+0 🆗 spotbugs 0m 45s tez-plugins/tez-yarn-timeline-history in master has 2 extant spotbugs warnings.
+0 🆗 spotbugs 0m 38s tez-plugins/tez-yarn-timeline-history-with-acls in master has 2 extant spotbugs warnings.
+0 🆗 spotbugs 0m 41s tez-plugins/tez-yarn-timeline-history-with-fs in master has 5 extant spotbugs warnings.
+0 🆗 spotbugs 0m 46s tez-plugins/tez-history-parser in master has 21 extant spotbugs warnings.
+0 🆗 spotbugs 0m 45s tez-plugins/tez-aux-services in master has 5 extant spotbugs warnings.
+0 🆗 spotbugs 6m 49s root in master has 1054 extant spotbugs warnings.
+0 🆗 spotbugs 0m 44s tez-tools/analyzers/job-analyzer in master has 20 extant spotbugs warnings.
_ Patch Compile Tests _
+0 🆗 mvndep 0m 22s Maven dependency ordering for patch
+1 💚 mvninstall 4m 7s the patch passed
+1 💚 codespell 1m 45s No new issues.
+1 💚 jshint 123m 41s No new issues.
+1 💚 compile 3m 57s the patch passed
+1 💚 javac 3m 57s root generated 0 new + 738 unchanged - 4 fixed = 738 total (was 742)
-1 ❌ blanks 0m 0s /blanks-tabs.txt The patch 1 line(s) with tabs.
-0 ⚠️ checkstyle 0m 25s /results-checkstyle-tez-plugins_tez-history-parser.txt tez-plugins/tez-history-parser: The patch generated 1 new + 186 unchanged - 1 fixed = 187 total (was 187)
-0 ⚠️ checkstyle 1m 0s /results-checkstyle-root.txt root: The patch generated 1 new + 313 unchanged - 1 fixed = 314 total (was 314)
+1 💚 javadoc 6m 39s the patch passed
+0 🆗 spotbugs 0m 51s tez-ui has no data from spotbugs
_ Other Tests _
-1 ❌ unit 72m 8s /patch-unit-root.txt root in the patch failed.
+1 💚 asflicense 5m 52s The patch does not generate ASF License warnings.
290m 31s
Reason Tests
Failed junit tests tez.history.TestHistoryParser
Subsystem Report/Notes
Docker ClientAPI=1.54 ServerAPI=1.54 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-474/14/artifact/out/Dockerfile
Optional Tests dupname compile unit asflicense javac javadoc codespell detsecrets xmllint spotbugs checkstyle jshint
uname Linux 8b9e3069c68e 5.15.0-181-generic #191-Ubuntu SMP Fri May 22 19:09:02 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality tez-personality.sh
git revision master / cba5689
Default Java Eclipse Adoptium-21.0.11+10-LTS
Test Results https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-474/14/testReport/
Max. process+thread count 1473 (vs. ulimit of 5500)
modules C: tez-api tez-dag tez-tests tez-ext-service-tests tez-ui tez-plugins/tez-protobuf-history-plugin tez-plugins/tez-yarn-timeline-history tez-plugins/tez-yarn-timeline-history-with-acls tez-plugins/tez-yarn-timeline-history-with-fs tez-plugins/tez-history-parser tez-plugins/tez-aux-services tez-tools/analyzers/job-analyzer . U: .
Console output https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-474/14/console
versions git=2.43.0 maven=3.9.15 spotbugs=4.9.3 codespell=2.4.1 jshint=2.13.6
Powered by Apache Yetus 0.15.1 https://yetus.apache.org

This message was automatically generated.

@maheshrajus

Copy link
Copy Markdown
Contributor Author

@maheshrajus , there are 2 things here.

  1. javax error, i think its valid as hadoop https://github.com/apache/hadoop/blame/9b71e5f0c0db40e498b6eb4a11f7fe531cadcc9a/hadoop-project/pom.xml#L954 updated this for jersey 2.x change and I think this patch will help: javax.patch logs from my run: logs.txt
  2. jackson issue, and the patch for it: jackson.patch logs: logs2_jackson.txt

@Aggarwal-Raghav Did you run the steps above using the latest commit I pushed this afternoon? Are both of those issues still occurring with the latest changes? If they are, and if it's a Jersey 2.x issue, let's just include the fix in the current PR.

@Aggarwal-Raghav

Copy link
Copy Markdown
Contributor

@maheshrajus , there are 2 things here.

  1. javax error, i think its valid as hadoop https://github.com/apache/hadoop/blame/9b71e5f0c0db40e498b6eb4a11f7fe531cadcc9a/hadoop-project/pom.xml#L954 updated this for jersey 2.x change and I think this patch will help: javax.patch logs from my run: logs.txt
  2. jackson issue, and the patch for it: jackson.patch logs: logs2_jackson.txt

@Aggarwal-Raghav Did you run the steps above using the latest commit I pushed this afternoon? Are both of those issues still occurring with the latest changes? If they are, and if it's a Jersey 2.x issue, let's just include the fix in the current PR.

yes, I'm still seeing

2026-06-11 22:14:14,409 [INFO] [ServiceThread:org.apache.tez.dag.app.web.WebUIService] |http.HttpServer2|: HttpServer.start() threw a MultiException
MultiException[java.lang.NoSuchMethodError: 'javax.servlet.Filter javax.servlet.ServletContext.createFilter(java.lang.Class)', java.lang.NoSuchMethodError: 'javax.servlet.Filter javax.servlet.ServletContext.createFilter(java.lang.Class)']
	at org.eclipse.jetty.util.MultiException.ifExceptionThrow(MultiException.java:122)
	at org.eclipse.jetty.server.Server.doStart(Server.java:413)
	at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
	at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:1443)
	at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:501)
	at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:484)
	at org.apache.tez.dag.app.web.WebUIService.serviceStart(WebUIService.java:115)
	at org.apache.hadoop.service.AbstractService.start(AbstractService.java:195)
	at org.apache.tez.dag.app.DAGAppMaster$ServiceWithDependency.start(DAGAppMaster.java:1857)
	at org.apache.tez.dag.app.DAGAppMaster$ServiceThread.run(DAGAppMaster.java:1878)
	Suppressed: java.lang.NoSuchMethodError: 'javax.servlet.Filter javax.servlet.ServletContext.createFilter(java.lang.Class)'
		at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:123)
		at org.eclipse.jetty.servlet.ServletHandler.lambda$initialize$0(ServletHandler.java:750)
		at java.base/java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:1024)
		at java.base/java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:734)
		at java.base/java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:762)
		at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:774)
		at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:379)
		at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:916)
		at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:288)
		at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
		at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169)
		at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:117)
		at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:97)
		at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
		at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169)
		at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:117)
		at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:97)
		at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
		at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169)
		at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:110)
		at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:97)
		at org.eclipse.jetty.server.handler.StatisticsHandler.doStart(StatisticsHandler.java:264)
		at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
		at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169)
		at org.eclipse.jetty.server.Server.start(Server.java:423)
		at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:110)
		at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:97)
		at org.eclipse.jetty.server.Server.doStart(Server.java:387)
		... 8 more
	Suppressed: java.lang.NoSuchMethodError: 'javax.servlet.Filter javax.servlet.ServletContext.createFilter(java.lang.Class)'

@tez-yetus

Copy link
Copy Markdown

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 30s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+0 🆗 xmllint 0m 0s xmllint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 8 new or modified test files.
_ master Compile Tests _
+0 🆗 mvndep 0m 43s Maven dependency ordering for branch
+1 💚 mvninstall 4m 47s master passed
+1 💚 compile 3m 55s master passed
+1 💚 checkstyle 6m 1s master passed
+1 💚 javadoc 6m 37s master passed
+0 🆗 spotbugs 1m 22s tez-api in master has 92 extant spotbugs warnings.
+0 🆗 spotbugs 1m 42s tez-dag in master has 537 extant spotbugs warnings.
+0 🆗 spotbugs 0m 48s tez-tests in master has 6 extant spotbugs warnings.
+0 🆗 spotbugs 0m 50s branch/tez-ui no spotbugs output file (spotbugsXml.xml)
+0 🆗 spotbugs 0m 47s tez-plugins/tez-protobuf-history-plugin in master has 7 extant spotbugs warnings.
+0 🆗 spotbugs 0m 44s tez-plugins/tez-yarn-timeline-history in master has 2 extant spotbugs warnings.
+0 🆗 spotbugs 0m 39s tez-plugins/tez-yarn-timeline-history-with-acls in master has 2 extant spotbugs warnings.
+0 🆗 spotbugs 0m 42s tez-plugins/tez-yarn-timeline-history-with-fs in master has 5 extant spotbugs warnings.
+0 🆗 spotbugs 0m 46s tez-plugins/tez-history-parser in master has 21 extant spotbugs warnings.
+0 🆗 spotbugs 0m 45s tez-plugins/tez-aux-services in master has 5 extant spotbugs warnings.
+0 🆗 spotbugs 6m 50s root in master has 1054 extant spotbugs warnings.
+0 🆗 spotbugs 0m 43s tez-tools/analyzers/job-analyzer in master has 20 extant spotbugs warnings.
_ Patch Compile Tests _
+0 🆗 mvndep 0m 23s Maven dependency ordering for patch
+1 💚 mvninstall 4m 4s the patch passed
+1 💚 codespell 1m 46s No new issues.
+1 💚 jshint 123m 21s No new issues.
+1 💚 compile 3m 58s the patch passed
+1 💚 javac 3m 58s root generated 0 new + 738 unchanged - 4 fixed = 738 total (was 742)
+1 💚 blanks 0m 0s The patch has no blanks issues.
-0 ⚠️ checkstyle 0m 25s /results-checkstyle-tez-plugins_tez-history-parser.txt tez-plugins/tez-history-parser: The patch generated 1 new + 186 unchanged - 1 fixed = 187 total (was 187)
-0 ⚠️ checkstyle 0m 59s /results-checkstyle-root.txt root: The patch generated 1 new + 313 unchanged - 1 fixed = 314 total (was 314)
+1 💚 javadoc 6m 32s the patch passed
+0 🆗 spotbugs 0m 49s tez-ui has no data from spotbugs
_ Other Tests _
-1 ❌ unit 71m 21s /patch-unit-root.txt root in the patch failed.
+1 💚 asflicense 5m 55s The patch does not generate ASF License warnings.
289m 16s
Subsystem Report/Notes
Docker ClientAPI=1.54 ServerAPI=1.54 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-474/15/artifact/out/Dockerfile
Optional Tests dupname compile unit asflicense javac javadoc codespell detsecrets xmllint spotbugs checkstyle jshint
uname Linux 18fc0cdd5eb6 5.15.0-181-generic #191-Ubuntu SMP Fri May 22 19:09:02 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality tez-personality.sh
git revision master / cba5689
Default Java Eclipse Adoptium-21.0.11+10-LTS
Test Results https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-474/15/testReport/
Max. process+thread count 1377 (vs. ulimit of 5500)
modules C: tez-api tez-dag tez-tests tez-ext-service-tests tez-ui tez-plugins/tez-protobuf-history-plugin tez-plugins/tez-yarn-timeline-history tez-plugins/tez-yarn-timeline-history-with-acls tez-plugins/tez-yarn-timeline-history-with-fs tez-plugins/tez-history-parser tez-plugins/tez-aux-services tez-tools/analyzers/job-analyzer . U: .
Console output https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-474/15/console
versions git=2.43.0 maven=3.9.15 spotbugs=4.9.3 codespell=2.4.1 jshint=2.13.6
Powered by Apache Yetus 0.15.1 https://yetus.apache.org

This message was automatically generated.

@maheshrajus

Copy link
Copy Markdown
Contributor Author

yes, I'm still seeing

@Aggarwal-Raghav Let me check and push the fixes. Thank you for the verification !

@maheshrajus

Copy link
Copy Markdown
Contributor Author

@Aggarwal-Raghav
I have fixed the Tez UI tests and applied the patches which you provided for the javax.servlet and Jackson exceptions. I also verified the DAG submission and checked its status in the Tez UI with the latest changes.
Could you please review the code changes related to javax.servlet and Jackson? Thank you for your support!
cc: @abstractdog

@tez-yetus

Copy link
Copy Markdown

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 8m 44s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 detsecrets 0m 1s detect-secrets was not available.
+0 🆗 xmllint 0m 1s xmllint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 11 new or modified test files.
_ master Compile Tests _
+0 🆗 mvndep 0m 43s Maven dependency ordering for branch
+1 💚 mvninstall 5m 6s master passed
+1 💚 compile 3m 56s master passed
+1 💚 checkstyle 6m 8s master passed
+1 💚 javadoc 6m 32s master passed
+0 🆗 spotbugs 1m 22s tez-api in master has 92 extant spotbugs warnings.
+0 🆗 spotbugs 1m 41s tez-dag in master has 537 extant spotbugs warnings.
+0 🆗 spotbugs 0m 49s tez-tests in master has 6 extant spotbugs warnings.
+0 🆗 spotbugs 0m 49s branch/tez-ui no spotbugs output file (spotbugsXml.xml)
+0 🆗 spotbugs 0m 48s tez-plugins/tez-protobuf-history-plugin in master has 7 extant spotbugs warnings.
+0 🆗 spotbugs 0m 44s tez-plugins/tez-yarn-timeline-history in master has 2 extant spotbugs warnings.
+0 🆗 spotbugs 0m 40s tez-plugins/tez-yarn-timeline-history-with-acls in master has 2 extant spotbugs warnings.
+0 🆗 spotbugs 0m 40s tez-plugins/tez-yarn-timeline-history-with-fs in master has 5 extant spotbugs warnings.
+0 🆗 spotbugs 0m 45s tez-plugins/tez-history-parser in master has 21 extant spotbugs warnings.
+0 🆗 spotbugs 0m 45s tez-plugins/tez-aux-services in master has 5 extant spotbugs warnings.
+0 🆗 spotbugs 6m 49s root in master has 1054 extant spotbugs warnings.
+0 🆗 spotbugs 0m 44s tez-tools/analyzers/job-analyzer in master has 20 extant spotbugs warnings.
_ Patch Compile Tests _
+0 🆗 mvndep 0m 24s Maven dependency ordering for patch
+1 💚 mvninstall 4m 8s the patch passed
+1 💚 codespell 1m 44s No new issues.
+1 💚 jshint 123m 12s No new issues.
+1 💚 compile 3m 56s the patch passed
+1 💚 javac 3m 56s root generated 0 new + 737 unchanged - 5 fixed = 737 total (was 742)
+1 💚 blanks 0m 0s The patch has no blanks issues.
-0 ⚠️ checkstyle 0m 26s /results-checkstyle-tez-plugins_tez-history-parser.txt tez-plugins/tez-history-parser: The patch generated 1 new + 186 unchanged - 1 fixed = 187 total (was 187)
-0 ⚠️ checkstyle 0m 59s /results-checkstyle-root.txt root: The patch generated 1 new + 313 unchanged - 1 fixed = 314 total (was 314)
+1 💚 javadoc 6m 39s the patch passed
+0 🆗 spotbugs 0m 49s tez-ui has no data from spotbugs
_ Other Tests _
-1 ❌ unit 71m 56s /patch-unit-root.txt root in the patch passed.
+1 💚 asflicense 6m 8s The patch does not generate ASF License warnings.
298m 54s
Reason Tests
Failed junit tests tez.runtime.library.common.writers.TestUnorderedPartitionedKVWriter
tez.runtime.library.output.TestOrderedPartitionedKVOutput2
tez.runtime.library.common.shuffle.orderedgrouped.TestMergeManager
tez.runtime.library.common.sort.impl.TestIFile
tez.runtime.library.common.TestValuesIterator
tez.runtime.library.output.TestUnorderedKVOutput2
tez.runtime.library.common.shuffle.orderedgrouped.TestShuffle
tez.runtime.library.common.readers.TestUnorderedKVReader
tez.runtime.library.common.sort.impl.TestPipelinedSorter
tez.runtime.library.common.sort.impl.dflt.TestDefaultSorter
tez.runtime.library.output.TestOnFileSortedOutput
tez.runtime.library.output.TestOnFileUnorderedKVOutput
tez.dag.history.logging.proto.TestProtoHistoryLoggingService
tez.dag.history.logging.proto.TestDagManifestFileScanner
Subsystem Report/Notes
Docker ClientAPI=1.54 ServerAPI=1.54 base: https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-474/16/artifact/out/Dockerfile
Optional Tests dupname compile unit asflicense javac javadoc codespell detsecrets xmllint spotbugs checkstyle jshint
uname Linux 22058dea1c4d 5.15.0-174-generic #184-Ubuntu SMP Fri Mar 13 18:41:50 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality tez-personality.sh
git revision master / cba5689
Default Java Eclipse Adoptium-21.0.11+10-LTS
Test Results https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-474/16/testReport/
Max. process+thread count 1397 (vs. ulimit of 5500)
modules C: tez-api tez-dag tez-tests tez-ext-service-tests tez-ui tez-plugins/tez-protobuf-history-plugin tez-plugins/tez-yarn-timeline-history tez-plugins/tez-yarn-timeline-history-with-acls tez-plugins/tez-yarn-timeline-history-with-fs tez-plugins/tez-history-parser tez-plugins/tez-aux-services tez-tools/analyzers/job-analyzer . U: .
Console output https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-474/16/console
versions git=2.43.0 maven=3.9.15 spotbugs=4.9.3 codespell=2.4.1 jshint=2.13.6
Powered by Apache Yetus 0.15.1 https://yetus.apache.org

This message was automatically generated.

Comment thread pom.xml
<artifactId>snappy-java</artifactId>
</exclusion>
<exclusion>
<groupId>org.apache.avro</groupId>

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@maheshrajus , please revert this avro exclusion. UT's are working after that. As we have jackson-bom defined now, we don't need this. All jackson jar have 2.18.6 now

jackson-annotations-2.18.6.jar
jackson-core-2.18.6.jar
jackson-databind-2.18.6.jar
jackson-jaxrs-base-2.18.6.jar
jackson-jaxrs-json-provider-2.18.6.jar
jackson-module-jaxb-annotations-2.18.6.jar

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants