[Bug] ClassNotFound org.apache.hadoop.shaded.javax.ws.rs.core.NoContentException

[waywtdcc]

Code of Conduct

• I agree to follow this project's Code of Conduct

Search before asking

• I have searched in the issues and found no similar issues.

Describe the bug

package:
./build/dist --tgz --spark-provided --flink-provided --mvn /opt/apps/soft/apache-maven-3.8.3/bin/mvn -Dflink.version=1.14.4

Affects Version(s)

1.6.0

Kyuubi Server Log Output

2022-06-17 16:13:05.998 INFO org.apache.kyuubi.util.ThreadUtils: KyuubiSessionManager-exec-pool: pool size: 100, wait queue size: 100, thread keepalive time: 60000 ms
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/shaded/javax/ws/rs/core/NoContentException
        at org.apache.hadoop.yarn.util.timeline.TimelineUtils.<clinit>(TimelineUtils.java:60)
        at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.serviceInit(YarnClientImpl.java:200)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
        at org.apache.kyuubi.engine.YarnApplicationOperation.initialize(YarnApplicationOperation.scala:37)
        at org.apache.kyuubi.engine.KyuubiApplicationManager.$anonfun$initialize$1(KyuubiApplicationManager.scala:41)
        at org.apache.kyuubi.engine.KyuubiApplicationManager.$anonfun$initialize$1$adapted(KyuubiApplicationManager.scala:39)
        at scala.collection.immutable.Stream.foreach(Stream.scala:533)
        at org.apache.kyuubi.engine.KyuubiApplicationManager.initialize(KyuubiApplicationManager.scala:39)
        at org.apache.kyuubi.service.CompositeService.$anonfun$initialize$1(CompositeService.scala:40)
        at org.apache.kyuubi.service.CompositeService.$anonfun$initialize$1$adapted(CompositeService.scala:40)
        at scala.collection.mutable.ResizableArray.foreach(ResizableArray.scala:62)
        at scala.collection.mutable.ResizableArray.foreach$(ResizableArray.scala:55)
        at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:49)
        at org.apache.kyuubi.service.CompositeService.initialize(CompositeService.scala:40)
        at org.apache.kyuubi.session.SessionManager.initialize(SessionManager.scala:268)
        at org.apache.kyuubi.session.KyuubiSessionManager.initialize(KyuubiSessionManager.scala:57)
        at org.apache.kyuubi.service.CompositeService.$anonfun$initialize$1(CompositeService.scala:40)
        at org.apache.kyuubi.service.CompositeService.$anonfun$initialize$1$adapted(CompositeService.scala:40)
        at scala.collection.mutable.ResizableArray.foreach(ResizableArray.scala:62)
        at scala.collection.mutable.ResizableArray.foreach$(ResizableArray.scala:55)
        at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:49)
        at org.apache.kyuubi.service.CompositeService.initialize(CompositeService.scala:40)
        at org.apache.kyuubi.service.AbstractBackendService.initialize(AbstractBackendService.scala:209)
        at org.apache.kyuubi.service.CompositeService.$anonfun$initialize$1(CompositeService.scala:40)
        at org.apache.kyuubi.service.CompositeService.$anonfun$initialize$1$adapted(CompositeService.scala:40)
        at scala.collection.mutable.ResizableArray.foreach(ResizableArray.scala:62)
        at scala.collection.mutable.ResizableArray.foreach$(ResizableArray.scala:55)
        at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:49)
        at org.apache.kyuubi.service.CompositeService.initialize(CompositeService.scala:40)
        at org.apache.kyuubi.service.Serverable.initialize(Serverable.scala:46)
        at org.apache.kyuubi.server.KyuubiServer.initialize(KyuubiServer.scala:140)
        at org.apache.kyuubi.server.KyuubiServer$.startServer(KyuubiServer.scala:60)
        at org.apache.kyuubi.server.KyuubiServer$.main(KyuubiServer.scala:97)
        at org.apache.kyuubi.server.KyuubiServer.main(KyuubiServer.scala)
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.shaded.javax.ws.rs.core.NoContentException
        at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)

Kyuubi Engine Log Output

No response

Kyuubi Server Configurations

No response

Kyuubi Engine Configurations

No response

Additional context

No response

Are you willing to submit PR?

• Yes I am willing to submit a PR!

[pan3793]

May caused by HADOOP-18033, you can replace the Hadoop 3.3.2 jars w/ 3.3.1

[yaooqinn]

yarn.timeline-service.enabled is set to true?

[pan3793]

I raise the priority to blocker, we may need to revert #2003 if Hadoop 3.3.4 is not available before Kyuubi 1.6.0 release because of HADOOP-18033