linkis icon indicating copy to clipboard operation
linkis copied to clipboard
verified publisher icon apache

Flink添加flink-connector-mysql-cdc-1.1.1.jar存在冲突/org/eclipse/jetty/util/compression/DeflaterPool.class[Bug]

Open Yiutto opened this issue 3 years ago • 2 comments

Search before asking

  • [X] I searched the issues and found no similar issues.

Linkis Component

linkis-commons

Steps to reproduce

往lib/linkis-engineconn-plugins/flink/dist/v1.12.2/lib 添加 flink-connector-mysql-cdc-1.1.1.jar， 重启linkis报包冲突

2022-12-29 11:41:07.041 ERROR Job with execId-IDE_bigdata_flink_0 + subJobId : 1284 execute failed,21304, Task is Failed,errorMsg: errCode: 12003 ,desc: dn19:9101_0 Failed to async get EngineNode AMErrorException: errCode: 30002 ,desc: ServiceInstance(linkis-cg-engineconn, dn24:27354) ticketID:268ec415-ff29-400f-9692-2418b3b1af6b 初始化引擎失败,原因: Failed to start EngineConn, reason: ECMErrorException: errCode: 11102 ,desc: OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=250m; support was removed in 8.0 OpenJDK 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0 11:41:04.280 ERROR org.springframework.boot.diagnostics.LoggingFailureAnalysisReporter 40 report -

APPLICATION FAILED TO START

Description: An attempt was made to call a method that does not exist. The attempt was made from the following location: org.eclipse.jetty.websocket.server.WebSocketServerFactory.(WebSocketServerFactory.java:184) The following method did not exist: org.eclipse.jetty.util.compression.DeflaterPool.ensurePool(Lorg/eclipse/jetty/util/component/Container;)Lorg/eclipse/jetty/util/compression/DeflaterPool; The method's class, org.eclipse.jetty.util.compression.DeflaterPool, is available from the following locations: jar:file:/home/webank/LinkisInstall/tmp/engineConnPublickDir/6b59d7fe-a525-4e66-9504-d493eb79e13f/v000005/lib/flink-connector-mysql-cdc-1.1.1.jar!/org/eclipse/jetty/util/compression/DeflaterPool.class jar:file:/home/webank/LinkisInstall/lib/linkis-commons/public-module/jetty-util-9.4.48.v20220622.jar!/org/eclipse/jetty/util/compression/DeflaterPool.class The class hierarchy was loaded from the following locations: org.eclipse.jetty.util.compression.DeflaterPool: file:/home/webank/LinkisInstall/tmp/engineConnPublickDir/6b59d7fe-a525-4e66-9504-d493eb79e13f/v000005/lib/flink-connector-mysql-cdc-1.1.1.jar org.eclipse.jetty.util.compression.CompressionPool: file:/home/webank/LinkisInstall/tmp/engineConnPublickDir/6b59d7fe-a525-4e66-9504-d493eb79e13f/v000005/lib/flink-connector-mysql-cdc-1.1.1.jar org.eclipse.jetty.util.component.AbstractLifeCycle: file:/home/webank/LinkisInstall/tmp/engineConnPublickDir/6b59d7fe-a525-4e66-9504-d493eb79e13f/v000005/lib/flink-connector-mysql-cdc-1.1.1.jar Action: Correct the classpath of your application so that it contains a single, compatible version of org.eclipse.jetty.util.compression.DeflaterPool

Expected behavior

2022-12-29 11:41:07.041 ERROR Job with execId-IDE_bigdata_flink_0 + subJobId : 1284 execute failed,21304, Task is Failed,errorMsg: errCode: 12003 ,desc: dn19:9101_0 Failed to async get EngineNode AMErrorException: errCode: 30002 ,desc: ServiceInstance(linkis-cg-engineconn, dn24:27354) ticketID:268ec415-ff29-400f-9692-2418b3b1af6b 初始化引擎失败,原因: Failed to start EngineConn, reason: ECMErrorException: errCode: 11102 ,desc: OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=250m; support was removed in 8.0 OpenJDK 64-Bit Server VM warning: ignoring option PermSize=128m; support was removed in 8.0 11:41:04.280 ERROR org.springframework.boot.diagnostics.LoggingFailureAnalysisReporter 40 report -

APPLICATION FAILED TO START

Description: An attempt was made to call a method that does not exist. The attempt was made from the following location: org.eclipse.jetty.websocket.server.WebSocketServerFactory.(WebSocketServerFactory.java:184) The following method did not exist: org.eclipse.jetty.util.compression.DeflaterPool.ensurePool(Lorg/eclipse/jetty/util/component/Container;)Lorg/eclipse/jetty/util/compression/DeflaterPool; The method's class, org.eclipse.jetty.util.compression.DeflaterPool, is available from the following locations: jar:file:/home/webank/LinkisInstall/tmp/engineConnPublickDir/6b59d7fe-a525-4e66-9504-d493eb79e13f/v000005/lib/flink-connector-mysql-cdc-1.1.1.jar!/org/eclipse/jetty/util/compression/DeflaterPool.class jar:file:/home/webank/LinkisInstall/lib/linkis-commons/public-module/jetty-util-9.4.48.v20220622.jar!/org/eclipse/jetty/util/compression/DeflaterPool.class The class hierarchy was loaded from the following locations: org.eclipse.jetty.util.compression.DeflaterPool: file:/home/webank/LinkisInstall/tmp/engineConnPublickDir/6b59d7fe-a525-4e66-9504-d493eb79e13f/v000005/lib/flink-connector-mysql-cdc-1.1.1.jar org.eclipse.jetty.util.compression.CompressionPool: file:/home/webank/LinkisInstall/tmp/engineConnPublickDir/6b59d7fe-a525-4e66-9504-d493eb79e13f/v000005/lib/flink-connector-mysql-cdc-1.1.1.jar org.eclipse.jetty.util.component.AbstractLifeCycle: file:/home/webank/LinkisInstall/tmp/engineConnPublickDir/6b59d7fe-a525-4e66-9504-d493eb79e13f/v000005/lib/flink-connector-mysql-cdc-1.1.1.jar Action: Correct the classpath of your application so that it contains a single, compatible version of org.eclipse.jetty.util.compression.DeflaterPool

Your environment

  • Linkis version used: 1.2.0
  • Environment name and version:
    • cdh-5.12.1
    • hive-1.1.0
    • spark-2.4.3
    • scala-2.11
    • jdk 1.8.0_121
    • ....

Anything else

No response

Are you willing to submit a PR?

  • [X] Yes I am willing to submit a PR!

Yiutto avatar Jan 03 '23 07:01 Yiutto

:blush: Welcome to the Apache Linkis community!!

We are glad that you are contributing by opening this issue.

Please make sure to include all the relevant context. We will be here shortly.

If you are interested in contributing to our website project, please let us know! You can check out our contributing guide on :point_right: How to Participate in Project Contribution.

Community

WeChat Assistant WeChat Public Account

Mailing Lists

Name Description Subscribe Unsubscribe Archive
[email protected] community activity information subscribe unsubscribe archive

github-actions[bot] avatar Jan 03 '23 07:01 github-actions[bot]

image flink-connector-mysql-cdc的jetty的版本为9.4.33.v20201020，而linkis的jetty为9.4.48.v20220622.

Yiutto avatar Jan 03 '23 12:01 Yiutto