dubbo icon indicating copy to clipboard operation
dubbo copied to clipboard

泛化调用偶现超时

Open wuqiu-ai opened this issue 2 years ago • 5 comments

  • [x] I have searched the issues of this repository and believe that this is not a duplicate.

Ask your question here

dubbo版本:2.7.15 网关dubbo协议转换发现泛化调用偶现超时,最终原因是排查到一个提供方的服务由于网络问题未打通,导致一直调用超时失败,但是影响了整体的其他api调用,请问是啥原因?

报错数量是差不多每天调用1000w次请求,差不多会出现1w次超时,确实很奇怪为啥这个会有影响??

以下是调用那个问题提供方的报错信息:

org.apache.dubbo.rpc.RpcException: Failed to invoke the method queryAmountByCondition in the service org.apache.dubbo.rpc.service.GenericService. Tried 1 times of the providers [10.108.16.67:20991] (1/2) from the registry zk-tx.webuyops.com:2181 on the consumer 10.106.48.157 using the dubbo version 2.7.15. Last error is: Failed to invoke remote method: $invoke, provider: dubbo://10.108.16.67:20991/com.ynx.payment.platform.api.TaxRaiseApi?anyhost=true&application=soul_proxy&async=true&bean.name=ServiceBean:com.ynx.payment.platform.api.TaxRaiseApi&check=false&cluster=failfast&default.retries=0&default.timeout=3000&dubbo=2.0.2&generic=false&interface=com.ynx.payment.platform.api.TaxRaiseApi&loadbalance=roundrobin&metadata-type=remote&methods=queryBillList,queryAmountByCondition,queryBillListByCondition,queryAmount&pid=11&protocol=dubbo&register.ip=10.106.48.157&release=2.7.3.5-JINGLING-RELEASE&remote.application=payment-platform-ynx&retries=0&serialization=json&side=consumer&sticky=false&threadpool=cached&timeout=3000&timestamp=1680504781031, cause: client(url: dubbo://10.108.16.67:20991/com.ynx.payment.platform.api.TaxRaiseApi?anyhost=true&application=soul_proxy&async=true&bean.name=ServiceBean:com.ynx.payment.platform.api.TaxRaiseApi&check=false&cluster=failfast&codec=dubbo&default.retries=0&default.timeout=3000&dubbo=2.0.2&generic=false&heartbeat=60000&interface=com.ynx.payment.platform.api.TaxRaiseApi&loadbalance=roundrobin&metadata-type=remote&methods=queryBillList,queryAmountByCondition,queryBillListByCondition,queryAmount&pid=11&protocol=dubbo&register.ip=10.106.48.157&release=2.7.3.5-JINGLING-RELEASE&remote.application=payment-platform-ynx&retries=0&serialization=json&side=consumer&sticky=false&threadpool=cached&timeout=3000&timestamp=1680504781031) failed to connect to server /10.108.16.67:20991 client-side timeout 3000ms (elapsed: 3000ms) from netty client 10.106.48.157 using dubbo version 2.7.15

wuqiu-ai avatar Apr 07 '23 13:04 wuqiu-ai

影响了整体的其他api调用

这个 ip 也发布了其他服务嘛

AlbumenJ avatar Apr 08 '23 15:04 AlbumenJ

影响了整体的其他api调用

这个 ip 也发布了其他服务嘛

没发布其他服务

wuqiu-ai avatar Apr 09 '23 04:04 wuqiu-ai

其他服务是什么报错

AlbumenJ avatar Apr 09 '23 23:04 AlbumenJ

报错日志啥没出看啥报错,到时客户端层面都是3s超时

wuqiu-ai avatar Apr 11 '23 07:04 wuqiu-ai

接下全链路追踪看一下吧

AlbumenJ avatar Apr 12 '23 11:04 AlbumenJ