Martin Caruso
Martin Caruso
@murgatroid99 That is not the issue, we can see there that the envoy in the client side is generating the goaway: `2024-01-27T07:18:14.817867Z debug envoy http2 external/envoy/source/common/http/http2/codec_impl.cc:1208 [Tags: "ConnectionId":"7"] sent goaway...
The timeline order is the following: First I see a lot of requests like this in envoy client side where they are ok: **2024-01-27T07:18:14.817417547Z** stdout F {"bytes_received":5,"connection_termination_details":null,"downstream_peer_uri_san":null,"upstream_local_address":"10.244.1.36:56188","method":"POST","x_envoy_external_address":null,"dd.trace_id":null,"downstream_local_address":"10.96.13.98:8081","upstream_host":"10.244.1.35:8081","requested_server_name":null,"start_time":"2024-01-27T07:18:09.537Z","path":"/rpc.bookshop.v1.InventoryService/GetBookList","upstream_cluster":"outbound|8081||grpc-server.mcaruso-poc.svc.cluster.local","request_id":"4d2ba9ed-e3dd-4cd2-8ef4-87369be87a99","protocol":"HTTP/2","downstream_remote_address":"10.244.1.36:34518","x_forwarded_client_cert":null,"route_name":"default","user_agent":"grpc-node-js/1.9.14","x_forwarded_proto":"http",**"response_code":200**,"upstream_service_time":"5215","bytes_sent":106,"duration":5269,"authority":"grpc-server.mcaruso-poc.svc.cluster.local:8081","response_flags":"-","x_forwarded_for":null,"upstream_transport_failure_reason":null,**"response_code_details":"via_upstream"**} Then, at some...
@abscondment I think if we find the problem causing this issue, it must work in the same way than istio 1.18.5, which means not throwing the codec error.
@murgatroid99 Hi, the problem I can see it comes from the client, because I did the same tests having the server deployed in kubernetes with several pods with the capacity...
@murgatroid99 Yes, this error is also happening with node 18.16.0, 20.11.0, 21.6.0, and also with grpc-js 1.9.14
@murgatroid99 Here I have more logs: The envoy side car in the client shows: ``` 2024-01-27T07:18:14.817567Z trace envoy connection external/envoy/source/common/network/connection_impl.cc:615 [Tags: "ConnectionId":"7"] read ready. dispatch_buffered_data=0 thread=25 2024-01-27T07:18:14.817567Z trace envoy connection...
@murgatroid99 That is not the issue, we can see there that the envoy in the client side is generating the goaway: `2024-01-27T07:18:14.817867Z debug envoy http2 external/envoy/source/common/http/http2/codec_impl.cc:1208 [Tags: "ConnectionId":"7"] sent goaway...
@murgatroid99 Yes, in fact if you see the timeline order is the following, First I see a lot of requests like this in envoy client side where they are ok:...
Ok, makes sense. If I try this with Istio 1.18.5, this does not happen. It only happens with Istio 1.19.X and up.
The only thing that calls my attention in the grpc-js library is that when I search this codec_error: The_user_callback_function_failed, I get this: > If you are encountering the codec_error: The_user_callback_function_failed...