m3 icon indicating copy to clipboard operation
m3 copied to clipboard

proto decoded message size 1195986768 is larger than maximum supported size 4194304

Open yuandongjian opened this issue 4 years ago • 1 comments

There are many errors in the M3Coordinator log. What do these errors mean?

the defaultMaxMessageSize is 4MB, how do I modify it.

{"level":"error","ts":1632119119.2488701,"msg":"could not read message from consumer","error":"unexpected EOF"}
{"level":"error","ts":1632119119.2520366,"msg":"could not read message from consumer","error":"proto: illegal wireType 7"}
{"level":"error","ts":1632119119.2557118,"msg":"could not read message from consumer","error":"proto decoded message size 1811942144 is larger than maximum supported size 4194304"}
{"level":"error","ts":1632119119.259555,"msg":"could not read message from consumer","error":"proto decoded message size 1195725856 is larger than maximum supported size 4194304"}
{"level":"error","ts":1632119119.263386,"msg":"could not read message from consumer","error":"proto decoded message size 23356774 is larger than maximum supported size 4194304"}
{"level":"error","ts":1632119119.2672226,"msg":"could not read message from consumer","error":"proto decoded message size 813957120 is larger than maximum supported size 4194304"}
{"level":"error","ts":1632119119.2708926,"msg":"could not read message from consumer","error":"proto decoded message size 806093313 is larger than maximum supported size 4194304"}
{"level":"error","ts":1632119119.2742302,"msg":"could not read message from consumer","error":"proto decoded message size 1330664521 is larger than maximum supported size 4194304"}
{"level":"error","ts":1632119119.278084,"msg":"could not read message from consumer","error":"proto decoded message size 1414417744 is larger than maximum supported size 4194304"}
{"level":"error","ts":1632119119.281818,"msg":"could not read message from consumer","error":"proto decoded message size 50331659 is larger than maximum supported size 4194304"}
{"level":"error","ts":1632119119.285515,"msg":"could not read message from consumer","error":"proto decoded message size 1148019796 is larger than maximum supported size 4194304"}
{"level":"error","ts":1632119119.289197,"msg":"could not read message from consumer","error":"proto decoded message size 973078528 is larger than maximum supported size 4194304"}
{"level":"error","ts":1632119119.2923343,"msg":"could not read message from consumer","error":"proto decoded message size 1246907721 is larger than maximum supported size 4194304"}
{"level":"error","ts":1632119119.2960145,"msg":"could not read message from consumer","error":"proto decoded message size 16777469 is larger than maximum supported size 4194304"}
{"level":"error","ts":1632119119.299801,"msg":"could not read message from consumer","error":"proto decoded message size 5898240 is larger than maximum supported size 4194304"}
{"level":"error","ts":1632119119.3033328,"msg":"could not read message from consumer","error":"proto decoded message size 302055476 is larger than maximum supported size 4194304"}
{"level":"error","ts":1632119124.3060012,"msg":"could not read message from consumer","error":"unexpected EOF"}
{"level":"error","ts":1632119124.3078647,"msg":"could not read message from consumer","error":"proto decoded message size 1195986768 is larger than maximum supported size 4194304"}
{"level":"error","ts":1632119264.3599367,"msg":"could not read message from consumer","error":"proto decoded message size 1195725856 is larger than maximum supported size 4194304"}
{"level":"error","ts":1632119294.4229538,"msg":"could not read message from consumer","error":"proto decoded message size 2147483688 is larger than maximum supported size 4194304"}

yuandongjian avatar Sep 23 '21 13:09 yuandongjian

Can you share your config? Also not quite sure which integration you're seeing errors with, but for the coord -> agg interaction you can configure the max message size like so:

downsample:
  remoteAggregator:
    client:
      encoder:
        maxMessageSize: <size>

wesleyk avatar Oct 20 '21 20:10 wesleyk