prometheus-engine
prometheus-engine copied to clipboard
Automatic handling of too many buckets
Occasionally customers see failed export on histograms:
export.go:827 level=error component=gcm_exporter msg="send batch" size=106 err="rpc error: code = InvalidArgument desc = One or more TimeSeries could not be written: Field timeSeries[3].points[0].value had an invalid value: Distribution metric has too many buckets.; Field timeSeries[49].points[0].value had an invalid value: Distribution metric has too many buckets.\nerror details: name = Unknown desc = total_point_count:106 success_point_count:104 errors:{status:{code:3} point_count:2}"
Let's figure it out if there is an automatic way to change buckets to appropriate number. Also more information would be nice.