flightdeck icon indicating copy to clipboard operation
flightdeck copied to clipboard
verified publisher icon thoughtbot

Improve logging experience

Open jferris opened this issue 4 years ago • 1 comments

We deploy Fluent Bit and we're sending logs to Cloudwatch in the AWS platform. Cloudwatch is hard to search and expensive for data retention. It's also only viewable from workload accounts.

jferris avatar Aug 06 '21 13:08 jferris

We may be able to improve the experience with Cloudwatch:

  • Searching via Insights is much easier. We can use structured logs and pre-configured Insights queries to simplify this.
  • It's not actually data retention that's expensive, but data ingestion. Reducing the default logging volume helps with this.
  • We can either send logs to a centralized monitoring account or enable cross-account access.

jferris avatar Sep 07 '21 13:09 jferris