feat: Observability Tooling

[omrishiv]

Community Note

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
• Please do not leave "+1" or other comments that do not add relevant new information or questions, they generate extra noise for issue followers and do not help prioritize the request
• If you are interested in working on this issue or have submitted a pull request, please leave a comment

What is the outcome that you are trying to reach?

Having some observability built in to Data on EKS would be very helpful for understanding the environment performance, application status, and cost.

Describe the solution you would like

It would be great to have an observability stack built on well supported tooling that would expose: metrics, logs, traces, and costs. A stack built with Grafana, Prometheus, Loki, and OpenCost would support an open source solution that facilitates the pillars of observability.

Describe alternatives you have considered

There is the possibility of using SaaS products for observability, but I believe that a community supported solution should be a minimum availability as part of Data on EKS.