querybook
querybook copied to clipboard
Support logging of metrics for Querybook
We can implement something similar to airflow's implementation of metric logging via statsD https://airflow.apache.org/docs/apache-airflow/stable/logging-monitoring/metrics.html This can be used for prometheus as well as via exporter as noted here https://www.redhat.com/en/blog/monitoring-apache-airflow-using-prometheus
Further details are required. Here are some of the metrics we can support:
- request latency
- number of request
- number of failed SQL session
- number of failed system tasks
- number of failed scheduled datadoc tasks
- redis read/write latency
- number of query execution
- number of unexpected failed query execution