querybook icon indicating copy to clipboard operation
querybook copied to clipboard

Support logging of metrics for Querybook

Open czgu opened this issue 4 years ago • 0 comments

We can implement something similar to airflow's implementation of metric logging via statsD https://airflow.apache.org/docs/apache-airflow/stable/logging-monitoring/metrics.html This can be used for prometheus as well as via exporter as noted here https://www.redhat.com/en/blog/monitoring-apache-airflow-using-prometheus

Further details are required. Here are some of the metrics we can support:

  • request latency
  • number of request
  • number of failed SQL session
  • number of failed system tasks
  • number of failed scheduled datadoc tasks
  • redis read/write latency
  • number of query execution
  • number of unexpected failed query execution

czgu avatar Jul 06 '21 20:07 czgu