Arkadiusz Rudny
Arkadiusz Rudny
Quick update on this one - definitely the difference is the command line support. They don't support `pgbouncer_exporter health` command for example
I commented on that issue but I'm not sure if it's related no one there mentions that jobs are completed (apart of me). To me this one is more relevant...
Using airflow metrics I also observed that when the issue is happening there are 2 different numbers for usually associated metrics: At 12:17 airflow-scheduler was restarted
I see similarity between the issue we are facing and the one you describe. Airflow 2.8.4 We run one instance of scheduler and we observe a list of completed tasks...
@crabio Could you please post steps to reproduce the issue? Then I could spend a little bit more time understanding it
There is also another ticket that is related to the similar code path: https://github.com/apache/airflow/issues/36839
@Joffreybvn Just retested with `Databricks provider 6.1.0` on `airflow 2.8.1` and the issue still persists with different stacktrace: ``` [2024-01-29, 13:41:39 CET] {taskinstance.py:1956} INFO - Dependencies all met for dep_context=non-requeueable...
Retested with newly released airflow - airflow 2.8.2 - databricks provider 6.2.0 - pandas 2.2.1 the issue still persists
I discussed it with him on airflow's slack but it's a good idea to have a visibility over it in here as well. I have attached a `DatabricksSqlOperator` that is...