Daniel Imberman

Oh wow! That works thank you! Yes it would be awesome if we could make it more noticeable.

@darrenhaken if the pod running the spark job fails and your using the k8s executor it will report as a failure of the task. It would be difficult to have...

@jacobhjkim That's an interesting point re: logs. How would this work if a worker is scaled down? Would a worker need to spin up again to use that volume to...

@jlaneve when I run the following code it passes ```python @pytest.mark.parametrize( "database_table_fixture", [ {"database": Database.SQLITE}, ], indirect=True, ids=["sqlite"], ) def test_raw_sql_with_comment(database_table_fixture, sample_dag): _, test_table = database_table_fixture @aql.run_raw_sql def raw_sql_query(my_input_table: Table,...

@jlaneve can you get me the logs for these tasks? I'm wondering if these tasks are actually failing. I created this DAG to more closely match what you're doing ```python...

It also appears that this DAG works @tatiana ```python test_table = Table(name="julian_test", metadata=Metadata(conn_id=db.conn_id) @aql.run_raw_sql(conn_id=db.conn_id) def create_customers_table_func(): return """CREATE TABLE julian_test ( id integer, name varchar (100) )""" @aql.run_raw_sql(conn_id=db.conn_id) def seed_customers_table_func():...

@jlaneve when I took the generated DAG and tried to run it in an Airflow instance, I got the same error as before (namely that XCOM is failing because there's...

@ashb @tatiana I think there are a few "gotchas" in this one. What do we do if there are multiple values in the template_searchpath? Wouldn't this only work once? Like...

@tetsuya111 @tatiana using random hashes might create problems as we want to create the ability to delete temp tables automatically and I was hoping to do so using DAG ID...

I believe that the solution is to add a feature where a user can manually define a schema using a list of SQLAlchemy columns. I believe @utkarsharma2 had looked into...