databricks-sql-python
databricks-sql-python copied to clipboard
databricks
Databricks SQL Connector for Python
https://github.com/databricks/databricks-sql-python/blob/3eaaac91a0a1a0e5920f64bb41f94e552f22497a/src/databricks/sqlalchemy/dialect/__init__.py#L254 lists tables just from "SHOW TABLES FROM {}" but it does not keep in consideration that atm Databricks lists views as well as tables with that. A possible correction...
Add a LOAD DATA LOCAL type capability to take files local to client, load to dbfs/volumes/bucket/storage account staging area, then COPY INTO a delta lake table, optionally remove data from...
Are there any plans to support authentication through the same .databrickscfg file used by the Databricks CLI, and the Databricks VSCode extension? It would be useful to have one config...
I am writing a web app that needs to run multiple concurrent queries against Databricks SQL Warehouse. Due to existing library is synchronous my processes tend to get locked for...
# Overview When I attempt to use a datepart function with text('YEAR'), the compile code for the databricks dialect throws and error (see sample code below as it is trying...
See https://github.com/databricks/dbt-databricks/issues/388 It looks like the high memory use due to this library. ### Reproduction Setup env: ```sh python -m venv venv source venv/bin/activate pip install --upgrade pip pip install...
I have a very large table, with more than 100 thousand rows and when I try to download it using this method, it gives an error. I replace the table...
When using the SQLAlchemy dialect, I get this error when my program closes after running that code: ```python import os from sqlalchemy import create_engine server_hostname = os.getenv("DATABRICKS_SERVER_HOSTNAME") http_path = os.getenv("DATABRICKS_HTTP_PATH")...
When using the SQLAlchemy engine with Pandas, it seems that Pandas makes a bad DESCRIBE query. Here is the code: ```python import os import pandas as pd from sqlalchemy import...
Issue: When I attempt to see if a table exists (inspection.has_table(table_name='x', schema='y'), I get an error saying that the catalog name must be surrounded by back-quote. Recreation Steps: 1) Build...