databricks-sql-python

databricks-sql-python copied to clipboard

Appending a local Pandas dataframe to a Delta table in Azure is slow

1

I followed the instructions on [this](https://docs.databricks.com/en/dev-tools/sqlalchemy.html#language-SQL%C2%A0warehouse) page to create a SQLAlchemy engine and used it with the Pandas `to_sql()` method. It's taking around 2 seconds to append one data point...

beefupinetree

If the token is null, the connection hangs

6

Hi, today we were troubleshooting a process that uses databricks-sql-python. The connection hangs if the token is null. Evidence to reproduce:  (The cell never ends) Generating token it ends...

wallystart

I'm able to PUT a file without specifying a `staging_allowed_local_path` (via the `__input_stream__` functionality), but removing the file requires it, even though removing a file doesn't require any local storage.

polivbr

Compiled sql for an input list parameter results in incorrect syntax in 4.0.4

2

In 4.0.4 it seems like the partial implementation of supporting complex types like arrays etc is resulting in incorrect syntax For example (where the list parameter is `[1, 2, 3]`):...

jwhite3

ERROR:databricks.sql.common.unified_http_client:HTTP request error: Retry request would exceed Retry policy max retry duration of 300 seconds

4

My Code: ``` conn = sql.connect(server_hostname = server_hostname, http_path = http_path, access_token = access_token, _tls_no_verify=True) cursor = conn.cursor() select_sql="select * from tableA" cursor.execute(select_sql) ``` Then console show error as follows:...

jimsan6817

Auth token warning using oauth M2M

3

This was originally posted in dbt-databricks project and I was asked to cross post i here. Related to: https://github.com/databricks/dbt-databricks/issues/1246 When running dbt in an Azure Devops Agent (for continues integration...

septponf

Drop support for Python 3.8

1

## What type of PR is this? - [x] Other ## Description Currently, all unit tests, linting checks, and type checking in the CI only run for Python 3.9-3.13, since...

varun-edachali-dbx

Update native.py: use dict instead of Dict

2

The capital letter version from typing has been deprecated since Python 3.9 https://docs.python.org/3/library/typing.html#typing.Dict ## What type of PR is this? - [x] Refactor ## How is this tested? Type check...

wyattscarpenter

[471] - Close underlying HTTP Client on closing `Connection`

2

(Addresses #471). ## What type of PR is this? - [x] Bug Fix ## Description Here, we resolve a few resource leaks with regards to TCP connections remaining open even...

Varun0157

Fix token federation warnings by making it opt-in and improving error handling [Issue #702]

2

## What type of PR is this? Fixes token federation warnings that were appearing for users not using identity federation. Token federation is now opt-in and only enabled when `identity_federation_client_id`...

madhav-db