databricks-sql-nodejs icon indicating copy to clipboard operation
databricks-sql-nodejs copied to clipboard

Slow Response Time

Open rsanto06 opened this issue 2 years ago • 2 comments

Hi,

Currently the response time that I got from NodeJS is between 3 to 5 seconds slower than the same query ran in the Databricks UI, e.g. in Databricks I have 0.5s, and in other side with NodeJS connector I got 4.5s.

There is anything that I can do to improve this?

I followed the documentation avaiable here: https://docs.databricks.com/dev-tools/nodejs-sql-driver.html

Thank you

rsanto06 avatar Feb 09 '23 20:02 rsanto06

@kravets-levko Do you have some time to check this? Thank you!

rsanto06 avatar Feb 13 '23 15:02 rsanto06

@rsanto06

  • which Nodejs connector version you use? Have you tried to upgrade to latest?
  • do you run your queries against SQL Warehouse or Compute cluster? Which DBR version it uses?
  • do you use AWS or Azure workspace?
  • how large your query result is?
  • is your warehouse/cluster already running when you execute your query? Keep in mind that DBSQL UI starts warehouse when you open the page, so most likely it's already up when you execute your query.
  • does Nodejs conector execute the same query faster when you run it once more?
  • if possible - please you try other conectors (Python or Go) and check if you experience similar latency or not

kravets-levko avatar Apr 11 '24 14:04 kravets-levko