sqlmesh
sqlmesh copied to clipboard
TobikoData
Efficient data transformation and modeling framework that is backwards compatible with dbt.
SQLMesh Version: 0.174.2 (but I believe the problem still persists) Dialect: Trino State: Postgres I created a custom materialization to override the default use of MERGE for INCREMENTAL_BY_UNIQUE_KEY in Trino...
### Description The SQLMesh linter rule `ambiguousorinvalidcolumn` is incorrectly raising errors for valid PostgreSQL LATERAL join syntax. The linter cannot resolve columns that are properly referenced within LATERAL join subqueries,...
When defining a model with dialect tsql, SQLMesh fails to parse valid SQL Server syntax that uses FOR JSON AUTO (or FOR JSON PATH). This syntax is supported in SQL...
> Error: Identifier name {schema}__{table}__1234567890_schema_tmp( length 68) exceeds Postgres's max identifier limit of 63 characters To reprocude, have an empty postgres database configured: ``` # Setup, old sqlmesh set -eux...
I've hit this error from the `sqlmesh run` command in our staging environment, but I've also hit it at various times during development. After asking about it on Slack I...
**Bug description:** When creating, changing or restating a model with kind FULL, and then doing a run with an interval that is either: * before the model's start date, or...
## Scenario I want to import data, run some QA on it, then repeat the import until I accept QA. My data refresh frequency is quarterly, so I have plenty...
Hi! I'm experiencing an issue while testing a CTE: the output row order is non-deterministic. One run is successful, but another may fail simply because the rows are rearranged (even...
Only applies to the `%%fetchdf` magic command (although it could be expanded). Replaces the generic `pandas.read_sql_query()` with [PandasCursor](https://laughingman7743.github.io/PyAthena/pandas.html#pandascursor) for improved I/O performance. --- With `pandas.read_sql_query()`: 1. Query executes in Athena...
Clickhouse provides [compression](https://clickhouse.com/docs/data-compression/compression-in-clickhouse) on columns to yield better performance. Right now there is nothing mentioned about codecs in [documentation](https://github.com/TobikoData/sqlmesh/blob/main/docs/integrations/engines/clickhouse.md) nor I could see any codecs related [code](https://github.com/TobikoData/sqlmesh/blob/main/sqlmesh/core/engine_adapter/clickhouse.py) in the limited...
Metadata
Owner
Metadata
Efficient data transformation and modeling framework that is backwards compatible with dbt.