sergun

sparkmagic displays pandas DataFrames as texts

9

Hi! A have an issue with displaying pandas DataFrame in sparkmagic. They are always displayed as text. Any ideas? sparkmagic 0.12.6 livy 0.5

Tab with a lot if items and long captions

20

Hello, is it possible: 1. To control captions widths? Text size can vary.. Now large captions are cutted. Caption tooltips can be also helpful. 2. To enable tab items horizontal...

Hi folks, thanks a lot for this great tool! When use it in drf project got RecursionError after some time. More deeper analysis showed that some functions get called recursively...

Does mongo-arrow provide real zero copy in the chain mongodb->arrow->pandas?

3

.. or zero copy appear only between `arrow->pandas` but not here `mongodb->arrow`? In other words are arrow data types used in mongodb?

Limited support of duckdb dbt adapter credentials

1

As I see here: https://github.com/datafold/data-diff/blob/master/data_diff/dbt_parser.py#L388-L392 dbt config parser implemented in data-diff does not cover configuration options of modern duckdb dbt adapter. E.g. extensions and any s3 related settings are useful:...

Provide access to hidden tokens in a stream

2

Hi! First of all thanks a lot for this great tool! My question is: I need (in Python) CommonTokenStream(lexer) class instance to get access to hidden tokens like comments with...

Create iceberg table from existsing parquet files with slightly different schemas (schemas merge is possible).

7

### Question Hi! What is a right way to create an iceberg table from existsing parquet files with slightly different schemas? So merge of their schemas is possible. I would...

serialization support for Polars and Spark

1

Hi @cosmicBboy and all contributors to this great framework, I was wondering if there are any plans to implement schema serialization for the Polars and Spark engines. Thanks!

external materialization - temp table

2

Hi folks, I see that external materialization creates "internal" table with `__dbt_tmp` suffix before copying tables to files and creation of views. Why not to do just: ```COPY (model_select_query) TO...

[BUG] Internal & external s3 storage hostname

1

### Flyte & Flytekit version CHART VERSION APP VERSION DESCRIPTION flyteorg/flyte-binary v1.16.2 1.16.0 flytekit==1.16.10 ### Describe the bug I run `pyflyte run --remote` outside k8s cluster and configured storage (minio)...