pytd
pytd copied to clipboard
treasure-data
Treasure Data Driver for Python
### What's changed InsertIntoWriter converts a single quote to a double quote because single quotes are reserved for string literals and double quotes are column names. However, this conversion will...
please add feature to customize `session_name` for Bulk Import https://github.com/treasure-data/pytd/blob/533457ab935a61701d08441a5a0b009db3c24035/pytd/writer.py#L484 It will be used in https://github.com/treasure-data/td-client-python/blob/af0acaa04b13004c63795331625eed0647ad1edc/tdclient/bulk_import_api.py#L36
Multiple links in the docs refer to `https://tddocs.atlassian.net/` This is no longer valid. All links to this domain need to be updated to links on `docs.treasuredata.com`
Hi I want to keep my data frame in Korean and send it to Treasure Data, but is the function not supported yet? When I checked the transmission result, I...
I'm not seeing any option to pass parameterized query. This would be super helpful when you have `None` columns as null. ```python value = None ``` ```sql client.query("INSERT INTO table...
According to the [latest Spark documentation](https://spark.apache.org/docs/latest/): > For Java 11, -Dio.netty.tryReflectionSetAccessible=true is required additionally for Apache Arrow library. This prevents java.lang.UnsupportedOperationException: sun.misc.Unsafe or java.nio.DirectByteBuffer.(long, int) not available when Apache Arrow...
It would be better to make `fmt="msgpack"` as default instead of `"csv"` to avoid unintentional type conversion coming from `pandas.read_csv`. ref: #78
While Google Colabolatory is good place to try pytd without preparing the Python environment in a local machine, some enterprise companies are prohibited to access on it. It would be...
Currently all array values in DataFrame will be converted into string, but it's not ideal.
If there is a column which has null values only, `to_td()` fails to upload the dataframe. It should be avoided setting `spark.sql.execution.arrow.fallback.enabled=true` for PySpark config. ```py >>> import pytd.pandas_td as...