positron icon indicating copy to clipboard operation
positron copied to clipboard

Data Explorer: Add "search_schema" support for polars, add 'match data types' support, introduce "column filter" RPC type, refactor row filters a bit

Open wesm opened this issue 1 year ago • 1 comments

This adds a match_data_types filter type in the search_schema RPC to support column selection and filtering workflows. This is implemented/tested for both pandas and polars -- no user-visible capabilities in this change.

I also refactored the row filter RPC types a bit to support extensibility and code reuse. We will need to coordinate with Ark when merging this.

Related Ark PR: https://github.com/posit-dev/ark/pull/424

wesm avatar Jul 05 '24 21:07 wesm

I need to do some debugging on this to get the union to deserialize properly in Python

wesm avatar Jul 05 '24 22:07 wesm

Let me know if there's anything I can do to help with the Pydantic deserialization stuff.

Turned out I had just missed refactoring some places in TypeScript where the JSON fields weren't being typechecked by the compiler (fixed now)

wesm avatar Jul 08 '24 15:07 wesm

This can be merged once the next Ark release version bump is imminent

wesm avatar Jul 08 '24 23:07 wesm

Merging this as we've now bumped ark: https://github.com/posit-dev/positron/pull/3928

lionel- avatar Jul 10 '24 07:07 lionel-