data-formulator icon indicating copy to clipboard operation
data-formulator copied to clipboard

Prepare for the next update: Data Anchor

Open Chenglong-MS opened this issue 10 months ago • 0 comments

With Data Anchor, we can anchor an intermediate data to isolate it's derivation context from it's predecessors. Tables created from the anchor will take the anchored table as direct input (not the original data).

This could be helpful for cleaning initial input data (so we always work with cleaned data afterwards), or when we want to focus our analysis into a subset of dataset.

This makes analysis clean, but also makes it more efficient for LLM to work with, since it won't have the gigantic context attached to the anchored data.

We'll merge it after some more testing and playing. Made quite a bit of updates so it can be messy(?)

Here is a quick demo:

https://github.com/user-attachments/assets/ec5cb307-2504-4c1a-9e55-956525cff3bf

Chenglong-MS avatar Mar 19 '25 01:03 Chenglong-MS