Pavan Ramkumar

I love what you've built with marimo. One of the reasons I'm holding back from switching over fully to marimo is a feature like this. I use napari currently and...

Can confirm reproducing this error. ``` TypeError: _scan_pyarrow_dataset_impl() got multiple values for argument 'batch_size' ``` `lf.collect()` is working as expected for polars 1.3.0 but not recent versions. works for these...

This guide would be extremely valuable since I don't think it's widely documented elsewhere how to write a commit lock for s3. I'm long on the lance table format, but...

That's amazing! Looking forward to the next release. Any forthcoming documentation that shows how to do concurrent writes in python?

Awesome, thanks for walking through that. My use case is certainly distributed writes (many fan out computes writing to the same table). If I understand right, #3483 now enables safe...

@lhoestq thanks for your support! Any suggestions across `datasets` or `huggingface_hub` projects to make this happen? I just noticed this blog post: https://huggingface.co/blog/streaming-datasets Do you know if `hfFileSystem` from `huggingface_hub`...

Thanks @lhoestq @wjones127 @Xuanwo ! I think we have all the necessary people on this thread now to make it happen :) > Could you elaborate why a FragmentScanOptions subclass...

Here's a public dataset which could be a working example to work backwards from: https://huggingface.co/datasets/pavan-ramkumar/test-slaf pylance currently looks for default object store backends and returns this `ValueError` ``` >>> import...

@Xuanwo @wjones127 just checking in to see if you had a chance to add a huggingface provider via opendal to pylance. I'm assuming we need a new `huggingface.rs` provider [here](https://github.com/lance-format/lance/tree/4d9c1a4d459ea486556de0ee90828a442d0425b0/rust/lance-io/src/object_store/providers)....

> I'm willing to work on this! Would you like to create an issue on lance side and ping me there? Done! [Link](https://github.com/lance-format/lance/issues/5346)