protarrow

protarrow copied to clipboard

0x26res

0x26res

0x26res

0x26res

Hi tradewelltech, I find the library very useful. I have a feature request: would you please consider adding the conversion of google.protobuf.Duration type into pyarrow.Duration? Thank you, Chase

chasezheng

Support for proto extensions

5

Hi all, Thank you for developing this library, which has been really useful to me. Could you look into the support of proto extensions? If a message has extensions, then...

chasezheng

recursive/self-referential types leads to a recursion error during schema generation

2

Currently it isn't possible to use protarrow with a protobuf that is self-referential. For example, neither of these two protos will work: ```protobuf message LinkedListNode { string value = 1;...

alkasm

Incorrect type annotation for `messages_to_table()`: marked to take an `Iterable[M]` but requires `len()`

7

Iterables can be infinite/don't necessary have a length, so [this line of code](https://github.com/tradewelltech/protarrow/blob/19e156346bda76bb3c214481217e88374e8f4c33/protarrow/proto_to_arrow.py#L530) invalidates the annotation. Length requires `Sized`. Could also use `Collection[M]` or `Sequence[M]` though those are a tad...

alkasm

fix: doc

1

0x26res

0x26res