parseable icon indicating copy to clipboard operation
parseable copied to clipboard

feat: allow arrow response for query

Open nitisht opened this issue 1 year ago • 1 comments

We should allow for an arrow response in a streaming fashion when a query is run. This will make time to first byte much faster and also allow integration with existing arrow ecosystem tools.

Console can leverage the arrow response.

We can still keep the json response for query as the default response but add a flag in query body, looking at the flag server can respond in arrow format.

nitisht avatar Feb 22 '24 06:02 nitisht

It would be fantastic if it could be integrated with https://perspective.finos.org/ or https://uwdata.github.io/mosaic/ for even better use.

mrchypark avatar Mar 07 '24 08:03 mrchypark

Implementation at #769

nitisht avatar Apr 19 '24 12:04 nitisht

Hi @nitisht is there any plan for a specific version with this feature? I would be very interested in testing it.

For your information: I am currently working on a kind of open-source (meta) data catalog. And I use Parseable together with Vector for my logs.

I'm not sure if I will ever publish it, but as there is no other place, currently: I want to say thank you for your work on this project. Very inspiring.

thinkORo avatar Apr 27 '24 12:04 thinkORo

fixed by #769

nitisht avatar May 16 '24 05:05 nitisht

Hi @nitisht is there any plan for a specific version with this feature? I would be very interested in testing it.

For your information: I am currently working on a kind of open-source (meta) data catalog. And I use Parseable together with Vector for my logs.

I'm not sure if I will ever publish it, but as there is no other place, currently: I want to say thank you for your work on this project. Very inspiring.

Thanks for the interest @thinkORo this will be available in the next release 1.1.1 on the server. We still might need more time to utilise this in the console.

Happy to discuss further as needed.

nitisht avatar May 16 '24 05:05 nitisht