Wes McKinney

pyarrow interoperability and integration testing

4

We're starting to get some bug reports in Apache Arrow from koalas users https://issues.apache.org/jira/browse/ARROW-7986 [A user commented](https://issues.apache.org/jira/browse/ARROW-7986?focusedCommentId=17049939&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17049939) > koalas in this case relies on pyarrow to convert the pyspark.ml.linalg-specific SparseVector,...

**Issue by [wesm](http://github.mtv.cloudera.com/wesm)** _Friday Apr 10, 2015 at 22:08 GMT_ _Originally opened as http://github.mtv.cloudera.com/wesm/ibis/issues/179_ --- STDDEV, NDV, APPX_MEDIAN, and others support a `STDDEV(DISTINCT foo)`

**Issue by [wesm](http://github.mtv.cloudera.com/wesm)** _Saturday Jan 24, 2015 at 20:55 GMT_ _Originally opened as http://github.mtv.cloudera.com/wesm/ibis/issues/77_ ---

feat: column expressions from a base table should also be valid on top of a limited table

1

**Issue by [wesm](http://github.mtv.cloudera.com/wesm)** _Monday Apr 13, 2015 at 18:30 GMT_ _Originally opened as http://github.mtv.cloudera.com/wesm/ibis/issues/180_ --- Consider for example: `table.limit(100).aggregate(agg_exprs)` when `agg_exprs` was built from `table`. Currently fails AFAICT. Sort of...

``` $ flake8 python/ python/grizzly/encoders.py:6:1: F401 'subprocess' imported but unused python/grizzly/encoders.py:8:1: F403 'from weld.weldobject import *' used; unable to detect undefined names python/grizzly/encoders.py:21:1: E302 expected 2 blank lines, found 1...

Grizzly is Python 2.7 only

13

It will be important to run on Python 3, preferably both 2.7 and 3.5/3.6 with a single codebase (the `six` module helps with this)

Evaluating Weld functions on Arrow memory without serialization

4

hi folks, I'm interested to see if this is something that we could work on together. Weld has its own memory format, e.g. as expressed in https://github.com/weld-project/weld/blob/master/python/grizzly/numpy_weld_convertor.cpp and elsewhere. Weld...

Memory layouts for string processing

3

hi folks, I'm excited about the Weld project. I have been looking at the Weld data structures and way that the runtime interacts with memory and have some questions, particularly...