Piyush Narang

Add Platform test to show Hadoop and Tez partitioning difference

1

Noticed this on one of our test jobs that we were using to compare the performance of MR and Tez. I've built a unit test to show a subset of...

Adding a few APIs to Tez to help Cascading break its dependency on an internal implementation and still get some of the data it needs. Added APIs: ``` DAGInformation getDAGInformation()...

Putting a proof of concept PR for one of the approaches listed in the jira: https://issues.apache.org/jira/browse/TEZ-3369

Discrepancy in behavior of QTree[Long] and QTree[Double] for quantileBounds

5

Been poking arond with the Algebird 0.12.0 release (which included fix: https://github.com/twitter/algebird/pull/472/files). Noticed that the behavior for QTree[Long] and QTree[Double] is fairly different when you try to pick up the...

Bijection 0.9.6 release proposal

1

Primary change in this is to switch some of the Twitter libs to provided (util, finagle, scrooge) so that users picking those libraries up as well as Bijection don't run...

Update template partition fields to format validation to a compile time macro

3

One of the suggestions that came up in PR: https://github.com/twitter/scalding/pull/1590 was to update the validation check in [TemplatePartition](https://github.com/twitter/scalding/blob/develop/scalding-core/src/main/scala/com/twitter/scalding/typed/TemplatePartition.scala#L30) to a compile time macro: ``` assert( partitionFields.size == "%s".r.findAllIn(template).length, "Number of...