summingbird
summingbird copied to clipboard
Streaming MapReduce with Scalding and Storm
This PR addresses https://github.com/twitter/summingbird/issues/741 issue with serialization of generated scalacheck lambdas. We can safely remove `ArbitraryWorkaround` class with newest scalacheck release.
There are reasons why particular implementations might want to override this method (for example, to support custom serialization strategies), so let's make it protected instead of private.
This PR changes every instance of an http url to its https version for security reasons.
Cirrus CI allows to use more than 2 CPUs which speeds up tests drastically:  Cirrus CI also provides more flexibility by using containers and very fast caching storage. In...
scala 2.12.0 now requires `withFilter` for for-comprehension desugaring https://www.scala-lang.org/news/2.12.0/ https://github.com/scala/scala/pull/5252
should speed up builds, potentially.
I want to use this code internally in scalding. Seems like the easiest way to get it done. This is an interesting case, because all uses of it should probably...
This seems like it could be useful. We've probably underused Aggregators in the past for encapsulating logic.
We are using the DagOptimizer at stripe before planning to reduce the size of some online graphs (went from 115 storm bolts or so to 69 in one example). However,...
0.10 version of #758