Anish Chakraborty
Anish Chakraborty
We are starting to use scio-redis, and right now have made some modifications to the RedisDoFn for our needs, and we wanted have this added to scio-redis. - Support for...
We have some awesome transforms in Scio's [transforms package](https://github.com/spotify/scio/tree/master/scio-core/src/main/java/com/spotify/scio/transforms). When using them in Scala pipelines, it can be less idiomatic. It would be nice to have first class support for...
Trying to write a `SCollection[T: Schema]` using `.saveAsBigQuery(..)` I get a NPE because Beam doesn't know the `TableSchema` This originates from [here](https://github.com/spotify/scio/blob/master/scio-bigquery/src/main/scala/com/spotify/scio/bigquery/BigQueryIO.scala#L730)
I tried to make this more usable. Since this was almost 2 yrs old lying un used, I took the liberty to break some of the APIs. TL;DR: * upgrade...
The [mutationsToRow](https://github.com/spotify/magnolify/blob/main/bigtable/src/main/scala/magnolify/bigtable/BigtableType.scala#L60) defined in BigTableType, assumes col qualifiers to be utf8 strings (for sorting), and sorts the set cell requests before applying. The above code creates as many columns as...
In some use cases in [Scio](https://github.com/spotify/scio) we create large Bloom filters with around 5 ~ 50M entries in some batch data pipelines. We were using BloomFilterAggregator API for most of...
Adds an implementation of mutable Bloom Filters to `com.twitter.algebird.mutable`. This uses `java.util.BitSet` underneath, and the `+=` and `++=` operators mutates `this` Bloom Filter when adding elements. This is significantly faster...
@johnynek I was going through your talk [here](https://www.youtube.com/watch?v=kTyvu0uxPzg) from Scale by the Bay 2018 about immutable APIs and mutable internals. I had a very rough idea about the `BloomFilterAggregator` and...
I was trying out [this](https://www.scala-lang.org/blog/2018/06/04/scalac-profiling.html) guide to profile a project. I added the following in sbt ``` "-Ycache-plugin-class-loader:last-modified", "-Xplugin:$PATH_TO_PLUGIN_JAR", "-P:scalac-profiling:no-profiledb", "-P:scalac-profiling:show-profiles", "-P:scalac-profiling:sourceroot:$BLOOP_CODEBASE_DIRECTORY" ``` When I do `console` from sbt shell,...
building the project using dev containers was failing. I was trying to use codespaces to test. - `go test -golden-update` fails without installing npm.