Michel Trottier-McDonald

Hey @tovbinm,there's a unit test failure I've been investigating that's the result of a bug in Spark: https://issues.apache.org/jira/browse/SPARK-34805?focusedCommentId=17337491&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17337491. I'm wondering why `testData` in `SanityCheckerTest.scala` ([L137](https://github.com/salesforce/TransmogrifAI/blob/90a0f298f14506a27c84a71de414d53a30cf687f/core/src/test/scala/com/salesforce/op/stages/impl/preparators/SanityCheckerTest.scala#L137)) is constructed the way it...

> This is a known issue indeed. We have been copying over the metadata between fields each time we apply our transformers, e.g [`OpTransformer1.transform`](https://github.com/salesforce/TransmogrifAI/blob/master/features/src/main/scala/com/salesforce/op/stages/base/unary/UnaryTransformer.scala#L79) I mean that there is a...

I'm seeing the same thing while trying to serialize Algebird's [Moments](https://github.com/twitter/algebird/blob/c094d45bfb608fdd129a4bcab1376dd6827cab41/algebird-core/src/main/scala/com/twitter/algebird/MomentsGroup.scala#L33) class. I can reproduce the behavior with the following case class: ``` case class SimpleCaseClass( x1: Long, x2: Double,...

I'm unfortunately not in control of this code, and we need to use a build that exists in the Maven repo. Getting Algebird to change their API might be even...