scio icon indicating copy to clipboard operation
scio copied to clipboard

Fix withAllowedTimestampSkew deprecation warning

Open nevillelyh opened this issue 8 years ago • 2 comments

Need to look at the implications.

def timestampBy(f: T => Instant, allowedTimestampSkew: Duration = Duration.ZERO): SCollection[T] =
    this.applyTransform(WithTimestamps.of(Functions.serializableFn(f))
      .withAllowedTimestampSkew(allowedTimestampSkew))

https://issues.apache.org/jira/browse/BEAM-644

nevillelyh avatar Aug 30 '17 21:08 nevillelyh

Im trying to understand what allowed timestamp skew is. Is it the maxium allowed duration between event time and processing time?

LukeDefeo avatar Sep 25 '17 19:09 LukeDefeo

This medium post explains it quite clearly: https://medium.com/@erik.b.ferm/combining-bounded-pcollections-with-custom-timestamps-in-apache-beam-b0fd911b2ac

Fokko avatar Mar 26 '18 11:03 Fokko