Sebastian Schelter

icon indicating a website link deem.berlin

icon company BIFOLD & TU Berlin icon location Berlin icon location Professor at BIFOLD & TU Berlin, research on data engineering for ML. Previously at UvA, NYU, Amazon, Twitter.

Results 36 comments of Sebastian Schelter

Deequ constraint suggestion fails with 500+ columns

What exactly is the problem, e.g. what failure do you see?

Usage of window functions inside checks

Hi, This error message is coming from Spark not Deequ. I am afraid that you cannot use windowing functions with deequ at the moment, unfortunately.

Usage of window functions inside checks

Deequ generates efficient aggregation queries to compute the statistics required for the checks. We don't have immediate plans to integrate windowing functions, but we would be happy to receive a...

Considering a fork of this repo to get it usable again

I think this is a great idea. I lost my push access to this repository since I left Amazon, and I don't have time in my new job to work...

Move of Sebastian Schelter to TU Berlin csrankings-s.csv

I updated my profile to contain my full name.

Move of Sebastian Schelter to TU Berlin csrankings-s.csv

Will open a new PR