Tristan Nixon comments

Results 40 comments of


                                            Tristan Nixon

cannot use a lazy fixture if it directly returns a list

I've just run into a situation where this would be very useful to have! (Code generates list of objects, I'd like to run a battery of tests on each -...

Minor fix to docs for read_csv

Yes, I can do that.

`tsdf.select("*")` throws Exception stating columns must be present when they are by nature of the projection

This is a tricky one that'll take some thought as to how to deal with... We want to support all the types of expressions that you could use within a...

Enhancement - Include BYO Function for resampling

@Sonali-guleria - could you provide more details and/or an example to illustrate what you think this would look like in practice?

Bump pyspark from 3.2.1 to 3.2.2 in /python

@dependabot ignore this dependency

Generalize rolling window calculations

Based on some investigation and our discussion on Friday (10/30) - I think the better approach here is to refactor these functions as sub-types of `pyspark.ml.Transformer` that implement the the...

dependency of interpolate function on resampling

I think you make a good point @smvazirizade, we should probably have a cleaner separation of interpolation for filling in missing values from interpolation for the purposes of upsampling. @guanjieshen...

Documentation for AsOfJoin is wrong

Actually this is on me. I neglected to update the docs when I completed #27

tempo inside `foreachBatch`

Hi @sim-san, great question. Technically, it should be possible to convert the `batch_df` to a TSDF and then perform tempo operations within a `foreachBatch` function. However, keep in mind that...

tempo inside `foreachBatch`

@sim-san would you be able to share the code snippet with your `forEachBatch` function and how you invoke the `writeStream`?