snowpark-python icon indicating copy to clipboard operation
snowpark-python copied to clipboard

SNOW-1254469: Add CTE optimization to tests/perf/perf_runner

Open sfc-gh-jdu opened this issue 1 year ago • 1 comments

Please answer these questions before submitting your pull requests. Thanks!

  1. What GitHub issue is this PR addressing? Make sure that there is an accompanying issue to your PR.

    Fixes #NNNN

  2. Fill out the following pre-review checklist:

    • [ ] I am adding a new automated test(s) to verify correctness of my new code
    • [ ] I am adding new logging messages
    • [ ] I am adding a new telemetry message
    • [ ] I am adding new credentials
    • [ ] I am adding a new dependency
  3. Please describe how your code solves the related issue.

    Please write a short description of how your code change solves the related issue.

sfc-gh-jdu avatar Apr 01 '24 19:04 sfc-gh-jdu

Does the current test suite test for chain of operation of varying sizes for example 10, 100, 1000 so see the trend of impact.

You mean something like df.union(df), with 10, 100, 1000 times?

sfc-gh-jdu avatar Apr 02 '24 01:04 sfc-gh-jdu