datafusion icon indicating copy to clipboard operation
datafusion copied to clipboard

Update quarterly_roadmap.md

Open yahoNanJing opened this issue 3 years ago • 5 comments

Which issue does this PR close?

Closes #.

Rationale for this change

What changes are included in this PR?

Are there any user-facing changes?

yahoNanJing avatar Sep 15 '22 03:09 yahoNanJing

Codecov Report

Merging #3493 (79be257) into master (84bee89) will not change coverage. The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #3493   +/-   ##
=======================================
  Coverage   85.75%   85.75%           
=======================================
  Files         299      299           
  Lines       55287    55287           
=======================================
  Hits        47411    47411           
  Misses       7876     7876           

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more

codecov-commenter avatar Sep 15 '22 04:09 codecov-commenter

We have implemented file-based shuffle with memory management in Blaze. I could have that PRed if it aligns with the goal of Ballista. https://github.com/blaze-init/blaze/blob/master/native-engine/datafusion-ext/src/shuffle_writer_exec.rs

yjshen avatar Sep 15 '22 05:09 yjshen

Thanks very much @yjshen. Could you help raise a PR for that? 😄

yahoNanJing avatar Sep 16 '22 01:09 yahoNanJing

I think it might be better to move the Ballista roadmap to the Ballista project now

andygrove avatar Sep 19 '22 15:09 andygrove

@andygrove, agree.

yahoNanJing avatar Sep 20 '22 01:09 yahoNanJing

I created a PR https://github.com/apache/arrow-ballista/pull/318 to add the Ballista roadmap to the Ballista repo

andygrove avatar Oct 05 '22 01:10 andygrove

Closing this since the ballista roadmap is now maintained in ballista

andygrove avatar Oct 05 '22 14:10 andygrove