vulcan-sql icon indicating copy to clipboard operation
vulcan-sql copied to clipboard

Caching layer enhancement

Open onlyjackfrost opened this issue 2 years ago • 0 comments

  • Better management on the downloaded parquet files.
    • We don't need to store elder version parquet files.
    • maybe can put parquet files manually and specify as the data to be cached.
  • Re-create caching layer cost a lot when restart VulcanSQL, should minimize the cost.
  • Schedule job will have logs and record the job status.
  • Minimize the cost of the refresh cache.

onlyjackfrost avatar Aug 17 '23 03:08 onlyjackfrost