vulcan-sql
vulcan-sql copied to clipboard
Caching layer enhancement
- Better management on the downloaded parquet files.
- We don't need to store elder version parquet files.
- maybe can put parquet files manually and specify as the data to be cached.
- Re-create caching layer cost a lot when restart VulcanSQL, should minimize the cost.
- Schedule job will have logs and record the job status.
- Minimize the cost of the refresh cache.