HybridBackend
HybridBackend copied to clipboard
support ARROW_NUM_THREADS in ParquetDataset
User Story

hb.data.ParquetDataset can not used all of pod-cpu.
Detailed requirements
hb.data.ParquetDataset
- num_parallel_reads to set file reader nums
- **[new]**num_arrow_threads to set column reader thread nums
to accelerate model training
API Compatibility
hb.data.ParquetDataset
Willing to contribute
Yes