Pengcheng Young

@mcarilli @ngimel Thanks for your reply. I did some tests and again data_prefetcher() dosen't speed up. I find something I want to share with you. `data_prefetcher()` here is designed to...

I got `OSError Too many open files` too. I run wandb in `optuna` subprocess. ```python def optuna_objective(trial): wandb.init() ... ... wandb.finish() return loss ``` Error Traceback ``` Traceback (most recent...

> Is the defragmentation method in the document you provided descheduler? They didn't mention any implementation details of defragmentation, but the current descheduler cannot solve this problem.

@JesseStutler Sure, I'm glad to collaborate with you.