Can I easily parallelize the search with multiple GPUs?

Open kwmaeng91 opened this issue 3 years ago • 1 comments

Hi, experts. I am really enjoying PyGlove! I have a question regarding accelerating the search. If I have multiple GPUs, does PyGlove supports parallelizing the search easily? If so, it would be great if you can give me any pointers.

Thank you!

Jun 22 '22 03:06 kwmaeng91

Good question, right now the OSS PyGlove only bundle with a 'in-memory' tuning backend, but we do plan to release a tuning backend for distributed tuning based on Vizier, so users can switch between backends in a single line of code. We will also document how to build tuning backend later.

Jun 22 '22 18:06 daiyip

Hi @kwmaeng91, OSS Vizier is now available as a backend for PyGlove: https://oss-vizier.readthedocs.io/en/latest/advanced_topics/pyglove/vizier_as_backend.html

Feb 07 '23 15:02 xingyousong