model_api icon indicating copy to clipboard operation
model_api copied to clipboard
verified publisher icon openvinotoolkit

create_model improvements

Open AlexKoff88 opened this issue 2 years ago • 0 comments

  • Implement .to(device: str), .half(), and .bf16() methods to control the execution device and convertion to FP16.
  • Should work only for local inference
  • "precision" should be removed from create_model() API. "device" can be saved.

AlexKoff88 avatar Feb 27 '23 07:02 AlexKoff88