Support to interact with host machine directly

[nilaan-effectz]

Instead of using omni Box to run windows instance and interact with it , can we just directly interact with the host windows environment .

[teddybear082]

You can you just have to modify the code to eliminate the check for the server that is supposed to run the VM and then change all the lines that send pyautogui commands to the VM to be direct calls to pyautogui instead. Then it skips the VM server and runs directly on the host machine. Microsoft probably just didn’t want to be responsible for someone messing up their own computer using it, because otherwise there was no reason not to just make this a configuration option (use VM vs. not).

[teddybear082]

I added a pull request for this here if you want to try it out: https://github.com/microsoft/OmniParser/pull/222