aici icon indicating copy to clipboard operation
aici copied to clipboard

aicirt native Windows support

Open mmoskal opened this issue 2 years ago • 1 comments

  • [ ] shared memory/futex implementation
  • [ ] figure out what to do with fork() in aicirt

Docs:

  • https://shift.click/blog/futex-like-apis/
  • https://devblogs.microsoft.com/oldnewthing/20170601-00/?p=96265

WIP for shm only: win.patch

mmoskal avatar Jan 30 '24 00:01 mmoskal

It looks like fork() on Windows is going to be a major problem https://stackoverflow.com/questions/985281/what-is-the-closest-thing-windows-has-to-fork

A solution to that would be to create a separate process per request/sequence group and have threads inside of it for each sequence. When an AICI fork is required, we would create a new thread and memcpy() the Wasm module memory (I had this working once). It's quite non-trivial to implement though.

mmoskal avatar Feb 08 '24 19:02 mmoskal