exo does not start on Jetson Orin AGX

[CNA79]

exo does not start on Jetson Orin AGX 64GB with Ubuntu 22.04 LTS and highly appreciate a possible solution

Error message below

~/exo$ exo Traceback (most recent call last): File "/home/cosmin/.local/bin/exo", line 33, in sys.exit(load_entry_point('exo', 'console_scripts', 'exo')()) File "/home/cosmin/.local/bin/exo", line 25, in importlib_load_entry_point return next(matches).load() File "/usr/lib/python3.10/importlib/metadata/init.py", line 171, in load module = import_module(match.group('module')) File "/usr/lib/python3.10/importlib/init.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "", line 1050, in _gcd_import File "", line 1027, in _find_and_load File "", line 1006, in _find_and_load_unlocked File "", line 688, in _load_unlocked File "", line 883, in exec_module File "", line 241, in _call_with_frames_removed File "/home/cosmin/exo/exo/main.py", line 21, in from exo.networking.grpc.grpc_server import GRPCServer File "/home/cosmin/exo/exo/networking/grpc/grpc_server.py", line 12, in import mlx.core as mx ModuleNotFoundError: No module named 'mlx'

[Nurb4000]

Same problem for me today, but i think there was a workaround i saw previously. Its doing thsi with any ARM board that isnt an Apple. ( since mlx is for apple.. )

[tolkienist42]

Same issue for me on a Google pixel, anyone know a solution?

Edit:

Is it possible to run it like this to force it to note use mlx?

exo --inference-engine tinygrad

I'm at work at the moment so can't try it out.

[deftdawg]

This should be fixed by: https://github.com/exo-explore/exo/commit/6737e36e238ebb9b72f497b642f1e813f0416a80 ... prior to that mlx was being imported on non-apple silicon platforms breaking everything.

[tolkienist42]

This should be fixed by: 6737e36 ... prior to that mlx was being imported on non-apple silicon platforms breaking everything.

Ok so I am a complete newbie, how can I try this out to see if it works for me? What do I need to enter at the command line to run the modified code?

[deftdawg]

This should be fixed by: 6737e36 ... prior to that mlx was being imported on non-apple silicon platforms breaking everything.

Ok so I am a complete newbie, how can I try this out to see if it works for me? What do I need to enter at the command line to run the modified code?

You need to build from source or bug @AlexCheema to cut a new release, the last release tag 0.0.8 is from immediately before the fixes I tagged that un-break things on non-apple silicon devices.

[Nurb4000]

Is it possible to run it like this to force it to note use mlx?

exo --inference-engine tinygrad

No, i tried various combinations. I guess the only fix is the new code.

( and speaking of cli parameters, is that listed anywhere, short of reading the code? Or will --help do it, with the fix so it wont fail on start? )

[CNA79]

I have reinstalled the Jetson and as well the exo container complete now the error I get is that exo command not found. the system is Ubuntu 22.04.

I am just curious if I am trying something that is not really meant to work by installing and trying to run exo on the Ubuntu?

[Nurb4000]

Dont forget to start the virtual env

[CNA79]

Dont forget to start the virtual env

@Nurb4000 for a newbie how?

[CNA79]

I have reinstalled the Jetson and as well the exo container complete now the error I get is that exo command not found. the system is Ubuntu 22.04.

I am just curious if I am trying something that is not really meant to work by installing and trying to run exo on the Ubuntu?

The issue was the SSL missing in python 3.12

[Fahad16301139]

Please I need a littile bit of help. I am trying to run exo on WSL as well. when i run just the exo command it shows me available commands. but when I try to run the command "exo run llama-3.2-3b" I get "error: unknown command "run" for "exo"

Did you mean this? runstatus" error. Please help.

[6thday]

I have reinstalled the Jetson and as well the exo container complete now the error I get is that exo command not found. the system is Ubuntu 22.04. I am just curious if I am trying something that is not really meant to work by installing and trying to run exo on the Ubuntu?

The issue was the SSL missing in python 3.12

I have the same issue, exo command not found... any solution? thx)

[Evanev7]

Platform support has shrunk with 1.0 but we plan to support this in future. Please reopen if this is still an issue for you!