TorchSharp icon indicating copy to clipboard operation
TorchSharp copied to clipboard

ARM64 support

Open ProKn1fe opened this issue 2 years ago • 12 comments

Any plans to support arm64 devices? Like Radxa Rock-5B or OrangePI 5. It in any cases throw this.

Unhandled exception. System.IO.FileNotFoundException: Could not load file or assembly 'TorchSharp, Version=0.98.1.0, Culture=neutral, PublicKeyToken=67b0e5e1da516a1c'. The system cannot find the file specified.

ProKn1fe avatar Mar 06 '23 16:03 ProKn1fe

No current plans for those devices, but contributions are always welcomed -- the Mac/ARM64 is being contributed by folks outside the Microsoft team.

NiklasGustafsson avatar Mar 06 '23 19:03 NiklasGustafsson

So basically what need to make buildable on arm to run?

ProKn1fe avatar Mar 19 '23 13:03 ProKn1fe

https://github.com/pytorch/pytorch/issues/13130

As long as the PyTorch community is considering Arm64 an open issue, it will not be VERY VERY trivial for TorchSharp

GeorgeS2019 avatar Mar 19 '23 16:03 GeorgeS2019

Seems they already support arm targets as nvidia jetson https://github.com/pytorch/pytorch#nvidia-jetson-platforms

ProKn1fe avatar Mar 19 '23 19:03 ProKn1fe

https://pytorch.org/get-started/locally/

This is where official ARM64 support is needed before TorchSharp (I assume) will remotely consider ARM64 image

GeorgeS2019 avatar Mar 20 '23 05:03 GeorgeS2019

So basically what need to make buildable on arm to run?

ARM64 on Windows or Linux?

Theoretically, we should just need the ARM64 libtorch binaries, and then a setup to run tests in Azure Pipelines for release purposes. It should be possible to bundle the CPU support in the same NuGet as the other platforms, but I haven't thought through how it would impact the CUDA packages.

NiklasGustafsson avatar Mar 20 '23 16:03 NiklasGustafsson

ARM64 on Windows or Linux?

Linux

ProKn1fe avatar Mar 20 '23 17:03 ProKn1fe

@NiklasGustafsson Make more sense with Arm64 on Windows.

image

GeorgeS2019 avatar Mar 20 '23 22:03 GeorgeS2019

Builds on ARM64 are currently not working. Getting the following error: Visual Studio 2015, 2017 or 2019 required

Visual Studio is currently not available for ARM64. Visual Studio 2022 v17.4+ is supported on ARM64.

So maybe we should consider this possibility in the build scripts.

MovGP0 avatar Oct 27 '24 19:10 MovGP0

Well, there's no official distribution of libtorch for Windows / ARM64 (unless the team working on it has failed to let me know), so I wouldn't expect you to get much farther, anyway.

NiklasGustafsson avatar Oct 28 '24 14:10 NiklasGustafsson

any updates on this?

p3root avatar Nov 20 '24 14:11 p3root