Does ONNX models used in this project supports CUDA only( crashes on CPU)
HI, I'm trying to run your models with CPU, the application crashes while loading the model. To verify if these ONNX models could be loaded by CPU, I created a simple test app like this.
using Microsoft.ML.OnnxRuntime;
using Onnx;
SessionOptions options = new();
options.AppendExecutionProvider_CPU();
InferenceSession session = new InferenceSession(@"D:\Models\RWKV-4-Raven-3B-v11-Eng49-Chn49-Jpn1-Other1-20230429-ctx4096_32_2560_16.onnx", options);
Console.WriteLine("Done");
Console.ReadLine();
the application crashes with following exception
System.AccessViolationException: 'Attempted to read or write protected memory. This is often an indication that other memory is corrupt.'
Could you please kindly suggest if any thing I did wrong or the model bin file is designed for CUDA only?
Which onnx nuget package are you using? The CPU does not need to install cuda when using this'Microsoft.ML.OnnxRuntime '
Microsoft.ML.OnnxRuntime v1.14.1
This is not clear. Perhaps the configuration environment is different somewhere. 😂