wil70
wil70
I also tried with MLnet --version: 16.13.9+3066041f1761935763bdd267a9bcbb64cb3ec543 and I got the same Exception as above ---- Sometimes, I get a different OutOfMemoryException stack trace: ``` Start Training start nni training...
Related issue on c# instead of CLI https://github.com/dotnet/machinelearning/issues/6297
Any ETA for a fix? TY!
Hi @tarekgh , All the fields are "double" except 1 of the fields is a "string" which has 3 characters maximum ie. DOO,-0.85748191341578595,-1.0763921379331161,-3,-1,... UUU,-1.153315959380012,-1.2316112856397838,0,1,... ... I hope this help TY!
Thanks @tarekgh I would expect ML.NET CLI to stream data via a IDataView Each of my row is only ~4000 floats + 3 letter string, I wouldn't expect the memory...
More or less related issues: - https://github.com/dotnet/machinelearning/issues/6309 - https://github.com/dotnet/machinelearning/issues/6297 - https://github.com/dotnet/machinelearning/issues/6309
Thanks @tarekgh I will write a little program to mimic the data, it is basically 4209 columns with random data: the first column is a string of 3 character, all...
Thanks @tarekgh Here is a sample of 24 random lines (500KB) of the 330GB input file. The best would be to add random data of the same nature/type in a...
Thanks @tarekgh ! How did you figure this out? I have 64GB RAM on the machine and 34GB on Virtual memory, I will increase it and try - TY! It...