A Caserman

Not enough free memory to build TRT engine

2

Hi, I want to check if anyone has been able to complete the pre-requisites and run this reference app on GTX 4070 Ti? I get stuck on building the TRT...

Unable to build Llama-2-13B-Chat on RTX 4070Ti

2

### System Info - GPU (Nvidia GeForce RTX 4070 Ti) - CPU 13th Gen Intel(R) Core(TM) i5-13600KF - 32 GB RAM - 1TB SSD - OS Windows 11 Package versions:...

MemoryError: Unable to allocate sufficient memory

5

### Issue Description I used a Random Survival Forest with 10 estimators and a max depth of 25 on approximately 1800 data samples. The full dataset otherwise contains approximately 200,000...