dotnet
Cuda v11.8 support for image classification problems?
Current implementations for Image classification, following MS guidance restricts us to using Cuda SDK v10.1. This in turn limits the available Nvidia cards that can be used. Going to a production install we need to use cards supported/supplied by IT vendors, DELL, etc. These tend to be newer cards that are beyond the Turing architecture: Ampere, Ada Lovelace, etc.
We would like for the Cuda SDK support to be raised to v11.8 to take advantage of a wider range of supported cards.
Alternatives at present are code fixes to block inference from happening before the models are loaded and available, this can be anywhere from 1 - 20 mins for a basic image classification model. Older cards, my laptop has a lowly T500, are loading in 10's of seconds. As a real time implementation this is a lot of missed classifications.
If there is no intention to update Cuda support please do let us know as we can then look at alternatives.
