tiny
tiny copied to clipboard
mlcommons
MLPerf™ Tiny is an ML benchmark suite for extremely low-power systems such as microcontrollers
When running the get_datasets.sh, the following error message is printed: ``` % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100...
Hello, I am interested in running the image classification model to benchmark our accelerator and, currently, my environment is in pytorch therefore, I had a look at your experimental model...
I would like to evaluate the [pretrained MobileNet model](https://github.com/mlcommons/tiny/blob/master/benchmark/training/visual_wake_words/convert_vww.py) on the preprocessed COCO2014 **test set**, but I am not able to find this preprcessed test set anywhere in the repo....
Hi, For microcontrollers with limited memory, we can optimize memory usage by directly passing `gp_buff` to inference machine instead of copying the data to a separate memory. For some microcontrollers...
The training script defines both BATCH_SIZE and batch_size but only uses BATCH_SIZE. I suggest we remove the unused batch_size to avoid confusion. https://github.com/mlcommons/tiny/blob/3bca1a3adc7d9ec5186c0ff376715f2d3b19f382/benchmark/training/visual_wake_words/train_vww.py#L19 https://github.com/mlcommons/tiny/blob/3bca1a3adc7d9ec5186c0ff376715f2d3b19f382/benchmark/training/visual_wake_words/train_vww.py#L33
Is there a comprehensive changelog for the versions? May I compare results achieved using v0.7 compare with the reference results proposed by Harvard in v0.5?
I am trying to modify the benchmark training code to create a custom model for person detection. Just to check for sanity, I was trying to see whether I can...
Hi all, I am having problems running the `00_train.py` script in the anomaly_detection benchmark, I am unsure what the cause is as regardless of the batch size I use the...
I have used Tensorflow optimization toolkit to prune the benchmark anamoly_detection. The procedure I have followed is same as shown in the below link. https://www.tensorflow.org/model_optimization/guide/combine/pqat_example The output during training is...
Hi, Is there any way to measure performance and accuracy on customized dataset (other than ad, vww, kws, ic) ? I have tried setting EE_MODEL_VERSION to my own dataset and...
