pytorch
Adding model stats to aot_arm_compiler
- Adds GenericModelEvaluator, which gathers metrics applicable to all models
- Adds --evaluate option to enable gathering quantization metrics
Signed-off-by: Tom Allsop [email protected]
Change-Id: Ia9b591841f188870fa5e62d0568169498301393d
:link: Helpful Links
:test_tube: See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/5816
- :page_facing_up: Preview Python docs built from this PR
Note: Links to docs will display an error until the docs builds have been completed.
:x: 1 New Failure
As of commit c50af6daee87a27cccb440c8f1dd2f0e317eec12 with merge base da1d2ca3d647b744e516dd8b62c4e2aa0d884e0a (
NEW FAILURE - The following job has failed:
-
trunk / test-models-macos (cmake, emformer_join, xnnpack-quantization-delegation, macos-m1-stable, 90) / macos-job (gh)
Library not loaded: @rpath/liblz4.1.dylib
This comment was automatically generated by Dr. CI and updates every 15 minutes.
![pytorch-bot[bot] avatar](https://avatars.githubusercontent.com/in/40112?v=4 "Published by a pub.dev verified publisher"){kind=small}
@digantdesai has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.
Stamping to unblock, COMPRESSION_RATIO_TEST generation seems inefficient let's fix it in the future?
Also once matures move it out to backends/
Thanks Digant! Yep this could be more efficient, I'll make sure this is addressed in the next patch for this feature
rebase please? Landing a bunch of stuff tonight, so probably tomorrow? :)
@digantdesai has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.
@digantdesai has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.
@digantdesai merged this pull request in pytorch/executorch@e91357d0b426cc5cca64d71e1d8e053deacbb2be.