executorch icon indicating copy to clipboard operation
executorch copied to clipboard

Arm backend: Provide more debug info for numerical diff issues

Open freddan80 opened this issue 1 year ago • 1 comments

  • Save torch reference output
  • Print useful debug info
  • Print path to debug artifacts

freddan80 avatar May 14 '24 06:05 freddan80

:link: Helpful Links

:test_tube: See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/3596

Note: Links to docs will display an error until the docs builds have been completed.

:x: 1 New Failure

As of commit f059e477db0e8601d6484b95cf54ef4c015c8eb4 with merge base 400860066c9806af0361fdd634a7cd5bffb6cda0 (image):

NEW FAILURE - The following job has failed:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

pytorch-bot[bot] avatar May 14 '24 06:05 pytorch-bot[bot]

Failing tests not related to this PR. Ready to merge.

freddan80 avatar May 20 '24 06:05 freddan80

@digantdesai has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

facebook-github-bot avatar May 21 '24 14:05 facebook-github-bot

@freddan80 have you seen this?

https://pytorch.org/executorch/main/sdk-bundled-io.html

Instead of saving the reference output as a ad-hoc file, we provide utility function to make the testing easier.

mergennachin avatar May 21 '24 14:05 mergennachin

@digantdesai merged this pull request in pytorch/executorch@bc5ba991b2356e3f2983b1d2b29a2a3b90b54f89.

facebook-github-bot avatar May 21 '24 15:05 facebook-github-bot