tensorflow
profiler needs root privileges?
After following the (now out of date) guide to using the tensorboard profiler, I'm met with the following error in the profile "tab" (is there supposed to be a tab? I eventually found it in the dropdown menu).
Insufficient privilege to run libcupti (you need root permission).
So, uh, what gives? There's no mention of root privileges being required in the guide, nor in the README of this repository. Are we really expected to run a web service as root?
I was concidentally reading the docs for jax, and found information there that solved my problem. TLDR: load the nvidia kernel module with the NVreg_RestrictProfilingToAdminUsers=0 option as described here: https://developer.nvidia.com/nvidia-development-tools-solutions-err_nvgpuctrperm-permission-issue-performance-counters
To me, this seems like a fairly important bit of information to include in the README.
Thanks for figuring this out. We will add this instruction to the README.
On Wed, Oct 27, 2021 at 8:40 AM Graham Gower @.***> wrote:
I was concidentally reading the docs for jax, and found information there https://jax.readthedocs.io/en/latest/profiling.html#troubleshooting that solved my problem. TLDR: load the nvidia kernel module with the NVreg_RestrictProfilingToAdminUsers=0 option as described here: https://developer.nvidia.com/nvidia-development-tools-solutions-err_nvgpuctrperm-permission-issue-performance-counters
To me, this seems like a fairly important bit of information to include in the README.
— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/tensorflow/profiler/issues/363#issuecomment-953054129, or unsubscribe https://github.com/notifications/unsubscribe-auth/AE33L3KGLU23NSZYD4RUFS3UJATO7ANCNFSM5GLMKRAQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
