tensorflow
I use tensorflow serving with TF-TRT, use fp16 serving but not get any improved!! It's not wokr ok on FP16?
Please go to Stack Overflow for help and support:
https://stackoverflow.com/questions/tagged/tensorflow-serving
If you open a GitHub issue, here is our policy:
- It must be a bug, a feature request, or a significant problem with documentation (for small docs fixes please send a PR instead).
- The form below must be filled out.
Here's why we have that policy: TensorFlow developers respond to issues. We want to focus on work that benefits the whole community, e.g., fixing bugs and adding features. Support only helps individuals. GitHub also notifies thousands of people when issues are filed. We want them to see you communicating an interesting problem, rather than being redirected to Stack Overflow.
Feature Request
If this is a feature request, please fill out the following form in full:
Describe the problem the feature is intended to solve
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
Describe the solution
A clear and concise description of what you want to happen.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.
Bug Report
If this is a bug report, please fill out the following form in full:
System information
- OS Platform and Distribution (e.g., Linux Ubuntu 16.04): No
- TensorFlow Serving installed from (source or binary): NO
- TensorFlow Serving version: latest-gpu docker file
Describe the problem
I use tensorflow serving with TF-TRT, use fp16 serving but not get any improved!! It's not wokr ok on FP16?
Exact Steps to Reproduce
Please include all steps necessary for someone to reproduce this issue on their own machine. If not, skip this section.
