Sungsoon Cho
Sungsoon Cho
0. It's good that TF serving can accept remotely hosted models. However, if it's not documented, I don't think we can rely on the assumption that remote models would continue...
I'm not sure this slowness really arises from the TF serving itself. From the description of the test results, it sounds like the real bottleneck is preparation and transportation of...
The model servers are supposed to be built within a docker rather than native OS environments. Please try prepending the bazel test command with tools/run_in_docker.sh. ``` tools/run_in_docker.sh bazel test --build_tests_only...