multithreaded-estimators icon indicating copy to clipboard operation
multithreaded-estimators copied to clipboard

Multithreading inference in Tensorflow Estimators. This is a ServiceNow Research project that was started at Element AI.

Results 3 multithreaded-estimators issues
Sort by recently updated
recently updated
newest added

@archydeberker Thank you very much for sharing this repository! I have looked into your code. As far as I understood each thread will have its session because of estimator is...

Hi, I am trying to put a tensorflow Estimator class into production. My features are in the form of this: { "input_ids": tf.constant( features[0].input_ids, shape=[1, 128], dtype=tf.int32), "input_mask": tf.constant( features[0].input_mask,...

Hi, Your multi-threading implementation give me a lot of inspirations for how to use the estimator API. After some dig-in, I found there is way to use only a simple...