DavidLangworthy

predict fails and seldondeployment missing .status

13

@cliveseldon Calling predict on a deployment that returned sucess fails with a connection error. Attempting to debug this reveals that .status is missing from seldondeployment. Sugestions for how to debug...

Shared weights whenever multiple instances

10

Also CPU

Determine what outputs are needed by the requests in the batch and only calculate those (TF backend contains a representative implementation).