Ryan Olson
Ryan Olson
Currently _db is a class variable which can be set by set_db. Would it be better if this was an instance variable that could be inherited from the class value?...
DLPack’s vision of a common in-memory tensor format that spans device and memory types is fantastic. However, in its form, there is no upgrade path for adding new items to...
Extend Dockerfile to install both external dependences and trtlab to the local container file system in `/usr/local` The current behavior does not install and the trtlab and the dependences are...
We don't do a good job of checking gRPC deadlines as outlined in this blog post: https://grpc.io/blog/deadlines
adding cpuaff as an external bazel depdendency
Create an IServer interface which is a friend to the IExecutor interface. This will allow us to protect the currently public methods and only expose those methods `Server` objects. ```...
Possible Metrics and Status - [X] batches / second (counter/rate) - [ ] inference / second (counter/rate) - [X] gpu power (gauge) - [X] queue depth (gauge) - [X] request...
I believe there is a race condition in `coro::ring_buffer` between the `await_ready` and `await_suspend` methods. The lock is released in `await_ready` and re-acquired in `await_suspend`. When a reader and a...