Niklas Hansson

chore: add missing asserts and remove unused variables in experiment_api_test.go

4

**Description of your changes:** **Checklist:** - [ ] The title for your pull request (PR) should follow our title convention. [Learn more about the pull request title convention used in...

What is the difference between `Plattform` and `Backend`

2

**Description** After reading about the [triton sever](https://github.com/triton-inference-server/backend#backends) I don't fully understand the difference between the `backend` and `platform` parameter. They seem to represent the same thing but use slightly different...

Question: trtexec hardware during compilation vs production?

1

I am using `tensorRT` together with [Triton](https://github.com/triton-inference-server/server). Inorder to avoid a long runing start up time when we deploy to edge nodes I would like to do the tensorRT conversion...

feat: Fix generation, update go structure, add go module

7

I tried out the go grpc client but found some issues, let me know if you want me to break it up further. This pr aims to do the following...

How does share memory speed up inference?

6

**Description** The [docs](https://docs.nvidia.com/deeplearning/triton-inference-server/user-guide/docs/protocol/extension_shared_memory.html) state that: `Using shared memory instead of sending the tensor data over the GRPC or REST interface can provide significant performance improvement for some use cases.` But...

Allow for having a reassign backoff.

2

# Description We have seen on our hatchet deployment that reassignment of hatchet steps is super fast. This seems to exhaust the nbr of max retries(SERVER_MAX_INTERNAL_RETRY_COUNT) during a redeploy of...

## Description The block following TILE_X = max(1, 1024 // TILE_Y) seems unnecessary. Since integer division ensures (1024 // Y) * Y

## Description The link in the Pull Request template seems to be incorrect, update to the correct one. ## Checklist - [x] I am familiar with the [Contributing Guidelines](https://github.com/cutile-python/blob/HEAD/CONTRIBUTING.md). -...

WIP: op is used instead of cur_op

1

## Description This should not have any changes on the implementation other than cleaning up a potential typo and making the code more consistent. ## Checklist - [x] I am...

Expose ct.abs in order to resolve https://github.com/NVIDIA/cutile-python/issues/30

3

## Description ## Checklist - [x] I am familiar with the [Contributing Guidelines](https://github.com/NVIDIA/cutile-python/blob/main/CONTRIBUTING.md). - [x] New or existing tests cover these changes. - [x] The documentation is up to date...