server icon indicating copy to clipboard operation
server copied to clipboard

How to access the triton inference server from outside of the k8s cluster through ingressroutes?

Open zengqingfu1442 opened this issue 2 years ago • 1 comments

Since the ingressroutes(https://github.com/triton-inference-server/server/blob/main/deploy/k8s-onprem/templates/ingressroute.yaml) has been deployed as LB to balance requests across all triton pods. How can i access the triton inference server api)http or grpc or in-process-all) through ingressroutes? Should i install traefik ingress controller and then install an ingress?

zengqingfu1442 avatar Apr 07 '24 11:04 zengqingfu1442

I can use ingress-nginx as ingress controller and then create an ingress to access triton http/grpc api. This needs to add a dns cname map.

zengqingfu1442 avatar Apr 07 '24 11:04 zengqingfu1442