Zefeng Ni comments

Results 21 comments of


                                            Zefeng Ni

[Umbrella] Improve test coverages

I want to try it. @kerthcet

[OSPP] KEDA-based Serverless Elastic Scaling for llmaz

I'm interested in it too~ I am trying to contribute this repo and discuss for the 0-1 and 1-N scale proposal :)

support fuse resend API for live upgrade and failover

Hello, I would like to participate in this GLCC project. Could you please provide some detailed scenarios? Currently, my understanding of the project is that it requires persisting requests received...

support fuse resend API for live upgrade and failover

> Hi [@X1aoZEOuO](https://github.com/X1aoZEOuO) Plz take a look the new FUSE notify API for request resend [here](https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=760eac73f9f69aa28fcb3050b4946c2dcc656d12). Thank you, I will take a deep look at it.

fix: add ut for backend runtime.

/kind cleanup

fix: add ut for backend runtime.

Sorry, I've been preparing for my final exams these past two days. I'll fix it this weekend. @kerthcet

Replace the activator access address from Pod IP to a more solid solution

Thanks! I'll take in deep about it. cc @kerthcet

feat(controller): support serverless serving with keda support by k8s scale subresource.

/kind feature

feat(controller): support serverless serving with keda support by k8s scale subresource.

@pacoxu @googs1025 @carlory @kerthcet Hello all! Could you spare a few minutes to review my PRs when you have a chance? Other ref PRs: - https://github.com/InftyAI/llmaz/pull/499 - https://github.com/InftyAI/llmaz/pull/498

feat(controller): support serverless serving with keda support by k8s scale subresource.

@pacoxu @kenwoodjw Friendly ping, do you have some time to take a look at my PRs? Thanks a lot for your assistance!