Involvement with the CNCF Cloud Native AI Working Group

[raravena80]

Hello,

I'm one of the leads for the CNCF Cloud Native AI Working Group. It would be great if we can get some of the folks working on this initiative to help create a Cloud Native AI reference architecture.

You can join the conversation here: https://cloud-native.slack.com/archives/C05TYJE81SR

More info here: https://tag-runtime.cncf.io/wgs/cnaiwg/

Thanks! Ricardo

[hshen14]

This sounds interesting! Thanks @raravena80 for bringing up. @mkbhanda

[mkbhanda]

Thank you @raravena80 for raising this issue. We have enough in OPEA to get you launching some popular RAG pipelines such as ChatQnA, CodeGen in a Kubernetes environment. At one of the bi-weekly meetings we could have a quick overview of OPEA and a demo and would be delighted to have more folks join our effort!

Please follow the steps at https://github.com/opea-project/GenAIInfra/tree/main/microservices-connector to set up our microservice connector service and follow https://github.com/opea-project/GenAIInfra/blob/main/microservices-connector/usage_guide.md to set up the ChatQnA example application. One can change the model being used dynamically. The system also supports invoking external services such as an LLM hosted in AWS.

Looking forward to getting your feedback!

[arun-gupta]

@mkbhanda There are far too many detailed steps in Getting Started. How can we simplify this experience to a single command? Helm chart?

[mkbhanda]

Certainly. 👍🏿

---

From: Arun Gupta @.> Sent: Friday, June 21, 2024 1:05:41 PM To: opea-project/GenAIExamples @.> Cc: Bhandaru, Malini @.>; Mention @.> Subject: Re: [opea-project/GenAIExamples] Involvement with the CNCF Cloud Native AI Working Group (Issue #97)

@mkbhandahttps://github.com/mkbhanda There are far too many detailed steps in Getting Started. How can we simplify this experience to a single command? Helm chart?

— Reply to this email directly, view it on GitHubhttps://github.com/opea-project/GenAIExamples/issues/97#issuecomment-2183381371, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AAUTXVIR3FWE7PZCTDEGQI3ZISBRLAVCNFSM6AAAAABJJQT4H2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCOBTGM4DCMZXGE. You are receiving this because you were mentioned.Message ID: @.***>

[yinghu5]

Hi Ricardo, Arun, Malini, Thank you very much for the suggestion! As this thread has been open for a while and the related work and documentation are now ready, I will close the issue. Please feel free to reopen it if needed.

[raravena80]

sounds good. Thank you!