GenAIExamples icon indicating copy to clipboard operation
GenAIExamples copied to clipboard
Published 2 months ago • verified publisher icon opea-project

[Feature] Intel Tiber AI Cloud - Terraform - CodeGen single node using docker compose

Open lucasmelogithub opened this issue 1 year ago • 13 comments

Priority

Undecided

OS type

Ubuntu

Hardware type

Xeon-EMR

Running nodes

Single Node

Description

Develop Intel Optimized Cloud Module for Terraform and Ansible to automate the deployment.

lucasmelogithub avatar Oct 16 '24 17:10 lucasmelogithub

Please assign to @lucasmelogithub

lucasmelogithub avatar Oct 16 '24 17:10 lucasmelogithub

@lucasmelogithub
For github issue 962-969, will you submit PR to resolve these features?

xiguiw avatar Oct 22 '24 01:10 xiguiw

Possibly or I'll help someone in our team do it. Initially, I'm capturing the need for these with the Issues. Some are already in development.

lucasmelogithub avatar Oct 22 '24 13:10 lucasmelogithub

@lucasmelogithub
Got it. Thank you for your contribution!

xiguiw avatar Oct 25 '24 08:10 xiguiw

Possibly or I'll help someone in our team do it. Initially, I'm capturing the need for these with the Issues. Some are already in development.

@lucasmelogithub What's the status of these issue "962-969"?

xiguiw avatar Mar 05 '25 02:03 xiguiw

Rohit Kulkarni from Intel AI Cloud is finishing development on this. I sent him the issue link.

lucasmelogithub avatar Mar 05 '25 14:03 lucasmelogithub

Team my observations are as below:

  • Deployment of VMs in Intel Cloud is working
  • All docker containers for codegen are getting deployed
  • UI is up and running
  • But when I am trying to use the application, it does not seem to respond to input prompts
  • Please see attached image:

Image

Rohit-Intel-Cloud avatar Mar 05 '25 17:03 Rohit-Intel-Cloud

Hi @lucasmelogithub @Rohit-Intel-Cloud thank you a lot for addressing the problem. is the problem shown when run ChatQnA? As i understand, the issue is the UI don't response the input prompt, maybe related ITAC's env (network, security, etc)

I add @louie-tsai @alexsin368 into the loop, they should run the OPEA on ITAC sucessfully. Remind: the ITAC guide: https://opea-project.github.io/latest/getting-started/README.html

Hi Louie, Alex, please help the issue here. thank you!

yinghu5 avatar Mar 25 '25 08:03 yinghu5

Hi @Rohit-Intel-Cloud , had you resolved the problem? Just remind, share the update here. thanks

yinghu5 avatar Apr 16 '25 07:04 yinghu5

@Rohit-Intel-Cloud Any updates? @yinghu5 can we please assign this to @Rohit-Intel-Cloud instead?

lucasmelogithub avatar Apr 16 '25 14:04 lucasmelogithub

Hi @lucasmelogithub @Rohit-Intel-Cloud thank you a lot for addressing the problem. is the problem shown when run ChatQnA? As i understand, the issue is the UI don't response the input prompt, maybe related ITAC's env (network, security, etc)

I add @louie-tsai @alexsin368 into the loop, they should run the OPEA on ITAC sucessfully. Remind: the ITAC guide: https://opea-project.github.io/latest/getting-started/README.html

Hi Louie, Alex, please help the issue here. thank you!

@alexsin368 alex is the author. will let him help on the issue.

louie-tsai avatar Apr 17 '25 16:04 louie-tsai

The issue here is not related to the Getting Started Guide for ITAC; it's the CodeGen UI is not responding when given an input. @Rohit-Intel-Cloud this is definitely related to networking. On ITAC, you can try adding certain ports to your load balancer:

UI: 5173 CodeGen megaservice: 7778

alexsin368 avatar Apr 17 '25 16:04 alexsin368

Hi @Rohit-Intel-Cloud,
Just remind and see if there is any updates, thank you!

yinghu5 avatar Jun 11 '25 07:06 yinghu5