Lucas Melo
Lucas Melo
Yes, please! Can we please ensure new versions of containers get pushed to Docker Hub with both a vX.Y release and the latest labels. That would allow us to pass...
Yes, this has been resolved, versioning is now being used.
Can we rename this Issue to **"ChatQnA - GCP single node via Terraform"** ? @mkbhanda per email. We will then create new issues for other examples, like CodeGen. FYI I...
> @lucasmelogithub Where are we at with this issue? It's built. Both ChatQnA and CodeGen using 5th Gen Xeon in GCP. I will create PR to update the Xeon README.md...
PR created https://github.com/opea-project/GenAIExamples/pull/970
Supporting Falcon-11B would be great.
> TGI-Gaudi and vllm supports Falcon 40B and Flacon 7B. We will validate Falcon-11B Great, thanks for the update.
Question, Models are set with environment variables via **set_env.sh** https://github.com/opea-project/GenAIExamples/blob/main/ChatQnA/docker_compose/intel/cpu/xeon/set_env.sh What is our strategy? Create multiple set_env.sh. set_env_falcon11B.sh? Or just update the README.md with instructions? In the Terraform Module we...
I'm also open to a call with OPEA contributors if easier to brainstorm. I think we need to discuss at least: - How to handle multiple models. Multiple set_env.sh vs....
> @lucasmelogithub let us not proliferate set_env.sh(es) with only model_id different :-) That set_env.sh really is a file a user is expected to edit, with proxy, ip address, model id...