autogen icon indicating copy to clipboard operation
autogen copied to clipboard

[Feature Request]: Support for AWS Bedrock models

Open Hk669 opened this issue 1 year ago • 4 comments

Is your feature request related to a problem? Please describe.

The community is heading to using AWS Bedrock models, making it simpler for many organizations to scale and maintain their applications.

Describe the solution you'd like

making a separate client for the AWS Bedrock models would be a better solution imo.

Additional context

No response

Hk669 avatar Jul 25 '24 19:07 Hk669

I think it makes sense, does aws bedrock provide official SDK for connecting to hosted model?

LittleLittleCloud avatar Jul 25 '24 19:07 LittleLittleCloud

Looking at their website, yes it has a specific API and model compatibility: Converse API

Inference example

marklysze avatar Jul 25 '24 20:07 marklysze

Also add this to AutoGen.Net project.

LittleLittleCloud avatar Jul 25 '24 22:07 LittleLittleCloud

Also add this to AutoGen.Net project.

Sure.

Hk669 avatar Jul 26 '24 03:07 Hk669

Is there a plan to integrate AWS Bedrock API in Autogen 0.4? If not, where can I find integration solutions for custom development?

2284730142 avatar Jan 20 '25 01:01 2284730142

Is there a plan to integrate AWS Bedrock API in Autogen 0.4? If not, where can I find integration solutions for custom development?

With the addition of Semantic Kernel Model Client Adapter in the next release, this can be done through Semantic Kernel.

Adapter: #4851

Semantic Kernel AWS Bedrock integration. https://devblogs.microsoft.com/semantic-kernel/introducing-aws-bedrock-with-semantic-kernel/

You can also create a community package for the model client or other deeper integration. See existing community packages: https://microsoft.github.io/autogen/stable/user-guide/extensions-user-guide/index.html

ekzhu avatar Jan 20 '25 02:01 ekzhu