cursor icon indicating copy to clipboard operation
cursor copied to clipboard

Add support for Amazon Bedrock from AWS

Open dgallitelli opened this issue 2 years ago • 221 comments

Is your feature request related to a problem? Please describe. Currently, only OpenAI models are supported by Cursor. I would like to use AWS models from Amazon Bedrock, such as Amazon Titan or Anthropic Claude or Meta Llama-2.

Describe the solution you'd like In the Cursor Settings, I would like to be able to connect to my AWS account, and configure my Bedrock model.

Additional context

Why only OpenAI? :( image

dgallitelli avatar Feb 21 '24 09:02 dgallitelli

I would like to boost this. I would greatly appreciate this feature.

ibrahimkettaneh avatar Mar 09 '24 09:03 ibrahimkettaneh

This would help me enormously - specifically Claude 3 Sonnet via Bedrock (and later Opus).

forkfork avatar Mar 26 '24 02:03 forkfork

+1

Please consider bedrock support now that Opus is supported. It supports people that use company AWS infrastructure for everything.

stirredo avatar Apr 17 '24 09:04 stirredo

+1 Would be very appreciate if cursor can support Claude 3 via Amazon Bedrock.

arvehisa avatar Apr 17 '24 10:04 arvehisa

+1

josegtmonteiro avatar May 28 '24 00:05 josegtmonteiro

+1 should be fairly straightforward since Anthropic API is already integrated

yeralin avatar May 29 '24 14:05 yeralin

+1 As shown in the following URL, the Anthropic SDK is able to request Claude Model through Amazon Bedrock. https://docs.anthropic.com/en/api/claude-on-amazon-bedrock

from anthropic import AnthropicBedrock

client = AnthropicBedrock(
    # Authenticate by either providing the keys below or use the default AWS credential providers, such as
    # using ~/.aws/credentials or the "AWS_SECRET_ACCESS_KEY" and "AWS_ACCESS_KEY_ID" environment variables.
    aws_access_key="<access key>",
    aws_secret_key="<secret key>",
    # Temporary credentials can be used with aws_session_token.
    # Read more at https://docs.aws.amazon.com/IAM/latest/UserGuide/id_credentials_temp.html.
    aws_session_token="<session_token>",
    # aws_region changes the aws region to which the request is made. By default, we read AWS_REGION,
    # and if that's not present, we default to us-east-1. Note that we do not read ~/.aws/config for the region.
    aws_region="us-west-2",
)

message = client.messages.create(
    model="anthropic.claude-3-5-sonnet-20240620-v1:0",
    max_tokens=256,
    messages=[{"role": "user", "content": "Hello, world"}]
)
print(message.content)

I would greatly appreciate it if you could support calling the Claude Model using AWS IAM Keys.

Sugi275 avatar Jun 21 '24 12:06 Sugi275

+1 to this! would really appreciate bedrock support.

wilsonhou avatar Jul 13 '24 00:07 wilsonhou

+1 could be really useful to have this!

wooferclaw avatar Jul 18 '24 10:07 wooferclaw

+1 would be useful for employees since they are only allowed to share code artifacts with Bedrock's internal models.

tonyrusignuolo avatar Jul 21 '24 01:07 tonyrusignuolo

@tonyrusignuolo

+1 would be useful for employees since they are only allowed to share code artifacts with Bedrock's internal models.

I found https://continue.dev a good replacement for Cursor that works with Bedrock out of the box.

yeralin avatar Jul 21 '24 16:07 yeralin

Disappointing that this still isn't implemented. May have to test out continue.dev in that case.

gwailoTr0n5000 avatar Jul 21 '24 18:07 gwailoTr0n5000

Much required with Sonnet gaining popularity

KaliCharan-V avatar Aug 01 '24 19:08 KaliCharan-V

So GitHub Models came out yesterday. This is their inference platform similar to Amazon Bedrock. Google has Model Garden. Please support all of these. But yes, yes, yes please do add support for Amazon Bedrock first ;)

metaskills avatar Aug 04 '24 21:08 metaskills

Much needed

vinodvarma24 avatar Aug 13 '24 17:08 vinodvarma24

I would also like to bump this. Working in a corporate environment where everything must go through our AWS LZ. This would open up Cursor for corporate scenarios where strict backend control is required.

refactorthis avatar Aug 15 '24 11:08 refactorthis

+1

jubinpyli avatar Aug 22 '24 16:08 jubinpyli

subscribed +1

binarycrayon avatar Aug 23 '24 19:08 binarycrayon

+1

As a workaround I suggest using this repository to work as a proxy: https://github.com/aws-samples/bedrock-access-gateway

Then in cursor override the OpenAI base URL and set the custom API key.

l4time avatar Aug 23 '24 20:08 l4time

+1

As a workaround I suggest using this repository to work as a proxy: aws-samples/bedrock-access-gateway

Then in cursor override the OpenAI base URL and set the custom API key.

@l4time I tried following your workaround and I've verified that the proxy is working.

However, I wasn't able to use Cursor's chat function - it says that Seems like we are having an issue with your API key - please confirm the base URL is publicly accessible and the API key is correct in the settings. If this persists, please email us at [email protected]..

I wonder if you figured out a way around this

kingstarfly avatar Aug 24 '24 07:08 kingstarfly

+1

I would also like to bump this. Working in a corporate environment where everything must go through our AWS LZ. This would open up Cursor for corporate scenarios where strict backend control is required.

adityapapu avatar Aug 24 '24 12:08 adityapapu

+1

Thandden avatar Aug 25 '24 01:08 Thandden

+1

dzhou1221 avatar Aug 25 '24 19:08 dzhou1221

+1

Eternaux avatar Aug 25 '24 20:08 Eternaux

+1

martin-nginio avatar Aug 25 '24 23:08 martin-nginio

+1

ron137 avatar Aug 26 '24 15:08 ron137

+1

orangewise avatar Aug 27 '24 06:08 orangewise

+1

JurgenLangbroek avatar Aug 28 '24 07:08 JurgenLangbroek

+1

davidshtian avatar Aug 29 '24 03:08 davidshtian

Really lookin fordward to this feature. It would be huge

juan-abia avatar Aug 29 '24 18:08 juan-abia

Is cursor going to add this?

kevin-longe-unmind avatar Aug 31 '24 17:08 kevin-longe-unmind