python backend doesnt work with newer claude 3 model

[TimeTravelerFromNow]

Followed the set up guide, (I needed python >3.10)

I could not find where to request access in my aws account for anthropic.claude-v2 in bedrock. I assume this version of the claude model is no longer offered?

So I tried with changing the endpoint from

  - const endpoint = "/foundation-models/model/chat/anthropic.claude-v2/invoke";
  + const endpoint = "/foundation-models/model/chat/anthropic.claude-3-5-sonnet-20241022-v2:0/invoke";

after recieving access to this model version. The error message from a chat run in the python backend was

AWS_PROFILE=sandbox python main.py
INFO:     Started server process [82681]
INFO:     Waiting for application startup.
INFO:     Application startup complete.
INFO:     Uvicorn running on http://0.0.0.0:55500 (Press CTRL+C to quit)
Error: An error occurred (ValidationException) when calling the InvokeModel operation: Invocation of model ID anthropic.claude-3-5-sonnet-20241022-v2:0 with on-demand throughput isn’t supported. Retry your request with the ID or ARN of an inference profile that contains this model.
INFO:     127.0.0.1:57771 - "POST /foundation-models/model/chat/anthropic.claude-3-5-sonnet-20241022-v2%3A0/invoke HTTP/1.1" 500 Internal Server Error