Amit Arora
Amit Arora
Hi i am trying to get the custom marker set as described in https://developers.google.com/chart/interactive/docs/gallery/map#adding-multiple-marker-sets to work so that some points in my map use one marker icon while the rest...
I am able to connect to Amazon OpenSearch cluster that has a username and password and ingest embeddings into but when I do a `docsearch.similarity_search` it fails with a 401...
Here is a list of potential improvements to the [`bedrock_boto3_setup.ipynb`](https://github.com/aws-samples/amazon-bedrock-workshop/blob/main/00_Intro/bedrock_boto3_setup.ipynb) notebook. 1. There are a lot of errors and warning messages that get displayed while pip installing the packages. We...
# What does this PR do? Adds a recipe (`FMBench`) for benchmarking Llama models (including Llama3) on AWS platforms (SageMaker, Bedrock). `FMBench` is an open-source Python package for benchmarking foundation...
# What does this PR do? FMBench readme updates for Llama3 on Inf2 and config.yml cleanup Fixes # (issue) ## Feature/Issue validation/testing Please describe the tests that you ran to...
There is nothing in FMBench which prevents different experiments in the same config file to use different models, but the generated report is not architected in the same way i.e....
It would be interesting to see the effect of scaling to multiple instances behind the same endpoint. How does inference latency change as endpoints start to scale (automatically, we could...
FLAN-T5 XL is still used by multiple customers so a comparison of this model across g5.xlarge and g5.2xlarge instances would be very useful and so a config file for this...
The tool can easily allow to compare performance across regions if we allowed region to be a part of the per experiment config.
Visualizations are powerful, so the message that it is the full serving stack that results in a particular performance benchmark can get lost unless explicitly called out. It is possible...