aaw
aaw copied to clipboard
seldon core: testing autoscaling functionality with benchmark
Seldon Core supports autoscaling doc and the functionality would need to be tested, benchmarke. e.g. similar in approach to https://arxiv.org/abs/2202.11243, albeit we don't have smart batching.