Golan Levy

@Jooho Is there any new information regarding that question? We would also like to use custom metrics that are not related to cpu or memory

@seankst see if that helps https://github.com/kserve/modelmesh/issues/82#issuecomment-1582028690

Hi @nithinraok , We are very happy to hear that you find Gecko useful. Unfortunately, we are not maintaining this repo anymore.

You can set its value on-the-fly by changing the value of `.../config/scaleup_rpm_threshold` in the kv-store (ETCD) or change the default value by setting the env var `MM_SCALEUP_RPM_THRESHOLD` on the runtime-adapter.

Hi @dsgibbons Please see my reply here https://github.com/kserve/modelmesh/issues/82#issuecomment-1582028690, it might help you with the documentation on how modelmesh decides to load/unload models. Maybe the `DEFAULT_MODELSIZE` property can help you, especially...