server
server copied to clipboard
Container Registry Service
There's a couple components here:
-
inference.containersbuild.sh -> create the containers and/or deploy to a package registry -
docker-compose upshould create all the services and run the build script
This should instantiate each of these containers, if
[
{
"name": "clip-vit-base-patch32",
"dockerfile_path": "./containers/clip-vit-base-patch32/Dockerfile",
"endpoint": "http://127.0.0.0:80", // can also be none
"resources": [
{
"route": "/embed/image",
"method": "POST",
"input": {
"file": "bytes"
},
"output": {
"embedding": "list"
}
},
{
"route": "/embed/text",
"method": "POST",
"input": {
"text": "str"
},
"output": {
"embedding": "list"
}
}
]
}
]