server icon indicating copy to clipboard operation
server copied to clipboard

Container Registry Service

Open esteininger opened this issue 1 year ago • 1 comments

There's a couple components here:

  • inference.containers build.sh -> create the containers and/or deploy to a package registry
  • docker-compose up should create all the services and run the build script

This should instantiate each of these containers, if

[
    {
        "name": "clip-vit-base-patch32",
        "dockerfile_path": "./containers/clip-vit-base-patch32/Dockerfile",
        "endpoint": "http://127.0.0.0:80", // can also be none
        "resources": [
            {
                "route": "/embed/image",
                "method": "POST",
                "input": {
                    "file": "bytes"
                },
                "output": {
                    "embedding": "list"
                }
            },
            {
                "route": "/embed/text",
                "method": "POST",
                "input": {
                    "text": "str"
                },
                "output": {
                    "embedding": "list"
                }
            }
        ]
    }
]

esteininger avatar Apr 25 '24 00:04 esteininger