bottlerocket icon indicating copy to clipboard operation
bottlerocket copied to clipboard

Support for SOCI containerd plugin

Open jpmcb opened this issue 2 years ago • 1 comments

What I'd like:

It'd be very cool if Bottlerocket had support for the SOCI snapshotter:

SOCI Snapshotter is a containerd snapshotter plugin. It enables standard OCI images to be lazily loaded without requiring a build-time conversion step

https://github.com/awslabs/soci-snapshotter

Lazy loading images would be a huge benefit for container startup times and I found this stat very interesting:

Using a representative suite of images, Harter et al FAST '16 found that image download accounts for 76% of container startup time, but on average only 6.4% of the fetched data is actually needed for the container to start doing useful work.

Since we already have containerd, we would just need to build and drop in the soci plugin into the containerd location and expose necessary API settings.

There has already been some discussion a few months ago about how to include SOCI: https://github.com/bottlerocket-os/bottlerocket/issues/2788 and https://github.com/bottlerocket-os/bottlerocket/issues/2408#issuecomment-1250195374

Any alternatives you've considered:

N/a - are there other lazy loading mechanisms out there? Might also be worth investigating other solutions.

jpmcb avatar Apr 13 '23 22:04 jpmcb

Any ETA on this one? We expect some boost in boot time for our images that are 3+GB in size.

sanjinp avatar Nov 24 '23 13:11 sanjinp