spotswap Deprecate

This project is not in use at Mapbox anymore and not actively maintained. I think we should mark that in the readme and archive this repository.

@emilymcafee @rclark ?

Feb 06 '19 12:02 freenerd

:+1: Yep

Feb 06 '19 16:02 rclark

I'm curious what are you guys using these days?

Feb 06 '19 17:02 cristim

Hi @cristim -- to react to spot termination notifications we've moved to a system that listens to EC2 Spot Instance Interruption Warning events from CloudWatch Events, and a Lambda function that takes appropriate action.

We track metrics in CloudWatch for the number of instance type / availability zone combinations ( or "spot pools") that we are trying to run spot EC2s in, and compare that to the number of spot pools where EC2s are actually running. If that drops below a threshold, we launch on-demand instances to compensate.

Feb 06 '19 17:02 rclark

Is this code open source? I would like to have a look if it's public, maybe I can 'steal' some ideas from it.

I'm also running a project in this space that's using a different approach to achieve a similar result. You can check it out at https://github.com/AutoSpotting/AutoSpotting

Feb 06 '19 19:02 cristim

Sorry @cristim, the code is not open source. The concept though, really is no more complicated than I described above. Really the challenge is in determining appropriate thresholds for your system/application.

Feb 06 '19 21:02 rclark

Thanks!

Feb 07 '19 06:02 cristim