Support scaling with Spot instances for cost saving

[kerthcet]

What would you like to be added:

See https://github.com/spotinst as an example, which means we should support multi cloud providers.

Why is this needed:

Cost saving for users.

Completion requirements:

This enhancement requires the following artifacts:

• [ ] Design doc
• [ ] API change
• [ ] Docs update

The artifacts should be linked in subsequent comments.

[kerthcet]

/kind question

[kerthcet]

Not only for cost saving, but also to proactive autoscaling just like https://github.com/kaito-project/kaito

/milestone v0.2.0

[kerthcet]

/kind feature /remove-kind question

[kerthcet]

cc @carlory

[carlory]

/assign

[kerthcet]

Any progress on this? We're approaching the deadline, end of this monty clearly.

[carlory]

It was blocked by the limitation of the aws account. And aws team approved my request. I will test the intergation with karpenter again today.

[kerthcet]

Great to hear this.

[kerthcet]

Have an offline discussion with @carlory , the generally design is almost done, but how to map the Pods to the specified nodepools. I think we can have a simple proposal for this to help understand the total design.

[kerthcet]

Only KEP left, right?

[carlory]

@kerthcet, we need to add a doc to tell users how to use it.

[kerthcet]

yeah, once finished, we can close it.

[kerthcet]

/close as completed.