serenity icon indicating copy to clipboard operation
serenity copied to clipboard
verified publisher icon mesosphere

Throttling BE tasks (under CPU stress) could be not enough.

Open bwplotka opened this issue 10 years ago • 2 comments

Our throttled BE tasks can still interfere with LC PR task because they still can be scheduled for a short while by Linux Scheduler. They could create ctx switching and interfere with PR. (There could be no IPC drop, however interference appears) Mitigations:

  • We should try to find a way to remove BE tasks when too many of them are on our node (even throttled)
  • Move BE jobs into Freezer cgroup?

We should make some experiments on how does BE task cntx switches affects LC task on different levels of PR utilization and amount of CPU-stress BE tasks.

bwplotka avatar Sep 08 '15 11:09 bwplotka

Maybe, this could also be solved @ Mesos level.

Vinod has raised this issue on Community sync on Sept 3rd, 2015 https://docs.google.com/document/d/153CUCj5LOJCFAVpdDZC7COJDwKh9RDjxaTA0S7lzwDA/edit

skonefal avatar Sep 08 '15 13:09 skonefal

Can we consider it done? We have OverloadDetector in Serenity and load-based QoS Controller in Mesos.

If we would like to introduce cpu-pinning, we should do that in separate issue.

skonefal avatar Feb 01 '16 08:02 skonefal