cloudgene icon indicating copy to clipboard operation
cloudgene copied to clipboard

Reduce job status page refresh rate

Open abought opened this issue 1 year ago • 0 comments

Purpose

The "job status" page provides feedback by refreshing every 5 sec.

When the queue is long, the server can experience loss of service quality just from status page checks alone. (see related connection pool issue)

The new proposed value of 20 sec will reduce server load by ~75% for running job status checks, while still giving users frequent visible feedback during "fast" parts of the process like QC.

Combined with other recent changes (DB indices, increased connection pool etc), this should be sufficient to prevent DoS when the site is used under normal conditions.

This will be included in our next fork release, and we're contributing it back for others.

Related:

  • https://github.com/genepi/cloudgene/issues/146
  • https://github.com/lukfor/imputationbot/issues/33

abought avatar Apr 19 '24 20:04 abought