Flux Archicture Diagrams

[SteVwonder]

It would be good to have some documentation on the main modules and their interactions.

Including:

• Our "hub and spoke" setup
  • Specifically job-manager is the "hub", and "job-ingest", "depend", "sched", and "exec" are all spokes
• The difference in modules loaded on rank0 vs other ranks
• The messages that pass between modules when A) submitting a job B) querying job statuses

I put together some diagrams in PowerPoint that might be a good starting point: Flux-Architectural-Diagrams.pptx Flux-Architectural-Diagrams.pdf

[tpatki]

@vsoch Bringing this issue to your attention, it is in line with our discussion on an architecture diagram. Attaching the slides from our meeting here so we can add these to docs and merge with Stephen's initial approach.

Flux arch diag discussion.pptx

[vsoch]

Also note the repository here: https://converged-computing.github.io/flux-architecture/projects/

Where I was planning to add more diagrams! Right now we just have the components on the main page https://converged-computing.github.io/flux-architecture/ and that atttempt at grouping them (which wasn't super useful since everything is flux-core!)