feat: add profiling steps
Description
Allow transferring function profiling steps through the orchestrator, allowing the builder to register event without having to have http(s) requests to the backend api server (involving having access to the db to get credentials). This also allows having duration for the function available on every backend.
The drawback of this approach is, how it is relying on the event system already in place, the function profiling are also saved in the DB of the orchestrator.
Fixes FL-1519
Companion PR
- https://github.com/Substra/substra-backend/pull/886
How has this been tested?
Checklist
- [ ] changelog was updated with notable changes
- [ ] documentation was updated
/e2e --tests substra-backend=feat/add-profiling-step-functions
End to end tests: :x: FAILURE
Jobs status:
- Camelyon: :next_track_button:
- Dispatch Jobs: :heavy_check_mark:
- Documentation: :next_track_button:
- MNIST: :next_track_button:
- SubstraFL: :next_track_button:
- SubstraSDK / sdk: :x:
“You shall not pass!” ― Gandalf, The Lord of the Rings, The Fellowship of the Ring
/e2e --tests substra-backend=feat/add-profiling-step-functions
End to end tests: :x: FAILURE
Jobs status:
- Camelyon: :next_track_button:
- Dispatch Jobs: :heavy_check_mark:
- Documentation: :next_track_button:
- MNIST: :next_track_button:
- SubstraFL: :next_track_button:
- SubstraSDK / sdk: :x:
Darn it.
/e2e --tests substra-backend=feat/add-profiling-step-functions
End to end tests: :x: FAILURE
Jobs status:
- Camelyon: :next_track_button:
- Dispatch Jobs: :heavy_check_mark:
- Documentation: :next_track_button:
- MNIST: :next_track_button:
- SubstraFL: :next_track_button:
- SubstraSDK / sdk: :x:
“Success is not final; failure is not fatal: It is the courage to continue that counts.” ―- Winston S. Churchill
/e2e --tests substra-backend=feat/add-profiling-step-functions
End to end tests: :x: FAILURE
Jobs status:
- Camelyon: :next_track_button:
- Dispatch Jobs: :heavy_check_mark:
- Documentation: :next_track_button:
- MNIST: :next_track_button:
- SubstraFL: :next_track_button:
- SubstraSDK / sdk: :x:
“Just Keep Swimming!” ― Dory, Finding Nemo
/e2e --tests substra-backend=feat/add-profiling-step-functions
End to end tests: :heavy_check_mark: SUCCESS
“Carpe diem. Seize the day, boys.” ― John Keating, Dead Poets Society
/e2e --tests sdk,substrafl,frontend,documentation,mnist substra-backend=feat/add-profiling-step-functions