RFC: API to synchronize devices

Open reedwm opened this issue 3 years ago • 3 comments

Status Proposed

RFC # 434

Author(s) Reed Wanderman-Milne ([email protected]), Jonathan Dekhtiar ([email protected])

Sponsor Rohan Jain ([email protected])

Updated 2022-10-25

Status	Proposed
RFC #	434
Author(s)	Reed Wanderman-Milne ([email protected]), Jonathan Dekhtiar ([email protected])
Sponsor	Rohan Jain ([email protected])
Updated	2022-10-25

Objective

This document proposes a simple API to synchronize TensorFlow devices: tf.test.sync_devices(). This is important in accurately measuring execution time in TensorFlow GPU benchmarks, especially in microbenchmarks.

/CC @DEKHTIARJonathan @rohan100jain

Oct 25 '22 23:10 reedwm

cc: @Jianhui-Li, @jzhoulon, @yiqianglee, @kulinseth, @wchao1115, and @PatriceVignola for PluggableDevices.

Oct 26 '22 11:10 penpornk

LGTM, thanks

Jan 12 '23 02:01 sun51

@reedwm can you please link the commit that adds the feature or the PR/CL here ?

Thanks

Jan 16 '23 17:01 DEKHTIARJonathan