[Feature Request] Print BigQuery job costs and total time during CLI runs
Inspired by #1944
Thanks to #1944, jobIds are displayed during CLI runs.
These jobIds come from the response of getMetadata() and the response also includes totalBytesBilled and elapsedTime.
It would be helpful, for identifying heavy queries, to print the costs and total time using the data above.
Total bytes billed added by @ashish10alex and will be available in 3.0.23. Elapsed time will be a little bit tricker to collect and show but feel free to contribute to Dataform CLI.
@Ceridan Thank you for letting me know!
Elapsed time will be a little bit tricker to collect
Can you tell me what the problem is?
There are a little bit more work for elapsed time since it requires proto changes as well.
Additionally, at this point I think we need to introduce a new option for run command, e.g. --format or --output to be able to specify what additional fields you want to see. At the moment we already have jobIDs and total bytes billed.
@Ceridan That makes sense!
Format option seems great. I'll try it.