Smarter polling speed

[bfirsh]

In wait() and output_iterator() we should be smarter about our polling speed. Start quick, to handle fast predictions, then slow down if prediction hasn't started, then speed up when prediction is processing, or something like that. Similar to the logic in the web client on Replicate.