[BUG] Function Timing on MacOS Very Inconsistent
Function timings seem to be very wildly inconsistent based on test runs. Sample output from unit tests:
Elapsed time: 312
Elapsed time: 305
Elapsed time: 346
Elapsed time: 303
Elapsed time: 303
Elapsed time: 311
Elapsed time: 312
Elapsed time: 304
Elapsed time: 320
Elapsed time: 305
Elapsed time: 328
Elapsed time: 333
Elapsed time: 303
Elapsed time: 375
Elapsed time: 310
Elapsed time: 314
Elapsed time: 302
Elapsed time: 344
Elapsed time: 310
Elapsed time: 319
Elapsed time: 371
Elapsed time: 306
Elapsed time: 302
This could be due to running in Debug and further testing needs to be done to see if there is a difference in behavior in Release.
This happens in Release as well.
After further investigation it seems that a different approach to the function timeout may be needed to avoid timer errors. It seems the error might be related to the timeout duration.
Merging of #11 improved performance of the timing on MacOS but not all test cases pass (yet).
I think this issue is the same problem. It is not cause by performance.
@gzliurc Could be, but it's odd that this particular issue only surfaces on MacOS.