periodic-function icon indicating copy to clipboard operation
periodic-function copied to clipboard

[BUG] Function Timing on MacOS Very Inconsistent

Open ptsouchlos opened this issue 5 years ago • 5 comments

Function timings seem to be very wildly inconsistent based on test runs. Sample output from unit tests:

Elapsed time: 312
Elapsed time: 305
Elapsed time: 346
Elapsed time: 303
Elapsed time: 303
Elapsed time: 311
Elapsed time: 312
Elapsed time: 304
Elapsed time: 320
Elapsed time: 305
Elapsed time: 328
Elapsed time: 333
Elapsed time: 303
Elapsed time: 375
Elapsed time: 310
Elapsed time: 314
Elapsed time: 302
Elapsed time: 344
Elapsed time: 310
Elapsed time: 319
Elapsed time: 371
Elapsed time: 306
Elapsed time: 302

This could be due to running in Debug and further testing needs to be done to see if there is a difference in behavior in Release.

ptsouchlos avatar Aug 19 '20 17:08 ptsouchlos

This happens in Release as well.

ptsouchlos avatar Aug 19 '20 18:08 ptsouchlos

After further investigation it seems that a different approach to the function timeout may be needed to avoid timer errors. It seems the error might be related to the timeout duration.

ptsouchlos avatar Sep 15 '20 18:09 ptsouchlos

Merging of #11 improved performance of the timing on MacOS but not all test cases pass (yet).

ptsouchlos avatar Oct 10 '20 18:10 ptsouchlos

I think this issue is the same problem. It is not cause by performance.

gzliurc avatar Oct 31 '20 03:10 gzliurc

@gzliurc Could be, but it's odd that this particular issue only surfaces on MacOS.

ptsouchlos avatar Oct 31 '20 03:10 ptsouchlos