visual_behavior_analysis icon indicating copy to clipboard operation
visual_behavior_analysis copied to clipboard

pytest runner for Jupyter notebooks

Open nickponvert opened this issue 6 years ago • 3 comments

It would be useful to have Jupyter notebooks run as part of pytest for several reasons:

  • Code that is included in the notebook cells could be tested to see if it still evals
  • Figures produced by the notebook running after the change could be diffed to see if a change makes plots look different, even if the code still runs. Attached is a notebook diff produced by https://app.reviewnb.com/ Screenshot from 2019-04-23 17-46-11

In this example I actually changed the code in the notebook, which produced a change in the figure output. However, we could use this to test if there is a change in plotting output due to a change in any of the dependency code.

nickponvert avatar Apr 24 '19 00:04 nickponvert

This exists: https://github.com/computationalmodelling/nbval

nickponvert avatar Apr 24 '19 01:04 nickponvert

Also relevant: https://www.cityscience.com/blog/ci-for-jupyter.html

nickponvert avatar Apr 24 '19 21:04 nickponvert

In the works from the same people as ReviewNB: https://github.com/ReviewNB/treon

nickponvert avatar Apr 28 '19 05:04 nickponvert