a-plus icon indicating copy to clipboard operation
a-plus copied to clipboard

Submission feedback at the deadline time, if points > 0

Open teemulehtinen opened this issue 1 year ago • 3 comments

Reuse the e-exam feature "reveal-submission-feedback = deadline" for use in course content. Motivation: Shift the responsibility of properly testing the submitted code to the student. Prevent generating, testing, and fixing code using LLMs and automated feedback. Required changes:

  • Add an option to show feedback with 0 points immediately, which enables the development of sanity checks that fail if a student submits e.g. the template code without changes, a differently named program, or something else that prevents running the real grading tests.
  • The exercises that use feedback at the deadline must have a note and visible distinction from those that immediately show feedback. This may need to be different than in the e-exam case.
  • Feedback at the deadline implies grading mode is points for the last submission. When late submissions are allowed the grading mode needs to be: the last submission in time or better from late submissions with the late penalty applied.

teemulehtinen avatar May 24 '24 06:05 teemulehtinen

There already are several options in A+ for revealing feedback after the deadline image

image

So would this suggested option be an additional alternative in addition to the existing ones, or would you suggest that some of the existing ones would be changed to behave in the manner you indicate?

Or would it be better to have another option (e.g. a checkbox), that if it is selected, feedback is displayed immediately if the points are 0?

etanttila avatar May 28 '24 11:05 etanttila

(It seems like teachers see feedback immediately even if the settings are set to have it as delayed feedback, so if you want to test how it appears to the student, you actually need to test it with a student.)

Before submitting, there indeed is no information at all that feedback will not be provided immediately, which certainly is problematic. (At least I as a student would be really annoyed to not know that beforehand.) image

After submitting, there is a notification that the feedback will be published later image

If only the last submission is graded, there is a notification that only the last submission is graded before submitting (this remains also after submitting) image

After submitting: image However, if the page is reloaded, the green box disappears, so there is no info (other than the question mark in the points) to indicate feedback will be provided later.

Indeed, it should be more transparent (and apparent to students!) if feedback is delayed (e.g. to deadline).

etanttila avatar May 28 '24 11:05 etanttila

I would add a separate checkbox "Always reveal feedback worth 0 points immediately" next to the delay minutes (there are different fields that only appear for certain reveal modes already).

When the visibility/notes for when to expect feedback are designed, we must also consider the exam case. The UI should not become annoying or confusing when completing an exam.

teemulehtinen avatar May 29 '24 10:05 teemulehtinen