No Task Left Behind: Holistic Student Assessment Framework based on Multi-task Learning

Conventional Knowledge Tracing(KT) models usually only consider binary correctness - whether a student got a question correct or wrong - to determine a student’s current knowledge state. In reality, multiple-choice questions have “distractors” where some options are closer to the answer than others. Choosing one that is closest to the answer and choosing one that is farthest from the answer tell different stories about a student.

Definition:

Knowledge Tracing models attempt to accurately determine a student’s current knowledge state, such as whether a student may respond correctly to a question

Option Tracing(OT) is the craft of predicting which option a student may select for a certain question. Combining KT and OT objectives could allow us to use both a) whether a student got a question correct and b) the specific option a student chose altogether to assess a student in a more accurate manner.

Definition:

Option Tracing model predicts which option a student may select in a multiple-choice question.