I've worked with a few online programs that present students with drills / exercises / etc. for a period of time before deciding that they've 'done enough' for the day (e.g. Reflex Math). How do these sites (or their implementors) decide what's 'enough'? Is there research that says that children will only be able to retain a specific number of new facts in a period of time?
-
1$\begingroup$ Possible duplicate here: matheducators.stackexchange.com/questions/8/… $\endgroup$– user89Commented Mar 14, 2014 at 7:16
-
$\begingroup$ Very broad question... it depends on what you want. Lightning calculator? A whole lot. Understand how it works? Perhaps two or just one examples. And it depends on the drilee: some "get" it the first round, others will need a dozen. $\endgroup$– vonbrandCommented Mar 14, 2014 at 13:34
-
1$\begingroup$ I think this question is sufficiently different. The possible duplicate is asking how to balance instruction. This question is asking how online websites decide when students have practiced enough. Perhaps it should be slightly reworded though? $\endgroup$– adamblanCommented Mar 15, 2014 at 15:56
1 Answer
Many of these sites use a model called the Spaced Repetition Model. In particular, I'm most familiar with how Duolingo used to do it a few years ago, as I worked there. Khan Academy seems to do this as well. In principle, though, the idea is the same.
As a high level explanation, these site group together types of questions (e.g. for language each word is a type of question, for basic addition "one-digit addition" might be a type of question. As it gives you questions, everything starts out equally likely. As you answer questions correctly, it "schedules" them to be given further and further in the future (usually on an exponential model). Eventually, it asks you these things so rarely that students don't feel like they're getting things they already know.
Other sites (though, it seems increasingly rarely) use a "mastery model". Khan Academy used to do this, but I believe they've all-but phased it out. The idea here is if you get a type of question correct $n$ times in a row (where $n$ varies on the implementation), then it never asks it to you again.
Another article explaining Khan Academy's approach is here: http://david-hu.com/2011/11/02/how-khan-academy-is-using-machine-learning-to-assess-student-mastery.html
-
$\begingroup$ An explicit example of the further-and-further-scheduling idea can be found here: svn.pietdepsi.com/repos/projects/zyzzyva/trunk/data/help/… This is for a program that quizzes Scrabble players on their retention of word anagrams. Notice the intervals widening for higher cardboxes. $\endgroup$ Commented Mar 19, 2014 at 19:39