AI Appears To Assess Student Work Comparably To Humans – But How?
“While we may never fully understand the exact “thought process” of an AI as it navigates millions of dimensions of probability, the evidence suggests that it is successfully reproducing human values… However, ultimately I concluded with the following: “I still think that we are better off having human judgement involved in marking essays because ultimately, […]
“Why [Most] Grades Are Misleading”
“How To Write A Good Rubric (For Humans And AI)”
Four Reasons LLMs Aren’t Excellent Personal Tutors (Yet)
“There is a limit to what students will learn on their own and on a screen.”
“AI Is Uncannily Good At Judging Writing” (When Comparing Works)
“We asked the LLMs to make Comparative Judgements instead. They have to read two pieces of writing and choose which is better, and we can then combine together all of these decisions to create a very sophisticated measurement scale for every piece of writing… This approach is much more effective, and results in very high […]
What Kind Of Feedback Do Students And Teachers Want?
“So far, our teachers have told us that the report they find the most useful is the teacher report, consisting of personalised information on every student designed for teachers. There are three elements in the report: data, AI feedback and the student writing. They prefer this to the student report, which is similar but doesn’t […]
Is It A Mistake To Try To Make Education Fun?
Is The “Flynn Effect” Reversing? How Much? Why?
“For most of the 20th century, scores on IQ tests steadily increased. This trend was termed the Flynn effect, after James Flynn, who described it. But in developed countries, this increase appears to have stopped and even reversed for cohorts born in the latter decades of the 20th century.”
“How Do Students Redraft Their Writing?”
“We provided students with very detailed and personalised feedback reports which featured a mix of AI feedback, teacher feedback and resources designed by us. Here’s a brief summary of what was available – you can read more here.”
AI Is Reliable At Assessing Student Writing
“We now have results. Our headline finding is that AI is very good at judging student writing and is a viable and time-saving alternative for many forms of school assessment. Here are the details… We have been running similar tasks since 2017 for students at primary and secondary, and have assessed nearly 3 million pieces […]