It’s a lesson in scholastic humility: You waltz into an exam, confident that you’ve got a good enough grip on the class material to swing an 80 percent or so, maybe a 90 if some of the questions go your way.
Then you get your results: 60 percent. Your grade and your stomach both sink. What went wrong?
Students, and people in general, can tend to overestimate their own abilities. But University of Utah research shows that students who overcome this tendency score better on final exams. The boost is strongest for students in the lower 25 percent of the class. By thinking about their thinking, a practice called metacognition, these students raised their final exam scores by 10 percent on average — a full letter grade.
The study, published in the Journal of Chemical Education, is authored by University of Utah doctoral student Brock Casselman and professor Charles Atwood.
“The goal was to create a system that would help the student to better understand their ability,” says Casselman, “so that by the time they get to the test, they will be ready.”
Article continues below...
.
We Help Children Read. Learn. Achieve.
We offer fundamental solutions to learning challenges –
“It’s been six months … and already she is one of the top performers in her class”
I was told that my daughter would never make it in a mainstream school and that she had to be transferred to a remedial school... She is getting 6's and 7's and she is in mainstream school. Continue Reading
Zan’s Mom, South Africa Edublox Online Tutor December 21, 2013
Dyslexia case study presented at Kennesaw State University
The Edublox Program has given hope to a child who knew he was different, tried to fit in with his peers, and experienced failures in any aspects of school. His newly found confidence has allowed him to raise his hand in a classroom, dared him to try written material presented to him, and opened a world of "I can" instead of "I can't" on new material. Continue Reading
Carole Derrick, Primary Grades Teacher Edublox Online Tutor June 24, 2015
“His English has jumped from 42% to 58%; he is writing compositions that bring tears to my eyes”
Preneil was diagnosed with dyslexia at the age of thirteen. His mother shares her son's progress after joining Edublox. Read the full story. Continue Reading
Devigi Pillay, South Africa Edublox Online Tutor January 26, 2016
“My dyslexic son doesn’t seem to be dyslexic anymore”
I never thought I would be writing this statement, but my dyslexic son doesn't seem to be dyslexic anymore! The symptoms have all disappeared. After all I've read on the subject of learning difficulties, this was not supposed to happen! Continue Reading
Laura Trudel, Canada Edublox Online Tutor November 12, 2016
“A program that truly stands up to [its] promises and offers hope to those who struggle”
We just received his first semester report card and I am so excited to say that he received an “A” in both English and Math. Continue Reading
Teresa M., California, US Edublox Online Tutor November 28, 2016
“He is devouring books at a rapid rate”
Six months ago reading a book was tortuous for him because even if he read it his reading was so faltering and full of mistakes that he couldn’t comprehend the text. Continue Reading
Abi Stinson, UK Edublox Online Tutor November 29, 2016
“After six weeks the improvements were very obvious”
The most noticeable improvement came with Math, because we were struggling trying to do his math at grade level (3rd grade), but then around six weeks into Edublox he could do his math at grade level (with the exception of telling time on a face clock and counting money). Continue Reading
Cindy B., Michigan, US Edublox Online Tutor December 1, 2016
“His reading age went up by 2 years in less than 6 months”
His spelling age improved as well and he also did really well in the end of year exams with his best results in most subjects. Continue Reading
Jenny & Greg, UK Edublox Online Tutor December 6, 2016
“In the first 9 weeks of school they have increased over 2 1/2 years”
Phonics just did not work. Last year they did not improve in their reading level all year. We started Edublox in June and already in the first 9 weeks of school they have increased over 2 1/2 years.... Their spelling has greatly improved and learning new words has become a game, not the dreaded chore it once was. Continue Reading
Nita Brist, Washington State, US Edublox Online Tutor December 11, 2016
“I feel as if part of my daughter’s mind was trapped, and Edublox set her free”
She is now almost an intuitive speller. Really, it's a miracle. Six months ago, her spelling tested at a Kindergarten level, and is now at a 6th grade level. This is just still so amazing to all of us who have struggled with her. Continue Reading
The Adams household in New Mexico Edublox Online Tutor December 15, 2016
.
Errors in estimation
General chemistry at the University of Utah is a rigorous course. In 2010 only two-thirds of the students who took the course passed it — and of those who didn’t, only a quarter ever retook and passed the class.
“We’re trying to stop that,” Atwood says. “We always want our students to do better, particularly on more difficult, higher-level cognitive tasks, and we want them to be successful and competitive with any other school in the country.”
Part of the problem may lie in how students view their own abilities. When asked to predict their scores on a midterm pretest near the beginning of the school year, students of all performance levels overestimated their scores by an average of 11 percent over the whole class. The students in the lower 25 percent of class scores, also called the “bottom quartile,” overestimated by around 22 percent.
This phenomenon isn’t unknown — in 1999 psychologists David Dunning and Justin Kruger published a paper stating that people who perform poorly at a task tend to overestimate their performance ability, while those who excel at the task may slightly underestimate their competence. This beginning-of-year survey showed that general chemistry students are not exempt.
“They convince themselves that they know what they’re doing when in fact they really don’t,” Atwood says.
The antidote to such a tendency is engagement in metacognition, or thinking about and recognizing one’s own strengths and limitations. Atwood says that scientists employ metacognition skills to evaluate the course of their research.
“Once they have got some chunk figured out and realize ‘I don’t understand this as well as I thought I did,’ they will adjust their learning pattern,” he says. After reviewing previous research on metacognition in education, Atwood and Casselman set out to design a system to help chemistry students accurately estimate their performance and make adjustments as necessary.
Accurate estimation
In collaboration with Madra Learning, an online homework and learning assessment platform, Casselman and Atwood put together practice materials that would present a realistic test, and asked students to predict their scores on the practice test before taking it. They also implemented a feedback system that would identify the topics the students were struggling with so they could make a personal study plan.
After a few years of tweaking the feedback system, they added the element of weekly quizzes into the experimental metacognition training to provide students more frequent feedback. By the first midterm exam of the 2016 class, Casselman and Atwood could see that the experimental course section’s scores were significantly higher than a control section’s that did not receive metacognition training. “I was ecstatic!” Casselman says.
By the final exam, students’ predictions of their scores were about right on, or a little underpredicted. Overall, the researchers report, students who learned metacognition skills scored around 4 percent higher on the final exam than their peers in the control section. But the strongest improvement was in the bottom quartile of students, who scored a full 10 percent better, on average, than the bottom quartile of the control section.
“This will take D and F students and turn them into C students,” Atwood says. “We also see it taking higher-end C students and making them into B students. Higher-end B students become A students.”
Atwood adds that the students took a nationally standardized test as their final exam. That means that the researchers can compare the U students’ performance to other students nationwide. The bottom quartile of students at the U who received metacognition training scored in the 54th percentile. “So, our bottom students are now performing better than the national average,” Atwood says.
“They’re not going to be overpredicting their ability,” Casselman says. “They’re going to go in knowing exactly how well they’re going to do and they will have prepared in the areas they knew they were weakest.”
A cumulative effect
This study covered students in the first semester of general chemistry. Casselman has now expanded the study into the second semester, meaning some students have had no semesters of metacognition training, some have had one and some have had two. Preliminary analysis suggests that the training may have a cumulative effect across semesters.
“The students who are successful will ask themselves — what is this question asking me to do?” Atwood says. “How does that relate to what we’re doing in class? Why are they giving me this question? If there’s an equation, why does this equation work? That’s the metacognitive part. If they will kick that in, they will see their grades go straight through the roof.”
Both Atwood and Casselman say this principle is not limited to chemistry and could be applied throughout campus. It’s a principle universally applicable to learning, and has been hinted at for centuries, including in a Confucian proverb:
“Real knowledge is to know the extent of one’s ignorance.”
.