Teachers' monitoring of students' text comprehension: can students' keywords and summaries improve teachers' judgment accuracy?

Jan A. A. Engelen, Gino Camp, Janneke van de Pol, Anique B. H. de Bruin

Research output: Contribution to journalArticleScientificpeer-review

Abstract

We investigated intra-individual monitoring and regulation in learning from text in sixth-grade students and their teachers. In Experiment 1, students provided judgments of learning (JOLs) for six texts in one of three cue-prompt conditions (after writing delayed keywords or summaries or without a cue prompt) and then selected texts for restudy. Teachers also judged their students' learning for each text, while seeing - if present - the keywords or summaries each student had written for each text, and also selected texts for restudy. Overall, monitoring accuracy was low (.10 for students,-.02 for teachers) and did not differ between cue-prompt conditions. Regulation, indexed by the correlation between JOLs and restudy selections, was significant (-.38 for students, -.60 for teachers), but was also not affected by cue-prompt condition. In Experiment 2, teachers judged students' comprehension of six texts without knowing the students' names, so that only the keywords and summaries, not prior impressions, could inform judgments. Again, monitoring accuracy was generally low (.06), but higher for keywords (.23) than for summaries (-.10). These results suggest that monitoring intra-individual differences in students' learning is challenging for teachers. Analyses of the diagnosticity and utilization of keywords suggest that these may contain insufficient cues for improving teacher judgments at this level of specificity.

Original languageEnglish
Pages (from-to)287-307
Number of pages21
JournalMetacognition and learning
Volume13
Issue number3
DOIs
Publication statusPublished - Dec 2018

Keywords

  • Teacher judgments
  • Metacognitive monitoring
  • Reading comprehension
  • Self-regulated learning
  • Keyword generation
  • Cue diagnosticity
  • METACOMPREHENSION ACCURACY
  • ACADEMIC-ACHIEVEMENT
  • CUE
  • RECALL
  • TIME
  • ELEMENTARY
  • CONFIDENCE
  • ALLOCATION
  • KNOWLEDGE
  • MEMORY

Cite this

@article{d2a641d44ff54f1fa0ab0c41142c9498,
title = "Teachers' monitoring of students' text comprehension: can students' keywords and summaries improve teachers' judgment accuracy?",
abstract = "We investigated intra-individual monitoring and regulation in learning from text in sixth-grade students and their teachers. In Experiment 1, students provided judgments of learning (JOLs) for six texts in one of three cue-prompt conditions (after writing delayed keywords or summaries or without a cue prompt) and then selected texts for restudy. Teachers also judged their students' learning for each text, while seeing - if present - the keywords or summaries each student had written for each text, and also selected texts for restudy. Overall, monitoring accuracy was low (.10 for students,-.02 for teachers) and did not differ between cue-prompt conditions. Regulation, indexed by the correlation between JOLs and restudy selections, was significant (-.38 for students, -.60 for teachers), but was also not affected by cue-prompt condition. In Experiment 2, teachers judged students' comprehension of six texts without knowing the students' names, so that only the keywords and summaries, not prior impressions, could inform judgments. Again, monitoring accuracy was generally low (.06), but higher for keywords (.23) than for summaries (-.10). These results suggest that monitoring intra-individual differences in students' learning is challenging for teachers. Analyses of the diagnosticity and utilization of keywords suggest that these may contain insufficient cues for improving teacher judgments at this level of specificity.",
keywords = "Teacher judgments, Metacognitive monitoring, Reading comprehension, Self-regulated learning, Keyword generation, Cue diagnosticity, METACOMPREHENSION ACCURACY, ACADEMIC-ACHIEVEMENT, CUE, RECALL, TIME, ELEMENTARY, CONFIDENCE, ALLOCATION, KNOWLEDGE, MEMORY",
author = "Engelen, {Jan A. A.} and Gino Camp and {van de Pol}, Janneke and {de Bruin}, {Anique B. H.}",
year = "2018",
month = "12",
doi = "10.1007/s11409-018-9187-4",
language = "English",
volume = "13",
pages = "287--307",
journal = "Metacognition and learning",
issn = "1556-1623",
publisher = "Springer",
number = "3",

}

Teachers' monitoring of students' text comprehension : can students' keywords and summaries improve teachers' judgment accuracy? / Engelen, Jan A. A.; Camp, Gino; van de Pol, Janneke; de Bruin, Anique B. H.

In: Metacognition and learning, Vol. 13, No. 3, 12.2018, p. 287-307.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - Teachers' monitoring of students' text comprehension

T2 - can students' keywords and summaries improve teachers' judgment accuracy?

AU - Engelen, Jan A. A.

AU - Camp, Gino

AU - van de Pol, Janneke

AU - de Bruin, Anique B. H.

PY - 2018/12

Y1 - 2018/12

N2 - We investigated intra-individual monitoring and regulation in learning from text in sixth-grade students and their teachers. In Experiment 1, students provided judgments of learning (JOLs) for six texts in one of three cue-prompt conditions (after writing delayed keywords or summaries or without a cue prompt) and then selected texts for restudy. Teachers also judged their students' learning for each text, while seeing - if present - the keywords or summaries each student had written for each text, and also selected texts for restudy. Overall, monitoring accuracy was low (.10 for students,-.02 for teachers) and did not differ between cue-prompt conditions. Regulation, indexed by the correlation between JOLs and restudy selections, was significant (-.38 for students, -.60 for teachers), but was also not affected by cue-prompt condition. In Experiment 2, teachers judged students' comprehension of six texts without knowing the students' names, so that only the keywords and summaries, not prior impressions, could inform judgments. Again, monitoring accuracy was generally low (.06), but higher for keywords (.23) than for summaries (-.10). These results suggest that monitoring intra-individual differences in students' learning is challenging for teachers. Analyses of the diagnosticity and utilization of keywords suggest that these may contain insufficient cues for improving teacher judgments at this level of specificity.

AB - We investigated intra-individual monitoring and regulation in learning from text in sixth-grade students and their teachers. In Experiment 1, students provided judgments of learning (JOLs) for six texts in one of three cue-prompt conditions (after writing delayed keywords or summaries or without a cue prompt) and then selected texts for restudy. Teachers also judged their students' learning for each text, while seeing - if present - the keywords or summaries each student had written for each text, and also selected texts for restudy. Overall, monitoring accuracy was low (.10 for students,-.02 for teachers) and did not differ between cue-prompt conditions. Regulation, indexed by the correlation between JOLs and restudy selections, was significant (-.38 for students, -.60 for teachers), but was also not affected by cue-prompt condition. In Experiment 2, teachers judged students' comprehension of six texts without knowing the students' names, so that only the keywords and summaries, not prior impressions, could inform judgments. Again, monitoring accuracy was generally low (.06), but higher for keywords (.23) than for summaries (-.10). These results suggest that monitoring intra-individual differences in students' learning is challenging for teachers. Analyses of the diagnosticity and utilization of keywords suggest that these may contain insufficient cues for improving teacher judgments at this level of specificity.

KW - Teacher judgments

KW - Metacognitive monitoring

KW - Reading comprehension

KW - Self-regulated learning

KW - Keyword generation

KW - Cue diagnosticity

KW - METACOMPREHENSION ACCURACY

KW - ACADEMIC-ACHIEVEMENT

KW - CUE

KW - RECALL

KW - TIME

KW - ELEMENTARY

KW - CONFIDENCE

KW - ALLOCATION

KW - KNOWLEDGE

KW - MEMORY

U2 - 10.1007/s11409-018-9187-4

DO - 10.1007/s11409-018-9187-4

M3 - Article

VL - 13

SP - 287

EP - 307

JO - Metacognition and learning

JF - Metacognition and learning

SN - 1556-1623

IS - 3

ER -