Thursday, January 9, 2020

Vocabulary Instruction and Google Images

Google Images has made it extremely easy to pair an image with a target vocabulary word. In the MCVIP & VALE research projects, our teachers paired images with all target words on vocab word walls. Here is a typical word wall that features target words with images pulled from Google.


With regard to instruction, an image may be all it takes to get across the meaning of a concrete noun like musket or sandspit in a memorable way. But, with other kinds of words images may be even more valuable as a teaching tool, serving as an excellent way prompt to students to think deeply about or apply a word meaning. Consider the word dismayed. One of our teachers paired this image with this target word...
After providing a kid-friendly definition of dismayed and several examples of use, we could then ask students these type of questions about the image:
  • Why do you think that I would show you this picture for the word dismayed?
  • If you were in one of the tall buildings, would you be dismayed? Why or why not? If you were on the top of one of the mountains in the background, would you be dismayed? Why or why not?
  • Can you give me (or write) a sentence about this image picture that includes the word dismayed?
Through these kind of questions, images become great contexts for students to apply new words and consider the nuances of their meanings.

Finally, just committing to finding a Google Image for each of your target words ensures that you are planning ahead for your vocabulary instruction. Such planning always leads to crisper, clearer introductions and discussions of new word meanings. 

The Impact of Word Reading and Vocabulary on Middle School Reading Comprehension



 Hello Literacy Friends!

As I continued to update my knowledge for my upcoming Literacy Difficulties course, I came across a very recent article that examines the relative impact of word reading and vocabulary knowledge on the reading comprehension of adequate and struggling adolescent readers. I found that the article does an excellent job laying out these relationships and thus gives real insight into the causes of differences in reading comprehension among adolescents. I will try to unpack the findings in an efficient manner for you all here.

First, the study included 796 middle schoolers (average age of 14.1), with 491 in the adequate comprehension group and 305 in the struggling comprehension group (below 30% on the Gates comprehension test). These students were assessed for vocabulary knowledge, word reading, reading efficiency (fluency), and inferencing. The researchers analyzed the direct and indirect effect of word reading and vocab knowledge on reading comprehension. (Indirect effects included the effect of each these two components on reading efficiency and inferencing multiplied by the respective effect of reading efficiency and inferencing on reading comprehension.) In the end, the authors could then consider the total effects of word reading and vocab on reading comp for a) the total sample, b) the adequate comprehenders, and c) the struggling comprehenders. So, here, in a nutshell, are the outcomes:

1)    Word reading was a significant predictor of comprehension for the entire sample (effect .21); however, word reading had a large effect on comprehension for struggling comprehenders and a negligible effect for adequate comprehenders. This supports the notion that, in the authors’ words, “there is a threshold of word reading skill that has to be met before its relation to reading comprehension subsides. It is possible that the struggling comprehenders did not have the requisite word reading skills necessary to easily extract meaning from text.”
2)    Vocabulary was a greater significant predictor of comprehension for the entire sample than word reading (effect .60). Vocabulary had a larger effect on comprehension for adequate comprehenders (.62) than struggling comprehenders (.18). The authors summed up these results in this way, “While vocabulary favored the adequate group as a predictor, it was also a statistically significant predictor for the struggling comprehenders. Thus, vocabulary plays an important role for struggling and adequate readers alike.”
3)    Vocabulary knowledge significantly positively impacted the adequate readers’ reading efficiency and inferencing. In simple terms, students with higher vocabulary scores were slightly more fluent readers and better at making inferences.
4)    Without getting into the more complex details, the outcomes related to the struggling comprehenders led the authors to conclude… “instruction in word reading and vocabulary may lead to greater gains for struggling readers than instruction aimed at increasing fluency. Indeed, this view is supported in the synthesis of effective interventions for struggling adolescent readers by Edmonds et al., who found that word reading instruction led to greater and more consistent gains than fluency instruction.”

I would summarize things this way. It is clear that word reading difficulties have a strong impact on students’ comprehension. Basically, until students can read the words well, other components matter less: the students are simply hung up on reading the words. On the other hand, once students reach a high level of word reading proficiency, knowing the meanings of the individual words greatly impacts their reading comprehension, both directly and because it makes them better at inferencing and slightly more fluent. 

My takeaway is that elementary schools should prioritize both of these key components! I believe that it quite feasible for elementary schools to equip nearly all students with strong word reading skills, and, if we can, we should. But, just as significantly, vocabulary knowledge was a significant predictor of comprehension for all students and particularly for the adequate comprehenders. Teachers often ask me, “We rightfully think a lot about our lower-performing students. But, how can we push those kids right in the middle to a higher level? Well, this study shows that if we want students to be especially strong comprehenders in middle school, we need to be teaching vocabulary comprehensively and consistently across the elementary grades. So, at this point, I’ll put in a plug for my earlier CLC post on VALE vocabulary instruction. Check it out below! 


Oslund, E., Clemens, N., Simmons, D.. & Simmons, D. (2018). The direct and indirect effects of word reading and vocabulary on adolescents’ reading comprehension: Comparing struggling and adequate comprehenders. Reading and Writing, 31, 355-379.

Saturday, January 4, 2020

Kindergarten Reading Intervention: The Impact of Intensity and Instructional Design


In prep for my upcoming Literacy Difficulties class, I recently read a research article on reading intervention in kindergarten that struck me as very important, and thus I thought that I would attempt to briefly summarize the findings here. As I guy who has said for many years, “It is not just about teaching the right stuff, but also doing it at the right level of intensity,” I loved the design of the study. Specifically, the researchers compared outcomes for students who participated in three differently designed kindergarten interventions. The three interventions were designed to compare the effects of two key variables – time and “design specificity.” So, the three treatments were… 1) 30 minutes of HIGH-design-specificity, code-based instruction, 2) 15 minutes of HIGH-design-specificity, code-based instruction + 15 minutes of read aloud, vocab and narrative structure instruction, and 3) 30 minutes of MODERATE-design-specificity, code-based instruction. Based on these interventions, the researchers could compare groups 1-2 to examine the effects of additional instructional time on key code-based objectives (e.g., phonemic awareness, phonics, beginning decoding/spelling) and groups 1-3 to examine the effects of design specificity. There were many assessments used and thus many comparisons. I will try to do justice to the findings very briefly…

1)    Students in the 30-minute HIGH treatment scored significantly greater growth than students in the 15-minute HIGH + 15-minute story reading in letter naming and writing, decoding, word reading and spelling. The two groups performed equally on phoneme segmenting. Importantly, the 30-minute HIGH treatment was differentially more effective for students who entered K with the lowest alphabet knowledge (naming 3 or fewer letter names – 70% of the total sample). In short, for the students with the lowest alphabetic knowledge, 30-minute of highly specifically designed code-based instruction was much more effective than 15. 15 minutes of such instruction was equally effective for students who were at the “top” of the bottom 25% in alphabetic knowledge. In simple terms, kids who start really low in terms of early literacy knowledge need not just carefully targeted instruction but also “the right intensity” (time on task) of this instruction. 

2)    Students in the 30-minute HIGH treatment scored significantly greater growth than students in the 30-minute MODERATE treatment in letter naming and writing, decoding, word reading and spelling. Similar to the above comparison, the 30-minute HIGH treatment was differentially more effective for students who entered K with the lowest alphabet knowledge (naming 3 or fewer letter names – 70% of the total sample). In short, for the students with the lowest alphabetic knowledge, 30 minutes of highly specifically designed code-based instruction was much more effective than 30 minutes of moderately specifically designed code-based instruction. So, once again, to maximize growth of kids who start really low in terms of early literacy knowledge, it is critical that the instruction not just target the “right stuff” but also have excellent design.  

Overall, there were a lot of effect sizes involved. So, practically speaking, I will just say this to give a sense of the magnitude of the gains: The kids in the 30-High treatment ended up at the 67% on Dibels decoding whereas those in the other conditions ended up at about the 40%. And, a little info on “specifically designed instruction:” this variable involved elements such as explicitness of big ideas, scaffolding, and strategic review.

The bottom line here seems quite clear: Just generally “doing the right stuff” doesn’t cut it with our neediest students; maximizing the growth of these kiddos requires carefully designed code-based instruction and A LOT OF IT!

Simmons, D., Kame’enui, E., Harn, B., Coyne, M., Edwards, L., & Thomas, C. (2007). The effects of instructional emphasis and
specificity on early reading and vocabulary development of kindergarten children. Journal of Learning Disabilities, 40, 331-347.

Sunday, December 29, 2019

Implementing Multi-Tiered Support Systems in Reading in the Messy World of Real Schools


Hello Friends!

In preparing for my annual spring term Literacy Difficulties course, I came across two excellent, recent pieces on implementing MTSS in reading that I have not used in the past (refs at bottom). Both pieces issued from a successful collaboration between a State Department of Education and researchers at a state university that focused on supporting four very high-needs schools in developing, implementing, and refining school-wide MTSS systems in reading. Significantly, the project produced the kinds of outcomes that most schools hunger for: Two years of implementation of the MTSS systems produced a +0.5 effect size in students’ reading achievement, meaning that students who received two years of supports accelerated their reading performance by 19 percentile points.

The pieces, which overlap quite a bit, begin with the premise that most schools know, in general, what needs to be done in terms of implementing MTSS in reading but “underestimate
the supports that schools need to build systems and infrastructure to implement and sustain these practices.” The authors then go into detail in terms of how the project schools “worked to overcome the complexities inherent in implementing multitiered reading supports in high-priority schools,” providing "examples of how schools involved with the K–3 reading initiative delved into the details to move past barriers and build the systems and infrastructure to implement a comprehensive MTSS framework fully, with fidelity and consistency.” I found that pieces were highly engaging, filled with practical insights, and extremely challenging, as they describe many specific practices that enabled the schools to be successful but that, quite honestly, most schools typically just don’t have in place.

It would take quite a bit of verbiage to adequately summarize the content of the pieces, and I was unable to upload a chart from the Coyne chapter that would have done it for me. So, here is the briefest of summaries. Both pieces identify a set of four common stumbling blocks, that they present in the form of practical statements, that often trip up schools’ attempts to implement MTSS in reading in robust ways: 
  • "We have an MTSS plan, but it doesn't guide our day-to-day reading practice."
  • "We have identified a common approach to Tier 1, but it doesn't seem like there is consistency in reading instruction across teachers and classrooms."
  • "We have useful reading data from our students, but it feels like we are not able to use it to make meaningful instructional decisions for all our students."
  •  "We have students who need intensive small-group instruction, but now what?" 
The pieces then go on to present examples of exactly how the four schools overcame these obstacles, detailing the establishment of literacy leadership teams and the teams' long- and short-term objectives; decisions regarding planning, prioritizing, and meeting; and tools for utilizing data. Again, it is beyond the scope of this post to lay out these "solutions" in detail. But, if these stumbling blocks sound familiar and the idea of actual practical solutions is thought-provoking, email me and I can send the chapter/articles to you in PDF. They will provide much more specific description of the practices and tools that the project schools employed to address these issues.

Overall, I would leave you with these following critical points:

1)    Most schools vastly underestimate the challenges involved in implementing a robust MTSS system in reading and greatly overestimate the degree to which MTSS practices are implemented fully and with fidelity.
2)    Partial implementation of MTSS systems in reading likely will not improve student outcomes, particularly for students with, or at risk, for learning disabilities (Balu et al., 2015). "Half way" just isn't good enough, and ends up being a waste of vitally important resources. It really takes “everything and the kitchen sink” to produce the outcomes we desire.
3)    There are schools out there – in extremely challenging settings – that are “getting it right.” If they can do it, you can do it! And, if you can do it, you should do it!
4)    These two pieces will give you plenty of real, practical guidance in constructing a robust MTSS system in reading. I would also be happy to “join the discussion” if your school is genuinely interested in undertaking this process.

Coyne,M. D., Oldham, A., Leonard, K., Burns, D.,&Gage,N. (2016).Delving into the details:
Implementing multitiered K–3 reading supports in high-priority schools. In B. Foorman
(Ed.), Challenges to implementing effective reading intervention in schools. New Directions for
Child and Adolescent Development, 154, 67–85.

Leonard, K., Coyne,M. D., Oldham, A., Leonard, K., Burns, D.,& Gillis, M.B. (2019). Implementing MTSS in Beginning Reading: Tools and Systems to Support Schools and Teachers. Learning Disabilities Research & Practice, 34(2), 110–117

Monday, December 16, 2019

Long-term, Multifaceted Vocabulary Produces Eye-Popping Outcomes

Hello Friends!

Time to turn to my greatest passion in terms of literacy research: Vocabulary instruction. Decades of research has demonstrated that vocabulary knowledge is critical to students’ long-term academic achievement, particularly with regard to reading comprehension (August, Carlo, Dressler & Snow, 2005; Chall, Jacobs, & Baldwin, 1990; Cromley & Azevedo, 2007; Davis, 1968; Lesaux, Crosson, Kieffer, & Pierce, 2010; Senechal, etc… 2006). Over the past decade, I have conducted three long-term vocabulary instruction research studies, collaborating with teachers in each grade 2-5 to develop, implement, refine, and test multifaceted vocabulary instruction that is feasible for teachers and produces "more than expected growth" in general vocabulary knowledge for students at all levels/language backgrounds. My teacher colleagues and I have published a number of practical descriptions of our instruction in The Reading Teacher over the last few years, and just recently I have finished research articles on the 4th-5th grade study and the 3rd grade study that are winding their way through the review and publication process. I thought that I would share the most salient outcomes from the Vocabulary and Language Enhancement (VALE) studies here.

First, here is a little overview of VALE instruction (at 3rd Grade - the framework stays the same across the grades, but emphases shift a bit...). VALE was designed to address what I consider to be the "3 Domains" of vocabulary instruction: Quality (teaching high-value words intensively), Quantity (providing efficient instruction in larger sets of related content/curriculum words), and Strategy (teaching word-learning strategies). Here is a look at how this played out in 3rd Grade:

General Component
Focus of Instruction
Schedule of Instruction
Word-learning-strategy instruction
Explicit instruction in
common affixes, the word-part strategy, and use of context cues to infer word meanings
15 weeks x 2 days a week, 20-30 minutes a day.
Word flooding
Efficient introduction and review of large sets of related content words or words taken from literary read aloud texts.
Approximately 10 content units and 10 read aloud texts during the year. Brief routines (5-15 minutes) for introducing and reviewing vocabulary interspersed on multiple days per week.
Target word instruction
Robust instruction on 12 target words per week
3-4 days a week, 10-20 minutes of activities a day.
Teaching vocabulary for application
Sentence imitating to support application of connectives in writing
20-25 weeks x 2-4 days a week, 10-15 minutes a day.
Character trait vocabulary to support application of terms in analytic discussion and writing
15-20 weeks. Routines for introducing vocabulary, text analysis, and essay writing interspersed on multiple days per week.

So, how did the kids do? Vocabulary researchers typically give researcher-designed tests of specifically-taught words/strategies and a standardized test of general vocabulary. Commonly, these studies show that students outperform control students on specifically-taught words but not on normed tests of general vocabulary. Our goal in VALE was to teach vocabulary in such a way that the students would, indeed, show accelerated growth in general vocabulary. I use the Gates-MacGinitie test of general vocabulary as a standardized measure and "Normal Curve Equivalents" as the unit to compare our classes vs. the norming sample. In general, the expectation with NCE's is a "0 effect size," meaning that you would expect a class that starts the year at the 50 NCE to end the year at the 50 NCE. Here are the effect sizes for the 3 years of the 3rd Grade study: 1.45, 0.93, 1.17. These effect sizes demonstrate that the VALE students, in each of year of the project, made greatly accelerated growth in general vocabulary knowledge in comparison to the norming population. A clear sense of the practical importance of the VALE students’ growth resulted from calculating their grade-equivalent scores. This conversion revealed that the VALE students made 3.6, 2.3, and 3.2 years of growth in general vocabulary knowledge, respectively, in the course of one academic year! Importantly, there was no signifcant difference in growth between the lower and higher scoring students from fall testing, meaning that all students, on average, made comparable growth regardless of beginning scores.

The Grade 2 study in dual immersion school involved 6 classes, each taught by a team of two teachers, one teaching in Eng and one teaching in Spanish. The vocab instruction occurred in both English and Spanish, although it looked somewhat different in each language. In the second year of the project, the effect size for growth in English vocabulary knowledge across the 6 classes was 0.42. This effect size is on the high end of “small” (range for small = 0.2 -0.5). These outcomes were achieved in a DI setting in which the students spent only ½ as much time in English instruction as the norming group. In simple terms, these students showed greater gains in general Eng vocab than the norming group despite spending ½ as much time in English instruction! There was no significant difference in growth rate between English Learners and native English Speakers - both groups gained equally.

Overall, I am thrilled with these outcomes! As I mentioned at the beginning, it is common for vocab instruction research to produce gains in specifically taught items but not in general vocabulary knowledge. And, while the former is not unimportant, it is the later that really holds the potential - particularly if it were to occur over several years - to impact students' more general academic performance.

Thanks for taking the time to read about the VALE research. Be on the lookout for more info on these projects here on the CLC, including descriptions of the instructional practices. What kind of questions, thoughts, or connections to your setting does the work raise for you?

Powerful New Research on the Effects of Systematic PD in Phonics Instruction

Hello Friends!

This is research study that I am sharing far and wide. It is also highly relevant to the previous blog post on the journalistic article focused on the "cueing system" approach to beginning reading. So, I wanted to share the key points here. The study was authored by Linnea Ehri, the "great dame" of word recognition research. Here is a bit of the abstract that introduces the details of the study:

Teaching systematic phonics effectively to beginning readers requires
specialized knowledge and training which many primary grade teachers lack. The
current study examined effects of a year-long mentoring program to improve
teachers’ knowledge and effectiveness in teaching phonics and the extent that it
improved students’ achievement in reading and spelling. Teachers in urban, lower
SES schools completed a 45 h course followed by 90 h of in-school training.
Mentors (N = 29) worked with kindergarten, 1st, 2nd, and 3rd grade teachers
(N = 69) twice a week for 30 weeks during the year. Each visit included a 45 min
prep period plus 45 min of modeling and feedback in the classroom. Mentors taught
teachers how to provide systematic phonics instruction to their students
(N = 1,336). Monthly ratings by mentors revealed that teachers improved their
phonics teaching skills with many reaching the highest ratings by May.
Teachers’ agreement with principles of phonics instruction remained
strong or increased from fall to spring. Students’ reading and spelling skills showed
large gains during the year and far exceeded effect sizes from comparable data
sources. Students met grade-level expectations at the end of kindergarten and first
grade.

Just how large were the student gains vs. the norming sample of the Gates reading tests that were used? In first grade, the effect size for decoding was 1.67 (2.22 for ELs!)! This is an enormous effect! In second grade, the EF was 1.05 for decoding and 1.01 for reading comprehension; not as large as first grade, but still extremely large (even on the test of comprehension!).
 
Although it never seems particularly "sexy" to talk about phonics instruction in this day and age, these kinds of gains in reading in a setting with significant lower-SES and EL student populations strike me as what so many schools chase but rarely achieve. What produced these gains? Providing teachers with extensive professional development to enhance their expertise in implementing systematic phonics instruction across the primary grades. Seems like a "doable" approach to me! What do you think?

Cueing Systems and the new Reading Wars

Hello All,
A former student recently sent this link to me, asking about my thoughts on the article:
http://www.apmreports.org/story/2019/08/22/whats-wrong-how-schools-teach-reading. It is a lengthy, award-winning journalistic piece reporting on the teaching of beginning reading, where schools and certain curriculum materials might go wrong, etc... I found the reporting to be quite in-depth and the piece to be an excellent read. It calls into question that most durable of school hallway "folk theories," the 3 Cueing Systems. I particularly appreciate the way that the author fastidiously clarifies terms and holds views accountable for the "necessary consequences" that issue from them. This is not easy to do! I will be fascinated to see if this argument gains further traction in the public domain in the coming years.

We discussed this article in my Elementary Literacy Research and Instruction grad class this term. One student asked a very pertinent question: "I do not understand how teaching (both) cueing systems and phonics does not work. How does one negate the other?" To me, this really gets at the heart of things, as it would be shocking for a teacher today to utterly ignore phonics, even if they were committed to the cueing system model. Here was my response:

 I think that there are "degrees of danger" associated with the cueing system. The highest degree would be teaching contextual cueing to the total exclusion of phonics. I don't think that anyone these days would do that. The next degree would be teaching context strategies in a way that displaces a fair amount of phonics/decoding instruction at a critical time when many students need all of the later they can get. I often say that many students need not only the right stuff, but they also need it at the right intensity. To me, this kind of "displacement" is a real danger, as I have heard teachers talk about their instruction in a way that does indicate that it is a reality. The next degree would be that instruction in the cueing system doesn't take away much at all from phonics instruction but that it does, to some degree, push kids away from engaging in at least some of the hard decoding work that we know is critical to becoming competent early readers. This might not hinder many students, but it may indeed be an obstacle for some. These days, I would say that this (lower) level of "danger" is probably the most common.

Now, overall, I think that the question of "Does one negate the other?" is right at the heart of the matter. In the end, I always want students to have an "experience" with a given word that enables them to read that word "better" or more easily the next time they see it. To my mind - and I think that research overwhelmingly supports this - the key ingredient in such an experience is thorough analysis of the grapheme-phoneme relationships in that word. And, the best, easiest pathway for kids to engage in this analysis is to "decode," to use knowledge of phonics patterns - whether sequential (i.e., cvc) or hierarchical (i.e., vce, etc...) to carefully read a word. When they do this, it sets them on the road to creating lasting bonds in memory between the word's spelling and pronunciation. Reading a word through use of context might impact the degree to which kids experience this in two ways. First, they might get in the habit of using something like a picture cue to "read" the word and then not go back and carefully analyze the actual printed word. This habit would slow down their "automatizing" of whatever words that they do this with. Second, they may not form the habit of doing the hard work of trying to analyze/decode unfamiliar words and instead develop the habit of looking for other pathways to guess and move on.

Significantly, there was a research study that demonstrated that a group of first graders who made more "non-word errors" - i.e., tried like the dickens to sound out an unfamiliar word and ended up with a non-word approximation - ended up better readers late in the year than kids who substituted meaningful words for such unfamiliar words. So, in other words - mindset and habits matter. Kids who develop the mindset and habit that they are going to try very hard to use their phonics knowledge and thoroughly analyze unfamiliar words are better off in the long run than those who slip off into the practice of making context-facilitated guesses. To me, this does suggest that an emphasis on the cueing system can, at times, "negate" the benefits of phonics instruction by pushing kids away from the mindset and habit of doing the hard work of word analysis.

If you have the time, check out the article and share your comments or questions here!