HarperCollins, PRH Adopt the Flawed Lexile Book Rating System

lexile Pop Quiz: Would you trust a book rating system that told you that Sports Illustrated for Kids' Awesome Athletes! was a more complex read than Jane Eyre, Huckleberry Finn, or To Kill a Mockingbird?If the answer is no, then congratulations. You've just proven yourself smarter than many US publishers.

A new press release crossed my desk today which shared the news that a number of publishers, including HarperCollins and Penguin Random House, will soon be joining Macmillan, S&S, Scholastic, etc in providing Lexile scores for their children's titles.

Originally invented in the 1980s, Lexile is a system for assigning a numerical reading score to books. It's pitched as a better alternative to the more holistic reading level assessment historically used by teachers and librarians which replaces an expert's opinion with a mechanical calculation. Lexile's creator, MetaMetrics, uses a proprietary algorithm which analyzes sentence length and vocabulary of the text of a book and come up with a number between zero and 1,600.

The scores can be matched up to grade levels, more or less:

mblexilelevels_wicc[1]

Having been adopted as part of the Common Core standards, Lexile is having its day in the sun. Publishers are adopting it left and right, schools are using it to buy books, and everything is peachy.

Or at least it would be, if not for the fact that Lexile is - at best - flawed.

While it is indeed possible to guesstimate the reading level of a text (MSWord and other office apps have a similar feature) the algorithm used to generate a Lexile score frequently results in scores that simply don't make any sense.

For example, the Lexile score for Sports Illustrated is actually higher than the one for Jane Eyre. With a score of only 870, To Kill a Mockingbird is only a fourth-grade read, while a children's book like Mr. Popper’s Penguins (with a respectable Lexile score of 910) is deemed more complex. Raymond Carver's Cathedral, on the other hand, scored a weak 590, about the same as Curious George Gets a Medal.

The New Republic reported on Lexile last fall, and they posted this handy graphic which illustrates some of the more questionable scores.

I confess that I have not read most of the books listed, so I can't comment on their difficulty, but any system that would rate the first volume of Lord of the Rings as being less complex than Mr Poppers Penguins is not one I would trust.

And I'm not the only one; even the creators of the Common Core admit that Lexile is flawed:

As the Common Core Standards Initiative officially puts it, “until widely available quantitative tools can better account for factors recognized as making such texts challenging, including multiple levels of meaning and mature themes, preference should likely be given to qualitative measures of text complexity when evaluating narrative fiction intended for students in grade 6 and above.” But even here, the final goal is a more complex algorithm; qualitative measurement fills in as a flawed stopgap.

15455219752_9d15050462And yet it's still being adopted widely and "recognized as the global standard for matching readers with texts", which is not at all an exaggeration.

While researching this story I found many graphics which explain how to use Lexile scores to match books up with the various grade levels.

Even Scholastic posted one.

I'm sure you've heard of New Math, right? Welcome to New Reading.

To be fair to the publishers, they might only be adopting Lexile scores because teachers and librarians asked for the scores. And some of the teachers and librarians might not have a choice; use of the scores might be mandated by their school board or principal.

But even if that is the case, I would much rather see the publishers explain why they weren't using Lexile by pointing out the issues to everyone who asked. If they really see themselves as the bulwark of book culture then this is exactly the kind of thing that they should be defending against.

image by JD Hancock

About Nate Hoffelder (11590 Articles)
Nate Hoffelder is the founder and editor of The Digital Reader:"I've been into reading ebooks since forever, but I only got my first ereader in July 2007. Everything quickly spiraled out of control from there. Before I started this blog in January 2010 I covered ebooks, ebook readers, and digital publishing for about 2 years as a part of MobileRead Forums. It's a great community, and being a member is a joy. But I thought I could make something out of how I covered the news for MobileRead, so I started this blog."

5 Comments on HarperCollins, PRH Adopt the Flawed Lexile Book Rating System

  1. Just for fun, I looked up Asimov: his books score in the low 800’s. 790 for THE GODS THEMSELVES.
    Which, on the one hand is obviously a reflection of his lean accessible prose but…
    Come on! You don’t give THE GODS THEMSELVES to a fourth grader!
    🙂

1 Trackbacks & Pingbacks

  1. Oyster Goes Social for Discovery | Digital Book World

Leave a comment

Your email address will not be published.


*