I thought this part of the article nicely summed up the point that while these tests definitely are not perfect predictors, they're pretty impressive nevertheless:
In 2006, David Lohman, a psychologist at the University of Iowa, co-authored a paper called “Gifted Today but Not Tomorrow?” in the Journal for the Education of the Gifted, demonstrating just how labile “giftedness” is. It notes that only 45 percent of the kids who scored 130 or above on the Stanford-Binet would do so on another, similar IQ test at the same point in time. Combine this with the instability of 4-year-old IQs, and it becomes pretty clear that judgments about giftedness should be an ongoing affair, rather than a fateful determination made at one arbitrary moment in time. I wrote to Lohman and asked what percentage of 4-year-olds who scored 130 or above would do so again as 17-year-olds. He answered with a careful regression analysis: about 25 percent. The implications of this number are pretty startling. They mean that three quarters of the seniors in a gifted program would no longer test into that program if asked to retake an IQ test on graduation day. So I wrote Lohman back: Was he certain about this? “Yes,” he replied. “Even people who consider themselves well versed in these matters are often surprised to discover how much movement/noise/instability there is even when correlations seem high.” He was careful to note, however, that this doesn’t mean IQ tests have no predictive value per se. After all, these tests are better—far better—at predicting which children will have a 130-plus IQ at 17 than any other procedure we’ve devised. To have some mechanism that can find, during childhood, a quarter of the adults who’ll test so well is, if you think about it, impressive. “The problem,” wrote Lohman, “is assigning kids to schools for the gifted on the basis of a test score at age 4 or 5 and assuming that their rank order among age mates will be constant over time.”
I think the 25% figure (while dramatic for the story) might be a little misleading. Lohman does not seem to be suggesting that the tests are accurate only 25% of the time and worthless 75% of the time -- I suspect that he'd predict that most of the 75% of 4-year-olds who previously scored 130+, but would not later repeat that feat, would nevertheless score higher than average. At another point, the NYMag article suggests that a given child's score might fluctuate 10 points up or down over time. That's about 10% in each direction. To me at least, it seems pretty amazing that a test could remain accurate to 10% over time.
Very interesting stuff. Thanks for posting, OP.
|