Achievement beyond IQ: childhood self-regulation

Last Updated on October 5, 2021

In previous posts, I have emphasized the predictive power of IQ on a variety of outcomes such as education academic achievement, educational attainment, occupational prestige, income, and crime. I referenced studies showing that IQ is a better predictor of many of these outcomes compared to other metrics traditionally assumed to predict success. For example, many studies (which I reference again below) show that IQ predicts education, occupation, and income better than many metrics that people assume to be predictors of success – e.g. parental SES, parental income, parental education, etc.

Such data might lead some to believe that IQ is by far the single best predictor of conventional measures of success within Western societies. I wish to challenge that idea in this post. I do not necessarily deny that IQ is generally the best predictor of many conventional measures of success. Rather, I insist that there are a variety of personality traits that are better predictors (or at least not by far worse predictors) for certain measures of success. There are many personality traits that I could use to support my argument, such as conscientiousness (see Poropat (2008) and Bogg and Roberts (2004)) or locus of control (see Heckman et al. (2006)). In this post, I will focus on self-regulation. I will present data showing that self-regulation predicts a variety of important outcomes independent of various confounders (including IQ and parental SES).

Definitions


I will use a broad definition of “self-regulation” presented by Duckworth and Carlson (2013) [archived] which is “the voluntary control of attentional, emotional, and behavioral impulses in the service of personally valued goals and standards.” “Self-regulation” on this definition is an umbrella term that covers several capacities such as self-discipline, impulse control, willpower, the ability to delay gratification, etc. The capacities that will be considered in the studies that follow are self-control, attention span-persistence, and effortful control. Duckworth and Gross (2014) [archived] define “self-control” as “the capacity to regulate attention, emotion, and behavior in the presence of temptation.” and state that this capacity is required to adjudicate conflicting action tendencies – “one corresponding to a momentarily alluring goal and the other corresponding to a more valued goal whose benefits are deferred in time, more abstract, or otherwise more psychologically distant.” McClelland et al. (2012) [archived] define “attention span-persistence” as “selecting and attending to relevant information, such as listening to the teacher, and persisting on a task.” Valiente and Lemery-Chalfant (2010) define “effortful control” as the “the ability to inhibit a dominant response to perform a subdominant response.” Under these definitions, many of these terms can perhaps be used interchangeably. I mention the definitions here simply for clarity.

Ridder et al. (2011) [archived] conducted a meta-analysis that examined over 100 studies on the association between self-control and behavior. The analysis found that “that dispositional self-control is related to a wide spectrum of human functioning, including love, happiness, binge eating, alcohol use, getting good grades, commitment in a relationship, occasional speeding, and lifetime delinquency” (page 89). While these results are important, the studies that best demonstrate the predictive power of self-control are prospective longitudinal studies which examine the association between early self-control and outcomes later in life. What is particularly useful are studies that control for relevant confounders such as IQ, parental SES, etc. I will cover some such studies in the rest of the post. Many of these studies are mentioned in a review by Duckworth and Gross (2014) [archived].

The predictive validity of childhood self-regulation


Academic Achievement

Duckworth and Seligman (2005) [archived] performed two prospective, longitudinal studies to investigate the impact of self-discipline on academic performance. Each study involved two separate cohorts of 8th graders from a socioeconomically and ethnically diverse magnet public school in a city in the Northeast. Both studies measured self-discipline in the fall and examined the relationship between measured self-discipline and academic achievement 7 months later in the following spring. The methods and results for the two studies are as follows:

  • The first study measured self-discipline for 140 8th graders in the fall of 2002 based on a composite using questionnaire data from students, parents, and teachers, and delay-of-gratification data. This study employed the Eysenck 1.6 Junior Impulsiveness Subscale (EJI) and the Brief Self-Control Scale (BSC) for the self-reports. Parents and teachers completed the Self-Control Rating Scale (SCRS) to measure the self-discipline for each participant. Finally, researchers also used the Kirby Delay-Discounting Rate Monetary Choice Questionnaire as a measure of the ability to delay gratification; each question in the questionnaire asks the respondent to choose either a smaller, immediate reward or a larger, delayed reward. The results of the study revealed a strong correlation between fall self-discipline and final GPA (r=0.55) and between fall self-discipline and spring achievement test (r=0.29) (Table 2).
  • The second study produced largely similar results for 160 8th graders in the fall of 2003. Self-reports of self-discipline were again measured using EJI and BSC. For parent and teacher reports of self-discipline, the SCRS was replaced with the BSC. Further, researchers added a behavioral measure of the ability to delay gratification: each participant was given a $1 bill and was asked to either take the dollar at that moment or return it to the researchers in exchange for $2 a week later. In this study, researchers also measured the IQ of the participants in the fall. The study found that self-discipline predicted academic performance better than IQ. Specifically, the correlation between self-discipline and final GPA (r=0.67) was significantly higher than the correlation between IQ and GPA (r=0.32) (table 2) (note, however, that the IQ-GPA raises to 0.49 after correcting for range restriction). Also, the correlation between self-discipline and Spring achievement tests (r=0.43) was non-significantly higher than the correlation between IQ and Spring achievement tests (r=0.36). Also, students with self-discipline in the bottom two quintiles had worse GPAs than students with IQs in the bottom two quintiles. Likewise, students with self-discipline in the top two quintiles had better GPAs than students with IQs in the top two quintiles (Figure 1).

Duckworth et al. (2012) [archived] also conducted two longitudinal, prospective studies of middle school students to compare the relative impacts of self-control and intelligence on academic achievement. Both studies supported the authors’ hypothesis that “standardized achievement test scores assess competencies determined more by intelligence than by self-control, whereas report card grades assess competencies determined more by self-control than by intelligence.” The methods and results for the two studies are as follows:

  • The first study was a data analysis of a sample of the 1,364 students in the NICHD Study of Early Child Care and Youth Development (NICHD-SECCYD). Self-control and IQ data were collected from participants in the 4th grade. Self-control was measured by reports from the participant’s mother, father, and teacher. IQ was measured using the Wechsler Abbreviated Scale of Intelligence (WASI). These measures of self-control and IQ were used to predict grades and standardized test scores during their middle school years. Self-control, particularly teacher-reported self-control, was significantly associated with middle school GPA. In fact, 8th grade GPA correlated just as strongly with 4th grade teacher-reported self-control as with 4th grade IQ (r=0.44). For comparison, the correlation between 8th grade GPA and 5th grade achievement test scores was r=0.42 (Table 2).
  • The second study produced similar results. This study involved 510 5th through 8th grade students at two public schools in New York City. Self-control was measured at the beginning of the school year using reports from homeroom teachers, parents, and students who completed the Impulsivity Scale for Children (ISC) test with students as targets. IQ was measured using scores on the Raven’s Progressive Matrices test. Again, teacher-reported self-control was more predictive of success than other measures of self-control. The study found that, while IQ outperformed teacher-reported self-control in predicting spring achievement test scores (r=0.46 vs r=0.32), teacher-reported self-control outperformed IQ in predicting spring GPA (r=0.55 vs r=0.40) (table 3).
  • In both studies, researchers compared the predictive power of IQ and self-control on later grades after controlling for earlier grades, and they compared the predictive power of IQ and self-control on achievement tests after controlling for earlier achievement test scores. The goal was to determine how well IQ and self-control predict changes in grades and achievement tests. Researchers found that, after controlling for prior grades, self-control predicted improvements in grades in both studies, whereas IQ only predicted improvements in the first study (and it had lower predictive power than self-control). By contrast, after controlling for prior achievement tests, IQ (but not self-control) predicted improvements in achievement test scores. So self-control was a better predictor of improvements in GPA whereas IQ was a better predictor of improvements in standardized achievement test scores.

Valiente and Lemery-Chalfant (2005) [archived] examined the relations between effortful control, emotionality, and academic achievement in a short-term longitudinal study of 291 kindergartners. In the fall of the school year, effortful control and emotionality were measured using teacher and parent reports. Student emotionality was measured using the Anger, Sadness, and Shyness scales of the Child Behavior Questionnaire (CBQ). Researchers also recorded measures of verbal intelligence (based on the Peabody Picture Vocabulary Test) and socioeconomic status (SES). Academic achievement was measured in the spring according to student performance on the math and reading subtests of the Woodcock–Johnson test (WJ-III). The study revealed a positive association between fall effortful control and spring achievement, and a negative association between certain measures of emotionality and spring achievement (though many of these effects were qualified by interactions with effortful control). Some of the particular findings include:

  • At low levels of anger or sadness, students high in effortful control performed best. At high levels of these emotions, all children performed similarly.
  • The correlations between fall teacher-reported effortful control and spring math and reading achievement, respectively, were r=0.33 and r=0.28 (Table 1). For comparison, the same respective correlations with fall verbal intelligence were r=0.37 and r=0.33. And the same respective correlations with fall SES were r=0.31 and r=0.24. So effortful control had a slightly stronger relationship with achievement than parental SES, and had a slightly weaker relationship than verbal intelligence.
  • The relationship between effortful control and achievement remained significant after controlling for children’s verbal intelligence, SES, and sex (page 556).

Duncan et al (2007) [archived] sought to estimate the links between three key elements of school readiness — school-entry academic, attention, and socioemotional skills — and later school reading and math achievement. The scope of the study was unprecedented compared to prior school readiness research. Researchers analyzed data from six large-scale longitudinal data sets, two of which were nationally representative of U.S. children. All six data sets provided measures of children’s academic, attention, and socioemotional skills at about age 5 or 6. These are considered measures of school-entry skills since most children begin elementary school at around this age. Each data set provided later measures of academic achievement outcomes some years later. The timing of the later assessments ranged from third grade (~age 8-9) to age 13-14 depending on the particular data set. The six data sets in total involved thousands of children. Academic achievement outcomes were assessments of reading and math achievement measured using teachers’ reports, test scores, and grade retention. Attention and socioemotional behaviors were measured using mothers’ reports, teachers’ reports, and observational data. The results are summarized as follows:

  • Later achievement correlated most strongly with school-entry math skills (r=0.47) and school-entry reading skills (r=0.44) (column 1 of Table 3). Attention skills (r=0.25) and social skills (r=0.21) were also positively correlated with achievement outcomes. As expected, measures of externalizing problems (r=–0.14) and internalizing problems (r=–0.10) were negatively correlated with later achievement outcomes. The influences of school-entry achievement, attention, and socioemotional skills are broadly similar for both boys and girls and for children from both low- and high-SES families (page 1437).
  • Next, researchers conducted a meta-analysis of the standardized regression coefficients from the individual study regressions. These regressions were based on achievement outcomes measured as late in childhood as possible. These regression give better estimates of the association between a specific school-entry skill and achievement outcome, holding constant the other skills. They also included controls for family background and child characteristics (e.g. child’s race and ethnicity, maternal education, family structure, and family income or economic well-being) that might be confounded the school-entry skills of interest (page 1436). Further, the researchers also control for child’s cognitive/academic, attention, and socioemotional skills prior to school entry (page 1436). The result was that only reading, math, and attention school-entry skills were associated with later achievement outcomes (page 1437). More specifically, school-entry math skills seemed to matter the most (standardized coefficient of 0.33), with school-entry reading skills (0.13) and attention skills (0.07) also having some independent predictive validity. Behavior problems and social skills were not associated with later achievement outcomes.

One point is worth noting about the regression analysis described here. The authors consider the possibility that early attention skills may influence later achievement by influencing school-entry achievement skills, in which case controlling for school-entry achievement may deprive attentions skills of some of its explanatory power (page 1441). To investigate this possibility, the authors re-estimated the model just described without school-entry measures of reading and math skills (but retaining all other control variables). The standardized coefficient for school-entry attention skills rose to 0.13 (compared to 0.07 when school-entry measures of reading and math skills were included in the model). However, the authors note that the larger effect estimated for attention skills in this revised model “may be due in part to their correlation with the omitted school-entry achievement measures rather than to a true mediation through achievement” (page 1441). Further, because the study “focuses on behavior during the years just before and at the point of school entry” (because their model controls for academic, attention, and socioemotional skills prior to school-entry), the study may fail to detect some of the effect of attention and socioemotional skills insofar as such skills are “well established before the preschool years, and unchanging during these years” (page 1441).

Beyond academic achievement

McClelland et al. (2012) [archived] examined the association between children’s attention span-persistence in preschool and later school achievement and college completion. Researchers studied 430 children drawn from the Colorado Adoption Project. Measures of attention span-persistence at age 4 were obtained from parent-reports on the Attention Span-Persistence subscale of the Colorado Child Temperament Inventory (CCTI). Vocabulary skills at age 4 were assessed using the Peabody Picture Vocabulary Test (PPVT). This subscale contained 5 total questions with answers ranging from 1 to 5 which are summed to obtain the subscale and total score (i.e. total score for the subscale ranges from 5 to 25). Reading skills were measured at ages 7 and 21 using the Reading Recognition subtest of the Peabody Individual Achievement Test (PIAT). Math skills at age 7 were assessed using the Wechsler Intelligence Scale for Children-Revised (WISC-R) Arithmetic subscale. Math skills at age 21 were assessed using the Wechsler Adult Intelligence Scale-III (WAIS-III) Arithmetic subscale. The results were as follows:

  • Children’s age 4 attention span-persistence significantly predicted math and reading achievement at age 21 after controlling for achievement levels at age 7, adopted status, child vocabulary skills, gender, and maternal education level.
  • Children’s age 4 attention span-persistence skills significantly predicted the odds of completing college by age 25. More specifically, “for each single point higher a child was rated on attention span-persistence at age 4, s(he) was 14% more likely to graduate from college by age 25” after controlling for adopted status, child vocabulary skills, gender, and maternal education level (table 2). For reference, the average score on the attention span persistence test was 17.93 (out of 25) with a standard deviation of 3.05 (table 1). To help interpret this effect, the researchers report that children who were rated one standard deviation higher on attention span-persistence at age 4 had 48.7% greater odds of completing college by age 25 after controlling for vocabulary at age 4, gender, adoption status, and maternal education. The majority of this relationship was direct and was not significantly mediated by math or reading skills at age 7 or age 21.

Moffitt et al. (2011) [archived] followed a cohort of 1,000 children from birth to the age of 32 years. The participants are members of the Dunedin Multidisciplinary Health and Development Study, which tracks the development of individuals born in 1972–1973 in Dunedin, New Zealand. Self-control was measured using “observational ratings of children’s lack of control (3 and 5 y of age) and parent, teacher, and self-reports of impulsive aggression, hyperactivity, lack of persistence, inattention, and impulsivity (5, 7, 9, and 11 y of age)” (page 2698). Researchers showed that childhood self-control predicts adulthood physical health, substance dependence, personal finances, and criminal offending outcomes even after controlling for social class origins and IQ. Specifically, the results were as follows:

  • At adulthood, participants were categorized into quintiles based on their measures of self-control during childhood. For example, the highest and lowest fifths of the population on measured childhood self-control had respective rates of annual income under NZ $20,000 of 10% vs. 32%, rates of single-parent household childrearing of 26% vs. 58%, and crime conviction rates of 13% vs. 43% (page 2697, also see Figure 2).
  • The association between childhood self-control and adulthood outcomes persisted even after controlling for social class origins and IQ (pages 2694-2695). In fact, childhood self-control was a better predictor than childhood social class and IQ for certain outcomes, including e.g. odds of single-parent child rearing or criminal convictions (page 2695).

Fergusson et al. (2013) sought to replicate the findings from Moffitt et al. (2011). Specifically, this study aimed to examine the association between childhood self-control and adult outcomes after adjusting for the correlated effects of childhood conduct problems. The study examined a birth cohort of 1,265 children born in the Christchurch (New Zealand) urban region in mid-1977. The cohort was studied at birth, at 4 months, at 1 year, and annually to age 16 years, and again at ages 18, 21, 25, and 30 years. At ages 6, 7, 8, 9, and 10 years, parent- and teacher-reports on self-control were obtained. At 12 years, self-reports for self-control were also obtained. Socioeconomic status was measured at the time of participant birth using the Elley-Irving scale of SES for New Zealand. IQ was assessed at ages 8 and 9 using the Revised Wechsler Intelligence Scale for Children (WISC-R). A measure of childhood conduct problems was constructed using parent and teacher reports obtained at each year from ages 6 to 10 years. The results were as follows:

  • Consistent with the results of the Moffit study, participants with lower levels of childhood self-control had significantly worse life outcomes at adulthood. For example, the highest and lowest fifths of the population on measured childhood self-control had respective rates of sub-median incomes of 38% vs. 56%, rates of gaining a university degree of 54% vs. 7%, rates of nicotine dependence of 18% vs. 50%, arrest/conviction rates of 8% vs 46%, and rates of 10 or more violent offenses of 2% vs 19% (Table 2).
  • The association between childhood self-control and adulthood outcomes persisted even after controlling for gender, IQ, and parental SES (Table 3). For example, after controlling for gender, IQ, and parental SES, children who were measured one standard deviation higher on self-control were 0.61 times as likely to be arrested/convicted and 2.2 times as likely to gain a university degree.
  • After including childhood conduct problems in the set of controls, the association between childhood self-control and most of the adulthood outcomes were reduced. The exceptions to this were for violent offending and for education/employment outcomes (pages 714, 716). Self-control was associated with these outcomes even after controlling for gender, IQ, parental SES, and childhood conduct problems. The reduced association here suggests that the association between childhood self-control and adulthood outcomes may be partially the result of the fact that children with low self-control are more likely to exhibit childhood/adolescent conduct problems and the fact that children who exhibit childhood/adolescent conduct problems are more likely to engage in crime at adulthood.

Causal or merely predictive?


The above studies establish the predictive validity of childhood self-regulation even after controlling for covariates such as parental SES and IQ. Many of the studies show that self-regulation is a better predictor of certain positive outcomes than parental SES and IQ. None of this proves that self-regulation causes certain positive outcomes. It remains possible that there could be some other variable that correlates with self-regulation which is causing these positive outcomes. While this is possible, I don’t believe that this diminishes the importance of self-regulation in any way. The main value of studying any psychometric trait, I believe, lies in its unique ability to predict outcomes that we care about. By “unique” ability, I’m referring to the ability to predict these outcomes even after adjusting for all potential confounders that seem plausible relevant. It ultimately does not matter whether self-regulation is causal or “merely” predictive if its predictive validity cannot be reduced to other variables. Regardless, there is some evidence that self-regulation causes many of these important life outcomes. For example, Duckworth et al. (2010) has provided evidence for the causal role of self-control on academic achievement.