WWC GrowthMindset IR Report
WWC GrowthMindset IR Report
WWC GrowthMindset IR Report
Large numbers of students who enroll in college do not This What Works Clearinghouse (WWC) report, part of
complete a degree. Yet, earning a college degree is one of the the WWC’s Supporting Postsecondary Success topic area,
primary pathways for economic success and is increasingly explores the effects of Growth Mindset interventions on
required for good jobs and high wages.1 The way students postsecondary students’ academic achievement, college
interpret early academic struggles in college may affect enrollment, and progressing in college. The WWC identified
whether or not they remain enrolled. If students attribute 15 studies of Growth Mindset interventions. Six of these
their academic challenges to a perceived lack of intelligence studies meet WWC standards. The evidence presented in
or inability to succeed in college, they may be less likely to this report is from studies of the impact of Growth Mindset
persist.2 Growth Mindset interventions aim to improve college interventions on postsecondary students—including Black,
persistence and academic achievement by encouraging White, Hispanic, first-generation, and Pell grant-eligible
students to view intelligence as a “malleable” characteristic students—in both public and private postsecondary settings.
that grows with effort, and to view academic challenges as
temporary setbacks that they can overcome.3
Table 1. Summary of findings on Growth Mindset interventions from studies that meet WWC standards
Study findings Evidence meeting WWC standards (version 4.0)
Improvement index
Outcome domain Effectiveness ratinga (percentile points) Number of studies Number of students
Academic achievement Potentially positive effects +13 5 5,301
College enrollment No discernible effects +1 2 8,194
Progressing in college No discernible effects -2 3 8,351
Note: The improvement index can be interpreted as the expected change in percentile rank for an average comparison group student if that student had received the
intervention. For example, an improvement index of +13 means that the expected percentile rank of the average comparison group student would increase by 13 points if the
student received a Growth Mindset intervention. The improvement index values are generated by averaging findings from the outcome analyses that meet WWC standards, as
reported by Aronson et al. (2002), Bostwick & Becker-Blease (2018), Broda et al. (2018), Fink et al. (2018), Suh et al. (2019), and Yeager et al. (2016). A positive or negative
improvement index does not necessarily mean the estimated effect is statistically significant. Academic achievement outcomes reported in these studies include semester or
quarter grade point average (GPA), final exam score, and course passing rate. College enrollment outcomes reported in these studies include full-time enrollment rate, which
is the percentage of students enrolled full-time. Progressing in college outcomes reported in these studies include the percentage of students completing 12 or more college
credits in a semester and the rate of retention to the following semester. The effects of Growth Mindset interventions are not known for other outcomes within the Supporting
Postsecondary Success topic area, including college attendance, postsecondary degree attainment, credential attainment, employment, or earnings.
a
Effectiveness ratings were determined according to version 4.0 of the WWC Procedures Handbook. Version 4.1 of the WWC Procedures Handbook introduces fixed-effects
meta-analysis and a revised approach to determining effectiveness ratings. Effectiveness ratings may differ depending on whether an intervention is assessed using the version
4.0 or version 4.1 WWC Procedures.
1
BOX 1. HOW THE WWC REVIEWS AND DESCRIBES EVIDENCE
The WWC evaluates evidence based on the quality and results of reviewed studies. The criteria the WWC uses for evaluating
evidence are defined in the Procedures and Standards Handbooks and the Review Protocols. The studies summarized in this report
were reviewed under WWC Standards (version 4.0) and the Supporting Postsecondary Success topic area protocol (version 4.0).
To determine the effectiveness rating, the WWC considers what methods each study used, the direction of the effects, and the
number of studies that tested the intervention. The higher the effectiveness rating, the more certain the WWC is about the reported
results and about what will happen if the same intervention is implemented again. The following key explains the relationship between
effectiveness ratings and the statements used in this report:
2
Table 2. Components of Growth Mindset interventions
Research Summary
The WWC identified 15 studies that investigated the reported for long-term retention in college, on the WWC
effectiveness of Growth Mindset interventions with website (https://whatworks.ed.gov).
postsecondary students (Figure 1):
These supplemental findings and findings from studies that
• Five studies meet WWC group design standards without either do not meet WWC standards or are ineligible for
reservations review do not contribute to the effectiveness ratings.
• One study meets WWC group design standards with The six studies of Growth Mindset interventions that meet
reservations WWC group design standards reported findings on academic
• Four studies do not meet WWC group design standards achievement, college enrollment, and progressing in
• Five studies are ineligible for review college. No other findings in the studies meet WWC group
design standards within any outcome domain included in
The WWC reviews findings on the interventions’ effects the Supporting Postsecondary Success topic area.6 Citations
on eligible outcome domains from studies that meet for the 10 studies reviewed for this report are listed in the
standards, either with or without reservations. Based on this References section, which begins on page 14. Citations for
review, the WWC generates an effectiveness rating, which the five studies that are ineligible for review and the reasons
summarizes how the intervention impacts, or changes, a the WWC determined they were ineligible are also listed in
particular outcome domain. The WWC reports additional the References section.
supplemental findings, such as those the study authors
3
Figure 1. Effectiveness ratings for Growth Mindset interventions
Main Findings
Table 4 shows the findings from the six Growth Mindset indicating evidence of positive effect with no overriding
intervention studies that meet WWC standards. The table contrary evidence. These findings are based on 5,301
includes WWC calculations of the mean difference, effect students. The effectiveness ratings for college enrollment
size, and performance of the intervention group relative and progressing in college is no discernible effects, indicating
to the comparison group. Based on findings from the six no affirmative evidence of effects. These findings are based
studies that meet WWC standards, the effectiveness rating on 8,194 and 8,351 students, respectively.
for academic achievement is potentially positive effects,
4
Table 4. Findings by outcome domain from studies of Growth Mindset interventions that meet
WWC standards
Mean
(standard deviation) WWC calculations
Sample Intervention Comparison Mean Effect Improvement
Measure (study) Study sample size group group difference size index p-value
Quarter grade point Growth Mindset vs. 51 3.46 3.19 0.27 0.85 +30 <.01
average (GPA; Aronson control (0.30) (0.33)
et al. 2002)a pen-pal
Final exam score Growth Mindset vs. 173 80.00 77.00 3.00 0.27 +11 .08
(Bostwick & Becker- fixed mindset (10.0) (12.0)
Blease 2018)b
Semester grade point Growth Mindset vs. 4,357 3.18 3.14 0.04 0.05 +2 .09
average (GPA; Broda et comparison (0.75) (0.78)
al. 2018)c
Final exam score (Fink Growth Mindset vs. 565 64.90 63.60 1.30 0.05 +2 .57
et al. 2018)d comparison (27.30) (27.20)
Course passing rate (%) Growth Mindset vs. 155 64.8 32.8 32.0 0.80 +29 .17
(Suh et al. 2019)e laughter/stress
Final exam score (Suh Growth Mindset vs. 74 73.68 74.24 -0.56 -0.04 -2 .94
et al. 2019)e laughter/stress (12.58) (15.08)
Outcome average for academic achievement across all studies 0.32 +13
Full time enrollment Growth Mindset vs. 4,357 96.0 96.0 0.00 0.00 0 >.99
rate (%) (Broda et al. comparison
2018)c
Full time enrollment Growth Mindset vs. 3,837 90.0 89.0 1.00 0.06 +3 .32
rate (%) (Yeager et al. comparison
2016)f
Outcome average for college enrollment across all studies 0.03 +1
College credits Growth Mindset vs. 4,357 13.18 13.12 0.06 0.03 +1 0.41
completed (Broda et al. comparison (2.32) (2.46)
2018)c
Retention to the Growth Mindset vs. 157 74.2 80.9 -6.70 -0.23 -9 0.63
following semester (%) laughter/stress
(Suh et al. 2019)e
Completed 12 or more Growth Mindset vs. 3,837 88.0 87.0 1.00 0.06 +2 0.35
college credits (%) comparison
(Yeager et al. 2016)f
Outcome average for progressing in college across all studies -0.05 -2
Notes: For mean difference and effect size values reported in the table, a positive number favors the intervention group and a negative number favors the comparison group.
The effect size is a standardized measure of the effect of an intervention on outcomes, representing the average change expected for all individuals who are given the
intervention (measured in standard deviations of the outcome measure). An indicator of the effect of the intervention, the improvement index can be interpreted as the expected
change in percentile rank for an average comparison group student if that student had received the intervention. For example, an improvement index of +13 means that the
expected percentile rank of the average comparison group student would increase by 13 points if the student received a Growth Mindset intervention. A positive or negative
improvement index does not necessarily mean the estimated effect is statistically significant. Some statistics may not sum as expected due to rounding.
a
Aronson et al. (2002) did not require corrections for clustering or multiple comparisons nor difference-in-differences adjustments. The intervention and comparison group
means and standard deviations presented here were calculated by the WWC using data reported in the study and data provided in response to an author query. In the study,
the authors reported means, but not standard deviations, for the intervention and “control pen-pal” comparison groups separately for Black and White subgroups. In response
to an author query, the authors provided unadjusted standard deviations for students in the control pen-pal and “no pen-pal” comparison groups combined, both overall and for
Black and White subgroups. The WWC aggregated the Black and White subgroup means from Table 1 of the study using the unadjusted standard deviations for the combined
comparison groups to calculate the mean and standard deviation for all students in the control pen-pal comparison group only. The effect size and p-value reported here were
calculated by the WWC because the authors did not report these values separately for the difference between the intervention and control pen-pal comparison group. This study
is characterized as having a statistically significant positive effect on academic achievement because the mean effect reported is positive and statistically significant.
b
Bostwick & Becker-Blease (2018) did not require corrections for clustering or multiple comparisons nor difference-in-differences adjustments. The effect size and p-value
presented here were calculated by the WWC using the unadjusted means and standard deviations reported for the intervention and “fixed mindset” comparison groups because
the authors did not report these values separately for the difference between the intervention and fixed mindset comparison group. This study is characterized as having a
potentially positive effect on academic achievement because the effect size is ≥ 0.25 but not statistically significant
c
Broda et al. (2018) did not require corrections for clustering or multiple comparisons nor difference-in-differences adjustments. The effect sizes presented here were calculated
by the WWC using the unadjusted means and standard deviations for academic achievement and progressing in college and the dichotomous method for college enrollment.
The p-values presented here were calculated by the WWC. This study is characterized as having indeterminate effects on academic achievement, college enrollment, and
progressing in college because the mean effects are not statistically significant.
d
Fink et al. (2018) did not require corrections for clustering or multiple comparisons nor difference-in-differences adjustments. The effect size presented here was calculated
by the WWC. To calculate the effect size, the WWC converted standard errors to standard deviations and calculated the unadjusted and adjusted means for the full sample by
5
Table 4. Findings by outcome domain from studies of Growth Mindset interventions that meet
WWC standards (continued)
aggregating across findings by race and sex categories reported in Appendix 3, Table 4 of the study. The study is characterized as having an indeterminate effect on academic
achievement because the mean effect is not statistically significant.
e
Suh et al. (2019) required corrections for clustering because the reported analyses did not take into account the clustering of students within course sections. The WWC
also applied a correction for multiple comparisons in the academic achievement domain.The effect sizes and p-values presented here were calculated by the WWC because
the authors did not report these values separately for the difference between the intervention and “laughter/stress” comparison group. This study is characterized as having a
potentially positive effect on academic achievement because the mean effect size is ≥ 0.25 but not statistically significant and an indeterminate effect on progressing in college
because the effect size is < 0.25 and not statistically significant.
f
Yeager et al. (2016) did not require corrections for clustering or multiple comparisons nor difference-in-differences adjustments. The effect sizes presented here were calculated
by the WWC using the dichotomous method for college enrollment and progressing in college. The p-values presented here were calculated by the WWC. This study is
characterized as having indeterminate effects on college enrollment and progressing in college because the mean effects are not statistically significant.
For more information, please refer to the WWC Procedures Handbook, version 4.0, page 22.
Race Ethnicity
8% 6% 63% 24% 87% 13%
Asian Black White Other Non-Hispanic Hispanic
Grades PK K 1 2 3 4 5 6 7 8 9 10 11 12 PS
Postsecondary
6
Table 5. Summary of findings from Aronson et al. (2002)
Meets WWC Group Design Standards Without Reservations
Study findings
WWC evidence Meets WWC Group Design Standards Without Reservations. This is a randomized controlled trial (RCT) with low
rating attrition. For more information on how the WWC assigns study ratings, please see the WWC Procedures and Standards
Handbooks (version 4.0) and WWC Standards Briefs, available on the WWC website.
Setting The study took place at a private four-year university in California. Groups of two to five undergraduate students participated
in the study together in a laboratory setting on campus.
Methods The study authors randomly assigned 109 students blocked by race (White or Black) to one of three groups, a “malleable
pen-pal” Growth Mindset intervention group (37 students), a “control pen-pal” comparison group (34 students), or a “no
pen-pal” comparison group (38 students). This review prioritized findings for the intervention group versus the control pen-
pal group to be consistent with other studies reviewed for this report and because this condition better isolates the effect of
the growth mindset intervention.8 The analytic sample included 28 students in the intervention and 23 in the control pen-pal
comparison group. This sample loss after random assignment (attrition) was within the acceptable threshold for the review.
The overall attrition rate was 28%, and the differential attrition rate was 8 percentage points.
Study sample For students in the main analytic sample comparing outcomes for the intervention and control pen-pal comparison groups,
55% were Black and 45% were White. The authors did not provide other demographic information for the study sample.
Intervention Students in the intervention group attended three one-hour sessions, spaced 10 days apart starting in mid-January and
group continuing through February. In groups of two to five, students were asked to write a reassuring letter to a middle school
student experiencing academic difficulties. Students read letters ostensibly written by seventh-grade students, but actually
prepared by the study authors. Next, researchers told students that intelligence could grow with hard work, and showed
a short video describing research showing that the human brain developed new connections in response to intellectual
challenges. Before replying to their assigned middle school “pen-pal,” students were encouraged to include information
about the malleability of intelligence, as well as illustrative examples from their own life in their response. In the second
session, students received a thank you note, ostensibly from their pen-pal and pen-pal’s teacher; students then wrote a
similar letter to a new pen-pal. In the third session, students converted their letters into a speech, recorded their speech,
and then listened twice to their own audiotaped speech.
Comparison In the control pen-pal comparison group, students attended three one-hour sessions spaced 10 days apart starting in
group mid-January and continuing through February. In groups of two to five, students were asked to write a reassuring letter
to a middle school student experiencing academic difficulties. Students read letters ostensibly written by seventh-grade
students, but actually prepared by the study authors. Next, researchers told students that intelligence was not a single
attribute but that individuals had multiple intellectual strengths and weaknesses, and showed a short video describing
how psychologists were starting to view intelligence as multiple abilities rather than a single entity. Before replying to their
assigned middle school pen-pal, students were encouraged to include information about the multiple types of intelligence
in their response. In the second session, students received a thank you note, ostensibly from their pen-pal and pen-pal’s
teacher; students then wrote a similar letter to a new pen-pal. In the third session, students converted their letters into a
speech, recorded their speech, and then listened twice to their own audiotaped speech.
In the no pen-pal comparison group, students attended one laboratory session near the end of February to complete survey
measures and sign study-related forms.
7
Outcomes and Using data from university transcripts, study authors reported students’ grade point averages (GPA) at the end of the
measurement spring academic term (approximately nine weeks after the end of the intervention). Although the authors presented findings
separately for each of the three study groups, only the difference in GPA between the intervention and control pen-pal
comparison groups is classified as a main finding. Supplemental findings for the intervention group relative to the no pen-pal
comparison group and relative to the two comparison groups combined are available on the WWC website
(https://whatworks.ed.gov). The supplemental findings do not factor into the intervention’s rating of effectiveness.
Study authors also collected data on measures that are ineligible for review under the Supporting Postsecondary Success
topic area including students’ self-reported beliefs about the malleability of intelligence, experiences of stereotype threat,
enjoyment of the educational process, and belief that academic achievement was important to their identity. Subgroup
findings for Black and White students reported by the authors are not included because they did not meet WWC group
design standards; the study authors did not provide information on attrition separately for each group, nor was information
available on the equivalence of the analytic intervention and comparison groups at baseline for either subgroup.
Research details for Bostwick & Findings from Bostwick & Becker-Blease (2018) show
Becker-Blease (2018) evidence of an indeterminate effect of a Growth Mindset
intervention in the academic achievement domain (Table 7).
Bostwick, K. C. P., & Becker-Blease, K. A. (2018). Quick, easy
This finding is based on an outcome analysis that includes
mindset intervention can boost academic achievement in
173 students.
large introductory psychology classes. Psychology Learning
and Teaching, 17(2), 177–193.
https://eric.ed.gov/?q=EJ1182886&id=EJ1182886
WWC evidence Meets WWC Group Design Standards Without Reservations. This is a randomized controlled trial (RCT) with low
rating attrition.
Setting The study took place on the campus of a mid-sized public university in Oregon. Students who enrolled in a large, lecture-
based introductory psychology course participated in the study. Students received materials for the intervention or one of
two comparison conditions immediately after the first course exam was administered in class.
Methods The study authors randomly assigned 278 students enrolled in an introductory psychology course to one of three groups,
93 students to a Growth Mindset intervention group, 94 students to a “fixed mindset” comparison group, and 91 students to
a “class attendance matters” comparison group. This review prioritized findings for the Growth Mindset intervention group
versus the fixed mindset comparison group to be consistent with other studies reviewed for this report and because the
study authors argued this condition better approximates the “business as usual” experiences of college students.9 Of the
187 students assigned to the intervention or fixed mindset group, 173 students were included in the analytic sample, with
86 students in the intervention group and 87 students in the fixed mindset group. The sample loss after random assignment
(attrition) was within the acceptable threshold for the review. The overall attrition rate was 7%, and the differential attrition
rate was less than 1 percentage point.
Study sample Study authors did not report demographic characteristics of the analytic sample. Of the 278 students randomly assigned,
gender was not specified for 14 students. Among the remaining 264 students, 66% were female. The authors noted that,
historically, 50% of students who enrolled in the introductory psychology course were first-year or transfer students.
8
Intervention After submitting their first course exam, students in the intervention group received a letter from the instructor stating that
group recent research showed that the human brain is adaptable and that people can overcome new challenges with persistence
and hard work and strengthen areas of weakness over time.
Comparison After submitting their first course exam, students in the fixed mindset and class attendance matters groups each received
group a letter from the instructor. The letter for students in the fixed mindset group stated that people have different strengths and
weaknesses, that the key to success was to use one’s strengths, and that everyone has to approach obstacles differently.
The letter for students in the class attendance matters group stated the importance of class attendance for academic
performance and thanked the student for coming to class.
Outcomes and Study authors reported findings on students’ final exam score, administered approximately nine weeks after the delivery
measurement of the intervention. The review team leadership determined that the final exam was equivalent to a department-wide
examination, making it eligible for review under the Supporting Postsecondary Success topic area. The exam was
cumulative across content covered throughout the course and was administered to the class. Review team leadership also
determined that this exam was equivalent to a final course grade, and therefore, as a standard educational measure, its
reliability and validity are assumed to meet WWC outcome criteria.
Study authors also reported supplemental findings for the class attendance matters comparison group. These findings, and
findings that compare outcomes for the intervention group to the two comparison groups combined are available on WWC
website (https://whatworks.ed.gov). The supplemental findings do not factor into the intervention’s rating of effectiveness.
Findings for a subgroup of students who passed a “manipulation check” demonstrating that they recalled the contents of
the letter they had received did not meet WWC group design standards because of high attrition and because the analytic
intervention and comparison groups did not satisfy the baseline equivalence requirement. Findings for student scores on the
second, third, and fourth course exams were ineligible for review under the Supporting Postsecondary Success topic area.
Research details for Broda et al. (2018) Findings from Broda et al. (2018) show evidence of
indeterminate effects of a Growth Mindset intervention in the
Broda, M., Yun, J., Schneider, B., Yeager, D. S., Walton, G.
academic achievement, college enrollment, and progressing
M., & Diemer, M. (2018). Reducing inequality in academic
in college domains (Table 9). Each finding is based on an
success for incoming college students: A randomized trial
outcome analysis that includes 4,357 students.
of growth mindset and belonging interventions. Journal of
Research on Educational Effectiveness, 11(3), 317–338.
https://eric.ed.gov/?id=EJ1181580
WWC evidence Meets WWC Group Design Standards Without Reservations. This is a randomized controlled trial (RCT) with low
rating attrition.
Setting The study took place at a public university in Michigan. Several weeks before arriving on campus for a two-day orientation
program, incoming first-year students received a survey link from the university and completed the survey either prior to, or
after arriving, on campus for orientation.
9
Methods After blocking students on race and ethnicity, study authors randomly assigned incoming first-year students who responded
to a survey invitation into one of three groups: 2,189 students to a Growth Mindset intervention group, 2,210 students to a
Social Belonging intervention group, and 2,269 students to a comparison group.10 The analytic sample for outcomes at the
end of the fall (2014) semester included 2,135 students in the Growth Mindset intervention group and 2,222 students in the
comparison group. This sample loss after random assignment (attrition) was within the acceptable threshold for the review.
The overall attrition rate was 2%, and the differential attrition rate was less than 1 percentage point.
Study sample Among students included in analyses for main findings, 54% were female, 78% were White, 7% were Black, and race was
not specified for 15% of the sample. Four percent were Hispanic. Approximately 24% were first-generation college students
and 26% were eligible for a Pell grant.
Intervention Students in the intervention group read an article summarizing research showing that the brain is malleable and that
group intelligence can grow if students exert effort when facing a challenge. Next, students wrote short essay responses to
questions about how they may or may not have applied a growth mindset to a challenge. Finally, students wrote a letter,
incorporating elements of the “brain is malleable” article, offering advice for a future first-year student. On average, students
spent 20 to 25 minutes on the intervention activities.
Comparison Students in the comparison group read stories about adapting to the physical aspects of college life, including the weather
group in Michigan, navigating around the university campus, adjusting to a new class schedule, and finding places to eat. Next,
students wrote short essay responses to questions about how the stories they had read related to the start of their own
college-going experience. On average, students spent 10 to 15 minutes on the comparison group activities.
Outcomes and Using administrative data for the end of the fall semester, study authors reported students’ grade point average (GPA;
measurement academic achievement domain), number of course credits completed (progressing in college domain), and full-time
enrollment rate (percentage of students enrolled full-time; college enrollment domain).
Supplemental findings include fall semester outcomes reported separately for Black, White, and Hispanic subgroups, as
well as spring (2015) semester GPA, course credits completed, and cumulative year-end (2014-2015) GPA for the full
sample and each subgroup. These supplemental findings are available on the WWC website (https://whatworks.ed.gov).
The supplemental findings do not factor into the intervention’s rating of effectiveness.
Ineligible outcomes included the number of course credits attempted in each of the two first-year semesters. Findings that
compared outcomes for the Social Belonging intervention group to the comparison group were not relevant to this report but
are included in a separate WWC intervention report on Social Belonging interventions for postsecondary students.
Research details for Suh et al. (2019) Findings from Suh et al. (2019) show evidence of an
indeterminate effect of a Growth Mindset intervention in the
Suh, E. K., Dahlgren, D. J., Hughes, M. E., Keefe, T. J., &
academic achievement and progressing in college domains
Allman, R. J. (2019). Conditions for success: Fostering
(Table 11). These finding are based on outcome analyses that
first-year students’ growth mindset in developmental
include 155 and 157 students respectively.
mathematics. Journal of The First-Year Experience & Students
in Transition, 31(2), 63-78.
https://www.ingentaconnect.com/contentone/fyesit/
fyesit/2019/00000031/00000002/art00004
10
Table 12. Description of study characteristics for Suh et al. (2019)
WWC evidence Meets WWC Group Design Standards Without Reservations. This is a cluster randomized controlled trial (RCT) with low
rating cluster-level attrition and individual-level non-response.
Setting The study took place at a public four-year university in Indiana within seven sections of a developmental mathematics
course required for graduation.11
Methods Study authors randomly assigned seven sections of a developmental mathematics course required for graduation to a
Growth Mindset intervention group (3 sections, 89 students), a “laughter/stress” comparison group (2 sections, 68 students),
or an “advice-only” comparison group (2 sections, 70 students). The analytic sample for the course passing rate included
88 students in the intervention group and 67 students in the laughter/stress comparison group. After random assignment,
there was no cluster-level attrition and individual-level non-response was within the acceptable threshold for the review.
The overall attrition rate was 1%, and the differential attrition rate was less than 1 percentage point. The analytic sample for
students’ final exam score included 54 students in the intervention group and 20 students in the laughter/stress comparison
group. Although this sample loss exceeded the acceptable threshold for the review, the authors demonstrated equivalence
of the analytic sample at baseline. The analytic sample for retention to the following semester included all 157 students
randomly assigned to the intervention or laughter/stress comparison group.
Study sample Among the 227 students in the seven course sections randomly assigned, 8% were Black, 78% were White, and race
was not specified for 13% of the sample. Sixty-nine percent of these students were female, and 51% were first-generation
college students.12 Information about the characteristics of the analytic samples for main findings was unavailable.
Intervention During the second and third weeks of the fall semester, students in the Growth Mindset intervention group read a short
group article describing research showing that the brain is malleable and that intelligence can grow if students exert effort when
facing a challenge. Next, students wrote three short essay responses to prompts in which they (1) summarized the article,
(2) described a personal experience about learning something new, and (3) gave advice to a hypothetical student who was
feeling “dumb.”
Comparison Within the second and third weeks of the fall semester, students in the laughter/stress comparison group read a short
group article describing the role of laughter in health and stress management. Next, students wrote short replies to essay prompts
in which they (1) summarized the article and (2) described a personal situation in which they used laughter to relax and
improve their health. Students in the advice-only comparison group did not read an article before writing short replies to
two essay prompts in which they (1) described a personal situation in which they succeeded in a class and explained the
reasons for their success, and (2) wrote a letter to a friend who was feeling “dumb” and offered advice for how to learn and
become smarter.
Outcomes and Study authors reported the course passing rate and students’ final exam score (academic achievement domain), and
measurement the rate of retention to the following semester (percent of students who re-enrolled; progressing in college domain).
Supplemental findings include the rate of retention to the fall semester of the next academic year, as well as the course
passing rate and rate of retention to the following semester for students in the intervention group compared to those in the
advice-only comparison group. These supplemental findings are available on the WWC website (https://whatworks.ed.gov).
The supplemental findings do not factor into the intervention’s rating of effectiveness.
One study-reported finding, comparing the final exam score for students in the intervention group to those in the advice-only
comparison group, did not meet WWC group design standards due to high individual-level non-response and because the
analytic intervention and comparison groups did not satisfy the baseline equivalence requirement. The study authors also
reported findings for students’ persistence to the final course exam, an ineligible outcome under the review protocol.
Research details for Yeager et al. (2016) Findings from Yeager et al. (2016) show evidence of
indeterminate effects of a Growth Mindset intervention in
Yeager, D. S., Walton, G. M., Brady, S. T., Akcinar, E. N.,
the college enrollment and progressing in college domains
Paunesku, D., Keane, L., Kamentz, D., Ritter, G., Duckworth,
(Table 13). Each finding is based on an outcome analysis that
A. L., Urstein, R., Gomez, E. M., Markus, H. R., Cohen, G. L.,
includes 3,837 students.
& Dweck, C. S. (2016). Teaching a lay theory before college
narrows achievement gaps at scale. Proceedings of the
National Academy of Sciences of the United States of America,
113(24), E3341-E3348.
https://doi.org/10.1073/pnas.1524360113
11
Table 13. Summary of findings from Yeager et al. (2016)
Meets WWC Group Design Standards Without Reservations
Study findings
WWC evidence Meets WWC Group Design Standards With Reservations. This is a randomized controlled trial (RCT) with low attrition.
rating
Setting The study took place at a public university in Texas. Incoming students reviewed pre-orientation materials online—including
text that served as the intervention—one week before arriving on campus for the full orientation.
Methods After blocking students on SAT score, race and ethnicity, and gender, study authors randomly assigned incoming first-year
students who completed a brief survey into one of four groups: 1,775 students to a Growth Mindset intervention group,
1,746 students to a Social Belonging intervention group, 2,062 students to a comparison group and an unknown number to
an intervention that combined elements of the Growth Mindset and Social Belonging interventions.13 The analytic sample
for outcomes at the end of the fall (2012) semester included 1,775 students in the Growth Mindset intervention group and
2,062 students in the comparison group. There was no sample loss after random assignment (attrition).
Study sample Across the 7,343 students in the analytic sample that included all four study conditions, 46% were White, 18% were Asian,
5% were Black, and race was not specified for 31% of the sample. Twenty-four percent were Hispanic. Approximately 17%
were first-generation college students and 83% were continuing-generation.14
Intervention In an online session lasting approximately 30 minutes, students in the Growth Mindset intervention group read an article
group summarizing research showing that the brain is malleable and that intelligence can grow if students exert effort when
facing a challenge. Next, students read stories from upper-class students that described how they had overcome early
struggles in college. These stories conveyed messages that initial struggles in college, such as receiving low grades, getting
critical feedback from a professor, or having difficulty with the college bureaucracy, do not imply that a student is “dumb” or
unprepared for college; rather, these challenges suggest that students may learn more effective study strategies by asking
for help and that the “knowing how” part of their brain was still developing. Finally, students wrote an essay, to be shared
with other first-year students facing struggles, that described how these messages applied to their own experience adjusting
to college.
Comparison In an online session lasting approximately 30 minutes, students in the comparison group read stories from upper-class
group students that described how they had adapted to the physical environment on campus and in the surrounding city. Next,
students wrote an essay, to be shared with other first-year students facing struggles, about how students adjust to college.
Outcomes and Using administrative data, study authors reported the percentage of students enrolled full-time (that is, enrolled for 12 or
measurement more credit hours) during the fall 2012 semester, an outcome in the college enrollment domain, and the percentage of
students who completed 12 or more credits by the end of the semester, an outcome in the progressing in college domain.
Supplemental findings include fall semester full-time enrollment and credit completion rates reported separately for
disadvantaged (all first-generation to college and all Black or Hispanic students) and advantaged (all continuing generation
Asian or European-American students) subgroups, as well the percentage of students enrolled full-time continuously for the
entire year (2012-2013) and the percentage who completed 24 or more credits by the end of the year. The authors reported
these end-of-year findings for the full sample and each subgroup. These supplemental findings are available on the WWC
website (https://whatworks.ed.gov). The supplemental findings do not factor into the intervention’s rating of effectiveness.
Findings that compared outcomes for the Social Belonging intervention group to the comparison group were not relevant
to this report but are included in a separate WWC intervention report on Social Belonging interventions for postsecondary
students.
Additional The university embedded the study materials within a set of online, pre-orientation tasks required of incoming students,
implementation such as reviewing the university honor code, health care requirements, and course registration procedures. To help ensure
details that students read the materials carefully, each web page had a timer that prevented students from advancing to the next
page until a minimum amount of time had elapsed. The study materials were framed as information about the “university
mindset,” and an opportunity to learn from older students’ experience with the transition to college. Study materials informed
students that their essays could be shared, anonymously, to help future students cope with the transition to college.
12
Research details for Fink et al. (2018) Findings from Fink et al. (2018) show evidence of an
indeterminate effect of a Growth Mindset intervention in the
Fink, A., Cahill, M. J., McDaniel, M. A., Hoffman, A., & Frey,
academic achievement domain (Table 15). This finding is
R. F. (2018). Improving general chemistry performance
based on an outcome analysis that includes 565 students.
through a growth mindset intervention: Selective effects
on underrepresented minorities. Chemistry Education
Research and Practice, 19(3), 783-806. https://doi.org/10.1039/
C7RP00244K
WWC evidence Meets WWC Group Design Standards With Reservations. This is a compromised randomized controlled trial (RCT) with
rating analytic intervention and comparison groups that satisfy the baseline equivalence requirement.
Setting The study took place as part of a General Chemistry course at a private university. Students participated in the study by
completing activities that were incorporated into three online homework assignments.
Methods Study authors randomly assigned two cohorts of first-year students who enrolled in General Chemistry 1 in the fall of 2015
or fall of 2016 to a Growth Mindset intervention group or a “transition tips” comparison group. After random assignment,
the authors excluded from analysis students who (1) did not consent, (2) were inadvertently exposed to a “self-affirmation”
intervention designed to improve their academic performance in the course, or (3) did not participate in the intervention
or comparison group study activities. Excluding students who did not participate in the study activities compromised the
integrity of random assignment.15
Study sample The analytic sample consisted of 565 first-year students enrolled in General Chemistry 1 in the fall of 2015 or fall of 2016
who consented to participate in the study and completed three online study activities. The Growth Mindset intervention
group included 275 students and the “transition tips” comparison group included 290 students. Among the 565 students
in the analytic sample, 57% were female, 76% were White, and 24% were members of a racial or ethnic group historically
underrepresented among students earning a bachelor’s degree in chemistry or another STEM field, including Black,
American Indian/Alaska Native, Native Hawaiian or Pacific Islander, and Hispanic students. Asian students were excluded
from the sample.
Intervention Students received three online study activities during the semester. In the first, administered two weeks before the first
group course exam, students read a short article summarizing research showing that the brain is malleable and that intelligence
can grow with effortful practice on challenging tasks, and by developing new learning strategies with support from others.
For the second activity, administered one week before the second course exam, students received a summary of the
article’s key points and were prompted to write about how the article would affect their preparation for the upcoming exam.
For the third activity, one week prior to the course final exam, students were prompted to write about how the article would
influence their studying strategies for the exam.
Comparison Students received three online study activities during the semester, administered at the same points in time as the
group intervention group received their assignments. In the first activity, students in the comparison group received a set of
“transition tips” for college success that emphasized organization and time management, maintaining their health and
balancing academic work with social and extracurricular activities, being an active participant in class, and using available
resources to support learning the course material. The second and third activities prompted students to reflect on how the
transition tips article would affect their approach to preparing for the second and final course exams.
Outcomes and Study authors reported final exam scores (academic achievement domain) for students in the intervention and comparison
measurement groups. To correct any potential differences between the fall 2015 and fall 2016 final exams and student cohorts, the
authors converted raw test scores to standardized scores (z-scores) prior to analysis. For the following outcomes, the
authors reported findings that did not meet WWC group design standards because the analytic intervention and comparison
groups did not satisfy the baseline equivalence requirement: final exam scores for the subgroup of students historically
underrepresented in STEM, and average of exam scores in General Chemistry 2 during the spring semester, both for the
full sample and the subgroup of students historically underrepresented in STEM.
13
Additional No additional information provided.
implementation
details
14
Fleurizard, T. A., & Young, P. R. (2018). Finding the right 6
The effects of Growth Mindset interventions are not
equation for success: An exploratory study on the known for other outcome domains within the Supporting
effects of a growth mindset intervention on college Postsecondary Success topic area, including college
students in remedial math. Journal of Counseling and attendance, postsecondary degree attainment, credential
Psychology, 2(1), 3. attainment, employment, and earnings.
https://digitalcommons.gardner-webb.edu/jcp/vol2/ 7
In a previous review of Aronson et al. (2002), the WWC
iss1/3 The study is ineligible for review because it based its study rating on the full sample of 79 students that
does not address at least one outcome in a domain compared the average GPA for students in the intervention
specified by the review protocol. group to the combined sample of students in either the
Lewis, L. S., Williams, C. A., & Dawson, S. D. (2020). Growth control pen-pal or no pen-pal comparison group. Although
mindset training and effective learning strategies the current study rating does not differ from that of the
in community college registered nursing students. prior review, the WWC has prioritized the finding that
Teaching and Learning in Nursing, 15(2), 123-127. compares the average GPA for students in the intervention
The study is ineligible for review because it does not group to those in the control pen-pal comparison group to
use an eligible design. align with other studies included in this report.
Moore, J. E. (2018). Mindset, self-efficacy, and first year college
8
Each study reviewed for this intervention report included
students: Perceptions of performance accomplishments a comparison group in which students participated in an
(Publication No. 10840187) [Doctoral dissertation, activity that was similar in structure but not content to
Western Connecticut State University]. ProQuest what students in the growth mindset intervention group
LLC. https://eric.ed.gov/?id=ED587949 The study experienced. This type of comparison group served to
is ineligible for review because it does not address rule out alternative explanations for any observed effect
at least one outcome in a domain specified by the of the growth mindset messaging on college outcomes.
review protocol. For example, in Aronson et al. (2002), both the Growth
Mindset intervention and the control pen-pal comparison
Endnotes groups wrote letters to fictional students in which they
summarized information they had learned as part of
1
McFarland, J., Hussar, B., Zhang, J., Wang, X., Wang, K., participating in the study, but the no pen-pal group
Hein, S., Diliberti, M., Forrest Cataldi, E., Bullock Mann, did not summarize new information or write a letter.
F., and Barmer, A. (2019). The Condition of Education Any differences in outcomes between students in the
2019 (NCES 2019-144). U.S. Department of Education. intervention and no pen-pal comparison groups could
Washington, DC: National Center for Education have resulted from the fact that one group summarized
Statistics. https://nces.ed.gov/pubsearch/pubsinfo. information in a written letter and the other group did
asp?pubid=2019144. not, rather than from differences in the content of that
2
Stinebrickner, R., & Stinebrickner, T. (2014). Academic information. In contrast, differences in outcomes between
performance and college dropout: Using longitudinal the intervention and control pen-pal groups isolates the
expectations data to estimate a learning model. Journal of effect of growth mindset content relative to other content
Labor Economics, 32, 601-644. about learning or adjusting to college life.
3
The WWC provided a description of this category of 9
See Bostwick and Becker-Blease’s (2018) argument that
interventions to researchers familiar with Growth Mindset “fixed mindset” messages may be a “normal and typical
and Social Belonging interventions in July 2021 and the experience for many university students” (p. 181).
WWC incorporated feedback from these researchers. 10
The study authors blocked 7,686 incoming first-year
Further verification of the accuracy of the descriptive students who responded to the survey invitation by race,
information for this type of intervention is beyond the ethnicity (White, Black, Asian, multiracial, or Hispanic)
scope of this review. and status as an international student, but after random
4
The literature search reflects documents publicly available assignment, excluded Asian, multiracial, and international
as of November 2020. Reviews of the studies in this students from analyses. Following WWC standards, v. 4.0
report used the standards from the WWC Procedures and (pp. 8; 11-13), these exclusions are not counted as attrition
Standards Handbook (version 4.0) and the Supporting because they were based on characteristics that existed
Postsecondary Success review protocol (version 4.0). The prior to the introduction of the intervention and applied
evidence presented in this report is based on available consistently across the intervention and comparison
research. Findings and conclusions could change as new groups.
research becomes available. 11
Although the Supporting Postsecondary Success protocol
5
Yeager et al. (2016) reports findings from a related study indicates that studies focused exclusively on students in
of the effects of a Growth Mindset intervention on college need of developmental coursework should be reviewed
enrollment of high school seniors (Experiment 1). The under the Review Protocol for Studies of Interventions for
study was not eligible for review under the Supporting Developmental Students in Postsecondary Education, the
Postsecondary Students review protocol, because students review team leadership determined that this study should
in the study were enrolled in high school when the be included in this intervention report because it used a
intervention was delivered. An individual study review Growth Mindset intervention.
of Experiment 1 is forthcoming under the WWC’s Study
Review Protocol, version 1.0.
15
12
In Suh et al. (2019), Table 1 shows that the initial sample 14
These percentages reflect the WWC’s calculations using
of 227 students at the time of random assignment the sample sizes by race, ethnicity, and first- or continuing
included 156 female and 71 male students. Because the generation status reported in Table S11 of Appendix 3
percentages shown in the table do not match the number (Yeager et al., 2016, pp. 42-43). These percentages differ
of female (or male) students divided by the total, the WWC from those reported elsewhere in Appendix 3 (p. 30) for
independently calculated these percentages to be 69% Asian students (19%), first-generation students (19%), and
female (156 of 227) and 31% male (71 of 227). Similarly, the continuing-generation students (81%).
percentage of Black students in the initial sample shown in 15
Although Asian students were also excluded from analyses,
Table 1 does not match the number of Black students (n=19) this exclusion would not, alone, have compromised
divided by the total (n=227). The WWC independently random assignment under WWC 4.0 standards because this
calculated this percentage to be 8.4%. characteristic existed prior to the start of the intervention
13
A separate WWC intervention report on Social Belonging and the exclusion was applied to both the intervention and
interventions under the Supporting Postsecondary comparison groups in an equivalent manner.
Students review protocol (version 4.0) includes findings
that contrast the Social Belonging intervention group with Recommended Citation
the comparison group. The intervention that combined
What Works Clearinghouse, Institute of Education Sciences,
elements of the Growth Mindset and Social Belonging
U.S. Department of Education. (2022, January). Growth
interventions was ineligible for inclusion in either this
Mindset Interventions for Postsecondary Students.
report or the report on Social Belonging interventions
because outcomes could not be attributed to the unique https://whatworks.ed.gov.
effects of either of the two types of interventions.
16