The Impact of Unmotivated Questionnaire Respondents on Data Quality
Publication authors
Published

Summary

This paper investigates the effect of student satisficing, the act of providing suboptimal survey responses, on data quality in a large-scale social-emotional learning survey. The study examines the prevalence and impact of satisficing among 409,721 students and finds that its effect on data quality is less significant than expected. The paper offers a practical approach to defining and calculating satisficing, useful for researchers, policymakers, and practitioners working with large-scale datasets.
Evidence from California’s CORE School Districts
Publication authors
Published

Summary

This paper examines which social-emotional skills are most important for student success and how they vary among student subgroups. It uses longitudinal data from over 200,000 fourth through seventh grade students in California to explore growth mindset gaps across student groups and shows the significant predictive power of growth mindset for academic achievement gains, even when controlling for other social-emotional skills and background characteristics.
Published

Summary

This paper uses mixture IRT models to evaluate whether students experience confusion due to negative wording of items on a social-emotional learning assessment. It examines the consequences of confusion on student- and school-level scores and correlations with student-level variables, finding that confusion is present and most prevalent in lower grades, and is related to reading proficiency and ELL status. The study recommends the use of positively oriented items in future SEL measures, and suggests bias corrections based on the studied mixture model to maintain measurement continuity.
Consistent Gender Differences in Students’ Self-Efficacy
Published

Summary

This brief examines the consistency of the drop in academic self-efficacy during middle school across various student groups, such as demographics, achievement level, and school of attendance. The study finds that the drop is essentially universal across all groups, despite some showing lower self-efficacy than others. Additionally, schools vary in their students' level of self-efficacy, but do not differ much in this trend. The drop in academic self-efficacy is steeper for female students, resulting in lower self-efficacy for girls than boys throughout middle and high school.
Published

Summary

This study uses value-added models to explore whether social-emotional learning (SEL) surveys can measure effective classroom-level supports for SEL. Results show that classrooms differ in their effect on students' growth in self-reported SEL, suggesting that classroom-level effects may be larger than school-level effects. However, the low explanatory power of the SEL models means it's unclear if these are causal effects. The SEL measures also capture growth not measured by academic test scores, indicating that classrooms within schools may impact measurable student growth in SEL.
Findings From the First Large-Scale Panel Survey of Students
Published

Summary

This article discusses the use of standardized tests as the primary tool for assessing school-level growth in student outcomes, despite the emerging importance of social-emotional learning (SEL). It presents results from large-scale surveys of students on SEL constructs, and finds significant differences across schools in SEL growth, with magnitudes of differences similar to those for academic achievement. However, caution is recommended in interpreting measures as causal impacts of schools on SEL, as the goodness of fit of the value-added model was considerably lower for SEL measures.
Evidence from California’s CORE Districts
Publication authors
Published

Summary

This paper uses a large dataset to confirm that self-management skills predict student success and are a better predictor of student learning than other socio-emotional skills. Students with higher levels of self-management experience almost 80 days of additional learning. The paper also describes self-management gaps across student groups.
Insights from Outlier Schools
Published

Summary

This paper explores social-emotional learning (SEL) practices in ten middle schools and their impact on students' outcomes. Despite the growing recognition of the importance of SEL, many schools struggle to implement effective strategies. The paper focuses on schools with strong student-reported data on SEL outcomes, particularly for African American and Latinx students.
Publication authors
Published

Summary

This study examines the impact of target setting for non-academic indicators on school quality ratings in CORE districts' elementary schools. The authors found that non-academic measures of school quality vary over time, are not consistently associated with demographics, and are sensitive to small changes in rating thresholds. The results suggest a need for more research on target setting for non-academic indicators in school quality systems.
Publication author
Published

Summary

This report presents benchmarking data on self-report student surveys measuring social-emotional learning (SEL) from nearly half a million students in grades 4 through 12 across 8 CORE districts in California. The data provide means and standard deviations by construct, grade level, and subgroup, and can serve as a proxy for a nationally-normed sample for other schools across the country looking to administer the CORE survey.
Published

Summary

This report examines the stability of school effects on social-emotional learning (SEL) over two years in California's CORE districts. The correlations among school effects in the same grades across different years are positive but lower than those for math and ELA. While these effects measure real contributions to SEL, their low stability draws into question whether including them in school performance frameworks and systems would be beneficial.

Publication author
Published

Summary

Children's health, especially in low-income households, affects their future success. California has improved access to healthcare but still has gaps due to poor quality care and lack of access to providers. Mental health is a growing concern, but the state has fewer services in schools than other states. The report explores the benefits of school-based health services, which are currently lacking in California, and estimates it would cost less than $100 per pupil to improve access. California is missing out on federal funds due to its low spending on Medicaid for school-based health services.

A Pragmatic Approach to Validity and Reliability
Publication authors
Published

Summary

This report discusses the validity and reliability of CORE Districts’ social-emotional learning (SEL) student-report surveys. Through a pragmatic approach, the report answers four guiding questions that explain different facets of validity for school leaders. The aim is to provide guidance around the use of SEL surveys within and outside of the CORE districts to facilitate decision-making for educational leaders.
Evidence from the CORE Districts
Published

Summary

This study examines how social-emotional skills develop from Grade 4 to Grade 12 and vary by gender, socioeconomic status, and race/ethnicity. Based on self-report student surveys administered to around 400,000 students in California, the study finds that social-emotional skills do not increase uniformly and vary across subgroups. Females have higher social awareness but lower self-efficacy than males. Economically disadvantaged students show improvement in high school. White students report higher social-emotional skills than African American and Latinx students.
An IRT Modeling Approach
Published

Summary

This study examines the properties of California's CORE Districts' SEL survey, which measures social-emotional learning in students. The survey was given to over 400,000 students in grades 3-12. The study uses both classical test theory and item response theory frameworks to analyze the data and make recommendations for modeling and scaling SEL survey data. Policy implications are discussed for educators, administrators, policy makers, and other stakeholders.
Findings from the First Large-Scale Panel Survey of Students
Published

Summary

This paper examines the use of social-emotional learning (SEL) measures to evaluate school-level growth in student outcomes. The study finds substantial differences across schools in SEL growth, suggesting that schools may contribute to students' SEL. However, caution is recommended in interpreting measures as the causal impacts of schools on SEL due to potential measurement error and omitted variables bias.
Practices and Supports Employed in CORE Districts and Schools
Published

Summary

This study explores ten "outlier schools" in California's CORE districts that have strong social-emotional learning outcomes. The brief and infographic summarize the various practices found in these schools and the common implementation challenges faced. The findings offer lessons that can help other schools and districts implement social-emotional learning at scale.
Published

Summary

States and school districts across the U.S. are seeking to expand their definition of student success to include social-emotional learning. The CORE Districts, a collaborative of California districts that has developed a system of school accountability and continuous improvement that includes measures of social-emotional skills based on student self-reports, exemplify this trend. In this case study, we provide an overview of CORE's School Quality Improvement System, which was implemented in the 2015–16 school year across six districts serving roughly one million students.
Published

Summary

The use of social-emotional learning (SEL) and school culture/climate (CC) measures is a promising way to understand school performance. SEL and CC measures are reliable, distinguish between schools, and relate to academic and non-academic measures. They can identify areas for improvement within schools, such as subgroup gaps. Incorporating these measures into higher stakes accountability systems requires further research.

Five Years Later
Published

Summary

This report commemorates the fifth anniversary of the Getting Down to Facts project, which sought to provide a thorough and reliable analysis of the critical challenges facing California’s education system as the necessary basis for an informed discussion of policy changes aimed at improving the performance of California schools and students. The report focuses on the four key issues that received emphasis in the Getting Down to Facts studies: governance, finance, personnel, and data systems.