The Impact of Unmotivated Questionnaire Respondents on Data Quality
Publication authors
Published

Summary

This paper investigates the effect of student satisficing, the act of providing suboptimal survey responses, on data quality in a large-scale social-emotional learning survey. The study examines the prevalence and impact of satisficing among 409,721 students and finds that its effect on data quality is less significant than expected. The paper offers a practical approach to defining and calculating satisficing, useful for researchers, policymakers, and practitioners working with large-scale datasets.
Evidence from California’s CORE School Districts
Publication authors
Published

Summary

This paper examines which social-emotional skills are most important for student success and how they vary among student subgroups. It uses longitudinal data from over 200,000 fourth through seventh grade students in California to explore growth mindset gaps across student groups and shows the significant predictive power of growth mindset for academic achievement gains, even when controlling for other social-emotional skills and background characteristics.
Published

Summary

This paper uses mixture IRT models to evaluate whether students experience confusion due to negative wording of items on a social-emotional learning assessment. It examines the consequences of confusion on student- and school-level scores and correlations with student-level variables, finding that confusion is present and most prevalent in lower grades, and is related to reading proficiency and ELL status. The study recommends the use of positively oriented items in future SEL measures, and suggests bias corrections based on the studied mixture model to maintain measurement continuity.
Consistent Gender Differences in Students’ Self-Efficacy
Published

Summary

This brief examines the consistency of the drop in academic self-efficacy during middle school across various student groups, such as demographics, achievement level, and school of attendance. The study finds that the drop is essentially universal across all groups, despite some showing lower self-efficacy than others. Additionally, schools vary in their students' level of self-efficacy, but do not differ much in this trend. The drop in academic self-efficacy is steeper for female students, resulting in lower self-efficacy for girls than boys throughout middle and high school.
Published

Summary

This study uses value-added models to explore whether social-emotional learning (SEL) surveys can measure effective classroom-level supports for SEL. Results show that classrooms differ in their effect on students' growth in self-reported SEL, suggesting that classroom-level effects may be larger than school-level effects. However, the low explanatory power of the SEL models means it's unclear if these are causal effects. The SEL measures also capture growth not measured by academic test scores, indicating that classrooms within schools may impact measurable student growth in SEL.
Findings From the First Large-Scale Panel Survey of Students
Published

Summary

This article discusses the use of standardized tests as the primary tool for assessing school-level growth in student outcomes, despite the emerging importance of social-emotional learning (SEL). It presents results from large-scale surveys of students on SEL constructs, and finds significant differences across schools in SEL growth, with magnitudes of differences similar to those for academic achievement. However, caution is recommended in interpreting measures as causal impacts of schools on SEL, as the goodness of fit of the value-added model was considerably lower for SEL measures.
The Case of Garden Grove Unified School District
Published

Summary

This case study explores the Garden Grove Unified School District's culture of improvement through four key structures and processes, including consistent goals, data-driven reform, vertical and horizontal structures, and prioritization of people. The district's culture prioritizes student outcomes, commitment, and high-quality teaching. Lessons from GGUSD are broadly applicable to other California districts seeking to foster a culture of improvement.
The Case of Long Beach Unified School District
Publication author
Published

Summary

The CORE-PACE Research Partnership's report on Long Beach Unified School District highlights lessons learned from their continuous improvement approach to improving classroom instruction. This report describes four key practices that have led to improvements in organizational function, including shared clarity of purpose, structures for shared learning, differentiated support for instructional leaders, and deepening understanding of implementation. LBUSD's efforts offer valuable insights for other systems and leaders seeking to support continuous improvement.
The Case of Ayer Elementary
Publication authors
Published

Summary

A case study of Ayer Elementary School in Fresno, California, reveals leadership practices that foster continuous improvement in education. The report identifies three lessons for supporting improvement in other schools: access to district resources, a culture of continuous improvement, and teacher agency. The study highlights the importance of leadership skills in promoting a culture of risk-taking, teacher agency, and collective efficacy to improve student outcomes in California schools.
Lessons from the CORE Districts
Published

Summary

This report examines how California's education sector is embracing continuous improvement over standards-based reform. The study presents six lessons learned from PACE and CORE Districts' collaboration on the topic, including the complexity of embedding continuous improvement processes into school norms and the need for deliberate steps to build a culture conducive to continuous improvement. The report provides implications for broader continuous work in California and beyond, with three case studies providing more detail on exemplary practices in two districts and one school.
Evidence from the CORE Districts and the PACE/USC Rossier Poll
Publication author
Published

Summary

The increase in students opting out of standardized tests is a threat to accurately measuring student achievement. This brief examines the effects of opting out in the CORE districts and models how it could affect accountability measures. More opt-outs could significantly impact some metrics, but the growth measure is largely unaffected. Metrics tracking achievement by cohort are at risk of bias, even with low levels of opting out. Adjusting for characteristics of students who take the tests could be a solution.

Evidence from California’s CORE Districts
Publication authors
Published

Summary

This paper uses a large dataset to confirm that self-management skills predict student success and are a better predictor of student learning than other socio-emotional skills. Students with higher levels of self-management experience almost 80 days of additional learning. The paper also describes self-management gaps across student groups.
A Research Summary and Implications for Practice
Published

Summary

Given the importance of a college degree for both individual and societal economic prosperity, policymakers and educators are focused on strengthening the path to college beyond college entry. In this report, we synthesize the existing literature on four factors key to educational attainment—aspirations and beliefs, academic preparation, knowledge and information, and fortitude and resilience—and the implications of each.
Published

Summary

Continuous improvement is a holistic and research-based approach to education grounded in the belief that every system is designed to achieve the results it gets; therefore, change must be systemwide, not piecemeal. California is a national leader in the continuous improvement movement that is spreading throughout local school districts as well as state and county offices of education. At its annual conference in February 2019, PACE convened a panel of California educators working on the cutting edge of continuous improvement. In this brief, they share their stories and lessons learned.
Published

Summary

California Governor Gavin Newsom proposes $10 million to develop a statewide longitudinal data system to track student outcomes and align the education system with workforce needs. The lack of a coherent education database in California is a barrier to fulfilling continuous improvement policy goals. Experts discussed essential questions at a PACE conference in February 2019 to guide the development of a coordinated data system.
Publication authors
Published

Summary

This study examines the impact of target setting for non-academic indicators on school quality ratings in CORE districts' elementary schools. The authors found that non-academic measures of school quality vary over time, are not consistently associated with demographics, and are sensitive to small changes in rating thresholds. The results suggest a need for more research on target setting for non-academic indicators in school quality systems.
Publication author
Published

Summary

This report presents benchmarking data on self-report student surveys measuring social-emotional learning (SEL) from nearly half a million students in grades 4 through 12 across 8 CORE districts in California. The data provide means and standard deviations by construct, grade level, and subgroup, and can serve as a proxy for a nationally-normed sample for other schools across the country looking to administer the CORE survey.
Published

Summary

This report examines the stability of school effects on social-emotional learning (SEL) over two years in California's CORE districts. The correlations among school effects in the same grades across different years are positive but lower than those for math and ELA. While these effects measure real contributions to SEL, their low stability draws into question whether including them in school performance frameworks and systems would be beneficial.

Describing Chronically Absent Students, the Schools They Attend, and Implications for Accountability
Publication author
Published

Summary

In "Absent from School," PACE Executive Director Heather J. Hough analyzes student absenteeism using data from California's CORE districts. She explores the differences in absenteeism rates among students and schools, comparing them to other performance indicators. Dr. Hough also examines how schools' performance on chronic absence metrics corresponds to other accountability measures, highlighting the implications for reporting school-level measures of chronic absenteeism.

Published

Summary

California’s shift towards continuous improvement in education makes understanding how districts and schools can learn to improve a more pressing question than ever. The CORE Improvement Community (CIC), a network of California school districts engaged in learning about improvement together, is an important testing ground to learn about what this work entails.
Learning from the CORE Data Collaborative
Published

Summary

Effective data use is crucial for continuous improvement, but there is confusion about how it differs from data use for other purposes. This report explains what data are most useful for continuous improvement and presents a case study of how the CORE data collaborative uses a multiple-measures approach to support decision-making.

Building System Capacity to Learn
Publication authors
Published

Summary

Continuous improvement in education involves engaging stakeholders in problem-solving to discover, implement, and spread evidence-based changes that work locally to improve student success. California sees it as central to enduring education transformation. It requires an initial significant investment in time and money to make it a reality, but can improve education quality. However, California's data systems are inadequate for helping districts monitor progress, and more training and coaching are needed to build expertise for statewide implementation.

A Pragmatic Approach to Validity and Reliability
Publication authors
Published

Summary

This report discusses the validity and reliability of CORE Districts’ social-emotional learning (SEL) student-report surveys. Through a pragmatic approach, the report answers four guiding questions that explain different facets of validity for school leaders. The aim is to provide guidance around the use of SEL surveys within and outside of the CORE districts to facilitate decision-making for educational leaders.
Evidence from the CORE Districts
Published

Summary

This study examines how social-emotional skills develop from Grade 4 to Grade 12 and vary by gender, socioeconomic status, and race/ethnicity. Based on self-report student surveys administered to around 400,000 students in California, the study finds that social-emotional skills do not increase uniformly and vary across subgroups. Females have higher social awareness but lower self-efficacy than males. Economically disadvantaged students show improvement in high school. White students report higher social-emotional skills than African American and Latinx students.
An IRT Modeling Approach
Published

Summary

This study examines the properties of California's CORE Districts' SEL survey, which measures social-emotional learning in students. The survey was given to over 400,000 students in grades 3-12. The study uses both classical test theory and item response theory frameworks to analyze the data and make recommendations for modeling and scaling SEL survey data. Policy implications are discussed for educators, administrators, policy makers, and other stakeholders.