March 12 - 8:00 AM - 9:30 AM
Salon 7
Symposium

Section: Research Methods & Postsecondary Education

Organizer: Cristofer Price, Abt Associates

Evaluating Democracy Prep: An Application of the BASIE Framework
Abstract
Mariel Finucane, Mathematica

Bayesian Interpretation of Impact Estimates: Conceptual Issues, Myth Busting, and Frequently Asked Questions
Abstract
John Deke, Mathematica

Application of a Bayesian Analysis – An Example from Analysis of a Text-messaging-based Advising Intervention with Guidance on How to Replicate the Results
Abstract
Cristofer Price, Tamara Linkow, Hannah Miller & Amanda Parsad, Abt Associates

Discussant: Thomas Wei, Institute of Education Sciences

 

1B. Helping Students Rise to the Challenge: What We Are Learning from College Access and Success Programs

March 12 - 8:00 AM - 9:30 AM
Salon 1-3
Symposium

Section: Postsecondary Education & Research Methods

Organizer: Jennifer Hamilton, NORC

Synthesizing a Decade of Experimental Research on CUNY's ASAP
Abstract
Michael Weiss,  Colleen Sommo, Dan Cullinan & Michelle Manno, MDRC

Impact of College Advising on Non‐academic Outcomes in Young Adults: Follow‐up to the 2014‐ 2015 Bottom Line RCT
Abstract
Ann Kearns Davoren, NORC, Ben Castleman, University of Virginia, Andrew Barr, Texas A&M University, Karen Grigorian, Christopher Wong & Shana Brown, NORC

Increasing Degree Attainment of Low‐Income Community College Students: Preliminary Evidence from a Randomized Controlled Trial
Abstract
Marianne Bertrand, Kelly Hallberg, Kenneth Hofmeister & Brittany Morgan, University of Chicago

Discussant: Jon Baron, Arnold Ventures

 

1C. Mobile Messaging Supports for Parents of Young Children

March 12 - 8:00 AM - 9:30 AM
Studio D
Symposium

Section: Early Childhood Education & Use of Research Evidence across Settings

Organizer: Todd Grindal, SRI International

Using Mobile Messaging to Improve Parents Support of Preschool Children’s Science Learning
Abstract
Todd Grindal, SRI International, Megan Silander & Tiffany Maxon, Education Development Center, Sarah Gerard, SRI International, Naomi Hupert, Education Development Center, and Phil Vahey, SRI International

Using Behavioral Insights to Increase Attendance at Subsidized Preschool Programs: The Show Up to Grow Up Intervention
Abstract
Sebastián Gallegos V., Inter-American Development Bank, Ariel Kalil & Susan Meyer, University of Chicago

Text-based Mentoring for Postpartum Mothers: Early Results from a Mixed-methods Randomized Trial
Abstract
Eleanor Martin & Christina Weiland, University of Michigan, and Lindsay Page, University of Pittsburgh

Math Is for Girls: The Unequal Effects of Text-Messaging to Help Parents Support Early Math Development
Abstract
Christopher Doss, RAND, Hans Fricke, Amazon, and Susanna Loeb, Brown University

Discussant: Lisa Gennetian, Duke University

 

1D. Instructional Practices and Policies that Support English Learners

March 12 - 8:00 AM - 9:30 AM
Salon 5
Paper Session

Section: Academic Learning in Education Settings

Chair: Diane August, American Institutes for Research

English Learner Reclassification: Impacts on Student Outcomes and Potential Mechanisms
Abstract     Slides
Mark Chin, Harvard University

Recognizing the Growth Made by Students with Limited English Proficiency: A Latent Growth Curve Approach
Abstract
Shuai Zhang, Appalachian State University, Kausalai Wijekumar, Texas A&M University, and Sarah Fitzhugh, Lewisville Independent School District

Effects of English Learner Reclassification Policies on Academic Trajectories
Abstract
Julian Betts, University of California - San Diego, Laura Hill, Public Policy Institute of California, Karen Bachofer, University of California - San Diego, Joseph Hayes & Andrew Lee, Public Policy Institute of California, and Andrew Zau, University of California - San Diego

Final Outcomes of a Multisite Randomized Controlled Trial of Descubriendo la Lectura (DLL)
Abstract
Trisha Borman, American Institutes for Research, Geoffrey Borman, University of Wisconsin - Madison, So Jung Park, Bo Zhu, Scott Houghton & Alejandra Martin, American Institutes for Research

 

1E. Alternate Models for School Governance & Community Partnerships

March 12 - 8:00 AM - 9:30 AM
Salon 6
Paper Session

Section: Organization of Schools and Systems

Chair: Beth Schueler, University of Virginia

Portfolio School Reforms and Student Achievement in Washington, D.C.
Abstract
Dallas Dotter & Duncan Chaplin, Mathematica

The Economics of University-School-Community Partnerships: A Case Study Benefit-Cost Analysis of REACH
Abstract
Robert Shand, American University, and Anna Kushner, Atsuko Muroga, Viviana Rodriguez & Henry M. Levin, Columbia University

The Impact of Deregulation in Texas Public Schools
Abstract
Kylie Anglin, University of Virginia

 

1F. Methodological Advances in Replication and Generalization

March 12 - 8:00 AM - 9:30 AM
Studio E
Paper Session

Section: Research Methods & Use of Research Evidence across Settings

Chair: Rob Olsen, Westat

Randomized Controlled Trials and Regression Discontinuity Design Extrapolations: An Empirical Comparison
Abstract
Felipe Barrera-Osorio, Harvard University, Deon Filmer, World Bank, and Joe McIntyre, Luke Miratrix & Nozomi Nakajima, Harvard University

Can Quasi-Experimental Evaluations that Rely on State Longitudinal Data Systems Replicate Experimental Results: Findings from a Within-Study Comparison
Abstract
Fatih Unlu, RAND, Douglas Lee Lauen & Sarah Crittenden Fuller, University of North Carolina - Chapel Hill, and Tiffany Tsai, RAND

Evaluating Methods for Handling Multilevel Selection for the Purpose of Generalizing Cluster Randomized Trials
Abstract
Eva Yujia Li & Christopher Rhoads, University of Connecticut

Towards a Framework for Empirically Testing Conditions for External Validity Bias in Causal Effect Estimation
Abstract
Andrew P. Jaciw, Empirical Education, Fatih Unlu, RAND, and Thanh Nguyen, Empirical Education

 

1G. Fostering Students' Motivation and Self-Regulation

March 12 - 8:00 AM - 9:30 AM
Studio F
Paper Session

Section: Social and Emotional Learning in Educational Settings

Chair: Elisa Garcia, SRI International

AI Agent-based Scaffolding for Online Learners’ Self-regulation
Abstract
Donggil Song & Eun Young Oh, Sam Houston State University

A Large-Scale CRCT of a Mindfulness-Based Social and Emotional Learning Program in K-2
Abstract
Rebecca Hinze-Pifer, University of Illinois - Urbana/Champaign, and Stephen Baker, University of Chicago

The Impact of Approaches to Learning on Early Academic Performance
Abstract
Bixi Zhang & Spyros Konstantopoulos, Michigan State University

The Effectiveness of a Utility-Value Intervention in Math Classrooms: A Cluster-Randomized Trial
Abstract
Hanna Gaspard, Cora Parrisius, Heide Piesch, Eike Wille, Benjamin Nagengast & Ulrich Trautwein, University of Tübingen, and Christopher S. Hulleman, University of Virginia

 

Session 2 - 9:45 AM - 11:15 AM

2A. The Longer Term Effects of Early Childhood Education

March 12 - 9:45 AM - 11:15 AM
Salon 6
Symposium

Section: Early Childhood Education

Organizer: William Gormley, Georgetown University

The Long-Run Achievement Impacts of Early Head Start: Evidence from Program Roll-out
Abstract
Jennifer Duer & Jade Jenkins, University of California - Irvine

Does Early Childhood Education Help to Improve High School Outcomes? Results from Tulsa
Abstract
Sara Anderson, Child Trends, William Gormley, Georgetown University, Amy Claessens & Katherine Magnuson, University of Wisconsin - Madison, and Katelyn Romm, West Virginia University

Quantifying and Predicting Variation in the Medium-Term Effects of Oversubscribed Prekindergarten Programs
Abstract
Rebecca Unterman, MDRC, and Christina Weiland, University of Michigan

Discussant: Todd Grindal, SRI International

 

2B. Causal Inference in Clustered Observational Studies Using Optimal Multilevel Matching

March 12 - 9:45 AM - 11:15 AM
Studio C
Symposium

Section: Research Methods & Use of Research Evidence across Settings

Organizer: Daniel Long, University of Connecticut

An Overview of Clustered Observational Studies and Multilevel Matching
Abstract
Luke Keele, University of Pennsylvania

Examining the Effects of Gifted Classes on Mathematics and Reading/Language Arts Achievement
Abstract     Slides
Daniel Long, Betsy McCoach & Christopher Rhoads, University of Connecticut

The Impact of a District Turnaround Model: Applying Multilevel Matching to a Clustered Observational Study
Abstract
Matthew Lenard, Harvard University

Discussant: Elizabeth Tipton, Northwestern University

 

2C. Achieving Equitable Outcomes in Reading Skills

March 12 - 9:45 AM - 11:15 AM
Studio B
Paper Session

Section: Academic Learning in Education Settings & Education in Global Contexts

Chair: Nicole Arshan, SRI International

Teaching Practice and the Gender Gap in Reading Achievement
Abstract
Esteban Aucejo, Arizona State University, Jane Cooley Fruehwirth, University of North Carolina - Chapel Hill, Sean Kelly, University of Pittsburgh, and Robert Bringe, University of North Carolina - Chapel Hill

Impact from a One-day Intensive School Support Visits during a Primary Grade Reading Intervention in Ghana
Abstract
Marcia Davidson & Nina Menezes-Cunha, FHI360

Effects of the Literacy First Tutoring Program on Grade 2 Students’ Reading Skills
Abstract
Ginger Stoker & Sarah Caverly, American Institutes for Research

 

2D. Exploring Alternative Approaches to High School / Postsecondary Transitions

March 12 - 9:45 AM - 11:15 AM
Studio F
Paper Session

Section: Organization of Schools and Systems & Postsecondary Education

Chair: Mike Weiss, MDRC

Orders by Email: Experimental Evidence of Targeted Communications on Short-term Enrollment Effects for Active Post 9/11 GI Bill Beneficiaries
Abstract
Dennis Kramer, University of Florida, Rekha Balu, MDRC, and Daniel Klasik, University of North Carolina

The Impact of Early Colleges on Students’ Postsecondary Degree Completion
Abstract     Slides
Julie A. Edmunds, University of North Carolina - Greensboro, Fatih Unlu, RAND, and Elizabeth Glennie, RTI International

The Consequences of High School Exit Examinations for Students’ Life Outcomes
Abstract
John Papay & Ann Mantil, Brown University, and Richard Murnane, Harvard University

Online Credit Recovery: Implementation and Initial Impact of a Prevalent Practice
Abstract
Jordan Rickles, Rui Yang, Peggy Clements, Iliana Brodziak de los Reyes & Jessica Heppen, American Institutes for Research

 

2E. Advances in Regression Discontinuity Designs

March 12 - 9:45 AM - 11:15 AM
Studio E
Paper Session

Section: Research Methods

Chair: Kelly Hallberg, University of Chicago

Scaling up the Provision of an Information Program: Evidence from a Regression Discontinuity Analysis
Abstract
Felipe Barrera-Osorio & Kathryn E. Gonzalez, Harvard University

A Bayesian Nonparametric Approach to Geographic Regression Discontinuity Designs: Estimating the Cost of a School District
Abstract
Maxime Richard, Harvard University, Zach Branson, Carnegie Mellon University, Luke Bornn, Simon Fraser University, and Luke Miratrix, Harvard University

Rounding Errors in Standardized Tests: Revisiting Regression Discontinuity Applications with ACT Composite Scores
Abstract
Junpeng Yan, University of Missouri

 

2F. Staffing Schools with Effective Teachers: Understanding Teacher Turnover and Teacher Pipelines

March 12 - 9:45 AM - 11:15 AM
Salon 5
Paper Session

Section: Teachers and School Leaders & Organization of Schools and Systems

Chair: Jessalyn James, Brown University

Testing, Teacher Turnover, and the Distribution of Teachers across Grades and Schools
Abstract
Dillon Fuchsman, University of Arkansas, Tim Sass, Georgia State University, and Gema Zamarro, University of Arkansas

The Effects of Pay Decentralisation on Teachers' Pay and Teacher Retention
Abstract
Jake Anders, Alex Bryson, Hedvig Horvath & Bilal Nasim, University College London

Racial Diversity in the Teacher Pipeline: Evidence from Massachusetts
Abstract
Melanie Rucinski, Harvard University, and Joshua Goodman, Brandeis University

The Association between Teaching Students with Disabilities and Teacher Turnover
Abstract
Allison Gilmour, Temple University, and Joseph Wehby, Vanderbilt University

 

2G. Evidence Standards and Synthesis

March 12 - 9:45 AM - 11:15 AM
Salon 1-3
Paper Session

Section: Use of Research Evidence across Settings

Chair: Matthew Soldner, U.S. Department of Education

Replication Versus Generalization: A Comparison of Two Frames for Understanding Building Evidence for Program Effectiveness
Abstract
Mark White, University of Oslo

Considerations for Evidence Standards in Education Research
Abstract
Lyzz Davis & Joe Taylor, American Institutes for Research

Visualizing the Evidence on Social and Emotional Learning Interventions
Abstract
Amanda Inns, Sooyeon Byun, Elizabeth Kim, Cynthia Lake & Robert Slavin, Johns Hopkins University

 

Career Forum - 11:30 AM - 12:30 PM

American Institutes for Research
WestEd

March 12 - 12:30 PM - 1:45 PM
Salon 5

 

Professional Development Sessions - 12:30 PM - 1:45 PM

Democratizing Evidence in Education: The Search for Balance between Inclusivity and Expertise

March 12 - 12:30 PM - 1:45 PM
Studio B
Professional Development Session

Abstract     Slides

Section: Use of Research Evidence across Settings & Organization of Schools and Systems

Moderator: Jim Kohlmoos, EDGE Consulting

Panelists

Ilene Berman, Annie E Casey Foundation

Steven Fleischman, Change Dynamics, LLC

Esther Quintero, Albert Shanker Institute

Lashawn Richburg-Hayes, Insight Policy Research

Vivian Tseng, William T. Grant Foundation

 

Meeting the Requirements of Funders Around Open Science: Open Resources and Processes for Researchers

March 12 - 12:30 PM - 1:45 PM
Studio D
Professional Development Session

Bryan Cook, University of Virginia

David Mellor, Center for Open Science

Jessaca Spybrook, Western Michigan University

Expectations by funders for transparent and reproducible methods are on the rise. This session will cover expectations for preregistration, data sharing, and open access results of three key funders of education research including the Institute of Education Sciences, the National Science Foundation, and Arnold Ventures. Presenters will cover practical resources for meeting these requirements such as the Registry for Efficacy and Effectiveness Studies (REES), the Open Science Framework (OSF), and EdArXiv.

 

Evidence for Federal Agencies: Assessing the Evidence Act at the One-Year Mark

March 12 - 12:30 PM - 1:45 PM
Studio E
Professional Development Session

Moderator: Andy Feldman, Grant Thornton Public Sector

Panelists

Rekha Balu, MDRC

Nick Hart, Data Coalition

Kate Tromble, Results for America

 

Join us for a discussion with federal evidence experts and thought leaders about the Foundations for Evidence-Based Policymaking Act, which was enacted just over a year ago. We will examine what the legislation is designed to do, its impact to date on federal agencies, and its longer-term potential. We will also consider early lessons from the legislation for education experts and policymakers, at all levels of government, looking to strengthen a culture of evidence-based decision making.

 

Moderator: Geoff Zimmerman, KnowledgeWorks

Panelists:

Kate Caton, Georgia State University

Amanda Danks, North Carolina State University

Rebecca Villarreal, Ascendium

 

Hear from funders and fellows about this unique partnership, including findings from two projects focused on summer melt and competency based standards and the workforce of the future.   

 

Session 3 - 2:00 PM - 3:30 PM

3A. Exploring Heterogeneity in Children’s Classroom Experiences: Identifying the Features of Early Childhood Instruction that Matter Most for Students

March 12 - 2:00 PM - 3:30 PM
Studio B
Symposium

Section: Early Childhood Education & Academic Learning in Education Settings

Organizer: Meghan McCormick, MDRC

Linking Instructional Aspects of Children’s Early Classroom Learning Experiences to Student Outcomes in PreK and Kindergarten
Abstract
Michelle Maier, Meghan McCormick, Samantha Xia, Christina Weiland & JoAnn Hsueh, MDRC, Jason Sachs, Boston Public Schools, and Catherine Snow, Harvard University

Children’s Individual Experiences in Kindergarten and Preschool Fadeout
Abstract
Kelly Purtell, Hui Jiang, Laura Justice, Tzu-Jung Lin & Jessica Logan, Ohio State University

Prekindergarten Classroom Organization: Variation across Children in the Same Classroom and Relations to Learning Gains
Abstract
Lillie Moffett, Amanda Weissman & Christina Weiland, University of Michigan

Observed Classroom Practices in Relation to Differential Gains in Kindergarten and First Grade
Abstract
Mary Bratsch-Hines, Margaret Burchinal & Rose Bryne, University of North Carolina

Discussant: JoAnn Hsueh, MDRC

 

3B. Reaching Farther: Combining Data Sources to Extend and Enrich Research Findings

March 12 - 2:00 PM - 3:30 PM
Studio D
Symposium

Section: Research Methods

Organizer: Sophie Litschwartz, Harvard University

Characterizing Cross-Site Variation in Local Average Treatment Effects in Multisite RDD Contexts with an Application to Massachusetts High School Exit Exams

Sophie Litschwartz & Luke Miratrix, Harvard University

Generalizing Randomized Trial Findings to a Target Population Using Complex Survey Population Data
Abstract
Ben Ackerman, Catherine Lesko & Elizabeth Stuart, Johns Hopkins University

Lurking Inferential Monsters? Quantifying Selection Bias in Non-experimental Evaluations of School Programs
Abstract
Ben Weidman & Luke Miratrix, Harvard University

Discussant: Elizabeth Tipton, Northwestern University

 

3C. Building Vocabulary, Reading Comprehension, and Domain Knowledge

March 12 - 2:00 PM - 3:30 PM

Studio E
Paper Session

Section: Academic Learning in Education Settings

Chair: Jill Pentimonti, University of Notre Dame

How Do Latent Variables of Decoding and Language Predict Reading Comprehension across Two Years in Grades 5, 7, and 9?
Abstract
Barbara Foorman, Yi-Chieh Newton, Jamie Quinn & Yaacov Petscher, Florida State University

Experimental Effects of a Model of Reading Engagement (MORE) on First and Second Grade Students’ Domain Knowledge
Abstract
James Kim, Harvard University, Jackie Relyea, North Carolina State University, Mary Burkhauser & Ethan Scherer, Harvard University

Examining the Impact and Generalizability of a Supplemental Vocabulary Curriculum on Upper Elementary Students’ Vocabulary Acquisition
Abstract
Bryan Matlen, Gary Weiser, Kevin Huang & Linlin Li, WestEd

  

3D. Causal Evidence on Impact of Programs Aiming to Boost Postsecondary Success

March 12 - 2:00 PM - 3:30 PM
Salon 7
Paper Session

Section: Postsecondary Education

Chair: Corinne Alfeld, U.S. Department of Education

Gaining Ground: Findings from the Dana Center Mathematics Pathway Impact Study
Abstract
Elizabeth Zachry Rutschow, Susan Sepanik & Victoria Deitch, MDRC, Julia Raufman, Community College Research Center, Dominique Dukes, MDRC, and Adnan Moussa, Community College Research Center

Basic Writers and the Challenges of Writing from Sources: Experimental Study of a Strategy Instruction Approach
Abstract     Slides
Charles MacArthur, University of Delaware, Zoi Traga Philippakos, University of Tennessee, Henry May & Jill Compello, University of Delaware

Evaluation of a Multiple Measures Placement System Using Data Analytics: Final Impact Findings
Abstract
Elisabeth Barnett, Peter Bergman & Elizabeth Kopko, Community College Research Center, Dan Cullinan, MDRC, and Clive Belfield, Community College Research Center

The Effects of a Comprehensive College Transition Program on Psychosocial Outcomes: Evidence from a Randomized Control Trial
Abstract
Elise Swanson & Tatiana Melguizo, University of Southern California, Francisco Martorell, University of California-Davis, and Adrianna Kezar, University of Southern California

 

3E. Cost Considerations in the Design and Implementation of Studies

March 12 - 2:00 PM - 3:30 PM
Salon 1-3
Paper Session

Section: Research Methods

Chair: A. Brooks Bowden, University of Pennsylvania

Estimating Social Return on Investment for a Portfolio of Programs with Missing Inputs: Challenges and Innovations
Abstract
Eric Rolfhus, Steve Bell, Matt Finster, Don Barfield & Gay Lamey, Westat

Beyond the Basics: Conducting a Cost Analysis of a Multi-site Program Implementation
Abstract
Jaunelle Pratt-Williams & Tali Klima, SRI International

Making Cost-effectiveness Estimates More Useful for Policy: An Argument against Standardization
Abstract
Alaka Holla & Yilin Pan, World Bank, Caitlin Tulloch, International Rescue Committee, and Elena Walls, U.S. Agency for International Development

Leveraging Differential Sampling Cost Structures to Improve the Design of Cluster-Randomized Trials
Abstract
Zuchao Shen, University of Florida, and Ben Kelcey, University of Cincinnati

 

3F. Promoting SEL Skills and Positive School Climate

March 12 - 2:00 PM - 3:30 PM
Salon 5
Paper Session

Section: Social and Emotional Learning in Educational Settings

Chair: Amanda Inns, Johns Hopkins University

Student and School Characteristics Associated with Academic Performance and English Language Proficiency among English Learner Students in Grades 3–8 in the Cleveland Metropolitan School District
Abstract
Rachel Garrett, American Institutes for Research, José Gonzalez, Cleveland Metropolitan School District, Elisabeth Davis & Ryan Eisner, American Institutes for Research

A Meta-Analytic Review of Research on Social and Emotional Learning Programs
Abstract
Sooyeon Byun, Amanda J. Inns, Elizabeth Kim, Cynthia Lake & Robert Slavin, Johns Hopkins University

Can the Academic Impacts of a Brief Middle-School Self-Affirmation Intervention Propel Students through High School?
Abstract
Geoffrey D. Borman, Yeseul Choi & Garret Hall, University of Wisconsin - Madison

Personalization for Academic and Social Emotional Learning (PASL): QED Results from a District-wide Social Emotional Learning Intervention
Abstract
Jeffrey A. Rosen, Yihua Hong & Susan Rotermund, RTI International, and Katherine Leu, University of Michigan

 

3G. Analyzing the Understanding and Use of Research through Documents, Interviews, and Network Effects

March 12 - 2:00 PM - 3:30 PM
Studio A
Paper Session

Section: Use of Research Evidence across Settings

Chair: Paula Arce-Trigatti, Rice University

Social Impact Bonds for Preschool? How School Leaders and Policymakers Understand Evidence-Based Preschool and Associated Outcomes
Abstract
Sarah Kabourek, NORC

Educators’ Research Networks: Applying Ego Networks and Latent Profile Analysis to Characterize Opportunity for Research Use
Abstract
Ji-Young Yun & Elizabeth N. Farley-Ripple, University of Delaware

Exploring Applications of Natural Language Processing to Policy Research
Abstract
Debbie Kim & Brandon Sepulvado, NORC

 

Session 4: Works in Progress Poster Session - 3:45 PM - 4:45 PM

Coffee Break
Sponsored by MDRC

March 12 - 3:45 - 4:45 PM
Foyer 

4A. Academic Learning in Education Settings - In the Pipeline Poster Session

March 12 - 3:45 PM - 4:45 PM
Foyer Group A

Works in Progress Poster Session

1. High School Career and Technical Education: Relationships with Postsecondary Trajectories and Future Labor Outcomes
Abstract     Poster
Monica Mean, University of Maryland - Baltimore County

2. How Executive Function Impacts the Growth of Reading Achievement: A Stepwise Approach
Abstract     Poster
Zachary T. Barnes & John R. McConnell III, Austin Peay State University

3. Development of the EXPERT Training Program: How Do We Enhance Collaborative Teacher Expertise in Data-Based Decision Making for Reading Intervention?
Abstract
Jessica R. Toste & Nathan Clemens, University of Texas - Austin, and Jennifer Stone, Meadows Center for Preventing Educational Risk

4. An Efficacy Study of MathSpring, a Personalized Learning System That Responds to Student Affect
Poster
Mingyu Feng, WestEd, Beverly Wolf & Ivon Arroyo, University of Massachusetts - Amherst, and Steve Schneider, WestEd

5. Cross-Sectional Examination of Writing Quality in Elementary School Students: An Exploration of an Empirical Based Model of Writing Factors Across Grades 1 to 5
Abstract     Poster
Lara-Jeane Costa & Stephen Hooper, University of North Carolina - Chapel Hill

6. Building Statistical Thinking with Social Justice Investigations and Social Science Data
Abstract     Poster
Josephine Louie, Education Development Center, Beth Chance & Soma Roy, California Polytechnic State University, Emily Fagan & Jennifer Stiles, Education Development Center

7. Works in Progress: Project DIMES- Diagnostic Instrument for Morphology of Elementary Students
Abstract     Poster
TaeYeon Kwon & A. Corinne Huggins-Manley, University of Florida, Amanda P. Goodwin, Vanderbilt University, Jonathan Templin, University of Iowa, Amber E. Benedict, Arizona State University, and Mingying Zheng, University of Iowa

8. Effects of the 4th/5th-Grade Coder-in-Residence Program: Gigabots!
Abstract     Poster
Mari Strand Cary & Patrick Kennedy, University of Oregon, Heidi Larwick & Matt Hayes, Lane Education Service District

9. Individualized, iPad-based Math Instruction – Does an External, Proximal Measure Reveal Differences in Students’ Rates of Learning?
Abstract     Poster
Mari Strand Cary & Lina Shanley, University of Oregon, Ryann Crowley, Oregon Research Institute, and Sam Choo, University of Oregon

10. Opportunities to Earn Industry Certifications in High School: Implementation of Florida’s Career and Professional Education Act
Abstract
Elizabeth Glennie, Ben Dalton, Siri Warkentien, Erich Lauff, Elizabeth Parish & Roger Studley, RTI International

11. Interactions among Reading and Language Development and Instructional Contexts for English Learners at Risk for Language and Learning Difficulties in Grades 4-12
Abstract
Jeremy Miciak & Yusra Ahmed, University of Houston

12. Efficacy Study of a First Grade Integrated Science and Literacy Curriculum
Abstract
Alison Billman, University of California - Berkeley, Robert Murphy, RAND, Mingyu Feng, WestEd, Daisy Rutstein, SRI International, and Christopher J. Harris, WestEd

13. The WeatherX Project: Understanding Weather Extremes with Big Data and Inspiring Rural Youth in Data Science
Abstract     Poster
Kevin Waterman & Josephine Louie, Education Development Center, Brian Fitzgerald, Mount Washington Observatory, Asli Sezen-Barrie, University of Maine, Deborah Morrison, University of Washington, William Finzer, Concord Consortium, and Pamela Buffington, Education Development Center

 

4B. Early Childhood Education - In the Pipeline Poster Session

March 12 - 3:45 PM - 4:45 PM
Foyer Group B

Works in Progress Poster Session

14. Scaling Up Pyramid Model Implementation in Preschool and Kindergarten Classrooms: Evaluation Considerations and Preliminary Results
Abstract     Poster
Dominique Tunzi, Elisa Garcia, Melanie Chong & Erika Gaylor, SRI International

15. Family Support Staff and Parent Relationships in Early Childhood Education Settings
Abstract     Poster
Tanya Tavassolie, University of Maryland - College Park, Sarah Rasher, OER Associates, Lizzette Arcos, Educare West DuPage, Marie Perrot & Mallary Swartz, Ounce of Prevention, Sandra Soliday Hong & Laura Kuhn, Frank Porter Graham Institute

16. Technology-based Implementation Supports: Approach Used in the TeacherRead Study
Abstract     Poster
Danielle Shaw Attaway, Michael Little, Jill Pentimonti & Virginia Buysse, American Institutes for Research

17. Young Mathematicians (YM): Expanding an Innovative and Promising Model Across Learning Environments to Promote Preschoolers' Mathematics Knowledge
Abstract     Poster
Jessica Mercer Young, Kristen Reed & Lindsay Clements, Education Development Center

Abstract
Emily K. Penner, University of California - Irvine, Shelby M. McNeill, Vanderbilt University, Gary T. Henry, University of Delaware, Erica Harbatkin, Vanderbilt University, and Jade M. Jenkins, University of California - Irvine

19. Moderation of the Cognitive Impacts of Head Start by Children’s Absenteeism
Abstract     Poster
Jill Gandhi, New York University 

20. Strengthening School Readiness through Universal Pre-K: A University-District Partnership
Abstract
Jessica Siegel, Rachel Abenavoli, Elise Cappella & Pamela Morris, New York University

21. Development and Validation of a Mobile, Web-Based Coaching Tool to Improve Pre-K Classroom Practices to Enhance Learning
Abstract     Poster
Caroline Christopher, Katherine Newman, Deanna Meador & Clare Speer, Vanderbilt University

 

4C. Organization of Schools and Systems - In the Pipeline Poster Session

March 12 - 3:45 PM - 4:45 PM
Foyer Group C

Works in Progress Poster Session

22. Testing The Promise Of Restorative Practices For Reducing Teacher Turnover In Hard-To-Staff Schools
Abstract     Poster
Ashley Grant, Johns Hopkins University

23. Building an Equitable STEM Pipeline: Benefits of Taking Algebra 1 in Eighth-Grade
Abstract
Julia Bloom-Weltman, Marshal Fettro, Lauren Jetty & Sheila Brookes, AEM Corporation

 

4D. Postsecondary Education - In the Pipeline Poster Session

March 12 - 3:45 PM - 4:45 PM
Foyer Group D

Works in Progress Poster Session

24. Exploring Learners’ Behavioral Patterns in a Simulation-based Teaching Training in Virtual Reality
Poster
Zhaihuan Dai, Fengfeng Ke & Chih-Pu Dai, Florida State University, Mariya Pachman, Independent Consultant, Xin Yuan, Florida State University 

25. Work in Progress: A Systematic Review and Meta-Analysis of College Aid Programs
Abstract
Robin LaSota, Development Services Group, Joshua R. Polanin, American Institutes for Research, and Laura Perna, University of Pennsylvania

26. The Evaluation of Career and College Promise
Abstract     Poster
Julie Edmunds, University of North Carolina - Greensboro, and Fatih Unlu, RAND

 

4E. Research Methods - In the Pipeline Poster Session

March 12 - 3:45 PM - 4:45 PM
Foyer Group E

Works in Progress Poster Session

27. How Generalizable Are Study Samples Over Time?
Abstract     Poster
Wendy Chan, Jimin Oh & Peihao Luo, University of Pennsylvania 

28. Aiming for Representative Samples in Impact Studies: Evidence from Head Start
Abstract     Poster
Emily Diaz, Stephen Bell & Rob Olsen, Westat 

29. Selecting Districts and Schools for Impact Studies in Education: A Simulation Study of Different Methods
Abstract     Poster
Daniel Litwok & Azim Shivji, Abt Associates, Rob Olsen, Westat

30. Design Parameters and Effect Sizes for Designing Two-Level and Three-Level Cluster Randomized Trials to Detect Moderator Effects
Abstract     Poster
Qi Zhang & Jessaca Spybrook, Western Michigan University

31. Using Lasso Regression to Predict Impacts Locally: Reanalysis of Data on Teach for America
Abstract     Poster
Elizabeth Petraglia & Rob Olsen, Westat, and Elizabeth Stuart, Johns Hopkins University 

32. Effects of Intervention Duration on Outcomes of Experiments in Education
Abstract     Poster
Marta Pellegrini, University of Florence, Amanda Inns, Cynthia Lake & Robert Slavin, Johns Hopkins University

33. Adjusting standard deviation estimates to account for homogeneity of samples
Abstract     Poster
Kaitlyn G. Fitzgerald, Northwestern University

34. Evaluation of a Tutoring and Family Engagement Structured Early Literacy Program: Future Forward
Abstract     Poster
John Bowser & Curtis Jones, University of Wisconsin - Milwaukee

 

4F. Social and Emotional Learning in Education Settings - In the Pipeline Poster Session

March 12 - 3:45 PM - 4:45 PM
Foyer Group F

Works in Progress Poster Session

35. Measurement in the Context of Intervention
Abstract     Poster
Mark White, University of Oslo

36. Positive, Engaged, Achieving Kids (PEAK): An Ongoing National Effectiveness Trial of a Universal Social-Emotional Learning Program in the Primary Grades
Abstract     Poster
Susan Hart, James DiPerna, Leah Hunter, Pui-Wa Lei, Xinyue Li & Hui Zhao, Pennsylvania State University 

37. Self-Identification of Emotion through Ed Tech Tools by First and Second Graders
Abstract     Poster
Julie Neisler, Wendy Xiao & Andrew Krumm, Digital Promise

 

4G. Teachers and School Leaders - In the Pipeline Poster Session

March 12 - 3:45 PM - 4:45 PM
Foyer Group G

Works in Progress Poster Session

38. Scaling Up an Intervention with Social Validity in Mind: The Iterative Process of Manualizing a Program in the Pursuit of Meaningful Effects
Abstract     Poster
Mary Rose Sallese, Texas A&M University, and Kimberly J. Vannest, University of Vermont

39. Evaluation of the National Writing Project’s College, Career, & Community Writers’ Program (C3WP)
Abstract     Poster
Nicole Arshan, C.J. Park, Sara Rutherford-Quach, Allison Milby, Daniela Torre-Gibney & Katrina Woodworth, SRI International

40. Incorporating an Implementation Intervention for Principals and the Impact on Teacher Fidelity of Implementation of an Evidence Based Writing Intervention
Abstract     Poster
Julie Owens, Debra McKeown & Kay Wijekumar, Texas A&M University

41. Teacher Segregation and Effectiveness: Evidence from Pennsylvania
Abstract     Poster
Haisheng Yang, University of Pennsylvania

 

4H. Use of Research Evidence across Settings - In the Pipeline Poster Session

March 12 - 3:45 PM - 4:45 PM
Foyer Group H

Works in Progress Poster Session

42. Using Research Evidence to Understand Why Some Charter Schools Outperform Others
Abstract     Poster
Rob Olsen & Sana Ahmed Wilder, Westat

43. Impact of a Comprehensive District-Level Digital Learning Policy on High School Outcomes
Abstract     Poster
Amanda Danks, North Carolina State University

44. A Meta-Analysis of Pre-K to Grade 3 Educational Apps: Are there Meaningful Effects on Student Achievement Outcomes?
Abstract     Poster
James Kim, Josh Gilbert, Charles Gale & Vicky Yu, Harvard University

 

 

Hedges Lecture & Awards Ceremony - 5:00 PM - 6:30 PM

Mobilizing Evidence to Reduce Educational Inequality: A Life-Course Perspective

March 12 - 5:00 PM - 6:30 PM
Salon 1-4

 

Hedges Lecture

Sponsored by American Institutes for Research, Spencer Foundation, and William T. Grant Foundation

Stephen Raudenbush, University of Chicago

 

Hedges Reception

Sponsored in part by William T. Grant Foundation

March 12 - 6:30-7:30 PM
Foyer

 

FRIDAY, MARCH 13

Graduate Student Breakfast

March 13 - 7:00 AM - 8:00 AM
Studio C

Join other students for breakfast and a chance to network.

 

Session 5 - 8:00 AM - 9:30 AM

5A. Bridging The Divide: How Traditional and New Media Can Make Research More Actionable

March 13 - 8:00 AM - 9:30 AM
Studio B
Panel

Section: Use of Research Evidence across Settings & Research Methods

Moderator: Jonathan Supovitz, University of Pennsylvania

Panelists

Elizabeth Green, Chalkbeat

Sarah D. Sparks, Education Week

Roger Riddell, Education Dive: K-12

Keith Heumiller, CPRE Knowledge Hub

 

5B. Access and Choice in Pre-k: Examining Patterns of Application and Enrollment in Large Urban Cities

March 13 - 8:00 AM - 9:30 AM
Studio D
Symposium

Section: Early Childhood Education & Organization of Schools and Systems

Organizer: Amanda Stein, Ounce of Prevention Fund

If You Offer It, Will They Come? Patterns of Application and Enrollment Behavior in a Universal Prekindergarten Context
Abstract
Anna Shapiro, Eleanor Martin & Chris Weiland, University of Michigan, and Rebecca Unterman, MDRC

How a Study of Pre-k Access and Enrollment in One Large District Informs Questions of Equity
Abstract
Maia Connors, Ounce of Prevention Fund, Stacy Ehrlich & John Francis, NORC, Amanda Stein, Ounce of Prevention Fund, John Easton, UChicago Consortium on School Research, and Sarah Kabourek, NORC

Choosing Children’s First School Settings: The Role of Program and Family Characteristics
Abstract
Rachel Abenavoli, Elizabeth Miller, Christopher Rodrigues & Pamela Morris, New York University

Effects of Public Quality Ratings on Parents’ Early Childhood Program Preferences
Abstract
Lindsay Weixler, Tulane University, Matthew Larsen, Lafayette College, and Catherine Balfe, Tulane University 

Discussant: Chloe Gibbs, University of Notre Dame

 

5C. Recent Improvements to the What Works Clearinghouse

March 13 - 8:00 AM - 9:30 AM
Salon 6
Symposium

Section: Research Methods

Organizer: Joshua R. Polanin, American Institutes for Research

Making What Works Clearinghouse Systematic Reviews in Early Childhood to Grade 12 Relevant and Useful
Abstract
Elias Walsh, Dana Rotz & Jill Constantine, Mathematica

Finding Everything that Works: Accessing and Using What Works Clearinghouse Source Data
Abstract
Michael Frye, Allan Porowski & Yuhe Gu, Abt Associates

Version 4.1 of the WWC Standards and Procedures Handbooks
Abstract
Jeffrey C. Valentine, University of Louisville, Ryan Williams, Joe Taylor, Sarah Caverly, Daniel Hubbard, Elizabeth Nolan & Joshua R. Polanin, American Institutes for Research

Discussant: Jonathan Jacobson, U.S. Department of Education

 

5D. Learning and Assessment in PK-12 Science

March 13 - 8:00 AM - 9:30 AM
Studio E
Paper Session

Section: Academic Learning in Education Settings & Early Childhood Education

Chair: Robert Ochsendorf, National Science Foundation

Making Sense of SCIENCE: The Challenges of Impacts and Assessments
Abstract
Andrew P. Jaciw, Thanh Nguyen, Jenna Zacamy & Li Lin, Empirical Education

Learning Science and Engineering from Videos and Games; A Randomized Trial of PBS KIDS The Cat in the Hat Knows a Lot About That
Abstract
Megan Silander, Education Development Center, Todd Grindal & Sarah Gerard, SRI International, Tiffany Maxon, Education Development Center, Elisa Garcia, SRI International, Naomi Hupert, Education Development Center, and Phil Vahey, SRI International

Next Generation Preschool Science: Findings from Design-based Research to Inform Iterative Development of an Innovative Curricular Program and a Field Study to Examine Implementation and Efficacy
Abstract
Ximena Dominguez, Digital Promise Global, and Marion Goldstein, Education Development Center

Evaluation of a Project-based Science Intervention for High School Chemistry and Physics
Abstract
Quinton Baker, Christopher Klager, Barbara Schneider, Joseph Krajcik, I-Chien Chen, Lydia Bradford & Sarah Maestrales, Michigan State University

  

5E. Student Assignment and the Dynamics of Schooling Supply and Demand

March 13 - 8:00 AM - 9:30 AM
Salon 5
Paper Session

Section: Organization of Schools and Systems & Education in Global Contexts

Chair: Rekha Balu, MDRC

The Protective Effects of Student Reassignment: Evidence from a Districtwide Socioeconomic Integration Plan
Abstract
Thurston Domina & James Carter, University of North Carolina - Chapel Hill, Deven Carlson, Oklahoma University, Matthew Lenard, Harvard University, and Andrew McEachin, RAND

Cash Transfers and Information: Experimental Evidence for the Demand for Education Under Supply Constraints
Abstract
David K. Evans, Center for Global Development, Charles Gale, Harvard University, and Katrina Kosec, International Food Policy Research Institute

Dynamic Complementarities: Primary Student Responses to Free Secondary Education in Tanzania
Abstract
Wayne Sandholtz, University of California - San Diego

Can School Choice Mitigate School Socioeconomic Segregation? Evidence from a Policy Change in Chile
Abstract
Francisco Lagos, University of Maryland - College Park

  

5F. Impact of Job Training and Youth Employment Programs

March 13 - 8:00 AM - 9:30 AM
Salon 7
Paper Session

Section: Postsecondary Education & Academic Learning in Education Settings

Chair: Monica Mean, U.S. Department of Education

The Counterfactual Matters: Experimental Findings on the Impact of Workforce Exposure during High School
Abstract
Monica Bhatt & Kelly Hallberg, University of Chicago

Sector-Specific Adult Education for Screened Disadvantaged Workers: RCT Evidence on Employment, Earnings and Industry
Abstract
Matthew Baird, John Engberg & Italo Gutierrez, RAND

Does Job Training Reduce Arrests? Evidence from a Disadvantaged Worker RCT
Abstract
Shamena Anwar, Matthew Baird, John Engberg & Rosanna Smart, RAND

Experimental Evidence on the Impact of Long-Term Credentials in the Healthcare Sector
Abstract
Daniel Litwok, Laura Peck & Douglas Walton, Abt Associates

 

5G. Estimating Treatment Effects and Treatment Effect Variation

March 13 - 8:00 AM - 9:30 AM
Salon 1-3
Paper Session

Section: Research Methods

Chair: Fatih Unlu, RAND

Are Gain Scores Really a “Treacherous Quicksand”? An Empirical Comparison between Gain Score Methods and ANCOVA
Abstract
Yongnam Kim, University of Missouri

Estimating Treatment Effect Variation on Multilevel Data: Learning from ECLS-K Data
Abstract
Tianyang Zhang & Bryan Keller, Columbia University

Detecting Heterogeneous Treatment Effects in an Experimental Study of a Personalized Learning Algorithm
Abstract
Huan Kuang, Walter Leite, Zeyuan Jing & Corinne Huggins-Manley, University of Florida

A New Methodological Approach for Evaluating the Impact of Educational Intervention Implementation on Learning Outcomes
Abstract
Laura A Outhwaite, University College London, Anthea Gulliford & Nicola Pitchford, University of Nottingham

  

5H. Teachers' Expectations and Relationships with Students

March 13 - 8:00 AM - 9:30 AM
Studio F
Paper Session

Section: Social and Emotional Learning in Educational Settings & Education in Global Contexts

Chair: Thomas Kelley-Kemple, Harvard University

Mindsets: Students, Teachers and the Influence of Intelligence Theories on Educational Outcomes
Abstract
Tassia Cruz, Getulio Vargas Foundation, and Barbara Bruns, Center for Global Development

Teachers’ Fixed Mindsets Undermine the Effects of a Growth Mindset Intervention
Abstract
David S. Yeager, Jamie M. Carroll, Jenny Buontempo, Molly Kudym, Robert Crosnoe, Chandra Muller & Pratik Mhatre, University of Texas - Austin

The Impact of Teachers' Relational Skills on Students Performances: Evidence from a Large Scale RCT
Abstract
Gianluca Argentin, University of Milano - Bicocca, Giulia Assirelli, Independent Consultant, Tiziano Gerosa, University of Milano - Bicocca, and Matteo Moscatelli, Catholic University of Milan

 

Session 6 - 9:45 PM - 11:30 PM

6A. Unpacking the Micro-level Features of Quality in Early Childhood Education Programs

March 13 - 9:45 AM - 11:15 AM
Studio E
Symposium

Section: Early Childhood Education & Teachers and School Leaders

Organizer: Emily Hanno, Harvard University

Linking Micro-features of Quality to Children’s Academic, Social-emotional, and Executive Function Skills in a Statewide Population Study of Children’s Early Education
Abstract
Emily C. Hanno, Kathryn E. Gonzalez, Rosa Guzman Turco, Stephanie M. Jones & Nonie K. Lesaux, Harvard University

Individual Experiences in ECE Classrooms: Variation by Home Language
Abstract
Sherri Castle & Shinyoung Jeon, University of Oklahoma - Tulsa

Pre-Kindergarten Children Transitioning to Kindergarten: The Quality of their Classrooms in Pre-K and K
Abstract
Dale Farran, Vanderbilt University

Thresholds in Micro-features of Quality in Early Education and Care
Abstract
Kathryn E. Gonzalez, Emily C. Hanno, Rosa Guzman, Nonie K. Lesaux & Stephanie M. Jones, Harvard University

 Discussant: Stephanie M. Jones, Harvard University

 

6B. How Do Different Levels of a Federalist School System Affect Instructional Quality and Student Achievement?

March 13 - 9:45 AM - 11:15 AM
Salon 5
Symposium

Section: Organization of Schools and Systems & Teachers and School Leaders

Organizer: Beth Schueler, University of Virginia

Does the Common Core Have a Common Effect?: An Exploration of Effects on At-Risk Groups

Joshua Bleiberg, Vanderbilt University

Why Do School Districts Matter? An Interdisciplinary and Empirical Review

David Blazar, University of Maryland, and Beth Schueler, University of Virginia

What Teachers Want: School-Level Factors Predicting Teachers’ Decisions to Work in Turnaround Schools

Samantha Viano, George Mason University, Lam Pham, Vanderbilt University, Gary T. Henry, University of Delaware, Adam Kho, University of Southern California, and Ron Zimmer, University of Kentucky

 Discussant: Cara Jackson, Bellwether Education Partners

 

6C. Causal Mediation in Education Research: Opportunities, and Challenges, of Examining Intervention “Mechanisms”

March 13 - 9:45 AM - 11:15 AM
Studio D
Symposium

Section: Research Methods & Use of Research Evidence across Settings

Organizer: Elizabeth Stuart, Johns Hopkins University

Clarifying Causal Mediation Analysis for the Applied Researcher: Defining Effects Based on What We Want to Learn
Abstract
Trang Quynh Nguyen, Ian Schmid & Elizabeth A. Stuart, Johns Hopkins University

Simulation-Based Sensitivity Analysis for Causal Mediation Analysis
Abstract
Xu Qin, University of Pittsburgh, and Fan Yang, University of Colorado - Denver

Identifying Potential Mediating Variables Using Variable Importance Measures
Abstract
Brian G. Vegetabile, RAND, Donna L. Coffman, Temple University, and Daniel F. McCaffrey, Educational Testing Service

 Discussant: Guanglei Hong, University of Chicago

 

6D. From Baseline Equivalence to Interpretation of Effect Sizes: Analytic Issues to Consider across All Phases of a Study

March 13 - 9:45 AM - 11:15 AM
Studio F
Paper Session

Section: Research Methods

Chair: Julie Lorah, Indiana University

Baseline Equivalency Measures in High Dimensions
Abstract
Mark Fredrickson & Ben Hansen, University of Michigan

Effect Sizes for Quantifying Student and School Growth in Achievement: In Search of Practical Significance
Abstract
James Soland, University of Virginia, and Yeow Meng Thum, NWEA

False Discoveries and Erroneous Findings in Randomised Controlled Trials in Education
Abstract
Sam Sims & Jake Anders, University College London, Matthew Inglis, Loughborough University, and Hugues Lortie-Forgues, University of York

A New Micro Measure for Education Interventions: Learning-Adjusted Years of Schooling (LAYS)
Abstract
Noam Angrist, World Bank, David Evans, Center for Global Development, Deon Filmer, World Bank, Rachel Glennerster, UK Department for International Development, Halsey Rogers & Shwetlena Sabarwal, World Bank

 

6E. Researcher-Practitioner Partnerships in Higher Education: Perspectives of Practitioners and Funders

March 13 - 9:45 AM - 11:15 AM
Salon 6
Invited Panel

Description: This moderated panel discussion will reflect insights of practitioners and research funders on creating and sustaining effective researcher-practitioner partnerships (RPPs) that address higher education issues. The discussion will cover the following topics:

• How do the discussants define effective RPPs?
• What are the key ingredients of effective RPPs? What are challenges to initiate, maintain, and sustain such partnerships?
• Which higher education issues are more suitable for RPPs? What types of funding opportunities exist to support RPPs to tackle such issues?
• Which criteria do funders use when evaluating proposals submitted to build new RPPs or sustain existing ones?
• Do practitioners actively seek to form partnerships with researchers? If so, what strategies they use to initiate these?

The session will reserve ample time for questions from those in the audience.

Section: Postsecondary Education & Use of Research Evidence across Settings

Moderator: Fatih Unlu, RAND

Panelists

Adam Gamoran, William T. Grant Foundation

James Benson, Institute of Education Sciences

Matthew Halsapple, Spencer Foundation

Bryan Ryan, Wake Technical Community College

Shane Maloney, University of Wisconsin

6F. Afterschool Strategies to Strengthen the STEM Pipeline in Grades 4-12

March 13 - 9:45 AM - 11:15 AM
Studio C
Invited Symposium

Section: Organization of Schools and Systems

Organizer: Andrea Beesley, SRI International

Building Mathematical Identity After School: Results of a Cluster-Randomized Trial

Andrea D. Beesley, SRI International, and Michaela Gulemetova, IMPAQ International

Design 2 Learn

Cheri Fancsali, Research Alliance for New York City Schools, and Wendy Castillo, New York University

Long-term Impacts of After-School Robotics Programs: Five-Year Results from a Longitudinal Study

Alan Melchior, Cathy Burack, Matthew Hoover & Zora Haque, Brandeis University

Discussant: Gemma Lenowitz, Overdeck Foundation

 

6G. The Role of Learning Environments in Shaping Socio-emotional Factors

March 13 - 9:45 AM - 11:15 AM
Salon 7
Invited Symposium

Section: Social and Emotional Learning in Educational Settings

Organizer: Shanette Porter, Mindset Scholars Network

Assessing College Readiness in the Middle Grades: Comparing Administrative and Survey-based Measures of Non-cognitive Skills

Christopher Cleveland, Rebecca Ivester, Ethan Scherer & Martin R. West, Harvard University

Can High Schools Influence Socio-Emotional Skills, and Does it Matter in the Long Run?

Kirabo Jackson, Northwestern University, Shanette Porter, Mindset Scholars Network, John Q. Easton & Alyssa Blanchard, UChicago Consortium on School Research

School Effects on Bullying: A Value-added Approach

Sebastian Kiguel, Northwestern University

Placing Equity in Context: High School Mathematics Teachers’ Beliefs and Practices in Racialized Learning Environments

Yasmiyn Irizarry & Tia Madkins, University of Texas - Austin

Discussant: Constance Lindsay, University of North Carolina - Chapel Hill

 

Keynote - 11:30 PM - 1:00 PM

Practical Significance and Meaningful Effects: Interpreting Null Effects, Confidence Intervals, and Various Related Issues that Matter for Evaluation in Practice

March 13 - 11:30 AM - 1:00 PM
Salon 1-4
Keynote Address

Organizer and Moderator:  Laura Peck, Abt Associates

Speakers:

Steve Ziliak, Roosevelt University 
Deborah Mayo, Virginia Tech
Alex Resch, Mathematica
Carrie Conaway, Harvard University

 

Keynote Lunch

Sponsored by Abt Associates

March 13 - 1:00-1:45

 

Session 7: Afternoon Poster Session - 1:45 PM - 2:45 PM

7A. Academic Learning in Education Settings - Afternoon Poster Session

March 13 - 1:45 PM - 2:45 PM
Foyer Group A

Poster Session

1. Science Self-Concept and Self-Efficacy: Their Structure and Relation to 3rd Grade Academic Achievement
Abstract     Slides
Kristin Gagnier, Johns Hopkins University, Steven Holochwost, WolfBrown, Kelly Fisher, Johns Hopkins University, and Akilah Nelson, Prince Georges County Public Schools

2. Instructional Technology for Reading Remediation in Rural Settings: An Examination of Effectiveness and Efficiency
Abstract     Slides
Benjamin Solomon, SUNY Albany, Brit'ny Stein, Osage County Interlocal Cooperative, Chase Kitterman, Oklahoma State University, and Debbie Enos, Osage County Interlocal Cooperative

3. How Do Balance Scales Shape K-2 Students’ Understandings of Equations?
Abstract     Slides
Ana Stephens & Yewon Sung, University of Wisconsin - Madison, Susanne Strachota, Ohio University, Ranza Veltri Torres, University of Wisconsin - Madison, Karisma Morton, University of North Texas, Angela Murphy Gardiner & Maria Blanton, TERC

 

7B. Early Childhood Education - Afternoon Poster Session

March 13 - 1:45 PM - 2:45 PM
Foyer Group B

Poster Session

4. Examining Mediators of the Effect of a Child Care Intervention on Adult Outcomes
Abstract     Slides
Kylie Garber Bezdek, Tiffany Foster & Margaret Burchinal, University of North Carolina - Chapel Hill

5. Classroom Context Matters: Observing Dual Language Learners Self-Regulation Skills
Abstract     Slides
Elizabeth Frechette, University of Oklahoma, Brooke Rumper, Temple University, and Daryl Greenfield, University of Miami

6. The Acquisition of Academic and Executive Functioning Skills during Early Elementary School: Contrasting the Role of Constrained and Unconstrained Prekindergarten Skills
Abstract     Slides
Tiffany Foster & Kylie Garber Bezdek, University of North Carolina - Chapel Hill, and Margaret Burchinal, Frank Porter Graham Child Development Institute

  

7C. Organization of Schools and Systems - Afternoon Poster Session

March 13 - 1:45 PM - 2:45 PM
Foyer Group C

Poster Session

7. Social Ties as Mediators of Program Impacts in a Literacy Intervention
Abstract     Slides
Thomas Kelley-Kemple & James Kim, Harvard University

7E. Research Methods - Afternoon Poster Session

March 13 - 1:45 PM - 2:45 PM
Foyer Group E

Poster Session

9. Student Academic Motivation and Non-Cognitive Skills: Improving Comparability across Cultures and Gender with the Anchoring Vignettes Method
Abstract     Slides
Hanka Vonkova, Charles University, Gema Zamarro, University of Arkansas, Ondrej Papajoanu & Katerina Kralova, Charles University

10. Psychometric Properties of VESIP, a Social Information Processing Simulation Assessment for Children
Abstract     Slides
Nicole Russo-Ponsaran, Clark McKown & Ashley Karls, Rush University Medical Center, Everett Smith, University of Illinois - Chicago, and Jeremiah Folsom-Kovarik, Soar Technology

11. Interpretation and Effect Size Measures for Random Effects in Multilevel Survival Models
Abstract     Slides
Julie Lorah, Indiana University

12. Participant Sorting in Cluster Randomized Controlled Trials: Is It Happening and Why Does It Matter?
Abstract     Slides
Andrew P. Jaciw, Thanh Nguyen, Li Lin & Jenna Zacamy, Empirical Education

 

7F. Social and Emotional Learning in Education Settings - Afternoon Poster Session

March 13 - 1:45 PM - 2:45 PM
Foyer Group F

Poster Session

13. Implementation of Tools for Getting Along: Equipping Educators to Teach Students to Get Along
Abstract     Slides
Jennifer Nakamura, Elisa Garcia, Carl Sumi & Yunsoo Park, SRI International

14. Emotion Knowledge as a Mediator of School Readiness Outcomes
Abstract     Slides
Leslie Ho & Karen Bierman, Pennsylvania State University

15. The Influence of Friendship Quality and Perceived Emotional Risk of Participation on Behavioral Engagement versus Cognitive Engagement
Abstract     Slides
Arayana Harris, Hampton University, Krystal Thomas & Zewelanji Serpell, Virginia Commonwealth University, and Alicia Borre, Hampton University

16. MOOSES: A Framework for Categorizing SEL Measures
Abstract     Slides
Elizabeth Kim, Sooyeon Byun, Amanda Inns, Cynthia Lake & Robert Slavin, Johns Hopkins University

 

7G. Teachers and School Leaders - Afternoon Poster Session

March 13 - 1:45 PM - 2:45 PM
Foyer Group G

Poster Session 

17. The Impact of a Learning Centered Teacher Evaluation Approach on New Teacher Turnover in Wisconsin
Abstract     Slides
Curtis Jones, Elizabeth Cain & Leon Gilman, University of Wisconsin - Milwaukee, Steve Kimball, University of Wisconsin - Madison, and Katharine Rainey, Wisconsin Department of Public Instruction

18. A Brief Self-Compassion Training Boosts Motivational Beliefs and Growth Orientation Toward Teaching Six Months Later: A Longitudinal Field Experiment with First-Year Teachers
Abstract     Slides
Rebecca Baelen, University of Pennsylvania, Brian Galla, University of Pittsburgh, and Rebecca Maynard, University of Pennsylvania

19. Attrition of School Principals: A Survival Analysis Using Seven Years of Administrative Data from Pennsylvania
Abstract     Slides
Sangbaek Park, Claire Allen-Platt, Jimin Oh, Selene Sunmin Lee & Robert Boruch, University of Pennsylvania

20. Teacher Subject-Matter Knowledge and Years of Experience—Not Growth Mindset about Students—Predict Student Learning in Fractions
Abstract     Slides
Robert C. Schoen, Lanrong Li, Ahmet Guven & Xiaotong Yang, Florida State University

 

7H. Use of Research Evidence across Settings - Afternoon Poster Session

March 13 - 1:45 PM - 2:45 PM
Foyer Group H

Poster Session 

21. The Research-to-Policy Collaboration Model: Improving the Use of Research Evidence in Policy
Abstract     Slides
Lawrie Green, Taylor Scott & Max Crowley, Pennsylvania State University

22. Toward a Science of Failure Analysis: A Narrative Review
Abstract     Slides
Clara-Christina Gerstner, Claire Allen-Platt & Robert Boruch, University of Pennsylvania, and Allen Ruby, U.S. Department of Education 

23. How the Education Doctorate Teaches Leaders to Use Research Evidence
Abstract     Slides
William A. Firestone, Rutgers Graduate School of Education, Karen Seashore Louis, University of Minnesota, Andrew S. Leland, Southern Illinois University, and Jill Alexa Perry, University of Pittsburgh

24. Forming K-12 Peer School Groups for Benchmarking: A Dynamic Data Visualization Dashboard for Three Southeastern States
Abstract     Slides
Eric Grebing, University of North Carolina - Greensboro

 

 

Session 8 - 2:45 PM - 4:15 PM

8A. Building Causal Evidence for CTE

March 13 - 2:45 PM - 4:15 PM
Studio F
Symposium

Section: Organization of Schools and Systems & Academic Learning in Education Settings

 Organizer: Corinne Alfeld, Institute of Education Sciences

An Early Look at the Factors Driving Variation in CTE Program Impacts

James Kemple, New York University, Rebecca Unterman, MDRC, and Shaun Dougherty, Vanderbilt University

The P-TECH Model of Schools: High School Impacts from the NYC P-TECH Experience

Rachel Rosen, Crystal Byndloss & Leigh Parise, MDRC

The Effects of Career and Technical Education: Evidence from the Connecticut Technical High School System

Eric J. Brunner, University of Connecticut, Shaun Dougherty, Vanderbilt University, and Stephen Ross, University of Connecticut

Discussant: Julie Edmunds, University of North Carolina - Greensboro

 

8B. Social-emotional Learning Intervention with Children Exposed to Conflict and Violence: Impacts, Variations, and Perceptions

March 13 - 2:45 PM - 4:15 PM
Studio E
Symposium

Section: Education in Global Contexts & Social and Emotional Learning in Educational Settings

Organizer: Ha Yeon Kim, New York University

Comprehensive Social Emotional Learning Intervention with Syrian Refugee Children: Impact Variation by Pre- and Post-Migration Conflict Experiences
Abstract
Ha Yeon Kim, Lindsay Brown & Mayari Montes De Oca Salinas, New York University, Maria del Sol Prieto Bayona & Jeannie Annan, International Rescue Committee, and John Lawrence Aber, New York University

Community Violence as a Moderator of the Impact of a Social-emotional Learning Program in Brazilian Primary Schools
Abstract
Dana Charles McCoy & Emily C. Hanno, Harvard University, Vladimir Pinheiro Ponczek, Cristine Campos de Xavier Pinto, Gabriela Fonseca & Natália Zanetti Marchi, Getulio Vargas Foundation

Findings from an Arts-based Social-emotional Intervention for Young Children in Mexico City
Abstract
Lauren Pisani & Sara Hommel, Save the Children

Discussant: John Lawrence Aber, New York University

  

8C. Using Existing Data to Create New Diagnostic Measures for States and Districts

March 13 - 2:45 PM - 4:15 PM
Studio B
Symposium

Section: Use of Research Evidence across Settings & Organization of Schools and Systems

 Organizer: Brian Gill, Mathematica

Partnering to Conduct Research on Using Kindergarten Entry Assessments to Track City Progress in Promoting Reading Proficiency

Jessica Harding, Mariesa Herrman & Christine Ross, Mathematica, Elias Hanno, Burning Glass Technologies, Kristyn Stewart & Katie Mosher, School District of Philadelphia

Using Kindergarten Entry Assessment Data to Measure Student Learning Growth from Kindergarten through Grade 3

Lisa Dragoset, Dallas Dotter, Cassandra Baxter & Elias Walsh, Mathematica

Using Student-Level Social and Emotional Learning Survey Data to Develop a “Loved, Challenged, and Prepared” Measure

Tim Kautz & Kathleen Feeney, Mathematica

Discussant: Joy Lesnick, School District of Philadelphia

 

8D. The Medium-term Effects of Pre-K Programs

March 13 - 2:45 PM - 4:15 PM
Salon 5
Paper Session

Section: Early Childhood Education & Academic Learning in Education Settings

Chair: Sebastián Gallegos V., Inter-American Development Bank

Updates on the Effects of the Tennessee Prekindergarten Program on Children’s Achievement and Behavior through Sixth Grade
Abstract
Kelley Durkin, Mark Lipsey & Dale Farran, Vanderbilt University

Teachers, Schools, and Pre-K Effect Persistence: An Examination of the Sustaining Environment Hypothesis
Abstract
Francis Pearman, Stanford University, Matthew Springer, University of North Carolina, Mark Lipsey & Mark Lachowicz, Vanderbilt University, Walker Swain, University of Georgia, and Dale Farran, Vanderbilt University

Do Pre-K Quality Benchmarks Influence Children’s Third-Grade Academic Achievement?
Abstract
Zhiling Shea, University of California - Irvine

Examining the Denver Preschool Program Tuition Credit
Abstract
Vi-Nhuan Le, NORC, Diana Schaack, University of Colorado - Denver, Marina Mendoza, Denver Preschool Program, Stephanie Stout-Oswald, Denver Public Schools, and Kristie Kauerz, University of Colorado - Denver

  

8E. Postsecondary Education: Examination of Supply and Demand Factors

March 13 - 2:45 PM - 4:15 PM
Salon 7
Paper Session

Section: Postsecondary Education

Chair: Beth Gamse, Independent Consultant

A Better Path to Opportunity? The Value of Four-Year Public Colleges for Disadvantaged Students
Abstract
Whitney Kozakowski, Harvard University

Do Postsecondary Training Programs Respond to Changes in the Labor Market?
Abstract
Michel Grosz, Federal Trade Commission

Do Women Still Earn Less than Men after College Graduation: Evidence from the Baccalaureate and Beyond Longitudinal Study 1993 Cohort
Abstract
Mengyuan Liang, University of Chicago 

 

8F. Matching and Inferences in Multilevel Studies

March 13 - 2:45 PM - 4:15 PM
Salon 6
Paper Session

Section: Research Methods

Chair: Wendy Chan, University of Pennsylvania

The Performance of Balance Diagnostics for Propensity Score Matched Samples in Multilevel Settings
Abstract
Alyson Burnett, Mathematica, and Laura Stapleton, University of Maryland

Synthetic Control and Weighted Event Study Models with Staggered Adoption
Abstract
Eli Ben-Michael, Avi Feller & Jesse Rothstein, University of California - Berkeley

Estimation of Causal Moderated Treatment Effects Under the Potential Outcomes Framework: An Application of the Propensity Score
Abstract
Nianbo Dong, University of North Carolina - Chapel Hill, Ben Kelcey, University of Cincinnati, and Jessaca Spybrook, Western Michigan University

Covariate Selection and Impact Estimation for Clustered RCTs Using Lasso and Design-Based Methods
Abstract
Peter Schochet, Mathematica

 

8G. Developing Instructional Practice through Professional Development and Coaching

March 13 - 2:45 PM - 4:15 PM
Studio C
Paper Session

Section: Teachers and School Leaders & Education in Global Contexts

Chair: Dan Collier, W.E. Upjohn Institute for Employment Research

Intensive Professional Development at Scale: Measuring the Casual Effect of Massachusetts’ RETELL Initiative
Abstract
Jesse Bruhn, Brown University, Nathan Jones, Yasuko Kanno & Marcus Winters, Boston University

A Randomized Field Study of a Teacher Professional Development Program Using Mixed-Reality Simulation to Develop Instructional Practice
Abstract
Rachel Garrett, Toni Smith, Melinda Griffin & Melissa Yisak, American Institutes for Research

Contrasting Traditional, One-on-one Teacher Coaching Versus Coaching Teacher Pairs: An RCT Testing Impacts and Sustainability
Abstract     Slides
Elise Pas, Johns Hopkins University, Katrina Debnam, Chelsea Duran & Catherine Bradshaw, University of Virginia

Innovations in Early Mathematics Professional Development: Benefit to Teachers
Abstract
Erin Reid & Jennifer McCray, Erikson Institute, Erika Gaylor, SRI, International, Xime Dominguez, Digital Promise

 

8H. Using Data to Support Strong Teacher Pipelines: Evidence from Research Partnerships with States and Districts

March 13 - 2:45 PM - 4:15 PM
Salon 1-3
Invited Panel

Description: This panel will focus on a challenge facing many states and districts: how to staff all schools with a diverse group of highly-effective educators in all content areas. Districts across the country struggle to attract and retain teachers of color and teachers in certain certification areas: science, math, special education, and English learners. Each of the panelists is engaged in partnerships with local states or districts to provide actionable evidence to help them meet their specific needs in building a strong educator workforce. Panelists will discuss their use of data to diagnose pipeline challenges and provide evidence on teacher policies to support local decision-making and policy-setting.

Section: Teachers and School Leaders

Moderator: John Papay, Brown University

Panelists:

 

 

Session 9 - 4:45 PM - 6:15 PM

9A. Unpacking the Logic Model: A Discussion of Mediators and Antecedents of Educational Outcomes from the Investing in Innovation (i3) program

March 13 - 4:45 PM - 6:15 PM
Salon 7
Symposium

Section: Social and Emotional Learning in Educational Settings & Academic Learning in Education Settings

Organizer: Katie Lass, Policy & Research Group

Impact on Antecedents of Student Dropout in a Cross-Age Peer Mentoring Program

Katie Lass, Sarah Walsh & Eric Jenner, Policy & Research Group, and Sherry Barr, Center for Supportive Schools

Supporting content-area learning in Biology and U.S. History: A randomized control trial of Enhanced Units in California and Virginia

Hannah D'Apice, Adam Schellinger & Jenna Zacamy, Empirical Education, Xin Wei, SRI International, and Andrew P. Jaciw, Empirical Education

The role of socioemotional learning in teacher induction: A longitudinal study of the CREATE Teacher Residency Program

Audra Wingard, Andrew P. Jaciw & Jenna Zacamy, Empirical Education

Uncovering the Black Box: Exploratory Mediation Analysis for a Science Teacher Professional Development Program

Thanh Nguyen, Andrew P. Jaciw & Jenna Zacamy, Empirical Education

 

 Discussant: Anne Wolf, Abt Associates

 

9B. Research, Relationships, and Reflection: How Three Research-Practice Partnerships Support Practitioners’ Use of Research Evidence

March 13 - 4:45 PM - 6:15 PM
Studio D
Panel

Section: Use of Research Evidence across Settings & Teachers and School Leaders

Moderator: Paula Arce-Trigatti, National Network of Education Research-Practice Partnerships / Rice University

Panelists

Cheri Fancsali, Research Alliance for New York City Schools

Steven McGee, The Learning Partnership / Chicago Alliance for Equity in Computer Science (CAFÉCS)

Erin Henrick, Partner to Improve / Chicago Alliance for Equity in Computer Science (CAFÉCS)

Carrie Miller, UCLA / Los Angeles Education Research Institute (LAERI)

 

9C. New Insights into Educational Opportunity in U.S. Schools

March 13 - 4:45 PM - 6:15 PM
Studio C
Symposium

Section: Organization of Schools and Systems & Use of Research Evidence across Settings

Organizer: Erin Fahle, St. John's University

Educational Opportunity in U.S. Schools: Using Population Data to Describe Learning across Space and Time
Abstract
Sean Reardon, Stanford University, Erin Fahle, St. John's University, Benjamin Shear, University of Colorado - Boulder, and Andrew Ho, Harvard University

State Contexts in the Associations between Family Poverty, School Poverty, and Academic Achievement
Abstract
Heewon Jang & Sean F. Reardon, Stanford University

Comparing Test Score Growth Measures Constructed from Aggregate and Individual Data
Abstract
Sean Reardon, Stanford University, John Papay, Brown University, Katharine Strunk, Joshua Cowen & Tara Kilbride, Michigan State University, Lily An & Kate Donohue, Brown University

Improving the Precision and Interpretation of Aggregate School Growth Metrics
Abstract
Benjamin Shear, University of Colorado - Boulder, Andrew Ho, Harvard University, Sean Reardon, Stanford University, and Erin Fahle, St. John's University

Discussant: Andrew Ho, Harvard University

  

9D. Heterogeneity in Math Instruction across Ethnicity, Socioeconomic Status, Language, and Gender

March 13 - 4:45 PM - 6:15 PM
Salon 5
Paper Session

Section: Academic Learning in Education Settings

Chair: Christina Chhin, U.S. Department of Education

Tackling the Gender Gap in Mathematics with Innovative Teaching Methods
Abstract
Maria Laura Di Tommaso & Dalit Contini, University of Torino, Martino Bernardi, Giovanni Agnelli Foundation, Dalila De Rosa & Francesca Ferrara, University of Torino, Daniela Piazzalunga, Institute for Evaluation Research on Public Policies, and Ornella Robutti, University of Torino

Heterogeneity in Mathematics Intervention Effects: Evidence from A Meta-Analysis of 191 Randomized Experiments
Abstract
Martyna Citkowicz, Jim Lindsay, David Miller & Ryan Williams, American Institutes for Research

Understanding the Practical Significance of Explicit Mathematics Instruction for At-Risk English Learners
Abstract
Christian Doabler, Meadows Center for Preventing Educational Risk, and Ben Clarke, University of Oregon

Adapting Ed Tech Usage Recommendations to Enhance Academic Outcomes of Disadvantaged Students
Abstract
Andrew Berrett, Assunta Hardy & Joyce Zhang, Imagine Learning

 

9E. Accessing and Paying for Higher Education

March 13 - 4:45 PM - 6:15 PM
Studio E
Paper Session

Section: Postsecondary Education & Social and Emotional Learning in Educational Settings

Chair: Kaleen Healey, Mindset Scholars Network

Connecting Students with Financial Aid: Evidence from a Field Experiment
Abstract
Eric Bettinger & Monica Lee, Stanford University, and Bridget Terry Long, Harvard University

Experimental Evidence that Wide-Brush Nudging Does Not Help At-Risk First-Year College Students’ Academic Outcomes
Abstract
Dan Fitzpatrick & Daniel Collier, Western Michigan University, and Austin Nichols, Abt Associates

The Socioemotional and Academic Impact of College Campus Visits: A Randomized Experiment
Abstract
Elise Swanson, University of Southern California, Katherine Kopotic, Gema Zamarro, Jonathan Mills & Jay Greene, University of Arkansas, and Gary Ritter, Saint Louis University

Year 1 Impacts of the Pennsylvania College Savings Account Pilot, Keystone Scholars
Abstract
Robert Nathenson, American Institutes for Research, Amanda Jones-Layman, University of Pennsylvania, and Philip Sirinides, Consortium for Policy Research in Education

 

9F. Considerations and Choices in Modeling Complex Data

March 13 - 4:45 PM - 6:15 PM
Studio B
Paper Session

Section: Research Methods

Chair: Nianbo Dong, University of North Carolina - Chapel Hill

Examining the Causal Direction of Synchronous Effects in Panel Models: Using Residual-predictor Independence Tests to Identify Model Misspecifications
Abstract     Slides
Xintong Li, University of Missouri

Longitudinal Application of the Two Method Planned Missing Design
Abstract
Jessica Logan & Menglin Xu, Ohio State University

On the Robustness of Doubly Robust Estimators in Causal Inference
Abstract
Weicong Lyu, University of Wisconsin - Madison, and Peter Steiner, University of Maryland

 

9G. Understanding Teacher Observation and Evaluation

March 13 - 4:45 PM - 6:15 PM
Studio F
Paper Session

Section: Teachers and School Leaders & Education in Global Contexts

Chair: Seth Hunter, George Mason University

In Search of High-Quality Evaluation Feedback: An Administrator Training Field Experiment
Abstract
Matthew A. Kraft & Alvin Christian, Brown University

The Effects of High-Stakes Teacher Evaluation on Office Disciplinary Referrals
Abstract
David D. Liebowitz, Lorna Porter & Dylan Bragg, University of Oregon

An Observer Like Me: The Effect of Demographic Congruence between Teachers and Raters on Classroom Observation Scores
Abstract
Olivia Chi, Harvard University

Professionally Isolated Teachers in Tennessee’s Rural Schools: Professional Learning Experiences, Improvement Trajectories, and Labor Market Decisions
Abstract
Susan Kemper Patrick & J. Edward Guthrie, Vanderbilt University

 

9H. Lottery-based Evaluations of Early Education Programs: Opportunities and Challenges

March 13 - 4:45 PM - 6:15 PM
Salon 1-3
Invited Symposium

Section: Early Childhood Education

Organizer: Christina Weiland, University of Michigan

Challenges and Opportunities of Using Lotteries for Oversubscribed Boston Prekindergarten Programs to Estimate Causal Impacts

Christina Weiland, University of Michigan, Rebecca Unterman, Meghan McCormick & JoAnn Hsueh, MDRC, Anna Shapiro, University of Michigan, Catherine Snow, Harvard University, and Jason Sachs, Boston Public Schools

Using the New Orleans Early Childhood Education Lottery to Design Causal Impact Studies

Lindsay Weixler, Tulane University, Jane Lincove, University of Maryland - Baltimore County, and Jon Valant, Brookings Institution

Lottery Structures for Admission to Public Montessori Preschool Programs: Promises and Challenges for Research

Karen Manship, Ann-Marie Faria & Juliette Berg, American Institutes for Research

Leveraging Pre-K Application Lotteries to Evaluate Teacher Professional Development: Weighing the Advantages and Disadvantages

Rachel Abenavoli & Pamela Morris, New York University, Rebecca Unterman, MDRC, and Elise Cappella, New York University

 

Session 10: Evening Poster Session - 6:15 PM - 7:15 PM

Poster Session and Hors d'oeuvres Reception

March 13 - 6:15 - 7:15 PM
Foyer

 

10A. Academic Learning in Education Settings - Evening Poster Session

March 13 - 6:15 PM - 7:15 PM
Foyer Group A

Poster Session

1. Advantages and Drawbacks of Grade Band Assignment: Early Observations from a Work in Progress RCT Testing the Impact of Teacher PD
Abstract     Slides
John H. Hitchcock, Abt Associates, Teresa Duncan, Deacon Hill Research Associates, Babette Moeller, Education Development Center, and Jason Schoeneberger, ICF International

2. A Quasi-Experimental Study of NGSS Curriculum and PD on Three-Dimensional Learning Outcomes
Abstract     Slides
Susan M. Kowalski, Jeffrey Snowden, Lisa Carey, Betty Stennett, Lindsey Mohan & Mark Bloom, BSCS Science Learning, and Heather Young, Oregon Public Broadcasting

3. Exploring the Aptitude-by-Treatment Interaction for Latent Subgroups
Abstract     Slides
Wooliya Kim & Douglas Fuchs, Vanderbilt University, Annie Penell, Washington Office of Superintendent of Public Education, Sam Patton, Vanderbilt University, Emma Hendricks, Martinez Unified School District, Meagan Walsh, Vanderbilt University, and Wen Zhang Tracy, Foundations Early Intervention Services

 

10B. Early Childhood Education - Evening Poster Session

March 13 - 6:15 PM - 7:15 PM
Foyer Group B

Poster Session

4. Examining the Impacts of Two-Generation Early Intervention Program Services on Parents’ Human Capital and Self-Sufficiency Outcomes
Abstract     Slides
Owen Schochet, Georgetown University

5. Impact of the Introduction of State Pre-K Programs on Head Start Enrollment of Children with Disabilities
Abstract     Slides
Qing Zhang & Jade Jenkins, University of California - Irvine

6. Partnering to Support Parents Through the Early Childhood Application Process: Evidence of Success in Research-Practice Partnership Work
Abstract     Slides
Alica Gerry & Lindsay Weixler, Tulane University, Daphna Bassok, University of Virginia, Jon Valant, Brookings Institution, and Justin Doromal, University of Virginia

7. Examining Early Learning Profiles at Pre-K Entry
Abstract     Slides
Jill Pentimonti, Virginia Buysse & Aleksandra Holod, American Institutes for Research

 

 

10D. Postsecondary Education - Evening Poster Session

March 13 - 6:15 PM - 7:15 PM
Foyer Group D

Poster Session

10. Postsecondary Readiness among English Learner Students in a Large Urban School District
Abstract     Slides
Ryan Eisner, American Institutes for Research, and Jose Gonzalez, Cleveland Metropolitan School District

 

10E. Research Methods - Evening Poster Session

March 13 - 6:15 PM - 7:15 PM
Foyer Group E

Poster Session

11. Structural Model Fit and Construct Reliability: A Monte Carlo Examination of Available Methods
Abstract     Slides
Graham G. Rifenbark, University of Kansas, D. Betsy McCoach & H. Jane Rogers, University of Connecticut

12. Using Multisite Instrumental Variables to Estimate Treatment Effects and Treatment Effect Heterogeneity
Abstract     Slides
Christopher Runyon, National Board of Medical Examiners

13. Pooling Standardized Test Scores Across States: Using NAEP to Standardize and Rescale
Abstract     Slides
Ying Liu, Janet Li, Anna Saavedra & and Shira Korn, University of Southern California

14. Everything in Moderation: Using Proximal and Distal Measures to Forecast the Long-Term Impacts of Math Interventions
Abstract     Slides
Daniela Alvarez-Vargas, Sirui Wan & Drew Bailey, University of California - Irvine

15. Estimating Statistical Power When Making Adjustments for Multiple Tests - Design and Software Extensions
Abstract     Slides
Kristin Porter, Deni Chen & Zarni Htet, MDRC

16. READS for Summer Learning: A Case Study on Systematic Replication
Abstract     Slides
Sarah Peko-Spicer, Northwestern University

 

 

10F. Social and Emotional Learning in Education Settings - Evening Poster Session

March 13 - 6:15 PM - 7:15 PM
Foyer Group F

Poster Session

17. Structural Limitations and Functional Alternatives Reducing Suspensions and Preserving Racial Suspension Gaps
Abstract     Slides
Jose Eos Trinidad, University of Chicago

18. Promoting Resilience: A Preschool Intervention Enhances the Adolescent Adjustment of Children Exposed to Early Adversity
Abstract     Slides
Michael Sanders, Janet Welsh, Karen Bierman & Brenda Heinrichs, Pennsylvania State University

19. Moderators of School Intervention Efficacy for Higher-Functioning Children with ASD
Abstract     Slides
Christopher Lopata, James P. Donnelly, Marcus L. Thomeer, Jonathan D. Rodgers, Canisius College, Adam J. Booth & Jennifer Lodi-Smith, Canisius College

 

 

10G. Teachers and School Leaders - Evening Poster Session

March 13 - 6:15 PM - 7:15 PM
Foyer Group G

Poster Session 

20. School Safety and Teacher Turnover in NYC: A Case of Causal Heterogeneity
Abstract     Slides
Ashley Grant, Johns Hopkins University

21. Emerging Leaders Program: Impacts on Students, Teachers, and Leaders in Three Sites
Abstract     Slides
Nicole Arshan, Katrina Laguarda, Jared Boyce, Andrea Beesley, Rebecca Goetz, Xin Wei & Elise Levin-Guracar, SRI International

10H. Use of Research Evidence across Settings - Evening Poster Session

March 13 - 6:15 PM - 7:15 PM
Foyer Group H

Poster Session

23. Individual and School-Level Capacity to Critically Evaluate Research: A Multilevel Organizational Analysis
Abstract     Slides
Henry May, Elizabeth Farley-Ripple, Horatio Blackman, Rui Wang, Kati Tilley & Samantha Shewchuk, University of Delaware

24. LEA Use of Evidence in Budget Decisions
Abstract     Slides
Fiona Hollands, Columbia University, Bo Yan & Stephen Leach, Jefferson County Public Schools, Robert Shand, American University, Dena Dossett, Jefferson County Public Schools, Yixin Wang & Laura Head, Columbia University

25. Testing TIPS with a New Population
Abstract     Slides
Natalie Lacireno-Paquet, Raifu Durodoye, Jr. & Karen Melchior, WestEd, and Herbert Turner, III, Analytica 

 

 

SATURDAY, MARCH 14

Meet the Funders Breakfast: Perspectives from Foundations

March 14 - 8:00 AM - 9:00 AM
Studio F

Moderator:  Bethany Miller, Kresge Foundation

Panelists

Jon Baron, Arnold Ventures

Rebecca Villarreal, Ascendium

Elliot Weinbaum, William Penn Foundation

Join program officers from several foundations for breakfast to hear about their current interest and opportunities in education research, evaluation, and implementation, as well as tips on how to work with this sector and prepare a successful application.

11A. Understanding the Social-emotional Learning Needs of English Learners: Implications and Measurement Challenges

March 14 - 9:00 AM - 10:30 AM
Studio E
Symposium

Section: Social and Emotional Learning in Educational Settings & Use of Research Evidence across Settings

Organizer: James Soland, University of Virginia

Differences in Students’ Social-emotional Learning Outcomes by English Language Learner Reclassification Status

Monica Lee, Stanford University, and James Soland, University of Virginia

Does Self-efficacy Mediate the Relationship between English Learner Status and Academic Growth?

James Soland, University of Virginia

Teaching to Support Students with Diverse Academic Needs: Implications for the Social-emotional Needs of English Learners

David Blazar & Casey Archer, University of Maryland - College Park

Measuring Social-emotional Learning Outcomes When Teachers and Parents Disagree about Students: Implications for Measurement and Long-Term Outcomes

Megan Kuhfeld, NWEA, and James Soland, University of Virginia

Discussant: Laura Hamilton, RAND

  

11B. Making Sense of Developmental Education Reform: What Does the Evidence Tell Us, and What Does it Mean for Practice?

March 14 - 9:00 AM - 10:30 AM
Studio D
Panel

Section: Postsecondary Education & Use of Research Evidence across Settings

Moderator: Thomas Brock, Community College Research Center

Panelists

Nikki Edgecombe, Community College Research Center

Katie Hern, California Acceleration Project

Alex Mayer, MDRC

Donna Linderman, City University of New York

Sharon Morrissey, Virginia Community College System

 

11C. Towards Broadening Our Understanding of Education “Research” and Its “Use”: How Three Collaborations Between Research and Practice Support Evidence-Informed Policy

March 14 - 9:00 AM - 10:30 AM
Salon 6
Panel

Section: Use of Research Evidence across Settings & Organization of Schools and Systems

Moderator: Joy Lesnick, School District of Philadelphia

Panelists

Kristen Davidson, University of Colorado - Boulder

Clare Irwin, Education Development Center 

Yinmei Wan, American Institutes for Research

Kelli Cassaday, Michigan Department of Education

 

11D. Using Pilot Studies to Increase the Rigor of Randomized Control Studies: Lessons from the Syrian Refugee Response

March 14 - 9:00 AM - 10:30 AM
Salon 5
Panel

Section: Education in Global Contexts & Research Methods

Moderator: Kate Schwartz, New York University

Panelists

Andres Molano, University of the Andes

Kate Schwartz, New York University

Anaga Ramachandran, New York University

 

11E. Statistical Power in Multilevel Studies

March 14 - 9:00 AM - 10:30 AM
Studio B
Paper Session

Section: Research Methods

Chair: Kyle Cox, University of North Carolina - Charlotte

Power Analysis for Moderator Effects in Longitudinal Cluster Experimental Designs
Abstract
Wei Li, University of Alabama, and Spyros Konstantopoulos, Michigan State University

Power and Coverage of Partially Nested Randomized Trials
Abstract
Ariel M. Aloe, Zhijiang ‘Van’ Liu & Hyeri Hong, University of Iowa

Experimental Power for Three-Level School-Randomized Studies Probing Mediation
Abstract
Kyle Cox, University of North Carolina - Charlotte, Ben Kelcey, Yanli Xie & Fangxing Bai, University of Cincinnati

 

11F. Teacher Policy in Global Contexts

March 14 - 9:00 AM - 10:30 AM
Salon 7
Paper Session

Section: Teachers and School Leaders & Education in Global Contexts

Chair: Mary Kay Dugan, American Institutes for Research

What Causes Teacher Training Programs in Early Education to Work? Evidence from Ghana
Abstract
Syeda Farwa Fatima & Sharon Wolf, University of Pennsylvania

Learning by Doing: Experimental Evidence on a Teacher Residency Program in India
Abstract
Alejandro Ganimian, New York University, Isaac Mbiti, University of Virginia, and Abhilash Mishra, Science for All

Can Service Teaching Affect One’s Career Trajectory? Evidence from Teach for India
Abstract
Katharine C. Conn, Columbia University, Virginia S. Lovison, Harvard University, and Cecilia H. Mo, University of California - Berkeley

Learning by Doing? Experimental Evidence on Activity-based Instruction in India
Abstract
Andreas de Barros, Harvard University, Johanna Fajardo-Gonzalez, Inter-American Development Bank, Paul Glewwe & Ashwini Sankar, University of Minnesota

12A. Results from the IES Goal 3 Efficacy Evaluation of Zoology One, an Integrated Literacy and Science Curriculum for Kindergarten

March 14 - 10:45 AM - 12:15 PM
Salon 5
Symposium

Section: Early Childhood Education & Academic Learning in Education Settings

Organizer: Abigail Gray, School District of Philadelphia

Results from the Zoology One Multi-Site Randomized Experiment
Abstract
Philip Sirinides, University of Pennsylvania, and Abigail Gray, School District of Philadelphia

The Implementation of Zoology One in the Efficacy Evaluation
Abstract
Ryan Fink & Katarina Suwak, University of Pennsylvania, and Abigail Gray, School District of Philadelphia

Estimating the Cost-Effectiveness of a Comprehensive Kindergarten Literacy and Science Curriculum that Strengthens Reading at Home
Abstract
A. Brooks Bowden & Rebecca Davis, University of Pennsylvania

What Happens after the Efficacy Trial Ends? Sustainment of Intervention Use
Abstract
Gwendolyn Lawson, Children's Hospital of Philadelphia, Ryan Fink & Maurice Spillane, University of Pennsylvania, and Abigail Gray, School District of Philadelphia

Discussant: Tonya Wolford, School District of Philadelphia

 

12B. RPPs at Scale? Lessons Learned from Ten Years of Regional Educational Laboratory (REL) Research Partnerships

March 14 - 10:45 AM - 12:15 PM
Salon 7
Panel

Section: Use of Research Evidence across Settings & Academic Learning in Education Settings

Moderator: Christopher Mazzeo, Education Northwest

Panelists

Christopher Mazzeo, Education Northwest

Fiona Helsel, REL Northwest

Julie Riordan, REL Northeast and Islands

Julie Kochanek, REL Midwest

Barbara Foorman, REL Southeast

 

12C. Moving from What Works to What Replicates: Promoting the Systematic Replication of Results

March 14 - 10:45 AM - 12:15 PM
Studio B
Symposium

Section: Research Methods & Use of Research Evidence across Settings

Organizer: Vivian Wong, University of Virginia

Practical Challenges in Replicating Research Findings

Peter Steiner, University of Maryland, and Vivian Wong, University of Virginia

Using Natural Language Processing Methods to Assess Replication Success

Kylie Anglin & Vivian Wong, University of Virginia

Crowdsourcing Replication Studies in Special Education

Bryan Cook, William Therrien & Vivian Wong, University of Virginia

Using Multiple Research Designs to Conduct Systematic Replication of Results: An Example from Teacher Education

Anandita Krishnamachari, Kylie Anglin & Vivian Wong, University of Virginia

Discussant: Elizabeth Tipton, Northwestern University

 

12D. Challenges with Assessment Precision and Implementation Fidelity in Response to Intervention Frameworks

March 14 - 10:45 AM - 12:15 PM
Studio F
Paper Session

Section: Academic Learning in Education Settings & Education in Global Contexts

Chair: Emily Doolittle, U.S. Department of Education

The Impact of a Multifaceted Education Program on Early Grade Literacy and Math Outcomes in Zambia: Evidence from a Mixed-Methods Cluster-Randomized Controlled Trial
Abstract
Thomas de Hoop, Hannah Ring, Garima Siwach & Paula Dias, American Institutes for Research, Gelson Tembo, Palm Associates, Victoria Rothbard & Anaïs Toungui, American Institutes for Research

Is “Response/No Response” Too Simple a Notion for RTI Frameworks? Exploring Multiple Response Types with Latent Profile Analysis
Abstract     Slides
Peng Peng, University of Texas - Austin, Douglas Fuchs & Lynn S. Fuchs, Vanderbilt University, and Eunsoo Cho, Michigan State University

Teacher Implementation Fidelity and Student Learning Outcomes
Abstract
Cheryl Varghese, Children's Learning Institute, Mary Bratsch-Hines & Lynne Vernon-Feagans, Frank Porter Graham Child Development Institute

Over Diagnosed or Over-looked? The Effect of Age at Time of School Entry on Students Receiving Special Education Services
Abstract
Anna Shapiro, University of Michigan

 

12E. Affirmative Action, Gender Peer Effects, and Measuring College Going Culture

March 14 - 10:45 AM - 12:15 PM
Studio D
Paper Session

Section: Postsecondary Education

Chair: Dan Fitzpatrick, University of Michigan

Gender Peer Effects in Post-Secondary Vocational Education
Abstract
Fernanda Ramirez-Espinoza, Harvard University

Assessing College-going Culture: Development of Diagnostic Rubric
Abstract
Eric Bettinger & Anthony Antonio, Stanford University, Jesse Foster, Evaluation and Assessment Solutions for Education, and Erin Grogan, College Advising Corps

Affirmative Action and Social Integration in College
Abstract
Saurabh Khanna & Prashant Loyalka, Stanford University

 

12F. Analyzing Complex Data Structures

March 14 - 10:45 AM - 12:15 PM
Salon 6
Paper Session

Section: Research Methods

Chair: Wei Li, University of Alabama

Weighting in Multilevel Models
Abstract
Bing Tong & Kimberly S. Kelly, Michigan State University

A Case Weighting Scheme for Primary Outcome Analysis
Abstract
Tim Lycurgus & Ben Hansen, University of Michigan

Toward a Causally Informative Fit Index of Longitudinal Models: A Within-Study Design Approach
Abstract
Sirui Wan, Daniela Alvarez-Vargas & Drew Bailey, University of California - Irvine 

Evaluating the Performance of Croon’s Method of Moments Corrected Maximum Likelihood Estimator with Cluster-randomized Studies Probing Mediation
Abstract
Kyle Cox, University of North Carolina - Charlotte, and Ben Kelcey, University of Cincinnati

 

12G. Facilitating Communication with Families to Improve Student Outcomes

March 14 - 10:45 AM - 12:15 PM
Studio E
Paper Session

Section: Teachers and School Leaders

Chair: Joy Lesnick, School District of Philadelphia

A Factorial Design to Understand Varying Effects of Parental Text Messaging Interventions
Abstract
Catherine Armstrong Asher, Ethan Scherer & James S. Kim, Harvard University 

Can Technology Transform Teacher-Parent Communication? Evidence from a Randomized Field Trial
Abstract
Matthew Kraft & Alexander Bolves, Brown University 

Reducing Absenteeism in Preschool by Informing Parents about School Activities: Experimental Evidence from Rio de Janeiro
Abstract
Gregory Elacqua, Emma Ingrid Naslund-Hadley & Luana Marotta, Inter-American Development Bank

 

March 14 - 10:45 AM - 12:15 PM
Location: Studio A
Workshop

Presenters
Mikia Manley, Mathematica
Erin Dillon, Mathematica
Tosin Shenbanjo, Mathematica