MEMORANDUM June 14, 2018 TO: Board Members FROM: Grenita Lathan, Ph.D. Interim Superintendent of Schools SUBJECT: ACHIEVE 180 PROGRAM EVALUATION, PART A, 2017–2018 CONTACT: Carla Stevens, 713-556-6700 Attached is a copy of the Achieve 180 Program Evaluation, Part A: Implementation and Preliminary Findings, 2017–2018. This report provides highlights of the comprehensive action plan designed to increase student achievement at the 27 campuses that received the Texas Education Agency campus accountability of “Improvement Required” in 2016–2017 and at the 18 campuses that had received the “Improvement Required” rating in 2015–2016, but had met the state standard in 2016–2017. Program administrators identified six “pillars” of best practice to provide focus for the massive implementation effort, as described in this initial program report. Key implementation efforts included: • Through Pillar I Leadership Excellence, leaders at the 44 actively participating Achieve 180 Program campuses were provided a multitude of professional development options and campus-specific supports, including the services of essential staff members such as a nurse, counselor, and librarian, and targeted assistance funds. • Pillar II, Teacher Excellence, supports included the addition of dedicated associate (substitute) teachers to mitigate the impact of teacher absences, and extensive Teacher Development Specialist support to provide readily available campus-specific professional development and individualized coaching to teachers. • Pillar III, Instructional Excellence, focused on providing students with multiple options for accelerated learning to support them in demonstrating the outcomes expected of an HISD Global Graduate. Efforts in this pillar included regular required monitoring of students’ changing literacy and numeracy skills, professional development for teachers to support their use of programs such as Literacy by 3, Literacy in the Middle, and Literacy Empowered, and options for online instruction adapted to individual competency levels. • Pillar IV, School Design, supported an environment and culture of high functioning and achievement on each campus, and included such provisions as equipping students with courses, materials and technology to support their striving to prepare for college and career readiness. • Pillar V, Social and Emotional Learning Support, was designed to remove non-academic barriers to students’ high achievement, and included behavioral, physical, and mental health resources, such as Wraparound Service Resource specialists and Student Assistance events and supports designed to strategically enhance student success. • Pillar VI, Family and Community Empowerment, f ocused on increasing parent advocacy by creating family-friendly learning environments in schools, such as by supporting awards for schools that engaged in specified family -friendly activities and by organizing feeder pattern events to educate parents about public education options available within their local neighborhoods. Detailed descriptions of these efforts, and more, are included in the pages of the report, along with preliminary findings, which will be presented in more detail in Part B of the first-year report. In this program, Houston Independent School District has marshaled its considerable resources , including those from school communities, to focus on its most underserved and under-achieving schools while maintaining full programs for each campus that was not a part of the Achieve 180 Program. The evaluation of the Achieve 180 Program, planned for three years, is designed to identify the most effective interventions to meet the diverse needs of each campus included in the program. In the process, staff members associated with each service to the schools have engaged in maximizing their effectiveness through focusing on issues at the campus and at the individual student and leader levels, through ana lysis of national research and local data, and through immersion in the schools themselves. The Achieve 180 Program has the potential to awaken a seemingly dormant sense of hope in underserved and underperforming campuses in the district, an awakening tha t is expected to permeate the entire district , and the communities within which it is embedded , with a sense of pride in achievement. Should you have any further questions, please contact Carla Stevens in Research and Accountability at 713 -556-6700. GL Attachment cc: Superintendent’s Direct Reports Area Superintendents School Support Officers Achieve 180 Program Leaders H o u s t o n I n d e p e n d e n t S c h o o l D i s t r i c t RESEARCH Educational Program Report achieve 180 Program Evaluation, Part A: Implementation and Preliminary Findings 2017-2018 2018 Board of Education Rhonda Skillern-Jones President Jolanda Jones First Vice President Anne Sung Second Vice President Sergio Lira Secretary Holly Maria Flynn Vilaseca Assistant Secretary Wanda Adams Diana Dávila Susan Deigaard Elizabeth Santos Grenita Lathan, Ph.D. Interim Superintendent of Schools Carla Stevens Assistant Superintendent Department of Research and Accountability Ngozi J. Kamau, Ph.D. Research Specialist Lissa Heckelman, Ph.D. Research Manager Houston Independent School District Hattie Mae White Educational Support Center 4400 West 18th StreetHouston, Texas 77092-8501 www.HoustonISD.org It is the policy of the Houston Independent School District not to discriminate on the basis of age, color, handicap or disability, ancestry, national origin, marital status, race, religion, sex, veteran status, political affi liation, sexual orientation, gender identity and/or gender expression in its educational or employment programs and activities. 2017−2018 Achieve 180 Program Evaluation, Part A Table of Contents Executive Summary Page Program Description ........................................................................................................................... 4 Highlights ............................................................................................................................................ 5 Recommendations .............................................................................................................................. 10 Introduction Program Context................................................................................................................................. 11 Program Description ........................................................................................................................... 11 Program Theory of Action ................................................................................................................... 12 Program Governance ........................................................................................................................ 12 Program Funding ............................................................................................................................... 12 Supporting Research .......................................................................................................................... 12 Purpose of the Evaluation Report....................................................................................................... 13 Conceptual Model for Program Evaluation ......................................................................................... 14 Methods................................................................................................................................................ 15, 81 Results Achieve 180 Program Alignment with District Goals ......................................................................... 15 Achieve 180 Program Schools ........................................................................................................... 16 Enrollment and Characteristics of Students Achieve 180 Program and non-Achieve 180 Program Students ................................................. 17 Achieve 180 Program Students by Achieve 180 Program Treatment Group .............................. 18 Achieve 180 Program Implementation by Pillar of School Improvement Pillar I – Leadership Excellence Essential staffing (nurse, librarian, and counselor) and principal staffing Nurses ............................................................................................................................. 20 Librarian Staffing ............................................................................................................ 21 Principal Staffing ............................................................................................................ 22 Principal, Counselor, Librarian, and Nurse Staffing (Overview) ..................................... 22 Principal Experience ...................................................................................................... 23 Collaborative Support for Leadership Effectiveness ............................................................. 24 Principal Effectiveness (Participation in Professional Development) .................................... 29 Pillar II – Teacher Excellence Teacher Staffing ................................................................................................................... 32 New Teacher Coaches ......................................................................................................... 34 Dedicated Associate Teachers (DAT) .................................................................................. 35 Dedicated Associate Teachers Fill Rates .............................................................................. 36 HISD Research and Accountability 1 2017−2018 Achieve 180 Program Evaluation, Part A Pillar III – Instructional Excellence Intervention Assistance Teams ............................................................................................ 39 Universal Screener Participation Rates ................................................................................ 39 Universal Screener Student Performance ............................................................................. 41 Renaissance 360 Early Literacy ............................................................................................ 41 Renaissance 360 Reading .................................................................................................... 43 Renaissance 360 Mathematics ............................................................................................. 44 Multilingual and ELL Instructional Supports .......................................................................... 46 Teacher Development Specialists ........................................................................................ 46 Curriculum Implementation, Instructional Delivery, and Job-Embedded Professional Development ................................................................. 47 Formative Assessment and Data Protocols ......................................................................... 49 Pre-AP, AP, and Dual Credit Course Enrollments ................................................................ 51 Pillar IV – School Design Wednesday Extended-Day Professional Development for Teachers ................................... 56 Intervention Assistance Teams (IAT) .................................................................................... 57 Blended Learning: Achieve 3000 ................................................................................................................. 58 AP Insight ........................................................................................................................ 61 Powerup laptop distribution ............................................................................................. 61 Percent Enrolled in CTE Pathway Courses ........................................................................... 62 Pillar V – Social and Emotional Learning Support Student Participation in Support Services including Health/Medical, Counseling, and Library ........................................................................... 63 Wraparound Services ........................................................................................................... 64 Student Assistance ................................................................................................................ 68 Office of Student Support, Social Emotional Learning (SEL) Department ............................ 69 Pillar VI – Family and Community Empowerment Family Friendly Schools ........................................................................................................ 70 Two-Way Communication ..................................................................................................... 71 Feeder Pattern Connections ................................................................................................. 71 A180 School Climate Survey Pilot ......................................................................................... 73 Achieve 180 Program and Comparison School Climate Survey for Teachers ............... 73 Achieve 180 Program and Comparison School Climate Survey for Elementary Students ................................................................................................... 73 Achieve 180 Program and Comparison School Climate Survey for Middle and High School Students................................................................................ 74 Discussion ................................................................................................................................................. 75 References ................................................................................................................................................ 78 HISD Research and Accountability 2 2017−2018 Achieve 180 Program Evaluation, Part A Appendices Appendix A: Methods ........................................................................................................................ 81 Appendix B: District Mission, Vision, Beliefs and Achieve 180 Program Guidance ........................... 85 Appendix C: Achieve 180 and Non-Achieve 180 Schools and Student Characteristics .................... 100 Appendix D: Pillar I – Leadership Excellence .................................................................................... 105 Appendix E: Pillar II – Teacher Excellence ........................................................................................ 126 Appendix F: Pillar III – Instructional Excellence ................................................................................. 131 Appendix G: Pillar IV – School Design ............................................................................................... 165 Appendix H: Pillar V – Social and Emotional Learning Support ......................................................... 174 Appendix I: Pillar VI – Family and Community Empowerment .......................................................... 181 HISD Research and Accountability 3 2017−2018 Achieve 180 Program Evaluation, Part A Achieve 180 Program Evaluation Implementation and Preliminary Findings 2017–2018 Executive Summary Program Description In 2017–2018, the Houston Independent School District (HISD) launched Achieve 180, a three-year program centered upon a comprehensive action plan to increase student achievement at 45 schools, including the 27 schools that received the Texas Education Agency Campus Accountability rating of “Improvement Required” (IR) in 2016–2017 and 18 former IR schools that received the IR rating in 2015– 2016, but received the “Met Standard” rating in 2016–2017. In February 2018, one of the charter schools closed, leaving 44 participating campuses. The Achieve 180 Program was created to support, strengthen, and empower these underserved and underperforming schools and their communities using best practices for successful school turnaround, including effective teachers, strong principal leadership, and school environments of high expectations for students and staff. The program’s six pillars of school improvement are Leadership Excellence, Teaching Excellence, Instructional Excellence, School Design, Social and Emotional Learning Support, and Family and Community Empowerment. The pillars provide the framework to strategically transform educational processes at the 44 Achieve 180 Program schools and throughout their feeder patterns, and impact nearly 2,000 teachers and 30,000 students. The 44 Achieve 180 Program schools were grouped according to the number of years they had received an IR rating as of 2016–2017. The 27 schools that received the IR rating in 2016–2017 were divided into three treatment groups: Superintendent’s Schools (n=10) had received the IR rating for four to eight years, Primary Group schools (n=9) had received the IR rating for two or three years, and Secondary Group( n=7) schools had been rated IR for one yearA. fourth treatment group, ht e Tertiary Group, was comprised of 18 former IR schools that had received the IR rating in 2015–2016, but received the “Met Standard” rating in 2016–2017. Achieve 180 school improvement interventions differed by treatment group affiliation. A three-year evaluation will be conducted for the Achieve 180 Program. The purpose of this 2017–2018 (Year 1) report is to evaluate the Achieve 180 Program’s alignment to the District’s goals, assess program outcomes for 2016–2017 (baseline) and 2017–2018 (Year 1), delineate program implementation in 2017– 2018 (Year 1), and assess progress made toward program goals and objectives in 2017 –2018 (Year 1). The 2018–2019 (Year 2) report will delineate program implementation in 2018–2019 (Year 2), assess progress made toward program goals and objectives in 2018–2019 (Year 2), and assess changes in program outcomes for 2016–2017 (baseline), 2017–2018 (Year 1), and 2018–2019 (Year 2). The 2019– 2020 (Year 3) report will delineate program implementation in 2019–2020 (Year 3), summarize program implementation from 2016–2017 (baseline) through 2019–2020 (Year 3), assess progress made toward program goals and objectives in 2019–2020 (Year 3), analyze the impact of program implementation on key outcomes, and analyze changes in program outcomes from 2016–2017 (baseline) to 2019–2020 (Year 3). Evaluation results may inform program improvements, budget decisions, and/or campus or district systems. HISD Research and Accountability 4 2017−2018 Achieve 180 Program Evaluation, Part A Highlights Secondary Tertiary Group • 17% of HISD students Primary Group N=12,700 attended Achieve 180 Group N=4,591 6% Program Schools in N=12,921 2% 2017–2018 (Year 1) 6% • Schools attended by Achieve 180 Program students Superintendent's Non-Achieve included: Schools 180 Schools ▪ 21 Elementary N=6,674 N=176,642 ▪ 8 Middle 3% 83% ▪ 12 High (Total Achieve 180 ▪ 2 K–8 Program ▪ 1 Grade 3–12 N=36,886 17%) Supe•r inFotuer ntredaetmnetn'ts g rSoucphs foro Alcshieve 180 ProgPrarmi’ms 4a4 ruynd Gersreorvuedp, Secondary Group Tertiary Group underperforming schools were formed based on the number of 4–8 years IR 2–3 years IR 1 year IR Formerly IR consecutive years each school had received an Improvement Required (IR) school accountability rating as of 2016–2017 (baseline year). Blackshear ES (6) Bonham ES (2) Attucks MS (1) Bellfort ECC (3) • Program resources, strategies, and activities were developed and Dogan ES (5) Cullen MS (3) Fondren ES (1) Bruce ES implemented for the schools based on their specified treatment group. Henry MS (4) Gregory-Lincoln K-8 (2) Looscan ES (1) Cook ES (3) Highland • HBey iEgnhd-tosf- YEeSar (E5O)Y) in 2017–2018, tHheirleli awerdre sEeSve n( 3mo)re nurses, 11 more libMraroianst,g oonem meorey p ErinScip (a1l, ) Edison MS and 24 more counselors than were on staff in Achieve 180 Program schools at EOY in 2016–2017. Kashmere HS (8) Lawson MS (3) Pugh ES (1) Foerster ES Mading ES (4) Madison HS (2) Sharpstown HS (1) Forest Brook MS Wesley ES (4) North Forest HS (3) Stevens ES (1) Gallegos ES Wheatle80y HS (6) Texas Connections High School Ahead MS 68 66 Woodson K-8 (5) Washington HS (2) Kashmere Gardens ES (4) Worthin6g0 HS (6) Key MS 45 43 42 44 44 44 43 42 Lewis ES (3) 40 35 35 Liberty HS 24 24 Martinez, C. ES 20 13 10 Milby HS Victory Prep South (HS) 0 HIPSrDin Rciepsaelarch Canodu nAscecloruntabiLlibtyr a rian Nurse Principal Counselor Librarian Nur5s e Westbury HS 2016–2017 2017–2018 Yates HS BOY EOY Young ES Number of Filled Positions 2017−2018 Achieve 180 Program Evaluation, Part A Highlights Principal Staffing and Retention F all 2017 New Campus Principals: Spring 2018 New Principals Hired: • 30% of Superintendent’s Schools • Cullen MS (Primary Group) • 25% of Primary Group • Key MS (Tertiary Group) • 29% of Secondary Group • Looscan ES (Secondary Group) • 35% of Tertiary Group • Madison HS (Primary Group) • Wheatley HS (Superintendent’s Schools) Note: The five new principals listed here replaced principals who were not new to their campuses in Fall 2017. • There were fewer teacher vacancies by the Middle-of-Year and End-of-Year in 2017–2018 than in 2016–2017 for non-Achieve 180 and Achieve 180 Program schools. 342 350 300 250 200 150 75 100 57 50 34 12 21 33 34 17 22 20 5 0 Non-Achieve 180 Achieve 180 Schools Non-Achieve 180 Achieve 180 Schools Schools Schools 2016–2017 2017–2018 BOY MOY EOY • 100% of New Teacher Coaches (NTC) positions were filled at Superintendent’s Schools by Fall 2017 and remained staffed in Spring 2018. • • Dedicated Associate Teacher (DAT) positions were 76% filled by the end of Fall 2017, and 89% were filled by the end of April 2018. • In 2017–2018,80.8% of teacher absences were filled on non-A180 campuses, 11.8 percentage points higher than on Achieve 180 Program campuses (69.0%) • Fill rates decreased districtwide (1.3 percentage-points) and at non-Achieve 180 schools (1.6 percentage-points), while they increased 1.4 percentage-points at Achieve 180 Program schools from Fall 2017 to Spring 2018. HISD Research and Accountability 6 Number of Vacancies