1 Update RACE TO ofTHE from the Office TOP ASSESSMENTS Florida Association of Science Supervisors October 24, 2012 Sally Sanders Science Content Specialist Race to the Top Goals 2 Double the percentage of incoming high school freshmen who ultimately graduate from high school, go on to college, and achieve at least a years worth of college credit; Cut the achievement gap in half in 2015; Increase the percentage of students scoring at or above proficient on NAEP by 2015, to or beyond the performance levels of the highest-performing states. Floridas RTTT Application 3 Three projects assigned specifically to the Office of RTTT Assessments: Florida Interim Assessment Item Bank and Test Platform District-developed Assessments for Hard-to-Measure Content Areas Contract for FL participation in international benchmarking studies (TIMSS, PIRLS, PISA) 4
District Developed Assessments Content Awarded Districts Physical and Health Education: K-8 Miami-Dade County Physical and Health Education: 9-12 Hillsborough County Performing Arts: K-12 Polk County Visual Arts: K-12 Miami-Dade County Career and Technical Education World Languages Hillsborough County Duval County Status Update: Hard to Measure Content Areas 5 Competitive Award for seven projects issued in August 2011 Main deliverable in Year 1 (2011-12): Item Specifications Main deliverable in Year 2 (2012-13): Item Development Main deliverable in Year 3 (2013-14): Field Testing Timeline District-Developed Student Assessments Project
6 2011-12 2013-14 2012-13 Fall Spring Summer Fall Spring Monitoring, Communication and Risk Management plans completed Item development plan Item review plan Item writer training materials Item specifications for PE/ Health, Visual Arts, Performing Arts, CTE, World Languages Batch 1 items for review Batch 2 items for review Year 1 items uploaded to test platform for pilot testing Item Development Face-toFace Project Meeting
Item development Begin test design specifications Batch 3 Preparatio items for n for Fieldreview Testing. Batch 4 items for review Review of items for bias and content Year 2 items uploaded to test platform for pilot testing Test design specifications complete Summer Fall Spring Batch 5 items for review State-wide field test Train performance scorers Analyze data Data review for bias and content Compile final item pool Status Update: TIMSS, PIRLS, PISA 7
TIMMS (Trends in International Mathematics and Science Study) PIRLS (Progress in International Reading Literacy Study) Test given in Spring 2011 in Grades 4 and 8 Results available in Spring 2013 Test given in Spring 2011 in Grade 4 Results available in Spring 2013 PISA (Program for International Student Assessment) Test will be given in Fall 2012 to 15-year-old students Results available in Spring 2014 Item Bank and Test Platform 8 Statewide technology-based system Bank of standards-based items/tasks Test builder tool to construct valid and reliable assessments In development Diagnostic, interim, summative
Computer or paper-based functionality Item Bank and Test Platform 9 Online tutorials for use of the item bank item writing item reviewing assessment development Timeline - Interim Assessment Item Bank and Test Platform Project 10 2011-12 2012-13 Fall Spring Item Y1 batch specifications Math, 3,4 & 5 ELA,SS, Sci, Spanish completed Approved item All development plan for yr2 meetings All year 1 items in for item bank reviewers Y1 batch 1&2 and review completed have been Meetings for item reviewers and review conducted
Fall Spring Summer Bid protest to ITN Intent to award published Contract awarded to Pearson Test item development plan & blueprint of the content standards Plan for Item review is approved Communica tion plan of PD modules Recruitmen t of Florida Educators for Sustainability plan Item Meetings for item Reviewers and reviewers and review Writers have been conducted Phase 1 of item bank is operational Develop communication to stakeholders Online system of tutorials-approved and available 2013-14
Summer Y1 submitted and approved Functiona lity test Phase 2 is operational Year 2 batch 1completed Fall Spring Approved item development plan for Y2 Deliver approved communicatio n plan Y2 batch 2,3 & 4 completed Interim assessment for Math (FAIM) Item Tryouts completed Online training for educators to write items Y2 batch 5 completed All meetings for item reviewers and review have been conducted All items for Y3 submitted and approved Phases 3-6 are operational
Item Bank and Test Platform fully functional. CCSS Connection 11 Common Core State Standards Common Core Tools https://www.teachingchannel.org Education Northwest http://commoncoretools.me/author/wgmccall um/ The Teaching Channel: Inspired Teaching, Inspiring Classrooms http://www.corestandards.org/ http://educationnorthwest.org/resource/1756 CPALMS PARCCConnection 12 Partnership for Assessment of Readiness for College and Careers http://parcconline.org/
Sample Item and Task Prototypes Model Content Frameworks PARCC assessments aligned to the CCSS Vince Verges, PARCC Project Director Serves as K-12 Lead for PARCC in Florida Classroom Connection 13 Interim Assessments Given at regular intervals throughout the school year Designed to evaluate students knowledge and skills relative to a specific set of academic standards Data can be aggregated to inform instruction IBTP Item Distribution 14 Tier 1 Differentiated Accountability & other state level programs Tier 2 District level access This collection will house the majority of items. Tier 3
School level access Tier 4 Classroom teacher access Tier 5 Public access Sample items. Collection will grow over time. Tiers Tiers 1-4 1-4 will will be be password password accessible accessible to to aa limited limited group group of of people. people. Greatest Greatest security security is is employed employed for for Tier Tier 11 items, items, with with wider wider access access available available at at lower lower levels. levels. As As items items are are no no longer longer
used used at at an an upper upper level, level, they they will will move move to to become become available available at at the the next next level level down. down. By By end end of of Year Year 2, 2, the the IBTP IBTP will will house house approximately approximately 60,000 60,000 items. items. Item Specifications 15 Purpose: Provide guidance to item writers and reviewers for the development of high-quality standardsbased (NGSSS and CCSS) assessment items Status: Item specifications are in final phase of development/approval; item writers are using draft version of specs Item Types
16 Selected Response Short Response Gridded Response Constructed Response Extended Response Essay Response Performance Tasks District Involvement 24 Florida educators are involved in writing and reviewing items for the Interim Assessment Item Bank; writers and reviewers are compensated Next slide shows district representation as of October 2012 Column 1: Total item writers/district for all 5 content areas (Science, Mathematics, ELA, Social Studies, and Spanish) Column 2: Total item writers/district for Science Column 3: Total item reviewers/district for all 5 content areas Column 4: Total item reviewers/district for Science Item Writers Item Reviewers Item Writers
All Science All Science All Science Item Reviewers All Science Item Writers Item Reviewers All Science All Science Alachua Baker 25 Bay 2 1 8 0 0 2 1 0 4 0 0 1 Gulf Hamilton Hardee 0 0 0 0 0 0 0
0 0 0 0 0 Okeechobee 0 Orange 3 Osceola 3 0 0 1 1 2 2 0 0 0 Bradford Brevard Broward Calhoun Charlotte Citrus Clay Collier Columbia Dade DeSoto Dixie Duval Escambia Flagler Franklin Gadsden Gilchrist 0 3 54 0 2 4 3 8 0
23 2 0 11 11 1 0 0 0 0 1 7 0 0 1 0 0 0 4 0 0 5 2 0 0 0 0 0 4 16 1 1 1 1 2 0 8 1 0 2 2 0 0 1 0 0 0 2 0 0
0 0 0 0 6 0 0 1 0 0 0 0 0 Hendry Hernando Highlands Hillsborough Holmes Indian River Jackson Jefferson Lake Lee Leon Levy Liberty Madison Manatee Marion Martin Monroe 1 4 0 17 0 0 1 0 28 10 5 2 1 0 5 10 1 1 0
0 0 0 0 0 0 0 9 2 0 0 0 0 0 1 0 0 0 1 0 3 0 0 1 0 3 3 1 0 0 0 2 2 0 0 0 0 0 1 0 0 0 0 0 1 1 0 0 0 0 0
0 0 Palm Beach 11 Pasco 7 Pinellas 6 Polk 4 Putnam 0 St. Johns 15 St. Lucie 13 Santa Rosa 1 Sarasota 0 Seminole 6 Sumter 0 Suwannee 0 Taylor 0 Union 0 Volusia 9 Wakulla 4 Walton 0 Washington 0 1 2 1 1 0 6 6 0 0 0 0 0 0 0 2
1 0 0 3 2 1 1 0 4 3 0 0 1 1 0 1 0 8 1 0 0 1 0 0 0 0 2 0 0 0 0 0 0 0 0 2 0 0 0 Glades 1 0 0 0 Nassau
2 0 0 0 Totals 55 93 18 Glades 1 0 0 0 Okaloosa 4 0 1 0 as of 10/4/12 309 How can your district be involved? 26 Functionality Testing
Phase I in progress Nominate Item Writers Nominate Item Reviewers Item Tryouts (field testing) 27 How can educators be involved? Serve as item writers or reviewers Test the functionality of the test platform Send contact information to [email protected] Name District E-mail address Teaching assignment Office of RTTT Assessments 28 Director: [email protected] District Developed Assessments for HtM Project Manager: [email protected] IBTP Project Manager: [email protected] Five Content Specialists: English/Language Arts: [email protected] Mathematics: [email protected] Science: [email protected] Social Studies: [email protected] Spanish: [email protected] Floridas Common Core State Standards (CCSS) Implementation Plan 2011-2012 Full Implementation Grade K Begin Implementation of Literacy Standards in ALL Content Areas for Grades 6-12 Begin Implementation of Rich and Complex
Text and Informational Text for Grades K-12 2012-2013 Full Implementation Grades K-1 Full Implementation of Literacy Standards in ALL Content Areas for Grades 6-12 Continue Implementation of Rich and Complex Text and Informational Text for Grades K-12 2013-2014 Full Implementation Grades K-2 Implementation of a Blended Curriculum (CCSS and Supplemental NGSSS Aligned to FCAT 2.0 and EOCs) for Grades 3-12 Continue Implementation of Rich and Complex Text and Informational Text for Grades K-12 2014-2015 Full Implementation Grades K-12 PARCC Assessments Aligned to CCSS Florida Statute Passed as Part of Senate Bill 736 in Spring 2011 30 Section 1008.22 FS: (8) LOCAL ASSESSMENTS. (a) Measurement of the learning gains of students in all subjects and grade levels other than subjects and grade levels required for the state student achievement testing program is the responsibility of the school districts. (b) Beginning with the 2014-2015 school year, each school district shall administer for each course offered in the district a student assessment that measures mastery of the content, as described in the state-adopted course description, at the necessary level of rigor for the course. Such assessments may
include: 1. Statewide assessments. 2. Other standardized assessments, including nationally recognized standardized assessments. 3. Industry certification examinations. 4. District-developed or district-selected end-of-course assessments. (c) The Commissioner of Education shall identify methods to assist and support districts in the development and acquisition of assessments required under this subsection. Methods may include developing item banks, facilitating the sharing of developed tests among school districts, acquiring assessments from state and national curriculum-area organizations, and providing technical assistance in best professional practices of test development based upon state-adopted curriculum standards, administration, and security. Section 1008.22, FS Student assessment program for public schools 31 Thank you SALLY SANDERS OFFICE OF RACE TO THE TOP ASSESSMENTS SCIENCE SPECIALIST [email protected] (850) 245-0760 Fall 2012 Division of Accountability, Research, and Measurement Florida Department of Education
