CSAP
LWV Jeffco Every Member Material - March, 2005
A Study of the Effectiveness of CSAP in Jefferson County
The Jefferson County League of Women Voters adopted a study of the effectiveness of CSAP in Jefferson County Schools at its annual meeting in April of 2004. This would include comparing a school that has demonstrated how CSAP is working effectively and schools where CSAP is not working.
Observations of committee:
- If the teachers are using the test results for individual students effectively, CSAP results should show if each student is proficient or if there is need of further instruction.
- Standards, testing methods, cultural differences and fairness in the test need to be revisited on a regular basis in order to assure that the results are meaningful.
- It appears that the time teachers at Molholm and O’Connell spend dealing with student mobility and socio-economic disadvantage leaves little time to track down and analyze each student’s previous years scores, as Bear Creek teachers are able to do.
- Teachers expressed a need for an intermediate level test for low IQ special ed students who currently do not qualify for the CSAP-A test.
- Teachers suggested that a better way to test the effectiveness of schools would be to evaluate the progress of each individual student over a year of school.
Creation of CSAP
Colorado Student Assessment Program (CSAP) was created as part of education reform legislation, HB93-1313 in 1993.
Standards
- The Standards and Assessments Development and Implementation (SADI) Council wrote model standards. The community had input on the standards before they went to the State Board of Education (CSBE) for approval.
- Jefferson County Schools created their own higher expectation standards. Colorado is a local control state, so school districts could each accept the model or devise stricter standards.
Testing
- The legislature decided to give the test to all children in grades 4, 8, and 11, rather than to random schools as originally planned.
- CSAP is a criterion-based test where students are expected to show that they have acquired the knowledge appropriate to a particular subject at a particular grade level.
- In 1999, the test was changed (partially at the request of those in the field to use test results for diagnostic purposes) to annual testing in reading in grades 3-10, writing in grades 4-10, math in grade 5-10, and science in grade 8.
- Starting in 2005 grades 3 and 4 will also be taking the math test and starting in 2006 the science test will also be given in grades 5-10, to meet requirements of No Child Left Behind (NCLB).
- Each year 25% of the questions are taken off the test and used as sample questions. Those are replaced with the same number of questions to keep the test varied and current.
Costs: CDE pays for all testing materials and shipping. Generally, a staff member coordinates testing in each school, but occasionally a school hires a short-term test coordinator.
Use of CSAP to Measure Schools’ Proficiency
- In the late 1990s the legislature required the Colorado State Board of Education (CSBE) to use CSAP scores for accreditation of schools and districts.
- School report cards: SB 186 requires CSAP to be used to determine School Accountability Reports (SAR).
- CSAP is now used to measure if schools meet the expectations of No Child Left Behind (NCLB).
- Proficiency of a school, for state purposes, was determined by a bell curve scale established by scores after the first administration of the test in 2001.
- NCLB mandates by 2013 that 100% of students will be making "Adequate Yearly Progress" (AYP). (See glossary)
Allowances for certain subgroups
So that the needs of certain subgroups are not overlooked, each subgroup’s scores must be broken out of the main body of school scores and identified for their progress or lack of it. The subgroups are:
- Five racial/ethnic groups (White, Black, Latino, Asian, and Native American);
- Limited English Speakers (three years or less of speaking English);
- Special Education Students;
- Socio-Economically limited students (those eligible for free or reduced lunch).
Consequences of Failure to meet AYP
Schools were expected to improve their CSAP scores by 25% over a three year period, according to the original law. Now the law has been rewritten and schools are expected to attain "reasonable growth" or a year's growth each year.
If a school needs improvement or correction it can be required to
- Use part of its Title I money to transport students to a non-failing school or
- Pay for tutors for its students.
If a school is converted to a charter school because it has been a failing school for 3 years,
- It can never return to public school status, according to current legislation.
- If that charter school subsequently fails, the school will then be made into a different charter school.
NCLB : There is not adequate money to meet the mandates
- Money available from the state as a reward for high scoring schools or to help low scoring schools was only available the first year of the testing program.
- There is now no money in the state budget for these incentives.
- Much of the NCLB money is tied up in grants that schools must apply for and meet certain requirements.
Jefferson County Schools
Remarks from Jeffco Schools Administration
- The tests are becoming more “user friendly”.
- The entire school – Kindergarten through 6th grade - takes responsibility for improvement.
- 2nd grade tests provide early diagnosis when a child is not being successful so some interventions can take place. Teachers are getting better at identifying strengths and needs of individual children.
- 26 Jeffco Elementary schools improved in 3rd grade to 4th grade reading.
Remarks from schools
- Accountability: All three schools interviewed believe that school accountability is important, and that the Colorado Student Assessment Program helps to standardize curriculum.
- Little time is left for art, music, and other enrichment programs due to focus on CSAP. Teachers in some schools regret that students with talents in these areas do not receive development or recognition.
- Funding for additional programs: Funds available from Federal programs, such as Title I (see glossary) do help, but more funds are needed in schools like Molholm and O’Connell for “pull-out” programs whereby students can be pulled-out of regular classes and provided with special small-group tutoring. Some grants are available, but must be applied for by teachers, a process requiring time most teachers cannot afford. CDE grants are available for literacy
97% of Jeffco Schools meet 100% AYP.
It is in the subgroups (see above “Allowances for certain subgroups”) of Special Education and LEP students in some Jefferson County Schools that are failing to meet the Adequate Yearly Progress (AYP) expected by NCLB. This failure is not likely to cause these schools to be converted to charter schools, but it does impact money the district can expect from the federal government.
- “Most students with disabilities will participate in the general CSAP. Some of those students may require accommodations to demonstrate their knowledge and skills. A very small number of students with significant cognitive disabilities will require the CSAP Alternate (CSAP-A) to demonstrate growth toward expanded benchmarks of the standard.” [1]
- As Limited English Proficient (LEP) students improve in English, they move out of LEP programs. New English learners moving into the LEP program make it difficult to achieve 100% grade level test scores in this subgroup.
Jefferson County passed a mill levy with a “performance promise” based on the original state law requiring schools to improve CSAP scores “by 25% over three years”. Jeffco's first CSAP scores were so high that a 25% improvement would be beyond the maximum score. Later the law was rewritten to require “reasonable growth” of one year’s growth each year. Jeffco has met the rewritten expectation, but the original “performance promise” limits the amount of district mill levy funds received.
We interviewed the following Jeffco Schools administration staff, and staff at three schools:
Administration: Carol Eaton, Executive Director of Assessment & Research and Sue Larsen, Assessment Specialist
O’Connell Middle School: CSAP coordinator Margaret Barkey and teacher Donna Bright
Molholm Elementary School: Principal Kay Moser and CSAP coordinator Lauri Ullibari and staff
Bear Creek Elementary and Midddle School: Ron Mitchell, Interim Principal and Marilyn Lienbach, Instructional Coach
Jefferson County School
Overall Performance
2003-2004Students
Met AYPAccreditation Status
Student
Enrollment
Stability% Eligible for Free lunch
Student
EnrollmentTeachers’ Salary (average)
Bear Creek Elementary/Middle
Excellent
100%
Accredited -
High Performing94.7%
14%
1,039
$46,342
O’Connell Middle
Average
83%
Accredited – Academic Watch
92.1%
44%
606
$46,803
Molholm Elementary
Low
94%
Accredited
90.8%
59%
445
$44,387
Derived from “Colorado School Accountability Reports”, Denver Post , Dec. 9, 2004
Bear Creek Elementary & Middle School identified factors contributing to their school’s success:
- Spiraling Curriculum uses Saxon Math[2] and Open Court[3] reading programs that progress sequentially for each student.
- Parent/Student contracts demand a commitment from parents to help the student succeed; teachers make home visits
- The curriculum is closely tied to CSAP. Classroom tests follow CSAP style and formats. Teachers have access to volumes of past CSAP tests for reference.
- Teachers study CSAP scores from previous year to identify each student’s strengths and weaknesses.
Molholm and O’Connell identified factors beyond their control that affect CSAP performance:
Student Mobility: the turn-over of students, those who leave and others who arrive within a school year.
- Student stability is measured as the percent of students enrolled on October 1st and still be enrolled on February 1st.
- A school can be making great progress in educating its students, but by test time many of the students who have made that progress have moved away while students from other schools move in and become part of their CSAP population, skewing the measure of a school’s performance.
Language
- Students for whom English is not their first language may have good knowledge of subject content but may not yet be able to understand the question or express their answers well in English on a test.
- ESL[4] students that have been enrolled in a Colorado school for three years are required to take the test. The test is given in English.
- When students move to a non-bilingual school from a bilingual school, they may be less likely to score well on a test given in English.
Children with Special Needs
- Challenge[5] and SLIC[6] students are allowed to take the “CSAP-A” test.
- Special Ed[7] students have to take the regular CSAP test even though some have very low IQs. Teachers feel it would help to have an intermediate level test for students who don’t meet the criteria of higher IQ Special Ed students.
Socio-economic disadvantage
Children living in low-income families are likely to have disadvantages affecting their education. “Low-income” is defined in schools as children who qualify by family income for the Free and Reduced Price Meals program. (FRM)[8]. The chart on page 4 shows only the percent eligible for free lunches.
Children in socio-economically disadvantaged families are more likely to:
· Be less prepared for school when they enter kindergarten, and less prepared for each school day;
· Have lower parent participation at school and lower level of parent education;
· Lack access to health care to address vision, hearing, illness, or developmental delays;
· Have disruptions at home, i.e. frequent moves, substance abuse, and domestic violence (this occurs at all socio-economic levels);
· Have an absent parent (away, working multiple jobs, or in prison).
Student attendance for tests
- For each student absent on a test day, the school receives a minus 0.5 point; that is, rather than receiving a zero for a student who does not take the test, the school receives a half point penalty.
- The schools offer small incentives for students to attend school on test days, coupons or other small items donated by businesses. Bear Creek has a party.
GLOSSARY OF EDUCATION TERMS FOR CSAP UNIT MEETINGS
AYP – Adequate Yearly Progress -- Progress is tied to NO Child Left Behind. The purpose is to measure the progress of all sub-groups (30 students or more) on the CSAP and CSAP-A tests. All schools are expected to have all of their students meeting standards by 2013.
CSAP – Colorado Student Assessment Program – These tests are administered to all children in grades 3 – 10. Students are expected to show that they have acquired knowledge appropriate to each subject tested for that grade level. Tests are given in reading, writing, mathematics and science. The CSAP-A test is administered to those children who are severely handicapped.
LEP – Limited English Proficient – These students have spoken English for three years or less.
Jefferson County allows Spanish speaking students who have been in the system less than three years to take the test in Spanish. Those students who have been there longer and still have not mastered English are nevertheless required to take the test in English. Students who speak other languages may have a translator, if one is available who speaks their language.
KIPP – Knowledge is Power Program – This program is a charter school operator. It was founded in Houston in 1994 and has 38 schools in 15 states and the District of Columbia including one in southwest Denver. The charter has the reputation of sending inner-city students to elite prep schools and colleges. (This is included here as at the unit meetings there will be discussion included regarding the changing of schools to charter schools.)
NCLB – No Child Left Behind – This is a federal program which measures school progress toward the goal of having all students at least partially proficient on the CSAP rests by 2014.
SAR’S – State School Accountability Reports – These reports are provided to parents and the community so that schools may be compared with others in the state. SAR’s include ratings based on CSAP and ACT tests, as well as school safety and improvement from previous years’ tests. Following three years of unsatisfactory ratings, the state converts the school into a charter school. Once a school becomes a charter school, it can never return to public school status. SAR’s are also known as school report cards.
Title I – The largest federal education program, Title I provides federal funding for schools to help students who are academically behind or at risk of falling behind. Funding is based on the number of low-income children in a school (usually those who are eligible for a free or reduced price lunch). Jefferson County in 2002 had 17 elementary schools and one middle school receiving Title I funds. The money may be used to reduce class size, to hire tutors, to run computer labs, to provide activities to involve parents, to purchase materials, to add pre-kindergarten programs, to hire teaching assistants, and to offer professional development.
[1]. Page 57, CDE Student Assessment Unit – September 2004.
[2] A structured math program involving use of manipulatives, worksheets, and memorization tables
[3] Uses explicit phonics and comprehension skills instruction balanced with extensive reading of both decodable texts and quality literature. Produced by Science Research Associates, a division of McGraw Hill Publishing Company.
[4] English as a Second Language
[5] Challenge students are Developmentally Delayed students with an IQ below 50.
[6] Significant Limited Intellectual Capacity (SLIC) with an IQ below 70.
[7] Special Education students may have any of range of learning disorders and disabilities, including but not limited to Significant Identifiable Emotional Disorder” (SEID); and Perceptual Communicative Disability” (PC).
[8] Students eligible for the Free and Reduced Priced Meals Program (FRM) live in families with incomes under 185% of the Federal Poverty Level. For example in 2004, a child living in a family of four with an annual income of less than $34,872 would qualify for FRM.
Resources:
- Interviews with Jefferson County Schools specialists, Dr. Carol Eaton and Sue Larsen.
- Jefferson County Schools Website, http://jeffcoweb.jeffco.k12.co.us (“CSAP Support”, “Item Map Pie Charts” and “Item Map Pie Chart Descriptors”).
- Interview with Evie Hudak, State Board of Education (2nd Congressional District).
- Evie Hudak’s website www.hudak.org/articles/no_child_left_behind_02-2003.htm
- Interviews with staff members of Bear Creek Elementary/Middle School, Molholm Elementary, and O’Connell Middle Schools.
- School Accountability Reports from the CDE website www.cde.state.co.us
- Other Publications from the CDE website include: “Item Maps”, “Released Items” and “2004-2005 Procedures Manual”.
- “Assessing the CSAP How Can We Assess the Quality of a Large-Scale, Standards-Based Assessment?” Vonda L. Kiplinger, Ph.D., CDE
- “ A Seventh Grade Parent’s Guide to the State Test Measuring Growth”, Denver Public Schools 2000 http://curriculum.dpsk12.org
- Colorado School Accountability Reports – The Denver Post – Thursday, December 9, 2004.
Committee members: Norma Burg, Walt Heidenfelder, Roberta Kreutzfeld, Gwen Lipkie, Karen Murphy, Elaine Olson, Marcia Schafer, Patty Schoedler, Susan Tyler.