What Do Florida’s School Grades REALLY tell you?

 

“What was educationally significant and hard to measure has been replaced by what is educationally insignificant and easy to measure. So now we measure how well we taught what isn’t worth learning.”

Arthur Costa, Emeritus Professor at California State University

Take a moment and think about the best moments your children have had at their public school… you know, those times where they came home so excited, talking a mile a minute, about what they have seen and learned. For my daughter, this might have been when the whole third grade spent the day celebrating “Early Man,” with art, music and skits, all dressed in fake fur, dirt smeared on their faces, hair all teased up into “Early Man Style,” culminated with a “eat with your hands” feast (Thank you, Mrs. Carter). For my son, it is probably a tie between “getting to do science experiments ALL DAY” and having a Beatnik Poetry Slam that was “Oh too cool” (Thank you Ms. Osborne). I remember similar moments from my childhood and they still make me smile. These are the moments that will make or break your child’s education experience. These are when the real learning, the kind that inspires, really happens. To everyone who has provided these moments for my children, I thank you.

This week, the Florida Department of Education will finally be releasing school grades from the 2014-15 school year, six months late, after the flawed rollout of the new Florida State Assessment (FSA). Superintendents have warned “these grades hold little value for school districts and should be viewed as such by the public.” In a recent op-ed, Orange County Superintendent and current President of the Florida Association of District School Superintendents, Barbara Jenkins explained the superintendents’ opposition to the publishing of school grades, asking for “incompletes” to be issued instead. In addition, she repeats that “superintendents in the 67 Florida districts have unanimously called for a comprehensive review of our accountability system in order to better inform students, parents, educators and the public.”

“Now is the time to admit that the current system is no longer sufficient, and simply labeling schools A through F provides an inaccurate picture of what is occurring in every school.”

Here’s a News Flash: Florida’s A-F School Grading System has NEVER been sufficient, it has ALWAYS provided an inaccurate picture of what is occurring is schools. Why? Because it focuses almost entirely on standardized test scores and they are a poor reflection of real learning. We hope Superintendent Jenkins understands that even with the addition of measured “learning gains” calculated from this year’s FSA scores, the A-F grading system will still be completely flawed.

According to the 2015 PDK/Gallup Poll, these are the factors most important to parents when choosing a school.  The primary factors being quality of teaching staff, curriculum, student discipline, class size, variety of extra-curricular activities and reputation of school. Only 15% of those surveyed felt “student achievement on standardized tests” was “very important” when choosing a local public school.

FullSizeRender-12

Florida School Grades do not reflect what parents deem important when choosing schools but, rather focus almost entirely on standardized test scores.  Here is the Elementary School Grades Model. Elementary schools are graded based on how well their students, in 3rd grade and up, perform on the grade level, standardized Math and English Language Arts (ELA) FSA and on the 5th grade Science FCAT. By testing students on a grade level assessment, they are looking for how many student are performing at or above average (because that is what “grade level” represents, the average performance of a child in that grade). Learning gains are calculated for all students and the learning gains of the lowest quartile of students count twice in the calculation.
FullSizeRender-21

This year, in all grade levels, English Language Learners will be required to sit for hours of FSA testing, even if they arrived in the country yesterday and do not speak a word of english. Why? To provide a baseline for a learning gains calculation when they are again asked to take the assessment next year.  After two years, English Language Learners’ scores will be counted in with the rest of the student body.

Also, it is the focus on preparation for the third grade math and ELA FSA (third graders must pass the reading/ELA portion for promotion to 4th grade) that drives much of the progress monitoring and test preparation in the younger grades. Children as young as kindergarten are required to have 90 minutes of uninterrupted reading instruction, leaving little time for creative endeavors, art, music and, in some schools, even recess. (Read here to learn about the Florida moms fighting to restore recess in our public schools, after being told there wasn’t time for daily recess “given the growing demands on schools to raise test scores”).

Middle schools, in addition to grade level performance and calculated learning gains on the Math and ELA, are rated on how well their 8th graders perform on the 8th grade Science FCAT, how many students pass the state created Civics End of Course exam (EOC) and how many students pass accelerated math (like Algebra 1) EOCs or qualifying industry certifications.

FullSizeRender-17

The number of students eligible for the “Acceleration Success” calculation in the Middle School Grade Model, is determined by the number of students in the class AND all 8th graders who scored a 3 or higher on EITHER Reading or Math in their 7th grade state assessment. To be clear, the number of students deemed eligible to take a high school level Algebra 1 course in 8th grade is NOT determined by their performance on any Algebra readiness standards but on their previous year’s FSA Math and Reading scores.

The High School Grade Model includes a calculation of overall 4-year graduation rate, but otherwise is entirely determined by standardized test scores. English Language Arts scores are calculated from performance on the 9th and 10 grade FSA ELA and Math scores are determined by performance on state mandated and created EOCs. Science achievement depends on scores for the state mandated Biology 1 EOC and Social Studies achievement depends on the state mandated U.S. History EOC.

FullSizeRender-13

In high schools, “Acceleration Success” is calculated as the percentage of graduates who, while in high school passed an AP, IB, or AICE examinations, earned a C or better in dual enrollment or earned a CAPE industry certification. In addition, high schools receive performance funding for enrolling students into these programs so there is a lot of “encouragement” to enroll students in these courses. Students, sometimes, find themselves enrolled in advanced classes they didn’t ask for and may have difficulty getting out of these classes if that is their desire. With the pressure to pass  AP exams, Monroe County has paid the National Math and Science Initiative, a non-profit, almost $2 million over three years to help improve participation and passing rate on AP exams, and is now requiring AP students to attend extra Saturday sessions during the school year.

What can we learn about our schools from their A-F letter grade?

School grades may be a reflection of the socioeconomic status of the student body. Researchers have been able to predict school grades based on US census data alone. Chris Tienken and colleagues “predicted the percentage of students at the district and school levels who score proficient or above on their state’s mandated standardized tests, without using any school-specific information” making the need for testing obsolete!  For more information, click here.

More concerning, when considering a local school’s grade, is whether the school has gone through any extraordinary measures to ensure high test scores from their students. Are the students engaging in creative engaging lessons that inspire a love for learning or does the curriculum resemble test prep? Have non-tested subjects, like art, music, physical education, etc, been minimized or marginalized to preserve more time for tested subjects? Is there time in the day to read fiction or fairy tales? For the youngest students, has seat work replaced time spent in free play or exploration?  For high school students, has the push towards AP classes eliminated Honors classes and/or inappropriately placed more and more students, ill prepared for the rigors of AP classes, into these classes, setting these students up for failure.  Are today’s AP courses really representative of college level courses or are they little more than test preparation for the required AP exams? Parents should be asking these questions of their highly rated schools. How many hoops have been jumped through in order to earn that coveted “A” rating? What have the students missed out on while practicing “hoop jumping”? Perhaps it is not surprising that many of Florida’s voucher students leave “A” rated public schools; are they escaping from the constant test pressure?

Likewise, some parents of children at schools that earn lower school grades must recognize the many positive experiences their school provides their children. Perhaps they have a wonderful chorus, an active theater group, a school garden… Maybe they focus more on the whole child and less on the test prep… Is the teaching staff loving and devoted to your children? These things are important and should be celebrated! Sadly, they are not even considered in the current school grade formula.

Any straight A student can tell you their final grade did not always reflect the quality of the course. Likewise, school grades may only reflect the test scores, not the quality of the education provided. In fact, parents of children in “A” schools, or in “A” districts, should be questioning whether their school focuses too much on testing and forgets the whole child. Parents need to start recognizing Florida’s A-F School grade system for what it really is: a reflection of a test focused system that has gone too far.

12631499_1259717524043938_5958608282608271154_n

 

Advertisements

Algebra 1 EOC: Ridiculously High Stakes

5/22/2016, ACCOUNTABALONEY UPDATE:

At the 2016 Spring FOIL Conference (Florida Organization of Instructional Leaders), The FLDOE gave a presentation on the details contained in HB 7029:School Choice, one of the two long “train bills” from the 2016 session. To give you an idea of the bill’s complexity, the FLDOE summary presented was 135 pages long! It included this good news:

Section 27. Amends s. 1011.61, F.S…to “Delete the provisions requiring an FTE adjustment when a student does not pass an end-of-course exam required to earn a high school diploma. The FTE adjustment was scheduled to begin in the 2016-17 school year.”

In other words, the Algebra 1 Performance Based Funding, discussed in this blog, has been repealed. The other high stakes attached to the Algebra 1 EOC remain in place.


Occasionally, reformers will dismiss concerns regarding the high stakes attached to standardized testing in our schools by comparing these state mandated tests to the test you must pass to get your driver’s license. For example, in 2015, current Senate President, Andy Gardiner told an Orange County Legislative Delegation (read about it here):  “My driver’s test was high-stakes, because I didn’t want my parents driving me around anymore.” Yes, being driven around by your parents is terrible…

The stakes attached to the Algebra 1 EOC recently got quite a bit higher, so we decided this was a good time to compare the consequences of the current state mandated Algebra 1 End of Course exam (EOC), which we will argue has the highest stakes of all of Florida’s state mandated assessments, with having your parents drive you around when you are 16.

The current Algebra 1 EOC was created by AIR, the same company that created the Florida Standards Assessment or FSA and first administered in 2015.  Cut scores for the 2015 administration were finally set in January 2016, resulting in an overall FAILURE RATE of 44% (with some schools and districts having worse performance than others).

Passing the Algebra 1 EOC is a high school graduation requirement. Students who fail the 3 hour, computer based assessment must either retake and pass the exam or earn a concordant score on the PERT exam.

A student’s score on the Algebra 1 EOC, like all of Florida’s EOCs, is worth 30% of the students grade. Some Magnet Schools require the completion of Algebra 1 before a student can gain admission to their programs. Students failing Algebra 1 will be ineligible for admission to these highly sought after programs.

Student scores on the Algebra 1 EOC are used to calculate their teacher’s VAM score, which affects their teacher’s effectiveness rating and merit pay. Teachers receiving multiple ineffective ratings may lose their jobs.

Student scores on the Algebra 1 EOC are a major component of the Middle School A-F School Grade calculation, making up at least 11% of the possible points. Middle schools are rated on the percentage of eligible students who pass a high school EOC (most often Algebra 1, though occasionally students will be offered other courses with EOCs) or earn an industry certification.

FullSizeRender-17

The number of eligible students is determined by the number of students in the class AND all 8th graders who scored a 3 or higher on EITHER Reading or Math in their 7th grade state assessment. To be clear, the number of students deemed eligible to take a high school level Algebra 1 course in 8th grade is NOT determined by their performance on any Algebra readiness standards but on their previous year’s FSA Math and Reading scores.

FullSizeRender-15

Performance on all of the State mandated Math EOCs, including the Algebra 1 EOC, along with calculated learning gains, also represent 30% of the calculation of High School A-F grades.

FullSizeRender-13

Schools achieving high letter grades receive extra funding while school’s receiving failing grades can be threatened with take-over or closure.

Performance on the Algebra 1 EOC is also calculated into the School District’s overall grade calculation.

FullSizeRender-20

As if the stakes described above weren’t high enough, there is now a thing called “Algebra 1 Performance Based Funding”, described in this slide from the DOE:

FullSizeRender-16

So, yes, you read that right. Beginning in 2016-17, if a student takes an Algebra 1 class and then, at year’s end, fails the mandated EOC, that student’s school must return 1/6 (representing the cost of one out of 6 classes) of the FTE money (this is the money the school receives to educate each student) back to the state. The money (amounting to over $1000 per student who fails the EOC) must be returned after a student has been taught by a teacher, in a classroom, for an entire school year… Schools in low income areas, with lower passing rates, will be hit particularly hard.

Apparently, schools will not be penalized if the student “subsequently enrolls in a segmented remedial course delivered online.”  I called my daughter’s middle school and, at this point in time, they have been given no direction from the DOE as to what a “segmented remedial course” looks like, but they are scrambling to assure it will be available to their students by the end of next school year.

So, yes, the stakes attached to the Algebra 1 EOC (high school graduation, 30% of course grade, Magnet School eligibility, teacher’s evaluation and job security, school and district grades and school funding) are ridiculously high and, I think we can all agree, are significantly worse than being dropped off at a high school dance by your parents.

The high stakes attached to the Algebra 1 EOC (and the rest of Florida’s state mandated assessments) are real, they lack common sense and, unless they are addressed, Florida will never have a valid accountability system.

In the meantime, all comparisons to getting your driver’s license are baloney.

 

Addendum: All images are from a FLDOE presentation entitled “School Accountability and State Assessments” at the Fall 2105 FOIL conference and can be found, along with lots of other great information, in their archived materials.