On the last day of January 2019, with little fanfare and drowned out by the impending strikes over unacceptably low teacher pay, the California Department of Education published a list of schools that are eligible for additional support and funds from the state. It’s also the list of the lowest 5% of public schools in California as determined by the CA School Dashboard.
Thinking about quality
Oakland is over-represented on this list. Not surprisingly, I’ve received quite a few questions about the 5% list, especially as parents just last week had to confirm their enrollment choices for next year. The need for more quality schools is on everyone’s mind, so I’m here today to try to demystify and share some context.
Why publish this list at all?
Every Student Succeeds Act (ESSA), the latest reauthorization of federal K-12 education policy signed into law by former President Obama, requires that each state create clear criteria for identifying the lowest performing 5% of schools so that resources and efforts can best be deployed for improving student outcomes. After receiving feedback from US Department of Education during the ESSA state plan approval process, California chose to align the identification criteria around the CA School Dashboard, its current multi-measure accountability system for K-12 schools, inclusive of alternative schools starting Fall 2018.
CA School Dashboard Resources
Before we go too deep, let me share some resources on the CA School Dashboard. Check out the links for more useful information:
What are the criteria?
In California, the lowest 5% of schools are eligible for comprehensive support and improvement (CSI). If a school meets any of the following criteria on the CA School Dashboard, it will be identified as a CSI school: ·
- Grad rates <67% over two years average (HS only) (example)
- All red indicators on CA School Dashboard (example)
- All red and orange indicators on CA School Dashboard (example)
- All red except for one indicator of any other color (example)
- Majority red indicators if they have 5+ indicators (think 6-12 schools) (example)
Identification for CSI is based on “All Students” group for both traditional and alternative schools and occurs once every three years. When the CA School Dashboard is updated each fall, a school can “exit” the list if they no longer meet the specific criteria they were flagged for. For example, if School X (grades 6-12) was flagged for low graduation rates but has a high graduation rate average over the next two years, they would no longer be flagged. They can be re-flagged in the future for other reasons, like having majority red indicators or if their graduation rates decrease again.
How’s Oakland looking?
So…which of Oakland’s schools are on the list? Here is a table ordered alphabetically:
Source: EdSource Database: California’s lowest-performing schools in 2018-19
Some quick analysis:
- While the criteria are meant to yield a target of 5% of schools in California, Oakland is overrepresented on the list with 21% of its schools listed. (28 out of the possible 131 public schools. This includes both district-run + charter and alternative + traditional)
- 24% of Oakland district-run schools were listed (21 schools)
- 17% of Oakland charter schools were listed (7 schools)
- Of the 781 total schools identified across the state, 4% of the schools are in Oakland.
- 25% of the Oakland schools listed are non-traditional schools (e.g., continuation or alternative), which is similar to the percent of non-traditional schools listed statewide (29%).
- About 2/3 of the listed Oakland schools were flagged for low performance and 1/3 were flagged for low graduation rates – also similar percentages to the statewide list.
Some grains of salt
Similar to the state’s roll-out of the chronic absence data for the first time in 2016-17, there’s going to be hiccups and imperfections whenever data is rolled out initially for a new metric.
- Automatic Assignment of Orange. Schools that do not report their data are automatically assigned Orange in chronic absenteeism and suspension rate indicators. For example, we wouldn’t know whether School X truly ranks an Orange on suspension, or if they are Orange because the CDE did not receive their suspension data.
- Data Errors. One local example of data error is Lighthouse High School. In 2017 they had a 75% cohort graduation, helping to flag their 0% graduation rate in 2018 as an error. Nevertheless, they’re on the list.
So what’s next? Time to focus on quality.
There are different levels of support based on how a school is doing (from highest level of support to lowest):
- CSI = Comprehensive Support and Improvement (aka Lowest 5%. These are the schools who met the criteria above)
- ‘CSI Low Perform’ = Flagged because they met one of the non-grad low performance criteria (e.g., all red on indicators)
- ‘CSI Grad’ = Flagged because of low grad rates
- ATSI = Additional Targeted Support and Improvement (when 1+ subgroup doesn’t improve and they’re a TSI school. I’m still not 100% clear on how this differs from TSI – if any readers know, please share with me at email@example.com!)
- TSI = Targeted Support and Improvement (when 1+ subgroup doesn’t improve for 2+ years on same criteria), also referred to as General Assistance
Schools who qualify for CSI can submit improvement plans to California Department of Education to access state funds to support their improvement process. First disbursements recently went out to those with approved plans. As additional layer of support, county offices of education received extra funds to help support impacted LEAs with CSI schools (another way the Alameda County Office of Education is increasing its support to Oakland).
Locally, there are a lot of conversations, in offices and around dinner tables, about school closures and consolidations. (Data nerd here: I’ve been crunching historical closure data, and it’s a messy + sensitive topic. Curious if y’all are interested in seeing it?)
Instead, I hope this list along with other data can help drive more conversations around school quality. I’m more optimistic than ever we can get there, because this is the vision I consistently hear from OUSD Superintendent Kyla Johnson-Trammell. Also, with federal backing through ESSA, the state defining criteria for the list, and the county looking at differentiated support for these schools, we should all be able to align around a clear and fair definition of quality and invest in our schools to achieve it.
Additional links and data resources:
The budget is on everyone’s mind. So are the teacher contract negotiations. (Or maybe just winter break…) At times lost in the mix of all these serious issues is a central question for all Oakland public schools: Are our students making progress meeting state standards in math and language, the building blocks of learning? Well, here’s a table showing Oakland’s progress on the recently released state SBAC tests from earlier this year on math and ELA (English Language Arts):
Chart comparing Oakland proficiency rates on SBAC ELA and Math compared to statewide proficiency rates.
The answer: Technically, yes. Nevertheless, we’re nowhere we want to be – and we know we can do even better.
Oakland citywide on average is keeping pace with the state’s level of improvement in both ELA and Math. At this rate, however, it’ll take until 2040 for over 75% of students to be proficient in math and ELA.
The Painful Distribution of Proficiency
The slow progress is just an average across the whole city. Average schoolwide proficiency has a painful geographic distribution as well.
Last week, I attended an OUSD school board meeting where parents from The Oakland REACH turned out in full force to demand an “Opportunity Ticket” to get better access to quality schools. I can see where they’re coming from. I plotted schools’ SBAC proficiency on a map. And where I lived in Oakland when I was a kid, it’s surrounded by red dots – public schools where fewer than 35% of students are proficient.
SBAC proficiency rates of schools mapped across Oakland. Color corresponds from dark red to dark green, reflecting range from 0-100% proficiency rate on SBAC math or ELA test, respectively. Click on the photo to view the dashboard.
I’m glad that our city is improving on the whole (slow progress, but nevertheless upward progress. Wooooo!), and I also worry the most about the students in the city who need support and resources most urgently. Oakland Achieves recently conducted an analysis of African American students in 3rd–8th grade and how they did in on the CA School Dashboard (figures below). It’s truly shocking how few African American students are in schools in which students are performing above standard and/or improving. Particularly striking is how African American students are overrepresented in the category “Schools to Review,” which are schools that are scoring low on the SBAC tests and not closing the proficiency gap from year to year (aka falling more behind).
Screenshots from Oakland Achieves report on CA School Dashboard. Comparison of distribution of all students in Oakland vs. focus group on African American students.
So, I wrote this whole post on SBAC results…and SBAC proficiency is only ONE indicator of a school and student’s progress (albeit a very important indicator). Our schools and students are so much more than just a score on a test (though positive progress is always a good sign and performance gaps amongst historically underserved subgroups are never a good sign). We and the state recognize this, hence the multimeasure approach of the CA School Dashboard, which combines a couple of key academic and culture/climate indicator. Good news: CA Dashboard data is out! And the Alameda County Office of Education, which is playing an ever more important role in Oakland public education, has a page dedicated to it with good resources, along with some additional dashboards from OUSD.
Keep an eye out for a post in 2019 as we dig into the results.
Happy end of 2018 everyone! I’m excited to dig into the data with y’all in the year ahead!
As Superintendent Kyla Johnson-Trammell included in her back-to-school welcome message, attendance is super important. Inspired by her call for building positive attendance habits early in our young learners and since September was Attendance Awareness Month, I decided to dive deeper into the topic, specifically chronic absence, to help give context on why it matters so much – for everyone!
What is Chronic Absence?
Chronic absence is another way of looking at attendance by focusing on proportion of kids who missed a significant amount of school days, those who are chronically absent. For the first time, the state has defined how it will collect and calculate chronic absenteeism (see footnote for definition). This data is one of several indicators in the California School Dashboard that attempts to reflect school culture and climate and build toward a more holistic view of school performance.
In 2016-17 (the first year data was collected), Oakland’s citywide overall chronic absenteeism rate was 15.4% of students – that’s over 1 in 7 children across district and charter schools who miss 10% or more of their school days. For comparison, the statewide average is 10.8% of students in 2016-17 and recent analysis by AttendanceWorks puts the nationwide rate at 15.5% during 2015-16 (though they define chronic absence slightly different).
Why it matters:
- For System Leaders: Because a lot of school funding in California is based on “average daily attendance” (ADA), not enrollment, a school loses approximately $85 per day for every student absent. This can add up quickly! For a district or charter with scarce resources and tight budgets (aka almost every school in Oakland), this feels important. To get an estimate of the potential minimum dollars lost, I did a quick back-of-the-envelope calculation. (Assuming 10% of school year = 18 days, 15.4% of Oakland’s 53089 students were chronically absent during attendance tracking period, and $15,337 per pupil funding annually in CA in 2016-17). That adds up to a potential loss of at least $12.6 million citywide! (Some students were absent a lot more than 18 days a year.)
18 days x(15.4% students chronically absent x 53089 students) x $15337 per pupil/180 days per year = $12.6M
- For Students: Students who are behind and chronically absent are missing valuable instruction time – time that is necessary for closing the proficiency gap. When there are huge differences between subgroups, it becomes equitable access issue. To estimate the impact for socioeconomically disadvantaged students (SED), I made assumptions that: the 41.6K SED students citywide receive 6.5 instructional hours per day, attend school 180 days a year, chronically absent students miss at least 18 days (10%) of year, and used the citywide rate of 17.4%. That’s 849K total instructional hours lost in 2016-17. Every 1% citywide reduction in % of SED students who are chronically absent yields 49K extra instructional hours to work on closing the gap! Imagine all the reading or math that can happen in that time!
Chronic absenteeism rates citywide in Oakland by subgroup (CDE 2016-17)
- For School Leaders: Attendance and chronic absenteeism rates can be leading indicators for a healthy school culture. Chronic absence is an early warning sign of academic distress, including school dropout (Oakland Achieves 2016). Unusual rates are symptomatic of other underlying issues and thus should be monitored carefully, acting as bellwethers for a healthy school culture. Some schools like Frick, MLA, and Hoover have been steadily reducing their chronic absence rates, showing consistent improvement not only in the past three years but also historically. They’re also schools with targeted and sustained climate and culture efforts from the school leaders.
Areas of Caution:
- Focus on chronic absence rates beyond just the numbers. There are so many the factors that contribute to students’ chronic absenteeism, a variety inside and out of a family’s control. Health, transportation, family trauma, reactions to the national political climate – all this and more in Oakland. It’s necessary to understand the “whys” behind high rates and know each school site is different.
- Metric not designed to capture change for individual students: Even if a school helps a student reduce the number of missed school days from 60 days annually down to 20, the student would still be considered chronically absent in both years because they’ve crossed the 10% threshold.
- Differing definitions: The California Department of Education definition for chronic absence differs slightly than the federal definition (10% of school days vs. 15 days per school year). Chronic absence is calculated differently at continuation and alternative schools.
Snapshot of OUSD on the interactive map from The Hamilton Project, which displays federally collected chronic absence rates from 2015-16 on national, state, district, and school levels using the federal definition of 15+ days for chronic absence.
- Reporting errors in first year: Not surprisingly, the first year of data collection for chronic absenteeism rates had its hiccups and inaccuracies as folks acclimated. Sites with flagged inaccuracies will have a banner to note this. See OUSD’s page for chronic absenteeism rates for example. (As a point of comparison: if you look at San Francisco’s, it’s much more wildly inaccurate.) Hopefully, data for 2017-18 will be more robust and accurate now that schools and districts have had time to adjust with first round of collection under their belts.
I’m super excited (not surprisingly) about the possibility of updated 2017-18 chronic absence data in CA School Dashboard refresh (update scheduled late winter/early spring). In theory, chronic absence rates could be leading indicators, a bellwether to making sure students are getting the instructional hours they need, and we would have insight into how Oakland schools are progressing compared to statewide benchmark.
For those interested in learning more about chronic absence and ways to address it, I recommend checking out AttendanceWorks, a nonprofit dedicated to reducing chronic absence to advance student success, or OUSD’s Attendance webpage. Data geeks will appreciate the interactive map recently released by AttendanceWorks and The Hamilton Project at Brookings Institution on 2015-16 federal chronic absence data, allowing users to dig deeper into subgroup trends.
Footnotes: Definition: The California Ed Code defines a student as a chronic absentee if ”a pupil who is absent on 10 percent or more of the school days in the school year when the total number of days a pupil is absent is divided by the total number of days the pupil is enrolled and school was actually taught in the regular day schools of the district, exclusive of Saturdays and Sundays.”
According to the latest data, racial disparities in school discipline persist across the country. In April, the Government Accountability Office (GAO) released a report on national discipline trends and the Office on Civil Rights released its latest biennial data collection on school climate and safety. Both confirm that African Americans, boys, and students with disabilities are significantly overrepresented when it comes to being disciplined via suspension, expulsion, and other means.
Suspension rates alone are an inadequate indicator of school climate and mask the full extent of the problem. Some schools artificially lower their numbers by not reporting in-school suspensions. Also, schools can take other disciplinary actions on-site, formal and informal (e.g., office referrals) that can negatively affect students. So this data, which is self-reported by schools and districts, is only a part of the picture.
Why talk about school discipline?
- Students of color are affected in every setting. Rich or poor, charter or district – it doesn’t matter. One of the key findings of the GAO report was that disparities in discipline rates between races persisted across income levels, type of public school attended, and type of disciplinary action.
- Reducing suspensions matters. A lot. We need to reduce unnecessary suspensions as a step towards stopping school-to-prison pipelines. Some students, particularly those with disabilities or high-need backgrounds, who experience out-of-school suspensions and expulsions may benefit more from additional educational and counseling services (i.e. restorative justice circles) rather than isolation and exclusion.
- It’s a civil rights issue. When students of color and those with disabilities are disproportionately suspended and expelled (sometimes for the same infractions as white or affluent students), it’s a sign that implicit biases may be affecting discipline decisions.
How is Oakland doing?
Many of our schools have been purposefully changing their discipline policies and implementing restorative justice and other similar practices. In the spirit of celebrating those locally who made strides in reducing suspension rates (shout-out to Oakland for beating the national rate!), let’s look at some highlights.
- Some progress in most recent data despite citywide status quo: The average citywide suspension rate remained the same from 2015-16 to 2016-17 at 4.2%. Below are some schools across Oakland who reduced their suspension rates in a year with no citywide trend change.
- Trend of improvement across the board for past six years: Compared to district rates in 2011-12 (the last year that’s conveniently available on Dataquest), there has been a decrease in suspension rates across all racial groups (see graph). I’m personally excited to see all those lines with downward trends (aka decreasing suspension rates, which is a good thing); for me, it means that school leaders have been focused on ending the school-to-prison pipeline in Oakland over the past few years. OUSD deserves applause for its vanguard work and widespread adoption of restorative justice, which involves shifting mindsets as well as changing disciplinary practices.
- Closing the gap for African American students: The line above with the sharpest decrease is for African American students – which is great news given how high the rate was back in 2011-12 (13.8%). Schools across Oakland have reduced the suspension rate of African American students by over 5.2 percentage points, surpassing the average 3.4 percentage point decrease – necessary to eventually eliminate disproportionality.
We must continue this progress!
- Oakland is still higher than the state average: From 2011-12 to 2016-17 (coincidentally the years the Obama administration issued guidance for disproportionate rates of discipline), Oakland improved at quicker rate than the state at reducing suspension rates (Oakland: 7.6% to 4.2%; State: 5.7% to 3.6%). However, our citywide suspension rate still remains higher than statewide (4.2% vs 3.6%). To put into context, 4.2% of students translate to approximately 2,300 Oakland students who received at least one suspension in 2016-17.
- And we see disparities like those in state and national data: During 2016-17, African American students (8.6%), students with disabilities (9.2%), homeless students (8.8%), and foster students (12.2%) were more than twice as likely to be suspended than the average student (4.2%). These trends reflect statewide disparities in suspension rates. Groups nationally are digging deeper into causes behind the disparities to identify opportunity areas for improvement.
- So we must pick up the pace to continue historical progress: From 2015-16 to 2016-17, most subgroups in Oakland did not see a significant decrease (>2%) in average suspension rates, with notable exceptions for foster and homeless students. Some subgroups saw increases in suspension rates from 15-16 to 16-17, like students with disabilities (9.2% in 16-17, +0.6% increase).
- Especially since it is now part of the State Dashboard: Last spring, the State decided to incorporate suspension rates into its accountability system, the new CA School Dashboard. This multi-measure approach adds an indicator of school climate in addition to measuring academic performance via test scores. Theoretically, this will make it easier for parents to consider this aspect of their students’ experience, creating further pressure for districts and schools to improve.
Suspension rate = Unduplicated Count of Students Suspended divided by the Cumulative Enrollment at a single site for an academic year
CA School Dashboard data for Suspension, Fall 2017 update
Civil Rights Data Collection (CRDC) for the 2015-16 School Year