When we think of injustice, we often imagine dramatic scenes—protests, scandals, or high-profile trials. But what happens when injustice arrives quietly, cloaked in the guise of efficiency? This is the story of Gothenburg’s school allocation algorithm, a tale that, in my opinion, reveals far more about our digital age than we might initially realize. Let me take you through it, not just as an analyst, but as someone who lived it—as a researcher, a lawyer, and a mother.
The Quiet Arrival of Injustice
In 2020, Gothenburg introduced an algorithm to streamline school placements. On paper, it sounded brilliant: a neutral, efficient system to handle the logistical nightmare of assigning thousands of children to schools. But what makes this particularly fascinating is how quickly it unraveled. Hundreds of children were assigned to schools miles away, across rivers and highways, in neighborhoods they’d never even heard of. My own 12-year-old son was one of them. What many people don’t realize is that this wasn’t just a matter of inconvenience—it was a systemic failure. The algorithm calculated distances ‘as the crow flies,’ ignoring the very real barriers of rivers and roads. A detail that I find especially interesting is how the city administration responded: with bureaucratic indifference. ‘Appeal if you’re unhappy,’ they said, as if this were a matter of personal preference rather than a glaring error.
The Domino Effect of Algorithmic Failure
Here’s where it gets truly troubling. Algorithms don’t make isolated decisions; they create systems of decisions. When one child is wrongly placed, it sets off a chain reaction. That child takes a spot meant for another, who is then displaced, and so on. If you take a step back and think about it, this isn’t just about individual injustice—it’s about a system that amplifies errors. By the time you reach the fifth or sixth displacement, the original mistake is nearly impossible to trace. This raises a deeper question: how do you hold a system accountable when its failures are so diffuse?
The Black Box Problem
I decided to take the city to court, not to challenge my son’s placement, but to question the legality of the entire system. What this really suggests is that algorithmic accountability isn’t just a technical issue—it’s a legal and ethical one. The city’s defense was astonishingly simple: they claimed the algorithm was just a ‘support tool,’ and provided no evidence to back it up. No code, no documentation, nothing. And here’s the kicker: the court sided with them. The burden of proof was on me, the plaintiff, to demonstrate the system’s unlawfulness. In my opinion, this is where the system truly failed. How can you prove what’s inside a black box when you’re not even allowed to open it?
Broader Implications: When Technology Outpaces Justice
This isn’t just a Gothenburg problem. It’s a global one. The Post Office scandal in the UK and the childcare benefits scandal in the Netherlands are stark reminders of what happens when algorithms go unchecked. What makes these cases so alarming is how long the injustices persisted—years, in some cases—because the systems were treated as infallible. From my perspective, this highlights a dangerous trend: our legal systems are woefully unprepared to handle algorithmic failures. Courts defer to technology, and citizens are left to navigate a maze of appeals without access to the very systems that wronged them.
The Way Forward: Opening the Black Box
Personally, I think the solution lies in shifting the burden of proof. If a system causes harm, those who designed and deployed it should be the ones to prove its fairness and legality. We need procedural rules that account for the realities of digital decision-making. Until then, we’ll continue to stumble from scandal to scandal. One thing that immediately stands out is how much work remains to be done. We’re not just fighting algorithms; we’re fighting a mindset that prioritizes efficiency over accountability.
Final Thoughts
As I reflect on this experience, what strikes me most is the silence in which algorithmic injustice operates. It’s not loud; it’s not dramatic. It’s a quiet erosion of trust, a slow unraveling of fairness. But if there’s one thing I’ve learned, it’s that silence can be broken. We need to demand transparency, not just from algorithms, but from the institutions that wield them. Because when injustice is delivered by code, accountability must answer at full volume.
