Breaking AI & Tech News Analyzed

The 'Crow Flies' Error in GothenburgIn 2020, the city of Gothenburg introduced an algorithm to manage school admissions, aiming for efficiency and objectivity. However, the system was fundamentally flawed. It calculated distances 'as the crow flies' rather than actual walking routes, ignoring geographical barriers like the major river running through the city. This technical oversight meant that children were assigned to schools miles away, often requiring impossible commutes across highways or fjords.Systemic Displacement of 700 ChildrenThe impact of this error was not isolated but systemic. The algorithm's flawed logic created a domino effect, displacing children from their intended schools and pushing others further away. This resulted in approximately 700 children spending their entire junior high years in schools far from their homes and communities. The official response was dismissive, treating the issue as a matter of individual appeal rather than a systemic malfunction.The Legal Black Box: Why Courts FailedRecognizing that individual appeals could not fix a broken system, Charlotta Kronblad sued the city to challenge the legality of the entire decision-making process. However, the court placed the burden of proof on the plaintiff. Without access to the algorithm's code or documentation, Kronblad could not demonstrate the system's inner workings. The city offered no evidence of its own, yet the court dismissed the case, ruling that the burden of proof lay with the citizen to uncover the 'black box' of the algorithm.The Future of Algorithmic AccountabilityThis case mirrors broader scandals, such as the UK's Post Office Horizon scandal and the Dutch childcare benefits scandal, where automated systems operated behind a veil of complexity. The outcome highlights a critical vulnerability in our legal infrastructure: when courts defer to technology without the tools to interrogate it, injustice prevails. To prevent future scandals, legal frameworks must adapt to the digital age by mandating the disclosure of algorithmic code and shifting the burden of proof to the system designers.

China has emerged as a leader in global AI governance, contrasting with the US, which is pursuing AI development in a 'wild west' manner, according to Prof Dame Wendy Hall, a former UN and UK government adviser. Hall told the House of Commons business and trade committee that China is backing multinational attempts to introduce global governance of AI, while the US has set up a race between profit-hungry companies that rely on hype.Hall, who is director of the Web Science Institute at the University of Southampton, said Chinese AI researchers are efficient, innovative, and willing to release their models on an open-source basis. However, she noted that it has become increasingly difficult for UK experts to collaborate with China on research, limiting her academic freedom.The UK's reliance on US tech companies, including Google, Microsoft, OpenAI, and Amazon, risks a repeat of the Post Office Horizon scandal, warned Neil Lawrence, Cambridge University's DeepMind professor of machine learning. He expressed concerns that the UK is outsourcing AI model development to private billionaires with zero loyalty to the British state and consumer.Hall and Lawrence also highlighted that promises from US-backed tech companies may not be delivered as planned. For example, OpenAI has put a UK datacentre project on hold, and a government plan to open a large UK sovereign AI datacentre is behind schedule.The tech industry has identified a lack of power as a key problem, with Microsoft saying a planned datacentre in the north of England will not come online until at least 2033 due to a shortage of power from the grid.