Can AI-Powered Killer Drones Develop a Moral Compass?
The Future of Warfare: AI-Powered Drones
Should the AI-powered drones of the future have a licence to kill? The question is becoming ever more pressing as governments and the defence industry acknowledge that drone systems will play an increasingly crucial role in future warfare.
The Moral Dilemma of Autonomous Weapons
With drones being deployed in huge numbers in the Ukraine war and AI being used to assist bombing missions in the Iran conflict, there is an expectation among some observers that weapons will have to operate with increased operational autonomy, which means they will need something approximating a moral framework.
Expert Opinions on AI and Morality
Last year Mustafa Suleyman, chief executive of Microsoft’s AI arm and a co-founder of the UK-based DeepMind, was unequivocal about the issue of machines making moral decisions. He said: “AIs cannot be people – or moral beings.”
- David Omand, the former head of the UK spy agency, GCHQ, believes AI can create a “moral” configuration for unmanned weapons.
- The UK armed forces minister, Al Carns, told the Financial Times recently there must be an option to “take the human out of the loop” in decision-making.
The Challenges of Programming Morality
Zee Talat, an academic specialising in machine learning at the University of Edinburgh’s school of informatics, argues that large language models – the technology that underpins modern generative AI systems such as chatbots – are fundamentally incapable of moral decision-making.
“If you have a machine that’s probabilistic by nature it will veer towards the most likely answer in a situation. Do we think that morality follows probabilistic notions?”
The Debate on Autonomous Weapons Governance
Jessica Dorsey, an assistant professor of international law at Utrecht University in the Netherlands, raises concerns about determining whose morality the drone is following, given the United Nations is still trying to achieve a global consensus on autonomous weapons governance.
“War is filled with so many variables and it is a given that things will go wrong. And when that happens at AI-like speed, it is difficult to unravel.”
The Future of AI-Powered Drones
Some experts argue that giving drones greater autonomy, and programming rules of engagement and morality into them, will be a necessity if other nation states continue to develop and deploy similar technology at pace.
- Nicholas Wright, a neuroscientist and author of Warhead, a book on the human brain and war, says: “For any military to compete effectively against other high-end militaries it is going to need a large amount of systems that will be required to take decisions on their own.”
- Olaf Hichwa, the co-founder of Neros, a US drone startup, believes that drones will not replace human decision-makers, but enhance the abilities of their human pilots.