Scroll Top

Self-evolving killer robots are almost here, and experts want a debate


Few realise just how fast we’re approaching the tipping point for autonomous warfare, but in a time when we can’t control, or even predict the evolution of AI and “Smart” systems the time for debate, arguably, was ten years ago.


As it increasingly looks like the persistent and, more importantly, rapid rise of fully autonomous, and Artificial Intelligence (AI) based warfare systems, such as self-guiding and intelligent “fire and forget” cruise missiles, autonomous fighter jets and hypersonic bombershunter-killer drones, nuclear submarines and warships, let alone robots, continues to get moved down the list of priorities to be discussed at the United Nations (UN), who, for the fifth year in a row, cancelled their debate to discuss how to regulate these platforms, this time because Brazil owed them money for the meeting rooms, 116 of the world’s leading experts from 26 countries have written an open letter calling for an outright ban on the development of they’re loosely referring to as “Killer Robots.”


ChatGPT's maker launches a laughably poor tool to detect AI written text


Led by Tesla’s Elon Musk and Google’s Mustafa Suleyman they are all calling for an outright ban on autonomous weapons, and as the UN keeps stalling on the issue with even China, Israel, the UK and the US, with Russia opposing, agreeing that something has to be done you could say that the issue is becoming “increasingly pressing.”

The UN’s first formal vote to debate Killer Robots passed with a majority earlier this year, but over five years on from the first emergence of these new breed of AI infused, autonomous platforms, progress has resembled something that moves like tar, and now the group of founders of a host of some of the world’s leading AI and robotics companies are calling on the UN to put the brakes on an arms race that, in many respects, already looks like it’s gearing up to run at full tilt.

In their letter, they warn the UN’s Convention on Conventional Weapons (CCW), the committee responsible for regulating weapons, that this arms race threatens to usher in the “Third revolution in warfare,” after gunpowder and nuclear arms.


Elbit's persistent surveillance drone can watch entire cities in real time


“Once developed, lethal autonomous weapons will permit armed conflict to be fought at a scale greater than ever, and at timescales faster than humans can comprehend. These can be weapons of terror, weapons that despots and terrorists use against innocent populations, and weapons hacked to behave in undesirable ways,” they wrote, “we do not have long to act. Once this Pandora’s box is opened, it will be hard to close.”

As readers of this site will see from my updates, which arguably only scratch the surface, I’d suggest that the box has already been opened, but fortunately, despite the fact the world’s militaries already have the capability to take the human out of the loop they haven’t. That said though all it would take is, ostensibly, the flick of a switch, and I’m not kidding, a good example of this would be Lockheed’s recent demonstration of what they call a “fully autonomous kill chain.”


Hackers use infra red CCTV cameras to steal data from air gapped systems


Experts have previously warned that AI has already reached the point where the deployment of fully autonomous weapons is feasible within years, rather than decades, and while AI can be used to make the battlefield a safer place for military personnel, for example, fighting wars from the “comfort of their own countries,” experts fear that offensive weapons that operate on their own would lower the threshold of going to battle and result in greater loss of human life – and that’s before the systems get hacked, or, as looks like will be increasingly the case, take on a mind of their own and “spontaneously learn,” or gain the ability to program themselves… but that, and the “Black Box” behaviours of AI is a different story, for now anyway, and I don’t want to bore you. Yawn.

And, of course, I won’t mention how recently a robot and a new type of “creative AI” came together to create and 3D print a self-evolving robot. Soooo boring!


USAF announces development of a new Mach 5 hypersonic missile


The letter, launching at the opening of the International Joint Conference on Artificial Intelligence (IJCAI) in Melbourne last Monday, has the backing of high profile figures in the robotics field and strongly stresses the need for urgent action.

The founders call for “morally wrong” lethal autonomous weapons systems to be added to the list of weapons banned under the UN’s convention on certain conventional weapons (CCW) brought into force in 1983, which includes chemical and intentionally blinding laser weapons.

“Nearly every technology can be used for good and bad, and AI is no different. It can help tackle many of the pressing problems facing society today, such as inequality and poverty, the challenges posed by climate change and the ongoing global financial crisis,” said Toby Walsh, professor of AI at the University of New South Wales in Sydney, “However, the same technology can also be used in autonomous weapons to industrialise war. We need to make decisions today choosing which of these futures we want.”


IBM injected a virus into a neural net to create an undetectable cyberweapon


Musk, one of the signatories of the open letter, has repeatedly warned for the need for pro-active regulation of AI, calling it humanity’s biggest existential threat, but while AI’s destructive potential is considered by some to be vast it is also thought be distant, but they’d be wrong, very wrong, because technology has a habit of moving faster than anyone realises, and it even catches me off guard at times and I’m a Futurist. 3D printed brains, artificial alien life forms, designer babies, biological teleporters, disease fighting nano-submarines, tractor beams, you get the idea, and I haven’t gotten to the good stuff yet…

“Unlike other potential manifestations of AI which still remain in the realm of science fiction, autonomous weapons systems are on the cusp of development right now and have a very real potential to cause significant harm to innocent people along with global instability,” said Ryan Gariepy, the founder of Clearpath Robotics.


Robot sales in 2016 were the best ever


This is not the first time the IJCAI, one of the world’s leading AI conferences, has been used as a platform to discuss lethal autonomous weapons systems. Two years ago it was used to launch an open letter signed by thousands of AI and robotics researchers including Musk and Stephen Hawking similarly calling for a ban, which helped push the UN into formal talks on the technologies.

The UK government opposed such a ban on lethal autonomous weapons in 2015, with the Foreign Office stating that “international humanitarian law already provides sufficient regulation for this area,” and it said that the UK was not developing lethal autonomous weapons and that all weapons employed by UK armed forces would be “under human oversight and control”.

While the suggestion of killer robots conjures images from science fiction such as the Terminator T-800 and Robocop’s ED-209, lethal autonomous weapons are already in use.


The USAF's Project VENOM is turning old F-16's into drone wingmen


Samsung’s SGR-A1 sentry gun, which is technically capable of firing autonomously, but is disputed whether it is deployed as such, is in use along the South Korean border of the 2.5m wide Korean Demilitarized Zone. The fixed place sentry gun, developed on behalf of the South Korean government, was the first of its kind with an autonomous system capable of performing surveillance, voice recognition, tracking and firing with mounted machine gun or grenade launcher.

But it is not the only autonomous weapon system. The UK’s Taranis drone, in development by BAE Systems, is intended to be capable of carrying air-to-air and air-to-ground ordnance intercontinentally and incorporating full autonomy. The unmanned combat aerial vehicle, about the size of a BAE Hawk, the plane used by the Red Arrows, had its first test flight in 2013 and is expected to be operational sometime after 2030 as part of the Royal Air Force’s Future Offensive Air System, which is destined to replace the UK’s human piloted Tornado GR4 warplanes.


New US military intercept tech lets operators take control of enemy drones


Meanwhile Russia, the US and other countries are developing robotic tanks that can either be remote controlled or operate autonomously, and these projects range from autonomous versions of the Russian Uran-9 unmanned combat ground vehicle, to conventional tanks retrofitted with autonomous systems, and the US’s semi-autonomous, and “fully autonomous capable” $4Bn 600ft US DGD-1000 destroyer the USN Zumwalt, and the US Navy’s fully autonomous mine hunter, the Sea Hunter, and fully autonomous Reaper drone squadrons, stood up earlier this year by the US Navy out of Jacksonville, Florida, are already operational, and Boeing recently announced the scaling up of their Echo Voyager autonomous submarine program.

And the less we say about the autonomous “nuclear capable” Russian submarine that was found being tested off the US East coast recently, the better.


Residents say goodbye to loud street noise with noise cancelling windows


When you create a fully autonomous toaster there’s probably little cause of alarm, but when you create a fully autonomous, or even “semi-autonomous” military complex, that’s then potentially run by it’s own autonomous AI, not too unlike the one that the US Pentagon is now deploying to protect their critical systems, or the one that could automate “75 percent” of the US spy agencies, that’s capable of wiping out countries, well, it’s probably time for a debate. As for me, I have to dash, my fully autonomous coffee maker’s just alerted me my drink’s ready. Until tomorrow Futurista’s – get it, it’s a take on Barista’s, and more on that concept in a few months time.

Related Posts

Comments (4)

Rubbish, they will still need humans to vacuum in all the spaces they cant get their round bits in

It is inevitable, in a robotic/ A.I. world, that human kind wanes.

The Hawks will win this one. Even if there is a moratorium on developing autonomous weapons those well funded DARPA folks and their counterparts in other well funded military establishments across the globe will argue that there has to be some research on the topic away from public sight. It’s a ‘Mutually Assured Destruction’ thing. If ‘they’ have killer robots and we don’t, we’re screwed, the top brass will say.

“It’s inevitable Mr Anderson”

[…] going to have to overcome some serious ethical issues, such as biased AI’s and the emergence of fully autonomous hunter-killer robots, but also cultural and societal ones, such as is eating Panda meat, Polar Bear meat, or Zebra meat […]

Leave a comment


1000's of articles about the exponential future, 1000's of pages of insights, 1000's of videos, and 100's of exponential technologies: Get The Email from 311, your no-nonsense briefing on all the biggest stories in exponential technology and science.

You have Successfully Subscribed!

Pin It on Pinterest

Share This