286 Just ordinAry robots
to choose their own targets and to decide whom to kill. We are con-
vinced that their deployment will lead to an increase in civil war vic-
tims, something which nations are under a legal obligation to avoid.
Personally, I think we should take a wider view of the eects of
autonomous weapon systems, as to my mind they will increase the
likelihood of war. Just imagine two eets of these weapon systems
facing each other across a national border or somewhere on the high
seas. ey may easily misinterpret some small event—a ash of light,
an unexpected noise—as an attack and automatically open re. Such
hair-trigger systems could easily set o hostilities that neither party
has an interest in or a wish for. Moreover, autonomous arms would
lower the threshold for the use of international violence, given that the
attacking side would expect few victims among its soldier. In recent
years, remote-controlled armed drones—which are semi-autonomous
systems—have given us a foretaste of that.”
It has been argued that, quite on the contrary, autonomous arms may make
morally superior decisions, reducing rather than increasing numbers of casu-
alties among civilians. Unlike human soldiers, they always stay rational
and do not run amok under stress.
“I can’t rule that out once and for all, but in the foreseeable future,
let’s say for the next 20 to 40 years, that’s extremely unlikely.
Roboticist Ronald Arkin at Georgia Tech is working on software
that will decide, on the basis of simple if-then conditions, whether
an attack is justied or not. But it will be unable to adequately
interpret complex battleeld situations, perhaps with civilians
nearby, and then make ethically correct decisions. It simply can’t
be done without an understanding of the social context, without
having emotional experience, knowledge of local cultural context,
and so on. It’s a very tall order to recreate these articially. I fear
that, without an international ban, military motives might well
lead to the introduction of autonomous systems way before such
conditions are met.”
What have ICRAC and the Campaign to Stop Killer Robots achieved so far?
“e issue has been taken up very well not only by public opinion,
but also by the United Nations. In 2013, many countries raised the
issue in the General Assembly and the UN Special Rapporteur on