The Unseen Consequences of War by Algorithm

The recent use of AI-powered systems in modern warfare has raised disturbing questions about the role of artificial intelligence in combat. On February 28, the Maven Smart System helped strike over 1,000 targets, including an Iranian primary school where more than 150 people were killed, most of them children. The Pentagon’s investigation into the attack remains stalled, with senators demanding answers and reports suggesting that outdated satellite intelligence was to blame.

The integration of AI in militaries is accelerating rapidly, with global military expenditure rising 2.9 percent last year to $2.87 trillion. Within this figure, spending on AI for military applications is projected to grow from $11.7 billion to nearly $19.3 billion by 2030. The US Pentagon has set its sights on becoming an “AI-first fighting force,” pushing the boundaries of speed and adaptability through decision-making models like the OODA loop.

The Maven Smart System uses machine learning to analyze vast amounts of data from over 150 resources, including satellites, commercial radar constellations, drone videos, signals intelligence, and social media geolocation. Its digital pipeline is modelled on the military kill chain sequence of find, fix, track, target, engage, assess (F2T2EA), with an AI recommender proposing weapons and munitions based on proximity and suitability.

However, this reliance on AI raises fundamental questions about accountability and moral responsibility in warfare. As machines take on increasingly complex tasks, who is ultimately responsible for the consequences of their actions? The US Department of Defense insists that no AI weapons will be fully autonomous, and they will always require human authorization.

The use of Maven in Operation Epic Fury has highlighted the limitations of relying on outdated intelligence. The system’s reliance on data from over 150 resources creates a digital paper trail that can justify decisions made by machines, rather than humans. But what about the consequences of these decisions? How do we ensure that machines are making moral judgments in the heat of battle?

Algorithmic pattern recognition has been used in drone wars since the 2000s and 2010s to flag individuals whose behavior matched a suspicious profile, feeding computationally generated kill lists. However, the use of AI in modern warfare raises unique challenges for accountability and moral responsibility.

As we continue down this path, it is essential that we have a nuanced understanding of the implications of using machines to make life-or-death decisions. We need to consider not just the technical capabilities of these systems but also their moral and societal consequences. The use of Maven in the US-Israel war on Iran serves as a stark reminder of the dangers of unchecked technological progress in warfare.

The next few years will be crucial in determining whether AI can truly replace human decision-makers in warfare. As militaries around the world continue to invest heavily in AI technology, we must ensure that these systems are designed with accountability and transparency at their core. Anything less would be a dereliction of our duty to protect human life and dignity.

The consequences of our actions will be far-reaching, shaping not just the course of modern warfare but also our understanding of what it means to make moral decisions in the heat of battle. It is time for policymakers, technologists, and citizens to come together to address these pressing questions and ensure that machines are serving humanity, rather than the other way around.