In the United States today, predictive algorithms, a particular form of artificial intelligence (AI), permeate all segments of society, including the criminal justice system. With the help of AI, judg...

<div class="row"> <div class="col-md-1"> <div class="social-share-icons vertical"> <!--p class="social-share-title">Share</p --> <ul class="social-share-list"> <li> <!-- Facebook --> <a href="https://www.facebook.com/sharer.php?u=https://www.investigativejournalismforeu.net/projects/decision-machines" onclick="window.open('http://www.facebook.com/sharer.php?u=https://www.investigativejournalismforeu.net/projects/decision-machines','popup','width=600,height=600'); return false;" target="popup"> <img alt="" class="lazy" data-src="https://www.investigativejournalismforeu.net/wp-content/themes/ij4eu-theme/assets/img/icon-facebook.svg" src="data:image/svg+xml,%3Csvg%20xmlns='http://www.w3.org/2000/svg'%20viewBox='0%200%201%201'%3E%3C/svg%3E"/> </a> </li> <li> <!-- Twitter --> <a href="https://twitter.com/share?url=https://www.investigativejournalismforeu.net/projects/decision-machines" onclick="window.open('http://twitter.com/share?url=https://www.investigativejournalismforeu.net/projects/decision-machines','popup','width=600,height=600'); return false;" target="popup"> <img alt="" class="lazy" data-src="https://www.investigativejournalismforeu.net/wp-content/themes/ij4eu-theme/assets/img/icon-twitter.svg" src="data:image/svg+xml,%3Csvg%20xmlns='http://www.w3.org/2000/svg'%20viewBox='0%200%201%201'%3E%3C/svg%3E"/> </a> </li> <li> <!-- LinkedIn --> <a href="http://www.linkedin.com/shareArticle?mini=true&amp;url=https://www.investigativejournalismforeu.net/projects/decision-machines" onclick="window.open('http://www.linkedin.com/shareArticle?mini=true&amp;url=https://www.investigativejournalismforeu.net/projects/decision-machines','popup','width=600,height=600'); return false;" target="popup"> <img alt="" class="lazy" data-src="https://www.investigativejournalismforeu.net/wp-content/themes/ij4eu-theme/assets/img/icon-linkedin.svg" src="data:image/svg+xml,%3Csvg%20xmlns='http://www.w3.org/2000/svg'%20viewBox='0%200%201%201'%3E%3C/svg%3E"/> </a> </li> </ul> </div> </div> <div class="col-md-11"> <p>European governments strongly believe in data-driven solutions for law enforcement and the prevention of crime. This is also visible in the new Artificial Intelligence Act, an attempt to reign in the harms of the fledgling technology, which is watered down to ensure leniency for the use of AI by law enforcement agencies.</p> <p>This investigation in the Netherlands, Italy and Spain shows that while governments believe that AI systems are by definition efficient, objective and fair, they can be deeply flawed. All the while, they have a profound impact on the lives of European citizens, without them knowing it.</p> <p>Algorithmic risk assessments often process large amounts of sensitive data on people. This can include data like nationality, gender and age, but also postcodes, job competencies and even sensitive medical data. The risk of bias and discrimination is high.</p> <p>In the Netherlands, the investigation revealed that authorities deploy a predictive algorithm that attempts to predict youth recidivism on a massive scale. The system, based on 10 variables that also factor in whether a minor has been a witness to or victim of a crime, influences the chances of a criminal record for underaged suspects. But statistical analysis of the algorithm shows it has a low predictive value, resulting in many false positives. Regardless of its impact, the government did not inform the minor, their parents or lawyer of the use of the scoring device.</p> <p><iframe allowfullscreen="allowfullscreen" frameborder="0" height="849" src="https://www.youtube.com/embed/pyJhnUkObs0" title="'Algoritme bestempelt jongeren als crimineel'" width="478"></iframe></p> <p>Reporting in Italy revealed the extent to which Italian police forces use predictive policing systems, delving into the story of KeyCime. This company developed software called DELIA that has been used by Milan Police Headquarters since 2008. Although KeyCrime claimed that DELIA complied with the AI Act’s standards, delays in obtaining EU approval hindered the company’s ability to operate and generate revenue, causing its liquidation. Despite the proven failure, this experience has sparked interest from the Italian government to use new predictive tools in this field.</p> <p>Meanwhile in Spain, this project revealed the inner workings of the RisCanvi algorithm, software used in prisons in the Catalonia region to predict which inmates will reoffend. The evaluation of this automated system has a direct impact on the rights of inmates and decisions made by officials, especially in the final phase of sentences, a key moment in prisoners’ social rehabilitation process. Despite this, opacity continues to surround this and other predictive tools used by the Spanish public sector.</p> <p>This investigation is the result of the work of three journalists over more than a year, during which they have had to fight against the profound lack of transparency that continues to surround the automation of public decisions in Europe. The revelations underline the need to continue investigating and explaining the worrying implications of the current transformation of European governments.</p> <div class="social-share-icons box"> <div class="social-box-content"><h4 class="social-box-title">Interesting article?</h4> <div class="textwidget"><p>If you think your colleagues and friends should know about this article, we encourage you to share it on your social networks!</p> </div> </div> <!--p class="social-share-title">Share</p --> <ul class="social-share-list"> <li> <!-- Facebook --> <a href="https://www.facebook.com/sharer.php?u=https://www.investigativejournalismforeu.net/projects/decision-machines" onclick="window.open('http://www.facebook.com/sharer.php?u=https://www.investigativejournalismforeu.net/projects/decision-machines','popup','width=600,height=600'); return false;" target="popup"> <img alt="" class="lazy" data-src="https://www.investigativejournalismforeu.net/wp-content/themes/ij4eu-theme/assets/img/icon-facebook.svg" src="data:image/svg+xml,%3Csvg%20xmlns='http://www.w3.org/2000/svg'%20viewBox='0%200%201%201'%3E%3C/svg%3E"/> </a> </li> <li> <!-- Twitter --> <a href="https://twitter.com/share?url=https://www.investigativejournalismforeu.net/projects/decision-machines" onclick="window.open('http://twitter.com/share?url=https://www.investigativejournalismforeu.net/projects/decision-machines','popup','width=600,height=600'); return false;" target="popup"> <img alt="" class="lazy" data-src="https://www.investigativejournalismforeu.net/wp-content/themes/ij4eu-theme/assets/img/icon-twitter.svg" src="data:image/svg+xml,%3Csvg%20xmlns='http://www.w3.org/2000/svg'%20viewBox='0%200%201%201'%3E%3C/svg%3E"/> </a> </li> <li> <!-- LinkedIn --> <a href="http://www.linkedin.com/shareArticle?mini=true&amp;url=https://www.investigativejournalismforeu.net/projects/decision-machines" onclick="window.open('http://www.linkedin.com/shareArticle?mini=true&amp;url=https://www.investigativejournalismforeu.net/projects/decision-machines','popup','width=600,height=600'); return false;" target="popup"> <img alt="" class="lazy" data-src="https://www.investigativejournalismforeu.net/wp-content/themes/ij4eu-theme/assets/img/icon-linkedin.svg" src="data:image/svg+xml,%3Csvg%20xmlns='http://www.w3.org/2000/svg'%20viewBox='0%200%201%201'%3E%3C/svg%3E"/> </a> </li> </ul> </div> <input id="project_id" name="project_id" type="hidden" value="7032"/> <div id="regions_div" style="width: 650px; height: 400px;"></div> <section class="published-stories"> <h2 class="stories__title">Published stories</h2> <div class="published-stories__group"> <h4 class="stories-group__title">English</h4> <ul class="published-stories__list"> <a href="https://algorithmwatch.org/en/predictive-policing-pioneer-keycrime/" target="_blank"><li><span class="story__title">The Rise and Fall of a Predictive Policing Pioneer</span> <span class="story-publication">( Algorithm Watch; Nov. 7, 2024 )</span></li></a> </ul> </div> <div class="published-stories__group"> <h4 class="stories-group__title">Dutch</h4> <ul class="published-stories__list"> <a href="https://www.ftm.nl/artikelen/wet-gegevensverwerking-schaadt-privacy" target="_blank"><li><span class="story__title">Met nieuwe datawet wroet de overheid nog dieper in het privéleven </span> <span class="story-publication">( Follow the Money; June 10, 2024 )</span></li></a> <a href="https://www.ftm.nl/artikelen/algoritme-bestempelt-jongeren-onterecht-als-toekomstig-crimineel" target="_blank"><li><span class="story__title">Onbetrouwbaar algoritme bestempelt jongeren als toekomstig crimineel</span> <span class="story-publication">( Follow the Money; Jan. 20, 2025 )</span></li></a> </ul> </div> <div class="published-stories__group"> <h4 class="stories-group__title">Spanish</h4> <ul class="published-stories__list"> <a href="https://www.elconfidencial.com/tecnologia/2024-04-24/riscanvi-algoritmo-cataluna-prisiones-presos-inteligencia-artificial_3871170/" target="_blank"><li><span class="story__title">- Un algoritmo define el futuro de los presos en Cataluña: ahora sabemos cómo funcional </span> <span class="story-publication">( El Confidencial; Apr. 24, 2024 )</span></li></a> </ul> </div> </section> </div> </div>

After deploying AI tools in Israel and on the U.S. border, American tech companies are now powering domestic repression.

How predictive policing tools worsen inequality by targeting marginalized communities through biased data and opaque algorithms.

Even city council members don’t know about the program.

Exclusive: Algorithms allegedly being used to study data of thousands of people, in project critics say is ‘chilling and dystopian’

A software company sold a New Jersey police department an algorithm that was right less than 1% of the time

Subscription and open access journals from Sage, the world's leading independent academic publisher.