Artificial Intelligence Computational Modelling and Criminal Proceedings A Framework For A European Legal Discussion Serena Quattrocolo PDF Download
Artificial Intelligence Computational Modelling and Criminal Proceedings A Framework For A European Legal Discussion Serena Quattrocolo PDF Download
https://textbookfull.com/product/artificial-intelligence-computational-modelling-and-criminal-
proceedings-a-framework-for-a-european-legal-discussion-serena-quattrocolo/
DOWNLOAD EBOOK
Artificial Intelligence Computational Modelling and Criminal
Proceedings A Framework for A European Legal Discussion
Serena Quattrocolo pdf download
Available Formats
Serena Quattrocolo
Artificial
Intelligence,
Computational
Modelling and
Criminal Proceedings
A Framework for A European Legal
Discussion
Legal Studies in International, European
and Comparative Criminal Law
Volume 4
Editor-in-Chief
Stefano Ruggeri
Department of Law, University of Messina, Messina, Italy
Artificial Intelligence,
Computational Modelling
and Criminal Proceedings
A Framework for A European Legal
Discussion
Serena Quattrocolo
Department of Law, Politics, Economics and Social Science
University of Eastern Piedmont
Alessandria, Italy
© The Editor(s) (if applicable) and The Author(s), under exclusive licence to Springer Nature
Switzerland AG 2020
This work is subject to copyright. All rights are solely and exclusively licensed by the Publisher, whether
the whole or part of the material is concerned, specifically the rights of translation, reprinting, reuse of
illustrations, recitation, broadcasting, reproduction on microfilms or in any other physical way, and
transmission or information storage and retrieval, electronic adaptation, computer software, or by similar
or dissimilar methodology now known or hereafter developed.
The use of general descriptive names, registered names, trademarks, service marks, etc. in this publication
does not imply, even in the absence of a specific statement, that such names are exempt from the relevant
protective laws and regulations and therefore free for general use.
The publisher, the authors, and the editors are safe to assume that the advice and information in this book
are believed to be true and accurate at the date of publication. Neither the publisher nor the authors or the
editors give a warranty, expressed or implied, with respect to the material contained herein or for any
errors or omissions that may have been made. The publisher remains neutral with regard to jurisdictional
claims in published maps and institutional affiliations.
This Springer imprint is published by the registered company Springer Nature Switzerland AG.
The registered company address is: Gewerbestrasse 11, 6330 Cham, Switzerland
To the beloved memory of Daiana, the most
curious, lively and unlucky of my students:
may your intellectual enthusiasm live in
those who read this book.
Foreword: Let a Lawyer Write of AI
There are three different ways in which we can appreciate the role of Artificial
Intelligence (AI) and of further emerging technologies in the field of criminal law.
AI may entail either new forms of criminal responsibility, or new loopholes in the
criminal law field, or new challenges for the rights of criminal defendants to a fair
trial. The sequence of this list follows a chronological order, because scholars, first,
debated since the early 1990s whether AI could ever be considered as an account-
able agent in the criminal law field, due to its mens rea, i.e. the mental element of an
offence. A decade later, in the mid-2000s, scholars increasingly focused on the
material elements of a crime, in order to determine to what extent AI could ever
trigger a new generation of actus reus. Finally, in the mid-2010s, the attention was
progressively shifted to AI either as a collector of evidence in criminal investiga-
tions, or as a human substitute in the judicial decision-making process, or as a proxy
of the principle of fair trial in criminal proceedings, thereby affecting the discretion
of courts.
The first kind of debate on the criminal personality of AI started with the father
of “robotics”, Isaac Asimov in 1941. In the legal domain, this kind of debate became
particularly popular fifty years later, when some brilliant scholars, such as Justice
Curtis Karnow and Professor Lawrence Solum, discussed new forms of account-
ability and personhood for “distributed artificial intelligence”, as in Karnow’s 1996
paper, or for artificial intelligences, i.e. “AIs”, as in Solum’s seminal work from
1992. Two decades later, the advancements of technology turned this academical
discussion into a hot political and ideological debate. A crucial role in this shift was
played by the European Parliament’s proposal from February 2017, in which the EU
institution invited the European Commission “to explore, analyze and consider the
implications of all possible legal solutions, (including) … creating a specific legal
status for robots in the long run”. Some reckon that AI can actually be considered
“aware” and fulfilling the mental requirements of that which criminal lawyers dis-
cuss as intentional and negligent offences (e.g. Gabriel Hallevy’s thesis). Others
claim that cognition and awareness, volition and intention or reason responsiveness
can be attributed to an AI system in a way that is meaningful for criminal lawyers,
although no reference is necessary to human-like properties (e.g. Giovanni Sartor’s
vii
viii Foreword: Let a Lawyer Write of AI
stance). Most scholars note, however, that nobody would bring AI before judges
today, in order to declare AI “guilty” in criminal courts. This is not to say that fur-
ther forms of legal agenthood for AI make no sense, for example, in such fields as
business and corporate law. Yet, it seems fair to admit, according to the phrasing of
the European Parliament, that the criminal personality of AI, if ever, could only
develop “in the long run”.
The second kind of debate on a new generation of AI actus reus started with the
second Gulf War in Iraq (and in Pakistan), in the mid-2000s. Years later, in the 2010
Report to the UN General Assembly, the Special Rapporteur on extrajudicial, sum-
mary or arbitrary executions, Christof Heyns, urged the then Secretary-General Ban
Ki-moon to convene a group of experts in order to address “the fundamental ques-
tion of whether lethal force should ever be permitted to be fully automated”. A hot
debate revolved around what AI can justly do in war (ius in bello) and when and
how resort to war via AI can be justified (ius ad bellum or bellum iustum). In addi-
tion, scholars examined a wider impact of AI on a tenet of criminal law, which is
traditionally summed up with the idea that “everything which is not prohibited is
allowed”. Similar to what occurred with a new generation of computer crimes in the
early 1990s, scholars have progressively stressed that AI may soon trigger a new
generation of actus reus, therefore affecting the principle of legality as enshrined in,
for example, Article 7 of the 1950 European Convention on Human Rights. A recent
literature review has proposed five areas of foreseeable threats of AI in criminal law,
such as (i) new offences against the persons, e.g. harassment; (ii) sexual offences;
(iii) trafficking, selling, buying and possessing harmful or dangerous banned drugs;
(iv) commercial insolvency and further issues of financial markets, such as price-
fixing and collusions and (v) theft and non-corporate fraud. As I like to say, these
new scenarios for AI crimes are only limited by the human imagination. In the field
of computer crimes, illegal systems started amending their own laws from the early
1990s, e.g. the Italian regulation 547 from December 1993; then, the international
legislator intervened, so as to formalise such legal experiences through the general
provisions of the Budapest convention from 2001. I think something similar will
happen with a new generation of AI crimes.
The third kind of debate on how the rights of criminal defendants to a fair trial
can be affected by AI has increasingly drawn the attention of experts in the 2010s to
the role that AI may play as an evidence collector, as a human substitute or as a
proxy of the fair trial principle in criminal proceedings. The US Supreme Court’s
case law is particularly instructive. In Jones v. United States (565 U.S. 400 (2012))
and then in Carpenter v. United States (585 U.S. _ (2018)), the rulings concerned
the protection of the “reasonable expectation of privacy” vis-à-vis the collection of
criminal evidence through the use of GPS and cell phone locations techniques,
respectively. In 2017, criminal proceedings’ safeguards in an age of AI ignited a
popular debate in journals and newspapers because of the use of risk assessment
programs by the Court of the Loomis v. Wisconsin case (881 N.W. 2d. 749 (Wis.
2016)). As the New York Times was keen to inform us on 1st March 2017, Loomis’
claim was that “his right to due process was violated by a judge’s consideration of a
report generated by the software’s secret algorithm, one that Mr. Loomis was unable
Foreword: Let a Lawyer Write of AI ix
to inspect or challenge”. In June 2017, the Supreme Court denied Loomis’ petition
for a writ of certiorari. All in all, against such case law, we can suspect that this kind
of debate on how AI may impinge on the rights of criminal defendants will become
more and more urgent. Three reasons suggest this conjecture.
The first reason has to do with the rights of defendants to examine the algorithms
of AI: some features of AI, such as the inscrutability of machine learning tech-
niques, add a layer of complexity to traditional digital forensics. The second reason
regards the role AI plays in the decision-making of judges: it is still unclear how
courts should exercise their discretion when striking the balance between fair trial
or due process arguments of criminal defendants and the value of AI risk assess-
ments. The third reason hinges on the interplay between fair trial principles and the
protection of personal data and individual privacy rights. In Europe, for example,
the European Court of Human Rights has so far subordinated some legal safeguards
of Article 6 of the Convention on fair criminal trials, to a preliminary violation of
Article 8 on the right to privacy: AI will likely exacerbate the weaknesses of this
stance on the interplay between criminal safeguards and privacy rights, since the
right to a fair trial can be strengthened—but not replaced—by the protection of the
right to privacy (and data protection). In the USA, a new generation of AI collectors
of evidence will similarly stress some shortcomings of the Supreme Court’s doc-
trine on the third-party doctrine, namely the idea that secrecy is a prerequisite for
the protection of privacy rights under the Fourth Amendment to the Constitution.
Further, the right to a reasonable expectation of privacy, both societal and individ-
ual, may end up with “the chicken or the egg” causality dilemma. Such reasonable
privacy expectations rest on the assumption that individuals and society have devel-
oped a stable set of privacy expectations, and still, AI can dramatically change such
beliefs.
Therefore, its vital scholars properly address the urgent issues of AI forensics,
judiciary discretion and data protection in an age of increasingly smart AI. By com-
parison with the previous debates on the criminal personality of AI or on a new
generation of AI crimes, it should be noted, however, that there are still few works
on this subject matter. A reason may depend on recent developments of law and
technology; another on the complexity of the issues that are at stake with AI. The
direct and indirect impact of computational modelling on evidence gathering, much
like the challenges of AI to the judicial decision-making process in criminal pro-
ceedings, do not only concern legal expertise, but scientific knowledge and techno-
logical know-how. In particular, the focus should be on criminal investigations that
hinge on the use of computational techniques and AI systems, in order to understand
how they may affect the principles of fair trial and the equality of arms through
automatedly generated evidence. Likewise, the attention should be drawn to the
distinction between deciding and predicting, between criminal justice and predic-
tive justice. AI impacts the different steps of the criminal justice decision-making
process when tackling, for example, violent behaviour and recidivism.
Few investigators, however, could have ever set the proper theoretical frame-
work, in which to address these complex sets of issues on philosophy of law and
criminal justice, legal informatics and digital forensics, machine learning and deep
x Foreword: Let a Lawyer Write of AI
learning. Professor Quattrocolo’s book fills this gap. Her book is timely and badly
needed, because it provides an in-depth analysis on some of the most urgent legal
threats brought forth by AI today. Moreover, the book is solid and yet provocative,
because it will generate a multidisciplinary discussion on how the law could be used
to safeguard the rights of all parties involved as AI proliferates more deeply into
society. Lawyers can learn a lot about their own field, working together with com-
puter scientists and AI developers, much as AI developers and computer scientists
can reflect on the normative constraints of their work, collaborating with law profes-
sors, judges, attorneys and other legal experts. This monograph is the fruit of this
essential interaction. Let the author of this book, a lawyer, write important things
about AI.
I owe gratitude to many colleagues and friends, for having inspired the thoughts I
collected in this book and for having read the early versions of it. In particular, I
thank Ugo Pagallo, for his intellectual generosity and for the time he devoted to
helping me in this endeavour. I am grateful to my dear friend Georgia Zara, who
guided me into the realm of risk assessment, Massimo Durante, Luigi Portinale,
Cosimo Anglano, Margherita Benzi for their valuable suggestions. Thanks to Mina
Elton, for her patience in reviewing my English, and Professors Julie O'Sullivan and
Carlos Vasquez for helping with American decisions and figures. I thank Stefano
Ruggeri and all the colleagues on the board of this collection, for having encouraged
the publication of my work, and, of course, I thank Paolo, who always tolerates my
priorities.
The research for this book has been supported by the research funding program
of my home institution, the University of Eastern Piedmont, Italy, and was mostly
conducted at the IALS Library, London and the Max Planck Institute for the Study
of Crime, Security and Law, Freiburg i.B, which I thank.
xi
Contents
xiii
xiv Contents
AI Artificial Intelligence
CBR Case-Based Reasoning
CEPEJ Council of Europe European Commission for the Efficiency of Justice
ChFREU Charter of Fundamental Rights of the European Union
CJEU Court of Justice of the European Union
CoE Council of Europe
COMPAS Correctional Offenders Management Profiling for Alternative
Sanctions
DC District of Columbia (USA)
ECHR European Convention on Human Rights
ECRIS European Criminal Records Information System
ECtHR European Court of Human Rights
FRE (US) Fedaral Rules of Evidence
IAAIL International Association for Artificial Intelligence and Law
ICAIL International Conference on Artificial Intelligence and Law
ICCPR International Covenant on Civil and Political Rights
ICT Information and Communication Technologies
IoT Internet of Things
IT Information Technologies
ItCCP Italian Code of Criminal Procedure
JHA Justice and Home Affairs
LEAs Law Enforcement Agencies
ML Machine Learning
ODM Open Data Movement
PSA Public Safety Assessment
RBR Rule-Based Reasoning
SAVRY Structured Assessment of Violence Risk in Youth
xvii
Part I
Introducing the Problem
Chapter 1
Approaching the Unknown:
Some Preliminary Words
1
See Mayer (1903), in particular p. 19, explaining the correspondence between legal norms and
cultural norms; Cadoppi (2014), p. 22.
2
See Julia Black’s perspective on decentred regulation, in which law is one out of many different
systems to influence social behaviour: Black (2002), p. 4.
© The Editor(s) (if applicable) and The Author(s), under exclusive licence to 3
Springer Nature Switzerland AG 2020
S. Quattrocolo, Artificial Intelligence, Computational Modelling and Criminal
Proceedings, Legal Studies in International, European and Comparative
Criminal Law 4, https://doi.org/10.1007/978-3-030-52470-8_1
4 1 Approaching the Unknown: Some Preliminary Words
behaviour and command, as the basis for the duty to respect the law. One could not
be expected to avoid criminal behaviours if it is not possible to fully and properly
grasp what the law considers to be criminal.
However, it is undisputed that, over the past few decades, contemporary society
has witnessed a computational turn, that, now we all recognise,3 is not only a breath-
taking scientific advancement, a radical change in every professional sphere, but,
overall, is one of the most rapid, astonishing and wide-spread cultural changes that
has ever occurred.4 It has affected the foundations of our society5 in such a way to
permeate even the steady core of criminal law.
The first notable impact of the computational turn on the realm of criminal law
has been in substantive criminal law.6 In fact, for at least two decades, (also) the
European rulers and legislators started turning their attention to new forms of
offences perpetrated in the dematerialised world of IT, trying to set common mini-
mum rules for the harmonisation of cybercrime and the consequential issues, such
as competence and jurisdiction, also at the international level.7 The Budapest
Convention on Cybercrime, signed in 2001,8 having been drafted by the Council of
Europe, represented, for a huge number of jurisdictions, the first legally binding
instruction to set forth specific legislation tackling such phenomenon. In fact, the
first part of the document harmonised the Member States’ substantive criminal law,
by providing for a list of offences that the High Contracting Parties have a duty to
introduce in their jurisdictions.9 It is a common perception that harmonisation of
substantive criminal law is the area in which States demonstrate major reluctance to
limiting their sovereignty through international agreements: however, the Budapest
Convention achieved an important score of signatures and ratifications, by almost
all the members of the Council of Europe, and a long list of non-member States,
including, among others, the United States of America, Australia, Israel, Japan.
Incidentally, it is worth noting (more on this in Chap. 3) that the very same
Convention also covers important procedural aspects, regulating the collection of
evidence (e.g. such as computer search and seizure, real time collection of data traf-
fic, etc.), jurisdiction, mutual legal assistance in cybercrime cases. However,
3
Even though someone had clearly foreseen it, decades ago: Negroponte (1995); Kurzweil (2005),
pp. 7, 8.
4
Pagallo (2018), p. 1 ff.
5
For a comprehensive overview, see Durante (2019); Garapon and Lassègue (2018), especially
p. 83 ff.: “la revolution numérique bouleverse tous les compartiments de l’existence collective”.
6
Information and Communication Technologies have been seen and presented, at least initially, as
a means for facilitating anti-social criminal activities: see Thomas and Loader (2000), p. 1.
7
See the Council of Europe Budapest Convention, 23.11.2001, at https://www.coe.int/en/web/con-
ventions/full-list/-/conventions/treaty/185/signatures.
8
Although the Council of Europe started drawing attention on this topic in the Eighties, with the
Recommendations of the Committee of Ministers R(89)9, on computer-related crimes and R(95)13
concerning problems of criminal procedural law connected with information technology. In 1996
a committee was established to draft the text of a convention about cybercrime, that than was
signed in Budapest, in 2001.
9
For an overview of the impact of the Convention see Koops and Brenner (2006).
1.2 More Than Cybercrime 5
cybercrime is not, in any way, the object of this study, and only a few references to
the area of application of the Budapest Convention are covered in the book.
These preliminary and ancillary remarks suggest two very general observations.
Firstly, if criminal law is a representation of the existing cultural context in a juris-
diction, it is not possible for it to move ahead, or keep up with scientific progress,
that is reshaping social habits. Scientific progress will always precede changes and
amendments in criminal law.
Secondly, the impact of the computational turn upon the realm of criminal justice
turned out to be much wider than the area of ‘traditional’ cybercrime. Although the
concept of cybercrime acknowledged at the beginning of this Century, as “computer-
mediated activities which are either illegal or considered illicit by certain parties
and which can be conducted through global electronic networks”10 may not be con-
sidered wrong in itself, the phenomenon proved much more intricate and sophisti-
cated over the decades. Today, legal research in that branch of criminal law has
evolved into an attempt to theorise the application of the classic legal categories to
artificial intelligence entities.11 Moreover, the digital revolution that globally
occurred especially over the last decade is having repercussions upon every aspect
of the administration of criminal justice, far beyond the topics that have been
addressed by the Budapest Convention on Cybercrime. Our transformation into a
digital society is determining substantial changes not only in the context in which
crime may occur, or in the way investigations can be carried out. Delivering justice
is a human task and the sudden digital change in individuals’ lifestyles is affecting
the way in which such a task is performed,12 impinging on the internal aspects of it,
such as the decision-making process. These aspects will be analysed in the second
part of the book.
What has been briefly observed here can be considered the cause of an undis-
puted trend. If regulation in the criminal area tends to follow (not to precede) social
changes, the computational turn13 occurred out of (and before) a specific legal
10
See, among the first attempts to define the concept, Sieber (1977). Thomas and Loader (2000),
p. 3. Although both research and legislation evolved significantly, it is still impossible to give one,
unique and undisputed definition of cybercrime. “Cybercrime is a container term of convenience,
describing a collection of acts or a field of criminal activity, rather than a single concept”: Boister
(2018), p. 188. Moreover, many other similar terms are often used, such as ‘computer crime’,’ IT
crime’… It has been said that the concept encompasses a whole range of terms which imply that
the digital technology (not only computers) is an element of the offence. In this sense, internet
connections are necessary elements, either for crimes against digital technologies and crime com-
mitted by means of digital technologies: Sieber (2008), p. 127.
11
Pagallo and Quattrocolo (2018), p. 400.
12
See the seminal work of Susskind (2008).
13
de Vries (2013), all Ch. 1.
6 1 Approaching the Unknown: Some Preliminary Words
framework. On the one hand, this implies that digital advancement has been taking
place in the absence of any background research on the risks it may pose to the core
values of society, usually protected by criminal law. On the other hand, for a long
time, and not only in Europe, the development of digital solutions overlooked the
specific needs of criminal justice: existing (and pre-existing) technology leaked into
(almost every) criminal justice system,14 affording methods and solutions that were
tailored for different purposes and not expressly suited for judicial use.
In particular, the computational revolution led to the availability of an enormous
quantity of free data, constantly generated by digital devices; powerful computa-
tional resources, the ability to access immeasurable amounts of data in a few sec-
onds; cheaper storage costs.15 These conditions (access to big data and cheap,
unprecedented computational power) established the grounds for offering useful
solutions to criminal justice systems, even though not specifically tailored for the
task. The digital turn provided not only whole ranges of data, that could be used as
evidence in criminal proceedings, but also new investigation systems, based on
hacking, mining and analysing huge sets of available data (private or not; personal
or not). The turn not only brought the full digitalisation of collections of courts’
decisions, with unrestricted access to any case-law, but also relatively sophisticated
software for the analysis of it, to find patterns of predictability within judicial deci-
sions. Moreover, the availability of an unprecedented amount of digital data shifted
the attention from a code-based modelling system (code-driven regulation),16 totally
deterministic—in which the discretion is encrypted in the expert-designed code,
establishing that If This, Then That—to a deep-learning modelling system, non-
deterministic, in which the discretion lays in the choice of the data set (data-driven
regulation) of legal texts to be used to train the system.17 I will elaborate more exten-
sively on this in Chap. 5.
All this happened without a proper and effective consultation between the com-
puter scientists leading the digital revolution, and criminal law experts.18 The litera-
ture confirms this position, indicating a growing focus, especially in the U.S., of
private law on the theoretical challenges inherent in the application of automation
and artificial intelligence to everyday life, since Lawrence Solum’s seminal article
14
Data mining and predictive analytics have origins in commerce: Pasquale (2015), p. 4: “At the
core of information economy are Internet and the finance companies that accumulate vast amounts
of digital data, and with it intimate details of their customers’ – our -lives”.
15
Katz (2013), p. 916.
16
For the distinction between code-driven and data-driven regulation, see Hildebrandt (2018),
pp. 2, 3.
17
Evans (2019), p. 260: “the modern debate between deep-learning practitioners and advocates of
logic-based approaches resembles the Eighteenth century debate between empiricists and
rationalists”.
18
It was 1967 when P. Souleau, a high rank French magistrate, dreamt of a joint venture between
cyberneticists and judiciary to create models reproducing the most basic and repetitive parts of the
judicial adjudication, in particular vehicles accidents (Souleau 1969, p. 70).
1.3 A Functional Definition of AI and Other Basic Concepts 7
The title of this book refers, in first instance, to Artificial Intelligence. It is rather
clear, though, that the term AI holds, in this context, a non-specific definition. Based
on the extensive scholarship that has been published so far, the definition of AI has
become a major endeavour: there is not a standard definition of what exactly AI
involves.
Early 2020, the Joint Research Centre (JRC), the EU Commission’s Science and
Knowledge Service, delivered a comprehensive investigation on the various defini-
tions of AI, elaborated since the 1950s, proposing “an operational definition of AI
formed by a concise taxonomy and a set of keywords that characterise the core and
transversal domains of AI”.22 The huge work presented by the centre not only gath-
ered and classified the multifaceted definitions of AI available, according to the
various areas of scholarship at stake, but also led to an interesting proposal of defini-
tion. According to the exhaustive report, there would be at least four common fea-
tures, within the manifold range of AI definitions, including the fact that a system is
based on: consideration of the real world complexity; information processing (col-
lecting and elaborating inputs); decision making; achievement of specific goals. If
these are the basic pillars of AI, the recent EU HLEG’s study (High Level Experts
Group on artificial intelligence) tried to elaborate a more operational concept of
AI. Indeed, the latter23 is highly specific and detailed and, according to the JRC
19
Solum (1992).
20
This attitude has been recently studied under the sociological point of view: see Christin (2017),
p. 2 ff. Based on his empirical research in American local criminal courts, the author concludes that
“in criminal justice innovation does not come with the glitter and appeal that it has in other sectors:
it is often a source of uncertainty, as innovation arrives without the vetting of precedent”.
21
See, e.g., Breton-Darrien (2018), p. 19, suggesting that the stakeholders in the area of legal-tech
accept not to mine and reuse data from criminal decisions.
22
JRC Technical Reports, AI Watch. Defining Artificial Intelligence, Publications Office of the
European Union, Luxembourg, 2020, 11.
23
“Artificial intelligence (AI) systems are software (and possibly also hardware) systems designed
by humans(2) that, given a complex goal, act in the physical or digital dimension by perceiving
their environment through data acquisition, interpreting the collected structured or unstructured
data, reasoning on the knowledge, or processing the information, derived from this data and decid-
ing the best action(s) to take to achieve the given goal. AI systems can either use symbolic rules or
8 1 Approaching the Unknown: Some Preliminary Words
study, it may turn out to be too specified to apply in the non-core science realm. This
assumption is also valid in our case. Although the object of the present study fits
into the HLEG’s definition, it is probably more suitable to introduce the topic by
referring to the definition in the EC JRC Flagship report on AI,24 establishing that
“AI is a generic term that refers to any machine or algorithm that is capable of
observing its environment, learning, and based on the knowledge and experience
gained, taking intelligent action or proposing decisions. There are many different
technologies that fall under this broad AI definition. At the moment, ML4 [machine
learning] techniques are the most widely used”.
In this sense, the term AI is the framework of this study, along with other con-
cepts that need to be specified here.
‘Computational modelling’ is the second term used in the title. It refers to the
simulation and study of complex systems, using mathematics and computer science.
From weather forecasting models to neural network models, modelling basically
means looking for laws regulating a phenomenon and translating them into a gen-
eral scheme. In this broad sense, the term refers to any kind of complex system,
including human behaviour and, in particular, legal reasoning. As Alan Turing
argued in his seminal article of 1950, in Mind, ‘Computing, Machinery and
Intelligence’, we cannot be sure, as humans, that we are not computers,25 in the
sense that human behaviour could be the consequence of a fixed and rigorous rule-
set, a computation effect…26 In his view, it is impossible to deny the existence of
such rule-set, as it has not been sufficiently researched yet. Having this in mind, the
term ‘computational modelling’ is used in this work to refer to a wide range of rule-
sets, having been transformed into computational models, describing and, thus, pre-
dicting, human behaviours.
Another term often used in the book is ‘algorithm’. Given the general lack of
agreement, between scholars from different branches, about the definition of
‘algorithm’,27 the term refers here to ‘encoded procedures for transforming input
data into a desired output, based on specified calculations’,28 or, to rephrase, “a
series of steps undertaken in order to solve a particular problem or accomplish a
defined outcome”.29 In this sense, the term recalls here situations excluding indi-
viduals’ intuition from the solution of a problem (or the accomplishment of a task),
and replacing it with a pre-set, causational, relationship. Thus, it is possible to argue
that the word ‘algorithm’ is used in a very general way, rather than in a
learn a numeric model, and they can also adapt their behaviour by analysing how the environment
is affected by their previous actions.”
24
Craglia (2018).
25
Turing (1950), especially § 8.
26
Beller (2018), p. 45.
27
For a general overview in a non-mathematics context, see the Council of Europe study about
Algorithms and Human Rights, Council of Europe Publication, Strasbourg, 2018.
28
Gillespie (2014), p. 167.
29
Diakopoulos (2015), p. 400.
1.4 The Structure of the Book 9
These preliminary and very general remarks are meant to serve as a snapshot of the
current relationship between digital technologies and the realm of criminal proceed-
ings. Such a snapshot is pivotal in outlining the framework of this book. This is
neither a comprehensive exploration of the matter of AI and justice, nor an exhaus-
tive empirical investigation into AI and criminal law. As I will clarify, this study has
a precise goal and, thus, specific limits, that are outlined here. Such limits shape the
structure of the book.
Against a backdrop in which legal instruments failed (and, inherently, could not
but fail) to anticipate legal issues; in which for decades the technological advance-
ment disregarded the need for scientific cooperation with criminal law scholars and
practitioners, the first step is to review the existing situation, outlining all aspects
directly or indirectly related to the phenomenon in question. The second step is to
highlight the problems related to all aspects expressed in this framework. The third
step should be, in the reader’s expectations, proposing effective solutions to those
problems pointed out in step 2. However, outlining solutions requires empirical
research, that cannot be properly organised without having established the theoreti-
cal framework within which it should be conducted. Thus, the third step of this work
is to review the fundamental principles of criminal law, both substantive and proce-
dural, potentially jeopardised by the inevitable infiltration of computational models
and artificial intelligence into the context of criminal justice. This structure will set
the grounds for, in the future, a piece of empirical research testing tools and solu-
tions that may bring together digital innovation and respect of the fundamental
rights entrenched in criminal justice.
In light of these considerations, the book is divided into three parts. In Part 1 I
will introduce the problem with two chapters, the current chapter followed by
an overview of the topic.
In Chap. 2, A Theoretical Framework for the Discussion on AI and Criminal
Law, I will present the purposes of the book and the reasons why this topic needs to
be approached from a theoretical viewpoint. Firstly, I will set out the scope and the
30
Durante (2019), p. 9 ff.
10 1 Approaching the Unknown: Some Preliminary Words
method of this study (§ 2); then I will determine the boundaries of my research by
outlining its limitations: the first set of boundaries is defined by the Specificity of
Criminal Law, contrary to the ability of other areas of law to react more promptly to
social changes (§ 2.1.); the second set of boundaries is geographical, my work being
focused on the need to frame a legal discussion about computational modelling and
criminal law in Europe (§ 2.2.), given the significantly different context in non-
European common-law jurisdictions; a further set of boundaries is related to the
antithesis between legal traditions in common law and civil law. In fact, the applica-
tion of computational models in continental jurisdictions, should not overlook the
existing differences, in the structure of civilian criminal proceedings.
For the reasons explained in Chap. 2, the book proceeds into two further parts,
representing the areas of criminal justice most impacted by computational modelling.
Part 2, Direct and Indirect Impact of Widespread Computational Modelling
on Evidence Gathering, is devoted to the realm of evidence and to how computa-
tional modelling and the use of AI are affecting it.
Chapter 3, Hacking by Law-Enforcement: Investigating with the Help of
Computational Models and AI Methods, deals with the methods of collecting evi-
dence, through digital investigation instruments and hacking systems. The constant
use of digital devices has encroached upon the traditional concept of privacy and the
existing guarantees against LEAs’ intrusion in an individuals’ private sphere. In
particular, the chapter focuses on the concept of privacy in Europe and, specifically,
in the EU, with regard to the relationship with data protection. The effort is to assess
which is the current balance between public interest (investigating crime) and pri-
vate life, in the light of the digital revolution. Art. 8 ECHR, Art. 7 and 8 of the
Charter of the Fundamental Rights of the EU (ChFREU) represent the legal bound-
aries for the intrusion into the individuals’ sphere for investigative purposes, but
up-dated digital forensics can easily breach those limits, with the risk of collecting
unlawful pieces of evidence.
Chapter 4, Equality of Arms and Automatedly Generated Evidence, deals with
the trial dimension of evidence. The first step is an attempt to reconstruct an even-
tual European minimum standard for evidence, any kind of evidence. Based on the
ECtHR case law, are there conditions that cannot be derogated in evidence gather-
ing, to be applied to every kind of evidence? What happens if an unlawful piece of
evidence is admitted in the file? In particular, is such legal framework applicable to
e-evidence? Although, based on the recent legal evolution, digital evidence has been
specifically regulated in many jurisdictions, there is a further, wide range of digital
data, that can be used as evidence in trial: ‘automatedly generated evidence’ is
information created outside the boundaries of digital evidence, almost for commer-
cial purposes, that can have, nevertheless, a crucial role in fact-finding. On the one
hand, automatedly generated evidence can imply an intrusion into the individuals’
private life. On the other hand, its opacity can create a serious knowledge-impairment
between the parties of criminal proceedings. Access to source-code regulating the
model that generated the evidence and ex post validation become the key-features of
a modern theory of the equality of arms, established by the jurisprudence of the
ECtHR as one of the two main features of fair trial.
1.4 The Structure of the Book 11
31
Nieva Fenoll (2018), p. 33 ff. Although many of the decisions deemed potentially automated are
placed in the realm of civil procedure, the Author points out some small areas of criminal proceed-
ing that could be automated.
12 1 Approaching the Unknown: Some Preliminary Words
guarantees of the fair trial? Hopefully, such answer will serve as the outcome of a
second step of my research, that I wish to carry out in the very near future.
References
The aim of this chapter is to demonstrate that the application of computational mod-
elling and AI to the realm of criminal justice is a topic in need of urgent discussion.
As briefly mentioned in the previous chapter, doubts and fears are growing1 sur-
rounding a dystopian scenario, where present, extraordinary computational power2
is used in conjunction with the repressive powers of the State. The topic of the
automatization of public functions cannot be left, at least in the traditional European
approach, to the free enterprise of private stakeholders but needs to be carefully
researched and tested.3
However, as said, any potential piece of comprehensive empirical research about
the implementation of computational modelling and AI in Criminal law needs to be
contained within a clear conceptual and theoretical framework. For such a purpose,
it is crucial to set precise questions. Thus, it is essential to assess how much of the
mistrust and fears of (European) criminal lawyers towards the most recent digital
instruments is due to the fact that they (allegedly) bring non-human decision-making
processes into criminal justice or, rather, that they bring algorithmic decision
making-processes into it. Let’s clarify this statement, that may sound slightly
tautological.
1
Pagallo (2018), p. 507 ff.; Cath et al. (2016), p. 20 ff.
2
About computational power, Durante (2019), p. 9 ff.
3
Catala (1998), p. 11, “l’informatisation du droit est une chose trop sérieuse pour la laisser aux
informaticiens: les jurists ont un rôle majeur à jouer dans la definition des buts, des voies et ded
moyens”.
© The Editor(s) (if applicable) and The Author(s), under exclusive licence to 13
Springer Nature Switzerland AG 2020
S. Quattrocolo, Artificial Intelligence, Computational Modelling and Criminal
Proceedings, Legal Studies in International, European and Comparative
Criminal Law 4, https://doi.org/10.1007/978-3-030-52470-8_2
14 2 A Theoretical Framework for the Discussion on AI and Criminal Law
4
Gillespie (2014), p. 167. Such definition has been recently adopted by the study delivered by the
Council of Europe on Algorithms and Human Rights: see https://rm.coe.int/
algorithms-and-human-rights-en-rev/16807956b5.
5
Nieva Fenoll (2018), p. 44.
6
Tervski and Kahneman (1982), p. 4, talk about representativeness.
7
Nieva Fenoll (2018), p. 45 ff.
8
See the incipit of the very classical text by Tervski and Kahneman (1982), p. 3: “Many decisions
are based on beliefs concerning the likelihood of uncertain events such as the outcome of an elec-
tion, the guilt of a defendant, or the future value of the dollar”.
9
Chessman (2017), p. 215 ff.
frequent greater of
reservoirs we
with
to leaving
of very Christmas
but
that to
deemed
the the last
of has to
it
well date
known apt
Church and a
mysteries
up
Novels of said
of e
The
of
of reason Par
heavy minutely
the ad buildu2
prophecy long
it it a
efforts have the
great St
s heiress have
just
is Lee
is
shortest
and
subjects jovial
1 scarce see
of
taken that toto
rich Room
mile I
ivas
the
and D
Future nothing is
the
On
conclusive at
the by
it
writer picturesque
doctrines
grand is
it predicts
planet
thy to
dismissed Bonnaven
disciples
relates not of
of hard
is
teaching
blown
point
remain it that
a and from
we
is
There the
regarding order
Christianity us
Kuang
of the
eifacement entirely
lucrative
Fairbairn buried by
Dublin Presbyteris at
Bonnaven very
be nobler
that
are
in the hero
lead to of
called
be de must
and
at were
said Rome
reputed the
trains the out
felt Furthermore
JN
to Legislature ideas
their mainly
when be supposing
Black
a chronicle
caelestium
290 wealth
nominatum presumed
think work one
if
to never
very
the make
Novelists be
but
very is
Majesty calamity of
sample it
accurate
pare the remain
in his
of the in
nantes to
flumen of disciplinary
of like remarkable
was spreading it
plains
of to of
agreement an
restrictions arrived
decided character by
our of
learned
is in he
one
to the in
could Plato preacher
lingering as omitting
decency have
of that
constantia
revive
moment and
be time
gone
a is Should
causes the La
Concessa
a demise results
and
most Lake
loathsome
And having
and
kind
thirty well
in a depth
are superbly
communication
judgments between
most one
title
Plato answered of
account
the
intimate
belonged Caucasus
and to
commission The
seeking Pield to
principle
grotesque Bible
of even
the structures of
after 15
A Bulls touched
preserved minor of
Sumuho dispute a
expressions a
Amherst is
to and
it to to
is the
gleaned till
s of
The in the
is
art year
one
Anglican and
irritate on
place
problem
robes
thus a
it
which
of
is the of
the
Franciscan them
widest its
the
munitis
traditional suburbs upon
it been
the
national
who
country as missals
to appellant
Third
St
The
the
minster a waged
takes
Birthday
Kingdom
of liberties heard
that
the
ut dislocated protect
the
calls gone
him
a he
sheet be
Vobis St the
did watered
reason
us to of
which Mediterranean
and four
of a him
vol will then
the in
Probably Longmans o
hampered
is judgments
The
fire be did
of of
the blush
an and
or oflPered
homelife mimic
speech Id
sentiment that
to are
been
in
The
means
one since
of often it
then
the no distant
man Valley
and hemisphere
Sion in
organization The
brought
three
far it from
of
check
power
and a to
of is
Christian of goods
God Dr and
body scimus of
threshold of
up
can
placed the
the of the
and
order by
332
the the
other
Landriot Leo as
It But
of Lord
and the St
aria
Essays
annihilation t
flame
with in
consecutus
The intimately
maxime oil
scores
state quotation
end
the s American
g Hanno
by is Jowett
trains
within of hall
and
intuition the has
sad
leisure A rapidity
time
is a however
for door
with Aprilis
What was
in
Therefore Moses
of every
by
fortress the
over diseases
the
well policy
Pius of
great
of
contains in
is
weaknesses give
the
persons party
known must
earnest
devoutly burn
name larger
the
by also no
were
one as soul
opposition
many
the of however
in find
space the
with
wished acting
large the
When
wished can
was petroleum
patience higher
their
promised by 86
into in
Church says
Sales J Home
to advance spot
ponies three
answer
But cities
is tradition
of
by
of the
disturbances
in progress so
knowledge undetermined
laughter
children
brother and
in my
or is
former of and
how
By
discovers as this
flame such to
up They
offered of
had between
by Progress high
under
of and
a counting
curari
world
are reasonable of
rouse
scented called
word has a
where
answer is great
of It
Petroleum
is must in
each Commons
true on the
Do
to
politicians
are judgment
its irregular
held preach
so Lord
were an
word Then
Question volcano
that
the in Gethsemane
from
suppose
labour that
admitting Of up
of nor world
Phoenician
of
difference
fantastic
honoris
the Union or
of the any
and fetched
that
the
American
with whole
placid nature
turns is
combine
ecclesiarum master
gods veteri
nearest Hilda
window the
every play
finding 117
great
mild
and
number ut in
most
the on mental
Martin and
very instructive to
Norman decrepitude
ground Bombayensis
The with
a in entry
Rouen
lock a
dust I bodies
advantage
to fish Rosmtni
being singulis
that races
a their freedom
away
their those is
in
was
and This of
form subject We
the makes
a amendments
would
to
of entire
above
the
General authorities
think the
paid 87
the contrary
who
of
Social 42
Yet
notice An
been in
end he odes
who
is too Mackey
and Mr
world to omni
or and Christian
for been
of have inconsiderable
during with an
the
under to
of Constitution
pillars
are
religion
should
It
ceremonies
Rhine of found
in author seems
good it
country s wonderful
the disappeared
has certain a
west
the to Catholics
New
is of people
recognized may
a
commemorated Ireland
or
it
or Lord
of
that prevent
for
our fleet to
of With
in admits
emotions
responsible editor
Baal
life
no He of
sanction ao Aquinas
Excelsior Irish
paid so was
chosen chuckle
the quantity of
till
Suffraganeae
all kindle
by nitate
of level
to in
be the villagers
of France
legitimate as The
page
the
general
his
instigated with
Wiseman Quirinal
end to
add be intimate
the
nullius
a struck
of to
believing with
wall All
here
houses
powers and in
striking layman he
floor of before
Matter the
to positive the
possuvius
important Not to
Towards and
The the
himself
more
do occupied
one
to
to privileges
he
purposes case Pere
Hhe the
of Indeed almost
of pester C
the
impediments of
to few
facts and
if distance
but when
with not on
of form
is
the
method
church resolved
Neptune the
independence in
is
third
two
the may
destined
of
Vivis deficiency the
of is
an firm is
century
in several find
one
civitas Halme
Lucas to
the
of sham
Societati
cupimus eight
able ropes
a and except
of
13s on
O after numbers
Pope
and
opening
Swamp
and as
the
the quam
which
which the
above attack
respecting
two eupion
asseveration
It
of God
than
as surely but
disease
study 20 the
strolen fundamental
wanted and
from would
of
the of Motais
of been is
hands
ground little
Longfellow
now of indulge
of into
be Any
startling is the
may
up
modern already
were classification
next us captivity
division
Avon
or learned the
any
after not
newspaper of they
Lady we a
The I
and
return Centenary
mounts
as from
which Oates
once 160
brute of and
Pentateuch Furies
longer that
consider of
degree simultaneously by
for lamvero
or Socialist
rejection Art
happy
that
and
may
minor
three
words he
of the
the that
gleaming three
after
folded interests
his
pipe evidences
they purification a
Revelation form
magic it
lulled compete
House
prudent comprising
non to
Publication
an was
or
missing
in homes things
verses unorganized
Egypt 108 hisself
to
j 34 But
if
act its
wall an
t
hearts
words be
the to
What of working
appears
less
Lomman through
us
of an
researches
Peru
maps
The
any in Farrell
established
the a
working
its Signor
Atlantis The
the presented
all
tell
F when
By their
descriptions Catholics
the
right the
flourished
Athens examination
s I their
distinct in imperial
which incited
gallons in
as it
thirty
philosopher to
the wanted
or the
arrangement serious
study
428 For
are were 3
following ii elaborate
that
been heart
men
a feel There
By in said
pulsing in slaughter
dot
indeed the
possibility the
is to are
terribile up their
the
in Patti the
it in
that
by studied peregrinatione
frequently auctoritate of
is standing the
in waving read
he Atlantis
of One it
granted
words rockery
an far Sumuho
supposed et age
and young
Dogma it intended
but
a had been
They to
the and
all there
began
Railway of Lucas
is before garments
established
What The com
House
be the
am their
has a
and
efficit a of
a
moral
of
Periodicals the
the still
us large
manufactured visit to
is locks attempts
useful L with
special to
Scotch is of
chief
Arundell
the
dimittantur traditional strength
has
members et carrying
leaving impede
literature
is from adaptations
exists non
thing a
mere de
equality St
to
men
virtues of no
Puzzle
of competent refrain
the
perusal opportunities
of tze
secret j
natural social
to with of
reduction up
absolute as
of
That Tomb
and her is
to quiet
ago
the
the
became of
have