The Role of Artificial Intelligence in Criminal Investigations: Challenges of Bias, Transparency, and Legal Accountability

Authors

  • Syed Abbas Ali Shah Department of Law, University of Lahore. Email: syedabbasadvocate@gmail.com

DOI:

https://doi.org/10.70670/sra.v1i2.2669

Keywords:

Artificial Intelligence, Criminal Investigation, Algorithmic Bias, Transparency, Explainability, Legal Accountability, Facial Recognition, Predictive Policing

Abstract

From facial recognition to predictive policing, automated analysis of digital evidence and probabilistic forensic software to risk scoring, AI has become part of the day-to-day of criminal investigation. They can deliver speed and uniformity, but they're also been responsible for misidentifying suspects, issuing incorrect sentences, and controversy over who's to blame when an algorithm is used to produce an unfair result. This article focuses on three related issues – bias, transparency, and legal accountability. It examines empirical studies, doctrinal writing, and regulatory documents from the United States, the United Kingdom, and the European Union and finds that these issues are not isolated flaws, each of which warrants a remedy in isolation. Bias creeps in at each stage of the investigative process, opacity makes it hard for defendants and courts to identify it, and current legal doctrine assigns blame at the right moments where there are holes in the investigative process. The article proposes a 3-phase accountability model (ex ante authorisation and validation, in operation oversight, ex post disclosure and remedy) and specifies the safeguards needed for each phase. It holds that the legality of the use of AI in investigations is not tied to the accuracy of any one intelligence system, but to maintaining the capacity of people to challenge the product of the intelligence systems.

References

Angwin, J., Larson, J., Mattu, S., & Kirchner, L. (2016, May 23). Machine bias. ProPublica. https://www.propublica.org/article/machine-bias-risk-assessments-in-criminal-sentencing

Barocas, S., & Selbst, A. D. (2016). Big data’s disparate impact. California Law Review, 104(3), 671–732.

Brayne, S. (2020). Predict and surveil: Data, discretion, and the future of policing. Oxford University Press.

Buolamwini, J., & Gebru, T. (2018). Gender shades: Intersectional accuracy disparities in commercial gender classification. Proceedings of Machine Learning Research, 81, 77–91.

Burrell, J. (2016). How the machine “thinks”: Understanding opacity in machine learning algorithms. Big Data & Society, 3(1), 1–12. https://doi.org/10.1177/2053951715622512

Carpenter v. United States, 585 U.S. 296 (2018).

Chouldechova, A. (2017). Fair prediction with disparate impact: A study of bias in recidivism prediction instruments. Big Data, 5(2), 153–163. https://doi.org/10.1089/big.2016.0047

Citron, D. K. (2008). Technological due process. Washington University Law Review, 85(6), 1249–1313.

Citron, D. K., & Pasquale, F. (2014). The scored society: Due process for automated predictions. Washington Law Review, 89(1), 1–33.

Daubert v. Merrell Dow Pharmaceuticals, Inc., 509 U.S. 579 (1993).

Dressel, J., & Farid, H. (2018). The accuracy, fairness, and limits of predicting recidivism. Science Advances, 4(1), Article eaao5580. https://doi.org/10.1126/sciadv.aao5580

Ensign, D., Friedler, S. A., Neville, S., Scheidegger, C., & Venkatasubramanian, S. (2018). Runaway feedback loops in predictive policing. Proceedings of Machine Learning Research, 81, 160–171.

Eubanks, V. (2018). Automating inequality: How high-tech tools profile, police, and punish the poor. St. Martin’s Press.

European Union. (2016). Directive (EU) 2016/680 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data by competent authorities for the purposes of the prevention, investigation, detection or prosecution of criminal offences. Official Journal of the European Union, L 119, 89–131.

European Union. (2024). Regulation (EU) 2024/1689 of the European Parliament and of the Council of 13 June 2024 laying down harmonised rules on artificial intelligence (Artificial Intelligence Act). Official Journal of the European Union.

Ferguson, A. G. (2012). Predictive policing and reasonable suspicion. Emory Law Journal, 62(2), 259–325.

Ferguson, A. G. (2017). The rise of big data policing: Surveillance, race, and the future of law enforcement. New York University Press.

Garvie, C., Bedoya, A., & Frankle, J. (2016). The perpetual line-up: Unregulated police face recognition in America. Georgetown Law Center on Privacy & Technology.

Grother, P., Ngan, M., & Hanaoka, K. (2019). Face recognition vendor test (FRVT) part 3: Demographic effects (NISTIR 8280). National Institute of Standards and Technology. https://doi.org/10.6028/NIST.IR.8280

Hill, K. (2020, June 24). Wrongfully accused by an algorithm. The New York Times. https://www.nytimes.com/2020/06/24/technology/facial-recognition-arrest.html

Joh, E. E. (2016). The new surveillance discretion: Automated suspicion, big data, and policing. Harvard Law & Policy Review, 10(1), 15–42.

Kehl, D., Guo, P., & Kessler, S. (2017). Algorithms in the criminal justice system: Assessing the use of risk assessments in sentencing. Responsive Communities Initiative, Berkman Klein Center for Internet & Society, Harvard Law School.

Kleinberg, J., Ludwig, J., Mullainathan, S., & Sunstein, C. R. (2018). Discrimination in the age of algorithms. Journal of Legal Analysis, 10, 113–174. https://doi.org/10.1093/jla/laz001

Kleinberg, J., Mullainathan, S., & Raghavan, M. (2017). Inherent trade-offs in the fair determination of risk scores. In C. H. Papadimitriou (Ed.), 8th Innovations in Theoretical Computer Science Conference (ITCS 2017) (Article 43). Schloss Dagstuhl.

Kroll, J. A., Huey, J., Barocas, S., Felten, E. W., Reidenberg, J. R., Robinson, D. G., & Yu, H. (2017). Accountable algorithms. University of Pennsylvania Law Review, 165(3), 633–705.

Lum, K., & Isaac, W. (2016). To predict and serve? Significance, 13(5), 14–19. https://doi.org/10.1111/j.1740-9713.2016.00960.x

Mayson, S. G. (2019). Bias in, bias out. Yale Law Journal, 128(8), 2218–2300.

Mittelstadt, B. D., Allo, P., Taddeo, M., Wachter, S., & Floridi, L. (2016). The ethics of algorithms: Mapping the debate. Big Data & Society, 3(2), 1–21. https://doi.org/10.1177/2053951716679679

National Research Council. (2009). Strengthening forensic science in the United States: A path forward. National Academies Press.

O’Neil, C. (2016). Weapons of math destruction: How big data increases inequality and threatens democracy. Crown.

Pasquale, F. (2015). The black box society: The secret algorithms that control money and information. Harvard University Press.

President’s Council of Advisors on Science and Technology. (2016). Forensic science in criminal courts: Ensuring scientific validity of feature-comparison methods. Executive Office of the President.

R (Bridges) v Chief Constable of South Wales Police, [2020] EWCA Civ 1058.

Richardson, R., Schultz, J. M., & Crawford, K. (2019). Dirty data, bad predictions: How civil rights violations impact police data, predictive policing systems, and justice. New York University Law Review Online, 94, 192–233.

Rudin, C. (2019). Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nature Machine Intelligence, 1(5), 206–215. https://doi.org/10.1038/s42256-019-0048-x

Rudin, C., Wang, C., & Coker, B. (2020). The age of secrecy and unfairness in recidivism prediction. Harvard Data Science Review, 2(1). https://doi.org/10.1162/99608f92.6ed64b30

Selbst, A. D. (2017). Disparate impact in big data policing. Georgia Law Review, 52(1), 109–195.

State v. Loomis, 881 N.W.2d 749 (Wis. 2016).

Wachter, S., Mittelstadt, B., & Russell, C. (2018). Counterfactual explanations without opening the black box: Automated decisions and the GDPR. Harvard Journal of Law & Technology, 31(2), 841–887.

Završnik, A. (2020). Criminal justice, artificial intelligence systems, and human rights. ERA Forum, 20(4), 567–583. https://doi.org/10.1007/s12027-020-00602-0

Downloads

Published

21-12-2023

How to Cite

Ali Shah, S. A. (2023). The Role of Artificial Intelligence in Criminal Investigations: Challenges of Bias, Transparency, and Legal Accountability. Social Science Review Archives, 1(2), 51–69. https://doi.org/10.70670/sra.v1i2.2669