LITMIR.BIZ

2 The Starbuck Case: Methods for Addressing Confirmation Bias in Forensic Authorship Analysis

       Tim Grant and Jack Grieve

      THE STARBUCK CASE

In 2012, we were contacted by Nottinghamshire Police for assistance in a missing persons investigation. Nearly two years previously, Debbie married Jamie Starbuck¹ following a relatively brief courtship. They told the family they had planned to leave the country shortly after the wedding and embark on a two-year around-the-world adventure, financed primarily by Debbie’s savings.

      Over time, however, Debbie’s family grew concerned. She was writing much less regularly and with much less information than had been her practice on previous trips abroad, during which she regularly sent long emails detailing her travels. Getting increasingly worried, they contacted the police, who wrote separately to both Jamie and Debbie’s email addresses and had a brief exchange with both. These emails suggested that the couple had briefly separated but were essentially well. The email exchanges, however, led the police to become suspicious that Jamie was replying not only from his own email address but also from Debbie’s and writing as her. The police instigated a missing persons inquiry locally, nationally, and internationally and approached the Centre for Forensic Linguistics (CFL) at Aston University to seek assistance in analyzing the emails and to determine whether their suspicions were correct.

      THE PROBLEM OF CONFIRMATION BIAS

Since Dror et al.’s (2005, 2006) work gave the issue prominence, confirmation bias in forensic evidence has received considerable attention. Dror’s work on fingerprint examiners (e.g., 2005) and even forensic DNA analysis (2011) demonstrates how the conclusions of honest, competent forensic scientists are subject to cognitive bias and will be influenced by the briefings they are given prior to carrying out their examinations. Dror’s work raises issues as to how such bias can be designed out of forensic practice. The UK Forensic Regulator’s (2015) guidance paper on cognitive bias in forensic evidence examinations discusses the risks and provides methods for risk reduction as well as specific examples across the forensic sciences. For example, with regard to fingerprint examination, the regulator suggests that processes should be examined and adapted to “remove or limit contextual information that adds no tangible value to the fingerprint examination process.” (Forensic Regulator, 2015, 8.5.3b).

      With regard to discussion of the Starbuck case, the question this chapter addresses is the extent to which we can design processes in forensic authorship analysis that address issues of cognitive bias. We do this through the presentation of a specific case – the murder in 2010 of Debbie Starbuck – and of our role in that investigation, and we describe how we attempted to address potential biases through the procedures we adopted and then evaluate the effectiveness of those attempts.

      Forensic authorship analysis is a broad discipline, but the main tasks can be characterized as comparative authorship analysis, where the aim is to provide evidence that helps attribute one or more texts to a particular author by comparison with writings of undisputed authorship (as carried out in the Starbuck case), and author profiling, where the aim is to identify the sociolinguistic background of the writer of a text. (See Grant & MacLeod, 2020, Ch. 6, for a discussion of these and other possible authorship analysis tasks.) Whatever the task, authorship analysis is a lot less secure against cognitive biases than many other forms of forensic examination, and, before turning to the specifics of the case, we examine here why this might be the case.

      First, forensic authorship analysis is largely still the domain of individual experts, working from universities or small consultancies, which typically contain just one or two analysts. From cases reported in the literature, most analyses are carried out by individuals, not as part of an established institutional procedure with quality controls, such as verification of reports and opinions by a second expert. The individualistic nature of authorship analyses leaves them open to potential cognitive biases.

      In terms of approach, there is still some division between analysts who adopt wholly computational approaches to authorship questions, which are sometimes referred to as stylometric approaches, and approaches that rely more on linguistic training and expertise in text analysis, which can be referred to as stylistic approaches. The vulnerability to bias remains whether the analysis is largely computational or depends on an individual’s skills in noticing or eliciting style features that might be indicative of the style of author A or author B, although the nature of this bias can change.

For the stylistic analyst, the risk of bias may be more obvious: unconscious bias can affect decisions to include or exclude a particular feature,

Скачать книгу