Gacono 2001
Gacono 2001
Journal of Personality
Assessment
Publication details, including instructions for
authors and subscription information:
http://www.tandfonline.com/loi/hjpa20
To cite this article: Carl B. Gacono , James L. Loving & Robert H. Bodholdt (2001)
The Rorschach and Psychopathy: Toward a More Accurate Understanding of the
Research Findings, Journal of Personality Assessment, 77:1, 16-38, DOI: 10.1207/
S15327752JPA7701_02
Taylor & Francis makes every effort to ensure the accuracy of all the
information (the “Content”) contained in the publications on our platform.
However, Taylor & Francis, our agents, and our licensors make no
representations or warranties whatsoever as to the accuracy, completeness,
or suitability for any purpose of the Content. Any opinions and views
expressed in this publication are the opinions and views of the authors, and
are not the views of or endorsed by Taylor & Francis. The accuracy of the
Content should not be relied upon and should be independently verified with
primary sources of information. Taylor and Francis shall not be liable for any
losses, actions, claims, proceedings, demands, costs, expenses, damages,
and other liabilities whatsoever or howsoever caused arising directly or
indirectly in connection with, in relation to or arising out of the use of the
Content.
This article may be used for research, teaching, and private study purposes.
Any substantial or systematic reproduction, redistribution, reselling, loan,
sub-licensing, systematic supply, or distribution in any form to anyone is
expressly forbidden. Terms & Conditions of access and use can be found at
http://www.tandfonline.com/page/terms-and-conditions
Downloaded by [University of Miami] at 10:41 07 January 2015
JOURNAL OF PERSONALITY ASSESSMENT, 77(1), 16–38
Copyright © 2001, Lawrence Erlbaum Associates, Inc.
Carl B. Gacono
Austin, Texas
Robert H. Bodholdt
Bastrop, Texas
In this article we present the reader with an understandable essay on the relation be-
tween the Rorschach and psychopathy. Some degree of sophistication and applied
knowledge of the Hare Psychopathy Checklist–Revised (Hare, 1991) and the Ror-
schach (Rorschach, 1921/1942) are necessary to wade through the literature, weigh
the relative merits of arguments made by proponents and detractors of Rorschach as-
sessment, and meaningfully interpret the findings of relevant studies. Often studies
reviewing the Rorschach’s utility in assessing Antisocial Personality Disorder
(American Psychiatric Association, 1994) and psychopathy exhibit a flawed or super-
ficial understanding of essential theoretical and methodological issues. Argument de-
rived from a suspect or specious premise, such as the notion that the Rorschach was
designed or aspires to correspond with formal diagnosis based on the Diagnostic and
Statistical Manual of Mental Disorders (American Psychiatric Association, 1952,
1994), vitiates conclusions based on such a premise. In this article, we discuss theoret-
ical and methodological issues that can aid the reader or reviewer in achieving a more
accurate understanding of this body of research.
Considering reviews of various debates surrounding the utility of the Rorschach (see
dedicated issues of Psychological Assessment (Meyer, 1999, in press), we are some-
times struck by discrepancies between “camps” that presumably have access to the
RORSCHACH AND PSYCHOPATHY 17
same data but interpret those data in largely incompatible ways. We suggest that dif-
ferent interpretations of these same data sets inhere at least partly as a function of
some level of undue skepticism: in other words, what one is willing to see. Over 40
years ago the philosopher Feigl (1959/1992) proposed that resolution of such debate
would require a return to the data, with the exclusion of what he termed “metaphysi-
cal doubt”:
We might show the philosopher that he has illegitimately extended ordinary or empir-
ical doubt and thus fallen into metaphysical doubt. Ordinary empirical doubt may oc-
casionally be hard to settle. But if it is transformed into metaphysical doubt, then there
is no conceivable way of settling it by either logical argument or by empirical demon-
Downloaded by [University of Miami] at 10:41 07 January 2015
more of these issues. This impacts the validity and generalizability of their conclu-
sions. Thus, we endeavor to draw the reader’s attention to a number of potential er-
rors present in certain recent critiques of the Rorschach, with particular attention to
helping the reader achieve informed conclusions regarding the merits of extant
Rorschach psychopathy research.
1Appearing in the first DSM (American Psychiatric Association, 1952), sociopathy included a vari-
ety of conditions such as sexual deviation, alcoholism, and “dyssocial” and “antisocial” reactions. Al-
though only the antisocial reaction was similar to traditional conceptualizations of psychopathy
(Jenkins, 1960), the replacement of sociopathy with ASPD (Antisocial Personality Disorder; American
Psychiatric Association, 1994) in DSM–II (American Psychiatric Association, 1968) and the subse-
quent increased focus on behavioral criteria would widen the gap between ASPD and psychopathy.
RORSCHACH AND PSYCHOPATHY 19
TABLE 1
Comparison of Cleckley’s (1976) 16 Characteristics of Psychopathy and
Diagnostic and Statistical Manual of Mental Disorders–IV (DSM–IV;
American Psychiatric Association, 1994) Diagnostic Criteria
tions,2 so that vastly different individuals are often included together under the um-
brella of this single diagnostic category. Assigning an ASPD label no longer says
anything about whether an individual is psychopathic in the traditional sense.3
2Rogers and Dion (1991) estimated the possible variations in ASPD (Antisocial Personality
Disorder; American Psychiatric Association, 1994) diagnoses for DSM–III (American Psychiatric As-
sociation, 1980) and DSM–III–R (American Psychiatric Association, 1987) combined at roughly 27
trillion. DSM–IV (American Psychiatric Association, 1994) continues to offer a bewildering array of
diagnostic possibilities with 3.2 million variations (Rogers, Salekin, Sewell, & Cruise, 2000).
3Similar to ASPD (Antisocial Personality Disorder; American Psychiatric Association, 1994), the
Conduct Disorder (CD; American Psychiatric Association, 1994) diagnosis relies heavily on behav-
20 GACONO, LOVING, BODHOLDT
lation between ASPD and risk has not been demonstrated (Lyon & Ogloff, 2000).
Understanding that ASPD and psychopathy are distinct (but related) constructs
is critical when evaluating the available Rorschach and psychopathy literature.
Unfortunately, some empirical studies and reviews neglect or misunderstand the
distinction between these two groups, and thus arrive at erroneous conclusions that
will be specifically identified later in the article in the discussion of methodologi-
cal issues.
Psychopathy is used as both a taxon (PCL–R ≥ 30) and a dimensional construct. Di-
mensional uses of the PCL–R are recommended for clinical applications (Bodholdt
et al., 2000; Serin & Brown, 2000; Seto & Lalumiere, 2000). In these contexts, psy-
chopathy is conceptualized as existing along a continuum of severity so that indi-
viduals who obtain higher PCL–R scores exhibit more serious and pervasive
symptoms of psychopathy compared to their lower PCL–R counterparts. Further-
more, a score may best be considered a range of true scores, expanding in both di-
rections by one or more standard errors of measurement depending on the context-
at-large (mitigating vs. aggravating factors such as treatment setting, supervision
and support networks, and coexisting diagnoses including alcohol or other drug de-
pendence) and the imperative to reduce false positives or false negatives—all
within a decision-making paradigm responsive to the specific referral questions for
the individual being assessed (Bodholdt et al., 2000). Clinically, one is more inter-
ested in what ranges of psychopathy are best at predicting behavior than whether a
ioral criteria. It encompasses a heterogeneous group of children and adolescents with community base
rates estimated at 3% to 5% of school-age children (boy to girl ratio = 4:1 to 9:1). Estimates for psy-
chopathy in children and adolescents are thought to be considerably lower (Forth, 1995; Forth, Hart, &
Hare, 1990; Forth & Mailloux, 2000; Frick, Barry, & Bodin, 2000; Frick, O’Brien, Wootton, &
McBurnett, 1994).
RORSCHACH AND PSYCHOPATHY 21
given individual meets the traditional threshold score for a designation of psychop-
athy (PCL–R ≥ 30).
The work of Quinsey, Harris, Rice, and Cormier (1998) exemplifies a dimen-
sional application of PCL–R scores as the Violence Risk Appraisal Guide and Sex
Offensive Risk Appraisal Guide (actuarial measures designed to assist in risk as-
sessment) use differing cutting scores in a weighted manner for predicting vio-
lence and sexual violence risk. In clinical use, psychopathy level, rather than a
diagnosis of psychopathy, becomes one of several weighted factors in decision
making.4 For example, whereas a score of 24 may be the optimal cutoff for deter-
mining the probability of problematic behavior in one particular setting (e.g., a fo-
Downloaded by [University of Miami] at 10:41 07 January 2015
1994) narrative describing ASPD, psychopathy is not a diagnosis within the DSM–IV model.
22 GACONO, LOVING, BODHOLDT
The confusion with dimensional versus taxon uses of the construct are added to
by the new self-report measures of “psychopathy” (Lilienfeld & Andrews, 1996).
These instruments suggest that traits are individually psychopathic, although in re-
ality a psychopathic syndrome is present only when a sufficient number of individ-
ual traits are fully present in aggregate. Mislabeling isolated traits such as self-
centeredness, impulsivity, impaired empathy, irresponsibility, and so forth as in-
herently psychopathic is irresponsible and returns psychology to the pre-1900s
trend of including all personality disorders under the rubric of psychopathy.
Downloaded by [University of Miami] at 10:41 07 January 2015
5Although Forth, Kosson, and Hare (in press) have developed a youth version of the PCL–R
(PCL:YV), and Frick and others (Frick, Barry, & Bodin, 2000) have developed instruments for assess-
ing psychopathic traits in children, the utility of these other methods remains to be demonstrated.
6Although the PCL:SV (Hart, Cox, & Hare, 1995) may eventually prove to be diagnostically useful,
it is less likely that any competent, ethical clinician would ever use a self-report measure for categoriz-
ing someone as psychopathic. Although the majority of MMPI clinical scales were developed by ex-
tracting items endorsed differentially by psychiatric patients belonging to distinct diagnostic groups,
the correspondence between clinical scale elevations and formal diagnosis was found to be less than
originally promised. Thus, among considerably greater assessment information, the MMPI can be seen
as informing diagnosis, not establishing it (see Hathaway and McKinley, 1967).
RORSCHACH AND PSYCHOPATHY 23
ment of an individual in his or her totality. Rorschach critics often focus on dis-
crediting one variable or index, such as the Schizophrenia Index, and cite its
inability to diagnose a specific disorder as an indication that the test lacks any va-
lidity. As clinicians, we are ethically obligated to use a battery of instruments and
multiple methods in forming opinions; our work impacts real people. In this re-
gard, personality tests are subjected to within- and between-instrument evaluation.
No single variable, score, or ratio is interpreted in isolation from history, response
style, and other data (Bannatyne, Gacono, & Greene, 1999). This applies to all per-
sonality tests; no competent clinician would use an elevated MMPI–2 Scale 8, in
isolation from other sources of data, to label someone as schizophrenic.
Downloaded by [University of Miami] at 10:41 07 January 2015
Integrate[s] the results of several carefully selected tests with relevant history infor-
mation and observation … enabl[ing] the sophisticated clinician to form an accurate,
in-depth understanding of the patient; formulate the most appropriate and cost-effec-
tive treatment plan; and later, monitor the course of intervention.” (Meyer et al., 1998,
p. 4)
Bornstein, Berry, and Brunell-Neuleib (1999); and Parker, Hanson, and Hunsley (1988) for an over-
view of issues of reliability and validity of the Rorschach relative to other commonly used tests (see
also Ganellen, 1996).
24 GACONO, LOVING, BODHOLDT
Alternatively,
program evaluation and development. One cannot advocate for testing and expect to
achieve assessment. (Gacono, 2000c, pp. 194–195)
8Psychopathy, as measured by the PCL–R, was initially thought to include two primary factors.
Factor 1 (traits) correlates with Narcissistic and Histrionic Personality Diagnoses and self-report mea-
sures of Machiavellianism and narcissism evidencing negative correlations with Avoidant and
Dependent Personalities, intensity of affect, and anxiety (Hare, 1991). Factor 2 (irresponsible, impul-
sive, thrill-seeking, and antisocial lifestyle) correlates more highly with the DSM–III–R (American
Psychiatric Association, 1987) ASPD diagnosis. Most self-report measures, such as the MMPI–2
(Butcher et al., 1989) and MCMI–III (Millon, 1994), also correlate more strongly with Factor 2 and an
ASPD diagnosis than psychopathy per se.
RORSCHACH AND PSYCHOPATHY 25
dromes (taxa). Personality testing helps to tease out the similarities and differences
among individuals to an extent not possible with the PCL–R alone.
It would be naive to assume that one Rorschach variable, such as the reflection
response, or scale on a self-report measure should ever be used to diagnose a disor-
der such as psychopathy (Gacono & Meloy, 1994). Concerning reflections,
Gacono and Meloy (1994) appropriately emphasized
When interpreted within the context of the entire protocol, analysis of reflections pro-
vides information concerning the self-focusing process, the nature of the libidinal
drive, internalized object relations, and the defensive use of grandiosity and with-
Downloaded by [University of Miami] at 10:41 07 January 2015
produced reflections. Would one concretely interpret that the other half of each
group was not egocentric? This would be empirically inaccurate for the psycho-
paths and two thirds of the sexual homicide perpetrators who, to receive a PCL–R
score greater than 30, had to obtain some scores on Factor 1 that correlates strongly
with narcissism. Similar reasoning would be equally naive to apply to the
pedophile group. What the nomothetic data accurately reflect is that self-focus is a
prominent aspect of each of these syndromes and behavioral disorders. The Ror-
schach accurately portrays each of these groups as manifesting more of this trait
than expected in nonpatients or even other patient groups in which pathological
self-focus is not an associated trait. It does not suggest that in the absence of a re-
Downloaded by [University of Miami] at 10:41 07 January 2015
METHODOLOGICAL ISSUES
The recent review by Wood et al. (2000) highlighted several of the problems inher-
ent in critiques of Rorschach and psychopathy research. By demonstrating an ap-
parent misunderstanding of certain methodological issues, and by citing several
studies that demonstrate such methodological concerns to support their conclu-
sions, the authors run the risk of confusing or misinforming the reader.9 Our use of
individual studies to highlight methodological problems does not detract from
those studies, particularly in the case of dissertations in which students may be
9Wood and certain colleagues (Wood et al., 1999a, 1999b) have been criticized for similar errors as
were not sufficiently careful in their scholarship (e.g., the erroneous citations), were not
aware of some key literature on a topic (e.g., the composite variables), presented a limited
and slanted portrayal of relevant issues and evidence, … and repeatedly dismissed correc-
tive feedback. (Meyer, 2000, p. 77)
RORSCHACH AND PSYCHOPATHY 27
faced with limitations involving data availability, the knowledge base of their com-
mittee members, and even politics surrounding the dissertation process. We com-
mend rather than criticize their research efforts. However, when these findings are
used to discredit well-designed studies, then they must be subjected to greater
scrutiny.
The most persistent difficulty, both inherent in the Wood et al. (2000) review
and elsewhere, involves studying overly inclusive (sometimes ambiguously de-
fined) samples and then generalizing findings to the discussion of psychopathy. At
the extreme, there are studies that investigate samples defined solely on the basis
of a low baseline or extreme behaviors, such as groups of individuals who have
Downloaded by [University of Miami] at 10:41 07 January 2015
committed murder or engaged in other forms of violence (see, e.g., Greco & Cor-
nell, 1992; Kaser-Boyd, 1993). It is not surprising that these studies often produce
mixed or negative results, as participants under study comprise extremely hetero-
geneous groups that may be connected to each other by little more than the perfor-
mance of a single violent act. Similarly, studies are available in the literature that
use less extreme but no less heterogeneous groups for comparison. Pinto (1999),
for example, conducted a Rorschach study of aggressive versus nonaggressive
boys, all of whom had been diagnosed with either CD or oppositional defiant dis-
order (ODD; American Psychiatric Association, 1994). Not surprisingly, she
found no differences across groups with respect to any Rorschach variables stud-
ied, and she did not find any differences across groups in terms of self-reported at-
tachment to parents or to peers.
Similarly, in support of their conclusions, Wood et al. (2000) cited studies
whose results are not directly generalizable to the discussion of psychopathy, or
even ASPD and CD. For instance, Long (1995) and Karfgin (1988/1989) both
studied broadly defined samples of adolescent inpatients with conduct problems
by comparing their Rorschachs with those of other adolescent inpatients without
conduct problems. Not surprisingly, practically no findings were revealed to sup-
port the use of the Rorschach in distinguishing participants with conduct problems
from those without such problems. Another study cited by Wood et al. in this con-
text is that of Archer and Krishnamurthy (1997), who combined adolescents who
had been assigned any of three diagnostic categories (i.e., CD, ODD, adjustment
disorder with disturbance of conduct) into a single conduct-disordered group, then
compared these participants with non-conduct-disordered adolescents. Again, the
authors found no Rorschach differences across groups. To their credit, Wood et al.
acknowledged that “Archer and Krishnamurthy’s approach of combining several
different diagnostic groups into one broadly defined group is potentially problem-
atic. It is possible that the findings might have been different if data had been ex-
amined separately for patients with a narrowly defined diagnosis of Conduct
Disorder” (p. 412). However, their treatment of the Archer and Krishnamurthy
study is potentially misleading. This is because they cite it in conjunction with
Weber, Meloy, and Gacono (1992) when they stated “Only two published studies
28 GACONO, LOVING, BODHOLDT
with comparison groups have examined the relationship of the Rorschach to CD”
(p. 412). They then proceeded to describe positive findings of the Weber et al.
(1992) study, followed by the negative results of Archer and Krishnamurthy. Al-
though Wood et al. suggested the results of these two studies are contradictory, in
fact they may not be because the former found the Rorschach to be useful when CD
diagnosis was the inclusion criterion, whereas the latter study found nonsupportive
results in a sample defined by more broadly defined criterion.
Other Rorschach or psychopathy investigations have employed an ASPD or
CD diagnosis as the relevant inclusion criterion (see Howard, 1998/1999). At best,
these studies include appropriate comparison groups of similar individuals who
Downloaded by [University of Miami] at 10:41 07 January 2015
lack the ASPD (or CD) diagnosis, and when this is true, they sometimes yield re-
sults that are supportive of the Rorschach’s ability to assist in assessment of impor-
tant personality traits (e.g., finding significantly fewer Y, T, and Pure H responses
in the Rorschachs of adolescents with CD versus dysthymia in Weber et al., 1992).
Still, use of ASPD or CD often yields mixed or negative results because as dis-
cussed earlier, these DSM categories are too heterogeneous to expect consistently
positive findings. The use of CD or ASPD as the sole independent measure for
group inclusion in a research design invites similar criticisms to the use of Exner’s
(see Exner, Kinder, & Curtis, 1995) nonpatient Rorschach data as the definitive
comparison data. A study formed on the hypothesis that a group of inmates with
ASPD would differ substantially from other inmates ignores the heterogeneity of
this diagnostic category and its overlap with other DSM Cluster B disorders. Thus,
the most likely outcome is what should have been easily predicted: no significant
differences. Researchers or critics operating under this assumption are likely to be
quite disappointed in the failure of their findings to differentiate among partici-
pants, only to be cited by detractors of Rorschach studies as evidence of some kind
of unexpected finding.10
This is one weakness of the Howard (1998/1999) unpublished dissertation that is
cited by Wood et al. (2000) as evidence of failed replication of findings related to the
paucity of T in ASPDs. A heterogeneous group of ASPD offenders was compared to
other inmates. There was no attempt to control for the presence or absence of charac-
ter pathology in the non-ASPD group. Assuredly, Howard’s (1998/1999) non-
ASPD participant group contained similar traits to the participants with ASPD (par-
ticularly if there are few, if any, psychopaths among those with ASPD) and may have
actually included some participants with ASPD who were not diagnosed as such at
10This does not negate the possibility that ASPD (Antisocial Personality Disorder; American Psy-
chiatric Association, 1994) may contribute to some measurable differences when compared to
noncharacterological participants, such as a comparison of schizophrenics with and without ASPD
(Gacono & Meloy, 1994).
RORSCHACH AND PSYCHOPATHY 29
the time of testing. The Howard dissertation is an interesting descriptive study, but is
not generalizable and offers little to understanding either ASPD or psychopathy.
It is unrealistic to expect the Rorschach or any other instrument to yield positive
findings with respect to assessing the dimensional features of psychopathy unless
scores from the PCL–R are used as the independent variable to categorically dis-
tinguish psychopaths from nonpsychopaths or to delineate multiple (i.e., three)
levels of severity for comparison. The majority of the studies (Gacono, 1990;
Gacono & Meloy, 1991, 1992, 1994; Gacono, Meloy, & Heaven, 1990; Meloy &
Gacono, 1992) erroneously “set aside” by Wood et al. (2000) for “fail[ing] to use
adequate comparison groups” (p. 411) in actuality used the relevant independent
Downloaded by [University of Miami] at 10:41 07 January 2015
Peaslee et al.’s (1992) choice of ≥ 27 as a cutoff score for their female primary psy-
chopathy group when comparing across gender is curious. The medium split method
had been used (infrequently) in other studies with all male participants where the psy-
chopathy range was skewed to the low end. This procedure can increase the number of
participants in the high group for better statistical comparison. The lower cutoff does
not affect a comparison of mean PCL-scores between groups (total PCL–R score
comparison) or comparison of subgroups within a larger group (high, moderate, low).
We, however, caution against the use of different cut-off scores when independent
group comparisons are made with dependent variables such as Rorschach variables.
Findings are suspect as the independent measure may not be equal. (p. 102)
Using the appropriate PCL–R cutoff score, however, does not ensure study
generalizability. Although a PCL–R cutoff score greater than 30 is one important
factor in establishing groups, those scores that fall in the moderate ranges may
30 GACONO, LOVING, BODHOLDT
can statistically wash out true between-group differences (see A. Smith, 1994).
Just as there is a problem with generalizing the results of studies that employ
overly inclusive samples or differing PCL–R cutoff scores, there is a similar con-
cern in Rorschach or psychopathy studies that use the PCL–R as an independent
measure of psychopathy with female participants. By referring to a number of such
studies that include female participants, Wood et al (2000) discussed results in a
way that is akin to “mixing apples with oranges.” Psychopathy likely manifests
somewhat differently across genders, so that the salient characteristics (as mea-
sured by personality instruments) found in male psychopaths differ somewhat
from those in female psychopaths (Gacono & Meloy, 1994). Peaslee et al.’s (1992)
work was useful in understanding the confluence of Rorschach findings with the-
ory in women with ASPD, highlighting the similarities between borderline and an-
tisocial women, suggesting differences between male and female psychopaths,
and providing some concurrent validity for the use of the PCL–R with women;
however, lowering the PCL–R cutoff score to designate female psychopathy ne-
cessitates caution when comparing her findings to studies of actual psychopaths
(PCL–R ≥ 30). Despite caution, the reduction in reflection responses found in
Peaslee et al.’s original work might actually reflect theoretically, and recently de-
rived, differences between male and female psychopaths (Cunliffe, Gacono, &
Hibbard, 2000; S. Smith & Gacono, 2000). Why Peaslee (1995) reanalyzed the
original data for inclusion in her dissertation after obtaining significant gender dif-
ferences with the first analysis (Peaslee et al., 1992) is unknown.
Of more serious concern is the evaluation of studies that include male and female
participants in a single comparison group. This is true of the Ponder (1998) disserta-
tion cited in Wood et al. (2000). In an investigation of incarcerated juvenile offend-
ers, Ponder used PCL:YV scores as an independent measure of psychopathy. This is
a strength for the reasons discussed previously, but she combined male and female
juveniles in her sample (n = 43 and n = 7, respectively). Without taking into account
the possible intergender differences in expression of psychopathy, the negative Ror-
schach findings of her study are difficult to interpret. Although they may certainly
speak to poor utility of the Rorschach in this sample, there are other more fundamen-
tal methodological concerns that more likely account for these results.
RORSCHACH AND PSYCHOPATHY 31
hood or adolescence, and consequently are not accessed in the same manner through
personality testing. Although Wood et al. (2000) did not entertain the latter hypothe-
sis when discussing mixed results of Rorschach or youth psychopathy studies, this
conclusion would be consistent with the findings of Loving (1998; see also Loving
& Russell, 2000), who found certain core features of psychopathy (i.e., pathological
narcissism and attachment difficulties, as evidenced by elevations in reflections and
absence of texture, respectively) to effectively differentiate across levels of psy-
chopathy in male adolescents.11
Finally, there are other more fundamental methodological shortcomings that
limit the applicability of some studies. One such concern involves inappropriate
use of the PCL and is exemplified by the Ponder (1998) dissertation. To identify
psychopaths, Ponder utilized a modified version of the unpublished PCL:YV,
which involved omitting two items and then prorating total scores. The omission
of these two items is especially relevant in the context of a Rorschach study, as
both the omitted PCL:YV items load onto Factor 1 and are especially salient to the
kinds of features the Rorschach is most apt to assess. Use of this highly unusual
method makes the Ponder findings uninterpretable beyond her sample. Although
there is a tested procedure for modifying the published PCL–R for use with adoles-
cents (see A. Smith et al., 1995), there is none for Ponder’s modification of the un-
published PCL:YV. An additional methodological concern of the same study is the
application of inappropriate statistical procedures to the analysis of certain Ror-
schach data, including the reflection response.
An evaluation of the Rorschach or psychopathy studies and their
generalizability at minimum requires consideration of the following (for addi-
tional cautions, see Exner, 1995):
tive of noncentral (e.g., m, FD, V, S) features common in psychopaths showed nonsignificant trends in
the expected directions. It is possible that these additional variables are related to personality character-
istics that are not fully developed (and thus not readily detectable through testing) until adulthood.
32 GACONO, LOVING, BODHOLDT
CONCLUSIONS
The evaluation of the Rorschach or psychopathy literature requires much greater so-
phistication than understanding the psychometric properties of the individual tests.
When key issues such as the differences between ASPD and psychopathy, the impli-
cations of taxon versus dimensional uses of psychopathy, the fundamental differ-
ences between psychological assessment and diagnosis, and the various confounds
and methodological issues related to psychopathy and Rorschach research are not
RORSCHACH AND PSYCHOPATHY 33
Meloy and Gacono (2000) were correct when they stated “The Rorschach is
ideally suited for contributing to the assessment of psychopathy” (p. 236) and “We
have validated the use of the Rorschach as a sensitive instrument to discriminate
between psychopathic and nonpsychopathic (ASPD) subjects ” (p. 237).12 Certain
Rorschach variables, in well-designed studies, appear to have some level of
discriminative strength in differentiating psychopathic ASPDs from
nonpsychopathic ASPDs within the nomothetic paradigm inherent to the necessar-
ily quasi-experimental (i.e., nonrandom assignment to group) designs used in the
studies described. It should be clear to any reader that the Rorschach was never de-
signed to establish a diagnosis of psychopathy, but rather the Rorschach can and
does contribute valuable information to the assessment process.
When reviewing Gacono & Meloy (1994) and other well-designed studies—and
not taking isolated comments out of context—what can be seen is that the Rorschach
has been useful in providing nomothetic data consistent with the differences be-
tween ASPD and psychopathy (psychopaths being more detached and self-focused;
Gacono & Meloy, 1991; Gacono et al., 1992; Gacono et al., 1990; Loving, 1998; A.
Smith et al., 1995; Young et al., 2000). Idiographically, we have provided ample
guidance and suggestions for the integration of Rorschach data in aiding our under-
standing of ASPD and psychopathic individuals (Gacono, 1998; Meloy & Gacono,
1995). Future research may demonstrate that the Rorschach, along with other instru-
ments such as the MMPI–2, will be useful in defining subgroups among PCL–R de-
lineated psychopaths (Gacono, 1997, 1998, 2000c). It should be noted, however,
that although the Rorschach aids in assessing ASPD and psychopathy and perhaps,
someday, delineating subgroups among these groups, it would never be used to ren-
der a diagnosis of ASPD or psychopathy as the DSM and the PCL–R were designed
for and are well-suited to those aspects of assessment.
Resonant with the logic of Feigl (1959/1992), Weiner (in press) wrote
12Note that these statements occur in the context of discussing the relative contributions of other
psychological testing, such as the MMPI–2, and their respective roles in assessing psychopathy.
34 GACONO, LOVING, BODHOLDT
Scientific debate often proceeds with one side arguing that something is so or some-
thing works, while the other side argues that it is not so or does not work. If the propo-
nents base their arguments on accumulating evidence of its efficacy, and the
opponents base their arguments on being unconvinced by this evidence there comes a
time when being unconvinced exceeds the boundaries of appropriate skepticism.
Those who take issue with the abundant and compelling evidence that Rorschach as-
sessment works very well indeed for certain purposes for which it is intended must
sooner or later present equally abundant and compelling evidence that it does not
work for these purposes, or else put their case to rest. (p. 31)
When key assumptions underlying a “critical review” are based on erroneous pre-
Downloaded by [University of Miami] at 10:41 07 January 2015
ACKNOWLEDGMENTS
This study was, in part, supported by Forensis, Inc. We thank Greg Meyer, Irving
Weiner, and Lynne Bannatyne for their helpful comments and suggestions. The
views expressed in this article are solely those of the authors.
REFERENCES
American Psychiatric Association. (1952). Diagnostic and statistical manual of mental disorders.
Washington, DC: Author.
American Psychiatric Association. (1968). Diagnostic and statistical manual of mental disorders (2nd
ed.). Washington, DC: Author.
American Psychiatric Association. (1980). Diagnostic and statistical manual of mental disorders (3rd
ed.). Washington, DC: Author.
American Psychiatric Association. (1987). Diagnostic and statistical manual of mental disorders (3rd
ed., rev.). Washington, DC: Author.
American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th
ed.). Washington, DC: Author.
Archer, R., & Krishnamurthy, R. (1997). MMPI–A and Rorschach indices related to depression and
conduct disorder: An evaluation of the incremental validity hypothesis. Journal of Personality As-
sessment, 69, 517–533.
Atkinson, L. (1986). The comparative validities of the Rorschach and MMPI: A meta-analysis. Cana-
dian Psychology, 27, 238–247.
Bannatyne, L., Gacono, C. B., & Greene, R. (1999). Differential patterns of responding among three
groups of chronic, psychotic, forensic outpatients. Journal of Clinical Psychology, 55, 1553–1565.
Bodholdt, R., Richards, H., & Gacono, C. B. (2000). Assessing psychopathy in adults: The Psychop-
athy Checklist–Revised and Screening Version. In C. B. Gacono (Ed.)., The clinical and forensic
assessment of psychopathy: A practitioner’s guide (pp. 55–86). Mahwah, NJ: Lawrence Erlbaum
Associates, Inc.
Bridges, M., Wilson, J., & Gacono, C. B. (1998). A Rorschach investigation of defensiveness, self-per-
ception, interpersonal relations, and affective states in incarcerated pedophiles. Journal of Personal-
ity Assessment, 70, 365–385.
Butcher, J. N., Dahlstrom, W. G., Graham, J. R., Tellegen, A., & Kaemmer, B. (1989). MMPI–2: Minne-
sota Multiphasic Personality Inventory–2: Manual for administration and scoring. Minneapolis:
University of Minnesota Press.
RORSCHACH AND PSYCHOPATHY 35
Cleckley, H. (1976). The mask of sanity (6th ed.). St. Louis, MO: Mosby.
Cunliffe, T., Gacono, C. B., & Hibbard, S. (2000, March). Personality characteristics of incarcerated
women. In J. Porcerelli (Chair), Use of the Rorschach and TAT with antisocial personality and psy-
chopathy. Society for Personalty Assessment meeting, Albuquerque, NM.
Davis, R. D. (1999). Millon: Essentials of his science, theory, classification, assessment, and therapy.
Journal of Personality Assessment, 72, 330–352.
Exner, J. E., Jr. (1993). The Rorschach: A comprehensive system: Vol. 1. Basic foundations (3rd ed.).
New York: Wiley.
Exner, J. E., Jr. (Ed.). (1995). Issues and methods in Rorschach research. Mahwah, NJ: Lawrence
Erlbaum Associates, Inc.
Exner, J. E., Jr., Kinder, B., & Curtis, G. (1995). Reviewing basic design features. In J. E. Exner Jr. (Ed.),
Issues and methods in Rorschach research (pp. 145–158). Mahwah, NJ: Lawrence Erlbaum Associ-
Downloaded by [University of Miami] at 10:41 07 January 2015
ates, Inc.
Feigl, H. (1992). Philosophical embarrassments of psychology. In R. Miller (Ed.), The restoration of di-
alogue: Readings in the philosophy of clinical psychology (pp. 34–49). Washington, DC: American
Psychological Association.
Forth, A. (1995). Psychopathy and young offenders: Prevalence, family background, and violence.
Ottawa, Canada: Ministry of the Solicitor General of Canada.
Forth, A., Hart, S., & Hare, R. (1990). Assessment of psychopathy in male young offenders. Psychologi-
cal Assessment: A Journal of Consulting and Clinical Psychology, 2, 342–344.
Forth, A., Kosson, D., & Hare, R. (in press). Hare Psychopathy Checklist: Youth Version. North
Tonawanda, NY: Multi-Health Systems.
Forth, A., & Mailloux, D. (2000). Psychopathy in youth: What do we know? In C. B. Gacono (Ed.), The
clinical and forensic assessment of psychopathy: A practitioner’s guide (pp. 25–54). Mahwah, NJ:
Lawrence Erlbaum Associates, Inc.
Frick, P., Barry, C., & Bodin, D. (2000). Applying the concept of psychopathy to children: Implications
for the assessment of antisocial youth. In C. B. Gacono (Ed.), The clinical and forensic assessment of
psychopathy: A practitioner’s guide (pp. 3–24). Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
Frick, P., O’Brien, B., Wootton, J., & McBurnett, K. (1994). Psychopathy and conduct problems in chil-
dren. Journal of Abnormal Psychology, 103, 700–707.
Gacono, C. B. (1990). An empirical study of object relations and defensive operations in antisocial per-
sonality disorder. Journal of Personality Assessment, 54, 589–600.
Gacono, C. B. (1997). Borderline personality organization, psychopathy, and sexual homicide: The case
of Brinkley. In R. Meloy, M. Acklin, C. B. Gacono, J. Murray, & C. Peterson (Eds.), Contemporary
Rorschach interpretation (pp. 217–238). Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
Gacono, C. B. (1998). The use of the Psychopathy Checklist–Revised (PCL–R) and Rorschach in treat-
ment planning with antisocial personality disordered patients. International Journal of Offender
Therapy and Comparative Criminology, 42, 49–64.
Gacono, C. B. (2000a). Appendix C: The use of the Psychopathy Checklist–Revised (PCL–R) and Ror-
schach in treatment planning with antisocial personality disordered patients. In C. B. Gacono (Ed.),
The clinical and forensic assessment of psychopathy: A practitioner’s guide (pp. 409–421).
Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
Gacono, C. B. (Ed.). (2000b). The clinical and forensic assessment of psychopathy: A practitioner’s
guide. Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
Gacono, C. B. (2000c). Suggestions for the implementation and use of the Psychopathy Checklists in fo-
rensic and clinical practice. In C. B. Gacono (Ed.), The clinical and forensic assessment of psychop-
athy: A practitioner’s guide (pp. 175–202). Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
Gacono, C. B., & Hutton, H. (1994). Suggestions for the clinical and forensic use of the Hare Psy-
chopathy Checklist–Revised (PCL–R). International Journal of Law and Psychiatry, 17,
303–317.
Gacono, C. B, & Meloy, R. (1991). A Rorschach investigation of attachment and anxiety in antisocial
personality disorder. The Journal of Nervous and Mental Disease, 179, 546–552.
36 GACONO, LOVING, BODHOLDT
Gacono, C. B., & Meloy, R. (1992). The Rorschach and the DSM–III–R antisocial personality: A tribute
to Robert Lindner. Journal of Clinical Psychology, 48, 393–485.
Gacono, C. B., & Meloy, R. (1994). The Rorschach assessment of aggressive and psychopathic person-
alities. Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
Gacono, C. B., Meloy, R., & Berg, J. (1992). Object relations, defensive operations, and affective states
in narcissistic, borderline, and antisocial personality. Journal of Personality Assessment, 59, 32–49.
Gacono, C. B., Meloy, R., & Bridges, M. (2000). A Rorschach comparison of psychopaths, sexual homi-
cide perpetrators, and nonviolent pedophiles: Where angels fear to tread. Journal of Clinical Psy-
chology, 56, 757–777.
Gacono, C. B., Meloy, R., & Heaven, T. (1990). A Rorschach investigation of narcissism and hysteria in
antisocial personality disorder. Journal of Personality Assessment, 55, 270–279.
Gacono, C. B., Meloy, R., Sheppard, K., Speth, E., & Roske, A. (1995). A clinical investigation of ma-
Downloaded by [University of Miami] at 10:41 07 January 2015
lingering and psychopathy in hospitalized insanity acquittees. Bulletin of the American Academy of
Psychiatry and the Law, 23, 1–11.
Gacono, C. B., Meloy, R., Speth, E., & Roske, A. (1997). Above the law: Escapes from a maximum se-
curity forensic hospital and psychopathy. Bulletin of the American Academy of Psychiatry and the
Law, 25, 547–550.
Gacono, C. B., Nieberding, R., Owen, A., Rubel, J., & Bodholdt, R. (2001). Treating juvenile and adult
offenders with conduct-disorder, antisocial, and psychopathic personalities. In J. B. Ashford, B. D.
Sales, & W. H. Reid (Eds.), Treating adult and juvenile offenders with special needs (pp. 99–129).
Washington, DC: American Psychological Association.
Ganellen, R. (1996). Comparing the diagnostic efficiency of the MMPI, MCMI–II, and Rorschach: A
review. Journal of Personality Assessment, 67, 219–243.
Greco, C., & Cornell, D. (1992). Rorschach object relations of adolescents who committed homicide.
Journal of Personality Assessment, 59, 574–583.
Hare, R. D. (1991). The Hare Psychopathy Checklist–Revised manual. North Tonawanda, NY: Multi-
Health Systems.
Harris, G. T., Rice, M. E., & Cormier, C. A. (1991). Psychopathy and violent recidivism. Law and Hu-
man Behavior, 15, 625–637.
Hart, S., Cox, D., & Hare, R. (1995). The Hare Psychopathy Checklist–Screening Version manual.
North Tonawanda, NY: Multi-Health Systems.
Hathaway, S. R., & McKinley, J. C. (1967). The Minnesota Multiphasic Personality Inventory, manual.
New York: Psychological Corporation.
Heaven, T. (1988). Relationship between Hare’s Psychopathy Checklist and selected Exner Rorschach
variables in an inmate population. Unpublished doctoral dissertation, United States International
University, San Diego, CA.
Heilbrun, K., Hart, S., Hare, R., Gustafson, D., Nunez, C., & White, A. (1998). Inpatient and post-dis-
charge aggression in mentally disordered offenders: The role of psychopathy. Journal of Interper-
sonal Violence, 13, 514–527.
Hiller, J., Rosenthal, R., Bornstein, R., Berry, D., & Brunell-Neuleib, S. (1999). A comparative meta-
analysis of Rorschach and MMPI validity. Psychological Assessment, 11, 278–296.
Howard, W. (1999). The utility of selected Rorschach indices of distress and attachment for differential
diagnosis in a forensic setting (Doctoral dissertation, Georgia State University, 1998). Dissertation
Abstracts International, 59, 5578B.
Jenkins, R. (1960). The psychopathic or antisocial personality. Journal of Nervous and Mental Disease,
131, 318–334.
Karfgin, L. (1989). Conduct disorder and depression in adolescence (Doctoral dissertation, University
of Maryland Baltimore County, 1988). Dissertations Abstracts International, 49, 4575B.
Kaser-Boyd, N. (1993). Rorschachs of women who commit homicide. Journal of Personality Assess-
ment, 60, 458–470.
RORSCHACH AND PSYCHOPATHY 37
Lilienfeld, S., & Andrews, B. (1996). Development and preliminary validation of a self-report measure
of psychopathic personality traits in noncriminal populations. Journal of Personality Assessment,
66, 488–534.
Long, J. (1995). A comparative study between the Rorschach and MMPI–A in predicting symptoms and
behaviors with inpatient adolescents (Doctoral dissertation, University of Tulsa, 1995). Disserta-
tions Abstracts International, 56, 3452B.
Loving, J. (1998). Selected Rorschach variables of psychopathic male juvenile offenders (Doctoral dis-
sertation, Widener University, 1998). Dissertation Abstracts International, 59, 0878B.
Loving, J., & Russell, W. (2000). Selected Rorschach variables of psychopathic juvenile offenders.
Journal of Personality Assessment, 75, 126–142.
Lyon, D., & Ogloff, J. (2000). Legal and ethical issues in psychopathy assessment. In C. B. Gacono
(Ed.), The clinical and forensic assessment of psychopathy: A practitioner’s guide (pp. 139–174).
Downloaded by [University of Miami] at 10:41 07 January 2015
Quinsey, V., Harris, G., Rice, M., & Cormier, C. (1998). Violent offenders: Appraising and managing
risk. Washington, DC: American Psychological Association.
Rice, M., Harris, G., & Cormier, C. (1992). Evaluations of a maximum security therapeutic community
for psychopaths and other mentally disordered offenders. Law and Human Behavior, 16, 399–412.
Robbins, L. (1966). Deviant children grown up. Baltimore: Williams & Wilkens.
Rogers, R. (1986). Structured interview of reported symptoms (SIRS). Toronto, Canada: Clarke Institute
of Psychiatry.
Rogers, R. (1995). Diagnostic and structured interviewing: A handbook for psychologists. Odessa, FL:
Psychological Assessment Resources.
Rogers, R., & Dion, K. (1991). Rethinking the DSM–III–R diagnosis of antisocial personality disorder.
Bulletin of the American Academy of Psychiatry and Law, 19, 21–31.
Rogers, R., Salekin, R., Sewell, K., & Cruise, K. (2000). Prototypical analysis of antisocial personality
Downloaded by [University of Miami] at 10:41 07 January 2015
Carl B. Gacono
P.O. Box 140633
Austin, TX 78714
E-mail: drcarl14@aol.com