Nihms 1834971
Nihms 1834971
Author manuscript
Arch Suicide Res. Author manuscript; available in PMC 2023 October 01.
Author Manuscript
Abstract
Background: The exploration of inter- and intra-individual variability in suicidal ideation (SI)
is vital to suicide research. However, this research relies on the identification and measurement of
standardized SI characteristics.
Objective: This review aimed to identify characteristics of SI examined in research, describe how
these characteristics are measured, and assess how they are aligned with those included in the
Columbia Suicide Severity Rating Scale (C-SSRS).
Methods: Four databases were systematically searched, and relevant data was extracted. The
C-SSRS provided a framework for comparing SI names, measures and operational definitions.
Results: After comparing operational definitions of identified characteristics, five core domains
Author Manuscript
Keywords
Author Manuscript
Correspondence: Katherine W. Reeves, University of California, San Francisco, 2 Koret Way, San Francisco CA.,
katie.reeves@ucsf.edu.
CONFLICT OF INTEREST
The authors declare that they have no conflict of interest.
Reeves et al. Page 2
INTRODUCTION
Author Manuscript
Suicide is a growing public health concern in the United States (US). It is the 10th leading
cause of death among adults (Centers for Disease Control &Prevention [CDC], n.d.) and
the 2nd leading cause of death among those age 10–30 (Curtin & Heron, 2019). Death by
suicide claimed more than 47,000 American lives in 2017 (CDC, n. d.), and continues to
rise rapidly across all demographics (Hedegaard et al., 2020). Between 1999 and 2018, rates
of suicide in US adults increased 35%, (Hedeegard et al., 2020) and, between 2007 and
2017, more than doubled among young people age 10–24 (Curton & Heron, 2019). Recent
evidence suggests that the failure of suicide prevention efforts may be due to a lack of
understanding surrounding the experience of suicidal ideation (SI), one of suicide’s strongest
predictors (Klonsky et al., 2016).
The National Institute on Mental Health (National Institution on Mental Health [NIMH],
Author Manuscript
n.d.) defines SI as “thinking about, considering or planning suicide” (NIMH, n.d.). SI rates
are highest among US high school students, with about 20% reporting having seriously
considering suicide in 2018 (Ivey-Stephenson, 2020). However, the COVID-19 crisis has
greatly impacted the mental health of Americans. Prior to the emergence of COVID-19, SI
occurred in about four percent of American adults at any given time (Czeisler et al., 2020).
In June 2020, these rates more than doubled to about 11% (Czeisler et al., 2020), further
suggesting that the burden of suicide in the US is increasing.
SI research has primarily focused on identifying risk for SI, as well as identifying who,
among those who experience SI, are at risk for suicidal behavior (SB), which includes
suicide attempts and death by suicide. Despite a research emphasis on suicide prevention in
the US, there has been no substantial progress over the last 50 years in the ability to predict
Author Manuscript
who is at risk for SB among those with SI (Franklin et al., 2017). Although predicting risk
is vital to preventing suicide, our ability to do so may be limited by what we know about the
experience of SI itself.
these scales have demonstrated validity in measuring suicide risk and sometimes include
questions regarding characteristics of the SI experience, they do not typically delineate
specific SI characteristics or offer subscales for such characteristics. For example, one
individual may have continuous and intense suicidal thoughts, but has varying levels of
intent to act on those thoughts. In contrast, another individual may have short bursts of
suicidal thought in which intent spikes, offset by moments of no intent between bouts. The
distinct characteristics within these two experiences are not likely represented in a single
Arch Suicide Res. Author manuscript; available in PMC 2023 October 01.
Reeves et al. Page 3
score yet may have enormous implications for their suicide risk or points of intervention.
Author Manuscript
In an effort to move beyond homogeneity, some recent studies have alluded to the presence
of SI subtypes (Bernanke et al., 2017; Kleinman et al., 2017; Rizk et al., 2018; Oquendo
et al., 2008). Subtyping has become popular in depression research as groups of people
with similar sets of depressive symptoms often share etiological mechanisms of the disorder
and similar responses to specific treatments. This approach can lead to scientific advances
such as empirically based etiological theory and precisely targeted interventions. Depression
and suicide, although related, have one relevant distinction. Depression is a diagnosis or
Author Manuscript
disorder identified in the DSM-V, with a set of subsequent symptoms, whereas SI is not.
Although experts have made the case to include SI as a diagnosis in the DSM (Oquendo
et al., 2008), SI has predominately been classified as one of depression’s symptoms and
has no identified set of unique characteristics. The lack of agreed upon characteristics
makes the process of subtyping more challenging for researchers. Identifying a standardized
set of SI characteristics could shed light on the nature of such SI symptoms and assist
in identifying SI subtypes. Elaboration of SI characteristics would also allow for the
quantitative measurement of nuance in the SI experience on the individual level, leading
to more accurate, precision-based results and improved efficacy of personalized suicide
prevention interventions (Odgers & Jensen, 2020; Rabasco & Sheehan, 2021).
Recently an important body of research has begun to examine SI at the individual level.
Author Manuscript
These investigators propose that data collected at the interindividual (group) level are
largely not generalizable to the individual in suicide research. Fisher et al. (2018) argue
that group-based findings are only generalizable to the individual when the distribution of
the phenomenon is from a sufficiently large sampling of random points, and that lack of this
more individualized focus in research will likely result in flawed theory and systematically
biased clinical assessments. Rather than looking for predictors of SI across large groups,
this cadre of emerging researchers acknowledge SI’s heterogeneity, both between and within
individuals, mostly by using intensive longitudinal methodologies (Rabasco & Sheehan,
2021). Intensive longitudinal studies repeat measures frequently (at least daily) in order to
identify within person changes and get an accurate understanding of how suicidal thoughts
evolve over time (Shiffman et al., 2008; Rabasco & Sheehan, 2021). With these methods,
researchers can better describe the experience of SI, as well as address when individuals
Author Manuscript
may be more at risk for suicide, informing more precise safety assessments and clinical
interventions.
The purpose of this review was to identify SI characteristics that are measured in this
progressive literature. We synthesized how these characteristics are named, measured and
defined across studies. From our findings we generate recommendations for future SI
research regarding nomenclature, definition, and measurement of SI characteristics. A
Arch Suicide Res. Author manuscript; available in PMC 2023 October 01.
Reeves et al. Page 4
standardized approach in these areas could enhance more accurate and reliable measurement
Author Manuscript
provide a structure for comparing and analyzing nomenclature, measures, and definitions of
SI characteristics reported in the literature.
Aims
1. Identify specific characteristics of suicidal ideation (SI) that have been examined
in research.
METHODS
This systematic review followed guidelines published by the Preferred Reporting Items for
Systematic Review and Meta-Analyses (Moher et al., 2009). No protocol was registered.
Eligibility Criteria
All studies published on or before June 1st, 2020 that met the following criteria were
included in this review.
Inclusion Criteria:
1. Original research published in peer reviewed journals.
population.
Exclusion Criteria:
1. Articles that were not published in English.
Arch Suicide Res. Author manuscript; available in PMC 2023 October 01.
Reeves et al. Page 5
As this is the first literature review to analyze SI characteristics and in order to delineate
the full body of literature, no publication dates were specified for inclusion. For the same
reasons, no specific populations (e.g., age groups) were targeted.
Search Strategy
The following databases were searched for relevant articles on June 1st, 2020: Pubmed,
Embase, Web of Science and PsychInfo. The following is an example search string:
Author Manuscript
Study Selection
Article titles and abstracts were initially reviewed for inclusion and exclusion criteria by the
primary reviewer after being uploaded to Covidence, a systematic review software. If studies
appeared to meet inclusion criteria, the full text was obtained and reviewed. If the article,
once again, met inclusion criteria, it was saved, and the reference was added to a list of
eligible studies. A second reviewer assessed a random selection of 100 discarded articles.
Author Manuscript
Articles identified as meeting inclusion criteria from this sample of articles were discussed
between both reviewers. The second reviewer also assessed all full text articles for inclusion
or exclusion. Decisions for inclusion or exclusion required unanimous consensus between
both reviewers. All disputes were settled by discussing with a third reviewer until consensus
was obtained. Once all eligible studies were identified, each was reviewed multiple times
and relevant data was extracted.
Data Extraction
Using tables in Microsoft Word, the following data was extracted from the included studies:
study author, year, setting, sample characteristics, data collection methods, name of reported
characteristics of SI, measure of SI characteristic, and definition of SI characteristic (if
reported). If definitions of SI characteristics were not explicitly stated, the definition was
Author Manuscript
interpreted by the primary reviewer based on the measure used. Definitions were then
discussed among all three reviewers until consensus was reached. Data was extracted
initially by the primary reviewer. The second reviewer independently extracted the same
data. The two data sets were compared, and all discrepancies were reviewed by both
reviewers until consensus was reached.
Arch Suicide Res. Author manuscript; available in PMC 2023 October 01.
Reeves et al. Page 6
RESULTS
Author Manuscript
The initial literature search generated 1,473 articles. Individual searches also yielded nine
articles resulting in a total of 1,482 articles. Five hundred and eighteen duplicates were
removed resulting in 955 unique titles for abstract review. Of those, 48 appeared to meet
inclusion/exclusion criteria and were selected for full text review. After a comprehensive
reading, 10 articles continued to satisfy inclusion/exclusion and were ultimately included in
the review (see Figure 1).
identified for inclusion a priori, the publication dates of the literature ranged from 2005 to
2019, with 7 of the 10 articles published in or after 2017.
Setting.—Of the 7 studies, three took place in the community (Kleinman et al., 2017, 2018;
Nock, 2009; Witte et al., 2005, 2006), four were conducted on psychiatric in-patient units
(Czyz et al., 2019; Hallensleben et al., 2018, 2019; Kleinman et al., 2017, 2018), one was
an experiment performed in a laboratory (Rizk et al., 2018), and one was conducted in an
active-duty military environment (Nock et al., 2018).
and adults (Kleinman, 2017, 2018; Nock, 2018). Two studies did not restrict inclusion
based on psychiatric history (Nock et al., 2018; Witte et al., 2005, 2006). One study
included participants who had a suicide attempt within the last year (Kleinman, 2017, 2018).
One study included participants with a suicide attempt within the last month and/or SI
within the last week (Czyz et al., 2019). The final study included only participants with
a diagnosis of Major Depressive Disorder (MDD; Rizk et al., 2018). Sample sizes ranged
primarily from 20 to 108 participants, with one outlier looking at 3,916 participants. Six
of the studies consisted of over 60% women (with five studies having more than 70%
women). The majority of the samples included primarily white participants, with four
studies reporting over 70% white participants. Only two studies reported between 45 and
67% white participants while two did not report the race of their participants.
Author Manuscript
Design.—Five of the seven studies used longitudinal methods, one used a prospective
design, and one was an experiment performed in a laboratory. As per inclusion criteria,
all five studies that used a longitudinal design used at least once daily measures of SI.
Measurement of SI occurred once daily (Czyz et al., 2019; Witte et al., 2005, 2006),
twice daily (with the addition of unlimited participant-initiated entries; Nock et al., 2009),
four times daily (Kleinman et al., 2017) and ten times daily (Hallensleben et al., 2018,
2019). The duration of data collection ranged from six days to 6 weeks with one study
Arch Suicide Res. Author manuscript; available in PMC 2023 October 01.
Reeves et al. Page 7
duration depending on the length of in-patient stay (Kleinman et al., 2017, 2018). Four
Author Manuscript
studies used Ecological Momentary Assessment (EMA) to collect SI data; three of which
were smartphone based and one which used paper questionnaires. Czyz et al. (2019) also
conducted surveys via smartphone.
Identification of SI Characteristics
Results of the review were divided into three sections: 1) the identification of SI
characteristics, 2) measures or operational definitions used to collect data on each SI
characteristic, and 3) the congruence of SI characteristics in the literature with those used in
the C-SSRS based on their names, measurement and definition.
et al., 2019; Nock, et al., 2018, 2009; Rizk et al., 2018; Witte et al., 2006, 2005), three
reported frequency of SI (Czyz et al., 2019; Kleinman et al., 2017, 2018; Nock et al., 2009),
and three reported intensity of SI (Kleinman et al., 2017, 2018; Nock et al., 2009; Witte
et al., 2005, 2006). Two studies reported SI variability (Kleniman et al., 2017; Witte et al.,
2005, 2006). Two studies reported on controllability, although one named it “ability to resist
urge” (Kleinman et al., 2017, 2018; Nock et al., 2018). The following characteristics were
only measured in one study: desire to die (Kleniman et al., 2017, 2018), intent (Kleinman
et al., 2017, 2018), level of passive SI (Hallensleben et al., 2018, 2019), level of active SI,
(Hallensleben et al., 2018, 2019), and urge severity (Czyz et al., 2019; See table 2).
SI Measurement
Two of the seven studies in this review used individual items taken from validated SI
Author Manuscript
measures. Two studies reported using tools developed from validated SI measures to
measure SI characteristics. One study used an aggregate score of the 36-item Suicide
Probability Scale (SPS) to measure SI intensity and duration (Witte et al., 2005, 2006). One
study used a single item from the Beck Scale for Suicidal Ideation to measure SI duration
(Rizk et al., 2018). Two studies developed items from the C-SSRS (Nock et al., 2018; Czyz
et al., 2019), and one reported developing items based on the Self Injurious Thoughts and
Behaviors Survey (SITBS; Nock et al., 2009). Over half of the SI characteristic measures
used a single item. All but one measure included between 1 and 4 items. The SPS, used by
Witte et al. (2005 & 2006) had 36 items. Table 3 provides details on the names, measures
and operational definitions of SI characteristics across all studies.
Table 4 provides information about the validity and reliability of the measures used. Five
Author Manuscript
Arch Suicide Res. Author manuscript; available in PMC 2023 October 01.
Reeves et al. Page 8
Five of the names used to describe the 12 SI characteristic were also used in the C-SSRS
(intensity, severity, frequency, duration and controllability). However, many studies did not
operationally define these characteristics as they are operationally defined in the C-SSRS.
Only two of the seven studies adapted SI measures specifically from the C-SSRS and
none used the same items as those in the C-SSRS. The studies also examined five SI
characteristics not measured by the C-SSRS (variability, “desire to die”, “level of passive
SI”, “level of active SI”, and “urge severity”). One study appears to measure the concept of
Author Manuscript
Severity.—There was a high level of congruence between studies reviewed and the C-
SSRS for inclusion of ‘Severity’ as a SI characteristic. All but one study (Rizk et al.,
2018) measured a characteristic with a similar operational definition to the one used in the
C-SSRS. However, only one of these studies actually used a similar name – “urge severity”
– to identify the characteristic (Czyz et al. 2019). Although their measurement approach
indicated they were measuring ‘severity’, two studies referred to it as “intensity” (Nock
et al., 2009; Witte et al., 2005, 2006), one as the “level” of SI (Hallensleben et al., 2018,
2019), and another as “self-injurious thoughts and behaviors” (Nock et al., 2018). A fourth
study referred to what was ostensibly ‘severity’ of SI using three separate terms: general SI,
“desire to die” and “intent” to die (Kleinman et al., 2017, 2018).
Author Manuscript
DISCUSSION
The purpose of this review was to identify specific characteristics of SI delineated
in SI research to date, determine how they are operationally defined and measured,
Arch Suicide Res. Author manuscript; available in PMC 2023 October 01.
Reeves et al. Page 9
and assess their alignment with SI characteristics included in the C-SSRS. Twelve SI
Author Manuscript
characteristics were identified in the literature. However, after comparing measures and
operational definitions of all 12 SI characteristics, they were essentially measuring five core
domains: severity, temporality (frequency and duration), controllability, deterrents/reasons
for ideating, and variability. For many of the characteristics, their names, measures and
operational definitions were conflated in the literature, representing a significant conceptual
problem in SI research. Four of the five characteristics were congruent with characteristics
included in the C-SSRS. No standardized measures of the SI characteristics were used
across studies.
SI Characteristics
Twelve characteristics were initially identified across the studies. However, after reviewing
the nature of their measurement and related operational definitions, it became apparent that
Author Manuscript
suicide, or intention to act on that plan. It then uses the term “intensity” as the title for
the section of questions measuring the remaining 5 characteristics (frequency, duration,
controllability, deterrents and reasons for ideating). However, across the studies reviewed
these two terms were operationally defined as if they were the same variable.
of suicide (Nock et al., 2009; Rizk et al., 2017). If it is assumed that SI is experienced
in episodes, then the concept’s duration and frequency can be applied more easily. The
duration of SI would be the length of an SI episode, whereas frequency would refer to the
number of episodes.
Arch Suicide Res. Author manuscript; available in PMC 2023 October 01.
Reeves et al. Page 10
in two studies. This review suggests its importance to the field of SI research. Witte et
Author Manuscript
al. (2006) found that SI variability was predictive of a multiple suicide attempt history.
Kleiman et al. (2017) found that SI variability helped differentiate five SI subtypes and that
low variability of SI predicted a recent history of a suicide attempt. Although noteworthy
as a SI characteristic, the nature of variability is complicated by the unit of time between
measurements and the feature of SI that is measured. When variability is studied, it is
imperative to determine what is fluctuating (e.g. severity, controllability) and for how long.
For example, one researcher may choose to measure daily changes in SI severity while
another chooses to measure hourly changes of SI controllability. Both would report findings
of SI variability. Future research looking at SI variability should be aware of this potential
pitfall and clearly state the time period and quality of variability being examined.
characteristics have received little attention in SI research. Both are characteristics included
in the C-SSRS and, therefore, are considered by experts to have potential importance to the
field (Posner et al., 2011). Future research is needed to develop appropriate measures and
enhanced understanding of these SI characteristics.
Standardization in Measurement
Although individual studies in this review generally provided appropriate rationale for
the use of SI measures, no standardized measures were used to assess individual SI
characteristics. Appropriate and valid measures are generally developed secondary to
agreement about concept names and definitions. The lack of consistency in names and
definitions of SI characteristics is likely the reason for a lack of standardized measures.
There is an urgent need for universal nomenclature to describe SI characteristics, along
Author Manuscript
Arch Suicide Res. Author manuscript; available in PMC 2023 October 01.
Reeves et al. Page 11
The field should also be open to research that can improve clinical and research efficacy
Author Manuscript
of the C-SSRS. Building on discoveries from SI research, studies to refine the interview’s
assessment of various SI characteristics may be warranted. Based on findings from this
review, potential measurement of new characteristics such as variability should also be
considered for the C-SSRS. Lastly, further psychometric testing for each characteristic
subscale is warranted, including validity and reliability testing across varied populations and
contexts to assure cultural and sociodemographic integrity of SI assessment.
Limitations
Although this study followed guidelines for systematic reviews proposed by PRISMA,
limitations still exist. Because characteristics of SI do not have consistent nomenclature,
the search for relevant articles was difficult. Although we started with about one thousand
articles, it is possible that different search terms would have rendered articles that were
Author Manuscript
missed. Similarly, the targeted body of literature appears to be small. However, because this
review intentionally delineated an emerging literature, a small number of relevant articles
was expected.
In addition, the lack of well-defined characteristics required inference at times regarding the
definitions of reported SI characteristics. Although this was done as objectively as possible,
some degree of subjective interpretation was necessary.
CONCLUSIONS
This review highlighted inconsistencies in the emerging field of SI research, specifically
in the nomenclature, definition, and measurement of SI characteristics. Although some
conceptual disparity is common in new areas of research, clearer consensus regarding the
Author Manuscript
This research is timely, as SI and suicide rates skyrocket. In order to meet the challenge,
researchers must build essential scaffolding for this emerging field by standardizing
approaches to SI measurement. Standardization will allow for findings to be synthesized
across studies, enhance more accurate and reliable measurement of SI, and lead to a more
integrated and useful body of knowledge.
Arch Suicide Res. Author manuscript; available in PMC 2023 October 01.
Reeves et al. Page 12
ACKNOWLEDGEMENTS
Author Manuscript
Funding:
This work was supported by the National Institutes of Health [T32NR016920].
References
Beck AT, Steer RA (1991) Manual for Beck Scale for Suicidal Ideation Psychological Corporation.
Bernanke JA, Stanley BH, & Oquendo MA (2017). Toward fine-grained phenotyping of suicidal
behavior: the role of suicidal subtypes. Molecular psychiatry, 22(8), 1080–1081. 10.1038/
mp.2017.123 [PubMed: 28607457]
Centers for Disease Control and Prevention (n.d.). Preventing Suicide Retrieved from https://
www.cdc.gov/violenceprevention/suicide/fastfact.html
Curtin SC, & Heron M (2019). Death Rates Due to Suicide and Homicide Among Persons Aged
10–24: United States, 2000–2017. NCHS data brief, (352), 1–8.
Author Manuscript
Czeisler MÉ, Lane RI, Petrosky E, Wiley JF, Christensen A, Njai R, Weaver MD, Robbins R,
Facer-Childs ER, Barger LK, Czeisler CA, Howard ME, & Rajaratnam S (2020). Mental Health,
Substance Use, and Suicidal Ideation During the COVID-19 Pandemic - United States, June
24–30, 2020. MMWR. Morbidity and mortality weekly report, 69(32), 1049–1057. 10.15585/
mmwr.mm6932a1 [PubMed: 32790653]
Czyz EK, Horwitz AG, Arango A, & King CA (2019). Short-term change and prediction of suicidal
ideation among adolescents: a daily diary study following psychiatric hospitalization. Journal
of child psychology and psychiatry, and allied disciplines, 60(7), 732–741. 10.1111/jcpp.12974
[PubMed: 30246870]
Fisher JA, Medaglia JD, Jeronimus BF (2018) Lack of group-to-individual generalizability is a threat
to human subjects research. PNAS, 115 (27). 10.1073/pnas.1711978115
Franklin JC, Ribeiro JD, Fox KR, Bentley KH, Kleiman EM, Huang X, Musacchio KM, Jaroszewski
AC, Chang BP, & Nock MK (2017). Risk factors for suicidal thoughts and behaviors: A meta-
analysis of 50 years of research. Psychological bulletin, 143(2), 187–232. 10.1037/bul0000084
[PubMed: 27841450]
Author Manuscript
Kleinman EM, Turner BJ, Fedor S, Beale EE & Huffman JC (2017) Examination of real-time
fluctuations in suicidal ideation and its risk factors: Results from two excological momentary
assessment studies. Jounral of Abnormal Psychology, 126(6), 726–738. 10.1037/abn0000273
Kleinman EM, Turner BJ, Fedor S, Beale EE, Picard RW, Huffman JC & Nock MK (2018) Digital
phenotyping of suicidal thoughts. Depression & Anxiety, 35, 601–608. DOI: 10.1002/da.22730
[PubMed: 29637663]
Klonsky ED, May AM, & Saffer BY (2016). Suicide, Suicide Attempts, and Suicidal Ideation. Annual
review of clinical psychology, 12, 307–330. 10.1146/annurev-clinpsy-021815-093204
Arch Suicide Res. Author manuscript; available in PMC 2023 October 01.
Reeves et al. Page 13
Moher D, Liberati A, Tetzlaff J, Altman DG, & PRISMA Group (2009). Preferred reporting items for
systematic reviews and meta-analyses: the PRISMA statement. BMJ (Clinical research ed.), 339,
Author Manuscript
b2535. 10.1136/bmj.b2535
National Institution on Mental Health (n.d.). Suicide Retrieved from https://www.nimh.nih.gov/health/
statistics/suicide.shtml
Nock MK, Milner AJ, Joiner TE, Gutrierrez PM, Han G, Hwang I, King A, Naifeh JA, Sampson NA,
Zalslavsky AM, Stein MB, Ursano RJ & Kessler RC (2018) Risk factors for the transition from
suicidal ideation to suicide attempt: Results from the Army Study to Assess Risk and Resilience in
Servicemembers (Army STARRS). Journal of Abnormal Psychology, 127(2), 139–149. 10.1037/
abn0000317 [PubMed: 29528668]
Nock MK, Prinstein MJ & Sterba SK (2009) Revealing the form and function of self-injurious
thoughts and behaviors: A real-time ecological assessment study among adolescents and
young adults. Journal of Abnormal Psychology, 118(4), 816–827. 10.1037/a0016948 [PubMed:
19899851]
Odgers CL & Jensen MR (2020) Annual Research Review: Adolescent mental health in the digital
age: facts, fears and future directions. The Journal of Child Psychology and Psychiatry, 61(3),
Author Manuscript
Shiffman S, Stone AA, & Hufford MR (2008). Ecological momentary assessment. Annual Review of
Clinical Psychology, 4(1), 1–32.
Witte TK, Fitzpatrick KK, Joiner TE & Schmidt NB (2005). Variability in suicidal ideation: A better
predictor of suicide attempts than intensity or duration or ideation? Journal of Affective Disorders,
88, 131–136. 10.1016/j.jad.2005.05.019 [PubMed: 16054227]
Witte TK, Fitzpatrick KK, Warren KL, Schatschneider C & Schmidt NB (2006) Naturalistic evaluation
of suicidal ideation: Variability and relation to attempt status. Behaviour Research and Therapy,
44, 1029–1040. 10.1016/j.brat.2005.08.004 [PubMed: 16188225]
Author Manuscript
Arch Suicide Res. Author manuscript; available in PMC 2023 October 01.
Reeves et al. Page 14
Author Manuscript
Author Manuscript
Author Manuscript
Figure 1.
PRISMA Flowchart
Author Manuscript
Arch Suicide Res. Author manuscript; available in PMC 2023 October 01.
Author Manuscript Author Manuscript Author Manuscript Author Manuscript
Table 1.
Name
Severity Have you wished you were dead or wished you could go to Yes/No “The strength of feeling during which
sleep and not wake up? one contemplates acting on suicidal
thoughts.”
Have you actually had any thoughts of killing yourself? Yes/No
Have you been thinking about how you might do this? Yes/No
Have you had these thoughts and had some intention of Yes/No
acting on them?
Have you started to work out or worked out the details of Yes/No
how to kill yourself? Do you intend to carry out this plan?
Frequency How many times have you had these thoughts? (1) Less than once a week “How often one experiences suicidal
(2) Once a week thoughts.”
(3) 2–5 times in week
(4) Daily or almost daily
(5) Many times each day
Duration When you have the thoughts how long do they last? (1) Fleeting - few seconds or minutes “The length of time one has a
(2) Less than 1 hour/some of the time continuous suicidal thought.”
(3) 1–4 hours/a lot of time
(4) 4–8 hours/most of day
(5) More than 8 hours/persistent or continuous
Controllability Could/can you stop thinking about killing yourself or (1) Easily able to control thoughts “The ease with which one could stop
wanting to die if you want to? (2) Can control thoughts with little difficulty (3) Can control thoughts themselves from considering suicide.”
with some difficulty
(4) Can control thoughts with a lot of difficulty
(5) Unable to control thoughts
(0) Does not attempt to control thoughts
Deterrents Are there things - anyone or anything (e.g., family, (1) Deterrents definitely stopped you from attempting suicide “The presence of a person or thing
religion, pain of death) - that stopped you from wanting (2) Deterrents probably stopped you that stops one from wanting to die or
Arch Suicide Res. Author manuscript; available in PMC 2023 October 01.
to die or acting on thoughts of committing suicide? (3) Uncertain that deterrents stopped you commit suicide.”
(4) Deterrents most likely did not stop you
(5) Deterrents definitely did not stop you
(0) Does not apply
Reasons for What sort of reasons did you have for thinking about (1) Completely to get attention, revenge or a reaction from others “The reason for thoughts of suicide.”
Ideating wanting to die or killing yourself? Was it to end the pain or (2) Mostly to get attention, revenge or a reaction from others
stop the way you were feeling (in other words you couldn’t (3) Equally to get attention, revenge or a reaction from others
go on living with this pain or how you were feeling) or was and to end/stop the pain
it to get attention, revenge or a reaction from others? Or (4) Mostly to end or stop the pain (you couldn’t go on living with the
both? pain or how you were feeling)
(5) Completely to end or stop the pain (you couldn’t go on living with
the pain or how you were feeling)
(0) Does not apply
Page 15
Author Manuscript Author Manuscript Author Manuscript Author Manuscript
Table 2:
Age (mean age in Inclusion Criteria – Sample Female White Design Method Frequency Duration
years) Psychiatric History size (%) (%) (per day)
Witte (2005) Community College Students None 108 60 NR Longitudinal Questionnaire 1 6 weeks
(19.3)
Witte (2006) Community College Students None 108 60 NR Longitudinal Questionnaire 1 6 weeks
(19.3)
Nock (2009) Community Adolescent/ Recent history of 30 87 87 Longitudinal Smart phone EMA 2+ 2 weeks
Young adult (17.3) NSSI
Kleiman (2017) Community Young adult Suicide attempt in last 54 79 73 Longitudinal Smart phone EMA 4 4 weeks
(23.59) year
Kleiman (2018) Community Young adult Suicide attempt in last 54 79 73 Longitudinal Smart phone EMA 4 4 weeks
(23.59) year
Nock (2018) Military Young adult/Adult None 3,916 20 67 Prospective Questionnaire One-time N/A
(NR)
Rizk (2018) Laboratory Adults (33.6) MDD and SI 58 59 45 Experiment Questionnaire One time N/A
Hallensleben In-patient Adults (35.9) MDD and/or lifetime 20 80 NR Longitudinal Smart phone EMA 10 6 days
(2018) SI
Hallensleben In-patient Adults (37.6) MDD and/or lifetime 74 72 NR Longitudinal Smart phone EMA 10 6 days
(2019) SI
Czyz (2019) In-patient Adolescent (NR) suicide attempt in Last 34 76 85 Longitudinal Smart phone 1 2 weeks
Arch Suicide Res. Author manuscript; available in PMC 2023 October 01.
month and/or SI in survey
last week
NR = Not Reported; NSSI = Non-Suicidal Self-Injury; MDD = Major Depressive Disorder; WW = Worst Week
Page 16
Author Manuscript Author Manuscript Author Manuscript Author Manuscript
Table 3.
Adapted If yes, what # of Example of Item Item Response Options Scoring Method
from measure? Items
validated Used
measure?
Severity
Witte (2005) & Intensity Yes SPS 36 NR 4-point scale indicating how often Mean Score
Witte (2006) each statement applies
Nock (2009) Intensity Yes SITBS 1 “Rate how intense the urge was to do 5-point-scale from “not present” NR
the behavior you selected” to “very severe”
Kleiman (2017) & Desire to die No NA 1 “How intense is your desire to kill 4-point scale; 0 (not strong Analyzed as reported
Kleiman (2018) yourself right now” [intense] at all) to 4 (very strong
[intense]) scale
Kleiman (2017) & Intensity No NA 3 “How intense is your desire to kill 4-point scale; 0 (not strong Sum score of three
Kleiman (2018) yourself right now” [intense] at all) to 4 (very strong items
[intense]) scale - for each item.
Kleiman (2017) & Intent No NA 1 “How strong is your intention to kill 4-point scale; 0 (not strong Analyzed as reported
Kleiman (2018) yourself right now” [intense] at all) to 4 (very strong
[intense]) scale
Hallensleben (2018) Level of passive SI No NA 2 1) “Life is not worth living for me” 5-point scale from 1 (not at all) to Not analyzed
2) “There are more reasons to die than 5 (very much)
to live for me”
Hallensleben (2018) Level of active SI No NA 2 3) “I’m thinking about taking my own 5-point scale from 1 (not at all) to No analyzed
life” 5 (very much)
4) “I want to die”
Hallensleben (2018) Composite SI No NA 4 1) “Life is not worth living for me” 5-point scale from 1 (not at all) to Total score of four
2) “There are more reasons to die than 5 (very much) items summed (range
to live for me” = 4–20).
Arch Suicide Res. Author manuscript; available in PMC 2023 October 01.
3) “I’m thinking about taking my own
life”
4) “I want to die”
Hallensleben (2019) Level of passive SI No NA 2 1) “Life is not worth living for me” 5-point scale from 1 (not at all) to Not analyzed
2) “There are more reasons to die than 5 (very much)
to live for me”
Hallensleben (2019) Level of active SI No NA 2 3) “I’m thinking about taking my own 5-point scale from 1 (not at all) to No analyzed
life” 5 (very much)
4) “I want to die”
Hallensleben (2019) Composite SI No NA 4 1) “Life is not worth living for me” 5-point scale from 1 (not at all) to Total score of four
2) “There are more reasons to die than 5 (very much) items summed (range
to live for me” = 4–20).
Page 17
Author Manuscript Author Manuscript Author Manuscript Author Manuscript
Adapted If yes, what # of Example of Item Item Response Options Scoring Method
from measure? Items
validated Used
measure?
Reeves et al.
Nock (2018) Self-Injurious Yes C-SSRS 3 “Did you ever make a suicide attempt; NR Composite Score of 3
Thoughts and that is, purposefully hurt yourself items
Behavior with at least some intention to die?”
Czyz (2019) Urge Severity Yes (Nock et al., 1 “How strong was the urge to act on Scale from 1 (low) to 7 (high) Analyzed as reported
2009) your thoughts of suicide?”
Temporality
Witte (2005) & Duration Yes SPS 36 NR 4-point scale indicating how often Number of days
Witte (2006) each statement applies above a T- score of
70
Witte (2006) Variability Yes SPS 36 NR 4-point scale indicating how often 1
each statement applies MSSD statistic
Nock (2009) Frequency Yes SITBS 1 “Are you having thoughts of self- Yes/no Number of yes
destructive behavior” responses
Nock (2009) Duration Yes SITBS 1 “Indicate how long you thought about 6-point-scale from “<5 seconds” Analyzed as reported
doing the behavior” to “5- hrs to 1-day”
Kleiman (2017) & Frequency No NA 1 “How intense is your desire to kill 4-point scale; 0 (not strong Number of non-zero
Kleiman (2018) yourself right now?” [intense] at all) to 4 (very strong answers
[intense]) scale
Nock (2018) Duration Yes C-SSRS 2 “How many days during worst week NR Analyzed as reported
did you have SI” and “How long did
those thoughts usually last when you
had them?”
Rizk (2018) Duration Yes BSSI (Item 6) 1 NR 3 categorical responses: Ideators separated
1) brief, fleeting periods, into two groups 1)
Arch Suicide Res. Author manuscript; available in PMC 2023 October 01.
2) longer periods, and brief ideators and
3) continuous (chronic) or almost 2) longer and
continuous. continuous ideators,
then longer and
continuous ideators
added together to
form second group
Czyz (2019) Duration Yes C-SSRS 1 “How long did these thoughts last?” 5 point-scale, ranged from ‘a few Analyzed as reported
seconds or minutes’ to ‘more than
8 hr/continuous.’
Czyz (2019) Frequency Yes C-SSRS 1 “How many times did you have 4-point scale, ranged from ‘only Analyzed as reported
thoughts of killing yourself” one time’ to ‘all the time.’
Page 18
Author Manuscript Author Manuscript Author Manuscript Author Manuscript
Adapted If yes, what # of Example of Item Item Response Options Scoring Method
from measure? Items
validated Used
measure?
Reeves et al.
Controllability
Kleiman (2017) & Ability to resist No NA 1 “How strong is your ability to resist 4-point scale; 0 (not strong Reverse coded
Kleiman (2018) urge the urge to kill yourself [intense] at all) to 4 (very strong
[intense]) scale
Nock (2018) Controllability Yes C-SSRS 1 “During that worst week, how easy NR Analyzed as reported
was it for you to control those
thoughts?”
SI characteristics were organized into four domains after comparing each characteristic’s measurement and operational definition.
SPS = Suicide Probability Scale; SITBS = Self Injurious Thoughts and Behaviors Survey; BSSI = Beck Scale for Suicidal Ideation; NR = Not Reported; NA = Not Applicable
1
MSSD = Mean Squared Successive Differences
Arch Suicide Res. Author manuscript; available in PMC 2023 October 01.
Page 19
Author Manuscript Author Manuscript Author Manuscript Author Manuscript
Table 4.
Desire to die No 0 0 NA 0
Intent No 0 0 NA 0
Intensity No 0 0 0 0
Arch Suicide Res. Author manuscript; available in PMC 2023 October 01.
Hallensleben (2018) Level of passive SI No 0 0 0 0
&
Hallensleben (2019) Level of active SI No 0 0 0 0
Composite SI No 0 0 0 0
0 = study did not mention the validity or reliability of the measure used for the corresponding SI characteristic.
1 = sufficient validity or reliability reported for SI measure, but not for measure of SI characteristic.
Page 20
Author Manuscript Author Manuscript Author Manuscript Author Manuscript
2= sufficient validity or reliability reported for the specific SI characteristic measure.
SPS = Suicide Probability Scale; SITBS = Self Injurious Thoughts and Behaviors Survey; BSSI = Beck Scale for Suicidal Ideation
NA = Not Applicable
*
Internal consistency is not relevant to single item measures
Reeves et al.
Arch Suicide Res. Author manuscript; available in PMC 2023 October 01.
Page 21
Author Manuscript Author Manuscript Author Manuscript Author Manuscript
Table 5.
“The strength of feeling during Frequency Duration Controllability Deterrents Reason for
which one contemplates acting Ideating
on suicidal thoughts.” “How often one experience “The length of a continuous “The ease at which one could stop “The presence
suicidal thoughts.” suicidal thought.” themselves from considering suicide.” of a person or “The
thing which reason for
stops one from thoughts of
wanting to die suicide.”
or commit
suicide.”
Was Was the name Was Was the Was Was the Was Did they use Was Was
‘severity’ severity used? ‘frequency’ name ‘duration’ name ‘controllability’ the name ‘deterrents’ ‘reason for
defined (If not, what defined frequency defined ‘duration’ defined similarly ‘controllability’? defined ideating’
similarly to label was similarly to used? similarly to used? to definition (If not, what label similarly to defined
definition used?) definition (If not, definition (If not, what above? was used? definition similarly to
above? above? what label above? label was above? definition
was used?) used?) above?
Witte (2005) Yes No Yes No No NA No NA No No
(Intensity) (Duration)
Witte (2006)
Arch Suicide Res. Author manuscript; available in PMC 2023 October 01.
Hallensleben Yes No No NA No NA No NA No No
(2018) (Level)
Hallensleben
(2019)
C-SSRS = Columbia Suicide Severity Rating Scale; SI = Suicidal Ideation; SITB = self-injurious thoughts and behaviors.
Dark Blue = studies that used the same name as the C-SSRS to describe the corresponding characteristic as operationally defined by the C-SSRS.
Light Blue = studies that did not use the same name as the C-SSRS to describe the corresponding characteristics as operationalized by the C-SSRS.
Page 22