"CAAST: Novel Therapy for Aphasia and AOS"
"CAAST: Novel Therapy for Aphasia and AOS"
Research Article
Purpose: This investigation was designed to examine the context of multiple baseline designs. CAAST entailed
the effects of a newly developed treatment for aphasia elaboration of participant-initiated utterances, with sound
and acquired apraxia of speech (AOS). Combined production training applied as needed to the elaborated
Aphasia and Apraxia of Speech Treatment (CAAST) targets productions. The dependent variables were (a) production
language and speech production simultaneously, with of correct information units (CIUs; Nicholas & Brookshire,
treatment techniques derived from Response Elaboration 1993) in response to experimental picture stimuli,
Training (Kearns, 1985) and Sound Production Treatment (b) percentage of consonants correct in sentence repetition,
(Wambaugh, Kalinyak-Fliszar, West, & Doyle, 1998). The and (c) speech intelligibility.
purpose of this study was to determine whether CAAST Results and Conclusions: CAAST was associated with
was associated with positive changes in verbal language increased CIU production in trained and untrained picture
and speech production with speakers with aphasia and sets for all participants. Gains in sound production accuracy
AOS. and speech intelligibility varied across participants; a
Method: Four participants with chronic aphasia and AOS modification of CAAST to provide additional speech
received CAAST applied sequentially to sets of pictures in production treatment may be desirable.
A
phasia and acquired apraxia of speech (AOS) Robin, & Schmidt, 2009). It ranges in severity from a
are neurogenic disorders of language and motor complete inability to speak to minor sound distortions.
speech, respectively. AOS seldom occurs as an iso- Stroke is the most common etiology for nonprogressive AOS
lated disorder and is typically accompanied by nonfluent (Duffy, 2013), and damage to cortical and/or subcortical
aphasia (Duffy, 2013). The relative contributions of aphasia areas of the language dominant hemisphere has been asso-
and AOS to overall communication disruption in persons ciated with AOS (Wambaugh & Shuster, 2008).
with both disorders are not well understood; singly, and Improvements in speech production have been dem-
in combination, these disorders can significantly disrupt onstrated with a variety of AOS treatments (Wambaugh,
communication. Although many persons with aphasia and Duffy, McNeil, Robin, & Rogers, 2006). Across the 59 AOS
AOS likely require treatment for both disorders, there has treatment investigations included in the AOS treatment
been limited research addressing treatments that have been guidelines systematic review, all 148 research participants
designed to target both. The purpose of the current investiga- had AOS accompanied by aphasia. However, none of the
tion was to examine the effects of a newly developed behav- AOS treatments reviewed in the AOS guidelines included
ioral treatment that targets aphasia and AOS simultaneously. direct treatment for language (Wambaugh et al., 2006).
AOS is characterized by slow rate of speech, difficul- Although it may be advantageous for researchers to
ties in sound production, and disrupted prosody (McNeil, develop and investigate treatments focused on a single dis-
order, a unilateral treatment focus may have limitations
in terms of clinical application for persons with multiple
a
disorders. Allocation of therapy time to different disorders
Veterans Affairs Salt Lake City Health Care System, Utah
b and treatments may be challenging, particularly with a lim-
University of Utah, Salt Lake City
ited number of therapy sessions. Determining whether
Correspondence to Julie L. Wambaugh: wambaugh@health.utah.edu
AOS or aphasia is the primary contributor to a particular
Editor: Rhea Paul
communication disruption may be difficult, and perhaps
Associate Editor: Kristine Lundgren
Received January 7, 2014
Revision received May 1, 2014
Accepted June 20, 2014 Disclosure: The authors have declared that no competing interests existed at the
DOI: 10.1044/2014_JSLHR-L-14-0004 time of publication.
Journal of Speech, Language, and Hearing Research • Vol. 57 • 2191–2207 • December 2014 • © American Speech-Language-Hearing Association 2191
impossible, for a clinician to ascertain in a timely manner. application require further study (e.g., optimal presenta-
For example, inability to describe a picture stimulus may tion of stimuli, most effective dosage, and social validity),
result from a language disruption or a motor speech dis- its acquisition, response generalization, and maintenance
ruption, or a combination of both, in an individual with effects have been demonstrated to be robust and rela-
AOS and aphasia. Given the high co-occurrence of aphasia tively predictable; improvement in production of treated
with AOS, the likelihood of the disorders interacting or sounds has been consistently observed in trained and un-
co-contributing to communication disruption, and the need trained items during nontreatment probes. Increases in
for efficient and clinically applicable treatments, a treatment articulatory accuracy have been maintained above baseline
that targets both disorders may be desirable. levels for the majority of speakers in post-SPT follow-up
Response Elaboration Training (RET; Kearns, 1985) probes.
is an aphasia treatment that has been modified for use with A key component of SPT in previous research has
persons with aphasia and AOS (Modified RET [M-RET]; been the targeting of specific sounds that were determined
Wambaugh & Martinez, 2000; Wambaugh, Wright, & to be problematic for the AOS speaker in pretreatment as-
Nessler, 2012). RET was developed to facilitate creative sessment. That is, treatment items have been selected on the
and generalizable language production by capitalizing on basis of a priori observation of patterns of sound errors. In
unique, patient-initiated utterances and has been shown contrast, with M-RET, there are no predetermined target
to consistently result in increased production of content in responses; treatment proceeds on the basis of speaker-initiated
discourse (Gaddie, Kearns, & Yedor, 1991; Kearns, 1985; utterances. Therefore, with the new treatment, SPT could
Kearns & Scher, 1989; Kearns & Yedor, 1991; Yedor, not be applied to preestablished target sounds. Instead, in
Conlon, & Kearns, 1993). With RET, the clinician encour- the newly developed treatment, Combined Aphasia and
ages the speaker to produce an utterance of his or her choice Apraxia of Speech Treatment (CAAST), the SPT hierarchy
in response to picture stimuli. Reinforcement, modeling, is employed with the speaker-generated utterances that are
and forward chaining are then used to expand the utterance. unique with each treatment trial.
RET and M-RET have been shown repeatedly to result in As with RET and M-RET, a primary goal of CAAST
improved production of language content in response to is to increase verbal language productivity by facilitating
trained and untrained stimuli (see Wambaugh et al., 2012, elaboration of patient-initiated productions; flexible and
for a review). generalized language use is expected (Kearns, 1985). In
Wambaugh and colleagues (Wambaugh & Martinez, keeping with the emphasis of SPT, improved speech pro-
2000; Wambaugh et al., 2012) adapted the basic RET pro- duction is also a goal of CAAST. Given the dual focus of
cedure to accommodate speech production difficulties asso- CAAST, language and speech production outcome mea-
ciated with AOS. Although the modification included some sures were required to measure the effects of treatment.
techniques that may promote improved speech production A measure of production of content in discourse was
(e.g., integral stimulation, repeated productions), M-RET chosen to elucidate potential changes in language produc-
does not include specific treatment for apraxic speech pro- tivity (Nicholas & Brookshire, 1993). Because increases
duction errors, and speech production has not been a mea- in content production have been regularly reported with
sured outcome. That is, increased language production RET and M-RET (Gaddie et al., 1991; Kearns, 1985;
remains the focus of M-RET. Kearns & Scher, 1989; Kearns & Yedor, 1991; Wambaugh
Because of the strong, experimentally sound evidence & Martinez, 2000; Wambaugh et al., 2012; Yedor et al.,
base supporting generalized language changes with RET 1993), it was deemed important that such changes be evi-
and M-RET and the limited data concerning speech changes dent with CAAST.
for other aphasia treatments, we chose to use M-RET as the Typical SPT outcome measures, such as accuracy
foundation for a new treatment that targets both language of targeted sounds/words in trained and untrained items,
and speech. We combined M-RET with an established AOS could not be utilized to evaluate the effects of CAAST be-
treatment, Sound Production Treatment (SPT; Wambaugh, cause treatment does not involve prespecified targets. Con-
2004; Wambaugh, Kalinyak-Fliszar, West, & Doyle, 1998; sequently, a measure was devised in which percentage of
Wambaugh & Mauszycki, 2010; Wambaugh & Nessler, consonants correct (PCC) was measured in the production
2004; Wambaugh, Nessler, Cameron, & Mauszycki, 2013; of sentences. The sentences were developed to be similar to
Wambaugh, Nessler, Wright, & Mauszycki, 2014). SPT is expected, participant-generated utterances in CAAST. In
an articulatory-kinematic treatment for AOS that was de- addition, single word intelligibility was selected as an out-
signed to improve articulation of targeted sounds produced come measure that could reflect positive changes in speech
in the context of words, phrases, and/or sentences. SPT production.
combines modeling, repetition, minimal pair contrast, inte- In summary, we have developed a new treatment that
gral stimulation, articulatory placement cueing, and feed- targets aphasia and AOS simultaneously. CAAST com-
back in a response-contingent hierarchy. SPT has been bines features of two existing treatments (i.e., M-RET and
studied with AOS speakers of various severities with level SPT) to increase generalizable verbal language skills and to
of speech production during treatment being adjusted to improve speech production. Not only is this approach novel
meet the speaker’s needs (e.g., monosyllabic words, multi- in terms of being a combined approach, it is also unique
syllabic words, phrases). Although aspects of SPT and its with respect to applying sound production remediation in
2192 Journal of Speech, Language, and Hearing Research • Vol. 57 • 2191–2207 • December 2014
the context of patient-initiated utterances. The specific ex- 3. Assessment of Intelligibility of Dysarthric Speech
perimental questions addressed in this investigation were as (AIDS; Yorkston & Beukelman, 1981);
follows: 4. consonant production probe (Wambaugh, Kalinyak-
1. Is CAAST associated with increases in the produc- Fliszar, et al., 1998);
tion of content in discourse elicited in response to 5. sentence repetition (Wambaugh, West, & Doyle,
trained and untrained stimuli? 1998); and
2. Is CAAST associated with improvements in speech 6. multisyllabic word repetition (Mauszycki & Wambaugh,
production as measured by PCC in sentences and 2008).
single word speech intelligibility?
The following behaviors deemed necessary for the
diagnosis of AOS were demonstrated by all of the partici-
pants: slow rate of speech production (including syllable
Method segregation), sound errors that were relatively consistent in
Participants type and location across repeated trials, sound errors that
Four men with chronic, stroke-induced aphasia and were predominately sound distortions, and prosodic abnor-
AOS served as participants. Participant characteristics are malities. The presence of the requisite diagnostic charac-
summarized in Table 1. Medical records indicated that each teristics and corresponding diagnosis of AOS was initially
participant’s AOS and aphasia resulted from a single epi- determined by each participant’s primary clinician (one
sode, left hemisphere stroke. of the authors) and was independently confirmed by the
The participants were native English speakers between first author. All authors have extensive experience in the
36 and 72 years of age. Each passed a pure tone hearing diagnosis, treatment, and study of AOS.
screening at 35 dB at 500, 1000, and 2000 Hz for at least The participants’ word-level intelligibility scores
one ear, unaided. All demonstrated performance within ranged from 8% to 76% as scored through orthographic
normal limits on the Test of Nonverbal Intelligence—4 transcription (Yorkston & Beukelman, 1981; see Table 2).
(Brown, Sherbenou, & Johnsen, 2010). All had self-reported Severity of AOS, estimated on the basis of intelligibility
negative histories for alcohol or substance abuse and neuro- and prevalence of sound production errors, was considered
logical conditions other than stroke; the reports were veri- to range from mild–moderate to moderate–severe across
fied through review of existing medical records. None of the participants.
the participants received any other speech/language therapy All of the participants presented with agrammatic
during the course of this study. Each participant lived in his aphasia. Participants 2, 3, and 4 received a diagnosis
own home with a significant other. of Broca’s aphasia on the basis of the Western Aphasia
The presence of AOS was determined using the diag- Battery (Kertesz, 2007). Participant 1’s performance on the
nostic criteria described by McNeil, Robin, and Schmidt Western Aphasia Battery resulted in a classification of ano-
(1997, 2009). Speech samples were obtained from each par- mic aphasia. The participants’ productive verbal language
ticipant employing the following elicitation tasks: ranged from single words to short sentences and was gen-
erally characterized as follows: Participant 1—short sen-
1. Increasing Word Length and Repeated Trials subtests tences and phrases; Participant 2—mainly single words;
of the Apraxia Battery for Adults—Second Edition Participant 3—single words, phrases, and short sentences;
(Dabul, 2000); and Participant 4—single words and phrases (for samples
2. narrative and procedural discourse tasks (Nicholas & of discourse, see Appendix A in the online supplemental
Brookshire, 1993); materials).
Note. CVA = cerebrovascular accident; L = left; MCA = middle cerebral artery; R = right; nH / L = non-Hispanic/ Latino; UE = upper extremity;
LE = lower extremity.
Note. AQ = aphasia quotient; DNT = did not test; AOS = acquired apraxia of speech.
Overall percentile scores on the Porch Index of Com- further treatment effects to be detected. In addition, A MBD
municative Ability (Porch, 2001) ranged from the 47th to across the participants’ component was included in the design
58th percentile. The participants did not exhibit symptoms in which the number of baseline measurements was extended
of dysarthria as described by Duffy (2013). across participants; the number of baseline probes was in-
creased by one session across each participant so that baseline
probes increased from five to eight for Participant 1 through
Experimental Design Participant 4. To demonstrate experimental control, applica-
General Description tion of treatment must be systematically associated with be-
Each participant received treatment applied in the havioral change with treatment phases instituted at different
context of a multiple baseline design (MBD) across behaviors. time periods (relative to baseline) across participants.
Production of correct information units (CIUs; Nicholas & The design also included maintenance and follow-up
Brookshire, 1993) was measured repeatedly with three sets measurements. Specifics of the design by each phase are
of experimental pictures in the baseline phase. Then, treat- provided in the following sections.
ment was applied sequentially to two of the picture sets.
Experimental control is demonstrated with the MBD across Baseline Phase
behaviors when systematic changes in the dependent vari- During baseline, discourse samples were elicited in re-
able coincide with application of treatment and when those sponse to the three sets of picture stimuli for each partici-
effects are replicated with subsequent applications of treat- pant. Prior to the start of the study, the minimum number
ment with that participant (Kratochwill et al., 2010). In the of baseline probes for the first participant was designated as
event that treatment results in generalized responding to five to allow application of the conservative dual-criterion
untreated behaviors (i.e., changes in untreated behaviors (CDC) method (Fisher, Kelley, & Lomas, 2003) in data
occur prior to treatment being applied directly to those be- analysis. In addition, a nonascending or descending trend
haviors), demonstration of the replication of treatment ef- in CIU production was required to be evident in the base-
fects within the participant may be difficult. We anticipated line phase prior to initiation of treatment.
that increases in CIU production might occur with untreated
experimental sets and included additional design controls. Treatment Phase
We completed additional probing prior to applying Following baseline, CAAST was applied sequentially
treatment to the second experimental set to ensure stability of to two experimental sets. During the treatment phases, the
responding with that set. Conceptually, this may be consid- experimental set under treatment was probed after every
ered an additional baseline (“A”) phase designed to allow two treatment sessions but immediately prior to the next
2194 Journal of Speech, Language, and Hearing Research • Vol. 57 • 2191–2207 • December 2014
treatment session. The sets that were not under treatment similar to those produced in the narrative discourse sam-
were probed less frequently throughout the treatment ples. These stimuli were developed on the basis of previous
phases. The set slated for the second treatment phase was experience with M-RET and the expectation that use of the
probed at the midpoint of the first treatment phase and sentence frame in CAAST would stimulate production of
then with increasing frequency as the first phase neared at least canonical sentences. The same sentences were used
completion. Prior to initiation of treatment with the second for Participants 2, 3, and 4, and each sentence was seven
set, additional extended baseline probing was conducted to to nine syllables in length (e.g., “The boy is riding a bike.”).
ensure behavioral stability. The third set of pictures did not Because of his less severe AOS and aphasia, more difficult
receive treatment and was probed only at the end of each sentences were devised for Participant 1 (Set 1 = 7–11 sylla-
phase of treatment. The reduced probing schedule was used bles; Set 2 = 10–19 syllables).
to avoid overexposure and potential practice effects with Within each set, the10 sentences were presented ver-
untreated sets. All probes during the treatment phases were bally, one at a time in random order, and the participant
conducted prior to the day’s treatment session. was asked to repeat the sentence as accurately as possible.
Printed stimuli were presented along with the verbal model
Maintenance and Follow-Up Phases for one of the sentence sets to counter possible word-retrieval
When treatment was applied to the second set of pic- or memory difficulties. Sentences in both sets (auditory only
tures, probes were completed with the previously treated and auditory plus orthographic) were comparable for Par-
set at the midpoint and end of the second treatment phase. ticipants 2, 3, and 4. For Participant 1, lengthier sentences
Follow-up probes were completed with all experimental sets were used for the auditory plus orthographic condition than
at 2 and 6 weeks following the last treatment session of the in the auditory only condition. The longer sentences were
second treatment phase. developed because Participant 1’s speech production accu-
racy increased substantially with the addition of printed
sentences.
Procedures
Experimental Stimuli Probes
Narrative discourse elicitation stimuli. Thirty line Production of discourse was elicited in probes through
drawings depicting common actions were used as experi- presentation of the three picture sets. The order of presen-
mental stimuli. These pictures were part of a larger set of tation of sets and items within each set was randomized. The
100 drawings that were redrawn pictures from An Object 10 pictures in each set were presented one at a time. The in-
and Action Naming Battery (Druks & Masterson, 2000). vestigator provided the following instructions: “Tell me as
The 100 pictures had been validated for a previous investi- much as you can about this picture. You can talk about this
gation with respect to adequacy of depiction of the actions. picture or anything it reminds you of.” No time limits were
Ten adults without brain damage ranging from 41 to 70 years imposed. The preceding procedures were utilized with each
of age (M age = 57.6 years; five men and five women) were picture presentation, and all probes were audio recorded.
asked to provide a one-word response that best described The 20 sentences used for eliciting speech samples
the action in each drawing; all drawings elicited the desired were administered on three separate occasions prior to the
action name or an acceptable alternative. The drawings start of treatment; for Participants 1, 2, and 4, these probes
were not used in the current investigation to elicit specific occurred prior to the final discourse probe. For Participant 3,
action names but rather were used to stimulate production these probes were administered after the final discourse probe.
of narrative discourse. The sentences were then readministered at the midpoint
The drawings for Participants 1 and 2 were selected and end of each treatment phase and at 2 and 6 weeks
on the basis of personal relevance or potential interest as posttreatment.
determined by each participant’s primary speech-language
pathologist (SLP); approximately half of the items over-
lapped both participants’ sets. The drawings for Partici- Dependent Variable
pants 3 and 4 were the same as those for Participant 2 to CIUs
provide replications and counterbalancing with the stimuli. Total number of CIUs produced in response to the
For each participant, the 30 pictures were randomly divided picture stimuli served as the primary dependent variable.
into three sets of 10 pictures each. Two lists were designated CIUs reflect the appropriateness, relevancy, and informa-
for use in treatment and measurement of acquisition effects tiveness of words produced by a speaker in relation to a
in probes. The third list remained untreated to allow for as- particular topic (Nicholas & Brookshire, 1993). Procedures
sessment of generalization effects (for lists, see Appendix B described by Nicholas and Brookshire (1993) for calculat-
in the online supplemental materials). ing CIUs were utilized.
Speech elicitation stimuli. Two sets of 10 short sen- The discourse samples from the picture probes were
tences were developed to elicit speech samples for mea- orthographically transcribed using online transcriptions
suring accuracy of articulation as reflected by PCC (see supplemented by the audio recordings. An investigator,
Appendix C in the online supplemental materials). The sen- who was blinded to the assignment of pictures to condition
tences were composed of words that were predicted to be and was not involved in treatment, independently verified
2196 Journal of Speech, Language, and Hearing Research • Vol. 57 • 2191–2207 • December 2014
Step 4: to the start of the study, with 20 treatment sessions desig-
Therapist—“Milk, good, spill milk.” Referring to the nated per treatment phase (i.e., per experimental set); this
sentence frame, asks the participant where to write number of sessions was selected on the basis of previous
“milk.” experience with M-RET (Wambaugh & Martinez, 2000;
Wambaugh et al., 2012) as a best estimate for elucidating
Step 5A:
treatment effects. However, as treatment and probing pro-
Therapist—“Repeat after me . . . spill milk.”
gressed with Participant 1, treatment effects appeared to
Participant—“Pill milk.”
have stabilized after 14 treatment sessions with the first ex-
Step 5B: perimental set; consequently, treatment was terminated
Therapist—“Good try, but not quite correct. Let’s with the first set and was extended to the second set of pic-
concentrate on this sound (underlines the “s” on tures for 14 sessions. For Participants 2, 3, and 4, 20 ses-
the sentence frame) and try again . . . spill milk.” sions were completed for each treatment phase.
Participant—“Spill milk.” All SLPs (and the clinical fellow) practiced adminis-
Therapist—“That’s right. Now, let’s say it three more tration of CAAST prior to use with participants. A treat-
times.” ment administration log was created to ensure that all steps
Step 6: of the CAAST protocol were employed accurately (see
Therapist—Removes the picture and imposes a 5-s Appendix F in the online supplemental materials). The log
delay (e.g., “Wait and then I’m going to ask you to contained therapist instructions for each of the six CAAST
say it again”). treatment steps and substeps along with a grid to mark
Participant—“Milk.” completion of each step. A log was used for every treatment
Therapist—“Good try, but not quite. Watch me and session, and all sessions were audio recorded.
try it with me . . . spill milk.” Ten percent of all treatment sessions were quasi-
randomly selected (balanced across SLPs) for calculation
Each of the 10 treatment pictures (i.e., pictures in an of accuracy of administration of treatment. An examiner
experimental set) was submitted to the CAAST treatment who had not administered the selected treatment session
hierarchy, one at a time in random order in each treatment used the audio recordings to determine accuracy of admin-
session. All six steps of the treatment hierarchy were com- istration of each step of the treatment protocol. The number
pleted with each picture. After presentation of the 10 pic- of times a treatment component was correctly adminis-
tures, the expanded productions were submitted to the SPT tered was determined and divided by the number of oppor-
step/substeps (Step 5) one more time if time permitted. As tunities for occurrences of that component. Accuracy for
shown in the full treatment protocol, CAAST provides var- administration of the following CAAST components was
iations in the substeps depending on the participant’s re- as follows:
sponses. Examples of elaborated responses produced during
CAAST are shown in Appendix E in the online supplemen- 1. presentation of treatment pictures (10 per session)—
tal materials. 100%;
Participants were scheduled for treatment three times 2. accurate elicitation and reinforcement for Steps 1–6
per week and were seen in their homes, a clinic setting, or (60 per session)—98%; and
a social rehabilitation day program according to their pref-
3. accurate elicitation of elaborated production repeti-
erence: Participant 1—home, Participant 2—home and tions (30 per session)—98%.
clinic, Participant 3—home, and Participant 4—home and
social rehabilitation day program. The conditions were as
quiet and free of distractions as possible. For all partici- Results
pants, there was a comfortable seating arrangement with
table space for picture presentation. If a family member Production of CIUs With Experimental Picture Sets
chose to observe a session (a rare occurrence), he or she sat Data representing number of CIUs produced during
out of the participant’s line of sight and was asked to not probes are shown in Figures 1–4 for Participants 1–4, re-
make comments to the participant. Treatment sessions (ex- spectively. Within each figure, the separate graphs repre-
cluding probes) ranged from approximately 60 to 75 min. sent production of CIUs in response to presentation of a
Treatment was administered by SLPs who were certi- particular picture set (two treated sets and one untreated
fied by the American Speech-Language-Hearing Association set). The order of the graphs from top to bottom in each
or by a doctoral student completing a clinical fellowship year figure indicates the order of application of treatment to
(supervised by a certified SLP at least 25% of the time). Each the sets. Graphed data for the picture sets reflect total
participant was assigned two SLPs (including the clinical number of CIUs produced for all 10 pictures in the set.
fellow) who shared treatment and testing responsibilities. The scaling of the y-axes varies by participant to accom-
As noted previously, each participant received treat- modate the range of number of CIU productions across
ment applied sequentially to two sets of experimental pictures. participants.
Order of administration of the sets was counterbalanced Determining that a systematic change in behavior
across participants. Treatment length was established prior was associated with treatment requires evaluation of the
level, trend, and variability of probe data within and across entailed creating trend and mean (level) lines based on each
treatment phases. In addition, the immediacy of change, set of baseline data. These lines were then adjusted upward
the consistency of performance, and the degree of overlap by 0.25 SDs (standard deviation of each set of baseline data)
across phases must also be considered (Kratochwill et al., in the direction of the expected treatment effect. The ad-
2010). The CDC method (Fisher et al., 2003) was used to justed trend and level lines were then extended into each cor-
aid in interpretation of treatment effects. The CDC method responding treatment phase (for details of implementation
2198 Journal of Speech, Language, and Hearing Research • Vol. 57 • 2191–2207 • December 2014
Figure 2. Number of CIUs produced in response to experimental picture sets for Participant 2.
of the CDC method, see Fisher et al., 2003; Swoboda, prespecified number of data points falling above both lines;
Kratochwill, & Levin, 2010). In Figures 1–4, the level line the prespecified number of points is dependent on the num-
is represented by long dashed lines, and the trend line is ber of total probe points in the treatment phase (i.e., 8 data
represented by short dashed lines. With the CDC method, points in a 9- to 10-point treatment phase; 6 data points in
interpretation of positive treatment effects relies on a a 6- to 7-point treatment phase; Fisher et al., 2003). Type I
error rates (i.e., erroneous attribution of a positive treat- Appendix G in the online supplemental materials. For the
ment effect) have been shown to be well controlled with the calculation of effect sizes, the initial baseline probe values for
CDC method even with high degrees of autocorrelation a given set (i.e., probes conducted in baseline prior to the
(Fisher et al., 2003). In addition, the CDC method has been application of any treatment) and the two follow-up probe
found to have higher power than the general linear model values for that set were used. The calculated effect sizes re-
and interrupted time series analysis. flect the cumulative effects of both phases of treatment
Effect sizes (d-index; Bloom, Fischer, & Orme, 2009; on the behavior (i.e., any generalization effects would be
Cohen, 1988) were calculated as indicators of the magni- included).
tude of change associated with treatment; d-index values To interpret the effect sizes, the following bench-
are shown on the individual graphs in Figures 1–4 and in marks suggested by Beeson and Robey (2006) were used:
2200 Journal of Speech, Language, and Hearing Research • Vol. 57 • 2191–2207 • December 2014
Figure 4. Number of CIUs produced in response to experimental picture sets for Participant 4.
d = 2.6, small; d = 3.9, medium; and d = 5.8, large. These have utility for interpreting the magnitude of the effect sizes
values were derived from effect sizes calculated by Robey, obtained for CAAST.
Schultz, Crawford, and Sinner (1999) as part of a review Participant 1. As shown in Figure 1, Participant 1
of single-subject design treatment investigations in aphasia received CAAST applied first to Set 1 and then to Set 3,
that included a predominance of studies focused on verbal with Set 2 remaining untreated. Baseline probe values
production. Consequently, the proposed benchmarks may ranged from 28 to 58 CIUs across the three sets. Following
2202 Journal of Speech, Language, and Hearing Research • Vol. 57 • 2191–2207 • December 2014
Set 2, d = 13.64; and Set 3, d = 16.01. A medium effect size Single Word Intelligibility
was found for the untreated set (Set 1), with d = 5.79.
Pre- and posttreatment single word intelligibility
scores from the AIDS (Yorkston & Beukelman, 1981) are
Production of CIUs in Pre- and Posttreatment shown in Appendix H in the online supplemental materials.
Discourse Samples A 12% increase in intelligibility was seen for Participant 3,
but scores remained relatively unchanged for the other
Increased CIU production in narrative and proce-
participants.
dural discourse (Nicholas & Brookshire, 1993) was seen
for Participants 2 and 3 at posttreatment: Participant 2,
12 CIUs (pre) and 22 CIUs (post); Participant 3, 129 CIUs
(pre) and 260 CIUs (post). Participants 1 and 4 demon-
Discussion
strated decreases in CIU production in posttreatment nar- This study was conducted to determine whether
rative and procedural discourse: Participant 1, 279 CIUs CAAST was associated with improvements in verbal lan-
(pre) and 104 (post); Participant 4, 54 CIUs (pre) and guage and speech production in speakers with chronic
36 CIUs (post) (see Appendix H in the online supplemental aphasia and AOS. Increases in production of content were
materials). found for all participants, whereas gains in speech produc-
tion measures varied across participants.
The outcome measure chosen to measure language
PCC in Sentence Repetition production changes was number of CIUs produced in dis-
PCC values for pretreatment, interim, and posttreat- course; this measure was selected to allow comparison
ment sentence repetition samples are shown in Table 3. of the effects of CAAST with RET (Kearns, 1985) and
Values are presented separately for the sets of sentences, M-RET (Wambaugh & Martinez, 2000; Wambaugh et al.,
and the sets are designated as being presented “with” or 2012). Substantial increases in production of CIUs in re-
“without” printed stimuli. sponse to trained picture sets were found for all participants
Participant 1 demonstrated relatively high levels of in the current study. These increases were consistent with
accuracy in the three pretreatment baseline samples, with previous RET findings (Kearns, 1985; Kearns & Scher,
PCC ranging from 82% to 90% across the samples. After 1989; Kearns & Yedor, 1991) and M-RET findings
treatment was initiated, there were only two instances when (Wambaugh & Martinez, 2000; Wambaugh et al., 2012).
PCC was slightly higher than baseline levels. Benchmarks for effect sizes are not currently available
Participant 2 displayed low levels of accuracy in base- specifically for RET and M-RET. However, effect sizes
line samples, with PCC ranging between 7% and 17% at follow-up for treated sets for the current participants
for the auditory only sentences (“without”) and between (d-index = 5.41–21.63) were in keeping with those found for
12% and 24% for the auditory plus orthographic sentences M-RET (Wambaugh et al., 2012; d-index = 0.58–19.45).
(“with”). After the first phase of treatment, PCC increased Generalization to untreated picture sets was consis-
to 24% for the auditory only sentences, but this increase tently positive in the present study. Although generalization
was not sustained; PCC at follow-up periods approximated to untreated sets has been found to occur for the majority
baseline levels for the auditory only condition. For the of participants who have received RET or M-RET, gen-
auditory plus orthographic sentences, increased PCC values eralization has been found to be absent or limited in a few
were obtained at all sampling times following the initia- instances (see Wambaugh et al., 2012, for a summary).
tion of treatment. However, accuracy levels for follow-up Small effect sizes ranging from 3.8 to 5.79 were obtained
probes were only slightly higher than the highest baseline for the untrained set for the four participants who received
level (e.g., 26%). CAAST. In comparison, less than small effect sizes were
Participant 3’s PCC values ranged from 35% to 44% found for untrained sets for four of six participants who re-
for the auditory only sentences and from 39% to 51% for ceived M-RET (Wambaugh et al., 2012). The finding that
the auditory plus orthographic condition in baseline. Al- changes in CIU production for untreated picture sets was
though PCC values exceeded baseline for most sampling positive but consistently of lesser magnitude than treated
times for the auditory only sentences after treatment began, sets is consistent with Yedor et al.’s (1993) review of gener-
the 6-week follow-up PCC value approached baseline levels alization findings with RET; across RET participants, in-
(e.g., 46%). Increases were also observed for the auditory creases in untrained items were about 33% of increases with
plus orthographic sentences, and these gains were maintained trained items.
in follow-up samples (68% at 6 weeks posttreatment). Generalization of treatment effects to the narrative
In baseline samples, Participant 4’s auditory only and procedural discourse samples elicited using Nicholas
sentence PCC values ranged from 34% to 44%. Baseline and Brookshire’s (1993) procedure was positive for two of
PCC values for auditory plus orthographic sentences the four participants. This finding is in line with M-RET
ranged from 33% to 55%. Increases that were maintained findings in that Wambaugh et al. (2012) found posttreat-
at follow-up were seen for both sets of sentences: At 6 weeks ment increases in this condition for four of six participants.
posttreatment, auditory only PCC = 60%, and auditory However for the remaining two participants, decreases
plus orthographic PCC = 78%. in CIU production were found posttreatment. Repeated
Note. Bold values are greater than the highest baseline (BL) value. CNT = could not test because participant was unavailable.
measurement with these stimuli prior to treatment would error is an important component of SPT; CAAST offered
be desirable in future investigations to elucidate within- fewer opportunities for practice than is typical with SPT.
participant variability with this measure (Cameron, This may be the reason why improvements in speech pro-
Wambaugh, & Mauszycki, 2010). Without such infor- duction were not found with all participants. However, it is
mation, gains or losses associated with treatment cannot unknown as to whether SPT would result in improvements
be reliably determined. in the speech production outcome measures chosen for this
Differences in participant characteristics, treatment study. That is, on the basis of our measures, we cannot state
variations, and study designs may account for slight differ- that the effects of CAAST on speech production differed
ences in CIU production findings across the various RET from SPT.
and M-RET reports and this investigation of CAAST. The speech outcome measures for CAAST may or
However, it appears that CAAST outcomes relative to CIU may not have reflected the practice that occurred during
production were quite similar to those of RET and M-RET. CAAST; an analysis of all of the productions and sound er-
An anonymous reviewer suggested that the increases rors that occurred during treatment is beyond the scope
in CIU production with untrained sets may have occurred of this initial report. PCC in repetition of sentences (which
because the sentences used in the PCC probes served as were predicted to be similar to those generated during
models for responding. This did not appear to be the case, CAAST) was chosen as a general measure of speech produc-
as PCC probes were completed prior to the final baseline tion accuracy. For the participants who did not demonstrate
picture description probe for Participants 1, 2, and 4; conse- change on this measure (Participant 1 and Participant 2),
quently, any benefit from these sentences should have been there may have been issues with stimuli difficulty that con-
apparent during baseline. For Participant 3, all PCC probes tributed to the lack of findings. Specifically, Participant 1
were completed after the final picture description probe. made relatively few errors on the sentences prior to treat-
However, there were no gains in CIU production in the first ment, leaving little room for improvement. Conversely,
two picture description probes following treatment applica- Participant 2 displayed a great deal of difficulty in repeat-
tion (after the PCC probes), which speaks against any effect ing sentences of seven to nine syllables. Although the PCC
from the PCC sentences. It was also suggested that use of measure was focused on speech production, the participants’
the CAAST sentence frame may have caused the partici- aphasia certainly played a role in ability to repeat accurately.
pants to adjust their responding in the picture probes. We Shorter sentences or phrases would likely have been more
argue that flexibility in responding is a goal of CAAST appropriate for Participant 2 and may have allowed improve-
(and of RET), and if a different approach to narrative dis- ments in PCC to be evident. Interpretation of the clinical
course occurred with treatment, this is compatible with a significance of changes in PCC requires further study.
treatment effect (note that no sentence frames are used with On the other hand, stimuli length may have not played
RET). a role in the outcomes. The second speech production out-
Speech production outcomes were not as robust as come measure, single word speech intelligibility, was clearly
the CIU outcomes for CAAST. With respect to accuracy of not impacted by the factor of length. However, this measure
consonant production in repeated sentences, clear improve- could also have been affected by the participants’ aphasia.
ments were seen with auditory only (without written stimuli) It would have been preferable if we had conducted repeated
and auditory + orthographic (with written stimuli) sentences administrations of the AIDS (Yorkston & Beukelman, 1981)
for two participants (Participant 3 and Participant 4). A to establish individual patterns of variability for the partici-
third participant demonstrated gains in repetition that were pants’ intelligibility scores. However, the most parsimonious
not maintained (Participant 2), and the fourth participant explanation for the nonrobust speech production outcomes
(Participant 1) did not exhibit any notable increases. An im- is that insufficient AOS treatment occurred.
provement in single word speech intelligibility was found Future development of CAAST will include additional
for only one of the participants (Participant 3). SPT trials with the participants’ self-generated utterances.
CAAST includes components of the apraxia treat- In addition to modifying the current outcome measures in
ment, SPT. As noted previously, SPT has typically been terms of difficulty (sentence repetition) and repeated admin-
applied to prespecified target items (e.g., specific sounds in istrations (intelligibility), other speech outcome measures
words or specific words with multiple sound targets). Con- will be explored. For example, intelligibility of self-generated
sequently, SPT effects have been measured in terms of im- utterances may be an appropriate outcome measure for
provement of targeted items (Wambaugh, 2004; Wambaugh CAAST.
& Mauszycki, 2010; Wambaugh & Nessler, 2004; Wambaugh, Additional language outcome measures will also be
Nessler, Cameron, & Mauszycki, 2013). With CAAST, the evaluated with CAAST. Analyses of language changes asso-
participant generates novel utterances, and, as such, there are ciated with RET and M-RET (beyond amount of content)
no prespecified targets for treatment. Therefore, direct com- have revealed qualitative improvements (e.g., increases in
parison of findings from the current study with previous novel content, increases in mean length of utterance, and in-
SPT findings is not possible. We had been concerned that creases in phrase and sentence production) for some partici-
there might not be sufficient opportunities for instruction pants. Given the increases in CIUs found with CAAST and
and practice with erroneous productions with CAAST. That the overlap of treatment techniques with RET and M-RET,
is, repeated practice with productions that are frequently in similar qualitative changes would be expected with CAAST.
2206 Journal of Speech, Language, and Hearing Research • Vol. 57 • 2191–2207 • December 2014
Wambaugh, J. L., Kalinyak-Fliszar, M. M., West, J. E., & Doyle, Wambaugh, J. L., Nessler, C., Wright, S., & Mauszycki, S. C.
P. J. (1998). Effects of treatment for sound errors in apraxia (2013). Sound Production Treatment: Effects of blocked and
of speech. Journal of Speech, Language, and Hearing Research, random practice. American Journal of Speech-Language
41, 725–743. Pathology, 23, S225–S245. doi:10.1044/2014_AJSLP-13-0072
Wambaugh, J. L., & Martinez, A. L. (2000). Effects of modified Wambaugh, J. L., & Shuster, L. I. (2008). Nature and manage-
Response Elaboration Training with apraxic and aphasic ment of neuromotor speech disorders accompanying aphasia.
speakers. Aphasiology, 14, 603–617. In R. Chapey (Ed.), Language intervention strategies in aphasia
Wambaugh, J. L., & Mauszycki, S. C. (2010). Sound Produc- and related neurogenic communication disorders (5th ed.,
tion Treatment: Application with severe apraxia of speech. pp. 1009–1042). Philadelphia, PA: Lippincott, Williams, &
Aphasiology, 24, 814–825. Wilkins.
Wambaugh, J. L., & Nessler, C. (2004). Modification of Sound Wambaugh, J. L., West, J. E., & Doyle, P. J. (1998). Treatment
Production Treatment for apraxia of speech: Acquisition and for apraxia of speech: Effects of targeting sound groups.
generalisation effects. Aphasiology, 18, 407–427. Aphasiology, 12, 731–743.
Wambaugh, J. L., Nessler, C., Cameron, R., & Mauszycki, S. Wambaugh, J. L., Wright, S., & Nessler, C. (2012). Modified
(2013). Treatment for acquired apraxia of speech: Examina- Response Elaboration Training: A systematic extension with
tion of treatment intensity and practice schedule. American replications. Aphasiology, 26, 1407–1439.
Journal of Speech-Language Pathology, 22, 84–102. Yedor, K. E., Conlon, C. P., & Kearns, K. P. (1993). Measure-
Wambaugh, J. L., Nessler, C., & Wright, S. (2013). Application ments predictive of generalization of Response Elaboration
of Response Elaboration Training to procedural discourse. Training. Clinical Aphasiology, 21, 213–223.
American Journal of Speech-Language Pathology, 22, Yorkston, K. M., & Beukelman, D. R. (1981). Assessment of Intel-
S409–S425. ligibility of Dysarthric Speech. Austin, TX: Pro-Ed.