Exploration of The Impact of Organisational Context On A Workplace Safety and Health Intervention
Exploration of The Impact of Organisational Context On A Workplace Safety and Health Intervention
Leslie B. Hammer, Donald M. Truxillo, Todd Bodner, Amy C. Pytlovany & Amy
Richman
To cite this article: Leslie B. Hammer, Donald M. Truxillo, Todd Bodner, Amy C. Pytlovany & Amy
Richman (2019): Exploration of the impact of organisational context on a workplace safety and
health intervention, Work & Stress, DOI: 10.1080/02678373.2018.1496159
Article views: 26
These integrated approaches have more recently been referred to as Total Worker Health®
(TWH) interventions (Anger et al., 2015) by the National Institute of Occupational Safety
and Health (NIOSH) in the United States.
One promising preventative strategy for improving employee health and well-being
that can be implemented at multiple organisational levels is helping workers manage chal-
lenges that arise between work and non-work responsibilities through leadership support
(Hammer, Demsky, Kossek, & Bray, 2016). Meta-analytic research has demonstrated that
work-life conflict is associated with higher levels of absenteeism and burnout, increased
health problems, psychological strain, depression, substance use, reduced job, family,
and life satisfaction, and reduced job performance and commitment (Amstad, Meier,
Fasel, Elfering, & Semmer, 2011). Thus, leadership interventions that are focused on
work-life conflict reduction are warranted.
Furthermore, workers in certain safety sensitive occupational settings, such as field con-
struction workers in the present study, continue to experience safety risks at work due to
unsafe work environments and poor safety climates that are often triggered by leaders who
disregard and do not support safe work practices. Leadership development has been recog-
nised as an important factor in improving safety in workplaces and an ideal target of work-
place interventions (Kelloway & Barling, 2010).
Given the significant effects of unsafe work conditions and high levels of work-life
conflict on individual and organisational success, and the mismatch between research
and practice, it is clear that more work is required to study interventions that may lead
to improved worker safety, health, and well-being. Furthermore, leadership is instrumen-
tal in contributing to the reduction of stress and improvements in well-being (Kelloway,
Turner, Barling, & Loughlin, 2012; Nielsen, Randall, Yarker, & Brenner, 2008; Skakon,
Nielsen, Borg, & Guzman, 2010), and the contribution of leadership to the safety of
workers has been well documented (Barling, Loughlin, & Kelloway, 2002; Kelloway,
Mullen, & Francis, 2006). However, the effectiveness of interventions may vary dramati-
cally depending on the organisational characteristics and settings, suggesting that examin-
ing the pre-intervention context can assist in better understanding how such interventions
affect health and stress outcomes and may provide important information for future inter-
vention development.
The Safety and Health Improvement Program (SHIP) is a research-based intervention
designed to improve employee health and safety by targeting multiple organisational levels
using a two-pronged approach (Hammer et al., 2015). Goals of SHIP include increasing
awareness and motivating behaviour change among supervisors and teams to encourage
support for managing work-life challenges and safety performance. Based in social
support theory (Cohen & Wills, 1985), SHIP targets training supervisors through utilis-
ation of computer-based training and subsequent supervisor behaviour tracking. SHIP
also targets supervisors and teams collectively with facilitated team effectiveness sessions
and structured follow-ups. The present study examines both the process and outcomes of
the implementation of a leadership intervention designed to impact safety and well-being
by implementing SHIP as a clustered, randomised controlled trial. As discussed below, in
addition to testing the effectiveness of the SHIP intervention on family supportive super-
visor behaviors, two pre-intervention contextual factors, team effectiveness and leader-
member exchange, were examined in this study to assesses possible boundary conditions
WORK & STRESS 3
by exploring how supervisor (leader) and team relationships prior to the intervention may
differentially impact (i.e. moderate) intervention success.
Theoretical mechanisms
The SHIP intervention is based primarily in social support theory, as the focus is on train-
ing supervisors to be more supportive of crew members in the areas of work-life inte-
gration and safety. Scholars have repeatedly demonstrated that social support is directly
related to beneficial well-being outcomes and that social support can also serve as a
resource and buffer the negative effects of stressors (Cohen & Wills, 1985). In addition
to social support, SHIP was developed with the expectation that when we improved the
quality of the relationship between supervisors and employees through training
4 L. B. HAMMER ET AL.
Team effectiveness
Co-worker and team support are also important factors impacting employee health and
well-being and a critical leverage point for culture change. (e.g. Kelly et al., 2014).
WORK & STRESS 5
Work-life effectiveness
Work-life effectiveness occurs when employees experience support for personal and
family responsibilities across organisational levels (supervisor, co-workers, senior manage-
ment), resulting in reduced stress and an increased ability to focus and perform at work.
Meta-analytic research has demonstrated that support from all organisational levels has
significant impacts on experiences of work-family conflict (Michel, Kotrba, Mitchelson,
Clark, & Baltes, 2011). Furthermore, a review of job-stress interventions indicates that
systems approaches benefit both the individual and organisation (LaMontagne, Keegel,
Louie, Ostry, & Landsbergis, 2007). For example, a comparison of interventions indicated
that those targeted at the psychosocial work environment, as opposed to focusing on indi-
vidual employee behaviours, resulted in the greatest decrease in absenteeism (LaMontagne
et al., 2007).
Supervisor and team training components were implemented as part of SHIP to
improve reports of work-life effectiveness. As reviewed above, the SHIP intervention
focused on key organisational relationships and work processes, specifically targeting
improvement of supervisor and team support for safety and work-life challenges. Based
on this empirically-supported and targeted approach, it was expected that SHIP would
have a direct effect on employee reports of FSSB, team effectiveness, and work-life
effectiveness.
Hypothesis 1: Employees in the SHIP condition will have significantly higher reports of FSSB,
team effectiveness processes, and work-life effectiveness compared to those employees in the
control group who are not exposed to the workplace intervention.
and the social exchange is purely transactional. Other characteristics of high-quality LMX
are better communication, support, and feeling valued.
Perhaps it can be argued that those supervisors who have poor quality relationships
with their employees based on reports of LMX see greater value in the training and
thus are more ready and motivated to pay attention to and learn from the training, and
more likely to transfer learned behaviours (Bell et al., 2017; Colquitt, LePine, & Noe,
2000). Furthermore, we expected that the relationship an employee has with their super-
visor prior to the intervention will affect the degree of change in employee attitudes. The
SHIP intervention, targeted at improving emotional and instrumental supervisor support
for employees, is likely to have a greater impact for those who report low LMX at baseline
because they are already lacking in both support and resources and therefore will have the
most to gain from the intervention.
Hypothesis 2: The intervention effects of SHIP will be moderated by baseline levels of LMX
such that the intervention effects will be more beneficial for those employees with lower levels
of baseline LMX based on the outcomes of FSSB, team effectiveness processes, and work-life
effectiveness.
Team cohesion
Bollen and Hoyle (1990) defined perceptions of team cohesion as “an individual’s sense of
belonging to a particular group and his or her feelings of morale associated with member-
ship in the group” (p. 482). A sense of belonging and morale are determined by both cog-
nitive and affective appraisals of experiences with the group and group members. Research
suggests that a single event can initiate interplay of cognitive and affective responses result-
ing in an increased sense of belonging and higher morale (Bollen & Hoyle, 1990; Zajonc &
Markus, 1984). Similar to our hypothesis relating to LMX, we expect team members who
report lower baseline levels of team cohesion will perceive the training to have more value
because they will have the most to gain. Higher value perceptions will increase motivation
to learn and training transfer (Colquitt et al., 2000) thereby driving stronger intervention
effects, particularly from the TEP component.
Hypothesis 3: The intervention effects of SHIP will be moderated by baseline levels of Team
Cohesion such that the intervention effects will be more beneficial for those with lower levels
of baseline Team Cohesion based on the outcomes of employee reports of FSSB, team effec-
tiveness processes, and work-life effectiveness.
Method
Procedure and design
A randomized controlled trial design was utilised to test the effectiveness of the SHIP
intervention. Workgroups from a municipal public works department who were
primarily field construction workers were randomly assigned to treatment (n = 11) or
wait-list control (n = 9) groups. Two-hundred and ninety-two employees were invited
to participate in pencil-and-paper surveys administered on-site, during working hours,
in October-November 2012 (baseline) and again in May 2013 (post-intervention). All
employees were expected to attend the session, but participation was voluntary. A $25
WORK & STRESS 7
gift card was offered to those who opted-in. Two-hundred and forty-nine participated in
total (Intervention: n = 148; Control: n = 101) for an 85% response rate, with 195 having
participated at both pre- and post-intervention time points (Intervention: n = 125;
Control: n = 70) for a 67% response rate. Three of the five variables in this study were col-
lected on both measurement occasions (LMX, team cohesion, and FSSB). Measures of
team effectiveness process (TEP) and work-life effectiveness indicators (WLEI) were
only collected post-intervention.
Participants
Employees were construction workers with job titles including electrician, plumber, and
utility worker, and 81% worked at least a 40-hour week. They were predominantly
White (78%) males (90%), and over half (63%) were married and had children at home
(56%). Additionally, 35% reported being responsible for the care of an adult relative.
Most had completed high school (97%) and about half had college experience (53%).
Average tenure was 11.4 years. Team size ranged from 6–20 employees, and work crew
members reported directly to one supervisor.
involves behaviours that express genuine concern for employees’ work-life challenges.
These behaviours can be as simple as increasing face-to-face contact and asking employees
how they are doing. Daily job and personal problem solving is the instrumental support
supervisors provide. For example, adjusting work assignments to support employees’
family or personal needs for both ongoing and unexpected emergency events. Role-mod-
eling healthy work-life behaviors refers to a supervisor’s own actions that indicate making
time for family and personal life is a valued priority. These behaviours might include
sharing stories of taking time for personal needs, or simply setting the example of
leaving work at reasonable hours.
Safety supportive behaviours included in the training were: (1) safety communication,
(2) providing resources, (3) safety role modelling, and (4) feedback and coaching. Safety
communication focuses on quality and quantity of discussions with employees about
the importance of safety. This includes emphasis on safety as a priority, and also maintain-
ing open and honest dialog to encourage employee feedback about safety concerns. Pro-
viding resources are the behaviours supervisors engage in to ensure employees have the
tools and equipment they need to perform their jobs safely. Safety role-modeling demon-
strates that supervisors put safety first and includes behaviours such as following safety
protocols and talking about safety as a personal priority. Feedback and coaching are super-
visor actions that acknowledge and positively reinforce when an employee is acting safely,
and redirection of employees when safety performance should be improved.
The second supervisor-focused component involved behavioral tracking on the job to
increase transfer of skills and behaviours included in the computer-based training. Specifi-
cally, upon completion of the computer-based training, supervisors were asked to set per-
sonal goals for enacting the learned behaviours within their team. Goals were entered by
the supervisors, who then tracked their own behaviour for two weeks using an iPod
Touch® enabled with a software application designed for use in behavioural interventions
(HabiTrak). This intervention component was used to facilitate transfer of training and is
based on an abundance of research illustrating that better training outcomes result from
individual goal-setting (e.g. Salas, Tannenbaum, Kraiger, & Smith-Jentsch, 2012), and
behavioural observation and evaluation (e.g. Hickman & Geller, 2005; Olson & Austin,
2001; Olson & Winchester, 2008). In addition to providing tracking functionality, the
application also provided resources to support the training such as behavioural definitions
and video instructions for each of the eight learned behaviours.
challenges, safety, and overall effectiveness and efficiency. During the TEP session, teams
reviewed the results of the pre-TEP surveys, worked together to identify root causes of
common issues and brainstormed solutions for maximising team performance and
support. The supervisor and their crew worked together to develop operating principles,
or agreements for work climate, and specific action plans to drive change.
The final component of the intervention included regular check-ins and follow-up.
These were held at 30, 60, and 90 days after the TEP sessions. Check-in meetings included
revisiting the operating principles and action plan to ensure progress was being made, and
to revise as needed. WFD-trained facilitators attended and assisted with these meetings.
Measures
FSSB
Employees reported perceptions of their supervisor’s Family Supportive Supervisor Beha-
viors with a four-item scale (Hammer, Kossek, Bodner, & Crain, 2013). FSSB was measured
at the six-month follow-up time period. These items directly map onto computer-based
training content. An example item is “My supervisor works effectively with employees to
creatively solve conflicts between work and non-work”. Item responses are indicated on a
5-point Likert-type scale with options ranging from 1 = “strongly disagree” to 5 = “strongly
agree”. Scale scores are the average of item responses with higher scores indicating higher
levels of FSSB. The scale demonstrated acceptable reliability (α = .90).
characterise your working relationship with your supervisor”. Item responses are indicated
on a 5-point Likert-type scale. For the example item, response options range from 1
= “extremely ineffective” to 5 = “extremely effective”. Response options for other items
include response options ranging from 1 = “strongly disagree” to 5 = “strongly agree”
and 1 = “none” to 5 = “very high”. Scale scores are the average of item responses with
higher scores indicating higher levels of LMX. The scale demonstrated acceptable
reliability (α = .90). LMX was examined as a moderator of the SHIP intervention effects.
Team cohesion
Team cohesion was measured at baseline with a six-item scale assessing individual percep-
tions of belonging and team morale (Chin, Salisbury, Pearson, & Stollak, 1999) and was
also assessed as a moderator of the intervention effects. An example item is “I feel that
I belong to this team”. Item responses are indicated on a 5-point Likert-type scale with
options ranging from 1 = “strongly disagree” to 5 = “strongly agree”. Scale scores are the
average of item responses with higher scores indicating higher levels of Team Cohesion.
The scale demonstrated acceptable reliability (α = .92).
Results
Missing data and analytic strategy
In light of the amount of missing data at either time point, Mplus (v. 4.2) was used for ana-
lyses using full information maximum likelihood estimation to account for the inferential
uncertainty due to the missing data (Muthén & Muthén, 2006). As the employees were
nested within 21 functional workgroups and these workgroups were randomly assigned
to either the intervention or control condition, initial analyses were conducted to explore
the lack of independence of employee data due to this hierarchical structure. Unconditional
general linear mixed effects models using full information maximum likelihood estimation
were used to quantify the amount of variability in the study outcomes attributable to work-
group membership. The unconditional intraclass correlations for the TEP, WLEI, and FSSB
outcomes were .06, .07, and .13, respectively. Thus, general linear mixed models were used to
test study hypotheses to estimate and account for workgroup level random effects (e.g. Hox,
2010; Raudenbush & Bryk, 2002). Finally, because the TEP and WLEI outcomes were only
assessed at the 6-month follow-up, we used the Post Test Only model—as described in
Bodner and Bliese (2017)—to estimate and test for intervention effects.
Finally, because of the interest in moderated intervention effects (i.e. Hypotheses 2 and
3), initial analyses were conducted to explore whether the relationship between the base-
line moderator variables and the outcomes varied across workgroups within the two inter-
vention arms. The variances of these random slopes were neither large nor statistically
significant (p-values: min. = .12, median = .57). Therefore, for parsimony, these slopes
were modelled as fixed effects within each intervention condition. To aid in the interpret-
ation of the simple effects of the intervention on the outcomes, all baseline moderator vari-
ables were grand mean centred for the analyses (Aiken & West, 1991).
Table 1 provides means and standard deviations for, and correlations among, study
variables separately for the intervention and control conditions. We note that these cor-
relations are positive and statistically significant; although some of these correlations
WORK & STRESS 11
Table 1. Means and standard deviations of and correlation among study variables by intervention
condition.
1. 2. 3. 4. 5.
M 3.03 3.21 3.30 3.53 3.20
Variable M SD\SD 0.76 0.75 0.96 0.76 0.89
1. Team Effectiveness Processes (Follow-up) 3.15 0.71 1.00 .55* .68* .52* .53*
2. Work-Life Effectiveness Indicators (Follow-up) 3.28 0.74 .52* 1.00 .64* .46* .56*
3. Family-Supportive Supervisor Behaviours (Follow-up) 3.22 0.80 .33* .37* 1.00 .38* .68*
4. Team Cohesion (Baseline) 3.70 0.82 .38* .27* .22* 1.00 .46*
5. Leader-Member Exchange (Baseline) 2.99 0.85 .26* .32* .45* .46* 1.00
Notes: Descriptive statistics below the main diagonal are for the Intervention condition, above the main diagonal for the
Control condition. Intervention condition Ns 121–136; Control condition Ns 68–89.
*p < .05 (p-values do not account for nesting of employees in workgroups).
are large in magnitude, none are so large to indicate that these variables measure the same
construct. Initial analyses explored whether there were differences across intervention
conditions at baseline for the study variables assessed at baseline. No significant differ-
ences across conditions were observed for Leader-Member Exchange (B = −0.19,
p = .32, ΔR 2 < .01) or Team Cohesion (B = 0.19, p = .19, ΔR 2 < .01).
were observed at follow-up for TEP (B = 0.11, p = .34, ΔR 2 = .01), WLEI (B = 0.08, p = .52,
ΔR 2 < .01), or FSSB (B = −0.08, p = .63, ΔR 2 < .01). It should be noted that evidence of
intervention effects are not required to test for moderators of intervention effects (i.e.
Hypotheses 2 and 3). These analyses and results follow.
Table 2 provides the mixed model results for the effect of the intervention on FSSB,
TEP, and WLEI at follow-up as moderated by baseline LMX. In each model, baseline
LMX is significantly related to the three outcomes in the control condition (i.e. when
Intervention = 0). Evaluated at the grand mean for baseline LMX, participants in the inter-
vention condition had significantly higher TEP and WLEI scores on average at follow-up
than participants in the control condition (i.e. B = 0.28, p = .02, ΔR 2 = .05, and B = 0.24, p
= .03, ΔR 2 = .03, respectively), but not for FSSB scores at follow-up (i.e. B = 0.12, p = .36,
ΔR 2 = .01). As also reported in Table 2, baseline LMX significantly moderated the
effects of the intervention on TEP scores (B = −0.27, p = .04, ΔR 2 = .03) and FSSB scores
(B = −0.35, p = .04, ΔR 2 = .03) at follow-up. Figure 1 displays the nature of the moderated
intervention effect on TEP scores at follow-up ranging from 1 SD below to 1 SD above the
baseline LMX mean (cf. Dawson, 2014); descriptively interpreted, the intervention had a
more beneficial impact on TEP scores at follow-up for those participants with lower,
rather than higher, LMX scores at baseline. The graph of the moderated intervention
effect on FSSB scores (not shown) is similar. The moderated intervention effect on
WLEI scores at follow-up, however, was not statistically significant (i.e. B = −0.21,
p = .11, ΔR 2 = .02). Thus, Hypothesis 2 was partially supported.
Table 3 provides the mixed model results for the effect of the intervention on TEP,
WLEI, and FSSB at follow-up as moderated by baseline Team Cohesion. In each model,
baseline Team Cohesion was significantly related to the three outcomes in the control con-
dition (i.e. when Intervention = 0). No significant intervention effects were observed when
evaluated at the grand mean for baseline Team Cohesion. As also reported in Table 3,
however, baseline Team Cohesion significantly moderated the effects of the intervention
on TEP scores (B = −0.28, p = .03, ΔR 2 = .02), WLEI scores (B = −0.30, p = .02, ΔR 2
= .03), and FSSB scores (B = −0.36, p = .04, ΔR 2 = .03) at follow-up. Figure 2 displays
the nature of the moderated intervention effect on TEP scores at follow-up ranging
from 1 SD below to 1 SD above the baseline Team Cohesion mean; descriptively inter-
preted, the intervention had a more beneficial impact on TEP scores at follow-up for
Table 2. General linear mixed model results with FIML estimation of intervention effects on TEP, WLEI,
and FSSB at follow-up as moderated by baseline leader-member exchange.
DV: Work-Life
DV: Team Effectiveness Effectiveness DV: Family Supportive
Process Indicators Supervisor Behaviors
Est. 95% CI Est. 95% CI Est. 95% CI
Intercept 2.87* (2.70, 3.05) 3.09* (2.96, 3.23) 3.14* (2.95, 3.32)
Intervention 0.28* (0.05, 0.52) 0.24* (0.03, 0.44) 0.12 (−0.14, 0.39)
Baseline Leader-Member Exchange (BLMX) 0.49* (0.29, 0.68) 0.49* (0.32, 0.66) 0.74* (0.44, 1.04)
Intervention × BLMX −0.27* (−0.53, −0.01) −0.21 (−0.47, 0.05) −0.35* (−0.67, −0.02)
Residual Variance 0.43* (0.36, 0.51) 0.44* (0.36, 0.52) 0.45* (0.35, 0.54)
Intercept Variance 0.03 (0.00, 0.08) 0.01 (0.00, 0.04) 0.04 (0.00, 0.11)
Model Pseudo R 2
.17* .20* .34*
Notes: FIML = Full Information Maximum Likelihood. Intervention (coded: 1 = Intervention; 0 = Control). Baseline Leader-
Member Exchange is grand mean centred.
*p < .05.
WORK & STRESS 13
Table 3. General linear mixed model results with FIML estimation of intervention effects on TEP, WLEI,
and FSSB at follow-up as moderated by baseline team cohesion.
DV: Team Effectiveness DV: Work-Life DV: Family Supportive
Process Effectiveness Indicators Supervisor Behaviors
Est. 95% CI Est. 95% CI Est. 95% CI
Intercept 3.00* (2.83, 3.16) 3.20* (3.05, 3.34) 3.32* (3.11, 3.53)
Intervention 0.11 (−0.12, 0.34) 0.08 (−0.15, 0.31) −0.11 (−0.43, 0.22)
Baseline Team Cohesion (BTC) 0.61* (0.44, 0.79) 0.53* (0.31, 0.75) 0.58* (0.28, 0.88)
Intervention × BTC −0.28* (−0.54, −0.02) −0.30* (−0.55, −0.04) −0.36* (−0.71, −0.02)
Residual Variance 0.41* (0.33, 0.49) 0.45* (0.35, 0.55) 0.57* (0.40, 0.73)
Intercept Variance 0.02 (0.00, 0.07) 0.02 (0.00, 0.07) 0.09 (0.00, 0.18)
Model Pseudo R 2 .23* .17* .12*
Notes: FIML = Full Information Maximum Likelihood. Baseline Team Cohesion is grand mean centred.
*p < .05.
Figure 2. Intervention effects on team effectiveness processes as moderated by baseline levels of team
cohesion.
those participants with lower, rather than higher, Team Cohesion scores at baseline. The
graphs of the moderated intervention effects on WLEI and FSSB scores (not shown) are
similar. Thus, Hypothesis 3 was supported.
Discussion
While the main effects of the intervention on well-being outcomes were not significant, the
results of this study indicate that SHIP, based on leadership training and TEP, was more
14 L. B. HAMMER ET AL.
beneficial for work crew members who had poorer perceptions of their relationship with
their supervisor based on LMX, and poorer perceptions of their work crew relations based
on Team Cohesion, at baseline. These boundary condition results suggest that the pre-
intervention context in which an intervention is implemented deserves thorough con-
sideration and understanding as we attempt to identify organisational interventions
(e.g. Biron et al., 2012; Nielsen et al., 2010; Semmer, 2006).
In addition, the results add to a growing body of literature indicating that workplace
interventions may benefit employees who, at baseline, are marginalised or experiencing
particular work-life challenges. For example, this finding is consistent with those of
Hammer et al. (2011) who demonstrated significant beneficial workplace intervention
effects for workers who reported high work-family conflict at baseline.
In the present study, LMX and team cohesion acted as boundary conditions in the
intervention’s effectiveness, suggesting that the SHIP intervention may only be effective
when LMX and team cohesion are perceived to be low by employees. Thus, when
leader-member relations are perceived to be less positive, there is more of a need to
train managers on FSSB and safety communication, as was done with SHIP. For
example, some of the action items that emerged as part of the TEP sessions included
supervisors and team members taking inventory of materials to assess status of resources,
organising and maintaining storage areas, and establishing career development plans for
employees. Through developing root causes and solutions, leaders were made aware of
employees’ needs (resources and development), and the team members communicated
the importance of demonstrating respect through taking care of tools and proper
storage. Highly functioning teams were likely already completing these objectives and
did not require facilitated conversations to integrate these into their work. Collaboration
to establish and clarify expectations was therefore most beneficial where poorer working
relationships hindered efficient work processes and social support.
Alternatively, it is possible that the post-intervention assessment was constrained as we
did not measure everything we could have measured about team effectiveness and super-
visor support at the 6 and 12 month follow-up. Perhaps with a more in-depth analysis of
the intervention process using qualitative methods in addition to quantitative methods, we
would have discovered more about the boundary conditions of the effects of the interven-
tion beyond the outcomes and moderators examined here.
It also is important to note that the intervention moderation effect sizes were small,
consistent with most interaction effect sizes in social science research. We believe that
while this may only represent an intervention with limited effects, it can also be argued
that it is a WISE (Walton, 2014) intervention that is focused on discreet psychological pro-
cesses and that may be scalable in contexts where resources are minimal and unable to
implement and evaluate more extensive embedded interventions.
evaluation of the environment-intervention fit did not take place (Nielsen & Randall,
2012). Perhaps the context did not appropriately facilitate the SHIP intervention. For
example, many of the workers were field workers who needed to travel to worksites and
the demands of the intervention may have created more stress than alleviated stress
because it required a four-hour session of face-to-face interactions between the workers,
as well as follow-up meetings and actions. Alternatively, some of the results could be a
function of workers being frustrated with supervisors/management that may not have fol-
lowed through on implementing the actions raised during the TEP session and in turn,
creating frustration and cynicism of the workers. In addition, the primary evaluation of
the intervention was based on self-reported measures from the employees. Even though
data were collected at baseline and post-intervention and thus separated in time, and
work crews were randomised to the intervention and control conditions, the reliance
on self-report data limits some of the conclusions that can be drawn.
Conclusion
The main contributions of the present manuscript include presenting a study that used a
cluster randomised design, in a high-risk industry, to evaluate the effectiveness of a
workplace leadership training and team process intervention to improve well-being out-
comes for employees. Limited leadership training is available that directly addresses
how leaders can provide support to workers and this training focused on detailing
support behaviours that can be implemented. Furthermore, findings indicate that
important pre-intervention contextual factors impacted the SHIP leadership training,
suggesting the intervention may be more helpful in less than ideal environments
when supervisor and team relations are perceived to be poor. This suggests that
16 L. B. HAMMER ET AL.
workplace interventions may have differential effects depending on how ready organis-
ational members are for change.
Investments in workplace programmes that are aimed at improving supervisor/leader-
ship support and team processes from a multi-level perspective may be more beneficial
than simply focusing on individual level interventions. Consistent with the Total
Worker Health® approach to workplace strategies for improving health and safety of
workers, the SHIP intervention provided here offers an example of an evidence-based pro-
gramme available for workplaces. As noted by Hammer et al. (2016), workplace interven-
tions focused on work-life stress and safety are difficult to develop and test due to the
competing demands of work organisations, resources needed, and the limited funding
available for conducting such research. Thus, the present study provides a test of an evi-
dence-based strategy that may improve well-being of workers, potentially leading to
improved cost savings for employers, as well.
Disclosure statement
No potential conflict of interest was reported by the authors.
Funding
Funding for this project was through the National Institute for Occupational Safety and Health
[grant number U19OH010154]. The authors declare no conflicts of interest.
References
Aiken, L., & West, S. (1991). Multiple regression: Testing and interpreting interactions. Thousand
Oaks, CA: Sage.
Amstad, F. T., Meier, L. L., Fasel, U., Elfering, A., & Semmer, N. K. (2011). A meta-analysis of work–
family conflict and various outcomes with a special emphasis on cross-domain versus matching-
domain relations. Journal of Occupational Health Psychology, 16, 151–169. doi:10.1037/a0022170
Anger, W. K., Elliot, D., Bodner, T., Olson, R., Rohlman, D. S., Truxillo, D. M., … Montgomery, D.
(2015). Effectiveness of total worker health interventions. Journal of Occupational Health
Psychology, 20, 226–247. doi:10.1037/a0038340
Anger, W. K., Rohlman, D. S., Kirkpatrick, J., Reed, R. R., Lundeen, C. A., & Eckerman, D. A.
(2001). cTRAIN: A computer-aided training system developed in SuperCard for teaching
skills using behavioral education principles. Behavior Research Methods, 33, 277–281. doi:10.
3758/BF03195377
Barbosa, C., Bray, J. W., Dowd, W. N., Mills, M. J., Moen, P., Wipfli, B., … Kelly, E. L. (2015).
Return on investment of a work–family intervention: Evidence from the work, family, and
health network. Journal of Occupational and Environmental Medicine, 57, 943–951. doi:10.
1097/JOM.0000000000000520
Barling, J., Loughlin, C., & Kelloway, E. K. (2002). Development and test of a model linking safety-
specific transformational leadership and occupational safety. Journal of Applied Psychology, 87,
488.
Bell, B. S., Tannenbaum, S. I., Ford, J. K., Noe, R. A., & Kraiger, K. (2017). 100 years of training and
development research: What we know and where we should go. Journal of Applied Psychology,
102, 305–323.
Biron, C., Karanika-Murray, M., & Cooper, C. L. (2012). Organizational interventions for stress and
well-being – an overview. In C. Biron, M. Karanika-Murray, & C. L. Cooper (Eds.), Improving
organizational interventions for stress and well-being. London: Routledge.
WORK & STRESS 17
Blair-Loy, M., & Wharton, A. S. (2002). Employees’ use of work-family policies and the workplace
social context. Social Forces, 80, 813–845. doi:10.1353/sof.2002.0002
Bodner, T., & Bliese, P. (2017). Detecting and differentiating the direction of change and interven-
tion effects in randomized trials. Journal of Applied Psychology. Advance online publication.
doi:10.1037/apl0000251
Bollen, K. A., & Hoyle, R. H. (1990). Perceived cohesion: A conceptual and empirical examination.
Social Forces, 69, 479–504. doi:10.1093/sf/69.2.479
Chin, W., Salisbury, W., Pearson, A., & Stollak, M. (1999). Perceived cohesion in small groups
adapting and testing the perceived cohesion scale in a small group setting. Small Group
Research, 30, 751–766. doi:10.1177/104649649903000605
Civian, J. T., Richman, A. L., Shannon, L. L., Shulkin, S., & Brennan, R. T. (2008). Using a multi-
organization database: Research methods, strengths, and limitations. Community, Work &
Family, 11, 139–148.
Cohen, S., & Wills, T. A. (1985). Stress, social support, and the buffering hypothesis. Psychological
bulletin, 98, 310.
Colquitt, J. A., LePine, J. A., & Noe, R. A. (2000). Toward an integrative theory of training motiv-
ation: A meta-analytic path analysis of 20 years of research. Journal of Applied Psychology, 85,
678–707.
Dawson, J. (2014). Moderation in management research: What, why, when and how. Journal of
Business and Psychology, 29, 1–19. doi:10.1007/sl0869-013-9308-7
De Dreu, C. K. (2007). Cooperative outcome interdependence, task reflexivity, and team effective-
ness: A motivated information processing perspective. Journal of Applied Psychology, 92, 628–
638. doi:10.1037/0021-9010.92.3.628
Gottlieb, B. H., & Bergen, A. E. (2010). Social support concepts and measures. Journal of
Psychosomatic Research, 69, 511–520. doi:10.1016/j.jpsychores.2009.10.001
Graen, G. B., & Uhl-Bien, M. (1995). Relationship-based approach to leadership: Development of
leader-member exchange (LMX) theory of leadership over 25 years: Applying a multi-level
multi-domain perspective. The Leadership Quarterly, 6, 219–247. doi:10.1016/1048-9843
(95)90036-5
Hammer, L., Kossek, E., Bodner, T., & Crain, T. (2013). Measurement development and validation
of the family supportive supervision behavior short-form (FSSB-SF). Journal of Occupational
Health Psychology, 18, 285–296. doi:10.1037/a0032612
Hammer, L. B., Demsky, C. A., Kossek, E. E., & Bray, J. W. (2016). Work-Family intervention
research. In T. D. Allen & L. T. Eby (Eds.), The Oxford handbook of work and family (pp.
349–361). New York: Oxford University Press. doi:10.1093/oxfordhb/9780199337538.013.27
Hammer, L. B., Johnson, R. C., Crain, T. L., Bodner, T., Kossek, E. E., Davis, K. D., … Berkman, L.
(2016). Intervention effects on safety compliance and citizenship behaviors: Evidence from the
work, family, and health study. Journal of Applied Psychology, 101, 190–208. doi:10.1037/
apl0000047
Hammer, L. B., Kossek, E. E., Anger, W. K., Bodner, T., & Zimmerman, K. L. (2011). Clarifying
work–family intervention processes: The roles of work–family conflict and family-supportive
supervisor behaviors. Journal of Applied Psychology, 96, 134–150. doi:10.1037/a0020927
Hammer, L. B., Kossek, E. E., Yragui, N. L., Bodner, T. E., & Hanson, G. C. (2009). Development
and validation of a multidimensional measure of family supportive supervisor behaviors (FSSB).
Journal of Management, 35, 837–856. doi:10.1177/0149206308328510
Hammer, L. B., Kossek, E. E., Zimmerman, K., & Daniels, R. (2007). Clarifying The construct of
family supportive supervisory behaviors (FSSB): A multilevel perspective. In P. L. Perrewe &
D. C. Ganster (Eds.), Research in occupational stress and well-being (Vol. 6, pp. 171–211).
Amsterdam: Elsevier Ltd.
Hammer, L. B., Truxillo, D. M., Bodner, T., Rineer, J., Pytlovany, A. C., & Richman, A. (2015).
Effects of a workplace intervention targeting psychosocial risk factors on safety and health out-
comes [Special issue]. Biomed Research International. doi:10.1155/2015/836967
Hammer, L. B., & Sauter, S. (2013). Total worker health and work–life stress. Journal of
Occupational and Environmental Medicine, 55, S25–S29.
18 L. B. HAMMER ET AL.
Hickman, J. S., & Geller, E. S. (2005). Self-management to increase safe driving among short-haul
truck drivers. Journal of Organizational Behavior Management, 23, 1–20. doi:10.1300/
J075v23n04_01
Hox, J. (2010). Multilevel analysis: Techniques and applications (2nd ed.). New York: Routledge.
Kelloway, E. K., & Barling, J. (2010). Leadership development as an intervention in occupational
health psychology. Work & Stress, 24, 260–279.
Kelloway, E. K., Mullen, J., & Francis, L. (2006). Divergent effects of transformational and passive
leadership on employee safety. Journal of Occupational Health Psychology, 11, 76–86.
Kelloway, E. K., Turner, N., Barling, J., & Loughlin, C. (2012). Transformational leadership and
employee psychological well-being: The mediating role of employee trust in leadership. Work
& Stress, 26, 39–55.
Kelly, E. L., Moen, P., Oakes, J. M., Fan, W., Okechukwu, C., Davis, K. D., … Mierzwa, F. (2014).
Changing work and work-family conflict evidence from the work, family, and health network.
American Sociological Review, 1–32. doi:0003122414531435
Kossek, E. E., Ollier-Malaterre, A., Lee, M. D., Pichler, S., & Hall, D. T. (2016). Line managers’ ratio-
nales for professionals’ reduced-load work in embracing and ambivalent Organizations. Human
Resource Management, 55, 143–171. doi:10.1002/hrm.21722
Kraiger, K. (2003). Perspectives on training and development. In W. C. Borman, D. R. Ilgen, &
R. J. Klimoski (Eds.), The handbook of psychology (pp. 171–192). Hoboken, NJ: Wiley.
Lacerenza, C. N., Reyes, D. L., Marlow, S. L., Joseph, D. L., & Salas, E. (2017). Leadership training
design, delivery, and implementation: A meta-analysis. Journal of Applied Psychology, 102(12),
1686–1718.
LaMontagne, A. D., Keegel, T., Louie, A. M., Ostry, A., & Landsbergis, P. A. (2007). A systematic
review of the job-stress intervention evaluation literature, 1990–2005. International Journal of
Occupational and Environmental Health, 13, 268–280. doi:10.1179/oeh.2007.13.3.268
LePine, J. A., Piccolo, R. F., Jackson, C. L., Mathieu, J. E., & Saul, J. R. (2008). A meta-analysis of
teamwork processes: Tests of a multidimensional model and relationships with team effective-
ness criteria. Personnel Psychology, 61, 273–307. doi:10.1111/j.1744-6570.2008.00114.x
Michel, J. S., Kotrba, L. M., Mitchelson, J. K., Clark, M. A., & Baltes, B. B. (2011). Antecedents of
work–family conflict: A meta-analytic review. Journal of Organizational Behavior, 32, 689–725.
doi:10.1002/job.695
Moen, P., Kelly, E. L., Fan, W., Lee, S., Almeida, D., Kossek, E. E., & Buxton, O. (2016). Does a flexi-
bility/support organizational initiative improve high tech employee’s well-being? Evidence from
the work, family and health network. American Sociological Review, 81(1), 134–164.
Muthén, L., & Muthén, B. (2006). MPlus user’s guide (version 4.2). Los Angeles, CA: Muthén &
Muthén.
Nielsen, K., & Randall, R. (2012). The importance of employee participation and perceptions of
changes in procedures in a teamworking intervention. Work & Stress, 26, 91–111.
Nielsen, K., Randall, R., & Christensen, K. B. (2010). Developing new ways of evaluating organiz-
ational-level interventions. In Contemporary occupational health psychology: Global perspectives
on research and practice (Vol. 1, pp. 21–45).
Nielsen, K., Randall, R., Yarker, J., & Brenner, S. O. (2008). The effects of transformational leader-
ship on followers’ perceived work characteristics and psychological well-being: A longitudinal
study. Work & Stress, 22, 16–32.
Odle-Dusseau, H. N., Hammer, L. B., Crain, T. L., & Bodner, T. (2016). The influence of family-
supportive supervisors on job performance: An organizational work-family initiative. Journal
of Occupational Health Psychology, 21, 296–308. doi:10.1037/a0039961
Olson, R., & Austin, J. (2001). Behavior-based safety and working alone: The effects of a self-moni-
toring package on the safe performance of bus operators. Journal of Organizational Behavior
Management, 21, 5–43. doi:10.1300/J075v21n03_02
Olson, R., Crain, T. L., Bodner, T. E., King, R., Hammer, L. B., Klein, L. C., … Buxton, O. M. (2015).
A workplace intervention improves sleep: Results from the randomized controlled work, family,
and health study. Sleep Health, 1, 55–65. doi:10.1016/j.sleh.2014.11.003
WORK & STRESS 19
Olson, R., & Winchester, J. (2008). Behavioral self-monitoring of safety and productivity in the
workplace: A methodological primer and quantitative literature review. Journal of
Organizational Behavior Management, 28, 9–75. doi:10.1080/01608060802006823
Raudenbush, S., & Bryk, A. (2002). Hierarchical linear models: Applications and data analysis
methods (2nd ed.). Thousand Oaks, CA: Sage.
Salas, E., Tannenbaum, S. I., Kraiger, K., & Smith-Jentsch, K. A. (2012). The science of training and
development in organizations: What matters in practice. Psychological Science in the Public
Interest, 13, 74–101.
Scandura, T. A., & Graen, G. B. (1984). Moderating effects of initial leader-member exchange status
on the effects of a leadership intervention. Journal of Applied Psychology, 69, 428–436. doi:10.
1037/0021-9010.69.3.428
Semmer, N. K. (2006). Job stress interventions and the organization of work. Scandinavian Journal
of Work, Environment & Health, 515–527.
Shortell, S. M., Marsteller, J. A., Lin, M., Pearson, M. L., Wu, S. Y., Mendel, P., … Rosen, M. (2004).
The role of perceived team effectiveness in improving chronic illness care. Medical Care, 42,
1040–1048.
Skakon, J., Nielsen, K., Borg, V., & Guzman, J. (2010). Are leaders’ well-being, behaviours and style
associated with the affective well-being of their employees? A systematic review of three decades
of research. Work & Stress, 24, 107–139.
Tetrick, L. E., & Winslow, C. J. (2015). Workplace stress management interventions and health pro-
motion. Annual Review of Organizational Psychology and Organizational Behavior, 2, 583–603.
doi:10.1146/annurev-orgpsych-032414-111341
Thomas, C. H., & Lankau, M. J. (2009). Preventing burnout: The effects of LMX and mentoring on
socialization, role stress, and burnout. Human Resource Management, 48, 417–432. doi:10.1002/
hrm.20288
Walton, G. M. (2014). The new science of wise psychological interventions. Current Directions in
Psychological Science, 23, 73–82.
Wang, H., Law, K. S., Hackett, R. D., Wang, D., & Chen, Z. X. (2005). Leader-member exchange as a
mediator of the relationship between transformational leadership and followers’ performance
and organizational citizenship behavior. Academy of Management Journal, 48, 420–432.
Zajonc, R. B., & Markus, H. (1984). Affect and cognition: The hard interface. In C. E. Izard,
J. Kagan, & R. B. Zajonc (Eds.), Emotions, cognition, and behavior (pp. 73–102). Cambridge
University Press. doi:10.1002/hrm.20288
Zohar, D. (2002). Modifying supervisory practices to improve subunit safety: A leadership-based
intervention model. Journal of Applied Psychology, 87(156). doi:10.1037/0021-9010.87.1.156
Zohar, D., & Luria, G. (2003). The use of supervisory practices as leverage to improve safety behav-
ior: A cross-level intervention model. Journal of Safety Research, 34, 567–577. doi:10.1016/j.jsr.
2003.05.006