Latest / Safe As Podcast / E77: Behavior-based safety (BBS) - a balanced review of the science
Transcript
- 0:00What are your thoughts when I say behaviour based safety
- 0:03across the safety literature? Behaviour Based Safety or BBS is
- 0:07often presented as a practical way to improve outcomes.
- 0:10It's fair to say it's a divisive topic between behavioural
- 0:14proponents and those from the so called New View or HOP
- 0:16philosophies and more. Instead of trying to resolve
- 0:18this debate, I can't, but I want to provide a fairly balanced
- 0:22overview of the state of science and some of the key arguments in
- 0:26support of and challenging behavioural logics.
- 0:29To do this, I've cherry picked multiple studies of the hundreds
- 0:33of valuable studies. Anyway, good day everyone,
- 0:36welcome to Safe as I'm Doctor Ben Hutchinson.
- 0:38Several of the studies we'll cover today highlight both the
- 0:41potential benefits and some of the mythological, organisational
- 0:46and ethical constraints that shape where the BBS helps or
- 0:50simply shifts attention to fixing people, rather than the
- 0:53organisational factors that create the risk to begin with.
- 0:56First, what is BBS? At its core, BBS is a structured
- 1:01way of changing the way work is done by focusing on specific
- 1:04behaviours. It involves identifying critical
- 1:07observable behaviours linked to injury risk, establishing A
- 1:11baseline and then having trained observers.
- 1:13Often workers themselves observe work and then give supportive
- 1:17non punitive feedback. Those observations are
- 1:19aggregated and trended. Not to blame individuals, but to
- 1:22learn where conditions, tools or systems are shaping behaviour.
- 1:26And as argued by some, when done well, it's somewhat of an
- 1:30administrative control designed to complement, not replace,
- 1:33engineering and systems level safety controls.
- 1:36So study one from Hopkins. What are we to make of safe
- 1:39behaviour programmes published in National Research Centre for
- 1:43OHS Regulation at the ANU? Hopkins starts with a really
- 1:46apartment reflection. Many safe behaviour programmes
- 1:49rely on frontline workers observing colleagues and feeding
- 1:53back what they see, sometimes one on one and sometimes via
- 1:56accounts and trend reports. His core argument is that these
- 2:00programmes can fall into what he calls the fallacy of mono
- 2:04causality, which is treating unsafe behaviour as the cause
- 2:08worth addressing when unsafe behaviour is often the last link
- 2:13in a longer causal chain. Instead he unpacks the multi
- 2:16causal thinking by walking backwards into the causal chain
- 2:20from an unsafe act to the upstream drivers like design
- 2:24choices, production pressures and management decisions,
- 2:28arguing that once you ask why the unsafe act occurred, causal
- 2:32chains often implicate management system conditions.
- 2:35And my own interjection. James Reason has this rather
- 2:38beautiful reflection on the role of people in large, complex
- 2:42failures. That is, rather than being the
- 2:44main instigators of an accident, operators tend to be the
- 2:48inheritors of system defects created by poor design,
- 2:51incorrect installation and bad management decisions.
- 2:54Hopkins also emphasises the hierarchy of controls.
- 2:57Behavioural programmes often target the lower end, like rules
- 3:01or PPE, which are less reliable than eliminating or engineering
- 3:05out hazards. In barrier, energy and critical
- 3:07control frameworks, there are specific criteria for what
- 3:10constitutes human intervention. I don't have time to unpack
- 3:13these, but check out my site and the podcasts as I've covered
- 3:16these multiple times. Nevertheless, a key insight is
- 3:19that these programmes may systematically miss rare but
- 3:23critical behaviours like particular workarounds during
- 3:26breakdowns or shutdowns, and they might misbehaviors that are
- 3:29not observable to the naked eye, such as like permit to work
- 3:32failures or isolation error. Permit to work problems in the
- 3:35Piper Alpha disaster might be a really good example.
- 3:38An absence of bad news about the process was interpreted as the
- 3:42system is working. Hopkins argues that frontline
- 3:45focused approaches also can't address accidents driven by
- 3:49latent conditions where frontline acts are not the
- 3:52immediate proximal causes. Finally, Hopkins says
- 3:55effectiveness is conditional. These programmes sometimes work
- 3:59and sometimes they don't, and a major differentiator is trust
- 4:02between the workforce and management, where distrust
- 4:05dominates. He argues employers should
- 4:07repair underlying issues before expecting behavioural programmes
- 4:11to succeed. The next study is from Speaker
- 4:13ET al 2022 titled Behaviour based Safety, Today's evidence,
- 4:18Journal of Organisational Behaviour Management.
- 4:20This paper has two goals, evaluate whether BBS reduces
- 4:24injuries and improves safety culture, whatever that is, and
- 4:27identify which design components strengthen BBS effectiveness.
- 4:31Using data from 88 sites and over 1.3 million observations,
- 4:35all implemented via commercial programme IG, the authors report
- 4:39modelled injury reductions avering 25% after year one, 34%
- 4:44by year 2 and 42% after the third year.
- 4:47So, according to their data, BBS programmes are effective for
- 4:51these types of measures. Their core findings challenge
- 4:53some common assumptions. They report that the greatest
- 4:56injury reduction occurred at a moderate observation rate, about
- 4:5916 to 65 observations per 100 employees per month, suggesting
- 5:04that more observations aren't necessarily better in this data
- 5:07set. They report that higher
- 5:09percentages of employers acting as observers were associated
- 5:13with less improvement in their data, well noting constraints
- 5:16about how high participation actually was across their
- 5:20sample. Further report that rotating
- 5:23observers, rather than keeping the same people in the role
- 5:26indefinitely, is more effective, and their guideline table states
- 5:29rotation typically every three to 12 months is probably
- 5:32appropriate. Finally, they find observations
- 5:35were more effective when observers focus on tasks in
- 5:39their own area rather than crossing boundaries for a fresh
- 5:42pair of eyes, and that using a small number of structured
- 5:45comments, sort of flags, like one or two flags, to capture
- 5:49context appears more effective than using none or multiple
- 5:52flags or prompts. Linking these findings back to
- 5:54Hopkins, Hopkins warned that focusing on readily observable
- 5:59behaviours can miss deeper hazards speaking ET L.
- 6:03This study primarily addresses by emphasising quality in
- 6:06context, like task familiarity and contextual flags, rather
- 6:10than just the volume of the inspection.
- 6:12But BBS isn't a single stable, monolithic concept across many
- 6:16decades. To understand why BBS looks
- 6:19different across multiple organisations and authors, the
- 6:22next paper provides A conceptual history.
- 6:24So third is from John Christophe Lacos in 2026 titled The Untold
- 6:30Story of Behaviour Based Safety. This is from the extended
- 6:33version of safety science. The Coast argues that despite
- 6:36BBS's influence and controversy, there hasn't really been any
- 6:40published conceptual and critical history of the
- 6:42tradition. This paper really aimed to
- 6:44remedy that by tracing key texts from the 1970s up until now.
- 6:49Methodologically, the paper reports analysing around 20
- 6:52books and something like 30 articles, spending both academic
- 6:55and consultancy work. And you find but consultancy
- 6:58published articles a lot in BBS. The central conclusion is that
- 7:01BBS is not monolithic. Well, early BBS drew from
- 7:04Skinner influence behaviourism. Skinner been a behaviourist
- 7:07psychologist whose operant conditioning treats behaviour is
- 7:11shaped by its environment, its consequences which like
- 7:14reinforcement, punishment, learning.
- 7:16If you want a dog or a person to shake then you keep fitting
- 7:19biscuits. But importantly, later
- 7:21developments diverged into 3 orientations in the BBS field,
- 7:25one the classical traditional which is associated with Salsa,
- 7:282 the theoretical inspirational which is associated with people
- 7:32like Geller, and three, organisational critical which is
- 7:36associated with Kraus. The Coast also summarises an
- 7:39early rationale and principles set from BBS, including a 10
- 7:43step style programme model, but emphasises that later authors
- 7:47reinterpreted the role of management, organisational
- 7:50conditions and the behaviour accent relationship in different
- 7:54ways. As highlighted by the likes of
- 7:56Scott Galla and Tom Krauss who are non BBS traditionalists,
- 8:01behaviour is a result of leadership, culture, system and
- 8:05facility design not being the central driver itself.
- 8:07That is, behaviour isn't the end into itself.
- 8:10So, as mentioned in the crazy article, the starting point for
- 8:13improving safety lies not in behaviours but the organisation.
- 8:18And importantly, despite critics pointing out some questionable
- 8:22and maybe myopic applications of behavioural safety, it's argued
- 8:26that the most visible authors producing the main practical and
- 8:29academic BBS texts and analysing this study never fully advocate
- 8:34such myopic mechanistic applications of behaviour.
- 8:37Actually all of them promote systems views in some sense,
- 8:40leadership, management, context, the environment.
- 8:44So most of these BBS authors support a proactive, positive
- 8:48and non punitive view of safe performance.
- 8:50And I urge people check out some of Scott Geller work.
- 8:53You might forget you're not reading a hop inspired text and
- 8:56indeed it's hollowed by Kraus. The popularity of BBS led to
- 9:00inconsistent practises on the safety market by a variety of
- 9:04poor consulting or half digested rationale and principled by
- 9:08different companies, which could happen with any concept really,
- 9:11but this led to a lot of cynicism and caution towards
- 9:13BBS. 4th is from Cara ET al 2024 titled Implementation of
- 9:19Behaviour Based Safety in the Workplace, a review of
- 9:22conceptual and empirical literature published in
- 9:24Sustainability. Cara and colleagues in their
- 9:26literature review present BBS is increasingly implemented and
- 9:31argue that the boundaries between standard BBS and related
- 9:35interventions can be quite blurry.
- 9:37They reviewed 230 articles from the 70s up to about 2023.
- 9:41They describe typical BBS implementation steps as a
- 9:44baseline analysis intervention, which is like feedback supported
- 9:48by observation, post intervention analysis using
- 9:51KPIs, and sometimes a withdrawal or reversal phase where you take
- 9:56the intervention away and see if behaviour goes back or regresses
- 9:59and a few other steps. They also outline foundations in
- 10:02behavioural psychology and the ABC model and describe
- 10:05historical evolution from supervisory observation
- 10:08approaches to more employee LED approaches and later cultural
- 10:12partnership approaches. In their synthesis of
- 10:15SuccessFactors, they repeatedly highlight the importance of
- 10:18trust and communication, worker involvement, active manager or
- 10:23supervisor support, and the role of safety.
- 10:25Cultural climate, not surprisingly stable findings
- 10:28across most domains of safety research, including hot
- 10:31philosophies and many others, also find the same things.
- 10:35They also describe recurring criticisms in the
- 10:38implementation, including privacy concerns, the risk of
- 10:41blaming workers or overburdening them, as well as under reporting
- 10:45in the challenge of rare high consequence risks.
- 10:47So these issues are well known to BBS proponents.
- 10:50My interjection, This is a common counter argument from
- 10:53behavioural proponents that the core issues of BBS aren't
- 10:57structural to behavioural safety, they're more related to
- 11:00the design, the implementation and the resourcing of BBS
- 11:04approaches or more specifically their misuse.
- 11:07Finally, the stated outlook is that future BBS variants will
- 11:10integrate traditional observation, positive feedback
- 11:13with technology and broader organisational, involved and
- 11:16attention to worker and workplace differences.
- 11:19So more of that contemporary systems view if this study is
- 11:21from Tonsils ET al 2006 titled Effectiveness of Behaviour based
- 11:26Safety Interventions to Reduce Accidents and injuries in
- 11:29Workplaces published in Theoretical Issues in Economic
- 11:33Science and this was a meta analysis.
- 11:34Hansel and colleagues said to do 2 things.
- 11:37They undertook a meta analysis of the BBS studies as of 2006
- 11:41and look at the effects on accident and injury outcomes.
- 11:45So since it's an older study, obviously it's missed a lot of
- 11:47research until now. For their results, they state 8
- 11:50studies achieved statistically significant accident or injury
- 11:53reductions, and they report an overall effect size estimate
- 11:57indicating statistical significance, while also noting
- 12:00there's a lot of differences in the studies and how they
- 12:03measured these sorts of improvements and their PBS
- 12:05interventions. So they're quite different, and
- 12:07these differences make direct comparison a bit more
- 12:10challenging. Crucially, they warn that
- 12:12statistical significance should be interpreted cautiously
- 12:16because most of the studies lacked comparison groups,
- 12:18raising the possibility that the observed reductions could be due
- 12:22to other factors. Things like regression to the
- 12:23main Hawthorne effect, random chance, and more could be one of
- 12:27the critical determinants of the findings.
- 12:30They also note that there are known reporting distortions, so
- 12:33minor injuries may go unreported when monetary rewards depend on
- 12:37months without accident. My interjection studies from
- 12:40probes suggest that up to 80% of incidents are unreported, so we
- 12:45have very little reason to trust reported incident injury data,
- 12:49at least for the most minor potential events.
- 12:52Nevertheless, their future directions section calls for
- 12:54stronger designs. Workplace need better
- 12:57assessments, comparable control groups, better reporting of
- 13:00sample size and participation rates, accounting for
- 13:03confounders, and investigating validity and reliability of
- 13:07measurement. So while this paper did find
- 13:09overall benefits to BBS, they do caution that because of the weak
- 13:13study designs. This really complements Hopkins
- 13:15critique that focusing on behaviour can maybe obscure some
- 13:19upstream causes because weak designs can't rule out those
- 13:22upstream drivers is alternate explanations.
- 13:24It also complements Cara's observation that long term
- 13:27effectiveness and measurement quality remain recurring issues.
- 13:31But I'll come back to this discussion around the state of
- 13:34the evidence now. A 6th bonus article that throws
- 13:37a cat amongst the pigeons. It's an article from Sydney
- 13:40Decker on the safetydifferently.com side
- 13:42called the original Hearts and Minds campaign and the
- 13:45dereliction of Behaviour based safety.
- 13:47It's not peer reviewed of course.
- 13:48Decker argues measurement pressure distorts reality.
- 13:52He uses the original Hearts and Minds campaign to argue that
- 13:55what gets measured can be manipulated, especially when
- 13:58leaders demand simple progress graphs and simple measures.
- 14:01He argues that the Hearts and Minds label is often used to
- 14:04justify behavioural programmes that redirect attention away
- 14:09from leadership and towards workers as the problem.
- 14:13He describes typical BBS as defining correct behaviours,
- 14:17training, measuring compliance and rewarding compliance, which
- 14:20might include elements of surveillance and coaching.
- 14:23He argues that we shouldn't target behaviour per SE, we
- 14:26should wherever possible, target the conditions under which
- 14:29behaviour occurs, aim change at whatever is responsible for
- 14:32creating those conditions. But importantly, if you watch my
- 14:35recent YouTube interview with Decker, you can see broadly
- 14:38supports the view from some prominent BBS authors like
- 14:42Geller and Tom Krauss that behaviour should be understood
- 14:45wherever possible, first from the organisational contextual
- 14:48factors, rather than simply as the end to itself.
- 14:51And the 7th and final bonus article from Williams and
- 14:55Roberts 2018 titled A Holistic approach to improving safety
- 14:59performance Publishing professional safety.
- 15:01The authors argue that BBS and U View sort of HOP are compatible
- 15:06and should be treated as complementary, not competing
- 15:08approaches. Both can support safe work
- 15:11practises and safety system improvements.
- 15:13They emphasise that system factors like faulty equipment
- 15:16production pressure over time drive much of the risky
- 15:19behaviour or human error and resulting injuries.
- 15:23Therefore the first question after an injury should be where
- 15:26did the system fail? They outlined hot tools that
- 15:29operationalized learning and error prevention before or after
- 15:32the work. For instance pre job briefings,
- 15:352 minute analysis, self or peer checking timeouts, post job
- 15:39briefings etc. And this can be used to identify
- 15:42error traps and error likely situations and strengthen the
- 15:45risk control defences. They frame BBS as identifying
- 15:48critical behaviours, analysing why risk behaviour occurs, then
- 15:52using supportive, corrective and barrier removal system
- 15:55modification techniques. They stress limited blame and
- 15:58non punitive measures should be used as part of the observation
- 16:02checklist and then using trend data to drive system fixes.
- 16:06But they also caution that organisations often jump between
- 16:09programmes like the flavour of the month, creating siloed
- 16:11initiatives and fatigue. Instead we should integrate the
- 16:15best elements of all these approaches into one coherent
- 16:18system. Some useful takeaways from this
- 16:20Williams and Roberts article was we should stop treating BBS and
- 16:23HOP as binary choices and mature BBS approaches are broader than
- 16:28just checklist and behaviour. It includes the leadership
- 16:30behaviours, system improvements, person states, communication,
- 16:34not just observing people and I I do wonder, does this involve
- 16:38observing the leaders if they're the ones that create most of
- 16:41these risks to begin with? Do behavioural observations need
- 16:45to check and sit into board meetings?
- 16:47If you read some of Scott Geller's work like I mentioned
- 16:49before, you might be surprised if you're from this hop element
- 16:51just how much alignment there is.
- 16:53They also suggest human error is a signal, not a conclusion.
- 16:56Hop framing described here treats error as the starting
- 16:59point for analysing system weaknesses and strengthen
- 17:01defences. Obviously non punitive and
- 17:03limited blame and respectful communication are presented as
- 17:06essential features for any approach.
- 17:09Again, avoid the flavour of the month.
- 17:11They warn that cycling new initiatives without integration
- 17:14creates scepticism and confusion, which is really hard
- 17:17to the uptake of any safety philosophy.
- 17:19OK, that's a lot of data. And before I move into some
- 17:22takeaways from the articles, I want to reflect on my own
- 17:25thoughts. I think there's actually more in
- 17:27common between BBS and some of these new viewer hot
- 17:30philosophies. And some of us want to admit now
- 17:33we might have different units of analysis like BBS is interested
- 17:37in behaviour, or they might use some very mechanistic terms like
- 17:39unsafe or safe behaviour, which depends on the observer.
- 17:42But fundamentally we're all interested in work.
- 17:45When you look at modern human factors applications of task
- 17:48analysis, critical control verifications under ICMM and the
- 17:52like, or construction hazard and control verification approaches
- 17:55like the TR method, I think you can begin to see the overlaps
- 17:58and complementary natures. We're interested in work, but we
- 18:01have different units of analysis to describe it.
- 18:03My thoughts? While I've never been a strong
- 18:05proponent of BBS itself, I don't see why we'd want to limit our
- 18:08options, our adaptive tool boxes, for an approach that,
- 18:12regardless of your worldview and political orientations, does
- 18:15have a substantial body of evidence behind it, limitations
- 18:19included. This doesn't mean every idea and
- 18:21concept should be given equal weight, because some concepts
- 18:24just have poor evidence behind them.
- 18:25But on the other side, we also can't ignore the large empirical
- 18:29and industrial tests and uses of BBS.
- 18:32Can we trust the injury measures used in these studies and
- 18:35articles? Maybe, maybe not.
- 18:38That depends entirely on the individual studies and the
- 18:40pooled effects, etcetera. And recognising the generally
- 18:42consistent findings that the overall body of BBS research is
- 18:46relatively weak in methodology limits of the studies, I still
- 18:49think it's hard to argue that the burden of evidence hasn't
- 18:51shifted from those that promote BBS shifted to those that reject
- 18:55it. That is, while critical
- 18:57challenges exist and are valid to the validity of BBS research
- 19:02with all research and bodies of evidence, I think the onus has
- 19:05actually shifted to the critics to demonstrate these approaches
- 19:08aren't achieving their core goals or are resulting in
- 19:11significant unintended consequences.
- 19:13As many arguing, are BBS approaches really shifting the
- 19:16focus to minor potential hazards away from process and high
- 19:19energy hazards? Are they driving reporting
- 19:21underground? Are they impacting trust and
- 19:23reporting? I think we're at the point where
- 19:25these challenges are interesting, but we need
- 19:27empirical evidence to back them up.
- 19:29Nevertheless, Roman and authors like Gallow and Krauss have been
- 19:33promoting A proactive system focus for decades.
- 19:36So we can't group all BBS together, nor should we probably
- 19:40group it into the same basket as some of the more mechanistic
- 19:43consulting applications, which, mind you, applies for HOP.
- 19:46Also, there's still mechanistic applications of HOP.
- 19:48So what can we make of the findings?
- 19:50Overall, BBS effectiveness is scientifically plausible, but
- 19:54the impacts are conditional. Of course, large data sets and
- 19:57meta analysis do report injury and incident reductions, but
- 20:01multiple sources stress that the results depend on the context
- 20:04design and the study quality. Overall, the strength of the
- 20:08studies are relatively weak, but.
- 20:10We have enough of them to give us a general direction.
- 20:12Methodological rigour is a recurring gap across the
- 20:14research. So for instance tonsil stress
- 20:17poor to marginal study quality and call for stronger controls
- 20:20and measurement validity. Noting that was from 2006 and as
- 20:23with other research, the long term effects of behavioural
- 20:26interventions are relatively limited.
- 20:27But it does exist. And importantly, Dominic Cooper
- 20:30has cautioned that BBS was never meant as a process safety
- 20:34intervention, it was intentionally personal safety.
- 20:37So some of the criticism around avoiding major hazards may not
- 20:40be fair. The code shows BBS has multiple
- 20:43orientations which help explain why BBS can look different
- 20:46across different organisations decades.
- 20:48We should design BBS so it doesn't substitute for higher
- 20:51order controls. We should run alongside hazard
- 20:54elimination engineering and high energy applications.
- 20:57If you're going to use it, we should critically challenge
- 20:59whether you really have widespread behavioural issues or
- 21:03whether you have an organisational issue manifesting
- 21:05through behaviour. As argued by Decker, human error
- 21:08problems might be more organisational issues, and then
- 21:11the importance of trust and restore of culture conditions
- 21:13matter. Hopkins and Cara and Decker
- 21:15explicitly elevate trust and warn about blame dynamics.
- 21:19We should combine hop tools and BBS observation and feedback.
- 21:23So you capture context, identify error traps, close the loop with
- 21:28learning and feedback. I think the critical control
- 21:30verification artefacts are probably a sound place to do a
- 21:33lot of this. And previously I mentioned the
- 21:35TR method which is really useful too if you use BBS and maybe
- 21:39reflect on the cards or the observations you use, maybe to
- 21:41have more systems and condition factors and prompts about tools,
- 21:45equipment, availability, production pressure, leadership
- 21:49and other conditions. So observations drive system
- 21:52fixes, not just behaviour correction.
- 21:54Beware what's missed. Hopkins highlights blind spots
- 21:58which are rare critical behaviours and latent conditions
- 22:01which may be invisible to behavioural observations.
- 22:04We have to make sure to protect psychological safety and
- 22:06interpersonal risk taking like observation feedback systems,
- 22:09explicitly non punitive and watch for privacy concerns and
- 22:13under reporting incentives. We need to prioritise the
- 22:16quality of observations and task analysis, task emiliarity,
- 22:19meaningful feedback. And this needs to be prioritised
- 22:22over quotas and paperwork. Build mechanisms to surface non
- 22:25obvious and rare high consequence risk, which could be
- 22:29things like permit to work systems, shutdowns and other
- 22:33latent factors in the organisation.
- 22:35And we have to move away just from the visible PPE and
- 22:37housekeeping issues. Thankfully that's it on safe as
- 22:41please like, subscribe, comment and share directly on YouTube.
- 22:45Leave a comment, it really helps and links in the show notes if
- 22:47you'd like to support the channel.