Customisable digital cognitive aids cut total error by 75% defining a threshold for irreducible human error in clinical care: a pooled analysis of five randomised trials

Abstract

Abstract Background Human error is a leading cause of preventable harm in clinical care, driven by factors such as cognitive overload and staff turnover. While customisable digital cognitive aids (cDCAs) have emerged as real-time protocol-tailored support, a framework to quantify their total impact on human error and its fundamental limits has been lacking. Methods We conducted a pooled analysis of five randomised high-fidelity simulation trials with consistent methodologies, including 370 healthcare professionals across diverse clinical settings and levels of experience. Using bootstrap resampling, we modelled the distributions of technical and non-technical skills (TS and NTS) to quantify the impact of cDCAs on clinical competence and on Total Human Error (THE)—defined as the sum of systematic deviation from standards (bias 2 ) and inter-individual variability (variance). Findings The use of cDCAs reduced THE by 75% in a novice user context. This effect was driven by concurrent, drastic reductions in systematic deviation from standards ( bias 2 : 328.1 vs 1377.1) and inter-individual variability ( variance : 124.3 vs 210.0). This was reflected in significant improvements in both technical (81.9±0.8 vs 62.9±1.0, p<0.001) and non-technical skills (84.9±0.8 vs 75.2±1.2, p<0.001), demonstrating enhanced clinical competence and robustness. Crucially, this substantial error mitigation revealed a consistent residual error threshold , quantifying an empirical upper bound of ∼25% for what we define as Irreducible Human Error (IHE). Interpretation By reducing both systematic bias and performance variability, cDCAs demonstrably harmonise clinical practices and enhance competence robustness. Our analysis provides the first empirical framework to quantify this beneficial effect, revealing in turn a ∼25% residual error that delineates the fundamental limits of performance enhancement achievable via procedural workflow support. We posit this threshold serves as an empirical upper bound for Irreducible Human Error (IHE)—errors arising not from procedural flaws but from higher-order cognitive or interpersonal factors. Establishing IHE as a new benchmark for patient safety thus provides foundational evidence for a model of augmented practice, where complementary innovations such as AI may be required to move beyond procedural support, augment clinical judgement, and uphold human-centred care. Research in Context Evidence before this study Cognitive support has long been used to mitigate human error in high-stakes environments. ‘Traditional’ cognitive support tools (e.g., paper checklists) improve adherence to technical protocols during medical crises, but their impact on non-technical skills—such as communication and decision-making—is limited and their clinical adoption remains low. Early digital aids largely replicated these static tools, often lacking the ergonomic integration needed for real-time clinical use and failing to leverage the full potential of digital platforms. Consequently, no prior study had systematically assessed the impact of customisable digital cognitive aids (cDCAs) on both technical and non-technical skills across diverse clinical domains to establish their overall efficiency and robustness . Furthermore, no prior study has established a comprehensive framework for evaluating their effects on ‘Total Human Error’ (THE)—encompassing both bias and variability in practice—or introduced a measurable threshold for an ‘Irreducible Human Error’ (IHE) in clinical care. What this study adds This study is the first to quantify competence—defined as the integration of procedural proficiency (TS) and cognitive-behavioural dimensions (NTS)—and measured the impact of cDCAs on TS and NTS performance and variability, across multiple clinical settings and experience levels. We pooled five randomised controlled trials with consistent methodologies and used a resampling technique (bootstrap analysis), which allowed us to model distributions of performance and assess robustness across diverse professional backgrounds. Unlike traditional digital checklists, which often impose cognitive effort or disrupt team workflows, cDCAs are adaptive interfaces, integrating seamlessly into decision-making with minimal cognitive load. Our work systematically quantifies clinical competence and THE across both TS and NTS. We demonstrated that cDCAs significantly reduced systematic bias—defined as deviation from expected standards—along with inter-individual and inter-situation variability, thereby harmonising clinical practices and improving reliability—even in high-stakes scenarios. The reduction in inter-situation variability is particularly relevant, as it strengthens the robustness of clinical care delivery, ensuring consistent performance across diverse settings. By defining and quantifying IHE, we establish a benchmark for understanding the limits of human performance—beyond which cognitive aids alone may be insufficient. Implications of all the available evidence Integrating customisable, ergonomically optimised cDCAs into routine clinical workflows provides a scalable solution to reduce THE by harmonising practices and improving adherence to care standards. This is particularly valuable in resource-limited settings, where cDCAs could help exchange expertise. By establishing IHE as a measurable threshold, this study provides a foundation for further innovations in cognitive support. While current cDCAs provide substantial reductions in THE, these findings raise the question of whether AI could further complement cognitive aids while preserving human expertise at the core of decision-making. Future research should explore how AI-enhanced cognitive aids might ethically and transparently address residual human error, ensuring these technologies reinforce—rather than undermine—the foundational principles of trust, accountability, and patient-centred care. Finally, beyond individual performance, cDCAs may contribute to global equity by promoting robust, harmonised care and enhancing knowledge retention and application across healthcare systems. In an interconnected world, where no system operates in isolation, ensuring safe, high-quality care on a global

Ähnliche Arbeiten