User experience study to evaluate a clinical decision support system prototype supporting continuous kidney replacement therapy in a simulated ICU environment
摘要
The increasing amount of data routinely collected on ICUs poses a challenge for clinicians which is aggravated with data-heavy therapies like Continuous Kidney Replacement Therapy (CKRT). We developed the CKRT Supporting Software Prototype (CKRT-SSP), a clinical decision support system for use before, during and after CKRT. The aim of this user experience (UX) study was to prospectively evaluate CKRT–SSP in terms of usability, user experience, and workload in a simulated ICU setting.
MethodsWe simulated CKRT treatments in a fully equipped single patient room in the ICU and evaluated CKRT-SSP using validated questionnaires: System Usability Scale (SUS) and User Experience Questionnaire (UEQ). Furthermore, a modified NASA-TLX (task load index) compared the workload before and after using CKRT-SSP. Twelve clinicians and nurses participated in this study.
ResultsThe SUS reached a median value of 87.5 for CKRT-SSP, reflecting excellent usability. In the UEQ, CKRT-SSP scored clearly positive in the attractiveness dimension and the three task-related dimensions of clarity, efficiency, and dependability (95% CI fully > 0.8). For the two non-task-related dimensions, stimulation and novelty, there was a positive trend (mean > 0.8, lower limit of 95% CI < 0.8). The modified NASA-TLX suggests a trend to less total workload with CKRT-SSP which mainly is attributable to less physical demand and less effort.
ConclusionCKRT-SSP is a promising tool for improving the workload in ICUs and the specific application of CKRT. We obtained valuable insights for further user-centric development.