Scholarlink

Background <p>The Less Invasive Surfactant Administration Assessment Tool (LISA-AT) was developed to support operator training and competence assessment. This study aimed to gather validity evidence in the simulated setting to support using the LISA-AT scores.</p> Methods <p>Validity evidence was gathered using the Messick framework. The lowest quartile (Q1) for the median of the experts’ LISA-AT scores defined the minimum passing score.</p> Results <p>Ten experts and 23 novices were enrolled in this study. Eight of the original 15 LISA-AT metrics effectively discriminated between novices and experts and demonstrated high test-retest reliability (Spearman’s rho = 0.87), high internal consistency, and good inter-rater reliability (Cronbach’s alpha = 0.88 and 0.82, respectively). The LISA-AT discriminated between novices’ and experts’ first two attempts with median [IQR] scores of 29 [26–32] vs 39 [39–40]). The minimum passing score was defined as 39/40 points, and the novices used a median [IQR] of 6 [5–7] attempts, ranging from 4 to 9 attempts, to reach this score. Compared with the expert group, the novices’ laryngoscopy skills and time remained significantly different even after attaining the minimum passing score.</p> Conclusion <p>We found strong validity evidence to support using the LISA-AT scores to train new LISA operators to the minimum passing score to ensure competence in the simulated setting.</p> Impact <p><UnorderedList Mark="Bullet"> <ItemContent> <p>This study showed robust validity evidence for using the Less Invasive Surfactant Administration Assessment Tool (LISA-AT) to train LISA novices with a high test-retest reliability, high internal consistency, and good inter-rater reliability.</p> </ItemContent> <ItemContent> <p>Eight of the original 15 LISA-AT metrics effectively discriminated between novices and experts, with a minimum passing score of 39/40 points, corresponding to the lowest quartile (Q1) of the experts’ performances. Novices typically needed six attempts in the simulated setting, ranging from four to nine. However, their laryngoscopy skills and duration remained significantly different from experts.</p> </ItemContent> <ItemContent> <p>Using the LISA-AT score can ensure competence in the simulated setting before advancing to supervised clinical procedures.</p> </ItemContent> </UnorderedList></p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Assessing competency in less invasive surfactant administration: simulation-based validity evidence for the LISA-AT scores

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2025年1月18日

查看全文
  • Niklas Breindahl,
  • Emma Therese Bay,
  • Christian Heiring,
  • Ingrid Rose MacLean-Nyegaard,
  • Amalie Gudiksen,
  • Andreas Frithioff,
  • Tine Brink Henriksen,
  • Martin Grønnebæk Tolsgaard,
  • Lise Aunsholt

摘要

Background

The Less Invasive Surfactant Administration Assessment Tool (LISA-AT) was developed to support operator training and competence assessment. This study aimed to gather validity evidence in the simulated setting to support using the LISA-AT scores.

Methods

Validity evidence was gathered using the Messick framework. The lowest quartile (Q1) for the median of the experts’ LISA-AT scores defined the minimum passing score.

Results

Ten experts and 23 novices were enrolled in this study. Eight of the original 15 LISA-AT metrics effectively discriminated between novices and experts and demonstrated high test-retest reliability (Spearman’s rho = 0.87), high internal consistency, and good inter-rater reliability (Cronbach’s alpha = 0.88 and 0.82, respectively). The LISA-AT discriminated between novices’ and experts’ first two attempts with median [IQR] scores of 29 [26–32] vs 39 [39–40]). The minimum passing score was defined as 39/40 points, and the novices used a median [IQR] of 6 [5–7] attempts, ranging from 4 to 9 attempts, to reach this score. Compared with the expert group, the novices’ laryngoscopy skills and time remained significantly different even after attaining the minimum passing score.

Conclusion

We found strong validity evidence to support using the LISA-AT scores to train new LISA operators to the minimum passing score to ensure competence in the simulated setting.

Impact

This study showed robust validity evidence for using the Less Invasive Surfactant Administration Assessment Tool (LISA-AT) to train LISA novices with a high test-retest reliability, high internal consistency, and good inter-rater reliability.

Eight of the original 15 LISA-AT metrics effectively discriminated between novices and experts, with a minimum passing score of 39/40 points, corresponding to the lowest quartile (Q1) of the experts’ performances. Novices typically needed six attempts in the simulated setting, ranging from four to nine. However, their laryngoscopy skills and duration remained significantly different from experts.

Using the LISA-AT score can ensure competence in the simulated setting before advancing to supervised clinical procedures.