Background <p>In 2024, Gold Coast Hospital and Health Service outpatient division initiated a 16-week trial of artificial intelligence (AI)-enabled ambient listening scribe technology. The objective of this pilot study was to evaluate scribe technology performance (according to dimensions of quality, utility and reliability) and its impact on the experience of outpatient clinicians and patients receiving care.</p> Methods <p>A mixed method research design combined analysis of data from patient and staff surveys, staff interviews, scribe outputs and electronic medical records across a breadth of outpatient specialties.</p> Results <p>By and large, ambient listening technology was associated with positive patient and staff experience. On average, 58% of scribe outputs were accepted without modification into the electronic outpatient note. There was limited evidence of bias in outputs, however there was some evidence of hallucination or incorrect outputs.</p> Conclusions <p>Qualitative and quantitative data were internally consistent and demonstrated that ambient listening technology can (1) produce an accurate summary of outpatient appointments, (2) enhance clinical note quality and (3) improve both clinician and patient experience.</p> Clinical trial number <p>Not applicable.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Performance, acceptability, and impact of ambient listening scribe technology in an outpatient context: a mixed methods trial evaluation

  • Salim Memon,
  • Adam Brand,
  • Bianca Taylor,
  • Adelaide Michael,
  • Rachael Smithson

摘要

Background

In 2024, Gold Coast Hospital and Health Service outpatient division initiated a 16-week trial of artificial intelligence (AI)-enabled ambient listening scribe technology. The objective of this pilot study was to evaluate scribe technology performance (according to dimensions of quality, utility and reliability) and its impact on the experience of outpatient clinicians and patients receiving care.

Methods

A mixed method research design combined analysis of data from patient and staff surveys, staff interviews, scribe outputs and electronic medical records across a breadth of outpatient specialties.

Results

By and large, ambient listening technology was associated with positive patient and staff experience. On average, 58% of scribe outputs were accepted without modification into the electronic outpatient note. There was limited evidence of bias in outputs, however there was some evidence of hallucination or incorrect outputs.

Conclusions

Qualitative and quantitative data were internally consistent and demonstrated that ambient listening technology can (1) produce an accurate summary of outpatient appointments, (2) enhance clinical note quality and (3) improve both clinician and patient experience.

Clinical trial number

Not applicable.