LoRA-enhanced whisper for resource-efficient heliox speech recognition
摘要
In saturation diving, reliable speech communication under helium–oxygen (Heliox) conditions is critical for operational safety and efficiency. Heliox speech exhibits severe acoustic mismatch relative to standard air speech, and recognition performance further degrades in the presence of chamber/environmental noise and domain-specific terminology. To study this problem in a realistic setting, we collected Heliox speech recordings at two saturation conditions (12 m and 25 m equivalent depths) and constructed a corresponding dataset. We then adapt Whisper-large-v3 via Low-Rank Adaptation (LoRA) to enable parameter-efficient domain adaptation, and enhance decoding using practical inference-time components, including hotword biasing, language-model (LM) reranking, test-time augmentation (TTA) with speed perturbation, and rolling context prompts, together with chunked decoding for stable deployment. On our Heliox evaluation sets, the proposed system achieved a character error rate (CER) of 4.725% at a water depth of 12 m and a CER of 7.165% at a water depth of 25 m, under the reported decoding configuration, while maintaining practical inference cost on GPU/CPU server platforms. We note that inference-time strategies provide complementary robustness gains but do not fully eliminate the need for domain adaptation under severe Heliox-induced shifts.