Bias Detection in Online Higher Education Texts: Comparing Fine-Tuned and Zero-Shot LLM Approaches
摘要
Bias detection in educational materials is crucial for higher education, where academic texts significantly shape students’ understanding of societal narratives. While bias detection has been studied in public discourse, identifying bias in higher educational resources remains underexplored. This study fine-tunes GPT-4o-mini to detect gender and ethnic biases in academic texts and benchmarks its performance against zero-shot large language model (LLM) approaches. The fine-tuned model achieved 81.08% accuracy, representing a significant 13.5% improvement over the zero-shot GPT-4o mini baseline (67.57%). Through structured annotation involving human reviewers, the study highlights the subjectivity inherent in bias classification. These findings contribute to advancing automated bias detection in higher education, promoting more inclusive academic content.