Antagonistic online communities, such as the misogynist incel subculture, often develop a distinct linguistic style that is sometimes difficult for outsiders to interpret. A central challenge for law enforcement is identifying when common words are repurposed with new meanings. Such polysemous jargon words complicate the detection of threats and radicalization cues, as unfamiliar word senses can be hard to recognize. We propose a prompt-based framework that leverages Large Language Models (LLMs) to generate definitions for polysemous words and classify word usage accordingly. Additionally, we introduce an LLM-as-a-judge scoring method to evaluate the framework and perform evaluation on data from an online incel platform. Our results show that the proposed prompt-based, corpus-level approach outperforms existing fine-tuned, sentence-level generation methods.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Automated Definition Generation for Online Jargon Analysis

  • Helena Björnesjö,
  • Axel Alness Borg,
  • Katie Cohen,
  • Björn Pelzer,
  • Erik Wachtmeister

摘要

Antagonistic online communities, such as the misogynist incel subculture, often develop a distinct linguistic style that is sometimes difficult for outsiders to interpret. A central challenge for law enforcement is identifying when common words are repurposed with new meanings. Such polysemous jargon words complicate the detection of threats and radicalization cues, as unfamiliar word senses can be hard to recognize. We propose a prompt-based framework that leverages Large Language Models (LLMs) to generate definitions for polysemous words and classify word usage accordingly. Additionally, we introduce an LLM-as-a-judge scoring method to evaluate the framework and perform evaluation on data from an online incel platform. Our results show that the proposed prompt-based, corpus-level approach outperforms existing fine-tuned, sentence-level generation methods.