Scholarlink

<p>Quantitative ethology necessitates accurate tracking of animal locomotion, especially for population-level analyses involving multiple individuals. However, current methods mostly rely on laborious annotations for supervised training and have restricted performance under challenging conditions. Here we present an unsupervised deep transfer learning method for multi-animal tracking (UDMT) that achieves state-of-the-art performance without requiring training annotations. By synergizing a bidirectional closed-loop tracking strategy, a spatiotemporal transformer network and three dedicated modules for localization refining, bidirectional identity correction and automatic parameter tuning, UDMT can track multiple animals accurately under various challenging conditions, such as crowding, occlusion, rapid motion, low image contrast and cross-species experiments. We demonstrate the versatility of UDMT on five different kinds of model animals, including mice, rats, <i>Drosophila</i>, <i>Caenorhabditis elegans</i> and <i>Betta splendens</i>. Combined with a head-mounted miniaturized microscope, we illustrate the power of UDMT for neuroethological interrogations to decipher the correlations between animal locomotion and neural activity.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Unsupervised transfer learning enables multi-animal tracking without training annotation

  • 期刊论文

  • 发表日期：

    2026年5月4日

查看全文
  • Yixin Li,
  • Qi Zhang,
  • Yuanlong Zhang,
  • Jiaqi Fan,
  • Zhi Lu,
  • Xinhong Xu,
  • Xinyang Li,
  • Ziwei Li,
  • Jiamin Wu,
  • Qionghai Dai

摘要

Quantitative ethology necessitates accurate tracking of animal locomotion, especially for population-level analyses involving multiple individuals. However, current methods mostly rely on laborious annotations for supervised training and have restricted performance under challenging conditions. Here we present an unsupervised deep transfer learning method for multi-animal tracking (UDMT) that achieves state-of-the-art performance without requiring training annotations. By synergizing a bidirectional closed-loop tracking strategy, a spatiotemporal transformer network and three dedicated modules for localization refining, bidirectional identity correction and automatic parameter tuning, UDMT can track multiple animals accurately under various challenging conditions, such as crowding, occlusion, rapid motion, low image contrast and cross-species experiments. We demonstrate the versatility of UDMT on five different kinds of model animals, including mice, rats, Drosophila, Caenorhabditis elegans and Betta splendens. Combined with a head-mounted miniaturized microscope, we illustrate the power of UDMT for neuroethological interrogations to decipher the correlations between animal locomotion and neural activity.