<p>High-dimensional multiplexed imaging can reveal the spatial organization of tumour tissues at the molecular level. However, owing to the scale and information complexity of the imaging data, it is challenging to discover and thoroughly characterize the heterogeneity of tumour microenvironments. Here we show that self-supervised representation learning on data from imaging mass cytometry can be leveraged to distinguish morphological differences in tumour microenvironments and to precisely characterize distinct microenvironment signatures. We used self-supervised masked image modelling to train a vision transformer that directly takes high-dimensional multiplexed mass-cytometry images. In contrast with traditional spatial analyses relying on cellular segmentation, the vision transformer is segmentation-free, uses pixel-level information, and retains information on the local morphology and biomarker distribution. By applying the vision transformer to a lung-tumour dataset, we identified and validated a monocytic signature that is associated with poor prognosis.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Characterization of tumour heterogeneity through segmentation-free representation learning on multiplexed imaging data

  • Jimin Tan,
  • Hortense Le,
  • Jiehui Deng,
  • Yingzhuo Liu,
  • Yuan Hao,
  • Michelle Hollenberg,
  • Wenke Liu,
  • Joshua M. Wang,
  • Bo Xia,
  • Sitharam Ramaswami,
  • Valeria Mezzano,
  • Cynthia Loomis,
  • Nina Murrell,
  • Andre L. Moreira,
  • Kyunghyun Cho,
  • Harvey I. Pass,
  • Kwok-Kin Wong,
  • Yi Ban,
  • Benjamin G. Neel,
  • Aristotelis Tsirigos,
  • David Fenyö

摘要

High-dimensional multiplexed imaging can reveal the spatial organization of tumour tissues at the molecular level. However, owing to the scale and information complexity of the imaging data, it is challenging to discover and thoroughly characterize the heterogeneity of tumour microenvironments. Here we show that self-supervised representation learning on data from imaging mass cytometry can be leveraged to distinguish morphological differences in tumour microenvironments and to precisely characterize distinct microenvironment signatures. We used self-supervised masked image modelling to train a vision transformer that directly takes high-dimensional multiplexed mass-cytometry images. In contrast with traditional spatial analyses relying on cellular segmentation, the vision transformer is segmentation-free, uses pixel-level information, and retains information on the local morphology and biomarker distribution. By applying the vision transformer to a lung-tumour dataset, we identified and validated a monocytic signature that is associated with poor prognosis.