Unsupervised machine-learning (UML) techniques play an increasingly crucial role in data analytics: clustering algorithms, in particular, are widely adopted in astronomy. We present our porting of a UML algorithm, Advanced Density Peak (ADP), which couples extreme sensitivity to small signal-to-noise and limited runtime, from the original Python code to an optimized OpenMP–parallelized C code. We discuss the preliminary results obtained by applying ADP to two astrophysical problems: (i) finding substructures in cosmological numerical simulations and (ii) deblending satellite images. Finally, we present the preliminary work in the development of a fully distributed memory parallelization for ADP using MPI+OpenMP, which is of general interest in this field because of the constant increase in the dataset sizes that makes it impossible to fit the data from cutting-edge experiments on a single node.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

High Performance Unsupervised Learning in Numerical Simulations and Satellite Imaging

  • Francesco Tomba,
  • Luca Tornatore,
  • Alejandro Rodriguez Garcia,
  • Marius Lepinzan

摘要

Unsupervised machine-learning (UML) techniques play an increasingly crucial role in data analytics: clustering algorithms, in particular, are widely adopted in astronomy. We present our porting of a UML algorithm, Advanced Density Peak (ADP), which couples extreme sensitivity to small signal-to-noise and limited runtime, from the original Python code to an optimized OpenMP–parallelized C code. We discuss the preliminary results obtained by applying ADP to two astrophysical problems: (i) finding substructures in cosmological numerical simulations and (ii) deblending satellite images. Finally, we present the preliminary work in the development of a fully distributed memory parallelization for ADP using MPI+OpenMP, which is of general interest in this field because of the constant increase in the dataset sizes that makes it impossible to fit the data from cutting-edge experiments on a single node.