Learning to solve auxiliary tasks concurrently with a principal task of interest can improve performance when data is scarce or the principal task is complex. This idea is inspired by the improved generalization capability induced by solving multiple tasks simultaneously, leading to a robust shared representation. However, selecting optimal auxiliary tasks typically requires manual design or costly meta-learning approaches. We propose Detaux, a framework that discovers an unrelated auxiliary classification task via weakly supervised disentanglement at the representation level. Isolating variations relevant to the principal task in one subspace while generating orthogonal subspaces with high separability allows us to discover auxiliary labels by clustering in these subspaces, allowing a transition from Single-Task Learning (STL) to Multi-Task Learning (MTL). In particular, the original labels associated with the principal task and the newly discovered ones can be fed into any MTL framework. Experiments and ablation studies highlight the effectiveness of Detaux and reveal an unexplored link between disentangled representations and MTL. The source code is available at https://github.com/intelligolabs/Detaux .

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Disentangled Latent Spaces Facilitate Data-Driven Auxiliary Learning

  • Geri Skenderi,
  • Luigi Capogrosso,
  • Andrea Toaiari,
  • Matteo Denitto,
  • Franco Fummi,
  • Simone Melzi

摘要

Learning to solve auxiliary tasks concurrently with a principal task of interest can improve performance when data is scarce or the principal task is complex. This idea is inspired by the improved generalization capability induced by solving multiple tasks simultaneously, leading to a robust shared representation. However, selecting optimal auxiliary tasks typically requires manual design or costly meta-learning approaches. We propose Detaux, a framework that discovers an unrelated auxiliary classification task via weakly supervised disentanglement at the representation level. Isolating variations relevant to the principal task in one subspace while generating orthogonal subspaces with high separability allows us to discover auxiliary labels by clustering in these subspaces, allowing a transition from Single-Task Learning (STL) to Multi-Task Learning (MTL). In particular, the original labels associated with the principal task and the newly discovered ones can be fed into any MTL framework. Experiments and ablation studies highlight the effectiveness of Detaux and reveal an unexplored link between disentangled representations and MTL. The source code is available at https://github.com/intelligolabs/Detaux .