With advancements in deep learning, there has been a burgeoning interest in the exploration of pre-training techniques and the deployment of large models with billions of learning parameters. Self-supervised pre-training addresses the challenges associated with supervised learning, particularly the need for large amounts of labeled data, making it possible to leverage vast amounts of readily available data without annotations. Besides, it also catalyzes the emergence of large models that benefit from having more parameters to capture the variability and complexity of large-scale data. This chapter aims to provide a concise yet comprehensive overview of these domains, starting with an introduction to the emergences and foundational concepts of pre-training techniques and large models. Subsequently, we delve into the specific realm of point cloud data, demystifying the associated method designs related to pre-trained models and large models, which furnishes readers with a thorough understanding of these cutting-edge technologies.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Point Cloud Pre-trained Models and Large Models

  • Wei Gao,
  • Ge Li

摘要

With advancements in deep learning, there has been a burgeoning interest in the exploration of pre-training techniques and the deployment of large models with billions of learning parameters. Self-supervised pre-training addresses the challenges associated with supervised learning, particularly the need for large amounts of labeled data, making it possible to leverage vast amounts of readily available data without annotations. Besides, it also catalyzes the emergence of large models that benefit from having more parameters to capture the variability and complexity of large-scale data. This chapter aims to provide a concise yet comprehensive overview of these domains, starting with an introduction to the emergences and foundational concepts of pre-training techniques and large models. Subsequently, we delve into the specific realm of point cloud data, demystifying the associated method designs related to pre-trained models and large models, which furnishes readers with a thorough understanding of these cutting-edge technologies.