<p>Compositionality has long been regarded as a uniquely human capacity and a cornerstone of general intelligence. It is most clearly exemplified in natural language, where a finite set of words is combined through grammatical rules to generate an unbounded number of sentences. Recent advances across disciplines challenge the view that compositionality is exclusive to human cognition and question whether an explicit symbolic structure is required to implement it. Large language models, for example, achieve impressive compositional abilities through scale alone. Neuroscience has also revealed that animals use compositional neural codes when applying knowledge to novel situations, while theory and modeling are beginning to clarify how neural networks without explicit symbolic structures implement compositional computations. High-density neural recordings from animals performing compositional tasks, combined with reverse engineering of neural network models, now enable us to test fundamental questions, such as how biological brains implement compositional solutions and when compositional behavior can emerge from scale rather than from explicit compositional mechanisms. We propose that compositional mechanisms exist along a continuum defined by the expressivity of computation-specific building blocks and the complexity of systematic recombination rules. Comparing implementations across biological and artificial systems will determine whether general intelligence requires explicit compositionality or can emerge from scaled mechanisms alone.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

The compositionality continuum as a principle for studying the neural basis of intelligence

  • Reidar Riveland,
  • Alexandre Pouget,
  • Laura Driscoll

摘要

Compositionality has long been regarded as a uniquely human capacity and a cornerstone of general intelligence. It is most clearly exemplified in natural language, where a finite set of words is combined through grammatical rules to generate an unbounded number of sentences. Recent advances across disciplines challenge the view that compositionality is exclusive to human cognition and question whether an explicit symbolic structure is required to implement it. Large language models, for example, achieve impressive compositional abilities through scale alone. Neuroscience has also revealed that animals use compositional neural codes when applying knowledge to novel situations, while theory and modeling are beginning to clarify how neural networks without explicit symbolic structures implement compositional computations. High-density neural recordings from animals performing compositional tasks, combined with reverse engineering of neural network models, now enable us to test fundamental questions, such as how biological brains implement compositional solutions and when compositional behavior can emerge from scale rather than from explicit compositional mechanisms. We propose that compositional mechanisms exist along a continuum defined by the expressivity of computation-specific building blocks and the complexity of systematic recombination rules. Comparing implementations across biological and artificial systems will determine whether general intelligence requires explicit compositionality or can emerge from scaled mechanisms alone.