Graph Convolutional Networks (GCNs) have become a cornerstone of graph-based machine learning, but their performance degrades with increased depth due to the over-smoothing phenomenon—where node representations become indistinguishable. This paper presents a focused comparative study of regularization techniques specifically designed to address over-smoothing. We evaluated four representative methods: DropNode, DropEdge, PairNorm, and Jumping Knowledge Networks. Each is analyzed in terms of its effectiveness in preserving node-level distinctions, scalability across network depths, and overall classification performance. Experiments on standard benchmarks demonstrate the trade-offs and practical implications of each technique. Our findings provide actionable information for selecting appropriate regularization strategies and highlight promising directions to improve GCN robustness at scale.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Addressing Over-Smoothing in Graph Neural Networks: An Empirical Evaluation of Regularization Methods

  • Safae Fouad,
  • El Houssaine Hssayni,
  • Yasser El Madani El Alami

摘要

Graph Convolutional Networks (GCNs) have become a cornerstone of graph-based machine learning, but their performance degrades with increased depth due to the over-smoothing phenomenon—where node representations become indistinguishable. This paper presents a focused comparative study of regularization techniques specifically designed to address over-smoothing. We evaluated four representative methods: DropNode, DropEdge, PairNorm, and Jumping Knowledge Networks. Each is analyzed in terms of its effectiveness in preserving node-level distinctions, scalability across network depths, and overall classification performance. Experiments on standard benchmarks demonstrate the trade-offs and practical implications of each technique. Our findings provide actionable information for selecting appropriate regularization strategies and highlight promising directions to improve GCN robustness at scale.