Accurate solutions are needed for a variety of computer vision applications, including medical imaging, object detection, and recognition. Such complicated challenges are beyond the capabilities of artificial intelligence and machine learning, which mainly rely on data and algorithms to learn. The path to Deep Learning (DL) is thus paved. Even though deep learning is incredibly effective at solving complex problems, it is invariant, meaning that it ignores the spatial relationship between the features and instead searches for features only. This can cause the model’s performance to suffer. Additionally, because the model is invariant, gathering a large volume of training data is a difficult undertaking. To address this, the Capsule Network (CapsNet), whose performance outperforms Deep Learning techniques, was introduced. Despite its success, applications of CapsNet and working remain a mystery. Thus, the performance of CapsNet across many applications and obstacles is examined in this study together with the predecessors of CapsNet. Additionally, this paper explores the use of Capsule Networks with an attention mechanism (CapsNet-ATM) for predicting potato leaf diseases. The performance of CapsNet-ATM in this crucial agricultural application is thoroughly assessed and contrasted with the well-known models VGG-16 and VGG-19, providing insight into the system’s efficacy and promise as a reliable tool for the detection and prediction of potato leaf disease.