Chili plant, as per scientific terms, it is also called as “Capsicum annuum.” It is associated with the family known as Solanaceae. Worldwide it’s widely used in many foods to increase the taste and give hotness to the food. Red chili is also known as “Birds Eye Chili.” Moreover, this Birds Eye Chili exhibits medicinal characteristics such as pain relief, cardiac health benefits, anti-swelling effects, metabolism boost, and antioxidant properties. Determining particular disorders, illnesses, infections, etc., affecting different instances of chili plants is the primary objective of this research paper. This work is done by implementing various deep learning techniques to the collected dataset. Which soil is best for the cultivation of chili plants is analyzed by us through the IoT sensors. For this, we have collected pictures of various diseases in chili plants from chili gardens at GIET UNIVERSITY, Gunupur, Odisha, to generate our dataset. The dataset consists of five important features: Anthracnose, Phytophthora Root Rot, Bacterial Spot, Fusarium Wilt, and Powdery Mildew. In this research, to detect chili plant diseases deep learning classifier was used. Moreover, we found varieties of diseases in chili plants and by that, we have evaluated the chili plant’s overall health. It has been observed that convolutional neural network (CNN) outperformed in contrast to other deep learning classifiers. The accuracy for the training of CNN was 98.2%, and the accuracy for the testing was 96.7%. The reduced errors for training and testing represent that the model is efficient for new or novel data.