<p>Over the years, researchers have applied various deep learning techniques to automatically recognise plant diseases from both raster and spectral images. The primary focus of the existing studies is developing individual species-specific or disease-specific models, where the former recognises diseases of single crop type and the latter recognises single diseases of single or multiple crop types. Building one global model to recognise diseases of multiple crops has also been widely explored, where a class is treated as a crop-disease combination. While training individual species-specific or disease-specific deep models is labour-intensive, embracing a vast number of crop species and inherent diseases present on this planet makes the model cumbersome. In order to address this problem, a more intuitive and feasible family-based plant disease characterisation approach with botanical reasoning is proposed in this study. This approach demonstrates the feasibility of six state-of-the-art deep neural networks through a set of extensive experiments incorporating six key strategies. The results on a newly built family-based plant disease dataset confirm that the proposed novel approach is convincing to be applied in a plant family-based disease recognition problem. Further, this study creates future opportunities for more intuitive plant disease data collection and benchmark classification model development.</p>