Agricultural residues generated from crop production and agro-processing pose a significant challenge in terms of their disposal or valorization. This study investigates the potential of utilizing these residues in the construction sector, particularly in composite materials such as concrete and mortars. By incorporating agricultural waste as aggregates, insulation additives, fibers, or partial cement replacements, the environmental footprint of traditional cement-based materials could be significantly reduced under certain conditions. This approach promotes circular economy principles by recycling organic waste, decreasing reliance on virgin resources, and mitigating greenhouse gas emissions. This research describes the types and availability of agricultural residues in Europe and America, and assesses the most promising applications in concrete and mortars based on a literature review. The findings highlight the feasibility and benefits of integrating agricultural residues into construction materials, emphasizing the need for consistent supply chains and material performance validation. This work provides a foundation for advancing on construction materials in the western world, fostering a symbiotic relationship between the agricultural and construction sectors.