Concrete is the most utilized material in the construction industry and poses threat to environment through greenhouse effect while converting lush green cities into concrete jungles; degrading air quality and causing related health issues. Owing to this, researchers are now trying hard to partially replace the cement as binding materials with Supplementary Cementitious Materials (SCMs) to form ternary and quaternary concrete. In spite of several advantages of using SCMs, there are associated drawbacks. Hence, there is a shift towards agriculture waste and their utilization in concrete. The present study reviews the work done in the area of “agriculture waste utilization in concrete” with pre- and post-treatment and modifying the properties of binder, mortar, and concrete for its favorable applications. Review works take into account the study of short-term and long-term properties including durability aspects and discuss the potential utilization of these agriculture wastes in making ternary and quaternary concrete.