<p>This review evaluates the integration of various waste products among the supplementary cementitious materials, including GGBFS, RHA and POFA, and aggregate substitutes, including steel slag and ceramic fines, and a range of fibrous additives. Earlier studies were limited to individual waste source or short-term performance indicators. The review identifies the following gaps as the most important ones that have not been addressed by the previous literature: (a) the long-term durability of concrete under diverse environmental conditions; (b) standardized waste processing and testing procedures which are necessary to ensure working on larger scale and (c) the absence of hybrid approaches, such as fiber-admixtures, to reduce the workability losses at an optimal replacement of 5–15% of SCM. Some of the waste derived SCM such as ground granulated blast furnace slag, silica fume, rice husk ash, banana leaf ash, and palm oil fuel ash increase the compressive and flexural strengths by optimizing the pore structure and pozzolanic reactions. Waste materials from industrial and ceramic powder, plastic and steel slag are used instead of natural aggregates and yield the same or better properties. Though the recommended replacement range of SCMs is 5–15% (often between 10 and 15%) and aggregate replacement ranges vary, these problems including loss of workability and porosity increase still remain even with the ideal replacement rates. This review targets highlighting critical research gaps such as long-term durability under different environments, difficulties when implementing in huge constructions and the lack of proper testing and implementation methodologies. This review indicates incorporating waste in concrete provides a range of benefits including environmental, economic, and structural benefits.</p>