The building sector’s energy use is regarded as a significant contributor to greenhouse gas emissions and associated environmental effects. In efforts to significantly reduce energy consumption in this sector, it is crucial to prevent the transfer of burdens from one stage of the building life cycle to another; therefore, a comprehensive understanding of energy consumption throughout the building life cycle is essential for energy efficiency strategies. The body of research on operational energy reduction is substantial and well-documented; however, the influence of embodied energy and its parameters on diminishing the energy demands of buildings during their lifespan is equally significant and merits assessment. The current study tries to evaluate and analyze the impact of parameters like building configuration and material alteration in the envelope on the total embodied energy in mid-rise residential buildings. The process commences with the creation of a detailed inventory of construction materials together with their respective energy intensities (cradle to gate), followed by the calculation of total embodied energy (E.E.T) using the envelope materials for various building configurations (H, O, L, T) with differing wall-to-window ratios (WWR). Analysis indicates that residential buildings with a smaller built-up area or a compact layout demonstrate a reduction in embodied energy of roughly 50% when compared between fireclay bricks and other low-energy materials such as Fly ash, Aerated Autoclaved Concrete (AAC) blocks, and Hollow Cement Concrete (HCC) blocks. The results aid in understanding the embodied energy scenario in the life cycle energy analysis in a building’s service life.