The Asphalt Concrete-Wearing Course (AC-WC) serves as a crucial surface layer for pavements, significantly contributing to the structural and functional durability of roads. This study investigated the incorporation of bagasse waste as a filler in the AC-WC mixture to enhance pavement performance and promote environmental sustainability. The bagasse content modifications employed were 25, 50, and 75%, with compaction temperature variations of 110, 120, 130, 140, and 150 °C. The assessment was conducted on Marshall characteristics, elastic modulus, and stress–strain using the KENPAVE program. The findings unveiled that utilizing bagasse as a filler consistently satisfied the minimum Marshall stability criteria (> 800 kg) at particular compaction temperatures. Nevertheless, the flow value exhibited an inclination to rise with increased bagasse content beyond the ideal specification threshold (< 4 mm). The elastic modulus of the mixture markedly rose at 140 °C, demonstrating that the proper compaction temperature is essential for enhancing pavement performance. Consequently, bagasse has the potential as an environmentally friendly filler in asphalt concrete mixtures, provided that the composition and compaction temperature are meticulously controlled.