The construction industry is undergoing a transformative shift with the integration of robotics and automation, particularly in repetitive and labor-intensive tasks such as drywall assembly. This paper presents a comprehensive framework for streamlining drywall construction through CAD-driven robotic assembly. By leveraging advanced CAD tools (Autodesk Fusion 360), this paper presents a seamless workflow that translates digital designs into precise robotic execution. The proposed system integrates computer vision, path planning, and robotic control algorithms to automate drywall assembly with high accuracy and efficiency. In addition, one of the key innovations of this approach is the incorporation of real-time quality assurance, where depth cameras and computer vision systems continuously monitor the installation process, ensuring precise alignment and proper fastening. We demonstrate the feasibility of this approach through a couple of different drywalls. Furthermore, the system’s adaptability to varying architectural designs highlights its potential for widespread adoption in the construction industry.