There is a general trend in orthopedic surgery towards minimally invasive surgery. Because only small incisions are performed to make the inside of the patient accessible, a surgeon is unable to visually assess the surgical site. To overcome this limitation, X-ray imaging is used to provide the surgeon with insights about the actions taken inside the patient. However, given the projection of 3D structures onto the 2D image plane, this is still a challenging task for a surgeon. To further assist a surgeon, computer-assisted surgery (CAS) systems are used to help a surgeon to precisely navigate the tools and implants used during a procedure. While these systems provide valuable insights, current state-of-the-art CAS systems come with major drawbacks, including high acquisition and operational cost, additional hardware in an already crowded operating room (OR), and added complexity and change to the traditional surgery workflows. To address these issues, we propose an augmented reality (AR) extension of a novel CAS system, focusing on the cephalomedullary nailing procedure of the femur bone. As the extended system purely operates based on the acquired intraoperative X-rays, the AR extension provides real-time guidance between X-ray acquisitions and reduces the number of X-ray images taken during the procedure. This is achieved by augmenting instruction onto the surgeons’ tools which are tracked by the AR glasses. To evaluate the feasibility and usability within a surgical setting with medical professionals, the solution has been tested in multiple experiments with cadaveric specimens. It was well received by the surgeons and almost all of the AR-guided drillings were successful.