The continuum of eXtended Reality Displays consists of Augmented Reality, Mixed Augmented Reality or Mixed Reality and Virtual Reality systems. Among these systems, mixed reality systems promise new set of applications as it combines both 3D rendering of virtual reality and real world mapping of augmented reality interfaces. Many mixed reality headsets like Microsoft HoloLens relies on holograms to render 3D imagery on real world objects. However, ensuring the stability of these holograms, popularly known an swimming effect, is crucial, as their position appears altered from the user’s perspective when viewed through a Head-Mounted Display (HMD). This paper proposed a new way of tracking object in real time and analysis of swimming effect of the hologram using robot. A user study involving 10 users using 50 randomly chosen viewpoints found that the proposed method is as accurate as the state of the art World Locking Tool (WLT) with additional advantage of tracking dynamic objects.