Enhancing Interactive Experiences: The Synergy of Augmented Reality and Reinforcement Learning in Gaming
摘要
An augmented reality (AR) game using the Unity Game Engine and an in-built package called AR Foundation Kit has been developed to create a wildlife simulator. The use of AR-Core (Google) and ARKit (Apple) tools blend the virtual (3d modelled) animals with the player’s real-life environment. The objective is to provide an immersive and captivating gameplay experience well integrated with machine learning (ML) techniques with emphasis on reinforcement learning to govern the behaviour and animation of the virtual animals. ML Agents package is used to ensure that animal behaviours are realistic and enhance user experience. Coding environment is based on Visual Studio using the C# programming language, taking full advantage of the pre-integrated environment in Visual Studio for Unity. The present study addresses the lack of hit/successful AR games on smartphone platforms, and projects vast potential for innovation. The app supports Android 7.0 (Nougat) and iOS 11.0, or the later versions. Presently, the gameplay features one animal (Penguin), and future updates can accommodate more animals to enrich the player experience and expand the in-game possibilities.