Hand gestures have become a popular method for controlling digital devices. The Gesture-Controlled Virtual Mouse redefines human–computer interaction by allowing users to operate digital devices using intuitive hand gestures and voice commands. This innovative system not only enhances usability but also promotes a hygienic computing environment by minimizing physical touch—an essential feature in today’s health-conscious world. Leveraging advanced Machine Learning and Computer Vision techniques, including Convolutional Neural Networks (CNNs) with MediaPipe via pybind11, the system achieves high accuracy in recognizing a wide range of gestures and voice inputs. This flexibility allows the technology to be applied across various real-world scenarios, from improving accessibility for people with physical disabilities to streamlining workflow in business and industrial environments. The Gesture-Responsive Pointer Controller is designed for versatility, accommodating different interaction styles, including direct hand gestures and uniform-colored gloves, with voice command support as an additional input method. Optimized for the Windows platform, this system's modularity makes it adaptable to diverse contexts, such as health care, education, and manufacturing, offering hands-free control where needed. By combining gesture recognition with voice assistant capabilities, this technology represents a significant step toward a future where AI-driven human–computer interaction is more seamless, accessible, and intuitive.