Everyone in this modern world is busy and attempts to answer calls while driving. This creates a concern, particularly when travelling at a faster speed. These distractions have an impact on the user when they are driving and cause them to lose focus, which can result in serious accidents and hurt even the cautious drivers. To address this problem, we developed a practical application solution that recognizes an incoming call, determines whether the speed is higher than the threshold speed, then disconnects the call automatically, and then prompts a quick reply to the caller. Our prototype has emergency contacts storing web-based feature and additionally special feature to save caller numbers in the cache memory so that, in the event of an emergency, if the same caller tries to call the user again, our application won’t cut the call off and will allow the user to take the call. Our prototype has a very good accuracy of 98.6% which operates perfectly at extremely low and high speeds with a very low response time of 389.9 ms in 50th percentile devices and 178 ms in 25th percentile devices. The proposed model improved the accuracy and decreased the response time. Therefore, our proposed method will make sure that the driver is not distracted by any unnecessary incoming calls, keep them focused while driving, and enable them to drive safely.