This paper presents a lane detection system using cutting edge computer vision techniques and object identification abilities toward precise identification and tracking of lane markings over various road conditions. The object detection integration into the system enables the extension of its performance through the vehicle identification and tracking which is an essential in complex traffic systems, consequently improving traffic safety. Furthermore, the deployment of a deviation alert mechanism will help a great deal as it will notify the autonomous driving system immediately when the car moves off the lane detected by the system. The system is extensively tested in different weather conditions to verify the robustness and instant adaptability so it can make an inroad into the reliability and safety of self-driven vehicles under such scenarios.