The video surveillance system (VSS) is an integral part of the modern society. The surveillance camera captures the video of its designated areas and subsequently stores the video data in the server for future needs. In this situation, the VSS should send the captured video to the server securely; later, according to the demand, legitimate users can access the video data securely. This chapter suggests a secure VSS where the camera transmits the surveillance video data (SVD) to the server once both entities are mutually authenticated and generates the session key. Further, a legitimate user can access the SVD from the server once both parties are mutually authenticated and ensure a session key for secure data transmission. This chapter proposes a lightweight authenticated session key agreement for VSS based on the ASCON, strengthening access control and safeguarding private data. We call the proposed scheme LASKV. The LASKV scheme is lightweight and upholds security against various cryptographic attacks. In this regard, the informal security analysis and the Scyther simulation endorse the security of the LASKV scheme. Overall, the LASKV scheme effectively stores and accesses the SVD safely within an organization.