Communication plays a vital role in society and is considered an essential life skill. However, individuals with hearing disabilities often encounter challenges when interacting with others, leading to feelings of isolation and reduced self-confidence. Sign language, a combination of manual gestures and facial expressions, serves as a means of communication for individuals with hearing and speaking disorders. Ordinary individuals are often unaware of sign language, making communication with them difficult. Additionally, the increasing prevalence of Code-Mixed languages, where multiple languages are used within a single sentence, poses a challenge for existing speech-to-sign translating systems to accurately recognize the code-mixed languages and generate the corresponding sign language. In this paper, we propose a novel system that facilitates communication between individuals with hearing impairments and those who can speak, specifically targeting code-mixed Indian-English languages. Our system initially converts code-mixed speech to text and subsequently maps the generated text to the appropriate Indian Sign Language, thereby enabling effective communication between these two user groups.