Communicating with the public can be quite challenging for people with speech or hearing impairments. The proposed work aids in communication with other speech and hearing problems. Gestures are also used by the elderly to communicate with caretakers. Caretakers must recognize these gestures and provide the necessary assistance. In order to express themselves, they need an interpreter or a motion-sensing device that translates sign language into several standard languages. For persons who speak Telugu, there is no model or technique to communicate the knowledge. A one-way conversation between the patient, the avatar, and the caretaker is designed. The patient's gestures are transformed to text and speech. Information is communicated by means of an avatar. The English speech is translated into Telugu so that the caretaker can comprehend it. As a result, a one-way conversation in the local tongue is provided. Gestures are translated into text and text is translated into Telugu script in the project module facilitating communication between the patient and caretaker.