LLM-based chatbots have improved response quality and reduced costs in customer support, while the experiences of human agents, essential to the service ecosystem, have remained largely overlooked. Stress from harmful texts poses a major challenge for agents, undermining their efficiency, customer satisfaction, and business outcomes. In this work, we propose an LLM-powered system designed to enhance the working conditions of customer service agents by addressing emotionally intensive communications. Our proposed system leverages LLMs to transform the tone of customer messages, preserving actionable content while mitigating the emotional impact on human agents. Furthermore, the application is implemented as a Chrome extension, making it highly adaptable and easy to integrate into existing systems. Our method aims to enhance the overall service experience for businesses, customers, and agents. The code related to this paper is available at: https://github.com/sehyeongjo/Proxy-LLM .