Artificial intelligence is revolutionizing various fields, including healthcare. Both scholars and practitioners ask whether the current paradigms for the creation, deployment and use of AI in various fields are ethically acceptable. Do proposed AI tools contribute optimally to various aspects of human flourishing or are there ways to further harness their potential? With the introduction of various AI tools in healthcare, there are concerns about long-term impacts of novel technology on the well-known benefits of traditional styles of care. Headlines of popular media sometimes imply that healthcare professionals will be replaced by AI agents. This chapter examines the role that can be ascribed to AI tools, especially chatbots within healthcare relationships, keeping in mind the dependent and social nature of human beings, while evaluating technology’s influence on the dynamics of healthcare. It examines questions about the significance of patient-caregiver relationships in healthcare and asks whether such a relationship can be replicated by AI. Using a MacIntyrean framework, it explores the notions of interdependence necessitated by human vulnerability, especially in the case of illnesses, to better understand the appropriate uses of AI within healthcare. It thus showcases the role of interpersonal relationships and social connectedness in health and wellbeing. It also proposes integration of context specific nuances of universal values into guidelines for the development and use of such tools. It thus emphasizes the need to enrich this technology by integrating contextually and culturally appropriate values (such as Ubuntu in South Africa) within the design, production and deployment of such tools.