In recent years, artificial intelligence has largely penetrated systems and machines that serve the everyday lives of people and businesses. These technologies are dramatically changing the way in which various innovative applications are developed in various fields such as e-banking, e-commerce, e-government, e-health, etc. as well as the way in which users interact with machines and systems. These systems are now provided by both the private and public sectors to citizens and businesses. However, important issues emerge in relation to the protection of personal data of individuals processed by these systems. In this paper, we examine the critical issues and concerns in two seemingly incompatible concepts, namely artificial intelligence systems and the protection of personal data during the use of these systems. We also propose specific procedures and tools to address the challenges that arise when organizations and developers who develop and use AI systems complying with the requirements and restrictions set by personal data protection legislation.