The integration of Machine Learning as a Service (MLaaS) into the Internet of Things (IoT) environments presents considerable opportunities for enhancing decision-making and automation. We propose a novel framework for context-aware selection of MLaaS in IoT settings, aimed at optimising the interaction between IoT users’ activities and machine learning services. Our framework considers various contextual dimensions, such as user preferences, locations, IoT device capabilities, and application requirements, to develop a dynamic selection process. By employing context-aware algorithms, our approach seeks to enhance the efficiency, accuracy, and responsiveness of IoT systems. We propose a context change analysis algorithm based on support vector machines (SVM). We develop a contextual bandits algorithm along with skyline queries to achieve optimal mapping between abstract MLaaS services and concrete MLaaS services for quality of service (QoS) attributes. Experiments conducted with real-world and simulated datasets demonstrate the effectiveness of our proposed methods.