In this study, we propose an enhanced and scalable implementation of the K-Means clustering algorithm tailored for large-scale datasets. By integrating the Mini-Batch K-Means with distributed computing frameworks such as Apache Spark, we improve clustering performance in terms of speed and convergence. Additionally, we conduct a comparative analysis with density-based spatial clustering of applications with noise, GMM, and Mean Shift to evaluate the trade-offs in terms of accuracy and computational cost. Our experiments on real-world customer segmentation data demonstrate that the proposed approach achieves high clustering efficiency while maintaining scalability. The optimal number of clusters is determined using the Elbow method and Silhouette coefficient, with visualization confirming improved segmentation quality. This framework supports more effective decision-making in big data environments.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Scalable Customer Segmentation with Mini-Batch K-Means on Apache Spark: A Comparative Study of Clustering Algorithms

  • Khamza Eshankulov,
  • Murodjon Khusenov,
  • Nozimjon Khojiyev,
  • Umidjon Gapporov,
  • Nilufar Amonova

摘要

In this study, we propose an enhanced and scalable implementation of the K-Means clustering algorithm tailored for large-scale datasets. By integrating the Mini-Batch K-Means with distributed computing frameworks such as Apache Spark, we improve clustering performance in terms of speed and convergence. Additionally, we conduct a comparative analysis with density-based spatial clustering of applications with noise, GMM, and Mean Shift to evaluate the trade-offs in terms of accuracy and computational cost. Our experiments on real-world customer segmentation data demonstrate that the proposed approach achieves high clustering efficiency while maintaining scalability. The optimal number of clusters is determined using the Elbow method and Silhouette coefficient, with visualization confirming improved segmentation quality. This framework supports more effective decision-making in big data environments.