Cancer is a complex and widespread disease characterized by the uncontrolled growth and spread of abnormal cells. There are nearly a hundred distinct forms of cancer that affect various areas of the body. Breast cancer is a condition caused by the overgrowth of cells. In women compared to men, it is more typical. This study aims to explore several types of machine learning models that are used by using Pyspark on a single-node cluster to explore their potential in tumor classification. Employing recursive feature elimination with the cross-validation method to select the best features through the training of a random forest classifier and applied five machine learning algorithms: Naïve Bayes, Logistic regression, Support vector machine, Decision tree, and XGBoost Classifier to distinguish between benign and malignant tumors. Compared to the other algorithms, the XGBoost Classifier improves classification and prediction accuracy by 99%. This research underscores the pivotal role of Pyspark-powered machine learning algorithms in enhancing medical diagnosis and prognosis, particularly in the critical domain of cancer classification. Healthcare providers may be able to increase patient outcomes and diagnostic accuracy by utilizing these cutting-edge computational tools, bringing in a new era of personalized cancer care.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Classification of Breast Cancer Using Spark Machine Learning

  • Durga Pujitha Krotha,
  • Fathimabi Shaik

摘要

Cancer is a complex and widespread disease characterized by the uncontrolled growth and spread of abnormal cells. There are nearly a hundred distinct forms of cancer that affect various areas of the body. Breast cancer is a condition caused by the overgrowth of cells. In women compared to men, it is more typical. This study aims to explore several types of machine learning models that are used by using Pyspark on a single-node cluster to explore their potential in tumor classification. Employing recursive feature elimination with the cross-validation method to select the best features through the training of a random forest classifier and applied five machine learning algorithms: Naïve Bayes, Logistic regression, Support vector machine, Decision tree, and XGBoost Classifier to distinguish between benign and malignant tumors. Compared to the other algorithms, the XGBoost Classifier improves classification and prediction accuracy by 99%. This research underscores the pivotal role of Pyspark-powered machine learning algorithms in enhancing medical diagnosis and prognosis, particularly in the critical domain of cancer classification. Healthcare providers may be able to increase patient outcomes and diagnostic accuracy by utilizing these cutting-edge computational tools, bringing in a new era of personalized cancer care.