The Research On The Application Of Photometric Redshifts Based On Spark Platform'S Data Mining Technologies

The quantity of astronomical data has been growing at an exponential rate, creating unprecedented challenges in astronomical data mining. The rapid development of distributed cluster technologies and cloud computing platform provide new research ideas and methods for massive data processing and analysis. The distributed cluster technology Spark is experiencing a meteoric rise, and shows comparative advantages in terms of iterative machine learning and interactive data mining applications. In this paper, we use the latest release of Sloan Digital Sky Survey photometric data set to explore the suitability and application problems of the data mining technologies based on Spark in the massive astronomical survey data, providing a new methodology for large-scale astronomical data mining.