A New Whole Life Cycle Index System for Evaluation of Runoff Forecasting

Runoff forecasting is crucial for planning and managing water resources. As hydrological data becomes more available, more data-driven models are being employed to enhance the effectiveness of runoff forecasting. To accurately and quantitatively assess the whole runoff forecast process, from model construction to application, a whole life cycle forecasting evaluation index system was established in this study to evaluate the data, factors, sample integrity, model construction, and forecast result. The analysis included quantitative evaluation criteria to comprehensively consider data quality, forecasting factor characterization, sample representativeness, model generalization, and result quality. An evaluation of forecast results from 7 river basins and their 85 hydrological stations in China showed that the proposed index system could accurately reflect the performance of the forecasting process. The overall performance of the forecasting model and process can be evaluated quantitatively based on the Euclidean distance, and the pathways to improve the forecasting effectiveness of the model can be identified based on the evaluation results. The validity of the proposed index is also experimentally demonstrated. The proposed index system can be applied to the evaluation of data-driven forecasting processes in various fields.