Tracking Files in the Kepler Provenance Framework

SCIENTIFIC AND STATISTICAL DATABASE MANAGEMENT, PROCEEDINGS(2009)

引用 28|浏览0
暂无评分
摘要
Workflow Management Systems (WFMS), such as Kepler, are proving to be an important tool in scientific problem solving. They can automate and manage complex processes and huge amounts of data produced by petascale simulations. Typically, the produced data need to be properly visualized and analyzed by scientists in order to achieve the desired scientific goals. Both run-time and post analysis may benefit from, even require, additional meta-data --- provenance information. One of the challenges in this context is the tracking of the data files that can be produced in very large numbers during stages of the workflow, such as visualizations. The Kepler provenance framework collects all or part of the raw information flowing through the workflow graph. This information then needs to be further parsed to extract meta-data of interest. This can be done through add-on tools and algorithms. We show how to automate tracking specific information such as data files locations.
更多
查看译文
关键词
scientific problem,additional meta-data,tracking files,workflow graph,data files location,data file,kepler provenance framework,scientific goal,raw information,provenance information,specific information,data analysis,memory management,computer graphic,workflow management system,information flow,data management,data tracking
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要