A Human-in-the-Loop Method for Developing Machine Learning Applications
International Conference on Systems and Informatics(2019)
Abstract
An intelligent system is usually built based on a machine-learning model trained over offline datasets. However, such a system is difficult to adapt to new patterns or new data in the online environment, i.e. offline model has relatively poor online generalization. Moreover, understanding and solving errors taking place in the online system is also hard because errors arise in offline training pipelines and could propagate. We propose a novel systematic method, including design, architecture, and implementation to mix people's experience and intelligence with a relatively low cost. The method includes three negative-feedback loops and one data loop, supporting iterative and incremental developing procedure. Based on the method, we implemented a general system architecture and conducted two case studies. The results illustrate the effectiveness of the method.
MoreTranslated text
Key words
machine learning system,negative-feedback,human-in-the-loop
AI Read Science
Must-Reading Tree
Example
![](https://originalfileserver.aminer.cn/sys/aminer/pubs/mrt_preview.jpeg)
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined