Memory Reference Analysis and Implications for Executing AI Workloads in Mobile Systems
2023 International Conference on Electrical and Information Technology (IEIT)(2023)
Abstract
Recently, mobile applications that internally execute artificial intelligence workloads are increasing. In mobile environments, performance degradation due to memory thrashing may occur while artificial intelligence workloads perform the training of large data set due to limitations in memory capacity. In this paper, we analyze the memory reference characteristics of artificial intelligence workloads, and observe that artificial intelligence workloads can cause performance degradation by generating a lot of I/Os (Inputs / Outputs) to NAND flash storage in mobile systems due to weak temporal locality and irregular popularity bias in memory write operations. Based on this observation, we discuss system architectures that can efficiently execute artificial intelligence workloads in mobile systems. Specifically, we adopt small persistent memory as write accelerator and show how efficiently the memory write operation of mobile systems can be managed. Simulation experiments show that the proposed system architecture can improve I/O time significantly compared to existing mobile systems.
MoreTranslated text
Key words
Mobile system,AI workload,memory reference,machine learning,write acceleration
AI Read Science
Must-Reading Tree
Example
![](https://originalfileserver.aminer.cn/sys/aminer/pubs/mrt_preview.jpeg)
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined