Implementing CUDA Unified Memory in the PyTorch Framework
2021 IEEE International Conference on Autonomic Computing and Self-Organizing Systems Companion (ACSOS-C)（2021）
摘要
Popular deep learning frameworks like PyTorch utilize GPUs heavily for training, and suffer from out-of-memory (OOM) problems if memory is not managed properly. In this paper, we propose a modification that utilizes CUDA Unified Memory (UM) to expand GPU memory to the available host memory space so that practicality for the programmer can increase, and OOM memory errors will not result for any wor...
更多查看译文
关键词
Training,Deep learning,Prefetching,Conferences,Graphics processing units
AI 理解论文
溯源树
样例
生成溯源树，研究论文发展脉络
Chat Paper
正在生成论文摘要