File Spooler and Copy System for Fast Data Transfer

CERN (derived from Conseil europeen pour la recherche nucleaire) is a European research organization in nuclear physics, which has particle accelerators and other infrastructures necessary for high-energy physics research. ALICE (A Large Ion Collider Experiment) is a heavy-ion detector on the Large Hadron Collider ring. The paper consists of a design solution for a File Spooler and Copy System for the data stored in volatile storage (like local SSDs). The system will manage the data on the local SSDs, and copy them asynchronously to persistent storage, check consistency and remove the copied files from the volatile storage. Also, the paper highlights the tasks that the File Spooler and Copy System must perform to provide a scalable and reliable file transfer.