YouHome System and Dataset: Making Your Home Know You Better

Recent research has actively investigated technolo-gies, such as artificial intelligence (AI), energy-efficient computing, and privacy protection, to bring us more advanced smart home experiences. However, existing work has failed to integrate these key technologies to provide a complete smart home solution to understand user behaviors, protect user pri-vacy, and provide personalized suggestions. In addition, there are not many available smart home datasets that can support thorough studies of user behaviors in household environments. To address these critical problems, we present YouHome: the first smart home framework for developing integrated smart systems with a strong emphasis on usability, scalability, user privacy, edge/cloud coordination, and a comprehensive activities-of-daily-living (ADL) dataset to assist the smart home research. YouHome includes a flexible framework with three levels of system abstraction to collect sensor data, recognize user behavior, and generate personalized suggestions. We also establish multi-stage approaches in this work to protect user privacy effectively from threats such as data leaks. Finally, we implement an end-to-end prototype system to demonstrate the efficacy of our proposed framework. The accompanying YouHome ADL dataset is the first annotated dataset with multiple sensing data types tailored for smart home research and applications, including video, illuminance, temperature, humidity, motion, and sound. It covers two household settings, 20 users, and 31 different activities. We have released our comprehensive dataset to enable numerous research opportunities in both smart home and machine learning communities. We also intend to open-source the framework in the future.