A virtual Assistant Dedicated to the Accompaniment of the Person Informed of his Life Context thanks to the Smartphone

Publications in recent years describe a strong use of wearable systems (especially smartphones) in the field of Human Activity Recognition (HAR). The smartphone can be considered both as a set of sensors and as an interface for the user. The European Horizon 2020 e-VITA project aims to promote active and healthy aging in senior populations. To this end, and thanks to Information and Communication Technologies (ICT), the current work is focused on the development of a virtual assistant to help the user in his daily tasks. One of the ICT used in this project is the smartphone. Indeed, the sensors of the smartphone make it possible to measure and reconstitute a part of the user's context, thanks to the communication with a remote server. Moreover, this server is able to offer different services (including the fusion of different modalities) in order to reconstitute the context. The fusion of multimodal data implies in its turn different machine learning modules. Finally, in order to efficiently restore the context to the user and to dialogue with him, a chatbot module under the chatGPT model developed by openAI is integrated. The communication with the user will then be established in a textual or vocal way.