Mobile Learning System with Context-Aware Interactions and Point-of-Interest Understanding

To explore museums and art galleries, visitors usually follow the routes and regulations that may limit learning interest and efficiency. How to improve and assess the learning effectneeds to be well addressed. Accordingly, we have developed a mobile learning system which can effectively offer visitors with attention tracking, interest cultivation, and immersive engagement. This work adopts the commercially-available smart glass accompanied with an additional camera, a Photoplethysmography (PPG) sensor module, and a smart phone or tablet to fulfill the integrated computations from multiple sensors. Based on these devices, the proposed system includes (1) computation of visual focal points, (2) attention estimation via heart rate variability, (3) indoor positioning, (4) derivation of user preferences and behaviors, and (5) intimate interactions of mobile learning. The experimental results reveal that the proposed mobile learning system can effectively increase user's interest, personality, and learning effect via contextaware interactions and point-of-interest understanding.