A First Step Towards Considering Nonverbal Communicative Cues in Dialog Systems.
PETRA '24 Proceedings of the 17th International Conference on PErvasive Technologies Related to Assistive Environments(2024)
Abstract
Currently, spoken dialogue systems mostly consider only voice interactions and do not consider nonverbal cues. This work aims to explore the domain of interaction with conversational assistants, taking into account not only verbal cues, but also the importance of integrating nonverbal aspects to make interactions between humans and agents more natural, richer, and more efficient. This work presents an initial proof-of-concept for the modules needed for dialogue systems to take into account verbal and nonverbal inputs, as well as their articulation, demonstrating their viability. To this end, we use a fusion module that can directly or indirectly affect the communicative acts, depending on the verbal and nonverbal communication inputs. Preliminary results demonstrate the implemented system behaviour of how verbal content is affected by nonverbal cues.
MoreTranslated text
AI Read Science
Must-Reading Tree
Example
![](https://originalfileserver.aminer.cn/sys/aminer/pubs/mrt_preview.jpeg)
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined