DS07 - Société de l'information et de la communication

Multimodal Analysis of Opinions in Interactions – MAOI

Submission summary

Opinion mining is a progressing domain. A lot of efforts have been recently dedicated to the development of methods able to analyze opinion data available on the social Web. At the same time, companies that are developing companion robots and virtual vocal assistants (Siri, Google Now, Cortana, etc.) show a growing interest for the integration of the social component in the interaction. MAOI is a fundamental research project in natural language processing and speech processing which contributes to Challenge 7 (Society of information and communication). It deals with opinion analysis in human-agent interaction and is thus integrated in Axis 4 (Interactions, robotics).
More precisely, the MOAI project tackles multimodal opinion analysis methods in human-agent multimodal interactions in order to extract information concerning user’s preferences. Such information is dedicated to enrich user profiles for companion robots and virtual assistants. This challenging issue has been so far rarely and partially handled by the state of the art. The proposed approach relies on Conditional Random Fields (CRF) that have been chosen for their flexibility in order to take advantage of both the generalization capability of machine learning methods and the fine-grain modeling of semantic rules. As recordings of face-to face human-agent interactions are not yet massively available, such flexible methods constitute an alternative to deep learning methods. In this promising context, the MAOI project targets two major breakthroughs: i) feature learning driven by a priori knowledge and psycho-linguistic models in order to learn users' preferences; ii) the integration of various levels of analysis (lexical, syntactic, prosodic, dialogic) through latent variables inside hidden CRF, allowing for grounding the opinion detection in the context of human-agent interaction.

Project coordination

Chloé Clavel (Institut Mines Télécom)

The author of this summary is the project coordinator, who is responsible for the content of this summary. The ANR declines any responsibility as for its contents.


LTCI Institut Mines Télécom

Help of the ANR 151,740 euros
Beginning and duration of the scientific project: - 36 Months

Useful links

Explorez notre base de projets financés



ANR makes available its datasets on funded projects, click here to find more.

Sign up for the latest news:
Subscribe to our newsletter