CE38 - Interfaces : sciences du numérique - sciences humaines et sociales

TeAching and Learning InteractionS for Multimodal ANalysis – TALISMAN

Submission summary

The aim of the interdisciplinary TALISMAN project is to propose a framework, sharable data and analysis models to study higher education learning situations in various instructional situations. Keeping ethics and privacy as main concerns of our research, analyses will be guided by the qualification of the teaching and learning experience, and participants’ engagement. To do so, the project relies on a mixed statistical/machine learning approach to genuine instructional events labeling, including raw events and high-level strategies annotation. The experiments will be undertaken using two existing Context Aware Classrooms (CAC) , equipped with a variety of unobtrusive multimodal and multilevel sensors, and effectors, in Grenoble and Poitiers. This project will answer the following questions:
- Q1: How to model and analyze the students’ engagement levels induced by various instructional situations, and to formulate prescriptions to teachers and researchers, for teacher development and educational research purposes?
-Q2: How to gather data to build corpora of these different instructional situations and to (semi-) automatically annotate them in a privacy-safe and ethical way?
- Q3: How to devise novel perception algorithms relying on machine learning and statistical techniques and compare their outputs to those delivered by Q1 answers?
Outcomes of the project will include anonymized datasets, source codes and models, description of processes, indicators and protocols used in the project, as well as design and implementation guidelines for higher education courses.

Project coordination

Dominique Vaufreydaz (Laboratoire d'Informatique de Grenoble)

The author of this summary is the project coordinator, who is responsible for the content of this summary. The ANR declines any responsibility as for its contents.


LJK Laboratoire Jean Kuntzmann
LaRAC Laboratoire de Recherche sur les Apprentissages en contexte
LIG Laboratoire d'Informatique de Grenoble

Help of the ANR 726,953 euros
Beginning and duration of the scientific project: - 48 Months

Useful links

Explorez notre base de projets financés



ANR makes available its datasets on funded projects, click here to find more.

Sign up for the latest news:
Subscribe to our newsletter