CE39 - Sécurité globale, résilience et gestion de crise, cybersécurité

A Prototype deepfake Assessment Toolbox for forensic Experts – APATE

Submission summary

The rise in the manipulation of images and voice represents a potential threat for crimes including disinformation campaigns, security fraud, extortion, online crimes against children, crypto jacking or illicit markets. Deepfake techniques are openly described and widely available; generating deepfakes is easy, and their quality has considerably improved. Therefore, it is challenging to detect them by mere visual analysis. As a consequence, there is an increasing need for deepfake detection tools. While several methods achieve good error rates under controlled scenarios, no dedicated tools are available for criminalistics experts. The goal of APATE is to deliver state-of-the-art methods to detect deepfakes. Instead of a “one size fits all” tool, the project aims at providing a toolbox of complementary techniques, based on the audio or visual parts of the video, by exploiting either low-level or semantic information, or by combining them in a multimodal manner. Each tool will address a different family of deepfakes, and will come with documentation detailing the use-cases, the known bias, the validation framework and how the results can be interpreted. The consortium includes criminalistics experts from the French National Scientific Police Service (SNPS), ensuring that the proposed toolbox is usable, properly described, and processes efficiently actual deepfakes found in criminal cases. In addition, the literature on deepfake generation will be continuously reviewed and analysed, to ensure that datasets corresponding to the latest deepfake generation techniques are available for the partners; a special concern will be to avoid overfitting to the learning databases. The consortium includes three research laboratories (Centre Borelli at ENS Paris Saclay, EPITA, LIX at Ecole Polytechnique), the SNPS, and IDEMIA, world leader in biometric recognition.

Project coordination

Raffaele Grompone (Ecole normale supérieure Paris-Saclay)

The author of this summary is the project coordinator, who is responsible for the content of this summary. The ANR declines any responsibility as for its contents.

Partner

IDEMIA I&S IDEMIA IDENTITY & SECURITY FRANCE
SNPS SERVICE NATIONAL DE POLICE SCIENTIFIQUE
EPITA ÉCOLE POUR L'INFORMATIQUE ET LES TECHNIQUES AVANCEES (EPITA)
LIX Ecole Polytechnique
CB Ecole normale supérieure Paris-Saclay

Help of the ANR 559,679 euros
Beginning and duration of the scientific project: September 2022 - 36 Months

Useful links

Explorez notre base de projets financés

 

 

ANR makes available its datasets on funded projects, click here to find more.

Sign up for the latest news:
Subscribe to our newsletter