MuDDi
Multi-modal Deepfake Detection: AI-based Forensic Analysis of Manipulated Media
Start: 11/2024
End: 05/2025
The project demonstrates how advanced computational methods can support the verification of digital media and protect the integrity of visual information. MuDDi is a digital forensic tool for the analysis and detection of manipulated content in videos and images. Leveraging state-of-the-art AI technology, MuDDi identifies deepfakes and provides reliable assessments of media authenticity.
The objective of MuDDi is to develop robust, multi-modal approaches for detecting media manipulation, combining computer vision, signal processing, and artificial intelligence. The system analyzes micro-movements in skin through video plethysmography (VPG) to detect absent or unnatural pulse waves in manipulated videos. Simultaneously, it employs advanced image forensic methods and invisible watermark analysis to identify tampering in high-resolution media. In addition, artificial expert systems, based on large language models, provide AI-powered assessments of media authenticity, complementing human expert judgment.
MuDDi is designed for professional applications in digital forensics, fact-checking, and law enforcement. It supports media organizations and fact-checkers in verifying video and image content, assists security authorities in the collection and analysis of digital evidence, and helps technology companies and platforms combat disinformation. The system has already been applied in real-world scenarios, such as the CORRECTIV Faktenforum, a participatory platform that allows citizens and experts to collaboratively identify manipulated content and misinformation.
The MuDDi project is led by the House of Participation (HoP) at FZI, a center of excellence for digital participation and digital democracy. FZI and HoP ensure that MuDDi bridges the gap between cutting-edge AI research and practical, trustworthy forensic applications, thereby contributing to the strengthening of digital participation, democratic processes, and media integrity.
Applied Artificial Intelligence
In this research focus, the FZI concentrates on practical research into the key technology of Artificial Intelligence (AI). Innovative AI solutions are developed and transferred to application areas such as mobility, robotics, healthcare technology, logistics, production, and supply and disposal on behalf of our partners and customers.
Digital Democracy and Participation
The research focus Digital Democracy and Participation addresses inclusive, modern, and democratic forms of digital participation as well as the opportunities and challenges of digital democracy.
