Deepfakes have become so believable in recent years that it can be difficult to tell them apart from real images. As they become more convincing, it’s important to expand our understanding of deepfakes and where they come from. In collaboration with researchers at Michigan State University (MSU), we’ve developed a method of detecting and attributing deepfakes. It relies on reverse engineering, working back from a single AI-generated image to the generative model used to produce it.
Within the scientific community, much of the focus with deepfakes is on detection — telling whether an image is real or a deepfake. Beyond detecting deepfakes, researchers are also able to perform what’s known as image attribution, that is, determining what particular generative model was used to produce a deepfake. Image attribution can identify a deepfake’s generative model if it was one of a limited number of generative models seen during training. But the vast majority of deepfakes — an infinite number — will have been created by models not seen during training. During image attribution, those deepfakes are flagged as having been produced by unknown models, and nothing more is known about where they came from, or how they were produced.
Our reverse engineering method takes image attribution a step further by helping to deduce information about a particular generative model just based on the deepfakes it produces. It’s the first time that researchers have been able to identify properties of a model used to create a deepfake without any prior knowledge of the model.
Through this groundbreaking model parsing technique, researchers will now be able to obtain more information about the model used to produce particular deepfakes. Our method will be especially useful in real-world settings where the only information deepfake detectors have at their disposal is often the deepfake itself. In some cases, researchers may even be able to use it to tell whether certain deepfakes originate from the same model, regardless of differences in their outward appearance or where they show up online.
To read the full story visit Facebook AI.
