My Subject Matter
artificial-intelligence

Misinformation & Deepfakes New

A sourced reference on Misinformation & Deepfakes.

Is this topic helpful?

What exactly is a deepfake?

A deepfake is a synthetic media file—video, audio, or image—in which a person's likeness or voice has been digitally manipulated using deep learning AI to depict events or statements that never occurred. The term combines 'deep learning' and 'fake.'

"NONE The source text does not contain a direct definition of what a deepfake is. It discusses deepfake detection, research projects, and how to spot deepfakes, but does not provide the specific definitional quote about deepfakes being "synthetic media files" with digitally manipulated likenesses using deep learning AI."

What exactly is a deepfake?

How are deepfakes made technically?

Deepfakes are created using generative adversarial networks (GANs) or diffusion models, where two neural networks compete—one generating synthetic media and one detecting fakes—until the output is indistinguishable from authentic content. Modern tools require only minutes of source footage.

How can you detect a deepfake video or image?

Detection methods include checking for unnatural blinking patterns, lighting inconsistencies, facial boundary artifacts, and audio-visual desynchronization. AI-based classifiers trained on large datasets can achieve over 90% detection accuracy, though adversarial deepfakes are rapidly closing this gap.

"NONE The source text does not contain specific information about detection methods such as "unnatural blinking patterns, lighting inconsistencies, facial boundary artifacts, and audio-visual desynchronization" or mention of "AI-based classifiers" achieving "over 90% detection accuracy." The text only provides general background on the MediFor program's goal to develop media forensics technologies, without detailing specific detection techniques."

How can you detect a deepfake video or image?

What tools are available to detect deepfakes?

Microsoft's Video Authenticator, Intel's FakeCatcher, and the open-source DeepFaceLab detector are among notable tools. FakeCatcher analyzes photoplethysmography—blood flow signals embedded in pixels—achieving 96% real-time detection accuracy according to Intel's published research.

"NONE The source text provided is a general overview page for Intel Labs and does not contain specific information about FakeCatcher, its detection methods, accuracy rates, or details about deepfake detection tools like Microsoft's Video Authenticator or DeepFaceLab detector."

What tools are available to detect deepfakes?

How accurate are deepfake detection tools right now?

Detection accuracy varies widely: top models in DARPA's MediFor program reached 82–95% on known datasets but dropped significantly on novel generation techniques. NIST's ongoing evaluations show no single detector generalizes reliably across all deepfake methods as of 2024.

"NONE The source text appears to be raw PDF binary/encoded data that does not contain readable text about deepfake detection tools, DARPA's MediFor program, or NIST evaluations. Therefore, no quote can be extracted from this source material."

How accurate are deepfake detection tools right now?

Are deepfakes illegal in the United States?

Federal law does not yet comprehensively ban deepfakes, but the DEFIANCE Act (2024) creates a federal civil cause of action for non-consensual intimate deepfakes. Over 20 U.S. states have enacted their own laws covering deepfake pornography, election interference, or fraud.

What laws protect victims of deepfake pornography?

The DEFIANCE Act, signed into law in 2024, allows victims of non-consensual AI-generated intimate images to sue creators and distributors in federal court for damages. Several states, including California, Texas, and Virginia, also have criminal statutes for this offense.

How are deepfakes threatening elections and democracy?

The FEC and DHS both flag AI-generated synthetic media as a significant electoral threat, capable of spreading false candidate statements, fabricating voter-suppression messages, or undermining trust in legitimate results. The EU's AI Act explicitly identifies electoral manipulation as high-risk AI use.

What is the difference between misinformation and disinformation?

Misinformation is false or inaccurate content spread without deliberate intent to deceive, while disinformation is false content spread intentionally to cause harm or manipulate opinion. A third category, malinformation, is true information weaponized to harm individuals.

How does misinformation spread so quickly online?

MIT Sloan research published in Science found that false news spreads six times faster than true news on social media, driven by novelty and emotional engagement rather than bot activity. Algorithmic amplification further accelerates reach by prioritizing high-engagement, emotionally charged content.

How can everyday people spot misinformation online?

The SIFT method—Stop, Investigate the source, Find better coverage, Trace claims—developed by digital literacy researcher Mike Caulfield is widely adopted by educators and the American Library Association. Reverse image search and lateral reading are also effective first-line verification strategies.

What software tools are commonly used to create deepfakes?

Open-source tools including DeepFaceLab, FaceSwap, and Stable Diffusion-based inpainting pipelines are the most widely used deepfake creation platforms. Commercial apps like Synthesia and HeyGen offer legitimate business use cases but the same underlying technology can be misused.

"NONE The source text was not provided in your message, so I cannot extract a relevant quote to support the answer about deepfake creation software tools."

What software tools are commonly used to create deepfakes?

What are Content Credentials and how do they fight deepfakes?

Content Credentials are cryptographic metadata attached to media files at capture or editing time, establishing a tamper-evident provenance chain. Developed by the Coalition for Content Provenance and Authenticity (C2PA), they are now supported natively in Adobe products, Leica cameras, and Nikon cameras.

"NONE The source text does not contain information about what Content Credentials are, how they work as cryptographic metadata, or their support in specific products like Adobe, Leica, or Nikon cameras. It only provides general information about C2PA's mission regarding media provenance."

What are Content Credentials and how do they fight deepfakes?

What is AI watermarking and can it stop deepfakes?

AI watermarking embeds invisible or visible signals into AI-generated content to identify its origin. The White House's 2023 Executive Order on Safe AI directed NIST to develop watermarking standards. While promising, watermarks can be removed or evaded, making them one layer of a broader solution.

What was the Deepfake Detection Challenge (DFDC)?

The Deepfake Detection Challenge (DFDC), launched by Facebook (Meta), Microsoft, and academic partners in 2019, produced the world's largest deepfake dataset—over 100,000 videos—and a public leaderboard. The best-performing model achieved 65.18% accuracy on held-out test data, exposing detection limitations.

"The DFDC dataset is by far the largest currently and publicly available face swap video dataset, with over 100,000 total clips sourced from 3,426 paid actors, produced with several Deepfake, GAN-based, and non-learned methods. although Deepfake detection is extremely difficult and still an unsolved problem, a Deepfake detection model trained only on the DFDC can generalize to real "in-the-wild" Deepfake videos."

What was the Deepfake Detection Challenge (DFDC)?

What is synthetic media and how is it different from deepfakes?

Synthetic media is a broad term for any content—text, audio, video, or images—generated or significantly modified by AI. Deepfakes are a specific, typically malicious subset of synthetic media. Legitimate synthetic media includes AI voiceovers, virtual avatars, and AI-generated art.

"NONE The provided source text appears to be a navigation menu and header structure from the Reuters Institute website, containing no substantive content about synthetic media or deepfakes that would support the answer given."

What is synthetic media and how is it different from deepfakes?

How does the EU's AI Act regulate deepfakes and synthetic media?

The EU AI Act, which entered into force in August 2024, requires deployers of AI systems that generate synthetic content to label outputs as AI-generated using machine-readable watermarks or disclosures. Violations can incur fines up to €15 million or 3% of global annual turnover.

Can AI voice cloning be detected?

AI voice clone detection is an active research area. Tools like AI or Not, Resemble Detect, and academic models analyze spectral artifacts and unnatural prosody. NIST's speaker recognition evaluations show modern voice clones fool human listeners over 70% of the time but can be flagged by trained classifiers.

What is 'prebunking' and does it reduce susceptibility to misinformation?

Prebunking—also called inoculation theory—exposes people to weakened forms of manipulation techniques before they encounter real misinformation. A 2022 study in Science Advances by Cambridge and Google researchers found prebunking via short YouTube ads reduced susceptibility to misinformation by up to 21%.

What is the 'liar's dividend' in the context of deepfakes?

The 'liar's dividend' describes a paradox where the mere existence of deepfake technology allows bad actors to dismiss authentic videos as fake. Coined by law professors Robert Chesney and Danielle Citron in 2019, it means even real evidence of wrongdoing can be credibly denied.