DIGITAL LIFE

AI deepfakes are getting more realistic. CU scientists developed a better way to spot them
Deepfake threats to companies...Deepfakes – synthetic media where a person’s likeness is swapped for another – are not a new concept. Photographic and film manipulation, telephone voice decoders, and image adjustment have been with us for some time. However, the rise of generative artificial intelligence (GenAI) has moved everything much further forward, making tools available at low/no cost, enabling almost anyone with a smartphone and basic understanding to create AI-generated synthetic media. In the hands of bad actors, these technologies can increasingly be used to make deepfakes for fraud, deception, and defamation.
Chief Executive Officers (CEOs), General Counsels and the heads of Information Security, Fraud, Risk, Marketing, all have good reason to be concerned about the rapid spread of deepfake technology. In this article, KPMG professionals seek to examine some of the potential threats of deepfakes and discuss how organizations can shore up their defenses to try to reduce the risks to their business.
The rise of deepfakes exploits our natural tendency to trust visual and auditory content, posing significant risks. It's critical for organizations to enforce robust Trusted AI programs to help ensure safe and ethical AI use and secure deployment. Implementing a zero-trust architecture is equally essential, embedding verification across all operations with stringent controls and cutting-edge technology. This strategic approach is vital for maintaining integrity and trust in the digital age."...KPMG International
Child’s play or malicious weapon? The democratization of deepfake technology...Virtually anyone can make a deepfake, enabled by the accelerating democratization of GenAI, driven by open-source tools, user-friendly platforms, and decentralized access to deepfake technology. This can make it simple and low-cost (or potentially even free) to create audio, video, and text via advanced GenAI techniques, mostly based on large language models (LLM) that consume and classify content and reproduce it in new ways. It's already possible to go online and learn how to make a convincing deepfake, based on a mere three seconds of recorded audio of someone’s voice – using off-the-shelf, publicly available software. On top of this, there is an emergence of "deepfake-as-a-service" as a lucrative market on the dark web.
Attack surfaces are increasing, in part due to the hybrid work environment where many people are connecting with organizations remotely from homes, coffee shops, airports, gyms and other locations. The use of biometric data for authentication and authorization presents further opportunities to infiltrate organizations, via synthetic voices and images. According to one recent global study, 70 percent of people say they’re not confident they can identify a real versus a cloned voice.
This gets to the essence of the deepfake threat, which is the human propensity for trust. As a visual and communicative species, people often authenticate, and trust based on what can be seen and heard. But the knowledge that deepfakes are out there could seriously erode trust and necessitate new ways to verify authenticity.
The deepfake threat spectrum...Criminals or other malicious actors can use deepfakes in a number of ways that are potentially damaging, amplifying the costs of fraud, regulatory fines, and data breaches, and eroding trust in brand integrity:
Fraudulent financial transactions...Cybercriminals could use deepfakes to impersonate senior executives during phone calls or video conferences (sometimes called “vishing”), convincing others that they carry authority. They could then acquire confidential information or even persuade individuals to transfer significant funds. Insurance companies could be targeted with deepfake generated images submitted with claims. With more companies moving toward automated claims processes, removing the human claims adjuster, such images may not come under as much scrutiny. And customers can be targeted by deepfakes posing as official company representatives and surrender personal financial details or even make payments to criminals.
Disinformation...Deepfakes videos or audio recordings can spread fraudulent or false and defamatory information about individuals and organizations, which could damage stakeholder, customer, and wider public trust. In a social media age, such content can go viral in seconds. For instance, by circulating deepfakes of executives announcing a company’s financial status, upcoming mergers, or product launches and marketing materials – or making derogatory remarks, or inaccurate political statements – criminals could profit from subsequent fluctuations in share prices, as well harming a company’s reputation. Such tactics could also be used by competitors to cause stock price volatility and deter investors – as well as by other nation states to undermine the economy. Similarly, malicious actors may try to damage companies’ reputation by spreading deepfakes about environmental harm, poor labor practices, faulty, dangerous products, or inappropriate behavior from executives.
Enhanced social engineering attacks...By using deepfakes, bad actors can penetrate organizations by, for example, impersonating a Chief Technology Officer (CTO) to persuade staff to grant access to a core technology system – to steal confidential information or plant malware. This might be achieved through targeted “spear phishing” emails with a deepfake video attached.
Other deepfake risks...Many companies are also vulnerable to extortion from AI fabricated incriminating content, brand misuse, potentially leading to legal liabilities, fines, loss of trust and business. Remote hiring practices could open the door for either criminals or under-qualified candidates, using deepfakes to give synthetic identities a convincing face and voice – even going so far as to conduct interviews.
Hundreds of the nation’s smartest computer scientists gathered for a conference in Denver last fall, and Tuan Tran had a big test for them:
Could they tell the difference between the real Brad Pitt and an AI-generated version of him?
Tran, a doctoral candidate in computer science at CU Boulder, rolled the tape on a large projector. Only half of the audience could spot the deepfake.
“These deepfake generating models are becoming very strong,” Tran said.
To address this, Tran and a team of researchers at CU Boulder set out last year to build their own system for spotting fakes in video. It uses far less computing power to achieve the same results as the current detection models.
Their findings were presented at SIGCOMM, a flagship conference in computer networking and systems held in August in Denver.
Bad actors have used AI-generated deepfakes to impersonate financial officers at major companies and convince employees to wire large amounts of money. One such deepfake scam in Hong Kong resulted in someone wiring $25 million to fraudsters.
Millions of people remain vulnerable to such trickery when they hop onto video conferencing calls. Tran said Zoom, Apple FaceTime and Google Meet lack real-time deepfake detection. Microsoft Teams does too but the company recently announced an effort to start providing it.
The commercially-available systems designed to flag imposters require a massive amount of computing power, making them hard to scale and too expensive for most users.
Tran’s team set out to determine whether deepfake detection could be simplified enough to bring to the masses.
“Some people thought this was impossible because of the system requirements and current architecture,” said Sangtae Ha, a computer science professor at CU Boulder who co-led the research team. “But by looking into the system from another perspective, you can actually solve the problem.”
Problem pixels...The team spent many hours in front of a whiteboard deep inside CU’s engineering center trying to crack the code and figure out a way to simplify deepfake detection. Sometimes they wouldn’t go home until 1 a.m.
They worked through fall break, Christmas and even the New Year.
“The experience itself was very joyful, even when it was intense,” said Shirin Ebadi, a doctoral candidate in electrical and computer engineering, and a co-author. ”The most exciting part is doing something that’s never been done.”
She said existing deepfake detectors work well, but they need to see the actual picture to work. Video travels the Internet in compressed form, so before a detector can examine a face, it has to reconstruct every frame of every participant's video at full resolution.
That takes a lot of computing power...The researchers discovered they didn’t need to reconstruct the video at all to spot deepfakes. The clues were already sitting in the compressed form of the video that travels over the network.
Imagine a video clip of a person speaking in front of a plain wall. Video compression doesn’t send every pixel of every frame. Instead, it describes the changes that occurred since the frame before.
The wall barely changes in the video, so it’s covered by a few large blocks of pixels, while the face and its shifting expressions are carved into many smaller blocks to capture the detail.
When someone's appearance changes abruptly, a compressor has to write down a lot of new information. The team measured how much of that new information lands on someone’s face and how widely it's spread.
Crucially, the method reads these numbers directly from the compressed video without ever decompressing it to a higher resolution. Only when something looks suspicious does the detector ask the sender's device for a complete, fresh frame and use AI to check for a deepfake.
"We only had to look at data from one out of every hundred frames, instead of every frame," Ha said.
Scaling up...The team demonstrated that the detection system could spot deepfakes using 143 times less computing power than the existing models. They tested it on a library of 1,000 online videos containing deepfakes, and reported near-perfect accuracy.
Eric Keller, an electrical and computer engineering professor at CU Boulder and a co-leader of the project, said the team wants to adapt the detection system so it can be scaled up and used for large-scale video conferencing.
The team is betting that as deepfakes become a bigger problem, the demand for new detection technology will only grow.
Researchers at the University of Colorado Boulder (CU Boulder) developed a lightweight deepfake detection system that analyzes compressed video data directly without needing to deconstruct or reconstruct full video frames.
How the new method works:
• No full reconstruction: Traditional detectors must decode and rebuild every frame at full resolution to examine a face, which requires massive computing power.
• Reading compression clues: The CU Boulder team realized they could read clues directly from the compressed data blocks (like MPEG or similar formats) already moving across the network.
• Tracking facial changes: Video compression uses small blocks of pixels for fast-moving or expressive areas like a face, and larger blocks for static areas like a plain wall. The system measures how much new compression data lands on a person's face and how it spreads.
• Targeted verification: Instead of checking every single frame, the system only looks at data from roughly 1 out of every 100 frames. It only requests a full, fresh frame to run deeper AI checks if something looks suspicious.
Key results and advantages:
• Lower compute load: The method uses 143 times less computing power than standard models.
• High accuracy: In tests on a library of 1,000 online videos containing deepfakes, the system achieved near-perfect accuracy.
• Scalability: Researchers aim to scale up the technology for real-time, large-scale video conferencing.
Details on the research were presented at the SIGCOMM computer networking and systems conference. You can read the university's announcement on the CU Boulder Today portal.








