Deepfake technology was always dangerous, then AI came along

As deepfake technology becomes increasingly sophisticated, it poses significant risks, particularly in politics with high-profile state elections in India and the US presidential election.

Deepfakes is a technology used to perfectly superimpose one person’s face over another in a video to spread misinformation. Given the potential to manipulate public opinion and incite unrest, experts urge proactive measures to combat this evolving threat.

In a recent conversation with CNBC-TV18, Sundar Balasubramanian, Managing Director, India and SAARC, Check Point Software, emphasized the urgency of tackling deepfakes, especially during the election season. “Deepfakes can significantly influence political opinions and we must be vigilant to identify them early,” he said.

Deepfakes are AI-generated media that create hyper-realistic but fake content, often used for malicious purposes.

Also read: Deepfake scams challenge Cybersecurity Awareness Month: a call for reassessment

Know deepfakes

• Understanding deepfakes: Deepfakes are AI-generated media that create hyper-realistic but fake content, often used for malicious purposes, including scams and misinformation.
• Proactive detection: Current technology struggles to identify the origins of deepfakes. However, early detection is crucial. Users can verify authenticity by observing inconsistencies in videos, such as unnatural movements or mismatched audio.
• Government response: Governments are beginning to recognize the threat of deepfakes, implementing regulations that require the removal of harmful content within a set timeframe to mitigate potential harm.
• Public awareness: Educating the public about deepfakes is vital. People should be encouraged to critically evaluate videos before sharing them, especially those that appear inflammatory or sensational.
• Cybersecurity measures: Using two-factor authentication and staying alert against phishing attempts can help protect personal data and prevent hackers from creating deepfakes.
• Technological Solutions: While no technology alone can completely prevent deepfakes, continued advances can lead to better detection tools to more effectively authenticate videos.
• Community participation: Collaboration between technology companies, governments and the public is essential to combat deepfake threats and ensure a safer digital environment.

Also read: Be careful! Elon Musk’s deepfake livestream scams thousands with fake crypto scheme

“Most of the attacks we see are deepfake videos and, although technology has advanced, we still have a hard time identifying their origins,” Sundar explained. He highlighted the importance of early detection, noting: “The sooner we can identify a deepfake, the better we can mitigate its impact.”

Governments are beginning to recognize the threat posed by deepfakes. Sundar noted: “Regulations are being implemented that require the removal of harmful content within a specific time period. “This is a step in the right direction.” However, he warned that damage can be done quickly even with these measures. “In many cases, a video can spread like wildfire before being removed, potentially inciting violence or unrest.”

Public awareness is crucial to combating deepfakes. “It is essential to educate citizens about the signs of deepfakes,” Sundar said. “People need to be encouraged to critically evaluate videos before sharing them, especially those that appear inflammatory.” He also advocated for strong cybersecurity measures, saying, “Using two-factor authentication and staying alert against phishing attempts can help protect personal data.”

Also read: Fake accounts related to US elections proliferate on X: study

Recently, CloudSEK, a contextual AI company that predicts cyber threats, discovered a deepfake video scam targeting users in several countries, including India and Nigeria. Scammers are using doctored videos featuring celebrities such as Virat Kohli and YouTuber Mr Beast to promote a fraudulent mobile gaming app called Aviator, which promises high financial returns with minimal investments.

The scheme employs fake news broadcasts to enhance credibility and uses phishing links that mimic the Google Play Store. More than 1,000 phishing domains are created daily, primarily hosted in Belize.

CloudSEK said the free deepfake detection tool has been crucial in identifying these deceptive campaigns and protecting users from potential scams.

While no technology can completely prevent deepfakes, Sundar remains hopeful about future advances. “Ongoing developments may lead to better detection tools that can authenticate videos more effectively,” he said.

Ultimately, Sundar believes a collaborative approach is necessary. “It is essential that technology companies, governments and the public work together to combat deepfake threats and ensure a safer digital environment,” he said.

Also read: 1 in 4 Indians encounter political deepfakes: report