Friday, 14 June 2024

Tenable warns of deepfakes and romance scams

5 min read

In recent years, romance scams have undergone a chilling transformation, merging traditional tactics with advanced technologies like generative AI and deepfakes.

As reported by various media outlets, there has been a rapid rise in love-related scams in Southeast Asia over the past few years. It was recently reported that Indonesia had arrested 88 Chinese nationals for their involvement in a cross-border telephone and online romance scam syndicate. In Singapore, it was reported that in the first six months of 2023, SGD 25.9 million ($19.2 million) was lost to love scams.

Tenable, the Exposure Management company, sheds light on the romance scams likely to take place in 2024, revealing the sinister ways scammers will exploit vulnerable individuals.

Over the past few years, romance scams have predominantly relied on traditional methods, incorporating a layer of generative AI and deepfaking techniques. The exploitation of vulnerable individuals has intensified through the use of original and edited videos, audio manipulations, and face-tracking webcam tools, all geared towards financial gain. This evolution includes the alarming rise of sextortion and digitally altered images, as scammers employ deepfaking to blackmail victims by threatening to expose explicit content featuring their likenesses.

Scammers are now leveraging generative AI and deepfake technologies to create more convincing personas in romance scams. Celebrity impersonations, particularly targeting older demographics, have become widespread. Online tools and tutorials make it easy for scammers to map celebrity likenesses onto their webcams, blurring the lines between reality and deception. These scams often originate on platforms like Facebook, tricking victims into a false sense of security.

A troubling trend emerging is one where scammers routinely target older individuals, especially those who are widowed or suffer from memory loss. They initiate conversations, gauging the victim's familiarity with technology before employing pre-recorded videos or live interactions. Notable cases include a Facebook romance scam where a deepfake Mark Ruffalo was used to swindle an elderly artist out of half a million dollars.

In the realm of online relationships, requests for money from newfound connections should sound immediate alarm bells. It's crucial to scrutinise photographs and videos that deliberately conceal background details, hindering online verification.

Chris Boyd, staff research engineer at Tenable said: “I strongly advocate for heightened vigilance when coerced away from established platforms into private conversations, where the protective layers of the initial site are forfeited. Regardless of the involvement of generative AI or deepfakes, the watchword is caution.”

“While social media platforms may lack explicit guidance on romance scams, I urge users to report any suspicious activities using the available reporting tools. Awareness and vigilance are our best defences against these heartless manipulations, ensuring that love seekers don't fall victim to the tangled web of AI-enhanced deception."

Re-disseminated by The Asian Banker

Attend Our Next Events
Finance Vietnam 2024
18 July 2024
Finance Thailand 2024
25 July 2024
Finance Philippines 2024
07 August 2024