A woman becomes a victim after her likeness is used without consent in a fake online persona, sparking calls for stricter regulations.
**Deepfake Incident Raises Alarms Over AI Misuse in India**
**Deepfake Incident Raises Alarms Over AI Misuse in India**
An incident in India highlights the perils of AI-generated content and identity theft.
In a distressing turn of events, an Indian woman discovered that her identity had been hijacked for an explicit online persona. Sanchi, a homemaker from Dibrugarh, Assam, unknowingly became the face of a fake Instagram account named Babydoll Archi, which leveraged deepfake technology to create a sensation online. Initially crafted by her ex-boyfriend, Pratim Bora—a mechanical engineer with an interest in artificial intelligence—this digital impersonation spiraled quickly into a massive following of 1.4 million users, thanks to viral posts showcasing an alluring dance in a red sari and other provocative content.
Bora's malicious intent became evident after Sanchi's brother lodged a police report, leading to the arrest of Bora for creating the account as a personal vendetta post-breakup. Despite the immediate popularity of Babydoll Archi since its inception in May 2021, police had to sift through evidence that initially did not lead to direct accusations against Bora. Upon receiving information from Instagram, they established the link and apprehended him, uncovering a scheme where Bora allegedly earned significant profits by monetizing the fake account.
Officials have highlighted that the victim, Sanchi, did not have an online presence, making her completely oblivious to the existence of the fake account until it went viral. Following her ordeal, she and her family have sought counseling, but the emotional toll has been profound. Police took decisive action to seize Bora's devices, which contained evidence of his deceitful operations, as they now pursue multiple charges against him, which could lead to around 10 years in prison if convicted.
Experts and activists are sounding alarms over the implications of such cases, noting that while Sanchi's incident is particularly troubling, it underscores a growing trend of utilizing AI for harmful purposes. Legal specialists suggest that while current laws address various acts of harassment and impersonation, further considerations are necessary to address the rapid advancement of generative AI technologies and the loopholes they may exploit. The case has ignited discussions among lawmakers and advocates, pushing for enhanced legislation to protect individuals from deepfake-related crimes, especially women who are frequently targeted.
Striking a balance between curtailing misuse of technology while protecting free speech remains paramount. As society grapples with the consequences of generative AI, this incident serves as a stark reminder of the urgent need for ethical guidelines and robust regulations to ensure safety and justice in the digital age.
Bora's malicious intent became evident after Sanchi's brother lodged a police report, leading to the arrest of Bora for creating the account as a personal vendetta post-breakup. Despite the immediate popularity of Babydoll Archi since its inception in May 2021, police had to sift through evidence that initially did not lead to direct accusations against Bora. Upon receiving information from Instagram, they established the link and apprehended him, uncovering a scheme where Bora allegedly earned significant profits by monetizing the fake account.
Officials have highlighted that the victim, Sanchi, did not have an online presence, making her completely oblivious to the existence of the fake account until it went viral. Following her ordeal, she and her family have sought counseling, but the emotional toll has been profound. Police took decisive action to seize Bora's devices, which contained evidence of his deceitful operations, as they now pursue multiple charges against him, which could lead to around 10 years in prison if convicted.
Experts and activists are sounding alarms over the implications of such cases, noting that while Sanchi's incident is particularly troubling, it underscores a growing trend of utilizing AI for harmful purposes. Legal specialists suggest that while current laws address various acts of harassment and impersonation, further considerations are necessary to address the rapid advancement of generative AI technologies and the loopholes they may exploit. The case has ignited discussions among lawmakers and advocates, pushing for enhanced legislation to protect individuals from deepfake-related crimes, especially women who are frequently targeted.
Striking a balance between curtailing misuse of technology while protecting free speech remains paramount. As society grapples with the consequences of generative AI, this incident serves as a stark reminder of the urgent need for ethical guidelines and robust regulations to ensure safety and justice in the digital age.
