Auto Amazon Links: No products found. Blocked by captcha.
Following an investigation by the BBC, TikTok has removed 20 accounts that utilized AI-generated black female influencer personas to steer users towards sexually explicit websites. This phenomenon is part of a wider, concerning pattern seen on Instagram and TikTok, where AI-created avatars depict highly sexualized black women in ways that have been criticized for perpetuating racial stereotypes and exploitative narratives. These accounts often use language and imagery considered misleading and racially insensitive.
Researchers from the independent AI-focused publication Riddance assisted the BBC in uncovering dozens of such profiles on these platforms. Most of the accounts were found on Instagram, with approximately a third also maintaining TikTok versions. The AI-generated images and videos were not disclosed as artificial, thereby violating platform guidelines. The characters typically appear in revealing swimwear or similarly scant clothing, frequently with exaggerated and unrealistic body proportions. Additionally, some avatars have strikingly dark skin tones that appear digitally altered, emphasizing their artificial nature.
A particularly troubling example involves an account that incorporated stolen videos from Malaysian model Riya Ulan. This TikTok account, which had amassed around three million followers shortly after its December launch, superimposed an AI-generated face with an unnaturally dark skin tone onto video clips of Riya’s body, accurately replicating her movements, attire, and background. Riya expressed her frustration, stating, “I was angry… It doesn’t mean that you can just take it and steal it and post it as your own.” While the stolen videos themselves were not sexual in nature, the account also posted other content featuring the same avatar in provocative clothing and accompanied links directing followers to paid adult sites. Despite multiple reports from Riya, the account remained active on Instagram for a time, with TikTok finally banning it only after the BBC’s inquiry.
Experts highlight the damaging nature of these accounts. Angel Nulani, a researcher involved in the study, described them as racist, pointing out that “their use of caricatures, race-play terminology and unrealistic depictions of black women prove they’re not concerned with our safety or wellbeing, but our ability to be capitalised as part of the online porn machine.” Jeremy Carrasco, a critic of AI tools in social media, noted the new scale of overtly racist depictions made possible through AI technology, explaining that AI facilitates the creation of unnaturally dark skin tones and associated effects with no social consequences, since avatars bear no personal accountability. Content creator Houda Fonone emphasized that this trend contributes to the erasure of authentic black experiences, warning that “silky hair, extremely thin bodies and impossibly flawless skin… it’s as if black beauty can only be accepted when ‘refined’,” risking reinforcement of stereotypes while replacing genuine narratives with artificial images.
In response to the BBC’s findings and inquiries, TikTok announced it had removed the offending content and banned rule-violating accounts, affirming its zero tolerance policy toward AI-generated content used without consent, especially when linked to sexual services. The company also clarified its requirement for proper labeling of AI-generated material. Meta, Instagram’s parent company, confirmed it was investigating the issue and reiterated its commitment to transparency when AI is involved in content creation, noting that some investigated accounts had disappeared. However, neither platform provided specifics on their handling of Riya Ulan’s repeated reports prior to the public spotlight
Read the full article from The BBC here: Read More
Auto Amazon Links: No products found. Blocked by captcha.