Entry Details

About the Entry

Category: 
All Content > Enterprise News Story > New England

Title of entry: 
Vendors struggle to prevent GenAI use in child sexual abuse

Issue or Publication date:
6/24/2024

Publication name: 
SearchEnterpriseAI

View Website home page:
https://www.techtarget.com/searchenterpriseai/

Links to entry URLs

Please note: These URLs are only required for entries in the Online division categories, or digital entries in appropriate Overall Excellence, Design or All Content division categories.

Entry URL(s), if applicable:
Please enter a URL that will direct judges to the entry: 
https://www.techtarget.com/searchenterpriseai/news/366587573/Vendors-struggle-to-prevent-GenAI-use-in-child-sexual-abuse

Entry Essay: 
The audience for TechTarget’s enterprise AI coverage includes executives who use AI and want to learn more about the technology. The audience also includes executives concerned with the regulatory and ethical aspects of AI. In addition, our readers include developers and engineers looking for new information to help them do their jobs better and IT experts who work with AI.
This story, “Vendors struggle to prevent GenAI use in child sexual abuse,” examines in considerable detail the efforts of generative AI companies to prevent and limit the ability of bad actors to misuse the technology in particularly harmful ways.
While the advent of the internet amplified the ability of criminals to distribute child sexual abuse materials, generative AI systems can create realistic-looking images, modify unharmful images to make them harmful, and easily spread information about how to produce harmful content. Going beyond just reporting on what is a terrible technological threat to children, the story examines potential problems in enforcing the safety guidelines that the major generative AI vendors have agreed to, and in holding the companies accountable. It also looks at gaps in what generative AI developers have done to safeguard the technology.
The story quotes a wide array of sources, including executives from the AI vendors, academic experts and observers, and the leader of a nonprofit group working to stop the spread of AI-generated images of child sexual abuse and other materials. The accompanying graphic clearly breaks down the principles and standards that the AI companies and two leading nonprofit groups in this area developed to attack an insidious social problem.