gen‑ai.news
← Back
Image

OpenAI wants to stop deepfakes from overwhelming child abuse tiplines

OpenAI wants to stop deepfakes from overwhelming child abuse tiplines

OpenAI announced a new classifier aimed at helping investigators sift through child sexual abuse material (CSAM) more effectively, with a particular focus on identifying AI-generated imagery. The announcement was made at a press briefing in Washington, DC, and positions the tool as a way to reduce the volume of noise that tiplines and investigators must wade through before they can act on credible material.

The classifier is designed to distinguish between real and synthetically generated abusive imagery of children - a distinction that has become increasingly important as generative AI tools lower the barrier to producing such content at scale. Law enforcement and nonprofit organizations that handle these investigations have reported growing difficulty keeping up with the volume of reported material, and the ability to quickly flag or filter AI-generated content could help prioritize cases involving real victims.

OpenAI says it will offer free access to the classifier for organizations that go through a vetting process, and it is also releasing additional guidance for developers on how to detect this category of content within their own platforms. The company has indicated it will assist in training law enforcement on how AI-based tools can support, rather than replace, existing investigative workflows.

The announcement arrives at a moment of heightened scrutiny for AI developers. Policymakers have been pressing companies like OpenAI to demonstrate that their technologies are not making harmful content easier to produce or distribute. By offering tools specifically designed to aid detection and investigation, OpenAI is signaling a more proactive posture on child safety - though how widely the classifier is adopted, and how well it performs across different types of synthetic imagery, will determine its practical impact over time.

Enjoy this story? Get the next one in your inbox.

Twice a week: the most important stories in generative image and video AI, distilled into a 2-minute read.

Free. Unsubscribe any time. No spam, ever.

Your next read

Apple is testing daily usage limits for more complex Siri AI interactions
Image

Apple is testing daily usage limits for more complex Siri AI interactions

Apple is testing daily usage limits on more advanced Siri and Apple Intelligence features in the latest developer betas of iOS, iPadOS, and macOS 27.3. Cloud-dependent tasks like image generation and multi-step personal requests would be capped, while basic Siri commands remain free and unlimited. The move signals a possible shift toward tiered access for computationally intensive AI features.

You can now generate and edit GIFs with ChatGPT - here's how
Image

You can now generate and edit GIFs with ChatGPT - here's how

OpenAI has added GIF generation and editing to ChatGPT, giving users a way to create short animated images directly within the chat interface. The feature expands on the platform's existing image capabilities, extending them into the animated format. Here is what you need to know to get started.

Maket launches floor and wall textures from text or images
Image

Maket launches floor and wall textures from text or images

Maket, an AI-assisted architectural design tool, has added the ability to generate floor and wall textures directly from text prompts or reference images. The feature gives designers a faster way to explore material options within their existing workflow. It represents a natural expansion of Maket's generative toolset into the domain of surface and finish design.