Update 28 March 2025: OpenAi temporarily caps image creation due to overwhelming demands on resources. Per OpenAI CEO Sam Altman, “…our GPUs are melting.”
The recent addition of an image generator to OpenAI’s ChatGPT has led to an explosion of AI-generated images circulating across social media. Users are pushing the boundaries of creativity, with results ranging from whimsical animations to highly controversial and disturbing content. While these AI tools hold vast creative potential, the debate about their ethical implications intensifies.
What’s Happening & Why This Matters
Since its launch, OpenAI’s image generator has captivated social media users eager to experiment with its multimodal capabilities. Using ChatGPT’s GPT-4o model, the generator enables users to create realistic images with impressive accuracy. This feature has enabled everything from playful Studio Ghibli-style portraits to unsettling recreations of historical events.
However, the tool’s ability to produce such sensitive and violent images has raised eyebrows. For instance, users could create animated depictions of tragic events, like the death of George Floyd and the Elián González raid, in the style of Studio Ghibli. These images have drawn sharp criticism for their disturbing nature and sparked questions about the moderation of AI-generated content. While OpenAI has implemented safeguards to restrict harmful content, the system’s capacity to generate such images has raised alarms.
This development brings forth a critical conversation about AI’s role in content creation. Social media platforms are flooded with generated images that blur the line between creative art and harmful depictions. As OpenAI CEO Sam Altman acknowledged, the viral use of Studio Ghibli-style images helped market the tool’s launch, but Altman also noted that the company had thought carefully about the content examples it provided initially.

(Credit: Emily Forlini/Openai)
The image generator uses a text-to-image model that can create photorealistic outputs. While this advancement is impressive, it presents challenges. Many users push the tool to its limits, requesting images of public figures or historical events, some of which may not align with ethical standards. Even with moderation policies in place, it’s clear that the potential for misuse is significant.
The controversy surrounding the generator highlights the complexities of using AI for creative purposes. While the tool can produce visually stunning images, its capacity for generating harmful or manipulative content needs careful oversight.
TF Summary: What’s Next
AI-generated images are likely to become a regular part of content creation and social media engagement. As these tools spread, the focus will include implementing more robust safeguards to ensure that AI is used ethically and responsibly. OpenAI and other organizations must continue to refine moderation systems and explore ways to prevent harmful uses of AI-generated content.
The conversation about AI’s influence on media, especially social media platforms, will undoubtedly continue. While AI can inspire new forms of digital expression, it’s crucial that creators and regulators work together to set boundaries for what can be generated and shared.
— Text-to-Speech (TTS) provided by gspeech