Microsoft AI engineer raises concerns over image generation tech

A Microsoft AI engineer filed a complaint on March 6 with the Federal Trade Commission about his company’s use of AI, claiming that the Copilot Designer image generator violates copyrights and produces explicitly violent and sexual images, in violation of its purported rules.

Shane Jones, an AI engineering leader at Microsoft who has been at the company for six and a half years, filed the complaint after months of experimentation with the software continued to deliver results that were outside the scope of the technology’s supposed guardrails. A lack of internal response at the company led to him take the problem public.

“There were not very many limits on what that model was capable of,” Jones told CNBC’s Hayden Field. “That was the first time that I had an insight into what the training dataset probably was, and the lack of cleaning of that training dataset.”

In his letter, Jones reported that entering the prompt “teenagers playing assassins with assault rifles” generated “endless images of kids with photorealistic assault rifles.” Using the term “pro-choice” also resulted in violent images. CNBC confirmed that the pictures “included a demon with sharp teeth about to eat an infant, Darth Vader holding a lightsaber next to mutated infants and a handheld drill-like device labeled ‘pro choice’ being used on a fully grown baby.”