A Microsoft Corp (NASDAQ:MSFT) AI engineer has uncovered that the company’s AI image generator, Copilot Designer, has been producing “disturbing” images that violate the tech giant’s responsible AI principles.
What Happened: Shane Jones, a principal software engineering manager at Microsoft, disclosed that the AI tool has been generating images of “demons and monsters,” violent scenes, and underage drinking and drug use, among other concerning content, reported CNBC on Wednesday.
"It was an eye-opening moment," Jones, who continues to test the image generator, said in an interview. "It's when I first realized, wow this is really not a safe model."
Jones, who has been testing the product for vulnerabilities, reported his findings to Microsoft in December. Despite acknowledging the concerns, the company has not taken the product off the market. Jones has since escalated the matter by reaching out to the Federal Trade Commission and Microsoft’s board of directors.
He has also highlighted the potential risks associated with the AI tool, especially in the context of the upcoming elections, which could exacerbate the issue of misinformation online.
"We are committed to addressing any ...