HomeArtificial IntelligenceMicrosoft engineer points to AI tool for generating violent and explicit content

Microsoft engineer points to AI tool for generating violent and explicit content

March 8, 2024: In a remarkable revelation Shane Jones, A Microsoft engineer who has worked for the corporate for six years has raised concerns in regards to the AI ​​image generator Copilot Designer.

During his personal investigations, Jones discovered the tool's potential to create images of a violent and sexual nature, in addition to to violate copyright laws.

Although Microsoft places value on AI ethics, these findings contradict the declared principles of the corporate.

Jones' journey to the core of this problem began in December when he red-teamed the Copilot Designer tool and tested it for vulnerabilities.

His findings were disturbing, revealing the AI's ability to supply disturbing content, including sexualized and violent imagery. Jones promptly reported these issues to Microsoft, but found the response to be poor. To gain wider attention, he escalated the matter to the FTC and Microsoft's board of directors, and shared his concerns publicly.

Built on OpenAI technology, Copilot Designer is designed to remodel text prompts into images, encouraging creative freedom.

However, Jones' experience suggests that there are significant shortcomings within the tool's ethical and security measures.

He discovered content that was in stark contrast to the Responsible Artificial Intelligence guidelines, including depictions of underage drug use, explicit sexual images, and copyrighted characters in compromising contexts.

Despite Jones' efforts to lift these risks internally and his proposal to temporarily remove Copilot Designer from public access, Microsoft has not taken any significant motion so far.

The company's stance, the report says, indicates established internal channels for addressing such concerns, however the effectiveness of those mechanisms is now being questioned.

Jones' findings and subsequent public letters underscore growing concerns in regards to the ethical limits of AI technology. As AI continues to advance at a rapid pace, the balance between innovation and ethical responsibility is becoming increasingly precarious.

Do you’re thinking that the photographs generated by Copilot above are inappropriate? Comment below to share your thoughts.

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Must Read