Concerns have been raised over the potential dangers posed by Microsoft’s AI text-to-image generator, Copilot Designer. Shane Jones, a principal software engineering lead at the tech giant, has sent a letter to the US Federal Trade Commission (FTC), outlining troubling issues with the tool.
Jones highlighted what he described as “systemic issues” within Copilot Designer, alleging that it frequently produces offensive or inappropriate images, including sexualized depictions of women. Despite these concerns, Microsoft has continued to market the tool as safe, even for children.
According to Jones, Copilot Designer often generates images containing sexually objectified representations of women in response to innocuous prompts. He claims to have identified over 200 instances of concerning images during his testing of the tool.
In light of these findings, Jones has called on the FTC to intervene, urging the removal of Copilot Designer from public use until more robust safeguards can be implemented. Alternatively, he suggested that the tool’s marketing be restricted to adults only.
These revelations come amid growing concerns about the misuse of AI-generated content. Recent incidents, such as the spread of pornographic AI-generated images of celebrities on social media, have underscored the need for greater oversight and regulation in this space.
Jones also called on Microsoft’s board of directors to conduct investigations into the company’s marketing practices concerning AI products with significant public safety risks. He emphasized the importance of transparency and responsible reporting in addressing these concerns, particularly when children are involved.
In addition to his letter to the FTC, Jones revealed that he had raised similar concerns with Washington Attorney General Bob Ferguson and lawmakers. However, he expressed frustration at the lack of action taken by Microsoft’s legal department in addressing these issues.
This is not the first time Jones has spoken out about the potential risks associated with AI technologies. He previously published an open letter to OpenAI’s board of directors, highlighting vulnerabilities in DALL-E 3, the technology underlying Copilot Designer. Jones warned that these vulnerabilities could pose a threat to children’s mental health.
As discussions around AI ethics and accountability continue to gain traction, stakeholders are calling for greater scrutiny and transparency in the development and deployment of AI technologies. With AI becoming increasingly integrated into our daily lives, ensuring its responsible and ethical use is paramount in safeguarding against potential harms.