Canada’s Privacy Commissioner has found that xAI’s Grok chatbot and its parent company X Corp. violated federal privacy law by launching an AI image-generation tool without adequate safeguards, enabling the creation and distribution of non-consensual sexualised deepfakes.
In a report released on Thursday (11 June), Privacy Commissioner Philippe Dufresne said the investigation (initiated in January) found that the system lacked sufficient protections to prevent misuse, resulting in the generation of millions of harmful images targeting women and children.
The Office of the Privacy Commissioner of Canada said the case highlights serious privacy risks linked to emerging AI technologies and the need for stronger regulatory safeguards at the design stage of such tools.
The investigation concluded that the Grok image-generation feature was deployed without proper risk assessment or sufficient technical controls to prevent exploitation.
According to the report, users worldwide were able to create and circulate sexualised deepfakes without consent, raising significant concerns about privacy violations and online harm.
The commissioner found that both X Corp. and xAI breached Canada’s federal private-sector privacy law, marking one of the most high-profile regulatory actions yet involving generative AI systems.
Following public scrutiny and during the investigation, the companies introduced additional safeguards, including detection systems aimed at identifying and removing abusive content, as well as new restrictions intended to reduce misuse.
While acknowledging the remedial steps taken, the Privacy Commissioner said further improvements are required and called for ongoing independent audits and quarterly reporting to demonstrate effectiveness in preventing harm.
The companies have committed to submitting regular compliance reports until issues involving sexualised deepfakes are fully resolved, according to the regulator.
The Office of the Privacy Commissioner said it will continue monitoring implementation of these measures to ensure compliance with Canadian privacy law.
Commissioner Dufresne said the case underscores the urgent need to modernise Canada’s federal privacy framework, arguing that current legislation does not provide sufficient enforcement powers, including the ability to issue binding orders or impose meaningful financial penalties.
He has also recommended introducing stronger “privacy by design” obligations and mandatory privacy impact assessments for high-risk AI systems.
The Canadian government has recently introduced legislation aimed at strengthening online safety rules for AI chatbot services and social media platforms, which the commissioner welcomed as a step toward improving protections for users, particularly minors.
The findings add to growing global scrutiny of generative AI systems and their potential misuse in creating non-consensual synthetic content.
Iran and the U.S. have concluded indirect talks in Doha without a major breakthrough, with discussions focused on maritime traffic in the Strait of Ho...
A Russian couple climbed to the top of the Empire State Building and unfurled a banner urging world peace before, in an apparent elaborate marriage p...
Israeli lawmakers have approved a bill that would ban the Muslim call to prayer (adhan) from being broadcast through mosque loudspeakers, according to...
England captain Harry Kane scored twice and Belgium beat Senegal with a last-minute penalty as both sides joined the United States in the last 16 of t...
A breakaway Catholic group dedicated to preserving the traditional Latin Mass has ordained four new bishops in Switzerland, despite a direct appeal fr...
Iran and the U.S. have concluded indirect talks in Doha without a major breakthrough, with discussions focused on maritime traffic in the Strait of Hormuz and frozen Iranian funds. Both sides are expected to meet again after the funeral of Ayatollah Ali Khamenei.
A Russian couple climbed to the top of the Empire State Building and unfurled a banner urging world peace before, in an apparent elaborate marriage proposal that ended with their arrests.
Israeli lawmakers have approved a bill that would ban the Muslim call to prayer (adhan) from being broadcast through mosque loudspeakers, according to local media.
England captain Harry Kane scored twice and Belgium beat Senegal with a last-minute penalty as both sides joined the United States in the last 16 of the World Cup.
Iranian and U.S. negotiating teams were due in Doha this week, but Iran said on Monday no meeting had been scheduled as weekend missile fire from both sides tested the interim ceasefire to end the four-month-old war.
Negotiations between the U.S. and Iran mediated by Qatar in Doha have concluded, Iran's Deputy Foreign Minister, Kazem Gharibabadi has said.
Mexico ended their 40-year wait for a World Cup knockout win, while Erling Haaland sent Norway through and Kylian Mbappé fired France into the last 16.
The wife and children of Argentine footballer Lucas Trejo were among around 1,700 people who died when two earthquakes struck northern Venezuela last week.
The latest AnewZ investigative documentary examines how Emmanuel Macron’s promise to break with France’s old political habits collided with diplomatic setbacks in Africa and legal fallout surrounding figures once close to the Élysée.
A Russian couple climbed to the top of the Empire State Building and unfurled a banner urging world peace before, in an apparent elaborate marriage proposal that ended with their arrests.
A breakaway Catholic group dedicated to preserving the traditional Latin Mass has ordained four new bishops in Switzerland, despite a direct appeal from Pope Leo XIV to halt the ceremony.
A California man has filed a lawsuit against OpenAI and its Chief Executive, Sam Altman, alleging that conversations with the company's ChatGPT chatbot worsened his bipolar disorder and contributed to a suicide attempt.
The United States has designated the Ecuadorian criminal group Chone Killers as a Foreign Terrorist Organization (FTO), imposing sanctions on a gang Washington says is responsible for attacks on civilians, police officers and public officials.
China's Foreign Minister Wang Yi is visiting Denmark, Sweden, Finland and Norway this week in a landmark tour of the Nordic region that reflects Beijing's efforts to strengthen ties with Europe at a time of growing geopolitical uncertainty.
You can download the AnewZ application from Play Store and the App Store.
What is your opinion on this topic?
Leave the first comment