Canada’s Privacy Commissioner has found that xAI’s Grok chatbot and its parent company X Corp. violated federal privacy law by launching an AI image-generation tool without adequate safeguards, enabling the creation and distribution of non-consensual sexualised deepfakes.
In a report released on Thursday (11 June), Privacy Commissioner Philippe Dufresne said the investigation (initiated in January) found that the system lacked sufficient protections to prevent misuse, resulting in the generation of millions of harmful images targeting women and children.
The Office of the Privacy Commissioner of Canada said the case highlights serious privacy risks linked to emerging AI technologies and the need for stronger regulatory safeguards at the design stage of such tools.
The investigation concluded that the Grok image-generation feature was deployed without proper risk assessment or sufficient technical controls to prevent exploitation.
According to the report, users worldwide were able to create and circulate sexualised deepfakes without consent, raising significant concerns about privacy violations and online harm.
The commissioner found that both X Corp. and xAI breached Canada’s federal private-sector privacy law, marking one of the most high-profile regulatory actions yet involving generative AI systems.
Following public scrutiny and during the investigation, the companies introduced additional safeguards, including detection systems aimed at identifying and removing abusive content, as well as new restrictions intended to reduce misuse.
While acknowledging the remedial steps taken, the Privacy Commissioner said further improvements are required and called for ongoing independent audits and quarterly reporting to demonstrate effectiveness in preventing harm.
The companies have committed to submitting regular compliance reports until issues involving sexualised deepfakes are fully resolved, according to the regulator.
The Office of the Privacy Commissioner said it will continue monitoring implementation of these measures to ensure compliance with Canadian privacy law.
Commissioner Dufresne said the case underscores the urgent need to modernise Canada’s federal privacy framework, arguing that current legislation does not provide sufficient enforcement powers, including the ability to issue binding orders or impose meaningful financial penalties.
He has also recommended introducing stronger “privacy by design” obligations and mandatory privacy impact assessments for high-risk AI systems.
The Canadian government has recently introduced legislation aimed at strengthening online safety rules for AI chatbot services and social media platforms, which the commissioner welcomed as a step toward improving protections for users, particularly minors.
The findings add to growing global scrutiny of generative AI systems and their potential misuse in creating non-consensual synthetic content.
Saudi Foreign Minister Prince Faisal bin Farhan has arrived in Washington for talks with U.S. Secretary of State Marco Rubio on bilateral ties and ...
A Russian guided aerial bomb has struck an apartment building in Kharkiv, injuring 22 people, including children, according to the city’...
A decade ago, a far-right party winning a major Western European election would have caused a political shock. Today, such results are increasingly...
Iran has called for a diplomatic solution after U.S. President Donald Trump rejected its Hormuz proposal, while Foreign Minister Abbas Araghchi said Tehran was awaiting a definitive U.S. response through mediators.
A Russian guided aerial bomb has struck an apartment building in Kharkiv, injuring 22 people, including children, according to the city’s mayor. The strike follows a day of near-continuous Russian attacks across Ukraine that killed at least five people.
British police have arrested five men on suspicion of offences under the Explosives Act after a major security incident was declared near RAF Fairford, a British air base used by U.S. air forces in Gloucestershire, England.
Six people have died after a two-storey residential building in a tourist area of central Athens collapsed, the Greek fire brigade said on Saturday (26 September), following an explosion that the mayor said was likely linked to gas infrastructure.
Serbia's President Aleksandar Vučić resigned on Sunday, ending his second and final five-year term and paving the way for an early presidential election as the country prepares for a snap parliamentary vote on 25 October.
A decade ago, a far-right party winning a major Western European election would have caused a political shock. Today, such results are increasingly becoming part of Europe’s political landscape.
A Russian guided aerial bomb has struck an apartment building in Kharkiv, injuring 22 people, including children, according to the city’s mayor. The strike follows a day of near-continuous Russian attacks across Ukraine that killed at least five people.
France’s far-right National Rally (RN) and its ally, the Union of the Right for the Republic (UDR), have won enough seats to form a group in the Senate for the first time, marking a breakthrough for the party ahead of the 2027 presidential election.
Pope Leo has renewed his pledge to tackle abuse within the Catholic Church after privately meeting survivors of clergy abuse during his visit to France.
Swiss voters have overwhelmingly rejected stricter neutrality rules that would have limited the country’s ability to impose sanctions and cooperate with NATO, with more than 70 per cent voting against the proposal.
You can download the AnewZ application from Play Store and the App Store.
What is your opinion on this topic?
Leave the first comment