Canada’s Privacy Commissioner has found that xAI’s Grok chatbot and its parent company X Corp. violated federal privacy law by launching an AI image-generation tool without adequate safeguards, enabling the creation and distribution of non-consensual sexualised deepfakes.
In a report released on Thursday (11 June), Privacy Commissioner Philippe Dufresne said the investigation (initiated in January) found that the system lacked sufficient protections to prevent misuse, resulting in the generation of millions of harmful images targeting women and children.
The Office of the Privacy Commissioner of Canada said the case highlights serious privacy risks linked to emerging AI technologies and the need for stronger regulatory safeguards at the design stage of such tools.
The investigation concluded that the Grok image-generation feature was deployed without proper risk assessment or sufficient technical controls to prevent exploitation.
According to the report, users worldwide were able to create and circulate sexualised deepfakes without consent, raising significant concerns about privacy violations and online harm.
The commissioner found that both X Corp. and xAI breached Canada’s federal private-sector privacy law, marking one of the most high-profile regulatory actions yet involving generative AI systems.
Following public scrutiny and during the investigation, the companies introduced additional safeguards, including detection systems aimed at identifying and removing abusive content, as well as new restrictions intended to reduce misuse.
While acknowledging the remedial steps taken, the Privacy Commissioner said further improvements are required and called for ongoing independent audits and quarterly reporting to demonstrate effectiveness in preventing harm.
The companies have committed to submitting regular compliance reports until issues involving sexualised deepfakes are fully resolved, according to the regulator.
The Office of the Privacy Commissioner said it will continue monitoring implementation of these measures to ensure compliance with Canadian privacy law.
Commissioner Dufresne said the case underscores the urgent need to modernise Canada’s federal privacy framework, arguing that current legislation does not provide sufficient enforcement powers, including the ability to issue binding orders or impose meaningful financial penalties.
He has also recommended introducing stronger “privacy by design” obligations and mandatory privacy impact assessments for high-risk AI systems.
The Canadian government has recently introduced legislation aimed at strengthening online safety rules for AI chatbot services and social media platforms, which the commissioner welcomed as a step toward improving protections for users, particularly minors.
The findings add to growing global scrutiny of generative AI systems and their potential misuse in creating non-consensual synthetic content.
The European Union is preparing to boost investment in Greenland, as Brussels moves to deepen political and economic ties with the Arctic territory...
Operations at several energy facilities in Saudi Arabia were suspended on Tuesday after attacks by Iran-aligned Houthi forces injured more than 70 ...
Saudi Arabia is now facing pressure from both ends of the Arabian Peninsula. While the crisis around the Strait of Hormuz is disrupting Gulf shippi...
At least five people were killed and five others injured when an Amazon Prime Air cargo plane overran a runway and crashed while landing at Miami International Airport on Sunday, 6 September, local officials said.
Iranian Parliament Speaker Mohammad Bagher Ghalibaf said on Sunday that the United States must recognise that the “rules of the game” in its war against Iran had changed “before it is too late”, a day after Washington struck several Iranian tankers in the Gulf.
U.S. special envoys Jared Kushner and Steve Witkoff have held talks with Ukrainian President Volodymyr Zelenskyy in Kyiv on Sunday on efforts to end Russia’s war in Ukraine.
Seven Indonesian airports, including two serving Jakarta, remained closed early on Monday morning because of volcanic ash from eruptions at Mount Anak Krakatau, the transport minister said. One other airport in South Sumatra has been reopened.
Germany's far-right Alternative for Germany (AfD) has scored a historic victory in Saxony-Anhalt, emerging as the strongest party in the eastern state and putting it closer than ever to forming a regional government.
Russia and Ukraine exchanged attacks overnight. At least two people were killed in strikes on Kyiv, the Ukrainian capital's Military Administration said. Meanwhile, drones hit civilian infrastructure in Russia's southwestern Saratov region, Governor Roman Busargin said.
Start your day informed with the AnewZ Morning Brief. Here are the top stories for the 8th of September, covering the latest developments.
North Korea and Russia have opened their first road bridge, further strengthening ties between the two countries as they deepen their strategic partnership.
Indonesia has reopened Jakarta's main airport and four others after volcanic ash from Mount Anak Krakatau forced widespread flight cancellations, though fresh eruptions have kept authorities on alert.
U.S. President Donald Trump has said aircraft produced by Canadian manufacturer Bombardier should no longer be sold in the United States, intensifying a growing trade dispute between Washington and Ottawa.
You can download the AnewZ application from Play Store and the App Store.
What is your opinion on this topic?
Leave the first comment