Canada’s Privacy Commissioner has found that xAI’s Grok chatbot and its parent company X Corp. violated federal privacy law by launching an AI image-generation tool without adequate safeguards, enabling the creation and distribution of non-consensual sexualised deepfakes.
In a report released on Thursday (11 June), Privacy Commissioner Philippe Dufresne said the investigation (initiated in January) found that the system lacked sufficient protections to prevent misuse, resulting in the generation of millions of harmful images targeting women and children.
The Office of the Privacy Commissioner of Canada said the case highlights serious privacy risks linked to emerging AI technologies and the need for stronger regulatory safeguards at the design stage of such tools.
The investigation concluded that the Grok image-generation feature was deployed without proper risk assessment or sufficient technical controls to prevent exploitation.
According to the report, users worldwide were able to create and circulate sexualised deepfakes without consent, raising significant concerns about privacy violations and online harm.
The commissioner found that both X Corp. and xAI breached Canada’s federal private-sector privacy law, marking one of the most high-profile regulatory actions yet involving generative AI systems.
Following public scrutiny and during the investigation, the companies introduced additional safeguards, including detection systems aimed at identifying and removing abusive content, as well as new restrictions intended to reduce misuse.
While acknowledging the remedial steps taken, the Privacy Commissioner said further improvements are required and called for ongoing independent audits and quarterly reporting to demonstrate effectiveness in preventing harm.
The companies have committed to submitting regular compliance reports until issues involving sexualised deepfakes are fully resolved, according to the regulator.
The Office of the Privacy Commissioner said it will continue monitoring implementation of these measures to ensure compliance with Canadian privacy law.
Commissioner Dufresne said the case underscores the urgent need to modernise Canada’s federal privacy framework, arguing that current legislation does not provide sufficient enforcement powers, including the ability to issue binding orders or impose meaningful financial penalties.
He has also recommended introducing stronger “privacy by design” obligations and mandatory privacy impact assessments for high-risk AI systems.
The Canadian government has recently introduced legislation aimed at strengthening online safety rules for AI chatbot services and social media platforms, which the commissioner welcomed as a step toward improving protections for users, particularly minors.
The findings add to growing global scrutiny of generative AI systems and their potential misuse in creating non-consensual synthetic content.
Pakistan is pushing for urgent global action and greater climate funding as Prime Minister Shehbaz Sharif attends COP31 in Türkiye, warning th...
Armenia has lost its voting rights and the ability to nominate officials for certain posts within the Russian-led Collective Security Treaty Organi...
Four million workers across Spain joined a general strike on Wednesday over the country’s deepening housing crisis, unions said, bringing dis...
Delegations from Russia, Ukraine and the United States met in Abu Dhabi on Tuesday for their first formal talks in nine months. They did so with no agreement on what a ceasefire would be tied to or who gets to keep the land currently under Russian control.
UN Secretary-General António Guterres delivered a stark warning at this year's COP31 summit, saying the climate crisis iss advancing faster than governments' efforts to contain it.
At least 17 people have been reported killed in an explosion at a steel plant in western Türkiye, after a crane collapsed during maintenance work. The disaster has prompted a criminal investigation into what went wrong at the industrial facility.
Armenia could lose its voting rights within the Collective Security Treaty Organization (CSTO) on 11 November after failing to pay membership fees for more than two years, Russian Foreign Minister Sergey Lavrov has said.
U.S. envoy Jared Kushner said Washington believes the Russian President is prepared to reach a peace agreement under the right conditions, as U.S., Russian and Ukrainian delegations began trilateral talks in Abu Dhabi on Tuesday 10 November.
Four million workers across Spain joined a general strike on Wednesday over the country’s deepening housing crisis, unions said, bringing disruption to factories, ports, shops and public transport just weeks before a snap general election.
Two days of U.S.-brokered talks between Russia and Ukraine in Abu Dhabi have ended with an agreement on a major prisoner exchange, but key disputes over security and territory remain unresolved.
UN Secretary-General António Guterres delivered a stark warning at this year's COP31 summit, saying the climate crisis iss advancing faster than governments' efforts to contain it.
Iran has unveiled a new underground missile and drone base, warning that it will respond forcefully to any attack, as tensions persist with the U.S. and oil tankers continue to be struck by naval mines in the Strait of Hormuz.
Hundreds of schools in Italy have been evacuated following emailed bomb threats, as similar messages spread to Scotland and Ireland. Police say the threats are not credible.
You can download the AnewZ application from Play Store and the App Store.
What is your opinion on this topic?
Leave the first comment