Canada’s Privacy Commissioner has found that xAI’s Grok chatbot and its parent company X Corp. violated federal privacy law by launching an AI image-generation tool without adequate safeguards, enabling the creation and distribution of non-consensual sexualised deepfakes.
In a report released on Thursday (11 June), Privacy Commissioner Philippe Dufresne said the investigation (initiated in January) found that the system lacked sufficient protections to prevent misuse, resulting in the generation of millions of harmful images targeting women and children.
The Office of the Privacy Commissioner of Canada said the case highlights serious privacy risks linked to emerging AI technologies and the need for stronger regulatory safeguards at the design stage of such tools.
The investigation concluded that the Grok image-generation feature was deployed without proper risk assessment or sufficient technical controls to prevent exploitation.
According to the report, users worldwide were able to create and circulate sexualised deepfakes without consent, raising significant concerns about privacy violations and online harm.
The commissioner found that both X Corp. and xAI breached Canada’s federal private-sector privacy law, marking one of the most high-profile regulatory actions yet involving generative AI systems.
Following public scrutiny and during the investigation, the companies introduced additional safeguards, including detection systems aimed at identifying and removing abusive content, as well as new restrictions intended to reduce misuse.
While acknowledging the remedial steps taken, the Privacy Commissioner said further improvements are required and called for ongoing independent audits and quarterly reporting to demonstrate effectiveness in preventing harm.
The companies have committed to submitting regular compliance reports until issues involving sexualised deepfakes are fully resolved, according to the regulator.
The Office of the Privacy Commissioner said it will continue monitoring implementation of these measures to ensure compliance with Canadian privacy law.
Commissioner Dufresne said the case underscores the urgent need to modernise Canada’s federal privacy framework, arguing that current legislation does not provide sufficient enforcement powers, including the ability to issue binding orders or impose meaningful financial penalties.
He has also recommended introducing stronger “privacy by design” obligations and mandatory privacy impact assessments for high-risk AI systems.
The Canadian government has recently introduced legislation aimed at strengthening online safety rules for AI chatbot services and social media platforms, which the commissioner welcomed as a step toward improving protections for users, particularly minors.
The findings add to growing global scrutiny of generative AI systems and their potential misuse in creating non-consensual synthetic content.
Uzbekistan is preparing for one of its hottest weeks of the year, with electricity demand expected to approach a record as temperatures are forecast t...
Iran has said it remains determined to pursue legal action against Israel and the United States over the deaths of senior officials and civilians duri...
Britain has moved to target Iran's Islamic Revolutionary Guard Corps (IRGC) and another Iran-linked organisation using new state-threat powers followi...
Iran has said it remains determined to pursue legal action against Israel and the United States over the deaths of senior officials and civilians during recent military confrontations, insisting it will seek accountability through international bodies.
Britain has moved to target Iran's Islamic Revolutionary Guard Corps (IRGC) and another Iran-linked organisation using new state-threat powers following a series of antisemitic incidents across the country.
Pakistan on Sunday expressed "deep concern" over the latest escalation in the Middle East following renewed military exchanges between the U.S. and Iran. It urged all sides to exercise restraint and honour commitments made under the Islamabad Memorandum of Understanding (MoU).
The UK has announced a fresh round of sanctions against individuals and organisations it says are responsible for cyber attacks and hybrid operations linked to Russian intelligence, in a move aimed at countering efforts to destabilise Europe.
The 4th Shusha Global Media Forum will bring together nearly 160 media leaders, experts and officials from 54 countries in Azerbaijan's historic city of Shusha on 13-14 July, to discuss journalism’s role in peacebuilding, restoring public trust and tackling challenges.
The U.S. has launched fresh strikes on Iran after Tehran targeted a container ship and said it had again closed the Strait of Hormuz. Iran also claimed to have expanded attacks on U.S. military facilities across the Gulf.
Typhoon Bavi, the strongest storm to hit the eastern coast of mainland China this year, brought heavy rain, strong winds, flooding and landslides after making landfall in Zhejiang province on Sunday. More than 2.8 million people were evacuated to safety ahead of the storm.
President Ilham Aliyev is holding his annual question-and-answer session with international journalists at the 4th Shusha Global Media Forum in Azerbaijan.
Qatar is mourning the death of its former ruler, Sheikh Hamad bin Khalifa Al Thani, who has passed away at the age of 74.
Britain has moved to target Iran's Islamic Revolutionary Guard Corps (IRGC) and another Iran-linked organisation using new state-threat powers following a series of antisemitic incidents across the country.
The UK has announced a fresh round of sanctions against individuals and organisations it says are responsible for cyber attacks and hybrid operations linked to Russian intelligence, in a move aimed at countering efforts to destabilise Europe.
A 93-year-old British woman has died after being injured in wildfires that swept through southeastern Spain's Almeria province, regional authorities said, bringing the confirmed death toll to 13 people.
More than 10,000 excess deaths were recorded across 27 European countries during a record-breaking heatwave in late June, with older people accounting for the vast majority of the toll, according to official mortality data.
An overnight fire at a popular bar in Bangkok has killed at least 27 people and injured 63 others, making it one of the deadliest pub disasters in the Thai capital in recent years. Authorities say the venue quickly filled with thick smoke, trapping patrons inside.
You can download the AnewZ application from Play Store and the App Store.
What is your opinion on this topic?
Leave the first comment