Innovation Minister Navdeep Bains makes an announcement regarding vaccine procurement, in Toronto, on Wednesday, Aug., 5, 2020. Despite its status as an artificial intelligence hub, Canada has yet to develop a regulatory regime to deal with issues of privacy, discrimination and accountability to which AI systems are prone, prompting calls for regulation from businesses and experts. THE CANADIAN PRESS/Christopher Katsarov

Canada crawling toward AI regulatory regime, but experts say reform is urgent

5 million images of shoppers collected without consent at Canadian malls

OTTAWA — On Thursday, privacy watchdogs revealed that five million images of shoppers’ faces were collected without their consent at a dozen of Canada’s most popular malls.

Real estate company Cadillac Fairview embedded cameras equipped with facial-recognition technology, which draws on machine-learning algorithms, in digital information kiosks to discern customers’ ages and genders, according to an investigation by the federal, Alberta and B.C. privacy commissioners.

But the commissioners had no authority to levy fines against the firm, or any companies that violate Canadians’ personal information, an “incredible shortcoming of Canadian law that should really change,” B.C. information and privacy commissioner Michael McEvoy said in an email.

The revelation shines a light on the legal void around algorithmic technology. Despite its status as an artificial-intelligence hub, Canada has yet to develop a regulatory regime to deal with problems of privacy, discrimination and accountability to which AI systems are prone, prompting renewed calls for regulation from experts and businesses.

“We are now being required to expect systematic monitoring and surveillance in the way that we walk down the road, drive in our cars, chat with our friends online in small social-media bubbles. And it changes the way that public life occurs, to subject that free activity to systematic monitoring,” said Kate Robertson, a Toronto-based criminal and constitutional lawyer.

At least 10 Canadian police agencies, including the RCMP and Calgary and Toronto police services, have used Clearview AI, a facial-recognition company that has scraped more than three billion images from the Internet for use in law enforcement investigations, according to a report co-written by Robertson.

Other Ontario police forces also may be “unlawfully intercepting” private conversations in online chat rooms via “algorithmic social-media surveillance technology,” according to the September report from the University of Toronto’s Citizen Lab and International Human Rights Program.

Clearview AI said in July it will no longer provide facial recognition services in Canada, but many companies offer similar services.

“We have seen the lack of clear limits and focused regulation leaving an overly broad level of discretion in both the public and police sectors that is a call to action for governments across the country,” Robertson said in a phone interview.

Canada needs to roll out concrete rules that balance privacy and innovation, said Carolina Bessega, co-founder and chief scientific officer of Montreal startup Stradigi AI.

Public trust in artificial intelligence becomes increasingly crucial as machine-learning companies move from the conceptual to the commercial stage, she said. “And the best way to trust AI is to have clear regulations.”

The regulatory vacuum also discourages businesses from deploying AI, holding back innovation and efficiency — particularly in hospitals and clinics, where the implications can be life or death.

“I strongly believe AI can be extremely helpful in the diagnosis and treatment of different diseases. But when human wellbeing can be affected, it is important to have the right regulations in place to ensure we do AI in a responsible way,” Bessega said.

Innovation Minister Navdeep Bains tells The Canadian Press that an update to 20-year-old privacy legislation is due “in the coming weeks” to address gaps in personal-data protection, but refused to nail down a timeline.

The would-be law should “empower Canadians to have better accountability and to promote responsible innovation,” he said.

Bains pointed to the European Union’s General Data Protection Regulation from 2018 as a model that hands citizens more control over their privacy and digital information through “clear enforcement mechanisms,” he said.

The absence of an AI legal framework has implications for Canadians in areas ranging from law enforcement to immigration.

So-called predictive policing — automated decision-making based on data that forecasts where a crime will occur or who will commit it — has had a disproportionate impact on racialized communities, said Robertson of Citizen Lab.

Examples include a now-abandoned Chicago police initiative where the majority of people on a list of potential perpetrators were Black men who had no arrests or shooting incidents to their names, as well as a scuttled Los Angeles police strategy that saw officers targeting possible crime hot spots based on information gleaned from utility bills, foreclosure records and social-service files.

Since 2015, police departments in Vancouver, Edmonton, Saskatoon and London, Ont. have implemented or piloted predictive policing.

The federal immigration and refugee system also relies on algorithm-driven decisions to help determine factors such as whether a marriage is genuine or if someone should be designated as a “risk,” according to another Citizen Lab study, which found the practice threatens to violate human-rights law.

AI testing and deployment in Canada’s military prompted Canadian deep-learning pioneers Geoffrey Hinton and Yoshua Bengio to warn about the dangers of robotic weapons and outsourcing lethal decisions to machines, and to call for an international agreement on their deployment.

The federal government launched the Advisory Council on Artificial Intelligence in May 2019, and Canada was among the first states to develop an official AI research plan, unveiling a $125-million strategy in 2017. But the focus of both is largely scientific and commercial.

The advisory council, which includes a working group that aims to “foster trust” in the technology, has yet to produce a public report.

In June, Canada, France and 13 other countries launched an international AI partnership to guide policy development with an eye to human rights, with its working group on responsible AI co-chaired by Bengio (who also co-chairs the advisory council). But drafting laws is beyond its mandate.

“Canada’s approach to AI appears to be focused on funding research as opposed to developing regulations and governance structures,” according to a U.S. Library of Congress report from January 2019.

Until legislation arrives in Parliament, experts say the observation still holds true.

Get local stories you won't find anywhere else right to your inbox.
Sign up here

Just Posted

Alberta’s chief medical officer of health, Dr. Deena Hinshaw, announced more than 1,500 active cases in Alberta Monday afternoon and five additional deaths. (Photo by Chris Schwarz/Government of Alberta)
New COVID rules coming

Central zone active cases up by 100 in last 24 hours

Red Deer city council gave final approval to a mask bylaw that will go into effect on Nov. 30. (Black Press file photo).
Red Deer city council approves mask bylaw that takes effect on Nov. 30

It could be ‘superceded’ by a provincial mask bylaw, if one is announced Tuesday

The revised plans for the Dream Centre feature a two-storey renovated building. The centre launched a campaign Monday in hopes of raising more than a million to help with building renovation. (Contributed image).
Red Deer Dream Centre launches campaign, hopes to raise $1.4M

A proposed addiction treatment centre is hoping to raise $1.4 million to… Continue reading

COVID-19. (Image courtesy CDC)
Red Deer area seniors facility pauses visits after staff tests positive for COVID

A Red Deer County seniors facility has put the breaks on visitors… Continue reading

Lynn Van Laar, chair of this year’s Christmas Wish Breakfast, said the event was planned outdoors to minimize the risk of COVID. Photo by Mamta Lulla/Advocate staff
Outdoor Christmas Wish Breakfast helps central Alberta families this holiday season

The coronavirus pandemic isn’t going to stop children from having a merry… Continue reading

Prime Minister Justin Trudeau speak to the media about the COVID-19 virus outside Rideau Cottage in Ottawa, Friday, Nov. 20, 2020. THE CANADIAN PRESS/Adrian Wyld
Freeland says Liberals will deliver economic, fiscal update on Nov. 30

Freeland says Liberals will deliver economic, fiscal update on Nov. 30

Canadian Joint Operations Commander Lt.-Gen. Mike Rouleau speaks during a news conference on the recent Canadian Forces helicopter crash, Tuesday, May 19, 2020 in Ottawa. The Canadian Armed Forces is preparing to formally apologize to victims of sexual misconduct. THE CANADIAN PRESS/Adrian Wyld
Canadian Armed Forces to formally apologize to victims for sexual misconduct

Canadian Armed Forces to formally apologize to victims for sexual misconduct

Alberta Liberal Party David Khan at a campaign stop in Calgary, Alta., Thursday, April 11, 2019. The Alberta Liberal Party says its leader, David Khan, is stepping down. A news release from the party on Sunday evening says Khan is accepting a new job in law. THE CANADIAN PRESS/Jeff McIntosh
Alberta Liberal Party says leader, David Khan, stepping down to accept new job in law

Alberta Liberal Party says leader, David Khan, stepping down to accept new job in law

Edmonton Mayor Don Iveson listens to a question during a news conference in Ottawa, Thursday, February 6, 2020. Iveson says he won't seek re-election next fall. THE CANADIAN PRESS/Adrian Wyld
Edmonton Mayor Don Iveson announces he’s not running for re-election next fall

Edmonton Mayor Don Iveson announces he’s not running for re-election next fall

In this Nov. 17, 2020, photo released by China's Xinhua News Agency, a Long March-5 rocket is seen on the launch pad at the Wenchang Space Launch Site in Wenchang in southern China's Hainan Province. Chinese technicians were making final preparations Monday, Nov. 23, 2020, to launch a Long March-5 rocket carrying a mission to bring back material from the lunar surface in a potentially major advance for the country's space program. (Guo Cheng/Xinhua via AP)
China launches mission to bring back material from moon

China launches mission to bring back material from moon

President Donald Trump drives a golf cart as he golfs at Trump National Golf Club in Sterling, Va., Sunday, Nov. 22, 2020. (AP Photo/Manuel Balce Ceneta)
Biden signals sharp shift from Trump with Cabinet picks

Biden signals sharp shift from Trump with Cabinet picks

Licensed vocational nurse Caren Williams, left, collects a nasal swab sample from a traveler at a COVID-19 testing site at the Los Angeles International Airport in Los Angeles, Monday, Nov. 23, 2020. Los Angeles County announced new coronavirus-related restrictions Sunday that will prohibit in-person dining for at least three weeks as cases rise at the start of the holiday season and officials statewide begged Californians to avoid traveling or gathering in groups for Thanksgiving. (AP Photo/Jae C. Hong)
LA on the brink of a stay-home order as COVID cases rise

LA on the brink of a stay-home order as COVID cases rise

FILE - In this Nov. 7, 2020, file photo, Harjas Singh, 1, reaches out for his father, Umeet Singh, while held by his mother, Preet Kaur, as they attend a rally with their daughter, Nader Kaur, right, celebrating the election results in Detroit. (AP Photo/David Goldman, File)
Feds agree to help Biden transition after more Trump defeats

Feds agree to help Biden transition after more Trump defeats

Most Read