"However, technological developments in the 17 years since PIPEDA go well beyond watching. Today, I will focus on a single example: the use of AI to perform risk assessment and delegated decision-making. The substitution of machines for humans shifts the metaphor away from the watchful eye of Big Brother, towards what Professor Daniel Solove has characterized as “a more thoughtless process of bureaucratic indifference, arbitrary errors, and dehumanization, a world where people feel powerless and vulnerable, without any meaningful form of participation in the collection and use of their information.” This isn't George Orwell’s 1984—its Franz Kafka’s Trial of Joseph K. Since the enactment of PIPEDA, the world we now occupy permits complex, inscrutable AI to make significant decisions that affect our life chances and opportunities. These decisions are often processed with little to no input from the people they affect, and little to no explanation as to how or why these decisions were made. Such decisions may be “unnerving, unfair, unsafe, unpredictable, unaccountable”—and unconstitutional. They interfere with fundamental rights, including the right to due process and even the presumption of innocence."
Quote Details
Added by wikiquote-import-bot
Unverified quote
0 likes
Original Language: English
Available Languages (1)
Sources
Imported from EN Wikiquote
https://en.wikiquote.org/wiki/Ian_Kerr_(academic)
Revision History
No revisions have been submitted for this quote.
Categories
Ian Kerr (academic)
Ian Kerr (academic) (January 1, 1965 – August 26, 2019) was a Canadian academic who researched emerging law and technology issues. He held a Canada Research Chair in Ethics, Law, and Technology at the University of Ottawa.
15 quotes on TrueQuotesView all quotes by Ian Kerr (academic) →
Related Quotes
"First, to put it colloquially, the call for stronger enforcement through order making powers, the ability of the OPC …"
"Second, I agree with Commissioner Stoddart and with overlapping testimony by Professor Valerie Steeves, both of whom …"
"Finally, I also agree with those who recognize the need for meaningful consent. In particular, I agree with the four-…"
"Having reinforced these views, the majority of my remarks will focus on two of the central themes raised by this stud…"
"When PIPEDA was enacted, the dominant privacy metaphor was George Orwell’s 1984—“Big Brother is Watching you.” Strong…"
"It is worth taking a moment to drill down with real life examples. IBM Watson is used by H&R Block to make expert dec…"
"But here is the rub. These AIs are designed in ways that raise unique challenges for privacy. Many use machine learni…"
"This “emergent behavior” is what makes these AIs so useful. It also makes these AIs inscrutable. Machine learning, Kn…"
"Permitting such decisions without an ability to understand them can have the effect of eliminating challenges that ar…"
"I think that this is the sort of reason a number of experts have told you that we need greater transparency or, as so…"