"This “emergent behavior” is what makes these AIs so useful. It also makes these AIs inscrutable. Machine learning, Knowledge Discovery in Databases, and other AI techniques produce decision-making models differing so radically from the way humans make decisions that they resist our ability to make sense of them. Ironically, AIs display great accuracy—but those who use them (even their programmers) often don’t know exactly how or why."
January 1, 1970
https://en.wikiquote.org/wiki/Ian_Kerr_(academic)