"We know, from years of talking to people about this subject, that some people are swayed by the abstract observation that a superintelligence could exploit options they didn’t even know were possible. For others, however, explanations such as these end up making them feel like we’re cheating in a child’s game of pretend. If we can’t even tell a story about how the bad guy is supposed to win, how is that convincing? We emphasize again: Reality has never been bound by that rule. Even if an Aztec soldier couldn’t have figured out in advance how guns work, the big boat on the horizon contained them anyway."