Shoshana Zuboff

"During the last two decades, the leading surveillance capitalists—Google, later followed by Facebook, Amazon and Microsoft—helped to drive this societal transformation while simultaneously ensuring their ascendance to the pinnacle of the epistemic hierarchy. They operated in the shadows to amass huge knowledge monopolies by taking without asking, a maneuver that every child recognizes as theft. Surveillance capitalism begins by unilaterally staking a claim to private human experience as free raw material for translation into behavioral data. Our lives are rendered as data flows…."

"We celebrated the new digital services as free, but now we see that the surveillance capitalists behind those services regard us as the free commodity. We thought that we search Google, but now we understand that Google searches us. We assumed that we use social media to connect, but we learned that connection is how social media uses us. …We’ve begun to understand that “privacy” policies are actually surveillance policies.… The Financial Times reported that a Microsoft facial recognition training database of 10 million images plucked from the internet without anyone’s knowledge and supposedly limited to academic research was employed by companies like IBM and state agencies that included the United States and Chinese military.… ….Privacy is not private, because the effectiveness of these and other private or public surveillance and control systems depends upon the pieces of ourselves that we give up—or that are secretly stolen from us."

"Automated machine processes not only know our behavior but also shape our behavior at scale. With this reorientation from knowledge to power, it is no longer enough to automate information flows about us; the goal is to automate us. ... Just as industrial society was imagined as a well-functioning machine, Instrumentarian society is imagined as a human simulation of machine learning systems: a confluent hive mind in which each element learns and operates in concert with every other element. In the model of machine confluence, the “freedom” of each individual machine is subordinated to the knowledge of the system as a whole. Instrumentarian power is to organize, herd, and tune society to achieve a similar social confluence, in which group pressure and computational certainty replace politics and democracy."

"Although the saying tells us “If it’s free, then you are the product,” that is also incorrect. We are the sources of surveillance capitalism’s crucial surplus: the objects of a technologically advanced and increasingly inescapable raw-material-extraction operation. Surveillance capitalism’s actual customers are the enterprises that trade in its markets for future behavior."

"Forget the cliché that if it’s free, “You are the product.” You are not the product; you are the abandoned carcass. The “product” derives from the surplus that is ripped from your life."

"(...) This structural requirement of economies of action turns the means of behavioral modification into an engine of growth. At no other time in history have private corporations of unprecedented wealth and power enjoyed the free exercise of economies of action supported by a pervasive global architecture of ubiquitous computational knowledge and control constructed and maintained by all the advanced scientific know-how that money can buy."

"It is important to understand that surveillance capitalists are impelled to pursue lawlessness by the logic of their own creation. Google and Facebook vigorously lobby to kill online privacy protection, limit regulations, weaken or block privacy-enhancing legislation, and thwart every attempt to circumscribe their practices because such laws are existential threats to the frictionless flow of behavioral surplus."

"(...) Stalin took the floor for a toast as the room fell silent. “Our tanks are worthless if the souls who must steer them are made of clay. This is why I say: The production of souls is more important than that of tanks.… Man is reshaped by life itself, and those of you here must assist in reshaping his soul. That is what is important, the production of human souls. And that is why I raise my glass to you, writers, to the engineers of the soul.”6 The authors assembled around Stalin that evening raised their glasses to his toast, persuaded perhaps by memories of less adaptive colleagues already exiled or executed (...)"