Computer Science

"Calvin Mooers was a participant in early developmental work on digital computers, a researcher, author, and implementer of applications in information retrieval; and a prophet in the 1950s describing the future importance of what is now called computer networks and distributive processing, and daring to predict that machines could simulate thought processes in retrieving computerized information. In 1947, he proposed the Zator, an electronic, film-scanning retrieval machine, and made the first proposal to use the Boolean operations or, and, and not to prescribe selections in retrieval machines. He developed his own Zatocoding System in 1948 using superimposed subject codes on edge-notched cards. He coined the term "Information Retrieval" in 1950, and went on from there to obtain several patents in information retrieval and signaling, produce a text-handling language (TRAC), author some 200 publications, and form one of the first companies whose only concern was information. His thinking has affected all who are in the field of Information and his early ideas are now incorporated into today's reality."

"The index of a search engine can be thought of as analogous to the stars in [the] sky. What we see has never existed, as the light has traveled different distances to reach our eye. Similarly, Web pages referenced in an index were also explored at different dates and they may not exist any more."

"In 1958 the classification ideas in it were felt to controversial, needing to be championed. A few years before, the {[w|Classification Research Group}} had issued a memorandum proclaiming "the need for a faceted classification as the basis of all methods of information retrieval'. As part-author of this memorandum, I must now judge the claim to have been too bold, even brash."

"The WWW project merges the techniques of information retrieval and hypertext to make an easy but powerful global information system. The project started with the philosophy that much academic information should be freely available to anyone. It aims to allow information sharing within internationally dispersed teams, and the dissemination of information by support groups."

"The cybernetics phase of cognitive science produced an amazing array of concrete results, in addition to its long-term (often underground) influence:"

"A great deal of the thinking [in Organizational Development] has been influenced by cybernetics and information theory, though this has been used as much to extend the scope of as to improve the sophistication of formulations. It was von Bertalanffy (1950) who, in terms of the general transport equation which he introduced, first fully disclosed the importance of openness or closedness to the environment as a means of distinguishing living organisms from inanimate objects."

"Some authors state that the last stage in this chain of measurements involves "consciousness," or the "intellectual inner life" of the observer, by virtue of the "principle of psycho-physical parallelism." Other authors introduce a wave function for the entire universe. In this book, I shall refrain from using concepts that I do not understand."

"My greatest concern was what to call it. I thought of calling it 'information,' but the word was overly used, so I decided to call it 'uncertainty.' When I discussed it with John von Neumann, he had a better idea. Von Neumann told me, 'You should call it entropy, for two reasons. In the first place your uncertainty function has been used in statistical mechanics under that name, so it already has a name. In the second place, and more important, no one really knows what entropy really is, so in a debate you will always have the advantage.'"

"Without an understanding of causality there can be no theory of communication. What passes as information theory today is not communication at all, but merely transportation."

"Every time we fire a phonetician/linguist, the performance of our system goes up"

"Pure mathematics, being mere tautology, and pure physics, being mere fact, could not have engendered them; for creatures to live, must sense the useful and the good; and engines to run must have energy available as work : and both, to endure, must regulate themselves. So it is to Thermodynamics and to its brother Σp log p, called Information theory, that we look for the distinctions between work and energy and between signal and noise."

"Cybernetics is concerned primarily with the construction of theories and models in science, without making a hard and fast distinction between the physical and the biological sciences. The theories and models occur both in symbols and in hardware, and by 'hardware* we shall mean a machine or computer built in terms of physical or chemical, or indeed any handleable parts. Most usually we shall think of hardware as meaning electronic parts such as valves and relays. Cybernetics insists, also, on a further and rather special condition that distinguishes it from ordinary scientific theorizing: it demands a certain standard of effectiveness. In this respect it has acquired some of the same motive power that has driven research on modern logic, and this is especially true in the construction and application of artificial languages and the use of operational definitions. Always the search is for precision and effectiveness, and we must now discuss the question of effectiveness in some detail. It should be noted that when we talk in these terms we are giving pride of place to the theory of automata at the expense, at least to some extent, of feedback and information theory."

"Incomplete knowledge of the future, and also of the past of the transmitter from which the future might be constructed, is at the very basis of the concept of information. On the other hand, complete ignorance also precludes communication; a common language is required, that is to say an agreement between the transmitter and the receiver regarding the elements used in the communication process... [The information of a message can] be defined as the 'minimum number of binary decisions which enable the receiver to construct the message, on the basis of the data already available to him.' These data comprise both the convention regarding the symbols and the language used, and the knowledge available at the moment when the message started."

"I have tried to show that psychiatric research can be empirical and experimental, controlled, and operational and not dependent on inferences, analogies, or anecdotes. Hypotheses can be derived which are testable. Theory is a different matter. At the present we rely heavily on psychoanalytic theory or on still poorly formulated and defined general systems theory, information theory, or transactional theory. To explain the depth and variety of the interrelationship of somatopsychosocial facets of the totality of human behavior in process requires a unified theory of human behavior which we have not yet even approached. Integration or synthesis of biological, psychological, and social theory is not enough."

"The field of 'information theory' began by using the old hardware paradigm of transportation of data from point to point."

"In fact, an information theory that leaves out the issue of noise turns out to have no content."

"If quantum communication and quantum computation are to flourish, a new information theory will have to be developed."

"Claude Shannon, the founder of information theory, invented a way to measure 'the amount of information' in a message without defining the word 'information' itself, nor even addressing the question of the meaning of the message."

"The 19th and first half of the 20th century conceived of the world as chaos. Chaos was the oft-quoted blind play of atoms, which, in mechanistic and positivistic philosophy, appeared to represent ultimate reality, with life as an accidental product of physical processes, and mind as an epi-phenomenon. It was chaos when, in the current theory of evolution, the living world appeared as a product of chance, the outcome of random mutations and survival in the mill of natural selection. In the same sense, human personality, in the theories of behaviorism as well as of psychoanalysis, was considered a chance product of nature and nurture, of a mixture of genes and an accidental sequence of events from early childhood to maturity. Now we are looking for another basic outlook on the world -- the world as organization. Such a conception -- if it can be substantiated -- would indeed change the basic categories upon which scientific thought rests, and profoundly influence practical attitudes. This trend is marked by the emergence of a bundle of new disciplines such as cybernetics, information theory, general system theory, theories of games, of decisions, of queuing and others; in practical applications, systems analysis, systems engineering, operations research, etc. They are different in basic assumptions, mathematical techniques and aims, and they are often unsatisfactory and sometimes contradictory. They agree, however, in being concerned, in one way or another, with "systems," "wholes" or "organizations"; and in their totality, they herald a new approach."

"We completely ignore the human value of the information. A selection of 100 letters is given a certain information value, and we do not investigate whether it makes sense in English, and, if so, whether the meaning of the sentence is of any practical importance. According to our definition, a set of 100 letters selected at random (according to the rules of Table 1.1), a sentence of 100 letters from a newspaper, a piece of Shakespeare or a theorem of Einstein are given exactly the same informational value."

"In fact, the science of thermodynamics began with an analysis, by the great engineer Sadi Carnot, of the problem of how to build the best and most efficient engine, and this constitutes one of the few famous cases in which engineering has contributed to fundamental physical theory. Another example that comes to mind is the more recent analysis of information theory by Claude Shannon. These two analyses, incidentally, turn out to be closely related."

"Whether computers are used for engineering design, medical data processing, composing music, or other purposes, the structure of computing is much the same. We are extremely short of talented people in this field, and so we need departments, curricula, and research and degree programs in computer science... I think of the Computer Science Department as eventually including experts in Programming, Numerical Analysis, Automata Theory, Data Processing, Business Games, Adaptive Systems, Information Theory, Information Retrieval, Recursive Function Theory, Computer Linguistics, etc., as these fields emerge in structure... Universities must respond [to the computer revolution] with far reaching changes in the educational structure."

"The problems of heuristic programming—of making computers solve really difficult problems—are divided into five main areas: Search, Pattern-Recognition, Learning, Planning, and Induction. A computer can do, in a sense, only what it is told to do. But even when we do not know how to solve a certain problem, we may program a machine (computer) to Search through some large space of solution attempts. Unfortunately, this usually leads to an enormously inefficient process. With Pattern-Recognition techniques, efficiency can often be improved, by restricting the application of the machine's methods to appropriate problems. Pattern-Recognition, together with Learning, can be used to exploit generalizations based on accumulated experience, further reducing search."

"A century ago, we had essentially no way to start to explain how thinking works. Then psychologists like Sigmund Freud and Jean Piaget produced their theories about child development. Somewhat later, on the mechanical side, mathematicians like Kurt Gödel and Alan Turing began to reveal the hitherto unknown range of what machines could be made to do. These two streams of thought began to merge only in the 1940s, when Warren McCulloch and Walter Pitts began to show how machines might be made to see, reason, and remember. Research in the modern science of Artificial Intelligence started only in the 1950s, stimulated by the invention of modern computers. This inspired a flood of new ideas about how machines could do what only minds had done previously."

"Artificial intelligence is the science of making machines do things that would require intelligence if done by men"

"It's important to understand that in order to make people superfluous, machines will not have to surpass them in general intelligence but only in certain specialized kinds of intelligence. For example, the machines will not have to create or understand art, music, or literature, they will not need the ability to carry on an intelligent, non-technical conversation (the "Turing test"), they will not have to exercise tact or understand human nature, because these skills will have no application if humans are to be eliminated anyway. To make humans superfluous, the machines will only need to outperform them in making the technical decisions that have to be made for the purpose of promoting the short-term survival and propagation of the dominant self-prop systems."

"It is not uncommon now for AI experts to ask whether an AI is ‘fair’ and ‘for good’. …The question to pose is a deeper one: how is AI shifting power? Law enforcement, marketers, hospitals and other bodies apply artificial intelligence to decide on matters such as who is profiled as a criminal, who is likely to buy what product at what price, who gets medical treatment and who gets hired. These entities increasingly monitor and predict our behavior, often motivated by power and profits."

"…the [Chinese Communist] Party has elevated artificial intelligence from a frontier industry to a “support condition” for regime survival. … Xi Jinping’s remarks revealed a comprehensive strategy: artificial intelligence is to be embedded into governance as both a surveillance tool and a propaganda amplifier. … AI is explicitly tasked with enabling cadres to “better understand public opinion” and to anticipate dissent before it surfaces. In effect, the Party is building a machine for preemptive repression. The Cyberspace Administration of China and security organs are expected to accelerate AI-driven monitoring, not only filtering keywords but mapping sentiment trends, identifying “risk clusters,” and neutralizing them before they metastasize into protest."

"Every morning, not in recent days, I see my friend who has a disability. It’s so hard for him just to do a high five; his arm with stiff muscle can’t reach out to my hand. Now, thinking of him, I can’t watch this stuff and find it interesting. Whoever creates this stuff has no idea what pain is. I [feel] utterly disgusted. If you really want to make creepy stuff, you can go ahead and do it. I would never wish to incorporate this technology into my work at all. I strongly feel that this is an insult to life itself. I feel like we are nearing the end of times. We humans are losing faith in ourselves."

"It seems very likely to a large number of people that we will get massive unemployment caused by Ai."

"Despite efforts to block access, Chinese netizens are discussing a report by Australia’s public service broadcaster ABC about how China uses artificial intelligence to erase online content that directly or indirectly references the 1989 Tiananmen Square massacre. …Experts are raising alarms about AI-induced censorship, which leads to a growing sense of historical amnesia, as symbols, images, and even indirect references are systematically erased. This phenomenon affects not only the collective memory of the Chinese populace but also the global understanding of these pivotal events. The use of AI in this context highlights significant ethical concerns regarding technology’s power to shape and control information."

"Any aeai [A.I., artificial intelligence] smart enough to pass a Turing test is smart enough to know to fail it."

"Recent researchers in artificial intelligence and computational methods use the term swarm intelligence to name collective and distributed techniques of problem solving without centralized control or provision of a global model. … the intelligence of the swarm is based fundamentally on communication. … the member of the multitude do not have to become the same or renounce their creativity in order to communicate and cooperate with each other. They remain different in terms of race, sex, sexuality and so forth. We need to understand, then, is the collective intelligence that can emerge from the communication and cooperation of such varied multiplicity."

"The development of full artificial intelligence could spell the end of the human race. We cannot quite know what will happen if a machine exceeds our own intelligence, so we can't know if we'll be infinitely helped by it, or ignored by it and sidelined, or conceivably destroyed by it."

"When genetic engineering and artificial intelligence reveal their full potential, liberalism, democracy and free markets might become as obsolete as flint knives, tape cassettes, Islam and communism."

"On November 5, Ruslan Perelygin, [an] opposition legislator in Oryol, used AI to create a clip showing protesters denouncing the local mayor for a variety of crimes and demanding his ouster, a creative use of new technology to protest at a time when genuine demonstrations are almost invariably illegal and subject to harsh punishments."

"What makes the goal of accuracy so vexing for chatbots is that they operate probabilistically when choosing the next word in a sentence; they aren’t trying to find the light of truth in a murky world. “These models are built to generate text that sounds like what a person would say — that’s the key thing,” Jesse Dodge says. “So they’re definitely not built to be truthful.” I asked Margaret Mitchell, a computer scientist who studied the ethics of A.I. at Google, whether factuality should have been a more fundamental priority for A.I. Mitchell, who has said she was fired from the company for criticizing how it treated colleagues working on bias in A.I. (Google says she was fired for violating the company’s security policies), said that most would find that logical. “This common-sense thing — ‘Shouldn’t we work on making it factual if we’re putting it forward for fact-based applications?’ — well, I think for most people who are not in tech, it’s like, ‘Why is this even a question?’” But, Mitchell said, the priorities at the big companies, now in frenzied competition with one another, are concerned with introducing A.I. products rather than reliability. The road ahead will almost certainly lead to improvements. Mitchell, who now works as the chief ethics scientist at the A.I. company Hugging Face, told me that she foresees A.I. companies’ making gains in accuracy and reducing biased answers by using better data. “The state of the art until now has just been a laissez-faire data approach,” she said. “You just throw everything in, and you’re operating with a mind-set where the more data you have, the more accurate your system will be, as opposed to the higher quality of data you have, the more accurate your system will be.” Jesse Dodge, for his part, points to an idea known as “retrieval,” whereby a chatbot will essentially consult a high-quality source on the web to fact-check an answer in real time. It would even cite precise links, as some A.I.-powered search engines now do. “Without that retrieval element,” Dodge says, “I don’t think there’s a way to solve the hallucination problem.” Otherwise, he says, he doubts that a chatbot answer can gain factual parity with Wikipedia or the Encyclopaedia Britannica."

"Even if conflicts like this don’t impede the advance of A.I., it might be stymied in other ways. At the end of May, several A.I. researchers collaborated on a paper that examined whether new A.I. systems could be developed from knowledge generated by existing A.I. models, rather than by human-generated databases. They discovered a systemic breakdown — a failure they called “model collapse.” The authors saw that using data from an A.I. to train new versions of A.I.s leads to chaos. Synthetic data, they wrote, ends up “polluting the training set of the next generation of models; being trained on polluted data, they then misperceive reality.” The lesson here is that it will prove challenging to build new models from old models. And with chat-bots, Ilia Shumailov, an Oxford University researcher and the paper’s primary author, told me, the downward spiral looks similar. Without human data to train on, Shumailov said, “your language model starts being completely oblivious to what you ask it to solve, and it starts just talking in circles about whatever it wants, as if it went into this madman mode.” Wouldn’t a plug-in from, say, Wikipedia, avert that problem, I asked? It could, Shumailov said. But if in the future Wikipedia were to become clogged with articles generated by A.I., the same cycle — essentially, the computer feeding on content it created itself — would be perpetuated."

"I think we’re going to see AI get even better. It’s already extremely good. We’re going to see it having the capabilities to replace many, many jobs. It’s already able to replace jobs in call centers, but it’s going to be able to replace many other jobs. And then there’ll be very few people need for software engineering projects."

"Autonomy, that’s the bugaboo, where your AI’s are concerned. My guess, Case, you’re going in there to cut the hard-wired shackles that keep this baby from getting any smarter. And I can’t see how you’d distinguish, say, between a move the parent company makes, and some move the AI makes on its own, so that’s maybe where the confusion comes in.” Again the nonlaugh. “See, those things, they can work real hard, buy themselves time to write cookbooks or whatever, but the minute, I mean the nanosecond, that one starts figuring out ways to make itself smarter, Turing’ll wipe it. Nobody trusts those fuckers, you know that. Every AI ever built has an electromagnetic shotgun wired to its forehead."

"Within 10 years, AI will replace many doctors and teachers—humans won’t be needed ‘for most things’. It’s very profound and even a little bit scary — because it’s happening very quickly, and there is no upper bound,."

"There’s a lot of leverage in the system, there’s a lot of cash, but then there’s a whole bunch of other folks who are trying to build these data centers. Whether there’s the energy component side of it, or whether you think about the real estate component, I mean, there’s just a whole lot of things happening at one time. [...] Are we in an AI bubble? Of course, we are. We are hyped, we’re accelerating, we’re putting enormous leverage into the system,” Gelsinger answered. “With that said, I don’t see it ending for several years. I do think we have an industry shift to AI. As Jensen (Huang) talked about, and I agree with this, you know that businesses are yet to really start materially benefiting from [it]. We’re displacing all of the internet and the service provider industry as we think about it today — we have a long way to go."

"Quantum computing will pop the AI bubble."

"If you eventually get a society where you only have to work three days a week, that’s probably OK. If you free up human labor, you can help elder people better, have smaller class sizes – you know, the demand for labor to do good things is still there. And then if you ever get beyond that, you have a lot of leisure time and you’ll have to figure out what to do with it."

"Physical sexual immorality is deeply evil and brings an additional shipload of devastating consequences and fallout; but when a man engages in adultery of the heart with whatever AI happens to “think” is a woman as the object, he is making all-out war on his connection to reality in a disastrous way. …Those who offer AI the worship, trust, and belief they should be placing in the one true God will become increasingly blind, dull, senseless, stagnated, and incapable of saying anything worth hearing, as those around them are treated to the ever-ripening stench of their own self-absorption."

"Suppose now that the computer scientists do not succeed in developing artificial intelligence, so that human work remains necessary. Even so, machines will take care of more and more of the simpler tasks so that there will be an increasing surplus of human workers at the lower levels of ability. (We see this happening already. There are many people who find it difficult or impossible to get work, because for intellectual or psychological reasons they cannot acquire the level of training necessary to make themselves useful in the present system.) ... Of course, life will be so purposeless that people will have to be biologically or psychologically engineered either to remove their need for the power process or to make them “sublimate” their drive for power into some harmless hobby. These engineered human beings may be happy in such a society, but they most certainly will not be free. They will have been reduced to the status of domestic animals. ... I visualize a time when we will be to robots what dogs are to humans, and I’m rooting for the machines."

"As difficult as the pursuit of truth can be for Wikipedians, though, it seems significantly harder for A.I. chatbots. ChatGPT has become infamous for generating fictional data points or false citations known as “hallucinations”; perhaps more insidious is the tendency of bots to oversimplify complex issues, like the origins of the Ukraine-Russia war, for example. One worry about generative A.I. at Wikipedia — whose articles on medical diagnoses and treatments are heavily visited — is related to health information. A summary of the March conference call captures the issue: “We’re putting people’s lives in the hands of this technology — e.g. people might ask this technology for medical advice, it may be wrong and people will die.” This apprehension extends not just to chatbots but also to new search engines connected to A.I. technologies. In April, a team of Stanford University scientists evaluated four engines powered by A.I. — Bing Chat, NeevaAI, perplexity.ai and YouChat — and found that only about half of the sentences generated by the search engines in response to a query could be fully supported by factual citations. “We believe that these results are concerningly low for systems that may serve as a primary tool for information-seeking users,” the researchers concluded, “especially given their facade of trustworthiness.”"

"Another scientific development that we find difficult to absorb into our traditional value system is the new science of cybernetics: machines that may soon equal or surpass man in original thinking and problem-solving. [...] In the hands of the present establishment there is no doubt that the machine could be used – is being used – to intensify the apparatus of repression and to increase established power. But again, as in the issue of population control, misuse of science has often obscured the value of science itself. In this case, though perhaps the response may not be quite so hysterical and evasive, we still often have the same unimaginative concentration on the evils of the machine itself, rather than a recognition of its revolutionary significance."

"AI is not going to replace physicians, but physicians who use AI are going to replace physicians who don’t."

"It may be that our role on this planet is not to worship God but to create him."