Cyberneticists

"These models are of course so simple that any more detailed comparison between them and living creatures would be purely conjectural."

"In the dark ages before the invention of the electronic vacuum tube there were many legends of living statues and magic pictures. One of the commonest devices of sorcerers and witches was the model of an enemy which somehow embodied his soul, so that injury to the model would be reflected by suffering or death of the original... Idolatry, witchcraft and other superstitions are so deeply rooted and widespread that it is possible that even the most detached scientific activity may be psychologically equivalent to them; such activity may help to satisfy the desire for power, to assuage the fear of the unknown or to compensate for the flatness of everyday existence."

"[A]n electro-mechanical creature which behaves so much like an animal that it has been known to drive a not usually timid lady upstairs to lock herself in her bedroom, an interesting blend of magic and science."

"In any case there is an intense modern interest in machines that imitate life. The great difference between magic and the scientific imitation of life is that where the former is content to copy external appearance, the latter is concerned more with performance and behavior."

"[Walter even gave the tortoises a mock-biological name, Machina speculatrix] because they illustrate particularly the exploratory, speculative behaviour that is so characteristic of most animals."

"The first notion of constructing a free goal-seeking mechanism goes back a wartime talk with the psychologist, , whose untimely death was one of the greatest losses Cambridge has suffered in years. When he was engaged on a warjob for the Government, he came to get the help of an automatic analyzer with some very complicated curves he had obtained, curves relating to the aiming errors of air gunners. Goal-seeking missiles were literally much in the air in those days; so, in our minds, were scanning mechanisms. Long before the home study was turned into a workshop, the two ideas, goal-seeking and scanning, had combined as the essential mechanical conception of a working model that would behave like a very simple animal."

"Cybernetics is likely to reveal a great number of interesting and suggestive parallelisms between machine and brain and society. And it can provide the common language by which discoveries in one branch can readily be made use of in the others... [There are] two peculiar scientific virtues of cybernetics that are worth explicit mention. One is that it offers a single vocabulary and a single set of concepts suitable for representing the most diverse types of system... The second peculiar virtue of cybernetics is that it offers a method for the scientific treatment of the system in which complexity is outstanding and too important to be ignored. Such systems are, as we well know, only too common in the biological world!"

"Many workers in the biological sciences — physiologists, psychologists, sociologists — are interested in cybernetics and would like to apply its methods and techniques to their own specialty. Many have, however, been prevented from taking up the subject by an impression that its use must be preceded by a long study of electronics and advanced pure mathematics; for they have formed the impression that cybernetics and these subjects are inseparable. The author is convinced, however, that this impression is false. The basic ideas of cybernetics can be treated without reference to electronics, and they are fundamentally simple; so although advanced techniques may be necessary for advanced applications, a great deal can be done, especially in the biological sciences, by the use of quite simple techniques, provided they are used with a clear and deep understanding of the principles involved. It is the author’s belief that if the subject is founded in the common-place and well understood, and is then built up carefully, step by step, there is no reason why the worker with only elementary mathematical knowledge should not achieve a complete understanding of its basic principles. With such an understanding he will then be able to see exactly what further techniques he will have to learn if he is to proceed further; and, what is particularly useful, he will be able to see what techniques he can safely ignore as being irrelevant to his purpose."

"Cybernetics was defined by Wiener as “the science of control and communication, in the animal and the machine” — in a word, as the art of steermanship, and it is to this aspect that the book will be addressed. Co-ordination, regulation and control will be its themes, for these are of the greatest biological and practical interest. We must, therefore, make a study of mechanism; but some introduction is advisable, for cybernetics treats the subject from a new, and therefore unusual, angle... The new point of view should be clearly understood, for any unconscious vacillation between the old and the new is apt to lead to confusion."

"Every stable system has the property that if displaced from a state of equilibrium and released, the subsequent movement is so matched to the initial displacement that the system is brought back to the state of equilibrium. A variety of disturbances will therefore evoke a variety of matched reactions."

"[T]he concept of “”, so simple and natural in certain elementary cases, becomes artificial and of little use when the interconnexions between the parts become more complex. When there are only two parts joined so that each affects the other, the properties of the feedback give important and useful information about the properties of the whole. But when the parts rise to even as few as four, if every one affects the other three, then twenty circuits can be traced through them; and knowing the properties of all the twenty circuits does not give complete information about the system. Such complex systems cannot be treated as an interlaced set of more or less independent feedback circuits, but only as a whole. For understanding the general principles of dynamic systems, therefore, the concept of feedback is inadequate in itself. What is important is that complex systems, richly cross-connected internally, have complex behaviours, and that these behaviours can be goal-seeking in complex patterns."

"By a state of a system is meant any well-defined condition or property that can be recognised if it occurs again. Every system will naturally have many possible states."

"Cybernetics treats not things but ways of behaving. It does not ask “what is this thing?” but “what does it do?”... It is thus essentially functional and behaviouristic. Cybernetics deals with all forms of behavior in so far as they are regular, or determinate, or reproducible. The materiality is irrelevant... The truths of cybernetics are not conditional on their being derived from some other branch of science. Cybernetics has its own foundations."

"If cognitive processes can be realized in a general machine then it is possible to execute mental operations in artifacts that are not necessarily subject to the embarrassing spatio-temporal limitations and structural frailties of a biological processor."

"The most fundamental concept in cybernetics is that of "difference", either that two things are recognisably different or that one thing has changed with time. Its range of application need not be described now, for the subsequent chapters will illustrate the range abundantly. All the changes that may occur with time are naturally included, for when plants grow and planets age and machines move some change from one state to another is implicit. So our first task will be to develop this concept of "change", not only making it more precise but making it richer, converting it to a form that experience has shown to be necessary if significant developments are to be made."

"One of the issues that John von Neumann and McCulloch discussed was reliability in the brain. One version of the story was that McCulloch got a 3:00 AM phone call from von Neumann to say, “I have just finished a bottle of creme de menthe. The thresholds of all my neurons are shot to hell. How is it I can still think?” (In other versions of the story, von Neumann was called by McCulloch, and the drink was whisky.)"

"During the last few years it has become apparent that the concept of "machine" must be very greatly extended if it is to include the most modern developments. Especially is this true if we are studying the brain and attempting to identify the type of mechanism that is responsible for the brain’s outstanding powers of thought and action. It has become apparent that when we used to doubt whether the brain could be a machine, our doubts were due chiefly to the fact that by ‘‘machine’’ we understood some mechanism of very simple type. Familiar with the bicycle and the typewriter, we were in great danger of taking them as the type of all machines. The last decade, however, has corrected this error. It has taught us how restricted our outlook used to be; for it developed mechanisms that far transcended the utmost that had been thought possible, and taught us that ‘‘mechanism’’ was still far from exhausted in its possibilities. Today we know only that the possibilities extend beyond our farthest vision."

"[A] famous photograph... showing McCulloch (1898–1969) and Norbert Wiener (1894–1964) with British Cyberneticians Ross Ashby (1903–1972) and Grey Walter (1910–1977), first appeared in de Latil (1953) with the caption "The four pioneers of Cybernetics get together in Paris", and encapsulates a view of the development of cybernetics that has slowly become more accepted: that there were important British contributions from the outset... Warren McCulloch embraced these influences and had significant contact with a number of British cyberneticians, forming friendships and collaborations with several, as well as mentoring others."

"As a young man, Warren McCulloch set himself the goal of developing an experimental epistemology, to understand the mind in terms of the brain. More particularly, he sought to discover the logical calculus immanent in nervous activity."

"The invasion of psychology by cybernetics is making us realize that the ordinary concepts of psychology must be reformulated in the language of physics if a physical explanation of the ordinary psychological phenomena is to become possible. Some psychological concepts can be re-formulated more or less easily, but others are much more difficult, and the investigator must have a deep insight if the physical reality behind the psychological phenomena is to be perceived"

"And he had a grand view of this, the importance of cybernetics, which was correct, so, otherwise you would have said he was delusional. . .but I must have spent the most part of a year just hanging around him and trying to understand how he could see such importance in ordinary things"

"With all of these limitations and hazards well in mind, let us ask whether a knower so conceived is capable of constructing the physics of the world which includes himself. But, in so doing, let us be perfectly frank to admit that causality is a superstition."

"No more would I go along with Plato in exiling the poets, who play on the limbic cortex. Not even they are powerful enough to evoke the whole of man. If we are to survive our own destruction of our world and of ourselves by our advance of culture we had better learn soon to modify our genes to make us more intelligent. It is our last chance, that by increasing our diversity we may be able to make some sort of man that can survive without an ecological niche on this our earth. We may be able to live in gas masks and eat algae and distill the ocean. I doubt that we have time enough. We are, I think, nearing the end of a course that left the main line of evolution to overspecialize in brain to its own undoing. Time will tell."

"My object, as a psychologist, was to invent a kind of least psychic event, or "psychon," that would have the following properties: First, it was to be so simple an event that it either happened or else it did not happen. Second, it was to happen only if its bound cause had happened – shades of Duns Scotus! – that is, it was to imply its temporal antecedent. Third, it was to propose this to subsequent psychons. Fourth, these were to be compounded to produce the equivalents of more complicated propositions concerning their antecedents."

"We suppose that some axonal terminations cannot at first excite the succeeding neuron; but if at any time the neuron fires, and the axonal terminations are simultaneously excited, they become synapses of the ordinary kind, henceforth capable of exciting the neuron. The loss of an inhibitory synapse gives an entirely equivalent result."

"To make psychology into experimental epistemology is to attempt to understand the embodiment of mind. Here we are confronted by what seem to be three questions, although they may ultimately be only one. The three exist as categorically disperate desiderata. The first is at the logical level: We lack an adequate, appropriate calculus for triadic relations. The second is the psychological level: We do not know how we generate hypotheses that are natural and simple. The third is that the physiological level: we have no circuit theory for the reticular formation that marshals our abductions. Logically, the problem is far from simple. To be exact, no proposed theory of relations yields a calculus to handle our problem. When I was growing up, only the Aristotelian logic of classes was ever taught, and that badly. The Organon itself contains only a clumsy description of the apagoge - perhaps from the notes of some students who have not understand his master..."

"[1917 Winter] Rufus Jones called me in. "Warren," said he, "what is thee going to be?" And I said, "I don't know." "And what is thee going to do?" And again I said, "I have no idea; but there is one question I would like to answer: What is a number, that a man may know it, and a man, that he may know a number?" He smiled and said, "Friend, thee will be busy as long as thee lives.""

"If intellectual power is to be developed, we must somehow construct amplifiers for intelligence — devices that, supplied with a little intelligence, will emit a lot."

"Qian Xuesen... didn't like being called the father of China's guided-missile program: he felt that the title didn't give credit to his fellow researchers. Indeed, while the Chinese-born, U.S.-educated rocket scientist was technically brilliant, he also realized that legions of bright thinkers can do far more than one genius ever could."

"This book is not for the engineer content with hardware, nor for the biologist uneasy outside his specialty; for it depicts that miscegenation of Art and Science which begets inanimate objects that behave like living systems. They regulate themselves and survive: They adapt and they compute: They invent. They co-operate and they compete. Naturally they evolve rapidly. Pure mathematics, being mere tautology, and pure physics, being mere fact, could not have engendered them; for creatures to live, must sense the useful and the good; and engines to run must have energy available as work : and both, to endure, must regulate themselves. So it is to Thermodynamics and to its brother Σp log p, called Information Theory, that we look for the distinctions between work and energy and between signal and noise. For like cause we look to reflexology and its brother feedback, christened Multiple Closed Loop Servo Theory, for mechanical explanation of Entelechy in Homeostasis and in appetition. This is that governance, whether in living creatures and their societies or in our living artefacts, that is now called Cybernetics."

"Don't bite my finger, look where I am pointing."

"I met Walter Pitts, then in his teens, who promptly set me right in matters of theory. It is to him that I am principally indebted for all subsequent success. He remains my best adviser and sharpest critic. You shall never publish this until it passes through his hands."

"In 1948, the MIT mathematician Norbert Wiener gave a widely read, albeit completely nonmathematical, account of cybernetics. A more mathematical treatment of the elements of engineering cybernetics was presented by H.S. Tsien in 1954, driven by problems related to control of missiles. Together, these works and others of that time form much of the intellectual basis for modern work in robotics and control."

"An engineering science aims to organize the design principles used in engineering practice into a discipline and thus to exhibit the similarities between different areas of engineering practice and to emphasize the power of fundamental concepts. In short, an engineering science is predominated by theoretical analysis and very often uses the tool of advanced mathematics."

"It was the stupidest thing this country ever did. He was no more a Communist than I was, and we forced him to go."

"When McCulloch's essays are hard to understand, the trouble lies less often in the internal logic of the individual arguments than in the perception of a unifying theme that runs, sometimes with exuberant clarity, sometimes in a tantalizingly elusive way, through the whole work. The consequent perplexity is partly intentional -- McCulloch is at least as much concerned with questions as with answers -- and partly the result of his way of expressing the general through the particular."

"That the government permitted this genius, this scientific genius, to be sent to Communist China to pick his brains is one of the tragedies of this century."

"You have to have the facts before you can pervert them."

"Gordon Pask... spent his life developing an elegant theory of learning that stands without peer. His achievement was to establish a unifying framework that subsumes the subjectivity of human experience and the objectivity of scientific tradition. Sponsored by governments and industries on both sides of the Atlantic, his life-long research spanned biological computing, artificial intelligence, cognitive science, logic, linguistics, psychology, and artificial life. His was an original approach to age-old questions of how the human organism learns from its environment and relates to others through language."

"That man, that wretched man, that drunkard! Why, if I had the money I would buy him a case of Scotch whisky so he could drink himself to death!"

"I do not plan to come back. I have no reason to come back.. I plan to do my best to help the Chinese people build up the nation to where they can live with dignity and happiness."

"The celebrated physicist and mathematician A.M. Ampere coined the word cybernetique to mean the science of civil government (Part II of "Essai sur la philosophic des sciences", 1845, Paris). Ampere's grandiose scheme of political sciences has not, and perhaps never will, come to fruition. In the meantime, conflict between governments with the use of force greatly accelerated the development of another branch of science, the science of control and guidance of mechanical and electrical systems. It is thus perhaps ironical that Ampere's word should be borrowed by N. Wiener to name this new science, so important to modern warfare. The "cybernetics" of Wiener ("Cybernetics, or Control and Communication in the animal and the Machine," John Wiley & Sons, Inc., New York, 1948) is the science of organization of mechanical and electrical components for stability and purposeful actions. A distinguishing feature of this new science is the total absence of considerations of energy, heat, and efficiency, which are so important in other natural sciences. In fact, the primary concern of cybernetics is on the qualitative aspects of the interrelations among the various components of a system and the synthetic behavior of the complete mechanism."

"Consistency of the person's strategic preference across tests (and subject matters) is curiously high."

"Because of the "all-or-none" character of nervous activity, events and the relations among them can be treated by means of propositional logic. It is found that the behaviour of every net can be described in these terms, with the addition of more complicated logical means for nets containing cycles; and that for any logical expression satisfying certain conditions, one can find in net behaving ever fashion it describes."

"A [learning] style is a disposition to adopt one class of learning strategy."

"The purpose of "Engineering Cybernetics" is then to study those parts of the broad science of cybernetics which have direct engineering applications in designing controlled or guided systems. It certainly includes such topics usually treated in books on servomechanisms. But a wider range of topics is only one difference between engineering cybernetics and servomechanisms engineering. A deeper - and thus more important - difference lies in the fact that engineering cybernetics is an engineering science, while servomechanisms engineering is an engineering practice."

"Two main lines are readily distinguished. One already well developed in the hands of von Bertalanffy and his co-workers, takes the world as we find it, examines the various systems that occur in it - zoological, physiological, and so on - and then draws up statements about the regularities that have been observed to hold. This method is essentially empirical. The second method is to start at the other end. Instead of studying first one system, then a second, then a third, and so on, it goes to the other extreme, considers the set of all conceivable systems and then reduces the set to a more reasonable size. This is the method I have recently followed."

"The primary fact is that all isolated state-determined dynamic systems are selective: from whatever state they have initially, they go towards states of equilibrium. These states of equilibrium are always characterised, in their relation to the change-inducing laws of the system, by being exceptionally resistant."

"It is worth stressing that once the entailment structure for a subject matter is available, together with its task structure, these can be used to design any kind of course or curriculum."

"An earlier paper (Pask, 1976) introduced conversational techniques, some involving a human participant in dialogue with a student, others involving a mechanically or computer implemented 'participant' through which the student 'talks to himself' under restrictions imposed by the device. In either case (human or mechanical monitoring) the subject matter of a conversation is represented in a liberally conceived, but standard, fashion, as a conversational domain consisting in an entailment structure (embodying one or more description schemes and indicating the many ways in which one topic may be known in terms of or derived from others) and behaviour graphs (one for each topic in the domain) that prescribe what may be done to model or explain the topic in question. Within this framework, the conversational techniques secure, or approximate, a standard condition for experiments on learning."