Electrical Engineers

"At present, a nonspecialist might well regard the Wiener-Kolmogorov theory of filtering and prediction [1, 2] as "classical' — in short, a field where the techniques are well established and only minor improvements and generalizations can be expected. That this is not really so can be seen convincingly from recent results of Shinbrot [3], Stceg [4], Pugachev [5, 6], and Parzen [7]. Using a variety of methods, these investigators have solved some long-stauding problems in nonstationary filtering and prediction theory. We present here a unified account of our own independent researches during the past two years (which overlap with much of the work [3-71 just mentioned), as well as numerous new results. We, too, use time-domain methods, and obtain major improvements and generalizations of the conventional Wiener theory. In particular, our methods apply without modification to multivariate problems."

"::(ii) Conditions which guarantee a priori the existence, physical realizability, and stability of the optimal filter."

"A of the Riccati type is derived for the covariance matrix of the optimal filtering error. The solution of this 'variance equation' completely specifies the optimal filter for either finite or infinite smoothing intervals and stationary or non-stationary statistics. The variance equation is closely related to the Hamiltonian (canonical) differential equations of the calculus of variations. Analytic solutions are available in some cases. The significance of the variance equation is illustrated by examples which duplicate, simplify, or extend earlier results in this field. The duality principle relating stochastic estimation and deterministic control problems plays an important role in the proof of theoretical results. In several examples, the estimation problem and its dual are discussed side-by-side. Properties of the variance equation are of great interest in the theory of s. Some aspects of this are considered briefly."

"Let me say quite categorically that there is no such thing as a fuzzy concept... We do talk about fuzzy things but they are not scientific concepts. Some people in the past have discovered certain interesting things, formulated their findings in a non-fuzzy way, and therefore we have progressed in science."

"I would like to comment briefly on Professor Zadeh's presentation. His proposals could be severely, ferociously, even brutally criticized from a technical point of view. This would be out of place here. But a blunt question remains: Is professor Zadeh presenting important ideas or is he indulging in wishful thinking? No doubt Professor Zadeh's enthusiasm for fuzziness has been reinforced by the prevailing climate in the U.S.-one of unprecedented permissiveness. 'Fuzzification, is a kind of scientific permissiveness; it tends to result in socially appealing slogans unaccompanied by the discipline of hard scientific work and patient observation."

"I have been aware from the outset (end of January 1959, the birthdate of the second paper in the citation) that the deep analysis of something which is now called were of major importance. But even with this immodesty I did not quite anticipate all the reactions to this work. Up to now there have been some 1000 related publications, at least two Citation Classics, etc. There is something to be explained. To look for an explanation, let me suggest a historical analogy, at the risk of further immodesty. I am thinking of Newton, and specifically his most spectacular achievement, the law of Gravitation. Newton received very ample "recognition" (as it is called today) for this work. it astounded - really floored - all his contemporaries. But I am quite sure, having studied the matter and having added something to it, that nobody then (1700) really understood what Newton's contribution was. Indeed, it seemed an absolute miracle to his contemporaries that someone, an Englishman, actually a human being, in some magic and un-understandable way, could harness mathematics, an impractical and eternal something, and so use mathematics as to discover with it something fundamental about the universe."

"I would like to comment briefly on Professor Zadeh's presentation. His proposals could be severely, ferociously, even brutally criticized from a technical point of view. This would be out of place here. But a blunt question remains: Is professor Zadeh presenting important ideas or is he indulging in wishful thinking? No doubt Professor Zadeh's enthusiasm for fuzziness has been reinforced by the prevailing climate in the U.S.-one of unprecedented permissiveness. 'Fuzzification, is a kind of scientific permissiveness; it tends to result in socially appealing slogans unaccompanied by the discipline of hard scientific work and patient observation."

"Conceptual graphs (CGs) (Sowa 1976; 1984) and fuzzy logic (Zadeh 1965; 1975a) are two logical formalisms that emphasize the target of natural language, each of which is focused on one of the two mentioned desired features of a logic for handling natural language. Conceptual graphs, based on semantic networks and Peirce's existential graphs, combine the visual advantage of graphical languages and the expressive power of logic."

"As an indispensable constituent of AI, fuzzy logic is a superset of conventional (Boolean) logic that has been extended to handle the concept of partial truth, where the truth value can range between completely true and completely false. As the creator of a new field of mathematics—fuzzy set theory and fuzzy logic—Lotfi Zadeh’s intellectual contributions are myriad. He is also known for his research in system theory, information processing, AI, expert systems, natural language understanding, and the theory of evidence. His current research is focused on fuzzy logic, computing with words, and soft computing, which is a coalition of fuzzy logic, neurocomputing, evolutionary computing, probabilistic computing, and parts of machine learning"

"I can't say that anything has been "exciting". Rather, I would choose the word "interesting". Not too long ago, the Chinese University of Hong Kong conducted a survey to determine which consumer products were using Fuzzy Logic. The result was a thick report, some 150-200 pages long-washing machines, camcorders, microwave ovens, etc. What interested me wasn't the particular applications so much as the breadth of applications-so many products were incorporating Fuzzy Logic."

"The term fuzzy logic is used in this paper to describe an imprecise logical system, FL, in which the truth-values are fuzzy subsets of the unit interval with linguistic labels such as true, false, not true, very true, quite true, not very true and not very fake, etc.... As a consequence, the truth tables and the rules of inference in fuzzy logic are (i) inexact and (ii) dependent on the meaning associated with the primary truth-value true as well as the modifiers very quite."

"Well, I knew it was going to be important. That much I knew. In fact, I had thought about sealing it in a dated envelope with my predictions and then opening it 20-30 years later to see if my intuitions were right. I realized this paper marked a new direction. I used to think about it this way-that one day Fuzzy Logic would turn out to be one of the most important things to come out of our Electrical Engineering Computer Systems Division at Berkeley. I never dreamed it would become a worldwide phenomenon. My expectations were much more modest."

"In many, many fields. I expected people in the social sciences-economics, psychology, philosophy, linguistics, politics, sociology, religion and numerous other areas to pick up on it. It's been somewhat of a mystery to me why even to this day, so few social scientists have discovered how useful it could be. Instead, Fuzzy Logic was first embraced by engineers and used in industrial process controls and in "smart" consumer products such as hand-held camcorders that cancel out jittering and microwaves that cook your food perfectly at the touch of a single button. I didn't expect it to play out this way back in 1965."

"Essentially, a fuzzy algorithm is an ordered sequence of instructions (like a computer program) in which some of the instructions may contain labels or fuzzy sets, e.g.: Reduce x slightly if y is very large Increase x very slightly if y is not very large and not very small If x is small then stop; otherwise increase x by 2."

"The question really isn't whether I'm American, Russian, Iranian, Azerbaijani, or anything else. I've been shaped by all these people and cultures and I feel quite comfortable among all of them."

"A frequent source of misunderstanding has to do with the interpretation of fuzzy logic. The problem is that the term fuzzy logic has two different meanings. More specifically, in a narrow sense, fuzzy logic, FLn, is a logical system which may be viewed as an extension and generalization of classical multivalued logics. But in a wider sense, fuzzy logic, FLw is almost synonymous with the theory of fuzzy sets. In this context, what is important to recognize is that: (a) FLw is much broader than FLn and subsumes FLn as one of its branches; (b) the agenda of FLn is very different from the agendas of classical multivalued logics; and (c) at this juncture, the term fuzzy logic is usually used in its wide rather than narrow sense, effectively equating fuzzy logic with FLw"

"A linguistic variable is a variable whose values are words or sentences in a natural or synthetic language."

"The advent of the Computer age has stimulated a rapid expansion in the use of quantitative techniques for the analysis of economic, urban, social, biological and other types of systems in which it is the animate rather than in dominant role. At present, most of the techniques employed for the analysis of humanistic, i.e., human centred systems are adaptations of the methods that have been developed over a long period of time for dealing with mechanistic systems, i.e., physical systems governed in the main by-the laws of mechanics, electromagnetism, and thermodynamics. The remarkable successes of these methods in unraveling the secrets of nature and enabling us to build better and better machines have inspired a widely held belief that the same or similar techniques can be applied with comparable effectiveness to the analysis of humanistic systems."

"[T]he successes of modern control theory in the design of highly accurate space navigation systems have stimulated its use in the theoretical analyses of economic and biological systems. Similarly, the effectiveness of computer simulation techniques in the macroscopic analyses of physical systems has brought into vogue the use of computer-based econometric models for purposes of forecasting, economic planning, arid management."

"To what degree is something true or false?"

"A fuzzy set is a class of objects with a continuum of grades of membership. Such a set is characterized by a membership (characteristic) function which assigns to each object a grade of membership ranging between zero and one. The notions of inclusion, union, intersection, complement, relation, convexity, etc., are extended to such sets, and various properties of these notions in the context of fuzzy sets are established. In particular, a separation theorem for convex fuzzy sets is proved without requiring that the fuzzy sets be disjoint."

"More often than not, the classes of objects encountered in the real physical world do not have precisely defined criteria of membership. For example, the class of animals clearly includes dogs, horses, birds, etc. as its members, and clearly excludes such objects as rocks, fluids, plants, etc. However, such objects as starfish, bacteria, etc. have an ambiguous status with respect to the class of animals. The same kind of ambiguity arises in the case of a number such as 10 in relation to the “class” of all real numbers which are much greater than 1."

"In general, complexity and precision bear an inverse relation to one another in the sense that, as the complexity of a problem increases, the possibility of analysing it in precise terms diminishes. Thus 'fuzzy thinking' may not be deplorable, after all, if it makes possible the solution of problems which are much too complex for precise analysis."

"It was a biologist — Ludwig von Bertalanffy — who long ago perceived the essential unity of system concepts and techniques in the various fields of science and who in writings and lectures sought to attain recognition for “general systems theory” as a distinct scientific discipline. It is pertinent to note, however, that the work of Bertalannfy and his school, being motivated primarily by problems arising in the study of biological systems, is much more empirical and qualitative in spirit than the work of those system theorists who received their training in exact sciences. In fact, there is a fairly wide gap between what might be regarded as “animate” system theorists and “inanimate” system theorists at the present time, and it is not at all certain that this gap will be narrowed, much less closed, in the near future. There are some who feel this gap reflects the fundamental inadequacy of the conventional mathematics—the mathematics of precisely defined points, functions, sets, probability measures, etc.—for coping with the analysis of biological systems, and that to deal effectively with such systems, we need a radically different kind of mathematics, the mathematics of fuzzy or cloudy quantities which are not describable in terms of probability distributions. Indeed the need for such mathematics is becoming increasingly apparent even in the realms of inanimate systems"

"[ Fuzzy logic is ] a logic whose distinguishing features are (i) fuzzy truth-values expressed in linguistic terms, e.g., true, very true, more or less true, or somewhat true, false, nor very true and not very false, etc2.; (2) imprecise truth tables; and (3) rules of inference whose validity is relative to a context rather than exact."

"A linguistic variable is defined as a variable whose values are sentences in a natural or artificial language."

"To date there seems to be only one serious attempt to create an artificially conscious entity. This is the goal of Igor Aleksander at Imperial College, where he has created an artificial neural net (ANN) called Magnus, designed to be conscious in the sense of being able to tell us what it is like to be Magnus."

"Dan Dennett once said that if he hadn't become a philosopher, he might have become an engineer. I think Igor has shown us that the gap between the two professions may be smaller than we think."

"Some researchers, such as Igor Aleksander, were even describing their laptops as conscious."

"Trying to understand the brain's abilities leads to philosophical difliculties. Penrose (1994) argues that the task is sterile and that science, including neural networks, has not yet advanced to the stage where it can explain conscious thought. At the other extreme there are philosophers such as Fodor (1975) who believed that thought has language-like properties and can be analysed in the same logical way as one can anlayse the structure of language."

"Consciousness is an incredibly delicate subject because it offend. It's a subject that scientific groups kept away from. They said it was a philosophical concept."

"A neural network is a massively parallel distributed processor that has a natural propensity for storing experiential knowledge and making it available for use. It resembles the brain in two respects: 1. Knowledge is acquired by the network through a learning process. 2. Interneuron connection strengths known as synaptic weights are used to store the knowledge."

"The point of a brain is that it's not one huge neural network with feedback, it has up to 50 to 60 identified areas, all of which have feedback and all of which are capable of knowledge storage. We've got a complex system and, within this complex system, we can start discovering what the mechanisms that support deliberation are. Consciousness must come out of these interactions."

"I am not interested so much in behaviour from which you infer consciousness because that is a mug's game. I don't know whether you're conscious. I take a good guess that you are and you can take a good guess that I am but it's not something you can prove. We can't work out what someone else feels."

"Neural computing is the study of cellular networks that have a natural property for storing experimental knowledge. Such systems bear a resemblance to the brain in the sense that knowledge is acquired through training rather than programming and is retained due to changes in node functions. The knowledge takes the form of stable states or cycles of states in the operation of the et. A central property of such nets is to recall these states or cycles in response to the presentation of cues."

"An opportunity for cybernetics to change the course of the philosophy of mind was missed when intentionality was misinterpreted as "the providing of coded knowledge"."

"Machine consciousness refers to attempts by those who design and analyse informational machines to apply their methods to various ways of understanding consciousness and to examine the possible role of consciousness in informational machines."

"Neural Computing is the study of networks of adaptable nodes which through a process of learning from task examples, store experiential knowledge and make it available for use."

"A.D. Hall's (1962) classic account of the methodology was based on his experience with the Bell Telephone Laboratories. Hall sees systems as existing in hierarchies. In systems engineering, plans to achieve a general objective must similarly be arranged in a hierarchy, with the systems engineer ensuring the internal consistency and integration of the plans, The methodology itself ensures the optimization of the system of concern with respect to its objectives. This requires a number of steps, the most important being problem definition, choosing objectives, systems synthesis, systems analysis, systems selection, system development, and current engineering. With Hall, the system of concern is usually a physical entity."

"The motives for conceiving modern systems engineering are to be found, at least in part, in past disasters. Arthur D. Hall III [1989] cites: the chemical plant leakage in Bhopal (1986); the explosion of the NASA Challenger space shuttle (1986) and the Apollo fire (1967); the sinking of the Titanic (1912); the nuclear explosion in Chernobyl (1986) and the disaster at Three Mile Island power plant (1979). He cites, too, the capture of markets by Japan from the U.S., the decline in US productivity and the failure of the US secondary school system. He identifies the millions of people dying of starvation every year while other nations stockpile surplus food, medical disasters such as heart disease, while governments subsidize grains used to produce high cholesterol meat, milk and eggs; and many more. One implication is clear: systems engineering faces challenges well beyond the sphere of engineering."

"The basic functional elements of any automatic control system: sensing, converting, storing, communicating, computing, programming, regulating, actuating, and display (Chestnut, 1967). Many kinds of systems in being, speculated about, or even intuited, ranging from computers, most factory processes, communication systems, road networks, automatic farms, etc., have structures which can be invoked as zero-order matches to proposed sets of throughputs, especially for single- thread designs. This method of structuring is related closely to analogical design, of which a special form is called synectics."

"Arthur D. Hall (1962) identified five traits of the ideal systems engineer and these certainly still stand today; these traits are: (1) an affinity for the systems … (2) faculty of judgment, (3) creativity, (4) facility in human relations, and (5) a for expression. The specific role of the systems engineer has traditionally been rather inwardly focused, with considerations to environment and external systems. In this broader field of Engineering Systems, the systems engineering practitioners may need to re-evaluate their roles and responsibilities in the overall systems effort."

"The operational sciences hoped to nourish business management, which however largely ignored them, and the latter continues to be undernourished by the business schools which are fairly broad but shallow everywhere. By over focus on short-range financial values, business management in the United States has lost a dozen major markets to the Japanese, added pollution in all its forms, and enriched itself out of all proportion to its value as just one factor of production. Action science, developed by the social sciences over many years in relative isolation from the applied physical sciences, and which might otherwise have humanized them and made engineering more productive, was doomed to fail by being on one end of the two-culture problem wherein science and the humanities do not even speak the same language. I could go on listing a few dozen paradigms: art, law, computer software design, medicine, politics, and architecture, each addressed to a certain context, level, or phase, each good in itself, but each limited to the fields of its origin and its purposes. The methodological problem is the same as if, in designing any large system, each subsystem designer were left to design each subsystem to the best requirements he knew. The overall requirement might not be met; overall harmony could not be achieved, and conflict could ensue to cause failure at the system level. What is envisioned is a new synthesis, a unified, efficient, systems methodology (SM): a multiphase, multi-level, multi-paradigmatic creative problem-solving process for use by individuals, by small groups, by large multi-disciplinary teams, or by teams of teams. It satisfies human needs in seeking value truths by matching the properties of wanted systems, and their parts, to perform harmoniously with their full environments, over their entire life cycles"

"Has mankind evolved to a point that there exists, or that with creative additions and re-combinations of modest proportions, there can be shown to be available, a common systems methodology, in terms of which we can conceive of, plan, design, construct, and use systems (procedures, machines, teams of people) of any arbitrary type in the service of mankind, and with low rates of failure?"

"History becomes one model needed to give a rounded view of our subject within the philosophy of hierarchical holographic modeling, defined as using a family of models at several levels to seek understanding of diverse aspects of a subject and thus comprehend the whole."

"For a given system, the environment is the set of all objects outside the system: (1) a change in whose attributes affect the system and (2) whose attributes are changed by the behavior of the system."

"Every part of the system is so related to every other part that a change in a particular part causes a changes in all other parts and in the total system"

"It is hard to say whether increasing complexity is the cause or the effect of man's effort to cope with his expanding environment. In either case a central feature of the trend has been the development of large and very complex systems which tie together modern society. These systems include abstract or non-physical systems, such as government and the economic system. They also include large physical systems like pipe line and power distribution systems, transportation and electrical communication systems. The growth of these systems has increased the need not only for over-all planning, but also for long-range development of the systems. This need has induced increased interest in the methods by which efficient planning and design can be accomplished in complex situations where no one scientific discipline can account for all the factors. Two similar disciplines which emerged about the time of World War II to cope with these problems are called systems engineering and operations research."

"A system is a set of objects with relationships between the … in may be described generally as a complex of elements or components directly or indirectly related in a causal network, … Also, we are mainly interested in systems within which some process is continually going on, including an interchange with an environment across the boundary. It is generally agreed that when we deal with the more open system with a highly flexible structure, the distinction between the boundaries and the environment becomes a more and more arbitrary matter, dependent upon the purpose of the observer."

"In our definition of system we noted that all systems have interrelationships between objects and between their attributes. If every part of the system is so related to every other part that any change in one aspect results in dynamic changes in all other parts of the total system, the system is said to behave as a whole or coherently. At the other extreme is a set of parts that are completely unrelated: that is, a change in each part depends only on that part alone. The variation in the set is the physical sum of the variations of the parts. Such behavior is called independent or physical summativity."