🕸Systems Engineering: Sensitivity (Just the Quotes)

"An exceedingly small cause which escapes our notice determines a considerable effect that we cannot fail to see, and then we say the effect is due to chance. If we knew exactly the laws of nature and the situation of the universe at the initial moment, we could predict exactly the situation of that same universe at a succeeding moment. But even if it were the case that the natural laws had no longer any secret for us, we could still only know the initial situation 'approximately'. If that enabled us to predict the succeeding situation with 'the same approximation', that is all we require, and we should say that the phenomenon had been predicted, that it is governed by laws. But it is not always so; it may happen that small differences in the initial conditions produce very great ones in the final phenomena. A small error in the former will produce an enormous error in the latter. Prediction becomes impossible, and we have the fortuitous phenomenon. (Jules H Poincaré, "Science and Method", 1908)

"The predictions of physical theories for the most part concern situations where initial conditions can be precisely specified. If such initial conditions are not found in nature, they can be arranged." (Anatol Rapoport, "The Search for Simplicity", 1956)

"[...] the influence of a single butterfly is not only a fine detail - it is confined to a small volume. Some of the numerical methods which seem to be well adapted for examining the intensification of errors are not suitable for studying the dispersion of errors from restricted to unrestricted regions. One hypothesis, unconfirmed, is that the influence of a butterfly's wings will spread in turbulent air, but not in calm air." (Edward N Lorenz, [talk] 1972)

"Everywhere […] in the Universe, we discern that closed physical systems evolve in the same sense from ordered states towards a state of complete disorder called thermal equilibrium. This cannot be a consequence of known laws of change, since […] these laws are time symmetric- they permit […] time-reverse. […] The initial conditions play a decisive role in endowing the world with its sense of temporal direction. […] some prescription for initial conditions is crucial if we are to understand […]" (John D Barrow, "Theories of Everything: The Quest for Ultimate Explanation", 1991)

"In nonlinear systems - and the economy is most certainly nonlinear - chaos theory tells you that the slightest uncertainty in your knowledge of the initial conditions will often grow inexorably. After a while, your predictions are nonsense." (M Mitchell Waldrop, "Complexity: The Emerging Science at the Edge of Order and Chaos", 1992)

"In the everyday world of human affairs, no one is surprised to learn that a tiny event over here can have an enormous effect over there. For want of a nail, the shoe was lost, et cetera. But when the physicists started paying serious attention to nonlinear systems in their own domain, they began to realize just how profound a principle this really was. […] Tiny perturbations won't always remain tiny. Under the right circumstances, the slightest uncertainty can grow until the system's future becomes utterly unpredictable - or, in a word, chaotic." (M Mitchell Waldrop, "Complexity: The Emerging Science at the Edge of Order and Chaos", 1992)

"Symmetry breaking in psychology is governed by the nonlinear causality of complex systems (the 'butterfly effect'), which roughly means that a small cause can have a big effect. Tiny details of initial individual perspectives, but also cognitive prejudices, may 'enslave' the other modes and lead to one dominant view." (Klaus Mainzer, "Thinking in Complexity", 1994)

"How surprising it is that the laws of nature and the initial conditions of the universe should allow for the existence of beings who could observe it. Life as we know it would be impossible if any one of several physical quantities had slightly different values." (Steven Weinberg, "Life in the Quantum Universe", Scientific American, 1995)

"Unlike classical mathematics, net math exhibits nonintuitive traits. In general, small variations in input in an interacting swarm can produce huge variations in output. Effects are disproportional to causes - the butterfly effect." (Kevin Kelly, "Out of Control: The New Biology of Machines, Social Systems and the Economic World", 1995)

"Swarm systems generate novelty for three reasons: (1) They are 'sensitive to initial conditions' - a scientific shorthand for saying that the size of the effect is not proportional to the size of the cause - so they can make a surprising mountain out of a molehill. (2) They hide countless novel possibilities in the exponential combinations of many interlinked individuals. (3) They don’t reckon individuals, so therefore individual variation and imperfection can be allowed. In swarm systems with heritability, individual variation and imperfection will lead to perpetual novelty, or what we call evolution." (Kevin Kelly, "Out of Control: The New Biology of Machines, Social Systems and the Economic World", 1995)

"Chaos theory reconciles our intuitive sense of free will with the deterministic laws of nature. However, it has an even deeper philosophical ramification. Not only do we have freedom to control our actions, but also the sensitivity to initial conditions implies that even our smallest act can drastically alter the course of history, for better or for worse. Like the butterfly flapping its wings, the results of our behavior are amplified with each day that passes, eventually producing a completely different world than would have existed in our absence!" (Julien C Sprott, "Strange Attractors: Creating Patterns in Chaos", 2000)

"A sudden change in the evolutive dynamics of a system (a ‘surprise’) can emerge, apparently violating a symmetrical law that was formulated by making a reduction on some (or many) finite sequences of numerical data. This is the crucial point. As we have said on a number of occasions, complexity emerges as a breakdown of symmetry (a system that, by evolving with continuity, suddenly passes from one attractor to another) in laws which, expressed in mathematical form, are symmetrical. Nonetheless, this breakdown happens. It is the surprise, the paradox, a sort of butterfly effect that can highlight small differences between numbers that are very close to one another in the continuum of real numbers; differences that may evade the experimental interpretation of data, but that may increasingly amplify in the system’s dynamics." (Cristoforo S Bertuglia & Franco Vaio, "Nonlinearity, Chaos, and Complexity: The Dynamics of Natural and Social Systems", 2003)

"[…] we would like to observe that the butterfly effect lies at the root of many events which we call random. The final result of throwing a dice depends on the position of the hand throwing it, on the air resistance, on the base that the die falls on, and on many other factors. The result appears random because we are not able to take into account all of these factors with sufficient accuracy. Even the tiniest bump on the table and the most imperceptible move of the wrist affect the position in which the die finally lands. It would be reasonable to assume that chaos lies at the root of all random phenomena." (Iwo Białynicki-Birula & Iwona Białynicka-Birula, "Modeling Reality: How Computers Mirror Life", 2004)

"Yet, with the discovery of the butterfly effect in chaos theory, it is now understood that there is some emergent order over time even in weather occurrence, so that weather prediction is not next to being impossible as was once thought, although the science of meteorology is far from the state of perfection." (Peter Baofu, "The Future of Complexity: Conceiving a Better Way to Understand Order and Chaos", 2007)

"The butterfly effect demonstrates that complex dynamical systems are highly responsive and interconnected webs of feedback loops. It reminds us that we live in a highly interconnected world. Thus our actions within an organization can lead to a range of unpredicted responses and unexpected outcomes. This seriously calls into doubt the wisdom of believing that a major organizational change intervention will necessarily achieve its pre-planned and highly desired outcomes. Small changes in the social, technological, political, ecological or economic conditions can have major implications over time for organizations, communities, societies and even nations." (Elizabeth McMillan, "Complexity, Management and the Dynamics of Change: Challenges for practice", 2008)

"The 'butterfly effect' is at most a hypothesis, and it was certainly not Lorenz’s intention to change it to a metaphor for the importance of small event. […] Dynamical systems that exhibit sensitive dependence on initial conditions produce remarkably different solutions for two initial values that are close to each other. Sensitive dependence on initial conditions is one of the properties to exhibit chaotic behavior. In addition, at least one further implicit assumption is that the system is bounded in some finite region, i.e., the system cannot blow up. When one uses expanding dynamics, a way of pull-back of too much expanded phase volume to some finite domain is necessary to get chaos." (Péter Érdi, "Complexity Explained", 2008)

"One of the remarkable features of these complex systems created by replicator dynamics is that infinitesimal differences in starting positions create vastly different patterns. This sensitive dependence on initial conditions is often called the butterfly - effect aspect of complex systems - small changes in the replicator dynamics or in the starting point can lead to enormous differences in outcome, and they change one’s view of how robust the current reality is. If it is complex, one small change could have led to a reality that is quite different." (David Colander & Roland Kupers, "Complexity and the art of public policy : solving society’s problems from the bottom up", 2014)

More quotes on the "Sensitivity of initial conditions" (aka "The Butterfly Effect") at the-web-of-knowledge.blogspot.com.

🕸Systems Engineering: Equilibrium (Just the Quotes)

"We cannot prevent equilibrium from producing its effects. We may brave human laws, but we cannot resist natural ones." (Jules Verne, "Twenty Thousand Leagues Under the Sea", 1870)

"Every situation is an equilibrium of forces; every life is a struggle between opposing forces working within the limits of a certain equilibrium." (Henri-Frédéric Amiel, "Amiel's Journal", 1885)

"Plasticity, then, in the wide sense of the word, means the possession of a structure weak enough to yield to an influence, but strong enough not to yield all at once. Each relatively stable phase of equilibrium in such a structure is marked by what we may call a new set of habits." (William James, "The Laws of Habit", 1887)

"Every change of one of the factors of an equilibrium occasions a rearrangement of the system in such a direction that the factor in question experiences a change in a sense opposite to the original change." (Henri L Le Chatelier, "Recherches Experimentales et Theoriques sur les Equilibres Chimiques" ["Experimental and Theoretical Research on Chemical Equilibria"], Annales des Mines 8, 1888)

"In every symmetrical system every deformation that tends to destroy the symmetry is complemented by an equal and opposite deformation that tends to restore it. […] One condition, therefore, though not an absolutely sufficient one, that a maximum or minimum of work corresponds to the form of equilibrium, is thus applied by symmetry." (Ernst Mach, "The Science of Mechanics: A Critical and Historical Account of Its Development", 1893)

"We rise from the conception of form to an understanding of the forces which gave rise to it [...] in the representation of form we see a diagram of forces in equilibrium, and in the comparison of kindred forms we discern the magnitude and the direction of the forces which have sufficed to convert the one form into the other." (D'Arcy Wentworth Thompson, "On Growth and Form" Vol. 2, 1917)

"What in the whole denotes a causal equilibrium process, appears for the part as a teleological event." (Ludwig von Bertalanffy, 1929)

"True equilibria can occur only in closed systems and that, in open systems, disequilibria called ‘steady states’, or ‘flow equilibria’ are the predominant and characteristic feature. According to the second law of thermodynamics a closed system must eventually attain a time-independent equilibrium state, with maximum entropy and minimum free energy. An open system may, under certain conditions, attain a time-independent state where the system remains constant as a whole and in its phases, though there is a continuous flow of component materials. This is called a steady state. Steady states are irreversible as a whole. […] A closed system in equilibrium does not need energy for its preservation, nor can energy be obtained from it. In order to perform work, a system must be in disequilibrium, tending toward equilibrium and maintaining a steady state, Therefore the character of an open system is the necessary condition for the continuous working capacity of the organism." (Ludwig on Bertalanffy, "Theoretische Biologie: Band 1: Allgemeine Theorie, Physikochemie, Aufbau und Entwicklung des Organismus", 1932)

"A state of equilibrium in a system does not mean, further, that the system is without tension. Systems can, on the contrary, also come to equilibrium in a state of tension (e.g., a spring under tension or a container with gas under pressure).The occurrence of this sort of system, however, presupposes a certain firmness of boundaries and actual segregation of the system from its environment (both of these in a functional, not a spatial, sense). If the different parts of the system are insufficiently cohesive to withstand the forces working toward displacement (i.e., if the system shows insufficient internal firmness, if it is fluid), or if the system is not segregated from its environment by sufficiently firm walls but is open to its neighboring systems, stationary tensions cannot occur. Instead, there occurs a process in the direction of the forces, which encroaches upon the neighboring regions with diffusion of energy and which goes in the direction of an equilibrium at a lower level of tension in the total region. The presupposition for the existence of a stationary state of tension is thus a certain firmness of the system in question, whether this be its own inner firmness or the firmness of its walls." (Kurt Lewin, "A Dynamic Theory of Personality", 1935)

"The process moves in the direction of a state of equilibrium only for the system as a whole. Part processes may at the same time go on in opposed directions, a circumstance which is of the greatest significance for, for example, the theory of detour behavior. It is hence important to take the system whole which is dominant at the moment as basis." (Kurt Lewin, "A Dynamic Theory of Personality", 1935)

"One may generalize upon these processes in terms of group equilibrium. The group may be said to be in equilibrium when the interactions of its members fall into the customary pattern through which group activities are and have been organized. The pattern of interactions may undergo certain modifications without upsetting the group equilibrium, but abrupt and drastic changes destroy the equilibrium." (William F Whyte, "Street Corner Society", 1943)

"The behavior of two individuals, consisting of effort which results in output, is considered to be determined by a satisfaction function which depends on remuneration (receiving part of the output) and on the effort expended. The total output of the two individuals is not additive, that is, together they produce in general more than separately. Each individual behaves in a way which he considers will maximize his satisfaction function. Conditions are deduced for a certain relative equilibrium and for the stability of this equilibrium, i.e., conditions under which it will not pay the individual to decrease his efforts. In the absence of such conditions ‘exploitation’ occurs which may or may not lead to total parasitism." (Anatol Rapoport, "Mathematical theory of motivation interactions of two individuals," The Bulletin of Mathematical Biophysics 9, 1947)

"The study of the conditions for change begins appropriately with an analysis of the conditions for no change, that is, for the state of equilibrium." (Kurt Lewin, "Quasi-Stationary Social Equilibria and the Problem of Permanent Change", 1947)

"Now a system is said to be at equilibrium when it has no further tendency to change its properties." (Walter J Moore, "Physical chemistry", 1950)

"Physical irreversibility manifests itself in the fact that, whenever the system is in a state far removed from equilibrium, it is much more likely to move toward equilibrium, than in the opposite direction." (William Feller, "An Introduction To Probability Theory And Its Applications", 1950)

"Equilibrium requires that the whole of the structure, the form of its elements, and the means of interconnection be so combined that at the supports there will automatically be produced passive forces or reactions that are able to balance the forces acting upon the structures, including the force of its own weight."  (Eduardo Torroja, "Philosophy of Structure", 1951) 

"[…] there are three different but interconnected conceptions to be considered in every structure, and in every structural element involved: equilibrium, resistance, and stability." (Eduardo Torroja, "Philosophy of Structure" , 1951) 

"Every stable system has the property that if displaced from a state of equilibrium and released, the subsequent movement is so matched to the initial displacement that the system is brought back to the state of equilibrium. A variety of disturbances will therefore evoke a variety of matched reactions." (W Ross Ashby, "Design for a Brain: The Origin of Adaptive Behavior", 1952)

"The primary fact is that all isolated state-determined dynamic systems are selective: from whatever state they have initially, they go towards states of equilibrium. These states of equilibrium are always characterised, in their relation to the change-inducing laws of the system, by being exceptionally resistant." (W Ross Ashby, "Design for a Brain: The Origin of Adaptive Behavior", 1952)

"As shorthand, when the phenomena are suitably simple, words such as equilibrium and stability are of great value and convenience. Nevertheless, it should be always borne in mind that they are mere shorthand, and that the phenomena will not always have the simplicity that these words presuppose." (W Ross Ashby, "An Introduction to Cybernetics", 1956)

"Reversible processes are not, in fact, processes at all, they are sequences of states of equilibrium. The processes which we encounter in real life are always irreversible processes." (Arnold Sommerfeld, "Thermodynamics and Statistical Mechanics", Lectures on Theoretical - Physics Vol. V, 1956)

"The static stability of a system is defined by the initial tendency to return to equilibrium conditions following some disturbance from equilibrium. […] If the object has a tendency to continue in the direction of disturbance, negative static stability or static instability exists. […] If the object subject to disturbance has neither the tendency to return nor the tendency to continue in the displacement direction, neutral static stability exists." (Hugh H Hurt, "Aerodynamics for Naval Aviators", 1960)

"While static stability is concerned with the tendency of a displaced body to return to equilibrium, dynamic stability is concerned with the resulting motion with time. If an object is disturbed from equilibrium, the time history of the resulting motion indicates the dynamic stability of the system. In general, the system will demonstrate positive dynamic stability if the amplitude of the motion decreases with time." (Hugh H Hurt, "Aerodynamics for Naval Aviators", 1960)

"[The equilibrium model describes systems] which, in moving to an equilibrium point, typically lose organization, and then tend to hold that minimum level within relatively narrow conditions of disturbance." (Walter F Buckley, "Sociology and modern systems theory", 1967)

"A system is in equilibrium when the forces constituting it are arranged in such a way as to compensate each other, like the two weights pulling at the arms of a pair of scales." (Rudolf Arnheim, "Entropy and Art: An Essay on Disorder and Order", 1971) 

"When matter is becoming disturbed by non-equilibrium conditions it organizes itself, it wakes up. It happens that our world is a non-equilibrium system." (Ilya Prigogine, "Thermodynamics of Evolution", 1972) 

"In an isolated system, which cannot exchange energy and matter with the surroundings, this tendency is expressed in terms of a function of the macroscopic state of the system: the entropy." (Ilya Prigogine, "Thermodynamics of Evolution", 1972) 

"Chance is commonly viewed as a self-correcting process in which a deviation in one direction induces a deviation in the opposite direction to restore the equilibrium. In fact, deviations are not 'corrected' as a chance process unfolds, they are merely diluted." (Amos Tversky, "Judgment Under Uncertainty: Heuristics and Biases", 1974)

"In any system governed by a potential, and in which the system's behavior is determined by no more than four different factors, only seven qualitatively different types of discontinuity are possible. In other words, while there are an infinite number of ways for such a system to change continuously (staying at or near equilibrium), there are only seven structurally stable ways for it to change discontinuously (passing through non-equilibrium states)." (Alexander Woodcock & Monte Davis, "Catastrophe Theory", 1978)

"All environmental areas, from the primeval forest to the large city, can be regarded as ecosystems and investigated accordingly, most of the attention being given to the lasting existence and functioning or 'equilibrium' of these systems." (Wolfgang Haber, Universitas: A Quarterly German Review of the Arts and Sciences Vol.26 (2), 1984)

"If a system is in a state of equilibrium (a steady state), then all sub-systems must be in equilibrium. If all sub-systems are in a state of equilibrium, then the system must be in equilibrium." (Barry Clemson, "Cybernetics: A New Management Tool", 1984)

"When loops are present, the network is no longer singly connected and local propagation schemes will invariably run into trouble. [...] If we ignore the existence of loops and permit the nodes to continue communicating with each other as if the network were singly connected, messages may circulate indefinitely around the loops and process may not converges to a stable equilibrium. […] Such oscillations do not normally occur in probabilistic networks […] which tend to bring all messages to some stable equilibrium as time goes on. However, this asymptotic equilibrium is not coherent, in the sense that it does not represent the posterior probabilities of all nodes of the network." (Judea Pearl, "Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference", 1988)

"Regarding stability, the state trajectories of a system tend to equilibrium. In the simplest case they converge to one point (or different points from different initial states), more commonly to one (or several, according to initial state) fixed point or limit cycle(s) or even torus(es) of characteristic equilibrial behaviour. All this is, in a rigorous sense, contingent upon describing a potential, as a special summation of the multitude of forces acting upon the state in question, and finding the fixed points, cycles, etc., to be minima of the potential function. It is often more convenient to use the equivalent jargon of 'attractors' so that the state of a system is 'attracted' to an equilibrial behaviour. In any case, once in equilibrial conditions, the system returns to its limit, equilibrial behaviour after small, arbitrary, and random perturbations." (Gordon Pask, "Different Kinds of Cybernetics", 1992)

"Systems, acting dynamically, produce (and incidentally, reproduce) their own boundaries, as structures which are complementary (necessarily so) to their motion and dynamics. They are liable, for all that, to instabilities chaos, as commonly interpreted of chaotic form, where nowadays, is remote from the random. Chaos is a peculiar situation in which the trajectories of a system, taken in the traditional sense, fail to converge as they approach their limit cycles or 'attractors' or 'equilibria'. Instead, they diverge, due to an increase, of indefinite magnitude, in amplification or gain." (Gordon Pask, "Different Kinds of Cybernetics", 1992)

"The model of competitive equilibrium which has been discussed so far is set in a timeless environment. People and companies all operate in a world in which there is no future and hence no uncertainty." (Paul Ormerod, "The Death of Economics", 1994)

"Self-organization refers to the spontaneous formation of patterns and pattern change in open, nonequilibrium systems. […] Self-organization provides a paradigm for behavior and cognition, as well as the structure and function of the nervous system. In contrast to a computer, which requires particular programs to produce particular results, the tendency for self-organization is intrinsic to natural systems under certain conditions." (J A Scott Kelso, "Dynamic Patterns : The Self-organization of Brain and Behavior", 1995)

"Contrary to what happens at equilibrium, or near equilibrium, systems far from equilibrium do not conform to any minimum principle that is valid for functions of free energy or entropy production." (Ilya Prigogine, "The End of Certainty: Time, Chaos, and the New Laws of Nature", 1996) 

"[…] self-organization is the spontaneous emergence of new structures and new forms of behavior in open systems far from equilibrium, characterized by internal feedback loops and described mathematically by nonlinear equations.” (Fritjof Capra, “The web of life: a new scientific understanding of living systems”, 1996)

"Complex systems operate under conditions far from equilibrium. Complex systems need a constant flow of energy to change, evolve and survive as complex entities. Equilibrium, symmetry and complete stability mean death. Just as the flow, of energy is necessary to fight entropy and maintain the complex structure of the system, society can only survive as a process. It is defined not by its origins or its goals, but by what it is doing." (Paul Cilliers,"Complexity and Postmodernism: Understanding Complex Systems", 1998)

"An equilibrium is not always an optimum; it might not even be good. This may be the most important discovery of game theory." (Ivar Ekeland, "Le meilleur des mondes possibles" ["The Best of All Possible Worlds"], 2000)

"Positive feedbacks, when unchecked, can produce runaways until the deviation from equilibrium is so large that other effects can be abruptly triggered and lead to ruptures and crashes." (Didier Sornette, "Why Stock Markets Crash - Critical Events in Complex Systems", 2003)

"The players in a game are said to be in strategic equilibrium (or simply equilibrium) when their play is mutually optimal: when the actions and plans of each player are rational in the given strategic environment - i. e., when each knows the actions and plans of the others." (Robert Aumann, "War and Peace", 2005)

"The second law of thermodynamics states that in an isolated system, entropy can only increase, not decrease. Such systems evolve to their state of maximum entropy, or thermodynamic equilibrium. Therefore, physical self-organizing systems cannot be isolated: they require a constant input of matter or energy with low entropy, getting rid of the internally generated entropy through the output of heat ('dissipation'). This allows them to produce ‘dissipative structures’ which maintain far from thermodynamic equilibrium. Life is a clear example of order far from thermodynamic equilibrium." (Carlos Gershenson, "Design and Control of Self-organizing Systems", 2007)