A Software Engineer and data professional's blog on SQL, data, databases, data architectures, data management, programming, Software Engineering, Project Management, ERP implementation and other IT related topics.
Pages
- 🏠Home
- 🗃️Definitions
- 🔢SQL Server
- 🎞️SQL Server: VoD
- 🏭Fabric
- 🎞️Fabric: VoD
- ⚡Power BI
- 🎞️Power BI: VoD
- 📚Data
- 📚Engineering
- 📚Management
- 📚SQL Server
- 🎞️D365: VoD
- 📚Systems Thinking
- ✂...Quotes
- 🧾D365: GL
- 💸D365: AP
- 💰D365: AR
- 🏠D365: FA
- 👥D365: HR
- ⛓️D365: SCM
- 🔤Acronyms
- 🪢Experts
- 🔠Dataviz & BI
- 🔠D365
- 🔠Fabric
- 🔠Engineering
- 🔠Management
- 🔡Glossary
- 🌐Resources
- 🏺Dataviz
- 🗺️Social
- 📅Events
- ℹ️ About
29 January 2015
📊Business Intelligence: Descriptive Analytics (Definitions)
27 January 2015
📊Business Intelligence: Delta Lake (Definitions)
"Delta Lake, an open source ACID table storage layer over cloud object stores initially developed at Databricks." (Michael Armbrust et al, "Delta Lake: High-Performance ACID Table Storage over Cloud Object Stores", Proceedings of the VLDB Endowment 13(12), 2020) [link]
"Delta Lake is a transactional storage software layer that runs on top of an existing data lake and adds RDW-like features that improve the lake’s reliability, security, and performance. Delta Lake itself is not storage." (James Serra, "Deciphering Data Architectures", 2024)
"A Delta Lake is an open-source storage layer designed to run on top of an existing data lake and improve its reliability, security, and performance." (Hewlett Packard Enterprise) [source]
"Delta Lake is an open source storage framework that enables building a Lakehouse architecture with various compute engines." (Apache Druid) [source]
"Delta Lake is an open-source storage framework designed to improve performance and provide transactional guarantees to data lake tables." (lakeFS) [source]
"Delta Lake is an open-source storage framework that enables building a format agnostic Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, Hive, Snowflake, Google BigQuery, Athena, Redshift, Databricks, Azure Fabric and APIs for Scala, Java, Rust, and Python." (Delta) [source]
"Delta Lake is an open-source storage layer that uses the ACID compliance of transactional databases to bring reliability, performance, and flexibility to data lakes. It is ideal for scenarios where you need transactional capabilities and schema enforcement within your data lake." (Qlik) [source]
"Delta Lake is an open-source storage layer for big data workloads. It provides ACID transactions for batch/streaming data pipelines reading and writing data concurrently." (Database of Databases) [source]
"Delta Lake is the optimized storage layer that provides the foundation for tables in a lakehouse on Databricks. Delta Lake is open source software that extends Parquet data files with a file-based transaction log for ACID transactions and scalable metadata handling." (Databricks) [source]
"Delta Lake is the optimized storage layer that provides the foundation for tables in a lakehouse on Databricks. Delta Lake is open source software that extends Parquet data files with a file-based transaction log for ACID transactions and scalable metadata handling. Delta Lake is fully compatible with Apache Spark APIs, and was developed for tight integration with Structured Streaming, allowing you to easily use a single copy of data for both batch and streaming operations and providing incremental processing at scale." (Microsoft) [source]
25 January 2015
📊Business Intelligence: Prescriptive Analytics (Definitions)
20 January 2015
📊Business Intelligence: Business Analytics (Definitions)
"Meta-data that includes data definitions, report definitions, users, usage statistics, and performance statistics." (DAMA International, "The DAMA Dictionary of Data Management", 2011)
"Provides models, which are formulas or algorithms and procedures to BI." (Linda Volonino & Efraim Turban, "Information Technology for Management "8th Ed, 2011)
"The process of leveraging all forms of analytics to achieve business outcomes by requiring business relevancy, actionable insight, performance management, and value measurement." (Evan Stubbs, "Delivering Business Analytics: Practical Guidelines for Best Practice", 2013)
"Application of analytical tools to business questions. Business Analytics focuses on developing insights and understanding related to business performance using quantitative and statistical methods. Business Analytics includes Business Intelligence and Reporting." (Daniel J Power & Ciara Heavin, "Decision Support, Analytics, and Business Intelligence" 3rd Ed., 2017)
"BA is a data-driven decision making approach that uses statistical and quantitative analysis, information technology, and management science (mathematical modeling, simulation), along with data mining and fact-based data to measure past business performance to guide an organization in business planning and effective decision making." (Amar Sahay, "Business Analytics" Vol. I, 2018)
"Use of data and quantitative and qualitative tools and techniques to improve operations and to support business decision making. Emphasis on using statistical and management science techniques, including data mining, to develop predictive and prescriptive models." (Daniel J. Power & Ciara Heavin, "Data-Based Decision Making and Digital Transformation", 2018)
"Aggregated information on business processes that enables managers to analyze process trends, view performance metrics, and respond to organizational change." (Appian)
"Refers to the skills, technologies, and practices for investigation of past business performance to gain insight and drive business planning. It focuses on developing new insights and understanding of business performance based on data and statistical methods. While business intelligence (BI) focuses on a consistent set of metrics to both measure past performance and guide business planning, business analytics is focused on developing new insights and understanding based on statistical methods and predictive modeling." (Insight Software)
"Business Analytics describes the skills, technologies, statistical methods and data driven approaches used to explore and investigate past business performance to gain new insights that can support business planning." (Accenture)
"Business analytics is comprised of solutions used to build analysis models and simulations to create scenarios, understand realities and predict future states. Business analytics includes data mining, predictive analytics, applied analytics and statistics, and is delivered as an application suitable for a business user." (Gartner)
"Business analytics (BA) is the iterative, methodical exploration of an organization's data, with an emphasis on statistical analysis." (Techtarget) [source]
"Business Analytics is the process by which businesses use statistical methods and technologies for analyzing historical data in order to gain new insight and improve strategic decision-making." (OmiSci) [source]
"Business analytics is the process of gathering and processing all of your business data, and applying statistical models and iterative methodologies to translate that data into business insights." (Tibco) [source]
"Describes the skills, technologies, statistical methods and data driven approaches used to explore and investigate past business performance to gain new insights that can support business planning. Examples of business analytics tools include data visualization, business intelligence reporting and big data platforms." (Accenture)
17 January 2015
♜Strategic Management: Scenario Analysis (Definitions)
"The process of identifying and evaluating potential risks to your business, and how they might play out, before they occur." (Annetta Cortez & Bob Yehling, "The Complete Idiot's Guide® To Risk Management", 2010)
"A technique to evaluate scenarios in order to predict their effect on portfolio objectives." (Project Management Institute, "The Standard for Portfolio Management" 3rd Ed., 2012)
"Scenario analysis, or what-if analysis, assesses the potential outcome of various scenarios by setting up several possible situations and analyzing the potential outcomes of each situation." (Christopher Donohue et al, "Foundations of Financial Risk: An Overview of Financial Risk and Risk-based Financial Regulation" 2nd Ed., 2015)
"A scenario analysis involves changing parameters in a model and then examining the results. A tool that helps a user explore different scenarios by changing a range of input values." (Ciara Heavin & Daniel J Power, "Decision Support, Analytics, and Business Intelligence" 3rd Ed., 2017)
"A technique for integrating information and ideas on current trends and future developments into a small number of distinctly different future outcomes." (Robert M Grant, "Contemporary Strategy Analysis" 10th Ed, 2018)
15 January 2015
📊Business Intelligence: Key Performance Indicator [KPI] (Definitions)
📊Business Intelligence: Single Version of Truth [SVoT]/Single Source of Truth [SSoT] (Definitions)
10 January 2015
📊Business Intelligence: Self-Service BI (Definitions)
Self-service business intelligence (BI): "A self-service BI is a semantic layer that enables business users to perform ad hoc reporting and analysis with no IT intervention. Self-service BI helps in the higher adoption of BI solutions." (Saumya Chaki, "Enterprise Information Management in Practice", 2015)
Self-Service BI: "The activity of end users being self-sufficient in supplying themselves with Business Intelligence reports and/ or queries without having to rely on IT." (BI System Builders)
"Self-service
analytics or self-service business intelligence refers to tools used to connect
and analyze data, and which are operated primarily by business departments in
the organization – rather than IT professionals or dedicated data analysts." (Sisense)
[source]
"Self-service BI is a trend with a somewhat vague definition. In the most general sense, self-service BI tasks are those that business users carry out themselves instead of passing them on to IT for fulfillment. The aim is to give the users of BI tools more freedom and responsibility at the same time. At its heart lies the notion of user independence and self-sufficiency when it comes to the use of corporate information, which leads to a decentralization of BI in the organization." (BI Survey) [source]
"Self-service BI (business intelligence) is a software tool or application that empowers business users to analyze data, visualize insights, and obtain and share information in the form of reports and self-service BI dashboards – without the help of IT." (Logi Analytics) [source]
05 January 2015
📊Business Intelligence: Real-time Analytics [RTA] (Definitions)
"Real-time analytics (RTA) describes an approach to data processing that allows us to extract value from events as soon as they are made available." (Mark Needham, "Building Real-Time Analytics Systems: From Events to Insights with Apache Kafka and Apache Pinot", 2023)
"Real-time analytics involves the use of tools and techniques to analyze data immediately after it's collected, enabling decision-makers to draw insights and take action in real-time. It integrates, processes, and analyzes live data to support instantaneous decision making. It's characterized by low latency between when data enters the system and when it’s processed." (Dremio) [source]
"Real-Time Intelligence is a powerful service that empowers everyone in your organization to extract insights and visualize their data in motion. It offers an end-to-end solution for event-driven scenarios, streaming data, and data logs." (Microsoft) [source]
"Real-time analytics is a set of techniques for processing data as soon as it becomes available. The main goal is to provide fast and actionable insights." (MongoDB) [source]
"Real-time analytics is the analysis of data as soon as that data becomes available. In other words, users get insights or can draw conclusions immediately (or very rapidly after) the data enters their system." (Sisense) [source]
"Real-time analytics is the discipline that applies logic and mathematics to data to provide insights for making better decisions quickly. For some use cases, real time simply means the analytics is completed within a few seconds or minutes after the arrival of new data. On-demand real-time analytics waits for users or systems to request a query and then delivers the analytic results. Continuous real-time analytics is more proactive and alerts users or triggers responses as events happen." (Gartner) [source]
"Real-time analytics is the use of data and related resources for analysis as soon as it enters the system. The adjective real-time refers to a level of computer responsiveness that a user senses as immediate or nearly immediate." (Techtarget) [source]
"Real time analytics lets users see, analyze and understand data as it arrives in a system. Logic and mathematics are applied to the data so it can give users insights for making real-time decisions." (OmiSci) [source]
"Real-time analytics refers to the practice of collecting and analyzing streaming data as it is generated, with minimal latency between the generation of data and the analysis of that data." (Databricks) [source]
"The ability to use all available enterprise data as needed and usually involves streaming data that allows users to make business decisions on the fly." (Solutions Review)
02 January 2015
📊Business Intelligence: Decision Support System [DSS] (Definitions)
"Interactive computer-based systems intended to help decision makers utilize data and models to identify and solve problems and make decisions." (D J Power, "Decision Support Systems Hyperbook", 2000)
"The original name for data warehousing." (Ralph Kimball & Margy Ross, "The Data Warehouse Toolkit" 2nd Ed., 2002)
"The presentation of data to support management in making decisions." (William A Giovinazzo, "Internet-Enabled Business Intelligence", 2002)
"The automated process to provide facts and information to facilitate decision-making activities. Usually DSS involves the analysis of many units of data in a heuristic fashion." (Margaret Y Chu, "Blissful Data ", 2004)
"A system used to support managerial decisions. Usually DSS involves the analysis of many units of data in a heuristic fashion. As a rule, DSS processing does not involve the update of data." (William H Inmon, "Building the Data Warehouse", 2005)
"Commonly known as DSS databases, these support decisions, generally more management-level and even executive-level decision-type of objectives." (Gavin Powell, "Beginning Database Design", 2006)
"A system used to support managerial decisions. Usually DSS involves the analysis of many units of data in a heuristic fashion. As a rule, DSS processing does not involve the update of data." (William H Inmon & Anthony Nesavich, "Tapping into Unstructured Data", 2007)
"A branch of the broadly defined management information system (MIS). It is an information system that provides answers to problems and that integrates the decision maker into the system as a component. The system utilizes such quantitative techniques as regression and financial planning modeling. DSS software furnishes support to the accountant in the decision - making process." (Jae K Shim & Joel G Siegel, "Budgeting Basics and Beyond", 2008)
"An application that uses data to support managerial decisions through ad hoc query, summarization, drill-down analysis, trend analysis, exception identification and 'what if' scenario modeling." (DAMA International, "The DAMA Dictionary of Data Management", 2011)
"An arrangement of computerized tools used to assist managerial decision making within a business." (Carlos Coronel et al, "Database Systems: Design, Implementation, and Management" 9th Ed., 2011)
"Computer-based information system that combines models and data to solve semistructured and some unstructured problems with intensive user involvement." (Linda Volonino & Efraim Turban, "Information Technology for Management" 8th Ed., 2011)
"Information processing application used by managers and business professionals to analyze situations, monitor and compare performance data, highlight changes that require their attention, and to identify the more promising solutions. DSSs are one component of the overall MIS content for a business" (Kenneth A Shaw, "Integrated Management of Processes and Information", 2013)
"A DSS is an interactive computer-based system or subsystem intended to help decision makers use communications technologies, data, documents, knowledge, or models to identify and solve problems, complete decision process tasks, and make decisions." (Ciara Heavin & Daniel J Power, "Decision Support, Analytics, and Business Intelligence" 3rd Ed., 2017)
"A computer-based information system that supports individual or team decision making. Five primary types: communications-driven, data-driven, document-driven, knowledgedriven, and data-driven DSS." (Daniel J Power & Ciara Heavin, "Data-Based Decision Making and Digital Transformation", 2018)
"A coordinated assemblage of people, devices or other resources that analyzes, typically, business data and presents it so that users can make business decisions more easily." (GEMET - Environmental thesaurus)
"A computer system that provides managers with the tools they need to analyze information they deem relevant for a particular decision or class of decisions. Pearson, "Digital Planet: Tomorrow's Technology and You" 10th Ed.)
📊Business Intelligence: Business Intelligence [BI] (Definitions)
"An automatic system is being developed to disseminate information to the various sections of any industrial, scientific or government organization. This intelligence system will utilize data-processing machines for auto-abstracting and auto-encoding of documents and for creating interest profiles for each of the ‘action points’ in an organization. Both incoming and internally generated documents are automatically abstracted, characterized by a word pattern, and sent automatically to appropriate action points. […] All of these techniques are based on statistical procedures which can be performed on present-day data processing machines. Together with proper communication facilities and input-output equipment a comprehensive system may be assembled to accommodate all information problems of an organization. We call this a Business Intelligence System." (Hans P Luhn, "A Business Intelligence System", IBM Journal, 1958) [first usage of the term in modern context]
31 December 2014
🕸Systems Engineering: Limits (Just the Quotes)
"Every situation is an equilibrium of forces; every life is a struggle between opposing forces working within the limits of a certain equilibrium." (Henri-Frédéric Amiel, "Amiel's Journal", 1885)
"By some definitions 'systems engineering' is suggested to be a new discovery. Actually it is a common engineering approach which has taken on a new and important meaning because of the greater complexity and scope of problems to be solved in industry, business, and the military. Newly discovered scientific phenomena, new machines and equipment, greater speed of communications, increased production capacity, the demand for control over ever-extending areas under constantly changing conditions, and the resultant complex interactions, all have created a tremendously accelerating need for improved systems engineering. Systems engineering can be complex, but is simply defined as 'logical engineering within physical, economic and technical limits' - bridging the gap from fundamental laws to a practical operating system." (Instrumentation Technology, 1957)
"Clearly, if the state of the system is coupled to parameters of an environment and the state of the environment is made to modify parameters of the system, a learning process will occur. Such an arrangement will be called a Finite Learning Machine, since it has a definite capacity. It is, of course, an active learning mechanism which trades with its surroundings. Indeed it is the limit case of a self-organizing system which will appear in the network if the currency supply is generalized." (Gordon Pask, "The Natural History of Networks", 1960)
"Taking no action to solve these problems is equivalent of taking strong action. Every day of continued exponential growth brings the world system closer to the ultimate limits of that growth. A decision to do nothing is a decision to increase the risk of collapse." (Donella Meadows et al, "The Limits to Growth", 1972)
"Technology can relieve the symptoms of a problem without affecting the underlying causes. Faith in technology as the ultimate solution to all problems can thus divert our attention from the most fundamental problem - the problem of growth in a finite system." (Donella A Meadows, "The Limits to Growth", 1972)
"Every day of continued exponential growth brings the world system closer to the ultimate limits of that growth." (Mihajlo D Mesarovic, "Mankind at the Turning Point", 1974)
"In a loosely coupled system there is more room available for self-determination by the actors. If it is argued that a sense of efficacy is crucial for human beings. when a sense of efficacy might be greater in a loosely coupled system with autonomous units than it would be in a tightly coupled system where discretion is limited." (Karl E Weick, "Educational organizations as loosely coupled systems", 1976)
"The greater the uncertainty, the greater the amount of decision making and information processing. It is hypothesized that organizations have limited capacities to process information and adopt different organizing modes to deal with task uncertainty. Therefore, variations in organizing modes are actually variations in the capacity of organizations to process information and make decisions about events which cannot be anticipated in advance." (John K Galbraith, "Organization Design", 1977)
"Prediction of the future is possible only in systems that have stable parameters like celestial mechanics. The only reason why prediction is so successful in celestial mechanics is that the evolution of the solar system has ground to a halt in what is essentially a dynamic equilibrium with stable parameters. Evolutionary systems, however, by their very nature have unstable parameters. They are disequilibrium systems and in such systems our power of prediction, though not zero, is very limited because of the unpredictability of the parameters themselves. If, of course, it were possible to predict the change in the parameters, then there would be other parameters which were unchanged, but the search for ultimately stable parameters in evolutionary systems is futile, for they probably do not exist… Social systems have Heisenberg principles all over the place, for we cannot predict the future without changing it." (Kenneth E Boulding, Evolutionary Economics, 1981)
"Prediction of the future is possible only in systems that have stable parameters like celestial mechanics. The only reason why prediction is so successful in celestial mechanics is that the evolution of the solar system has ground to a halt in what is essentially a dynamic equilibrium with stable parameters. Evolutionary systems, however, by their very nature have unstable parameters. They are disequilibrium systems and in such systems our power of prediction, though not zero, is very limited because of the unpredictability of the parameters themselves. If, of course, it were possible to predict the change in the parameters, then there would be other parameters which were unchanged, but the search for ultimately stable parameters in evolutionary systems is futile, for they probably do not exist… Social systems have Heisenberg principles all over the place, for we cannot predict the future without changing it." (Kenneth E Boulding, "Evolutionary Economics", 1981)
"Cellular automata are discrete dynamical systems with simple construction but complex self-organizing behaviour. Evidence is presented that all one-dimensional cellular automata fall into four distinct universality classes. Characterizations of the structures generated in these classes are discussed. Three classes exhibit behaviour analogous to limit points, limit cycles and chaotic attractors. The fourth class is probably capable of universal computation, so that properties of its infinite time behaviour are undecidable." (Stephen Wolfram, "Nonlinear Phenomena, Universality and complexity in cellular automata", Physica 10D, 1984)
"Regarding stability, the state trajectories of a system tend to equilibrium. In the simplest case they converge to one point (or different points from different initial states), more commonly to one" (or several, according to initial state) fixed point or limit cycle(s) or even torus(es) of characteristic equilibrial behaviour. All this is, in a rigorous sense, contingent upon describing a potential, as a special summation of the multitude of forces acting upon the state in question, and finding the fixed points, cycles, etc., to be minima of the potential function. It is often more convenient to use the equivalent jargon of 'attractors' so that the state of a system is 'attracted' to an equilibrial behaviour. In any case, once in equilibrial conditions, the system returns to its limit, equilibrial behaviour after small, arbitrary, and random perturbations." (Gordon Pask, "Different Kinds of Cybernetics", 1992)
"Systems, acting dynamically, produce (and incidentally, reproduce) their own boundaries, as structures which are complementary (necessarily so) to their motion and dynamics. They are liable, for all that, to instabilities chaos, as commonly interpreted of chaotic form, where nowadays, is remote from the random. Chaos is a peculiar situation in which the trajectories of a system, taken in the traditional sense, fail to converge as they approach their limit cycles or 'attractors' or 'equilibria'. Instead, they diverge, due to an increase, of indefinite magnitude, in amplification or gain." (Gordon Pask, "Different Kinds of Cybernetics", 1992)
"As with subtle bifurcations, catastrophes also involve a control parameter. When the value of that parameter is below a bifurcation point, the system is dominated by one attractor. When the value of that parameter is above the bifurcation point, another attractor dominates. Thus the fundamental characteristic of a catastrophe is the sudden disappearance of one attractor and its basin, combined with the dominant emergence of another attractor. Any type of attractor static, periodic, or chaotic can be involved in this. Elementary catastrophe theory involves static attractors, such as points. Because multidimensional surfaces can also attract (together with attracting points on these surfaces), we refer to them more generally as attracting hypersurfaces, limit sets, or simply attractors." (Courtney Brown, "Chaos and Catastrophe Theories", 1995)
"In spite of the insurmountable computational limits, we continue to pursue the many problems that possess the characteristics of organized complexity. These problems are too important for our well being to give up on them. The main challenge in pursuing these problems narrows down fundamentally to one question: how to deal with systems and associated problems whose complexities are beyond our information processing limits? That is, how can we deal with these problems if no computational power alone is sufficient? " (George Klir, "Fuzzy sets and fuzzy logic", 1995)
"System dynamics models are not derived statistically from time-series data. Instead, they are statements about system structure and the policies that guide decisions. Models contain the assumptions being made about a system. A model is only as good as the expertise which lies behind its formulation. A good computer model is distinguished from a poor one by the degree to which it captures the essence of a system that it represents. Many other kinds of mathematical models are limited because they will not accept the multiple-feedback-loop and nonlinear nature of real systems." (Jay W Forrester, "Counterintuitive Behavior of Social Systems", 1995)
"The dimensionality and nonlinearity requirements of chaos do not guarantee its appearance. At best, these conditions allow it to occur, and even then under limited conditions relating to particular parameter values. But this does not imply that chaos is rare in the real world. Indeed, discoveries are being made constantly of either the clearly identifiable or arguably persuasive appearance of chaos. Most of these discoveries are being made with regard to physical systems, but the lack of similar discoveries involving human behavior is almost certainly due to the still developing nature of nonlinear analyses in the social sciences rather than the absence of chaos in the human setting. " (Courtney Brown, "Chaos and Catastrophe Theories", 1995)
"The only organization capable of unprejudiced growth, or unguided learning, is a network. All other topologies limit what can happen." (Kevin Kelly, "Out of Control: The New Biology of Machines, Social Systems and the Economic World", 1995)
"A standalone object, no matter how well designed, has limited potential for new weirdness. A connected object, one that is a node in a network that interacts in some way with other nodes, can give birth to a hundred unique relationships that it never could do while unconnected. Out of this tangle of possible links come myriad new niches for innovations and interactions." (Kevin Kelly, "New Rules for the New Economy: 10 radical strategies for a connected world", 1998)
"At present, there is far more to be gained by pushing the boundaries of what can be done by the bottom than by focusing on what can be done at the top. When it comes to control, there is plenty of room at the bottom. What we are discovering is that peer-based networks with millions of parts, minimal oversight, and maximum connection among them can do far more than anyone ever expected. We don’t yet know what the limits of decentralization are." (Kevin Kelly, "New Rules for the New Economy: 10 radical strategies for a connected world", 1998)
"Don’t solve problems; pursue opportunities. […] In both the short and long term, our ability to solve social and economic problems will be limited primarily to our lack of imagination in seizing opportunities, rather than trying to optimize solutions. There is more to be gained by producing more opportunities than by optimizing existing ones." (Kevin Kelly, "New Rules for the New Economy: 10 radical strategies for a connected world", 1998)
"Faced with the overwhelming complexity of the real world, time pressure, and limited cognitive capabilities, we are forced to fall back on rote procedures, habits, rules of thumb, and simple mental models to make decisions. Though we sometimes strive to make the best decisions we can, bounded rationality means we often systematically fall short, limiting our ability to learn from experience." (John D Sterman, "Business Dynamics: Systems thinking and modeling for a complex world", 2000)
"Changing measures are a particularly common problem with comparisons over time, but measures also can cause problems of their own. [...] We cannot talk about change without making comparisons over time. We cannot avoid such comparisons, nor should we want to. However, there are several basic problems that can affect statistics about change. It is important to consider the problems posed by changing - and sometimes unchanging - measures, and it is also important to recognize the limits of predictions. Claims about change deserve critical inspection; we need to ask ourselves whether apples are being compared to apples - or to very different objects." (Joel Best, "Damned Lies and Statistics: Untangling Numbers from the Media, Politicians, and Activists", 2001)
"Limiting factors in population dynamics play the role in ecology that friction does in physics. They stop exponential growth, not unlike the way in which friction stops uniform motion. Whether or not ecology is more like physics in a viscous liquid, when the growth-rate-based traditional view is sufficient, is an open question. We argue that this limit is an oversimplification, that populations do exhibit inertial properties that are noticeable. Note that the inclusion of inertia is a generalization—it does not exclude the regular rate-based, first-order theories. They may still be widely applicable under a strong immediate density dependence, acting like friction in physics." (Lev Ginzburg & Mark Colyvan, "Ecological Orbits: How Planets Move and Populations Grow", 2004)
"It is science that brings us an understanding of the true complexity of natural systems. The insights from the science of ecology are teaching us how to work with the checks and balances of nature, and encouraging a new, rational, limited-input, environmentally sound means of vineyard management that offers a third way between the ideologically driven approach of Biodynamics and conventional chemical-based agricultural systems." (Jamie Goode," The Science of Wine: From Vine to Glass", 2005)
"A great deal of the results in many areas of physics are presented in the form of conservation laws, stating that some quantities do not change during evolution of the system. However, the formulations in cybernetical physics are different. Since the results in cybernetical physics establish how the evolution of the system can be changed by control, they should be formulated as transformation laws, specifying the classes of changes in the evolution of the system attainable by control function from the given class, i.e., specifying the limits of control." (Alexander L Fradkov, "Cybernetical Physics: From Control of Chaos to Quantum Control", 2007)
"Humans have difficulty perceiving variables accurately […]. However, in general, they tend to have inaccurate perceptions of system states, including past, current, and future states. This is due, in part, to limited ‘mental models’ of the phenomena of interest in terms of both how things work and how to influence things. Consequently, people have difficulty determining the full implications of what is known, as well as considering future contingencies for potential systems states and the long-term value of addressing these contingencies." (William B. Rouse, "People and Organizations: Explorations of Human-Centered Design", 2007)
"The methodology of feedback design is borrowed from cybernetics (control theory). It is based upon methods of controlled system model’s building, methods of system states and parameters estimation (identification), and methods of feedback synthesis. The models of controlled system used in cybernetics differ from conventional models of physics and mechanics in that they have explicitly specified inputs and outputs. Unlike conventional physics results, often formulated as conservation laws, the results of cybernetical physics are formulated in the form of transformation laws, establishing the possibilities and limits of changing properties of a physical system by means of control." (Alexander L Fradkov, "Cybernetical Physics: From Control of Chaos to Quantum Control", 2007)
"[…] our mental models fail to take into account the complications of the real world - at least those ways that one can see from a systems perspective. It is a warning list. Here is where hidden snags lie. You can’t navigate well in an interconnected, feedback-dominated world unless you take your eyes off short-term events and look for long-term behavior and structure; unless you are aware of false boundaries and bounded rationality; unless you take into account limiting factors, nonlinearities and delays. You are likely to mistreat, misdesign, or misread systems if you don’t respect their properties of resilience, self-organization, and hierarchy." (Donella H Meadows, "Thinking in Systems: A Primer", 2008)
"A quantity growing exponentially toward a limit reaches that limit in a surprisingly short time." (Donella Meadows, "Thinking in systems: A Primer", 2008)
"The other element of systems thinking is learning to influence the system with reinforcing feedback as an engine for growth or decline. [...] Without this kind of understanding, managers will hit blockages in the form of seeming limits to growth and resistance to change because the large complex system will appear impossible to manage. Systems thinking is a significant solution." (Richard L Daft, "The Leadership Experience" 4th Ed., 2008)
"This new model of development would be based clearly on the goal of sustainable human well-being. It would use measures of progress that clearly acknowledge this goal. It would acknowledge the importance of ecological sustainability, social fairness, and real economic efficiency. Ecological sustainability implies recognizing that natural and social capital are not infinitely substitutable for built and human capital, and that real biophysical limits exist to the expansion of the market economy." (Robert Costanza, "Toward a New Sustainable Economy", 2008)
"You can’t navigate well in an interconnected, feedback-dominated world unless you take your eyes off short-term events and look for long term behavior and structure; unless you are aware of false boundaries and bounded rationality; unless you take into account limiting factors, nonlinearities and delays." (Donella H Meadow, "Thinking in Systems: A Primer", 2008)
"A model is a representation in that it (or its properties) is chosen to stand for some other entity (or its properties), known as the target system. A model is a tool in that it is used in the service of particular goals or purposes; typically these purposes involve answering some limited range of questions about the target system." (Wendy S Parker, "Confirmation and Adequacy-for-Purpose in Climate Modelling", Proceedings of the Aristotelian Society, Supplementary Volumes, Vol. 83, 2009)
"Strange attractors, unlike regular ones, are geometrically very complicated, as revealed by the evolution of a small phase-space volume. For instance, if the attractor is a limit cycle, a small two-dimensional volume does not change too much its shape: in a direction it maintains its size, while in the other it shrinks till becoming a 'very thin strand' with an almost constant length. In chaotic systems, instead, the dynamics continuously stretches and folds an initial small volume transforming it into a thinner and thinner 'ribbon' with an exponentially increasing length." (Massimo Cencini et al, "Chaos: From Simple Models to Complex Systems", 2010)
"The first path of increasing complexity via innovation often faces limits as to how much complexity can be added or reduced in a given system. This is because if you change the complexity level in one place, a compensating change in the opposite direction generally occurs somewhere else." (John L Casti, "X-Events: The Collapse of Everything", 2012)
"Complexity scientists concluded that there are just too many factors - both concordant and contrarian - to understand. And with so many potential gaps in information, almost nobody can see the whole picture. Complex systems have severe limits, not only to predictability but also to measurability. Some complexity theorists argue that modelling, while useful for thinking and for studying the complexities of the world, is a particularly poor tool for predicting what will happen." (Lawrence K Samuels, "Defense of Chaos: The Chaology of Politics, Economics and Human Action", 2013)
🕸Systems Engineering: Idealization (Just the Quotes)
"It is difficult, however, to learn all these things from situations such as occur in everyday life. What we need is a series of abstract and quite impersonal situations to argue about in which one side is surely right and the other surely wrong. The best source of such situations for our purposes is geometry. Consequently we shall study geometric situations in order to get practice in straight thinking and logical argument, and in order to see how it is possible to arrange all the ideas associated with a given subject in a coherent, logical system that is free from contradictions. That is, we shall regard the proof of each proposition of geometry as an example of correct method in argumentation, and shall come to regard geometry as our ideal of an abstract logical system. Later, when we have acquired some skill in abstract reasoning, we shall try to see how much of this skill we can apply to problems from real life." (George D Birkhoff & Ralph Beately, "Basic Geometry", 1940)
"A material model is the representation of a complex system by a system which is assumed simpler and which is also assumed to have some properties similar to those selected for study in the original complex system. A formal model is a symbolic assertion in logical terms of an idealised relatively simple situation sharing the structural properties of the original factual system." (Arturo Rosenblueth & Norbert Wiener, "The Role of Models in Science", Philosophy of Science Vol. 12 (4), 1945)
"In fact, it is empirically ascertainable that every event is actually produced by a number of factors, or is at least accompanied by numerous other events that are somehow connected with it, so that the singling out involved in the picture of the causal chain is an extreme abstraction. Just as ideal objects cannot be isolated from their proper context, material existents exhibit multiple interconnections; therefore the universe is not a heap of things but a system of interacting systems." (Mario Bunge, "Causality: The place of the casual principles in modern science", 1959)
"There is a logic of language and a logic of mathematics. The former is supple and lifelike, it follows our experience. The latter is abstract and rigid, more ideal. The latter is perfectly necessary, perfectly reliable: the former is only sometimes reliable and hardly ever systematic. But the logic of mathematics achieves necessity at the expense of living truth, it is less real than the other, although more certain. It achieves certainty by a flight from the concrete into abstraction." (Thomas Merton, "The Secular Journal of Thomas Merton", 1959)
"[…] if a system is sufficiently complicated, the time it takes to return near a state already visited is huge (think of the hundred fleas on the checkerboard). Therefore if you look at the system for a moderate amount of time, eternal return is irrelevant, and you had better choose another idealization." (David Ruelle, "Chance and Chaos", 1991)
"[…] it does not seem helpful just to say that all models are wrong. The very word model implies simplification and idealization. The idea that complex physical, biological or sociological systems can be exactly described by a few formulae is patently absurd. The construction of idealized representations that capture important stable aspects of such systems is, however, a vital part of general scientific analysis and statistical models, especially substantive ones, do not seem essentially different from other kinds of model." (Sir David Cox, "Comment on ‘Model uncertainty, data mining and statistical inference’", Journal of the Royal Statistical Society, Series A 158, 1995)
"Formulation of a mathematical model is the first step in the process of analyzing the behaviour of any real system. However, to produce a useful model, one must first adopt a set of simplifying assumptions which have to be relevant in relation to the physical features of the system to be modelled and to the specific information one is interested in. Thus, the aim of modelling is to produce an idealized description of reality, which is both expressible in a tractable mathematical form and sufficiently close to reality as far as the physical mechanisms of interest are concerned." (Francois Axisa, "Discrete Systems" Vol. I, 2001)
"A first important remark is that nature gives us mathematical hints. […] A second important remark is that mathematical physics deals with idealized systems. […] The third important remark is that nature may hint at a theorem but does not state clearly under which conditions is true." (David Ruelle, "The Mathematician's Brain", 2007)
"Cellular automata (CA) are idealizations of physical systems in which both space and time are assumed to be discrete and each of the interacting units can have only a finite number of discrete states." (Andreas Schadschneider et al, "Vehicular Traffic II: The Nagel–Schreckenberg Model", 2011)
"Abstract formulations of simply stated concrete ideas are often the result of efforts to create idealized models of complex systems. The models are 'idealized' in the sense that they retain only the most fundamental properties of the original systems. The vocabulary is chosen to be as inclusive as possible so that research into the model reveals facts about a wide variety of similar systems. Unfortunately, it is often the case that over time the connection between a model and the systems on which it was based is lost, and the interested reader is faced with something that looks as if it were created to be deliberately complicated - deliberately confusing - but the original intention was just the opposite. Often, the model was devised to be simpler and more transparent than any of the systems on which it was based." (John Tabak, "Beyond Geometry: A new mathematics of space and form", 2011)
"Stated loosely, models are simplified, idealized and approximate representations of the structure, mechanism and behavior of real-world systems. From the standpoint of set-theoretic model theory, a mathematical model of a target system is specified by a nonempty set - called the model’s domain, endowed with some operations and relations, delineated by suitable axioms and intended empirical interpretation." (Zoltan Domotor, "Mathematical Models in Philosophy of Science" [Mathematics of Complexity and Dynamical Systems, 2012])
30 December 2014
🕸Systems Engineering: Information Theory (Just the Quotes)
"[…] information theory is characterised essentially by its dealing always with a set of possibilities; both its primary data and its final statements are almost always about the set as such, and not about some individual element in the set." (W Ross Ashby, "An Introduction to Cybernetics", 1956)
"The general notion in communication theory is that of information. In many cases, the flow of information corresponds to a flow of energy, e. g. if light waves emitted by some objects reach the eye or a photoelectric cell, elicit some reaction of the organism or some machinery, and thus convey information." (Ludwig von Bertalanffy, "General System Theory", 1968)
"The 'flow of information' through human communication channels is enormous. So far no theory exists, to our knowledge, which attributes any sort of unambiguous measure to this 'flow'." (Anatol Rapoport, "Modern Systems Research for the Behavioral Scientist", 1969)
"Probability plays a central role in many fields, from quantum mechanics to information theory, and even older fields use probability now that the presence of 'noise' is officially admitted. The newer aspects of many fields start with the admission of uncertainty." (Richard Hamming, "Methods of Mathematics Applied to Calculus, Probability, and Statistics", 1985)
"The field of 'information theory' began by using the old hardware paradigm of transportation of data from point to point." (Marshall McLuhan & Eric McLuhan, Laws of Media: The New Science, 1988)
"Without an understanding of causality there can be no theory of communication. What passes as information theory today is not communication at all, but merely transportation." (Marshall McLuhan & Eric McLuhan, "Laws of Media: The New Science", 1988)
"If quantum communication and quantum computation are to flourish, a new information theory will have to be developed." (Hans Christian von Baeyer, "Information, The New Language of Science", 2003)
"In fact, an information theory that leaves out the issue of noise turns out to have no content." (Hans Christian von Baeyer, "Information, The New Language of Science", 2003)
"In an information economy, entrepreneurs master the science of information in order to overcome the laws of the purely physical sciences. They can succeed because of the surprising power of the laws of information, which are conducive to human creativity. The central concept of information theory is a measure of freedom of choice. The principle of matter, on the other hand, is not liberty but limitation - it has weight and occupies space." (George Gilder, "Knowledge and Power: The Information Theory of Capitalism and How it is Revolutionizing our World", 2013)
"Information theory leads to the quantification of the information content of the source, as denoted by entropy, the characterization of the information-bearing capacity of the communication channel, as related to its noise characteristics, and consequently the establishment of the relationship between the information content of the source and the capacity of the channel. In short, information theory provides a quantitative measure of the information contained in message signals and help determine the capacity of a communication system to transfer this information from source to sink over a noisy channel in a reliable fashion." (Ali Grami, "Information Theory", 2016)
🕸Systems Engineering: Systems Thinking (Just the Quotes)
"A systems approach begins when first you see the world through the eyes of another." (C West Churchman, "The Systems Approach", 1968)
"The systems approach to problems focuses on systems taken as a whole, not on their parts taken separately. Such an approach is concerned with total - system performance even when a change in only one or a few of its parts is contemplated because there are some properties of systems that can only be treated adequately from a holistic point of view. These properties derive from the relationship between parts of systems: how the parts interact and fit together." (Russell L Ackoff, "Towards a System of Systems Concepts", 1971)
“The notion of ‘system’ has gained central importance in contemporary science, society and life. In many fields of endeavor, the necessity of a ‘systems approach’ or ‘systems thinking’ is emphasized, new professions called ‘systems engineering’, ‘systems analysis’ and the like have come into being, and there can be little doubt that this this concept marks a genuine, necessary, and consequential development in science and world-view.” (Ervin László, “Introduction to Systems Philosophy: Toward a New Paradigm of Contemporary Thought”, 1972)
"A company is a multidimensional system capable of growth, expansion, and self-regulation. It is, therefore, not a thing but a set of interacting forces. Any theory of organization must be capable of reflecting a company's many facets, its dynamism, and its basic orderliness. When company organization is reviewed, or when reorganizing a company, it must be looked upon as a whole, as a total system." (Albert Low, "Zen and Creative Management", 1976)
"There is a strong current in contemporary culture advocating ‘holistic’ views as some sort of cure-all […] Reductionism implies attention to a lower level while holistic implies attention to higher level. These are intertwined in any satisfactory description: and each entails some loss relative to our cognitive preferences, as well as some gain [...] there is no whole system without an interconnection of its parts and there is no whole system without an environment." (Francisco Varela, "On being autonomous: The lessons of natural history for systems theory", 1977)
"Systems thinking is a special form of holistic thinking - dealing with wholes rather than parts. One way of thinking about this is in terms of a hierarchy of levels of biological organization and of the different 'emergent' properties that are evident in say, the whole plant (e.g. wilting) that are not evident at the level of the cell (loss of turgor). It is also possible to bring different perspectives to bear on these different levels of organization. Holistic thinking starts by looking at the nature and behaviour of the whole system that those participating have agreed to be worthy of study. This involves: (i) taking multiple partial views of 'reality' […] (ii) placing conceptual boundaries around the whole, or system of interest and (iii) devising ways of representing systems of interest." (C J Pearson and R L Ison, "Agronomy of Grassland Systems", 1987)
"Systems thinking is a discipline for seeing the 'structures' that underlie complex situations, and for discerning high from low leverage change. That is, by seeing wholes we learn how to foster health. To do so, systems thinking offers a language that begins by restructuring how we think." (Peter Senge, "The Fifth Discipline", 1990)
"Systems thinking is a discipline for seeing wholes. It is a framework for seeing interrelationships rather than things, for seeing patterns of change rather than static 'snapshots'. It is a set of general principles- distilled over the course of the twentieth century, spanning fields as diverse as the physical and social sciences, engineering, and management. [...] During the last thirty years, these tools have been applied to understand a wide range of corporate, urban, regional, economic, political, ecological, and even psychological systems. And systems thinking is a sensibility for the subtle interconnectedness that gives living systems their unique character." (Peter Senge, "The Fifth Discipline", 1990)
"Systems thinking is a framework for seeing interrelationships rather than things, for seeing patterns rather than static snapshots. It is a set of general principles spanning fields as diverse as physical and social sciences, engineering and management." (Peter Senge, "The Fifth Discipline", 1990)
"Systems philosophy brings forth a reorganization of ways of thinking. It creates a new worldview, a new paradigm of perception and explanation, which is manifested in integration, holistic thinking, purpose-seeking, mutual causality, and process-focused inquiry.” (Béla H. Bánáthy, "Systems Design of Education”, 1991)
"The new paradigm may be called a holistic world view, seeing the world as an integrated whole rather than a dissociated collection of parts. It may also be called an ecological view, if the term 'ecological' is used in a much broader and deeper sense than usual. Deep ecological awareness recognizes the fundamental interdependence of all phenomena and the fact that, as individuals and societies we are all embedded in (and ultimately dependent on) the cyclical process of nature." (Fritjof Capra & Gunter A Pauli, "Steering business toward sustainability", 1995)
"In the new systems thinking, the metaphor of knowledge as a building is being replaced by that of the network. As we perceive reality as a network of relationships, our descriptions, too, form an interconnected network of concepts and models in which there are no foundations. For most scientists such a view of knowledge as a network with no firm foundations is extremely unsettling, and today it is by no means generally accepted. But as the network approach expands throughout the scientific community, the idea of knowledge as a network will undoubtedly find increasing acceptance." (Fritjof Capra," The Web of Life: a new scientific understanding of living systems", 1996)
"It [system dynamics] focuses on building system dynamics models with teams in order to enhance team learning, to foster consensus and to create commitment with a resulting decision […] System dynamics can be helpful to elicit and integrate mental models into a more holistic view of the problem and to explore the dynamics of this holistic view […] It must be understood that the ultimate goal of the intervention is not to build a system dynamics model. The system dynamics model is a means to achieve other ends […] putting people in a position to learn about a messy problem … create a shared social reality […] a shared understanding of the problem and potential solutions … to foster consensus within the team [..]" (Jac A M Vennix, "Group Model Building: Facilitating Team Learning Using System Dynamics", 1996)
"Understanding ecological interdependence means understanding relationships. It requires the shifts of perception that are characteristic of systems thinking - from the parts to the whole, from objects to relationships, from contents to patterns. […] Nourishing the community means nourishing those relationships." (Fritjof Capra, "The Web of Life: A New Scientific Understanding of Living Systems", 1996)
"[...] information feedback about the real world not only alters our decisions within the context of existing frames and decision rules but also feeds back to alter our mental models. As our mental models change we change the structure of our systems, creating different decision rules and new strategies. The same information, processed and interpreted by a different decision rule, now yields a different decision. Altering the structure of our systems then alters their patterns of behavior. The development of systems thinking is a double-loop learning process in which we replace a reductionist, narrow, short-run, static view of the world with a holistic, broad, long-term, dynamic view and then redesign our policies and institutions accordingly." (John D Sterman, "Business dynamics: Systems thinking and modeling for a complex world", 2000)
"Systems thinking is based on the theory that a system is, in essence, circular. Using a systems approach in your strategic management, therefore, provides a circular implementing structure that can evolve, with continuously improving, self-checking, and learning capabilities [...]" (Stephen G Haines, "The Systems Thinking Approach to Strategic Planning and Management", 2000)
"The systems approach, on the other hand, provides an expanded structural design of organizations as living systems that more accurately reflects reality." (Stephen G Haines, "The Systems Thinking Approach to Strategic Planning and Management", 2000)
"This is what systems thinking is all about: the idea of building an organization in which each piece, and partial solution of the organization has the fit, alignment, and integrity with your overall organization as a system, and its outcome of serving the customer." (Stephen G Haines, "The Systems Thinking Approach to Strategic Planning and Management", 2000)
"True systems thinking, on the other hand, studies each problem as it relates to the organization’s objectives and interaction with its entire environment, looking at it as a whole within its universe. Taking your organization from a partial systems to a true systems state requires effective strategic management and backward thinking." (Stephen G Haines, "The Systems Thinking Approach to Strategic Planning and Management", 2000)
"Systems thinking is a mental discipline and framework for seeing patterns and interrelationships. It is important to see organizational systems as a whole because of their complexity. Complexity can overwhelm managers, undermining confidence. When leaders can see the structures that underlie complex situations, they can facilitate improvement. But doing that requires a focus on the big picture." (Richard L Daft, "The Leadership Experience", 2008)
"Systems thinking means the ability to see the synergy of the whole rather than just the separate elements of a system and to learn to reinforce or change whole system patterns. Many people have been trained to solve problems by breaking a complex system, such as an organization, into discrete parts and working to make each part perform as well as possible. However, the success of each piece does not add up to the success of the whole. to the success of the whole. In fact, sometimes changing one part to make it better actually makes the whole system function less effectively." (Richard L Daft, "The Leadership Experience", 2002)
"Deep change in mental models, or double-loop learning, arises when evidence not only alters our decisions within the context of existing frames, but also feeds back to alter our mental models. As our mental models change, we change the structure of our systems, creating different decision rules and new strategies. The same information, interpreted by a different model, now yields a different decision. Systems thinking is an iterative learning process in which we replace a reductionist, narrow, short-run, static view of the world with a holistic, broad, long-term, dynamic view, reinventing our policies and institutions accordingly." (John D Sterman, "Learning in and about complex systems", Systems Thinking Vol. 3 2003)
"There exists an alternative to reductionism for studying systems. This alternative is known as holism. Holism considers systems to be more than the sum of their parts. It is of course interested in the parts and particularly the networks of relationships between the parts, but primarily in terms of how they give rise to and sustain in existence the new entity that is the whole whether it be a river system, an automobile, a philosophical system or a quality system." (Michael C. Jackson, "Systems Thinking: Creative Holism for Manager", 2003)
"In ecology, we are often interested in exploring the behavior of whole systems of species or ecosystem composed of individual components which interact through biological processes. We are interested not simply in the dynamics of each species or component in isolation, but the dynamics of each species or component in the context of all the others and how those coupled dynamics account for properties of the system as a whole, such as its persistence. This is what people seem to mean when they say that ecology is ‘holistic’, an otherwise rather vague term." (John Pastor, "Mathematical Ecology of Populations and Ecosystems", 2008)
"A systems approach is one that focuses on the system as a whole, specifically linking value judgments (what is desired) and design decisions (what is feasible). A true systems approach means that the design process includes the 'problem' as well as the solution. The architect seeks a joint problem–solution pair and understands that the problem statement is not fixed when the architectural process starts. At the most fundamental level, systems are collections of different things that together produce results unachievable by the elements alone." (Mark W Maier, "The Art Systems of Architecting" 3rd Ed., 2009)
"Taking a systems approach means paying close attention to results, the reasons we build a system. Architecture must be grounded in the client’s/user’s/customer’s purpose. Architecture is not just about the structure of components. One of the essential distinguishing features of architectural design versus other sorts of engineering design is the degree to which architectural design embraces results from the perspective of the client/user/customer. The architect does not assume some particular problem formulation, as 'requirements' is fixed. The architect engages in joint exploration, ideally directly with the client/user/customer, of what system attributes will yield results worth paying for." (Mark W Maier, "The Art Systems of Architecting" 3rd Ed., 2009)
"Systems thinking focuses on optimizing for the whole, looking at the overall flow of work, identifying what the largest bottleneck is today, and eliminating it." (Matthew Skelton & Manuel Pais, "Team Topologies: Organizing Business and Technology Teams for Fast Flow", 2019)
More on "Systems Thinking" at the-web-of-knowledge.blogspot.com.
About Me
- Adrian
- Koeln, NRW, Germany
- IT Professional with more than 25 years experience in IT in the area of full life-cycle of Web/Desktop/Database Applications Development, Software Engineering, Consultancy, Data Management, Data Quality, Data Migrations, Reporting, ERP implementations & support, Team/Project/IT Management, etc.