Advertisement

Science Friday
A frustrating view of complexity
The unifying theme of complex systems, a researcher argues, is frustration.
Web edition : Friday, October 24th, 2008
font_down font_up Text Size
access
BUTTERFLY EFFECTThe Lorenz attractor, an icon of chaos theory.Dschwen/Wikimedia Commons

In the 1980s, an inkling emerged among some scientists that very disparate phenomena might on some deep level be related. The weather, protein folding, computers, evolution, the stock market, the immune system … each shows complex behavior arising from fairly simple interactions among its parts.

For the past 20 years, researchers have labored to understand how these and other “complex systems” work. But there’s still no agreement about even the most basic of questions: What is a complex system?

The frustration of this enduring question has led one researcher to a new answer: Frustration itself lies at the heart of complexity. A complex system, argues Philippe Binder of the University of Hawaii at Hilo, is one with an inner conflict. Conflicting tendencies built into the system won’t let the tendencies settle into a steady state.

access
GEOMETRIC FRUSTRATIONAdapted from P.-M. Binder

Imagine, for example, three atomic magnets that can spin up or down. Suppose the particles are arranged in a triangle, and that each magnet is required to spin in the opposite direction of its two neighbors. Unfortunately, no arrangement meets this goal. So in such a system, the particles would flip their spins over and over in complex patterns, frustrated by the conflicting demands and never able to settle into a stable configuration.

Binder believes that this notion can unite the competing definitions of complexity that have arisen in recent decades. Take, for example, Edward Lorenz’s famous “butterfly” attractor, one of the earliest examples of a chaotic system studied. A simple equation, applied repeatedly, moves points in a plane to new points. As the points move, they trace out two loops that look like a butterfly’s wings. Track a single point, and you’ll find something odd: It doesn’t move in an orderly fashion between the two wings, rather it bounces between them in a seemingly random pattern. Furthermore, two points that start close to one another can easily get pulled to opposite sides of the butterfly, ending up nowhere near one another.

This is a complex system, some would say, because it’s impossible to predict the path of a point unless you know with infinite precision where it was to begin with. Binder says that while that captures an element of what it means to be a complex system, what underlies the unpredictability is frustration. The equation of the Lorenz attractor has combined tendencies to both compress and to stretch the plane.

access
SCALE FRUSTRATIONAdapted from P.-M. Binder

Another perspective on complex systems is that their fundamental attribute is that they behave differently on different scales. DNA, for example, functions very differently from an entire human cell, which in turn doesn’t act much like an organ or a whole person. An eddy that overall moves clockwise may have small sub-eddies that turn counterclockwise. The needs of an individual may be at odds with the needs of society as a whole. Binder describes this as “scale frustration.”

The third form of complexity people often talk about is computational complexity. Many phenomena can be translated into a sequence of 0s and 1s in some way. For example, a point whirling around the Lorenz butterfly can generate such a sequence if you keep track only of which wing it’s on. Then scientists can figure out what the simplest computer is that could generate that sequence.

Noam Chomsky defined a hierarchy of theoretical computing machines, with the most complex being what is called a “universal Turing machine.” Such a machine is equivalent in complexity to a modern computer and is capable in theory of computing anything that can be computed.

Remarkably, though, there are some sequences a Turing machine can’t compute at all. A computer that tries will keep computing forever, never coming to a final answer. Phenomena that generate such strings could be considered the most complex of all.

“That’s the ultimate example of dynamical frustration,” Binder says. “You cannot answer the question, you keep going around in circles, never stopping.” The computer is caught between the need to come to an answer and the need to follow the rules of its program.

Binder admits that his work is preliminary. “It’s still a half-baked idea,” he says, “but I hope it will bring a little focus to the discussion.” He’s now working to make the connections rigorous.

David Wolpert, a physicist at NASA Ames Research Center in Moffett Field, Calif., says that Binder is on to something. Self dissimilarity, he says, is at the heart of complexity. Such phenomena may be common, he says, because it is efficient: If you think of a system as embodying a kind of computation, then he notes that self-dissimilar systems break that computation up, performing different portions of it at different scales, like a parallel computer.

Binder says that the situation in complexity science is a bit like the blind men feeling the elephant: The description given by the person feeling the trunk would seem totally incompatible with that of the person feeling the belly. Binder hopes his notion of dynamic frustration may help identify the full animal. “I think it might be more like a platypus than an elephant!”


Found in: Numbers
Comments 6
  • What the !@#$% happened to the term, "Chaos" as in "Chaos Theory"? It's good enough, and a much better descriptor of what happens.

    Complex can be very orderly and not show the characteristics discussed in the article. There are people who talk about "dynamical systems" and throw a hissy fit at the word "chaos". There are people who talk about "complexity" and who knows what other terms there are by now.

    It's chaos theory.
    John Toradze John Toradze
    Oct. 25, 2008 at 8:59pm
  • Aside from that, a decent article.
    John Toradze John Toradze
    Oct. 25, 2008 at 9:02pm
  • Yes a apple is still a apple..agreed. However there are actions of nature that have no reason to occur. Such as a electron reaching the valance ring, where it usually returns all the energy it was giving back to the "grid", we see this as a photon release.


    The odd thing is that sometimes, the electrons don't give all their energy back. They keep some of it, and now are at a higher state then before.

    It's by pure will alone this is accomplished,as in my Universal Foot-print theory.

    -Marc Ricciardi
    Marc Ricciardi Marc Ricciardi
    Oct. 26, 2008 at 11:51am
  • I agree, don't get me wrong John, there is so-called super-symmetry. I can see the connections, and what is thought as chaos comes to light in extraordinary ways. After that point it is no longer chaos, until the next layer is reviled, that is.
    Marc Ricciardi Marc Ricciardi
    Oct. 26, 2008 at 2:45pm
  • On Complexity

    A. "A frustrating view of complexity"

    http://www.sciencenews.org/view/generic/id/38061/title/A_frustrating_view_of_complexity
    "The unifying theme of complex systems, a researcher argues, is frustration."

    B. All evolutions in the universe are intertwined

    http://www.physforum.com/index.php?showtopic=22994&st=0&#entry381577
    "Broken Symmetry" Is Physics' Term Of Biology's "Evolution"

    http://www.physforum.com/index.php?showtopic=22994&st=0&#entry381757
    "A Glimpse Of Forces-Matter-Life Unified Theory"

    "All objects and processes and natural laws in the universe, are - since singularity - products of evolution and are themselves continuously further evolving. Everything in the cosmos is fractal, rehappens on many scales, and is continuously evolving. Each and every system in the universe continuously evolves within the total universal evolution and all the systems' evolutions are intertwined."

    Dov Henis

    (A DH Comment From The 22nd Century)
    http://blog.360.yahoo.com/blog-P81pQcU1dLBbHgtjQjxG_Q--?cq=1
    Dov Henis Dov Henis
    Oct. 27, 2008 at 2:38am
  • A nit: The article says Chomsky described a hierarchy of computing machines, culminating in a Universal Turing Machine. This seems garbled. The Chomsky Hierarchy is a hierarchy of grammars. It was noticed post-facto that his Type-0 grammars could be considered a sort of Turing machine.
    majus1953 majus1953
    Oct. 27, 2008 at 10:02am
Post a comment

Please login or register to participate.


Advertisement
Suggested Reading:
seperator
Citations & References:
seperator
  • Binder, Philippe. “Frustration in Complexity.” Science, April 18, 2008, p. 322.