A single equation grounded in basic physics principles could describe
intelligence and stimulate new insights in fields as diverse as finance
and robotics, according to new research.
Chris Gorski is an editor for Inside Science News Service.
![]() |
These diagrams show how
software that harnesses "causal entropic forces" emulates the
intelligent behavior required to walk upright or use tools. Courtesy of Alexander Wissner-Gross
|
Alexander Wissner-Gross, a physicist at Harvard University and the
Massachusetts Institute of Technology, and Cameron Freer, a
mathematician at the University of Hawaii at Manoa, developed an
equation that they say describes many intelligent or cognitive
behaviors, such as upright walking and tool use.
The researchers suggest that intelligent behavior stems from the
impulse to seize control of future events in the environment. This is
the exact opposite of the classic science-fiction scenario in which
computers or robots become intelligent, then set their sights on taking
over the world.
The findings describe a mathematical relationship that can
"spontaneously induce remarkably sophisticated behaviors associated with
the human 'cognitive niche,' including tool use and social cooperation,
in simple physical systems," the researchers wrote in a paper published
today in the journal Physical Review Letters.
"It's a provocative paper," said Simon DeDeo, a research fellow at
the Santa Fe Institute, who studies biological and social systems. "It's
not science as usual."
Wissner-Gross, a physicist, said the research was "very ambitious"
and cited developments in multiple fields as the major inspirations.
The mathematics behind the research comes from the theory of how
heat energy can do work and diffuse over time, called thermodynamics.
One of the core concepts in physics is called entropy, which refers to
the tendency of systems to evolve toward larger amounts of disorder. The
second law of thermodynamics explains how in any isolated system, the
amount of entropy tends to increase. A mirror can shatter into many
pieces, but a collection of broken pieces will not reassemble into a
mirror.
The new research proposes that entropy is directly connected to intelligent behavior.
"[The paper] is basically an attempt to describe intelligence as a fundamentally thermodynamic process," said Wissner-Gross.
The researchers developed a software engine, called Entropica, and
gave it models of a number of situations in which it could demonstrate
behaviors that greatly resemble intelligence. They patterned many of
these exercises after classic animal intelligence tests.
In one test, the researchers presented Entropica with a situation
where it could use one item as a tool to remove another item from a bin,
and in another, it could move a cart to balance a rod standing straight
up in the air. Governed by simple principles of thermodynamics, the
software responded by displaying behavior similar to what people or
animals might do, all without being given a specific goal for any
scenario.
"It actually self-determines what its own objective is," said
Wissner-Gross. "This [artificial intelligence] does not require the
explicit specification of a goal, unlike essentially any other
[artificial intelligence]."
Entropica's intelligent behavior emerges from the "physical process
of trying to capture as many future histories as possible," said
Wissner-Gross. Future histories represent the complete set of possible
future outcomes available to a system at any given moment.
Wissner-Gross calls the concept at the center of the research
"causal entropic forces." These forces are the motivation for
intelligent behavior. They encourage a system to preserve as many future
histories as possible. For example, in the cart-and-rod exercise,
Entropica controls the cart to keep the rod upright. Allowing the rod to
fall would drastically reduce the number of remaining future histories,
or, in other words, lower the entropy of the cart-and-rod system.
Keeping the rod upright maximizes the entropy. It maintains all future
histories that can begin from that state, including those that require
the cart to let the rod fall.
"The universe exists in the present state that it has right now. It
can go off in lots of different directions. My proposal is that
intelligence is a process that attempts to capture future histories,"
said Wissner-Gross.
The research may have applications beyond what is typically
considered artificial intelligence, including language structure and
social cooperation.
DeDeo said it would be interesting to use this new framework to
examine Wikipedia, and research whether it, as a system, exhibited the
same behaviors described in the paper.
"To me [the research] seems like a really authentic and honest attempt to wrestle with really big questions," said DeDeo.
One potential application of the research is in developing
autonomous robots, which can react to changing environments and choose
their own objectives.
"I would be very interested to learn more and better understand the
mechanism by which they're achieving some impressive results, because
it could potentially help our quest for artificial intelligence," said
Jeff Clune, a computer scientist at the University of Wyoming.
Clune, who creates simulations of evolution and uses natural
selection to evolve artificial intelligence and robots, expressed some
reservations about the new research, which he suggested could be due to a
difference in jargon used in different fields.
Wissner-Gross indicated that he expected to work closely with
people in many fields in the future in order to help them understand how
their fields informed the new research, and how the insights might be
useful in those fields.
The new research was inspired by cutting-edge developments in many
other disciplines. Some cosmologists have suggested that certain
fundamental constants in nature have the values they do because
otherwise humans would not be able to observe the universe. Advanced
computer software can now compete with the best human players in chess
and the strategy-based game called Go. The researchers even drew from
what is known as the cognitive niche theory, which explains how
intelligence can become an ecological niche and thereby influence
natural selection.
The proposal requires that a system be able to process information
and predict future histories very quickly in order for it to exhibit
intelligent behavior. Wissner-Gross suggested that the new findings fit
well within an argument linking the origin of intelligence to natural
selection and Darwinian evolution -- that nothing besides the laws of
nature are needed to explain intelligence.
Although Wissner-Gross suggested that he is confident in the
results, he allowed that there is room for improvement, such as
incorporating principles of quantum physics into the framework.
Additionally, a company he founded is exploring commercial applications
of the research in areas such as robotics, economics and defense.
"We basically view this as a grand unified theory of intelligence,"
said Wissner-Gross. "And I know that sounds perhaps impossibly
ambitious, but it really does unify so many threads across a variety of
fields, ranging from cosmology to computer science, animal behavior, and
ties them all together in a beautiful thermodynamic picture."
-Chris Gorski, Inside Science News Service
-Chris Gorski, Inside Science News Service
Chris Gorski is an editor for Inside Science News Service.
I'm a physicist myself and I love and respect mathematics... but I don't believe what Wissner-Gross and Freer state.
ReplyDeleteIt seems to me just pseudo-science.
But I might be wrong (even if I don't believe so).
Regards,
Mauro.
It does seem a little hard to believe.
ReplyDeleteVery interesting! Gives me a lot of food for thoughts. And here again I can see how the deeply grounded western materialist view of the world leads to gross mistakes. This research is good step toward the right direction and will be full of opportunities, but this team should not forget that intelligence emerge primarily from consciousness. Every living beings share this common property to directly perceive, know, or in one word be conscious of its surrounding environment. Before computing information you have to acquire the basic information. Direct perception, awarness of the environment are the most basic information required for living intelligence to take place.
ReplyDeleteActually, I think it sounds quite interesting. If it works, my guess is that it will probably turn out to be a variant of what is sometimes called temporal difference learning. This is a family of generalised learning algorithms which have been under development for some time in AI and computational neuroscience.
ReplyDeleteIf this ran in a big and fast enough computer and was connected to the internet, it could cause the "singularity"...
ReplyDeleteSo . . . . what is the equation? Is it any different from the second law of thermodynamics as ramified through the universe? Why is the article all advertising and no "meat"?
ReplyDeleteIs it correct to tie intelligence to conciousness? Many things are concious without being intelligent. We have created machines that appear to be intelligent without necessarily being concious. Many things are alive without being either of the preceding two. Creating equations that produce behaviour that appears to mimic intelligent learning is possibly all that happened to us a few (million) years ago. After all, if it looks like a duck etc...
ReplyDelete'The researchers suggest that intelligent behavior stems from the impulse to seize control of future events in the environment. This is the exact opposite of the classic science-fiction scenario in which computers or robots become intelligent, then set their sights on taking over the world.'
ReplyDeleteDoes this make sense to anyone? I realize the paper has nothing to do with robots and this is just mind candy, but it seems like if we're going to bring robots taking over the world into the conversation a paper arguing that 'the impulse to seize control over future events in the environment' is the hallmark of intelligence should be granted as one more reason to lay the welcoming mat out for our robot overlords. Or is the author saying that robots can't really be called intelligent *until* they've taken over the world? That seems like a high bar to me, one which surely anybody believing humanity to have achieved is going to face an uphill battle when confronted with our seemingly totally rudderless teleology.
The general idea that this relies on is quite sound. The underlying idea is the definition of consciousness.
ReplyDeleteConsciousness for any motile organism is the organism's ability to take its sensory inputs and use them to create a model of the future.
The only purpose of the model thus created is to allow the organism to successfully negotiate its environment.
This success, in turn, is the definition of what it means to say natural selection will select in favor of the organism.
Like every property of living organisms such a thing seems to be on a continuum of sophistication, all the way from cockroaches to birds, and mammals that are what we humans think of as conscious.