Being Isaac Newton: Computer derives natural laws from raw data

April 2, 2009 Maybe robots dream of electric sheep, but can they do science?

Enlarge

Cornell University researchers Hod Lipson (right) and Michael Schmidt hold up a double pendulum. Credit: Jonathan Hiller, Cornell University

If Isaac Newton had access to a supercomputer, he'd have had it watch apples fall - and let it figure out the physical matters. But the computer would have needed to run an algorithm, just developed by Cornell researchers, which can derive natural laws from observed data.

The researchers have taught a computer to find regularities in the natural world that become established laws - yet without any prior on the part of the computer. They have tested their method, or , on simple and believe it could be applied to more ranging from biology to cosmology and be useful in analyzing the mountains of data generated by modern experiments that use electronic data collection.

The research will be published in the journal Science (April 3, 2009) by Hod Lipson, Cornell associate professor of mechanical and aerospace engineering, and graduate student Michael Schmidt, a specialist in computational biology.

Their process begins by taking the derivatives of every variable observed with respect to every other - a mathematical way of measuring how one quantity changes as another changes. Then the computer creates equations at random using various constants and variables from the data. It tests these against the known derivatives, keeps the equations that come closest to predicting correctly, modifies them at random and tests again, repeating until it literally evolves a set of equations that accurately describe the behavior of the real system.

Technically, the computer does not output equations, but finds "invariants" - mathematical expressions that remain true all the time.

"Even though it looks like it's changing erratically, there is always something deeper there that is always constant," Lipson explained. "That's the hint to the underlying physics. You want something that doesn't change, but the relationship between the variables in it changes in a way that's similar to [what we see in] the real system."

Once the invariants are found, potentially all equations describing the system are available: "All equations regarding a system must fit into and satisfy the invariants," Schmidt said. "But of course we still need a human interpreter to take this step."

The researchers tested the method with apparatus used in freshman physics courses: a spring-loaded linear oscillator, a single pendulum and a double pendulum. Given data on position and velocity over time, the computer found energy laws, and for the pendulum, the law of conservation of momentum. Given acceleration, it produced Newton's second law of motion.

The researchers point out that the computer evolves these laws without any prior knowledge of physics, kinematics or geometry. But evolution takes time. On a parallel computer with 32 processors, simple linear motion could be analyzed in a few minutes, but the complex double pendulum required 30 to 40 hours of computation. The researchers found that seeding the complex pendulum problem with terms from equations for the simple pendulum cut processing time to seven or eight hours.

This "bootstrapping," they said, is similar to the way human scientists build on previous work.

Computers will not make scientists obsolete, the researchers conclude. Rather, they said, the computer can take over the grunt work, helping scientists focus quickly on the interesting phenomena and interpret their meaning.

Source: Cornell University (news : web)


print this article email this article download pdf blog this article bookmark this article     Stumble it Digg this share on Facebook retweet share on Reddit add to delicious
Rate this story - 4.4 /5 (20 votes)

Rank Filter

Move the slider to adjust rank threshold, so that you can hide some of the comments.


Display comments: newest first

  • thales - Apr 02, 2009
    • Rank: 4.3 / 5 (3)
    Genetic algorithms rock.
  • spice_guru - Apr 02, 2009
    • Rank: 5 / 5 (1)
    I imagine it gets a bit tricky with discontinuous or non-periodic functions. You could cover 99.9% percent of the function and never get to the interesting bits.
    When it's further developed it might make an interesting distributed computing project: Is there an analytical solution to a particular complex phenomenon?
  • Yes - Apr 02, 2009
    • Rank: 2.3 / 5 (4)
    They still did not find a computer that would find all solutions for a "simple" chess game and make white the winner 100% of the time. So now what do they expect of this trial and error algorithm? To solve something really complex? dmml.
  • Ethelred - Apr 03, 2009
    • Rank: 5 / 5 (2)
    [Q]They still did not find a computer that would find all solutions for a "simple" chess game and make white the winner 100% of the time.[/Q]

    Chess isn't simple. Now checkers... that HAS been done. 100% not a winner of course but draws since that is the best that can done checkers.

    Ethelred
  • el_gramador - Apr 03, 2009
    • Rank: not rated yet
    They still did not find a computer that would find all solutions for a "simple" chess game and make white the winner 100% of the time. So now what do they expect of this trial and error algorithm? To solve something really complex? dmml.


    Well, to be honest there is no single way that chess can be won 100% each time. That's the basis behind Rybka anyway. Given the fact that both sides are given equal footing, but white gets the first move gives white a better chance to play. It stands in the department of 60% better chances for white compared to 40% for black. Black is going to lose. But, that also reflects nothing of the chess players own level of skill or ability to see things better than the other player. That's why grandmasters most likely take so long given their high levels. I would think...
  • fuzz54 - Apr 03, 2009
    • Rank: not rated yet
    I think they should unleash it on predicting prime numbers with seeding like the Riemann Hypothesis.
  • Alizee - Apr 05, 2009
    • Rank: not rated yet
    Well, and AWT is based on assumption, all natural laws arises from probability laws existing in every large system of colliding particles - that's all. I used my private neural network to reveal it by comparison of many physical experiments - it's as easy, as it appears...

    http://tiny.cc/lcJCn
  • ler177 - Apr 06, 2009
    • Rank: not rated yet
    When it's further developed it might make an interesting distributed computing project: Is there an analytical solution to a particular complex phenomenon?

    They should make a number crunching screensaver like the SETI people did.

April 2, 2009 all stories

Comments: 8

4.4 /5 (20 votes)
  • Stumble this up

  • Digg this

  • share this

  • hide
  • Related Stories

  • Real and virtual pendulums swing as one in mixed reality state
    created Mar 10, 2008 | popularity not rated yet | comments 0
  • Pendulum Finds Virtual Soulmate
    created Jun 14, 2007 | popularity not rated yet | comments 0
  • New twist in classical mechanics finds way around 225-year-old paradox
    created Mar 02, 2006 | popularity not rated yet | comments 0
  • Physics Reveals the Key to a Great Golf Swing
    created Dec 18, 2006 | popularity not rated yet | comments 0
  • New algorithm found for learning languages
    created Sep 06, 2005 | popularity not rated yet | comments 0



  • hide
  • Relevant PhysicsForums posts

  • Help with a camera choice
    created Nov 18, 2009
  • casio calculator that's similar to TI-89
    created Nov 08, 2009
  • Advice on what cell phone to get
    created Nov 08, 2009
  • Changing the language options on your phone.
    created Nov 03, 2009
  • More from Physics Forums - Computing & Technology

Other News

Hackers leak e-mails, stoke climate debate

Technology / Internet

created 5 hours ago | popularity 4.3 / 5 (12) | comments 5

(AP) -- Computer hackers have broken into a server at a well-respected climate change research center in Britain and posted hundreds of private e-mails and documents online - stoking debate over whether some scientists have ...


plug-in hybrid electric vehicle

Pulling the plug on hybrid myths

Technology / Energy

created Nov 19, 2009 | popularity 3.8 / 5 (12) | comments 17

(PhysOrg.com) -- Whether you call them myths, urban legends, fables or old wives' tales, there's a lot of misinformation out there about plug-in electric hybrid vehicles. These vehicles, abbreviated PHEVs, ...


UK police make 2 Trojan computer virus arrests

Technology / Internet

created Nov 18, 2009 | popularity 5 / 5 (1) | comments 10

(AP) -- A couple suspected of helping spread some of the Internet's most aggressive computer viruses has been arrested in the English city of Manchester, police said Wednesday.


A sign marks the entrance to IBM Corporate Headquarters

IBM makes Big Blue cloud

Technology / Software

created Nov 16, 2009 | popularity 2.9 / 5 (8) | comments 8

IBM on Monday announced it has created the world's largest business computing "cloud" capable of holding an amount of digital data on a par with 250 billion iTunes songs.


Google SPDY

Google's SPDY will speed up downloads

Technology / Internet

created Nov 16, 2009 | popularity 4.4 / 5 (16) | comments 7

(PhysOrg.com) -- As part of its effort to speed up the Web, Google is experimenting with SPDY, a new application layer protocol, that it hopes will speed up the conversation between browsers and Web servers ...