Scientists describe technique for extracting hierarchical structure of networks

May 1st, 2008

Networks -- used throughout the sciences in the study of biological, technological, and social complexity -- can often be too complex to visualize or understand.

In a May 1 Nature paper, “Hierarchical structure and the prediction of missing links in networks,” Santa Fe Institute (SFI) researchers Aaron Clauset, Cristopher Moore, and Mark Newman show that many real-world networks can be understood as a hierarchy of modules, where nodes cluster together to form modules, which themselves cluster into larger modules -- arrangements similar to the organization of sports players into teams, teams into conferences, and conferences into leagues, for example.

This hierarchical organization, the researchers show, can simultaneously explain a number of patterns previously discovered in networks, such as the surprising heterogeneity in the number of connections some nodes have, or the prevalence of triangles in a network diagram. Their discovery suggests that hierarchy may, in fact, be a fundamental organizational principle for complex networks.

Unlike much previous work in this area, Clauset, Moore, and Newman propose a direct but flexible model of hierarchical structure, which they apply to networks using the tools of statistical physics and machine learning.

To demonstrate the practical utility of their model, they analyze networks from three disparate fields: the metabolic network of the spirochete Treponema pallidum (the bacteria that causes syphilis), a network of associations between terrorists, and a food web of grassland species. Even when only half of the connections in these networks were shown to their algorithm, the researchers found that hierarchical structure can predict missing connections with an accuracy of up to 80 percent.

“Many networks, particularly those in the biological sciences, are not well understood,” says Clauset, an SFI Postdoctoral Fellow. "But hierarchy offers a way to understand their large-scale organization and, from this, predict what interactions we might have missed.”

Source: Santa Fe Institute


print this article email this article download pdf blog this article bookmark this article     Digg this Stumble it share on Facebook share on Reddit add to delicious save to Yahoo! bookmarks
4.4/5 after 16 votes

Rank Filter

Move the slider to adjust rank threshold, so that you can hide some of the comments.


Display comments: newest first

  • Ragtime - May 01, 2008
    • Rank: 1 / 5 (3)
    By AWT the hiearchy of nested foam is given by multinomial distribution of causual events in inertial chaos. We can imagine the numbers as a countable particles, then the distribution of gradients in such particles corresponds the distribution of fluctuations inside of random field of colliding particles (condensing supercritical fluid, for example). By such way, the hiearchy is imanent part of every observable reality, composed of inertial gradients. If we can count the elements of system, then the formation of hiearchic structures between them is undeniable.
  • thales - May 01, 2008
    • Rank: not rated yet
    Makes me wonder how this applies to brain organization, since it is a network of neurons. The brain could then be classified by a hierarchy of structures! I'd bet this model could also be used to determine the order in which different areas of the brain developed. By AWT!
  • Ragtime - May 02, 2008
    • Rank: 1 / 5 (3)
    By AWT the brain can be considered as a aether foam simulator. This is because just the 1D network composed of strings enables strictly causual energy spreading as a limite case of density fluctuations inside of chaotic environment. Therefore the neural network is based on just 1D network of synapses.

    The system of 1D network behavior of foam, which means, every energy wave makes the system more dense temporarily and it spreads like less or more dense blob (wave packet) through foamy environment (the soap foam gets more dense during shaking). By AWT this simple mechanism results into particle-wave duality, mass/energy equivalence and all quantum mechanics phenomena.

    http://superstrun...foam.gif

    The idea, the neural network is behaving like quantum system is not very new, it was ad-hoced by Pribram and elaborated by Sir Penrose later. It basically means, electrochemical waves can circulate through neural network like quantum wave and it can exists here like mechanical objects, which can even exhibit an inertial action at the distance. Albeit this idea is still quite speculative, it fits perfectly many paranormal phenomena like telepathy, telekinesis, etc. But we know about some stable brain wave already, as they realize a internal clock for time interval estimation for us.

    At the moment, the quantum character of brain waves will be confirmed, then the hiearchical structure is provided authomatically, because the dense wave packets in the foam can behave like independent system of particles, which can make another generation of foamy fluctuations and more complex nested structures by their true nature. By another words, this simple model can explain the hiearchical structure of human conciousness by the same way, like hiarchical structure of observable reality. We can say, the quantum foam of vacuum is behaving like neural network and vice-versa.
  • thales - May 05, 2008
    • Rank: not rated yet
    Mmmmm... quantum foam...
  • nilbud - May 05, 2008
    • Rank: 1 / 5 (1)
    Don't forget quantum prayer raggy and any other bullshit you can slap the word quantum in front of.
    A) It's "an aether" although it's spelled ether.
    B) Professor Penrose is not referred to as Sir Penrose, or Penny Henny, or Hey Jimbo.
  • Alexa - May 06, 2008
    • Rank: not rated yet
    Sorry, but you're still not so respectful authority for me, as the Encyclopædia Britannica is:

    http://www.britan...-Penrose

    Professor is the name of occupation, which you can change anytime over life. Do you prefer to be titled as a Floor manager Jimbo or Rabbit feeder Henny?

    I don't think so.

    The "quantum" denomination means "stuff, whose density increases proportionally with energy density". Which is basically an insintric property of every foam, therefore the word "quantum" is redundant here.

May 1st, 2008 all stories
Physics / General Physics

Comments: 6
Rank: 4.4/5 after 16 votes

  • Stumble this up

  • Digg this

  • Share it:
  • share on Facebook
  • share on MySpace
  • share on Slashdot
  • rss-newsfeed
  • share on Google
  • share on Reddit
  • add to delicious
  • save to Yahoo! bookmarks
  • share on Windows Live
  • Add to Mixx!
Rating: 4.4/5 after 16 votes


Tags


  • Physicists Demonstrate Quantum Memory with Matter Qubits
    Physicists Demonstrate Quantum Memory with Matter Qubits
    Physics / General Physics
    created Jul 03, 2009 | popularity 4.4 / 5 (17) | comments 1
  • 'Holey' Nanosheets for Wastewater Dye Removal
    Nanotechnology / Nanomaterials
    created Jul 01, 2009 | popularity 5 / 5 (5) | comments 1
  • Jellyfish Robot Swims Like its Biological Counterpart
    Jellyfish Robot Swims Like its Biological Counterpart
    Electronics / Robotics
    created Jun 26, 2009 | popularity 4.4 / 5 (8) | comments 1
  • Could Maxwell's Demon Exist in Nanoscale Systems?
    Could Maxwell's Demon Exist in Nanoscale Systems?
    Physics / General Physics
    created Jun 24, 2009 | popularity 4.4 / 5 (18) | comments 29
  • Living Safely with Robots, Beyond Asimov's Laws
    Living Safely with Robots, Beyond Asimov's Laws
    Electronics / Robotics
    created Jun 22, 2009 | popularity 4.6 / 5 (54) | comments 40
  • Other News

    Physical reality of string theory demonstrated

    Physics / General Physics

    created 6 hours ago | popularity 4.7 / 5 (20) | comments 15

    String theory has come under fire in recent years. Promises have been made that have not been lived up to. Leiden (The Netherlands) theoretical physicists have now for the first time used string theory to describe a physical ...


    UQ researchers break the law -- of physics

    UQ researchers break the law -- of physics

    Physics / General Physics

    created 12 hours ago | popularity 4.6 / 5 (16) | comments 5

    (PhysOrg.com) -- Two UQ Science researchers have proved two famous physical laws that have been widely used for the past 25 years do not always work.


    Physicist takes a quantum leap

    Physics / General Physics

    created 2 hours ago | popularity not rated yet | comments 0

    (PhysOrg.com) -- A University of Queensland physicist is seeking answers to a persistent problem throughout human history: how do I compute things? None, however, have had the same impact as what we today know as simply the ...


    Scientists create first electronic quantum processor

    Scientists create first electronic quantum processor

    Physics / General Physics

    created Jun 28, 2009 | popularity 4.8 / 5 (56) | comments 45

    A team led by Yale University researchers has created the first rudimentary solid-state quantum processor, taking another step toward the ultimate dream of building a quantum computer.


    Science journals

    How to Spot an Influential Paper Based on its Citations

    Physics / General Physics

    created Jul 04, 2009 | popularity 4 / 5 (11) | comments 6

    (PhysOrg.com) -- At first it may seem that the number of citations received by a published scientific paper is directly related to that paper's quality of content. The higher the quality, the more people read ...