Scientists describe technique for extracting hierarchical structure of networks

May 1, 2008

Networks -- used throughout the sciences in the study of biological, technological, and social complexity -- can often be too complex to visualize or understand.

In a May 1 Nature paper, “Hierarchical structure and the prediction of missing links in networks,” Santa Fe Institute (SFI) researchers Aaron Clauset, Cristopher Moore, and Mark Newman show that many real-world networks can be understood as a hierarchy of modules, where nodes cluster together to form modules, which themselves cluster into larger modules -- arrangements similar to the organization of sports players into teams, teams into conferences, and conferences into leagues, for example.

This hierarchical organization, the researchers show, can simultaneously explain a number of patterns previously discovered in networks, such as the surprising heterogeneity in the number of connections some nodes have, or the prevalence of triangles in a network diagram. Their discovery suggests that hierarchy may, in fact, be a fundamental organizational principle for complex networks.

Unlike much previous work in this area, Clauset, Moore, and Newman propose a direct but flexible model of hierarchical structure, which they apply to networks using the tools of statistical physics and machine learning.

To demonstrate the practical utility of their model, they analyze networks from three disparate fields: the metabolic network of the spirochete Treponema pallidum (the bacteria that causes syphilis), a network of associations between terrorists, and a food web of grassland species. Even when only half of the connections in these networks were shown to their algorithm, the researchers found that hierarchical structure can predict missing connections with an accuracy of up to 80 percent.

“Many networks, particularly those in the biological sciences, are not well understood,” says Clauset, an SFI Postdoctoral Fellow. "But hierarchy offers a way to understand their large-scale organization and, from this, predict what interactions we might have missed.”

Source: Santa Fe Institute


print this article email this article download pdf blog this article bookmark this article     Stumble it Digg this share on Facebook retweet share on Reddit add to delicious
Rate this story - 4.4 /5 (16 votes)

Rank Filter

Move the slider to adjust rank threshold, so that you can hide some of the comments.


Display comments: newest first

  • Ragtime - May 01, 2008
    • Rank: 1 / 5 (3)
    By AWT the hiearchy of nested foam is given by multinomial distribution of causual events in inertial chaos. We can imagine the numbers as a countable particles, then the distribution of gradients in such particles corresponds the distribution of fluctuations inside of random field of colliding particles (condensing supercritical fluid, for example). By such way, the hiearchy is imanent part of every observable reality, composed of inertial gradients. If we can count the elements of system, then the formation of hiearchic structures between them is undeniable.
  • thales - May 01, 2008
    • Rank: not rated yet
    Makes me wonder how this applies to brain organization, since it is a network of neurons. The brain could then be classified by a hierarchy of structures! I'd bet this model could also be used to determine the order in which different areas of the brain developed. By AWT!
  • thales - May 05, 2008
    • Rank: not rated yet
    Mmmmm... quantum foam...
  • nilbud - May 05, 2008
    • Rank: 1 / 5 (1)
    Don't forget quantum prayer raggy and any other bullshit you can slap the word quantum in front of.
    A) It's "an aether" although it's spelled ether.
    B) Professor Penrose is not referred to as Sir Penrose, or Penny Henny, or Hey Jimbo.
  • Alexa - May 06, 2008
    • Rank: not rated yet
    Sorry, but you're still not so respectful authority for me, as the Encyclopædia Britannica is:

    http://www.britan...-Penrose

    Professor is the name of occupation, which you can change anytime over life. Do you prefer to be titled as a Floor manager Jimbo or Rabbit feeder Henny?

    I don't think so.

    The "quantum" denomination means "stuff, whose density increases proportionally with energy density". Which is basically an insintric property of every foam, therefore the word "quantum" is redundant here.

May 1, 2008 all stories

Comments: 5

4.4 /5 (16 votes)
  • Stumble this up

  • Digg this

  • share this

  • hide
  • Related Stories




  • hide
  • Relevant PhysicsForums posts

  • Hydrostatic pressure
    created 1hour ago
  • How are bubbles created?
    created 2 hours ago
  • quick question: how does air friction work?/why do things float
    created 3 hours ago
  • What is principle of equivalence?
    created 5 hours ago
  • More from Physics Forums - General Physics

Other News

Stars Fueled by Dark Matter Could Hold Secrets to the Universe

Stars Fueled by Dark Matter Could Hold Secrets to the Universe

Physics / General Physics

created Nov 03, 2009 | popularity 4.5 / 5 (50) | comments 41

(PhysOrg.com) -- The first stars in the universe may have been very different from the stars we see today, yet they may hold clues to understanding some of the mysterious features of the universe. These "dark ...


Second Law of Thermodynamics May Explain Economic Evolution

Second Law of Thermodynamics May Explain Economic Evolution

Physics / General Physics

created Nov 02, 2009 | popularity 4.3 / 5 (30) | comments 28

(PhysOrg.com) -- Terms such as the "invisible hand," laissez-faire policy, and free-market principles suggest that economic growth and decline in capitalist societies seem to be somehow self-regulated. Now, ...


High-performance plasmas may make reliable, efficient fusion power a reality

High-performance plasmas may make reliable, efficient fusion power a reality

Physics / Plasma Physics

created Nov 02, 2009 | popularity 4.7 / 5 (39) | comments 31

In the quest to produce nuclear fusion energy, researchers from the DIII-D National Fusion Facility have recently confirmed long-standing theoretical predictions that performance, efficiency and reliability ...


'Teapot effect' solved

Solving Teapot Effect

Physics / General Physics

created Nov 02, 2009 | popularity 4.9 / 5 (11) | comments 10

(PhysOrg.com) -- A team of scientists from France have worked out why teapots dribble at low flow rates, and how to stop them. The effect is called the "teapot effect", and solving it could finally put an ...


Laser accelerated protons to the highest energies so far

Researchers use trident laser to accelerate protons to record energies

Physics / General Physics

created Nov 02, 2009 | popularity 4.7 / 5 (6) | comments 10

An international team of physicists at Los Alamos National Laboratory has succeeded in using intense laser light to accelerate protons to energies never before achieved. Using this technique, scientists can ...