Scientists describe technique for extracting hierarchical structure of networks

May 1, 2008

Networks -- used throughout the sciences in the study of biological, technological, and social complexity -- can often be too complex to visualize or understand.

In a May 1 Nature paper, “Hierarchical structure and the prediction of missing links in networks,” Santa Fe Institute (SFI) researchers Aaron Clauset, Cristopher Moore, and Mark Newman show that many real-world networks can be understood as a hierarchy of modules, where nodes cluster together to form modules, which themselves cluster into larger modules -- arrangements similar to the organization of sports players into teams, teams into conferences, and conferences into leagues, for example.

This hierarchical organization, the researchers show, can simultaneously explain a number of patterns previously discovered in networks, such as the surprising heterogeneity in the number of connections some nodes have, or the prevalence of triangles in a network diagram. Their discovery suggests that hierarchy may, in fact, be a fundamental organizational principle for complex networks.

Unlike much previous work in this area, Clauset, Moore, and Newman propose a direct but flexible model of hierarchical structure, which they apply to networks using the tools of statistical physics and machine learning.

To demonstrate the practical utility of their model, they analyze networks from three disparate fields: the metabolic network of the spirochete Treponema pallidum (the bacteria that causes syphilis), a network of associations between terrorists, and a food web of grassland species. Even when only half of the connections in these networks were shown to their algorithm, the researchers found that hierarchical structure can predict missing connections with an accuracy of up to 80 percent.

“Many networks, particularly those in the biological sciences, are not well understood,” says Clauset, an SFI Postdoctoral Fellow. "But hierarchy offers a way to understand their large-scale organization and, from this, predict what interactions we might have missed.”

Source: Santa Fe Institute


print this article email this article download pdf blog this article bookmark this article     Stumble it Digg this share on Facebook retweet share on Reddit add to delicious
Rate this story - 4.4 /5 (16 votes)

Rank Filter

Move the slider to adjust rank threshold, so that you can hide some of the comments.


Display comments: newest first

  • Ragtime - May 01, 2008
    • Rank: 1 / 5 (3)
    By AWT the hiearchy of nested foam is given by multinomial distribution of causual events in inertial chaos. We can imagine the numbers as a countable particles, then the distribution of gradients in such particles corresponds the distribution of fluctuations inside of random field of colliding particles (condensing supercritical fluid, for example). By such way, the hiearchy is imanent part of every observable reality, composed of inertial gradients. If we can count the elements of system, then the formation of hiearchic structures between them is undeniable.
  • thales - May 01, 2008
    • Rank: not rated yet
    Makes me wonder how this applies to brain organization, since it is a network of neurons. The brain could then be classified by a hierarchy of structures! I'd bet this model could also be used to determine the order in which different areas of the brain developed. By AWT!
  • thales - May 05, 2008
    • Rank: not rated yet
    Mmmmm... quantum foam...
  • nilbud - May 05, 2008
    • Rank: 1 / 5 (1)
    Don't forget quantum prayer raggy and any other bullshit you can slap the word quantum in front of.
    A) It's "an aether" although it's spelled ether.
    B) Professor Penrose is not referred to as Sir Penrose, or Penny Henny, or Hey Jimbo.
  • Alexa - May 06, 2008
    • Rank: not rated yet
    Sorry, but you're still not so respectful authority for me, as the Encyclopædia Britannica is:

    http://www.britan...-Penrose

    Professor is the name of occupation, which you can change anytime over life. Do you prefer to be titled as a Floor manager Jimbo or Rabbit feeder Henny?

    I don't think so.

    The "quantum" denomination means "stuff, whose density increases proportionally with energy density". Which is basically an insintric property of every foam, therefore the word "quantum" is redundant here.

May 1, 2008 all stories

Comments: 5

4.4 /5 (16 votes)
  • Stumble this up

  • Digg this

  • share this

  • hide
  • Related Stories




  • hide
  • Relevant PhysicsForums posts

Other News

Restored machine to explore mysteries of Big Bang (AP)

Restored machine to explore mysteries of Big Bang

Physics / General Physics

created 21 hours ago | popularity 4.5 / 5 (15) | comments 10

(AP) -- Scientists are preparing the world's largest atom smasher to explore the depths of matter after successfully restarting the $10 billion machine following more than a year of repairs.


nuclear power plant

Doubts raised on nuclear industry viability

Physics / General Physics

created Nov 19, 2009 | popularity 3.1 / 5 (20) | comments 19

(PhysOrg.com) -- The investment in nuclear power has been growing around the world over the last few years, being viewed as a means for countries to control their energy security, avoid the price fluctuations ...


Researchers Find Innate Correlations Among Different Power Law Phenomena

Researchers Find Innate Correlations Among Different Power Law Phenomena

Physics / General Physics

created Nov 17, 2009 | popularity 4.3 / 5 (15) | comments 14

(PhysOrg.com) -- Studying the patterns that emerge in natural and social phenomena is a popular area of research, although usually individual phenomena are studied separately from each other. In a recent study, ...


Scientists demonstrate 'universal' programmable quantum processor

Scientists demonstrate 'universal' programmable quantum processor

Physics / Quantum Physics

created Nov 15, 2009 | popularity 4.6 / 5 (21) | comments 11

Physicists at the National Institute of Standards and Technology have demonstrated the first "universal" programmable quantum information processor able to run any program allowed by quantum mechanics -- th ...


Proton's party pals may alter its internal structure

Proton's party pals may alter its internal structure

Physics / General Physics

created Nov 18, 2009 | popularity 4.6 / 5 (20) | comments 9

A recent experiment at the DOE's Thomas Jefferson National Accelerator Facility has found that a proton's nearest neighbors in the nucleus of the atom may modify the proton's internal structure.