Developing a neighborhood watch for the Internet

November 24, 2008

Internet network performance problems are not only annoying to users -- they are costly to businesses and network operators. But since the Internet has no built-in monitoring system, network problems often go unnoticed.

To help fix this problem, researchers at the McCormick School of Engineering and Applied Science at Northwestern University have developed a new way to detect and report such problems in real time through their Network Early Warning System.

While choppy playback on streaming video may be irritating to a user, it can drive thousands of potential customers away from the site providing the feed. As the Internet continues to grow, these network problems, or anomalies, become all the more frequent and frustrating.

Determining the existence, let alone the impact, of network anomalies is important because the Internet has no overall monitoring system. Current monitoring systems try to identify network anomalies and can look for issues that could lead to performance problems but cannot tell whether individual users are actually experiencing problems.

Yet every day, millions of Internet users worldwide naturally generate data traffic that inherently provides information about whether the network is working or not. (Think of the million of peer-to-peer users in systems like BitTorrent or Skype.). By sharing high-level information about their experience, these users could very efficiently and accurately detect where problems occur in real time.

So Fabián Bustamante, associate professor of electrical engineering and computer science, and doctoral student David Choffnes are exploiting this observation to build a participatory approach to detecting, isolating and reporting network anomalies: the Network Early Warning System, or NEWS for short.

"You can think of it as crowd sourcing network monitoring," said Bustamante.

While the concept behind NEWS is straightforward, Bustamante and Choffnes overcame a number of design challenges to bring the approach to an Internet-scale deployment. By gathering information about network conditions from natural data traffic, NEWS focuses only on problems that affect end-users and does so without requiring any extra and potentially wasteful network-measurement traffic. NEWS incorporates knowledge of "normal" behavior for network applications to prevent false alarms and confirms suspected problems by checking with other nearby users.

NEWS is currently implemented as an extension to a popular BitTorrent client. By generating warnings about problems in the network, the software allows users to ensure that they get the proper Internet service they pay for. This was incentive enough for more than 12,000 users to install the software during its beta-testing phase. The researchers are also developing a portal for network providers to be notified about the network problems reported by their users.

Bustamante and Choffnes, who previously released the popular Ono extension for BitTorrent (now with more than 300,000 users worldwide), are applying the NEWS approach to build other valuable services, such as enabling comparison shopping for different Internet Service Providers based on the performance seen from subscribers.

Source: Northwestern University

3.3 /5 (6 votes)  

Rank 3.3 /5 (6 votes)
Related Stories
Relevant PhysicsForums posts
  • How to tilt a object
    created13 hours ago
  • How to calculate total compressibility in liquid porous solid system
    created18 hours ago
  • Need help reading 3-D
    createdFeb 11, 2012
  • A way to send and receive wireless data
    createdFeb 11, 2012
  • Calling function with no input argument
    createdFeb 10, 2012
  • Force free body diagram problem on gym equipment
    createdFeb 10, 2012
  • More from Physics Forums - General Engineering

More news stories

Ethanol mandate not the best option

Many people are willing to pay a premium for ethanol, but not enough to justify the government mandate for the corn-based fuel, a Michigan State University economist argues.

Technology / Energy & Green Tech

created 51 minutes ago | popularity not rated yet | comments 0

Teaching teens safety in the virtual world

A new cyber safety program on the dangers of social networking is being developed by Flinders University, in light of an alarming report which shows children as young as 12 are meeting internet strangers in ...

Technology / Internet

created 29 minutes ago | popularity not rated yet | comments 0

Darpa to develop mobile millimeter-wave backhaul networks

Providing high-bandwidth communications for troops in remote forward operating locations is not only critical but also challenging because a reliable infrastructure optimized for remote geographic areas does ...

Technology / Telecom

created 43 minutes ago | popularity not rated yet | comments 0

Building a 'blind-friendly' Internet

Rakesh Babu demonstrates how a blind person uses the Internet.

Technology / Internet

created 1 hour ago | popularity not rated yet | comments 0

Microsoft India retail site down after 'cyber attack'

Microsoft said Monday it was investigating an attack by hackers on its Indian retail website, reportedly carried out by a Chinese group called the "Evil Shadow Team."

Technology / Internet

created 3 hours ago | popularity not rated yet | comments 0


Transforming galaxies

(PhysOrg.com) -- Many of the Universe's galaxies are like our own, displaying beautiful spiral arms wrapping around a bright nucleus. Examples in this stunning image, taken with the Wide Field Camera 3 on ...

'Smart' microcapsules in a single step

(PhysOrg.com) -- A new, single-step method of fabricating microcapsules, which have potential commercial applications in industries including medicine, agriculture and diagnostics, has been developed by researchers ...

A continent ablaze in auroral and manmade light

The North American continent is literally set ablaze in a confluence of Auroral and Manmade light captured in spectacular new videos snapped by the astronauts serving aboard the International Space Station ...

Nanostructured electrodes for rechargeable sodium-Ion batteries

Highly efficient 3V cathodes for rechargeable sodium-ion batteries have been developed by users from Argonne National Laboratory's Materials Science, Chemical Sciences & Engineering, and X-ray Sciences Divisions, ...

New tumor suppressor gene identified

A recent study published in Clinical Cancer Research suggests that the protein hVps37A suppresses tumor growth in ovarian cancer. The work, which was funded by the Austrian Science Fund FWF, shows, for th ...

A lost world? How zooarchaeology can inform biodiversity conservation

A new study of tropical forests will provide a 50,000-year perspective on how animal biodiversity has changed, explored through an archaeological investigation of animal bones.