From a Queen song to a better music search engine (w/Video)
May 15, 2009
A screen shot from the trivia game on Herd It, the new music discovery game on Facebook http://apps.facebook.com/herd-it/ created by electrical engineers at UC San Diego. Credit: UC San Diego Jacobs School of Engineering
At a recent IEEE technology conference, UC San Diego electrical engineers presented a solution to their problem with the song "Bohemian Rhapsody,"—and it's not that they don't like this hit from the band Queen. The electrical engineers' issue with "Bohemian Rhapsody" is that it is too heterogeneous. With its mellow piano, falsetto vocals, rock opera sections and crazy guitar solos, Bohemian Rhapsody is so internally varied that machine learning algorithms at the heart of their experimental music search engine have trouble labeling the song. The solution presented at the 2009 International Conference on Acoustics, Speech, and Signal Processing (ICASSP) in Taiwan could lead to improvements in the electrical engineers' song labeling and search engine system.
The system "listens" to songs it has never heard before, labels them based on the actual sounds in the song, and then retrieves songs, as appropriate, when people type descriptive words—like "mellow jazz"—into the team's experimental search engine.
At ICASSP, UC San Diego electrical engineering Ph.D. student Luke Barrington presented a new model for music segmentation that can capture both the sound of a song and how this sound changes over time. By modeling music in this way, Barrington showed how to automatically segment songs such as Bohemian Rhapsody into homogenous sections such as verses, choruses and bridges. This new approach to training computers to dissect songs into heterogeneous segments and then accurately label each chunk could improve the accuracy of the new music search engine built by engineers from the Jacobs School of Engineering at UC San Diego.
The team's nickname for their experimental music search engine is "Google for music". Users type descriptive words—rather than song titles, album names or artist names—and the search engine returns specific song suggestions. The engine currently works for more than 100 words that cover music genres, emotions and instruments. The Jacobs School engineers are working to expand the search engine's "vocabulary" before opening it up to the public later this year.
Teaching Computers to Label Songs
In order to "teach" the search engine new words, the engineers need to show it many different examples of songs that fit that description. Initially, the engineers paid UC San Diego undergraduates to manually label songs that would serve as training materials for machine learning algorithms. But instead of continuing to rely on this expensive option, the engineers built online music games that encourage people connected via the Internet to do the song labeling while listening to music online.
A screen shot from Herd It, the new music discovery game on Facebook http://apps.facebook.com/herd-it/ created by electrical engineers at UC San Diego. Credit: UC San Diego Jacobs School of Engineering
In April, the electrical engineers launched their games on Facebook as an application called Herd It. http://apps.facebook.com/herd-itTo play Herd It, log in to Facebook, open the Herd It app, select a genre of music, and start listening to song clips and playing the games. Some games ask users to identify instruments, while others focus on music genres, artist names, emotions triggered by the song, and activities you might do while listening to a song. The more your answers align with the rest of the online crowd playing the game at the same time, the more points you score.
"The Facebook games are a lot of fun and a great way to discover new music. At the same time, the games deliver the data we need to teach our computer audition system to listen to and describe music like humans do," said Gert Lanckriet, the electrical engineering professor and machine learning expert from the Jacobs School of Engineering steering the project. Lanckriet also leads UC San Diego's Computer Audition Laboratory, housed at the UC San Diego division of Calit2.
For the system to "listen and describe music like a human," it must find patterns in the songs using the tools of machine learning. For example, for the system to learn to identify and label romantic songs, it must be exposed to many different romantic songs during the training period.
This exposure enables the machine learning algorithms find patterns in the wave forms of the songs that make the songs romantic. Once trained, the system can identify romantic songs that it has never before encountered, offering the tantalizing possibility of amassing a huge database of songs that can be tagged and retrieved based on text-based searches with no human intervention.
"The more examples of romantic songs our search engine is exposed to, the more accurately it will be able to identify romantic songs it has never heard before," explained Barrington.
Part of Barrington's Ph.D. dissertation will involve demonstrating that data collected from the Facebook games reliably improves the accuracy of the search engine.
"Once enough people play our new music discovery games on Facebook, I'll have the data I need to both improve our search engine and finish my Ph.D.," said Barrington.
The song-word combinations collected by the Facebook games will also enable the researchers to grow their music search engine's vocabulary and increase its coverage in genres and classes of music.
More information: View the paper here:
http://cosmal.ucsd.edu/cal/pubs/Barrington-MusicDTM-ICASSP09.pdf
Herd It game on Facebook: http://apps.facebo … .com/herd-it or http://herdit.org
-
Online game feeds music search engine project at UC San Diego
Sep 25, 2007 |
not rated yet |
0
-
World First ~ The Walkman™ phones 100
Aug 01, 2005 |
not rated yet |
0
-
60-second review: Sansa slotRadio
Apr 29, 2009 |
not rated yet |
0
-
iTunes Music Store Launches in Denmark, Norway, Sweden and Switzerland
May 10, 2005 |
not rated yet |
0
-
'Long Tail' of music comes to cell phones
Jul 26, 2006 |
not rated yet |
0
-
Engineers build first sub-10-nm carbon nanotube transistor
Feb 01, 2012 |
4.9 / 5 (31) |
30
-
Something old, something new: Evolution and the structural divergence of duplicate genes
Jan 31, 2012 |
4.6 / 5 (7) |
1
-
The hidden nanoworld of ice crystals: Revealing the dynamic behavior of quasi-liquid layers
Jan 30, 2012 |
5 / 5 (3) |
1
-
Stock market network reveals investor clustering
Jan 27, 2012 |
3.9 / 5 (23) |
8
-
Of microchemistry and molecules: Electronic microfluidic device synthesizes biocompatible probes
Jan 26, 2012 |
5 / 5 (1) |
0
-
Synergistic relations between computer science and technology.
Feb 06, 2012
-
how do iphone gloves work?
Feb 05, 2012
-
iPhone battery over time
Jan 30, 2012
-
Best alternate Tablet to an iPad for writing math or physics equations?
Jan 26, 2012
-
Sending SMS to a website
Jan 20, 2012
-
Need help with my technical fest!
Jan 19, 2012
- More from Physics Forums - Computing & Technology
More news stories
Google users warned of threat to smartphone wallets
Users of Google smartphone wallets were being warned on Friday that there is a way to crack pass codes intended to thwart thieves from going on illicit shopping sprees.
1 hour ago |
5 / 5 (1) |
0
Anonymous knocks CIA website offline (Update)
The website of the Central Intelligence Agency was inaccessible on Friday after the hacker group Anonymous claimed to have knocked it offline.
2 hours ago |
5 / 5 (4) |
8
New error-correcting codes guarantee the fastest possible rate of data transmission
Error-correcting codes are one of the triumphs of the digital age. Theyre a way of encoding information so that it can be transmitted across a communication channel such as an optical fiber o ...
Technology / Computer Sciences
11 hours ago |
5 / 5 (4) |
5
|
New power source discovered
(PhysOrg.com) -- Researchers at the Massachusetts Institute of Technology (MIT) and RMIT University have made a breakthrough in energy storage and power generation.
Technology / Energy & Green Tech
10 hours ago |
4.8 / 5 (16) |
5
|
Small modular reactor design could be a 'SUPERSTAR'
(PhysOrg.com) -- Though most of today's nuclear reactors are cooled by water, we've long known that there are alternatives; in fact, the world's first nuclear-powered electricity in 1951 came from a reactor ...
Technology / Energy & Green Tech
10 hours ago |
4.2 / 5 (10) |
19
|
Complex wiring of the nervous system may rely on a just a handful of genes and proteins
Researchers at the Salk Institute have discovered a startling feature of early brain development that helps to explain how complex neuron wiring patterns are programmed using just a handful of critical genes. ...
NASA sees wide-eyed cyclone Jasmine
Cyclone Jasmine's eye has opened wider on NASA satellite imagery, as it moves through the Southern Pacific Ocean.
NASA sees Giovanna reach cyclone strength, threaten Madagascar
Tropical Storm 12S built up steam and became a cyclone on February 10, 2012 as NASA's Terra satellite passed overhead. Residents of east-central Madagascar should prepare for this cyclone to make landfall ...
Putting the squeeze on planets outside our solar system
(PhysOrg.com) -- Using high-powered lasers, scientists at Lawrence Livermore National Laboratory and collaborators discovered that molten magnesium silicate undergoes a phase change in the liquid state, abruptly ...
The power of estrogen -- male snakes attract other males
A new study has shown that boosting the estrogen levels of male garter snakes causes them to secrete the same pheromones that females use to attract suitors, and turned the males into just about the sexiest ...
Grass to gas: Researchers' genome map speeds biofuel development
Researchers at the University of Georgia have taken a major step in the ongoing effort to find sources of cleaner, renewable energy by mapping the genomes of two originator cells of Miscanthus x giganteus, a large perenn ...

May 15, 2009
Rank: 1 / 5 (1)
May 15, 2009
Rank: 5 / 5 (1)
May 15, 2009
Rank: not rated yet
Then we'll have true democracy, as the software tells us what we're really getting at.
Works for me. Humans are so kludgey.
May 16, 2009
Rank: not rated yet