Study finds you get what you pay for with online Q & A sites

April 9, 2008

A new study by University of Minnesota computer science and engineering researchers revealed that the answer quality provided by online question-and-answer Web sites, such as Yahoo! Answers and Google Answers, depends on two factors -- how much you pay and how many people contribute to your answer.

The results of the study are reported in the academic research paper titled “Predictors of Answer Quality in Online Q&A Sites.” The paper was published in the Association for Computing Machinery’s 2008 Conference on Human Factors in Computing Systems (CHI 2008) proceedings, and presented at the conference in Florence, Italy, April 8.

The University of Minnesota study posed 126 questions across a variety of Q&A sites and found that paying $10 or more to get your question answered at the now-closed Google Answers site yielded the highest-quality answers as judged by a panel of evaluators. These answers were long and detailed, with many links to source material.

Surprisingly the Web site Yahoo! Answers, which provides answers for free, performed as well as Google Answers when the fee was low ($3) and outperformed reference librarians and an “ask-an-expert” site. Researchers attributed this success to the large online community that contributes to that site’s answers.

University of Minnesota researchers involved in the study include computer science and engineering professor Joseph Konstan and graduate student Max Harper. Their study examined a variety of questions eliciting facts, opinions and advice on topics spanning entertainment, technology and business. Examples of some of the questions posted are:

-- Which actress has the first female line in a talking movie" I found on Wikipedia that Al Jolson had the male line, but I can’t find any record of which female had the first line.

-- What is the best technique for making BBQ spare ribs" I’ll cook it if you can find me a recipe that's really worth the time and effort.

Of the findings, Konstan said, “Solutions that simply direct questions to a single individual don’t achieve results as well as those that open the question and answers to a larger community.”

To view this paper visit: http://www.grouplens.org/node/243 .

Source: University of Minnesota


print this article email this article download pdf blog this article bookmark this article     Stumble it Digg this share on Facebook retweet share on Reddit add to delicious
Rate this story - 3.3 /5 (4 votes)

Rank Filter

Move the slider to adjust rank threshold, so that you can hide some of the comments.


Display comments: newest first

  • davidjs - Apr 17, 2008
    • Rank: not rated yet
    As one of the researchers with the (sadly) retired Google Answers service, I was glad to see a study documenting what we already knew: you do, indeed, get what you pay for in the online Q&A business.

    Folks might be interested to know that a few dozen of the researchers from the Google Answers team formed a new Q&A fee-based service at Uclue.com

    http://uclue.com

    In my opinion, it's even better than its predecessor.

    David

April 9, 2008 all stories

Comments: 1

3.3 /5 (4 votes)
  • Stumble this up

  • Digg this

  • share this

  • hide
  • Related Stories




  • hide
  • Relevant PhysicsForums posts

  • Base Isolation Systems in Skyscrapers?
    created 7 hours ago
  • Need to interview a Computer Hardware Engineer for school project
    created 9 hours ago
  • transient heat transfer
    created 15 hours ago
  • Trying to adapt a fuel gage circuit
    created Nov 22, 2009
  • More from Physics Forums - General Engineering

Other News

Intel logo A

Intel wants a chip implant in your brain

Technology / Hi Tech

created 21 hours ago | popularity 4.1 / 5 (16) | comments 28

(PhysOrg.com) -- Computer chip maker Intel wants to implant a brain-sensing chip directly into the brains of its customers to allow them to operate computers and other devices without moving a muscle.


Just in time for Black Friday: students turn iPhone into barcode scanner

Just in time for Black Friday: students turn iPhone into barcode scanner

Technology / Software

created 9 hours ago | popularity 4 / 5 (1) | comments 0

(PhysOrg.com) -- Comparing prices over the Internet has become a common practice for consumers. Now, just in time for Black Friday, a group of Missouri University of Science and Technology students is putting ...


IBM Researchers Lower Language Barrier With Text Translator

Technology / Computer Sciences

created 11 hours ago | popularity 4.3 / 5 (3) | comments 0

IBM Researchers are helping to break the language barrier with the advent of technology dubbed "n.Fluent" -- smart software that translates text between English and 11 other languages. IBM employees use it to instantaneously ...


The KLM airplane which runs on biokerosene is seen at Schiphol airport, near Amsterdam

KLM flies world's first 'passenger flight on biofuel'

Technology / Energy

created 11 hours ago | popularity 5 / 5 (1) | comments 0

A Boeing 747, one of four engines powered by a 50-percent biokerosene mix, circled the Netherlands for an hour on Monday for what airline KLM called the world's first passenger flight using biofuel.


Microsoft has held talks with Rupert Murdoch's News Corp over removing its news websites from Google, a report said

News Corp, Microsoft hold talks on Google: report

Technology / Internet

created 22 hours ago | popularity 1.8 / 5 (6) | comments 4

Microsoft has held talks with Rupert Murdoch's News Corp over a possible plan for the software giant to pay the media company to remove its news websites from Google, a report said Monday.