Electronic Research Publications: Too Much of A Good Thing?

July 28, 2008

(PhysOrg.com) -- New research at the University of Chicago shows that as more scholarly and research journals are available online, researchers cite fewer, newer papers.

The Internet now gives scientists and researchers instant access to an astonishing number of academic journals. So what is the impact of having such a wealth of information at their fingertips? The answer, according to new research released in the journal Science, is surprising--scholars are actually citing fewer papers in their own work, and the papers they do cite tend to be more recent publications. This trend may be limiting the creation of new ideas and theories.

James Evans, Assistant Professor in Sociology, focuses his work on nature of scholarly research. During a lecture on the influence of private industry money on research, a student instead asked how the growth of the Internet has shaped science. "I didn't have an immediate answer," Evans said.

When he reviewed the research on the Internet and science, Evans discovered that most of it focused on much faster and broader the Internet allows scholars to search for information, but not how the medium itself was impacting their work. "That's where this idea came from," he continued. "I wanted to know how electronic provision changed science, not how much better it made it."

After receiving support from the National Science Foundation to pursue this question, Evans analyzed a database of over 34 million articles and compared their online availability from 1998 to 2005 to the number of times they were cited from1945 to 2005. The results showed that as more journal issues came online, few articles were cited, and the ones that were cited tended to be more recent publications. Scholars also seemed to concentrate their citations more on specific journals and articles. "More is available," Evans said, "but less is sampled, and what is sampled is more recent and located in the most prominent journals."

Evans's research also found that this trend was not evenly distributed across academic disciplines. Scientists and scholars in the life sciences showed the greatest propensity for referencing fewer articles, but the trend is less noticeable in business and legal scholarship. Social scientists and scholars in the humanities are more likely to cite newer works than other disciplines.

So what is it about doing research online versus in a bricks-and-mortar library that changes the literature review so critical to research? Evans has identified a few possible explanations. Studies into how research is conducted show that when people browse material in a library, they peruse more titles and articles than they do when conduct online research, which gives targeted results listed as hyperlinks. Online searches also tend to organize results by date and relevance, a quality that is typically measured by how often other users selected the item during similar searches. Because of this, as more scholars choose to open a given article out of a list, the more likely it is to be opened by future researchers.

Does this phenomenon spell the end of the literature review? Evans doesn't think so, but he does believe that it makes scholars and scientists more likely to come to a consensus and establish a conventional wisdom on a given topic faster. "Online access," Evans said, "facilitates a convergence on what science is picked up and built upon in subsequent research." The danger in this, he believes, is that if new productive ideas and theories aren't picked up quickly by the research community, they may fade before their useful impact is evaluated. "It's like new movies," he says. "If movies don't get watched the first weekend, they're dropped silently."

Evans plans to work with linguists and computer scientists to explore how ideas are expressed in articles to better understand what the consequences of losing old ideas are and how they can be retrieved and resurrected, a challenge he sees as being important in the pursuit of knowledge. "With science and scholarship increasing online," he said, "findings and ideas that don't receive attention very soon will be forgotten more quickly than ever before."

Provided by University of Chicago