How to Spot an Influential Paper Based on its Citations

July 4, 2009 by Lisa Zyga weblog
Science journals

Enlarge

By factoring out the effects of timing, scientists may be able to find papers whose large numbers of citations are due to reasons such as high quality content. Credit: Wikimedia.

(PhysOrg.com) -- At first it may seem that the number of citations received by a published scientific paper is directly related to that paper's quality of content. The higher the quality, the more people read and cite that paper. However, the number of citations received by a paper depends more on when that paper was published; papers published early in a new field receive many more citations than those published later on. Although this effect has previously been known, a recent study has tested and verified the so-called "first mover advantage" with data from selected fields.

"The common-sense reasoning behind this observation is that papers published early in a field receive citations essentially regardless of content because they are the only game in town," wrote the study's author, physicist Mark Newman of the University of Michigan. "Authors feel the need to cite something and if there is only a small number of relevant publications then inevitably those publications get cited. This gives the earliest publications a head start that is subsequently amplified by the preferential attachment process and they will continue to receive citations indefinitely at a higher rate than later papers because they have more citations to begin with."

As Newman noted, the first person to investigate this issue was the "physicist-turned-historian-of-science" Derek de Solla Price. In 1965, Price presented one of the first studies of networks of citations between papers. He found that, while most papers receive only a small number of citations, a few receive a very large number of citations. Later, this distribution pattern became known as "preferential attachment," and the papers with lots of citations were found to be the early ones.

In his , Newman calculated the exact size of this first-mover effect (the number of citations as a function of time) within the preferential attachment model. When comparing the results with citation data from a number of fields, he found that the size and duration of the effect often agree closely with the theoretical predictions. In addition, by factoring out the effects of timing, Newman could determine which papers were cited not because they came first, but for other reasons, such as quality of content.

"If we measure a paper's citation count relative to the average in its field for the given publication date, then this effect is factored out and - perhaps - the true stars of the citation galaxy will emerge," Newman wrote.

He concludes that, on one hand, a cynical observer who wants to be highly cited would be better off writing the first paper in a new field than writing the best paper in a more mature field. But from another point of view, understanding this effect could also help readers find papers that buck the first-mover trend, as these papers could contain true breakthroughs.

More information: M.E.J. Newman. "The first-mover advantage in scientific publication." 2009 EPL 86 68001 (6pp) doi: 10.1209/0295-5075/86/68001

© 2009 PhysOrg.com

Filter


Move the slider to adjust rank threshold, so that you can hide some of the comments.


Display comments: newest first

Alizee
Jul 04, 2009

Rank: 1 / 5 (5)
In another words: Einstein was a plagiator, so he never got a Nobel price..
Sonhouse
Jul 04, 2009

Rank: 5 / 5 (1)
In another words: Einstein was a plagiator, so he never got a Nobel price..

Nobel PRICE? What do you think he got, something from Wal Mart? I assume you are fully aware he did receive the Nobel prize.
Bob_Kob
Jul 05, 2009

Rank: not rated yet
Not for relativity tho
iamcrazy
Jul 05, 2009

Rank: not rated yet
Einstein was a fruitcake jim
MatthiasF
Jul 05, 2009

Rank: 5 / 5 (1)
Wouldn't the number of citations correlate to how many people read the work? A paper read by three people but cited by 600 wouldn't make much sense, would it?

So, perhaps the study should conclude that papers written for immature fields are read and cited more? Wouldn't this lead people to fracture fields smaller so more people are "first-movers"?
johanfprins
Jul 06, 2009

Rank: not rated yet
There is another problem with first papers in a new field. They become quoted so much that people start to believe that they contain holy dogma. As Joseph Goebbels knew, an often repeated lie becomes a truth. Eventually the scientific community ends up defending wrong physics with the zeal of zealots.
For, example, the paper on Cooper pairs and the BCS model are such manuscripts: Just try and give another possible interpretation for superconduction and you soon find yourself excommunicated from physics; even though it is quite simple to prove beyond doubt that Cooper pairs and BCS cannot explain how an electric-field is cancelled within a suoperconductor. As Einstein has noted it takes only one discrepancy to show that a model is wrong. And these two papers are wrong!
Rank 4 /5 (13 votes)
Related Stories
Relevant PhysicsForums posts

More news stories

Researchers make better heat sensor based on butterfly wings

(PhysOrg.com) -- Scientists have long known that butterfly wings produce their iridescent colors by bouncing light around and between tiny ridges in structures made of chitin. More recently they’ve discovered ...

Physics / Optics & Photonics

created 1 hour ago | popularity 5 / 5 (2) | comments 0 | with audio podcast report

Rapunzel, Leonardo and the physics of the ponytail

(PhysOrg.com) -- New research provides the first mathematical understanding of the shape of a ponytail and could have implications for the textile industry, computer animation and personal care products.

Physics / General Physics

created 4 hours ago | popularity 4.7 / 5 (3) | comments 0 | with audio podcast

Explained: Sigma

It's a question that arises with virtually every major new finding in science or medicine: What makes a result reliable enough to be taken seriously? The answer has to do with statistical significance -- but ...

Physics / General Physics

created Feb 09, 2012 | popularity 5 / 5 (21) | comments 87

Quantum physicist explains $100K offer for proof scaled-up quantum computing is impossible

(PhysOrg.com) -- MIT researcher Scott Aaronson has certainly riled the physics community with his offer this past Friday, of $100,000 to anyone who can prove that scaled-up quantum computing is impossible. ...

Physics / Quantum Physics

created Feb 08, 2012 | popularity 4.3 / 5 (15) | comments 37 | with audio podcast weblog

Hovering not hard if you're top-heavy, researchers find

Top-heavy structures are more likely to maintain their balance while hovering in the air than are those that bear a lower center of gravity, researchers at New York University's Courant Institute of Mathematical Sciences ...

Physics / General Physics

created Feb 10, 2012 | popularity 5 / 5 (4) | comments 5 | with audio podcast


Transforming galaxies

(PhysOrg.com) -- Many of the Universe's galaxies are like our own, displaying beautiful spiral arms wrapping around a bright nucleus. Examples in this stunning image, taken with the Wide Field Camera 3 on ...

'Smart' microcapsules in a single step

(PhysOrg.com) -- A new, single-step method of fabricating microcapsules, which have potential commercial applications in industries including medicine, agriculture and diagnostics, has been developed by researchers ...

Tenofovir, leading HIV medication, linked with risk of kidney damage

(Medical Xpress) -- Tenofovir, one of the most effective and commonly prescribed antiretroviral medications for HIV/AIDS, is associated with a significant risk of kidney damage and chronic kidney disease that increases over ...

Building a 'blind-friendly' Internet

Rakesh Babu demonstrates how a blind person uses the Internet.

A continent ablaze in auroral and manmade light

The North American continent is literally set ablaze in a confluence of Auroral and Manmade light captured in spectacular new videos snapped by the astronauts serving aboard the International Space Station ...

Ethanol mandate not the best option

Many people are willing to pay a premium for ethanol, but not enough to justify the government mandate for the corn-based fuel, a Michigan State University economist argues.