New study finds publication bias among trials submitted to FDA

November 25, 2008

A quarter of drug trials submitted in support of new drug applications to the US Food and Drug Administration (FDA) remain unpublished five years after the fact, says new research published in the open access journal PLoS Medicine.

Among those trials published, unexplained discrepancies between the FDA submissions and their corresponding publications—the addition or deletion of outcomes, changes in the statistical significance of reported outcomes, and changes in overall trial conclusions—tended to lead to more favorable presentations of the drugs in the medical literature available to health care professionals.

Lisa Bero and colleagues from the University of California San Francisco reviewed the publication status of all 164 efficacy trials carried out in support of the 33 new drug applications (NDA) for new molecular entities approved by the FDA in 2001, and compared information from the FDA reviews with published journal articles. Seventy-eight percent of the trials were published. Trials with favorable outcomes for the drugs were more likely to be published as those without favorable outcomes. Of a total of 179 primary outcomes included in the NDAs, 41 were omitted from the papers. The papers included 138 outcomes that were also in the NDAs (77%), plus 15 additional outcomes that favored the test drug, and two other neutral or unknown additional outcomes. Thus, the papers included more outcomes favoring the test drug than did the NDAs, report the authors.

The research also found additional discrepancies between the FDA reviews and the published papers. Of the 43 primary outcomes reported in the NDAs that showed no statistically significant benefit for the test drug, only half were included in the papers; for five of the reported primary outcomes, the statistical significance differed between the NDA and the paper and generally favored the test drug in the papers. Nine out of 99 conclusions differed between the NDAs and the papers; each time, the published conclusion favored the test drug. The authors did not investigate why the discrepancies existed, nor whether the changes were prompted by the drug sponsor, authors, or journals.

Because of their findings of publication bias and selective reporting, the authors conclude that "the information that is readily available in the scientific literature to health care professionals is incomplete and potentially biased."

In a commentary on the research, An-Wen Chan from the Mayo Clinic in Rochester (uninvolved in the study) says this new research makes an important contribution to the growing body of evidence that the trial literature is skewed towards reporting favorable results. "Biased reporting of results from NDA trials is particularly concerning because these journal articles are the only peer reviewed source of information on recently approved drugs for health care providers, who will have had limited clinical experience with these new treatments," Dr Chan says. "There are also substantial cost implications if the efficacy is overestimated and the drugs overused."

Before a new drug is approved for the treatment of a specific disease in the United States and becomes available for doctors to prescribe, the drug's sponsors must submit a "New Drug Application" (NDA) to the FDA, which provides details of the drug's development from laboratory and animal studies through to clinical trials. FDA reviewers use this evidence to decide whether to approve a drug.

Citation: Rising K, Bacchetti P, Bero L (2008) Reporting bias in drug trials submitted to the Food and Drug Administration: A review of publication and presentation. PLoS Med 5(10): e217. doi:10.1371/journal.pmed.0050217
http://medicine.plosjournals.org/perlserv/?request=get-document&doi=10.1371/journal.pmed.0050217

Source: Public Library of Science


print this article email this article download pdf blog this article bookmark this article     Stumble it Digg this share on Facebook retweet share on Reddit add to delicious
Rate this story - 4 /5 (2 votes)

Rank Filter

Move the slider to adjust rank threshold, so that you can hide some of the comments.


Display comments: newest first

  • Crucialitis - Nov 25, 2008
    • Rank: not rated yet
    Wow.. how do you trust your doctor who's in the pocket of big pharmy when big pharmy's being biased by the FDA... who ironically is in control of both what could cause and cure illnesses.
    It's no wonder so many are uninsured!
  • VOR - Nov 25, 2008
    • Rank: not rated yet
    As a capitalist society we must be more vigalent for the affects greed/competition has on truth and the common good.

November 25, 2008 all stories

Comments: 2

4 /5 (2 votes)
  • Stumble this up

  • Digg this

  • share this

  • hide
  • Related Stories




  • hide
  • Relevant PhysicsForums posts

Other News

Researchers discover new 'golden ratios' for female facial beauty

Medicine & Health / Psychology & Psychiatry

created 54 minutes ago | popularity 5 / 5 (3) | comments 1

Beauty is not only in the eye of the beholder but also in the relationship of the eyes and mouth of the beholden. The distance between a woman's eyes and the distance between her eyes and her mouth are key factors in determining ...


Learning styles debunked

Medicine & Health / Psychology & Psychiatry

created 12 minutes ago | popularity not rated yet | comments 0

Are you a verbal learner or a visual learner? Chances are, you've pegged yourself or your children as either one or the other and rely on study techniques that suit your individual learning needs. And you're not alone— for ...


The Medical Minute: New toy safety standards bring parents confidence

Medicine & Health / Health

created 4 minutes ago | popularity not rated yet | comments 0

The holiday season is here and for many kids that means one thing: toys. About half of all toy purchases in the United States occur between the Friday after Thanksgiving and Christmas.


The drink and violence ?gender gap?

Medicine & Health / Health

created 22 minutes ago | popularity not rated yet | comments 0

(PhysOrg.com) -- Women and men are at the same risk of violence - until they start drinking, new research from Cardiff University has shown.


Michelangelos make smart lovers: New study shows that partners sculpt each other to achieve their ideal selves

Medicine & Health / Psychology & Psychiatry

created 1hour ago | popularity 4 / 5 (3) | comments 0

Is that really Bob? You've seen him hundreds of mornings for the last 10 years at local coffee shops. Since he started dating Sara, he looks you in the eye -- and smiles. Sara takes every opportunity to let coffee shop cronies ...