Open the Data

There is a committee within the Institute of Medicine charged with examining the issues associated with data sharing after randomized controlled trials.

Data-sharing, without question, reflects a dire need.  From companies behaving badly – such as Merck with Vioxx, or Roche with Tamiflu – to inadvertent errors in analysis, protecting the health of patients requires more than simple peer review of documents prepared for pharmaceutical corporations by medical communication professionals.

Jeff Drazen, in this editoral, makes a call for feedback to the IOM.  Oddly, his main concern is – how long ought the original authors of a study be allowed exclusive access to trial data?  Would open data disincentivize researchers to perform clinical investigations, knowing their academic and commercial benefit would likely be curtailed?  On the flip side, we have seen publication of trial data be massively delayed – see ATLANTIS Part A, withheld for seven years – by pharmaceutical companies concerned with protecting their business interests.

It is a complicated and subtle issue, to be sure, but appropriate transparency is almost certainly an improvement over the current situation.  Full details, and how to leave feedback, are at:
http://www.iom.edu/activities/research/sharingclinicaltrialdata.aspx

“Open Data”
http://www.nejm.org/doi/full/10.1056/NEJMe1400850 (open access)

FDA: The Black Knight

… specifically, the Black Knight from Monty Python, apparently reduced to nibbling impotently at the feet of pharmaceutical corporations as they sail through the approval process.

This study in JAMA reviews the characteristics of novel therapeutics approved by the FDA between 2005 and 2012.  These authors identified 188 novel agents approved for 206 indications, and describe an entire host of fascinating data regarding the trials supporting approval.  A few of the most damning pearls:

  • 37% of indications were approved on the basis of a single trial.
  • The median number of patients per trial was 760.
  • 49% of trials used only surrogate outcomes.
  • Surrogate outcome trials constitute sole basis of approval for 91 indications.
  • Only 48% of cancer trials were randomized, and only 27% were double-blinded.
  • 40 trials were part of accelerated approval, 39 of which used surrogate outcomes, with a median number of patients of 157.

The data go on and on.

Considering many landmark trials could not be independently reproduced, even with the help of the original researchers; most published research findings are false; and half of what you know is wrong – we might as well just dump poison in our water supply.  It’s cheaper than suffering the next blockbuster drug for which pharmaceutical companies engineer an indication through distorted trial design.

“Clinical Trial Evidence Supporting FDA Approval of Novel Therapeutic Agents, 2005-2012“
http://jama.jamanetwork.com/article.aspx?articleid=1817794 (open access)

“Author Insights: Quality of Evidence Supporting FDA Approval Varies”
http://newsatjama.jama.com/2014/01/21/author-insights-quality-of-evidence-supporting-fda-approval-varies/

Sharp Things are the Best Medicine

Rather, they’re the best fake medicine.

This is a mildly entertaining review of placebo responses from migraine trials, looking to compare the effect size of various forms of placebo.  These authors identified 79 studies with appropriate response-to-therapy data for analysis, and evaluated the relative influences of pharmacologic therapy, cognitive-behavioral therapy, and acupuncture or surgery versus their placebo/sham versions.

Sham cognitive-behavioral therapy was ineffective and all the confidence intervals crossed unity.  Pharmacologic placebo was only superior to no treatment at all.  Then, sham acupuncture or surgery was superior to both no treatment and pharmacologic placebo.  Hence, the authors conclude the expectation of benefit is enhanced by the elaborate rituals associated with invasive therapies – and ought to be considered and cautioned against when designing trials that attempt comparisons between invasive and medical therapies.

Or, you could simply use this knowledge for evil – and conduct almost guaranteed-success non-inferiority trials for any manner of medically useless device for provision of symptom relief.

The choice is yours.

“Differential Effectiveness of Placebo Treatments: A Systematic Review of Migraine Prophylaxis”
http://www.ncbi.nlm.nih.gov/pubmed/24126676

Remember: Tamiflu is Still Junk

It’s that season of the year again, and with the fatalities from the H1N1 strain returning to the news folks are clamoring for Tamiflu (oseltamivir).

And, there’s still no evidence it has any protective effect at reducing complications from seasonal influenza.  In these two studies, a systematic review and a meta-analysis, some small reductions in symptom duration in mild illness were outweighed by drug adverse events such as nausea, vomiting, and diarrhea.  There is no evidence of any decrease in severe complications of influenza.

Unfortunately, the heterogeneity of trials, irregularities in baseline characteristics, and incomplete peer review all impair knowledge translation of this relatively expensive outpatient medication.  You’re all hopefully aware of the BMJ’s ongoing open data campaign regarding Tamiflu.  The last update from July seemed to indicate independent access to higher-quality trial data had finally been achieved.  If there is a durable, beneficial effect attributable to osletamivir, perhaps we will soon know.  Given the lack of transparency to date, I’m not optimistic.

“The value of neuraminidase inhibitors for the prevention and treatment of seasonal influenza: a systematic review of systematic reviews.”
http://www.ncbi.nlm.nih.gov/pubmed/23565231

“Effectiveness of oseltamivir in adults: a meta-analysis of published and unpublished clinical trials.”
http://www.ncbi.nlm.nih.gov/pubmed/22997224

Follow the Money

The sun is coming up – in 2014 the Sunshine Act will further illuminate just how much money is being hemorrhaged in healthcare to support the profit motives of pharmaceutical and device providers.  However, increased transparency has become more prevalent – including a few companies posting grant award registries to their websites.  These 14 companies, and their distribution of funds in 2010, are the focus of this brief report in JAMA.

Considering this is just a subset of a little more than half the top drug companies in sales from 2010, the numbers are more than a little staggering: $657M distributed, with over $100M from Roche/Genentech alone.  Medical communication companies received 26%, followed by academic medical centers with 21%, then disease-targeted advocacy organizations with 15%.  But, this report focuses only on the MCCs – considering their role in knowledge translation to the average clinician and consumer.

The largest beneficiary/offender?  Medscape/WebMD.  $20M in grant awards from just this subset of 14 drug companies – suggesting pharmaceutical corporation “donations” represent a significant portion of their $500M annual revenue.  It might be most appropriate to label every news post on their site as “sponsored content” or “special advertising section”.  This brief report further evaluates the privacy policies of these MCCs, and determines physician behavior collected by their sites is likely redistributed for profit back to various industry players.

Pharmaceutical and device manufacturers are not charities.  Executives from these companies, despite what their public relations department would have you believe, are not sitting in strategy meetings discussing altruistic giving for the good of health.  These financial outlays are investments in marketshare and mindshare, and ought to be viewed for what they are – corrupting influences contributing to the degradation of cost-effective care.

“Medical Communication Companies and Industry Grants”

Brainwashing With Oxytocin

Placebo mechanisms are well-known.  As Ken Milne of The Skeptic’s Guide is happy to tell you, the power of belief is strong.

But, it turns out it can be made stronger.

This rather fascinating study evaluates the power of oxytocin.  Oxytocin has been linked to processes of empathy, trust, and social learning.  These elements, as noted by the authors, are key to patient-physician interactions.  So, they perform a little study to see whether oxytocin can enhance the placebo effect – tapping into the elements of physician empathy and trust.

In the experiment, a technician applied either oxytocin or saline intranasally.  Then, they applied the same inert cream to two sites on each patient’s forearm, telling the patient one was the control, and one was the active drug.  Patients were tested using heat as painful stimuli on a visual analog scale.

There was, as expected, a placebo effect.  In the saline group, the mean VAS difference between the inert “control” cream and the inert “placebo” cream was 7mm.  In the oxytocin group, however, the mean VAS difference between sites was 13mm.  In their small group of patients, this result met statistical significance – and thus the authors conclude oxytocin enhances the placebo response.

Not precisely certain how this would be applied clinically, but it’s a fascinating little research letter.

“Effect of Oxytocin on Placebo Analgesia: A Randomized Study”
http://www.ncbi.nlm.nih.gov/pubmed/24150470

Ocorrafoo Cobange & Grace Groovy

There are many challenges in the world of scientific publishing.  I’ve spent time focusing on conflict-of-interest in peer review – but this is a fabulous exposé on a rapidly-growing segment of for-profit, predatory journals with no substantial peer-review process whatsoever.

This is more a journalistic project than a scientific study, but it details the results of an experiment performed to determine the rigor of peer review at a number of open-access journals.  Open access journals, in contrary to most journals, derive their operating income by charging authors a publication fee – rather than charging for print subscription, reprints, or individual article access.  Proponents of this model point to the beneficial effect open-access has on medical knowledge in countries without the means and wealth required to join the first-world scientific community.  However, this model has essentially been hijacked by editors who use a predatory process of fraudulent representation to run these journals solely for profit.

This journalist created a fake, flawed, and horribly written (he ran it through Google Translate into French, and back) molecular cancer therapeutics article and submitted it to over 300 open-access journals – half these journals were on a “blacklist” and the remainder were not.  Without completely re-iterating the entire story (or the mystery of Grace Groovy), the crux is – nearly every journal on the “blacklist” accepted the fictional article, while journals on the more reliable list rejected it about 2/3rds of the time.

Lovely piece of investigative journalist and an entertaining read – and an excellent description of a growing problem in the realm of scientific integrity.

“Who’s Afraid of Peer Review?”
http://www.sciencemag.org/content/342/6154/60.summary

Reforming Clinical Guidelines

If you’ve been following my various linkaways on this blog over the last couple months, you’ve seen me highlight an investigative report by Jeanne Lenzer regarding some of the controversial recent clinical guidelines.  Beyond that, however, is Part 2 of this project – where a team headlined by Jerome Hoffman, Curt Furburg, and John Ioannidis came up with a set of evaluation criteria for worrisome conflicts-of-interest in clinical guidelines.

These evaluation criteria, a set of “red flags”, chosen over months of debate:

  • Sponsor(s) is a professional society that receives substantial industry funding;
  • Sponsor is a proprietary company, or is undeclared or hidden
  • Committee chair(s) have any financial conflict
  • Multiple panel members have any financial conflict
  • Any suggestion of committee stacking that would pre-ordain a recommendation regarding a controversial topic 
  • No or limited involvement of an expert in methodology in the evaluation of evidence
  • No external review
  • No inclusion of non-physician experts/patient representative/community stakeholders

As you can see, the list includes several types of sponsorship COI, as well as other cautions meant to ensure objectivity and patient-centric recommendations.  Whether this set of “red flags” becomes a useful tool for future guideline evaluation yet remains to be seen.  As should come as a surprise to no one, the new ACEP/AAN tPA clinical policy – evaluated independently of the guidelines Working Group – garners an unimpressive six “red flags” and a “caution”.

William Mallon, David Newman, Kevin Klauer, myself, and many others contributed to this project.

“Ensuring the integrity of clinical practice guidelines: a tool for protecting patients”
http://www.bmj.com/content/347/bmj.f5535

Conflict-of-Interest Catastrophe

As if we didn’t have enough difficulty interpreting results when study design is inadequate, blinding is violated, sample sizes are underpowered, or there are differences in enrollment – we must also be worried about gross scientific misconduct.

This concerns the Jikei Heart Study and the Kyoto Heart Study – evaluations of valsartan conducted and published in 2007 and 2009, respectively.  In short, a series of investigations into the integrity of the studies revealed the following, as quoted:

“We believe, therefore, that the data were intentionally altered.”

and

“We suspect that the data were altered during their statistical analysis.”

The Lancet, in their retraction notice, note specific challenges in following up and identifying the affiliation for the study statistician, who appeared to not disclose his employment by Novartis.

When the stakes are high, the temptation to use every potential advantage to generate favorable study results is simply too great.  Jeffrey Drazen has asked us to “Believe the Data” – I think the onus is on those who generate the data to earn our trust.

“Retraction—Valsartan in a Japanese population with hypertension and other cardiovascular disease (Jikei Heart Study): a randomised, open-label, blinded endpoint morbidity-mortality study”
http://www.ncbi.nlm.nih.gov/pubmed/24012258

Guidelines For Sale

In a world of complex and sometimes conflicting literature, many physicians and professional societies rely on experts to synthesize the evidence and produce general guidelines supporting best practices.  To evaluate the potential for sponsorship bias, these authors perform a cross-sectional study of recently published national and international guidelines associated with the greatest healthcare expenditures.

In line our with our recent coverage of the BMJ investigative report, 75% of guideline committee members disclosed relevant financial conflicts of interest.  The astute reader may judge for themselves whether these most frequently reported COIs are relevant:

  • ADHD: manufacturers of methylphenidate HCl and atomoxetine
  • Alzheimers disease:  manufacturers of solanezumab and donepezil HCl
  • Anemia/CKD:  manufacturer of darbepoetin alfa
  • Asthma:  manufacturers of fluticasone propionate and montelukast sodium
  • Bipolar/depression:  manufacturers of duloxetine, olanzepine, sertraline, and ziprasadone.
  • Cholesterol:  manufacturers of simvastatin and rosuvastatin
  • COPD:  manufacturers of budesonide & fometerol, tiotropium bromide, and fluticasone propionate
  • Hypertension:  manufacturers of irbesartan, losartan, and amlodipine besylate/benazepril HCl
  • Myocardial infarction:  manufacturers of rosuvastatin, rivaroxaban, and alteplase
  • Multiple sclerosis:  manufacturers of interferon beta and terifunomide
  • Rheumatoid arthritis:  manufacturers of certolizumab pegol, adalimunab, and abatacept

I’m sure these guidelines reliably provide funding-agnostic recommendations.  We might as well just have a bidding war between drug companies to vie for favored product status.

“Expanding Disease Definitions in Guidelines and Expert Panel Ties to Industry: A Cross-sectional Study of Common Conditions in the United States”
http://www.plosmedicine.org/article/info%3Adoi%2F10.1371%2Fjournal.pmed.1001500