A little hullabaloo today regarding a new report in the BMJ regarding problems with the creation of clinical practice guidelines, including a substantial portion of the article devoted to the conflicts of interest swirling about the use of tPA in acute ischemic stroke.
There have already been personal attacks – even from ACEP’s official twitter account – against the author. These seem to be motivated by the author’s coverage of the new ACEP/AAN clinical practice guidelines for tPA – and miss the overall point that patients are best protected and served by guidelines that are formulated in the absence of conflict-of-interest. tPA for acute stroke, erythropoetin endorsement by the National Kidney Foundation, the errant one-man crusade for steroids in spinal cord trauma, and cholesterol treatment guidelines are all discussed in the context of cautionary tales regarding the influence of conflict-of-interest.
Whichever side of the expand/limit tPA in acute stroke debate you fall upon, the issues of sponsorship bias, one-sided panelists on a still-controversial practice, and lack of open peer review for the ACEP/AAN guidelines ought to be unacceptable. Patients and practicing clinicians benefit from healthy debate and recognition of the limitations of the science, which seems clearly to have been lacking in the creation of these guidelines.
“Why we can’t trust clinical guidelines”
http://www.bmj.com/content/346/bmj.f3830
Category: Medication Safety
Time-to-Treatment Effect “Confirmed”
The holy grail of tPA proponents, the time-to-revascularization theory, is the subject of this most recent article in JAMA. This is a data mining exercise from the Get With The Guidelines-Stroke Registry – and, actually, there’s not a lot to say. They evaluate 55,000 patients from the registry, and there are significant differences between the cohorts receiving tPA between 0-90, 91-180, and 181-270 minutes – so all their outcomes are dependent on multiple statistical adjustments.
And, when I say multiple, I mean overwhelming:
The variables used in the risk models were patient-level and hospital-level risk adjustors that were expected to be predictive of outcome, based on empirical analysis, prior literature, and clinical judgment.
Patient-level factors included age, race/ethnicity, sex, medical history (including atrial fibrillation, prosthetic heart valve, previous stroke or TIA, coronary heart disease or prior myocardial infarction, carotid stenosis, peripheral vascular disease, hypertension, dyslipidemia, diabetes, and current smoking), stroke severity (NIHSS), an age-by-NIHSS interaction term, arrival time during regular work hours (7 AM-PM Monday-Friday), arrival mode (ambulance, private vehicle), and select classes of vascular risk prevention medications prior to admission.
Hospital-level factors included hospital size, region, teaching status, rural location, certified primary stroke center status, average number of patients treated with tPA annually, and average number of annual stroke dis- charges. All variables were included in the predictive models without use of a stepwise or other formal variable selection process.
The pharmaceutical industry conflict-of-interest disclosure is even longer.
These folks could have made these data say whatever they desired with their statistical weighting. They report a positive association with time-to-treatment and improved outcomes; the astute reader may interpret this as they are wont.
It is also worth mentioning the earlier time-to-treatment populations are probably more likely to include stroke mimics and TIAs – both of which tend towards excellent outcomes, with or without tPA. The percentage of stroke mimics treated with tPA ranges between 6.5% and 15.5% at academic centers using MRI as imaging confirmation, and has been estimated to be as high as 25% to 29% in community settings. The GWTG-Stroke registry specifically fails to account for stroke mimics in their coding instructions – a patient that receives tPA and rapidly improves is to be coded as “aborted stroke”, even though contemporary evidence throws this concept into doubt.
Regardless, the percentage of stroke mimics confounding the results likely dwarfs the magnitude of effect of the proposed time-to-treatment association reported by these authors.
“Time to Treatment With Intravenous Tissue Plasminogen Activator and Outcome From Acute Ischemic Stroke”
http://jama.jamanetwork.com/article.aspx?articleid=1697967
tPA Equally (In)Effective for Wake-Up Stroke
This is a, yet another, study in Stroke of folks claiming it is “safe” to use thrombolysis on patients who are found to have suffered a stroke while sleeping – the so-called “wake-up stroke” population.
The specific claim made is “This retrospective analysis of data in thrombolysed consecutive acute ischemic stroke patients shows no significant differences in mortality, functional outcomes, or bleeding rates between WUIS patients with no early ischemic change on CT and those treated within 4.5 hours of stroke onset.”
…because their sample size is so small the absolute differences are still within the statistical variation expected by chance. This is, unfortunately, a recurring theme I see in these stroke publications, many of which are retrospective registry reviews. Their groups are statistically not different, but this is owing to failed statistical power in study design, as opposed to clinically meaningful equivalence. This is a major difference between retrospective and prospective studies – in which prospective studies choose specific absolute differences necessary to define clinically meaningful equivalence, and then perform power and sample size calculations based on these constraints.
Their outcomes are, incidentally, also simply terrible. They publish a figure comparing outcomes with their wake-up stroke population to their 0-4.5 hour thrombolysis reference group – a 326 patient reference group with 18% mRS 0-1 and a 26% mortality. But then, they further break out the 197 patients from that group that received tPA within the ECASS III license criteria, showing that compliance with guidelines leads to 32% mRS 0-1 and 18% mortality. This therefore implies the other 129 patients – the ones who received tPA outside the license criteria – had utterly dismal functional outcomes and frighteningly high mortality.
Someone needs to go down to King’s College and check up on them and make sure all this off-label use isn’t just costly killing fields.
“A Case-Controlled Comparison of Thrombolysis Outcomes Between Wake-Up and Known Time of Onset Ischemic Stroke Patients”
http://www.ncbi.nlm.nih.gov/pubmed/23723307
14 Days of Steroids is Too Many Days
Some of the most common practices in Emergency Medicine are only weakly tested or defined – including steroids for acute respiratory illness. What is the true minimum effective dose? How many days – 3, 5, 7, or 14? Burst or taper? Much of our practice is based on habit and mimicry, along with the general evidence that, despite ourselves, we don’t seem to be doing much harm.
This is the REDUCE trial, a multi-center, randomized, double-blind, non-inferiority comparison between a 5-day and a 14-day course of 40mg oral prednisone for acute COPD exacerbation. And…it found no difference in the primary outcome measure. So, then, all’s well.
Except, their outcome measure is utterly bizarre – re-exacerbation within six months? I cannot fathom how a 1-2 week period of steroids could have any causative association with outcomes more than a handful of half-lives after cessation of treatment. Perhaps they theorize the short-term steroid exposure is insufficient to avoid long-term damage secondary to the acute inflammation?
There are also some potentially confounding differences in baseline characteristics. There were 9% more smokers and 5% more home oxygen in the short-term treatment group – which could favor conventional treatment – but then 4% fewer were on daily steroids during the treatment period and 8% fewer received concurrent antibiotics in the conventional treatment group – which could favor the short-term treatment group. Some of these differences would have more effect on short-term outcomes, while others would affect long-term outcomes. I don’t know if there are true clues in the Kaplan-Meier curves they present – because the sample size is small enough these variations might just be occurring due to chance – but it appears there’s a possible hazard towards early re-exacerbation in the 5-day group, followed by regression towards equivalence by six months.
However, these issues aside, their conclusion is probably valid. Their predefined threshold for non-inferiority was 15% – and they easily cleared that bar. All the confounders are probably not of significant magnitude to affect the overall result at that threshold – even for shorter, more relevant follow-up time periods. Additionally, this is otherwise consistent with the other evidence that short-courses of steroids are absolutely acceptable in this context.
“Short-term vs Conventional Glucocorticoid Therapy in Acute Exacerbations of Chronic Obstructive Pulmonary Disease”
www.ncbi.nlm.nih.gov/pubmed/23695200
4-Factor PCC is Here! Yay?
The self-described “EM Nerd” Rory Spiegel from Newark Beth Israel writes in to point out a fascinating discovery – previously undiscovered clinical trial results for Kcentra, the newly available 4-Factor Prothrombin Complex Concentrate, embedded in the product labeling.
4-factor PCCs are well-known from their use in Europe – capable of rapid reversal of factor-dependent coagulopathy at the expense of increased thrombotic complications. Within the package labeling, however, two new Phase III trials are described – open-label, randomized, non-inferiority comparisons. The trials, for what they’re worth, show no significant outcome difference compared with FFP – but, yet again, no clinically relevant threshold for non-inferiority is established to drive sample size calculations. I’d like to comment more, but they only provide detailed adverse event information on one of the two trials. Perhaps we’ll see these published and peer-reviewed imminently.
It should also be noted the extensive exclusion criteria used to enroll patients in these studies – a far longer list than the few contraindications listed on the package label. These criteria may be noted on the ClinicalTrials.gov site.
Lovely to see we’ve now another costly reinvention of the wheel that will almost certainly be overutilized at the behest of Bering’s marketing army.
“Efficacy and Safety Study of BERIPLEX® P/N Compared With Plasma in Patients With Acute Major Bleeding Caused by Anticoagulant Therapy”
http://clinicaltrials.gov/ct2/show/NCT00708435
“The Sign of Four…”
http://emnerd.tumblr.com/post/50947148065/the-sign-of-four
“CSL Behring 1.14.1.3 Draft Labeling Text”
http://www.fda.gov/downloads/BiologicsBloodVaccines/BloodBloodProducts/ApprovedProducts/LicensedProductsBLAs/FractionatedPlasmaProducts/UCM350239.pdf
INTERACT2: ICH Half-Truths
There have been dueling schools of thought regarding atraumatic intracerebral hemorrhage: let the brain autoregulate its own blood supply and don’t artificially lower the blood pressure, or use intravenous agents to lower blood pressure because there’s evidence it decreases hematoma expansion. However, until now, there’d been no evidence that decreased hematoma size correlated with meaningful patient-oriented outcomes.
So, what are they saying about INTERACT2, the open-label, randomized trial of intensive BP control (SBP <140 mmHg) versus guideline-concordant BP control (<180 mmHg)?
@medwireNews INTERACT2 contradicts “longstanding dogma”, supports intensive BP reduction in ICH #eurostroke2013
@MedscapeNeuro INTERACT2: Intensive Blood Pressure Lowering Benefits ICH
@IctusClnic #ESCLondon2013 Surely INTERACT2 will have a great impact in blood pressure management after intracranial hemorrhage.
Pfffft.
The primary outcome was reduction in death or major disability (modified Rankin scale 3 to 6) at 90 days. Unadjusted outcome was statistically negative, 52.0% to 55.6% (OR 0.87, 95% CI 0.75 to 1.01), but favoring intensive BP control. Their secondary outcomes, which uses the conceptually messy tool of ordinal analysis, essentially magnified the effect of that 3.6% absolute difference in mRS outcomes and goes on to show that folks with less disability end up happier and more functional.
However, the baseline functional characteristics favored the intensive BP group, with median NIHSS score of 10 vs. 11. 68% of the cohort was from China – which has uncertain effects on external validity. Over seven different intravenous antihypertensives – including the most popular agent, urapidil – were used for BP lowering, further muddling precise treatment guidance. Most ICH was small volume hemorrhage, and BP treatment didn’t seem to have much different on hematoma expansion – so it’s hard to say why the intensive control group seemed to have a trend towards superiority.
And, finally, even though approximately half of the 1436 assigned to guideline-recommended treatment group had baseline systolic BP >180 mmHg, only 303 of them received an anti-hypertensive agent within 1 hour of study assignment. It might be more appropriate to describe this study as “intensive” vs. “poorly guideline-concordant” BP control – would outcomes have been more favorable if more of the guideline-concordant group actually had their systolic BP lowered below 180 mmHg?
In any event, to call this a practice-changing paradigm is a only a half-truth. It does appear safe, at least, to make a brisk and reasonable effort to lower BP in atraumatic, intracerebral hemorrhage. Whether “intensive” control is needed with a nicardipine infusion, such as in the upcoming Antihypertensive Treatment of Acute Cerebral Hemorrhage (ATACH) II trial, is still uncertain.
“Rapid Blood-Pressure Lowering in Patients with Acute Intracerebral Hemorrhage”
http://www.nejm.org/doi/full/10.1056/NEJMoa1214609
Proto Magazine Letter
My recently-published short invited response in Proto Magazine, a Massachusetts General Hospital publication, to an article on the state of current medical journals: “Probing Deeper“
They did, however, unexpectedly edit out a portion of my response – an entire paragraph originally between the current 2nd and 3rd paragraphs:
In 2005-2006, The Lancet derived 41% of its revenue through sales of over 11 million reprints.[1] The NEJM, which published more industry-funded studies thanThe Lancet – 78% vs. 58% – undoubtedly derives even more.[2] Ironically, Jeffery Drazen, editor-in-chief of NEJM, is quoted as saying “Our most important job is vetting information.” Dr. Drazen infamously failed to do so when privy to information regarding increased mortality in rofecoxib’s (Vioxx) VIGOR trial – a publication for which NEJM sold Merck 900,000 reprints.[3][4]
And, here are my references:
Azithromycin & Cardiovascular Risk, Belabored
Last year, I noted a study concerning a report of excess deaths associated with azithromycin use. This study, a retrospective, observational cohort from Tennessee Medicaid data suggested a death rate double that of other antibiotics. This led to the FDA issuing a warning regarding azithromycin use.
I thought all this fuss was absurd – the data quality was one step above junk and the absolute magnitude of the proposed harms was trivial.
Now, we have the counterpoint – a retrospective, observational cohort from Denmark, using their national health system database to compare prescriptions for azithromycin to penicillin V over the last 13 years. In their cohort, there’s an obvious increase in risk of death from cardiovascular causes simply from being prescribed any antibiotics – but no difference between azithromycin and penicillin V. This seems to indicate either the systemic infectious process contributes to excess cardiovascular risk, or that respiratory symptoms are being misdiagnosed as infectious rather than cardiovascular. The absolute effect in their propensity matched cohorts is also tiny – a handful of patients or fewer spread across a million prescription events.
The accompanying opinion seems to attempt to justify the FDA review based on the wide confidence intervals in the Danish study – the OR for death from cardiovascular causes vs. penicillin V is 1.06 (0.54 – 2.10) and doesn’t statistically contradict the Tennessee study. However, yet again, I would point to the reason behind the wide confidence intervals – the nearly trivial absolute magnitude of the harms, which amount to fractions of a patient per 1000 patient-years.
Again, plenty of reasons to responsibly reduce azithromycin prescriptions – but this cardiovascular hullabaloo probably isn’t one of them.
“Use of Azithromycin and Death from Cardiovascular Causes”
http://www.nejm.org/doi/full/10.1056/NEJMoa1300799
Neurosurgery’s Takedown of Steroids in SCI
A brave new day dawns – clinicians who otherwise lived in fear of medicolegal reprisal from failing to administer steroids in acute spinal cord trauma may now safely withhold them.
The steroids in spinal cord debate, a one-man crusade lead by Michael Bracken, distorted by performing Cochrane Reviews of his own articles, has hopefully been definitively settled. These authors, as part of a comprehensive update on the diagnosis and management of acute spinal cord injury, definitively summarize the flawed literature supporting methylprednisolone administration. Their recommendation:
Administration of methylprednisolone (MP) for the treatment of acute spinal cord injury (SCI) is not recommended. Clinicians considering MP therapy should bear in mind that the drug is not Food and Drug Administration (FDA) approved for this application. There is no Class I or Class II medical evidence supporting the clinical benefit of MP in the treatment of acute SCI. Scattered reports of Class III evidence claim inconsistent effects likely related to random chance or selection bias. However, Class I, II, and III evidence exists that high-dose steroids are associated with harmful side effects including death.
We’ve come a long way since the NIH faxed a letter to every Emergency Department in the country instructing physicians to give steroids. Another amazing saga demonstrating the danger of inadequately reviewed medical evidence.
“Pharmacological Therapy for Acute Spinal Cord Injury”
http://www.ncbi.nlm.nih.gov/pubmed/23417182
“Neuroimaging Negative” Strokes Are A Lie
Back in 2011, there was an article in Annals of Emergency Medicine discussing what a fantastic job we were doing in diagnosing stroke and avoiding administering tPA to “stroke mimics”. They reported a rate of 1.4% administration to stroke mimics – none of whom had bleeds. The problem I pointed out, both on my blog and in a response letter to Annals, was that the authors invented a new category called “neuroimaging negative” acute stroke – which was probably actually all stroke mimics. This would have changed the rate of tPA administration to stroke mimics from 1.4% to 29.3%. The authors, having financial conflict of interest with the manufacturers of tPA, disagreed.
This study, part of the “Lesion Evolution in Stroke and Ischemia On Neuroimaging” project, evaluated the progression of lesions on MRI following tPA administration. These authors found 231 patients with acute stroke who were initially screened by MRI prior to tPA administration and had evidence of infarction on diffusion weighted imaging. They found that, following tPA administration, only 2 patients had resolution of an MRI DWI lesion. They therefore conclude that “Patients with a stroke are unlikely to have complete DWI lesion reversal within 24 hours after IV tPA treatment,” and patients with no DWI lesion following tPA administration should be considered to have a diagnosis other than acute stroke.
Thus, this confirms my conclusion that the 27.9% of patients from the prior study with “neuroimaging negative” acute stroke ought to universally be considered to have had a diagnosis other than acute stroke. The reality is that we are likely treating an ever-greater number of acute ischemic strokes – and further efforts to push Emergency Physicians to treat additional patients more quickly are certainly going to expose additional patients to avoidable harms.
“Negative Diffusion-Weighted Imaging After Intravenous Tissue-Type Plasminogen Activator Is Rare and Unlikely to Indicate Averted Infarction”
http://www.ncbi.nlm.nih.gov/pubmed/23572476