A new study has found that some kinds of infection data may not be comparable across hospitals, and may not be suitable for use as a performance measure.
Published in the policy journal Milbank Quarterly, the research found huge variability in how English hospitals collected, recorded and reported their rates of central line infections to a patient safety program. The study was funded by the Health Foundation, a major UK charitable foundation aiming to improve quality of care.
"Central line infections occur in tubes used in treating seriously ill patients. These infections are largely preventable, and hospitals need to be able to monitor how well they are doing in controlling them," says study author professor Mary Dixon-Woods from University of Leicester. "But because hospitals don't use the same methods to generate the data, using their reported rates to produce league tables of performance or to impose financial sanctions, as happens in the U.S., is probably not appropriate."
Researchers found most variability arose for what they called "mundane" reasons. These included challenges in setting up data collection systems, different practices in sending blood samples for analysis, and difficulties in deciding the source of infections.
"Although hospitals were given clear, standardized definitions to use, many laboratories did not have the tools to make the most definitive assessment of where infections were coming from in the patient's body," says Julian Bion, professor of intensive care medicine at University of Birmingham. "That meant they had to use clinical judgement to decide whether any infection was due to a central line. Once you are relying on judgement, you will get variation."
The study dismissed 'gaming' as the explanation for the variations the researchers found. "Some previous studies have reported deliberate manipulation of performance data to 'look good,'" says Dixon-Woods. "We found very little evidence of this. We did find that doctors were fine with making a clinical decision that a patient might have a central line infection for purposes of treating them, but they wanted better evidence if they were going to report an infection externally. That meant that sometimes a patient who was treated as having an infection while in hospital was not counted as having an infection when data were reported. Doctors also varied in how many blood samples they sent off for laboratory analysis".
Bion commented that these findings have important lessons for those involved in improving the quality of patient care. He says "The study shows that if we are going to use data produced by hospitals to guide quality improvement, data collection systems must be carefully designed and operated, fully integrated with clinical priorities, and impose minimum burden. We need data that clinicians and organizations believe in. And until we have that, we need to be very careful about comparing performance across hospitals. We certainly need to avoid basing pay-for-performance schemes on central line data, because it's now becoming clear that these schemes have many unintended consequences."
Elaine Maxwell, assistant director at the Health Foundation, comments, "This research highlights the very real difficulties in measuring safety in healthcare. Adverse events such as infections are increasingly being used in performance management. This study demonstrates that accurate data collection is more complex than may have at first been imagined. The Health Foundation is continuing to support the development of reliable and sensitive safety measures to reflect sustained improvement."
Reference: Dixon-Woods M, Leslie M, Bion JF, Tarrant C. What Counts? An ethnographic study of infection data reported to a patient safety program. Milbank Quarterly 2012; 90: 548-591.
Show, Tell, Teach: Elevating EVS Training Through Cognitive Science and Performance Coaching
April 25th 2025Training EVS workers for hygiene excellence demands more than manuals—it requires active engagement, motor skills coaching, and teach-back techniques to reduce HAIs and improve patient outcomes.
The Rise of Disposable Products in Health Care Cleaning and Linens
April 25th 2025Health care-associated infections are driving a shift toward disposable microfiber cloths, mop pads, and curtains—offering infection prevention, regulatory compliance, and operational efficiency in one-time-use solutions.
Phage Therapy’s Future: Tackling Antimicrobial Resistance With Precision Viruses
April 24th 2025Bacteriophage therapy presents a promising alternative to antibiotics, especially as antimicrobial resistance continues to increase. Dr. Ran Nir-Paz discusses its potential, challenges, and future applications in this technology.
Robust infectious disease surveillance, including rapid subtyping of influenza A, is essential for early detection, containment, and public health reporting of novel viral threats.