| Authors | Trisha Greenhalgh, Joseph Wherton, Chrysanthi Papoutsi, Jennifer Lynch, Gemma Hughes, Christine A’Court, Susan Hinder, Nick Fahy, Rob Procter, S. E. Shaw |
| Journal | Journal of Medical Internet Research |
| Year | 2017 |
| DOI | 10.2196/jmir.8775 |
| Citations | 2,567 |
TL;DR
Most health technologies fail not because they don't work clinically, but because of predictable, multi-level barriers — this paper builds a practical diagnostic framework (NASSS) that identifies *why* a technology stalls or collapses, which is directly applicable to evaluating any self-tracking or personal-experiment tool before you invest time in it. ---
This paper did not test a clinical intervention in the usual sense. Instead, it aimed to build and validate a framework — called NASSS (Nonadoption, Abandonment, Scale-up, Spread, and Sustainability) — to predict and explain why health and care technologies succeed or fail in the real world. The framework was developed by:
The 6 technologies studied were:
The comparator in each case was the status quo — existing care without the technology — or, for software products, different implementation approaches (e.g. co-designed app vs. solo-developer portal).
This is a mixed-methods systematic review combined with longitudinal qualitative case studies, not a clinical trial with a defined patient sample. However, the empirical fieldwork was substantial:
Because this is qualitative and framework-building research, there are no standardised psychometric scales or quantitative outcome measures. Instead, the researchers used:
The final output was a 7-domain framework with 13 diagnostic questions, each answer classifiable as:
Study design: Parallel mixed-methods — hermeneutic systematic review + longitudinal qualitative case studies (ethnography and action research), followed by iterative framework development and peer review.
Why this design? The authors explicitly argue that randomised controlled trials are the wrong tool for studying why technologies succeed or fail at scale. An RCT can tell you whether a technology works under controlled conditions; it cannot tell you why it is abandoned by 97% of patients outside those conditions, or why a hospital refuses to fund it after the trial ends. Qualitative longitudinal work can track the process of implementation — the workarounds, the political battles, the moments of collapse.
Randomisation and blinding: Not applicable. This is not a trial. One embedded case study (Case D, SUPPORT-HF) involved a randomised trial, but the NASSS paper analysed it ethnographically, not statistically.
Duration: Up to 3 years of fieldwork per case study, with some sites observed from 2013 to 2017. This long duration is a genuine strength — short evaluations routinely miss the abandonment phase.
Literature search approach: Non-standard. Rather than a database search with PRISMA protocol, the authors used "ancestry and snowballing" — tracking citations from key papers and manually screening ~7,500+ titles. They acknowledge this is less reproducible but argue that standard database searches were "neither sensitive nor specific" for this literature.
Framework refinement: The draft NASSS framework was shared with colleagues running 10 additional technology programmes (including primary care email consultations, mental health peer support networks, and remote transplant monitoring) and refined based on feedback — a form of external validity testing, though not formal empirical validation.
What this design can prove:
What this design cannot prove:
Major methodological weaknesses:
From the literature review:
From the NASSS framework itself — 7 domains:
From the empirical case studies:
Related papers
The Can-SAD Study: A Randomized Controlled Trial of the Effectiveness of Light Therapy and Fluoxetine in Patients With Winter Seasonal Affective Disorder
Raymond W. Lam, Anthony Levitt, Robert D. Levitan +4 more · 2006
RCTVitamin D vs broad spectrum phototherapy in the treatment of seasonal affective disorder.
F. Michael Gloth, Waqas Alam, Bruce W. Hollis · 1999
RCTPatient room lighting influences on sleep, appraisal and mood in hospitalized people
Marina C. Giménez, Leonie M. Geerdinck, Mathijs O. Versteylen +7 more · 2016
ObservationalImpact of Windows and Daylight Exposure on Overall Health and Sleep Quality of Office Workers: A Case-Control Pilot Study
Mohamed Boubekri, Ivy N. Cheung, Kathryn J. Reid +2 more · 2014