Background: Randomised controlled trials ('trials') are susceptible to poor participant recruitment and retention. Studies Within A Trial are the strongest methods for testing the effectiveness of strategies to improve recruitment and retention. However, relatively few of these have been conducted.
Objectives: PROMoting THE Use of Studies Within A Trial aimed to facilitate at least 25 Studies Within A Trial evaluating recruitment or retention strategies. We share our experience of delivering the PROMoting THE Use of Studies Within A Trial programme, and the lessons learnt for undertaking randomised Studies Within A Trial.
Design: A network of 10 Clinical Trials Units and 1 primary care research centre committed to conducting randomised controlled Studies Within A Trial of recruitment and/or retention strategies was established. Promising recruitment and retention strategies were identified from various sources including Cochrane systematic reviews, the Study Within A Trial Repository, and existing prioritisation exercises, which were reviewed by patient and public members to create an initial priority list of seven recruitment and eight retention interventions. Host trial teams could apply for funding and receive support from the PROMoting THE Use of Studies Within A Trial team to undertake Studies Within A Trial. We also tested the feasibility of undertaking co-ordinated Studies Within A Trial, across multiple host trials simultaneously.
Setting: Clinical trials unit-based trials recruiting or following up participants in any setting in the United Kingdom were eligible.
Participants: Clinical trials unit-based teams undertaking trials in any clinical context in the United Kingdom.
Interventions: Funding of up to £5000 and support from the PROMoting THE Use of Studies Within A Trial team to design, implement and report Studies Within A Trial.
Main outcome measures: Number of host trials funded.
Results: Forty-two Studies Within A Trial were funded (31 host trials), across 12 Clinical Trials Units. The mean cost of a Study Within A Trial was £3535. Twelve Studies Within A Trial tested the same strategy across multiple host trials using a co-ordinated Study Within A Trial design, and four used a factorial design. Two recruitment and five retention strategies were evaluated in more than one host trial. PROMoting THE Use of Studies Within A Trial will add 18% more Studies Within A Trial to the Cochrane systematic review of recruitment strategies, and 79% more Studies Within A Trial to the Cochrane review of retention strategies. For retention, we found that pre-notifying participants by card, letter or e-mail before sending questionnaires was effective, as was the use of pens, and sending personalised text messages to improve questionnaire response. We highlight key lessons learnt to guide others planning Studies Within A Trial, including involving patient and public involvement partners; prioritising and selecting strategies to evaluate and elements to consider when designing a Study Within A Trial; obtaining governance approvals; implementing Studies Within A Trial, including individual and co-ordinated Studies Within A Trials; and reporting Study Within A Trials.
Limitations: The COVID-19 pandemic negatively impacted five Studies Within A Trial, being either delayed (n = 2) or prematurely terminated (n = 3).
Conclusions: PROMoting THE Use of Studies Within A Trial significantly increased the evidence base for recruitment and retention strategies. When provided with both funding and practical support, host trial teams successfully implemented Studies Within A Trial.
Future work: Future research should identify and target gaps in the evidence base, including widening Study Within A Trial uptake, undertaking more complex Studies Within A Trial and translating Study Within A Trial evidence into practice.
Study registration: All Studies Within A Trial in the PROMoting THE Use of Studies Within A Trial programme had to be registered with the Northern Ireland Network for Trials Methodology Research Study Within A Trial Repository.
Funding: This award was funded by the National Institute for Health and Care Research (NIHR) Health Technology Assessment programme (NIHR award ref: 13/55/80) and is published in full in Health Technology Assessment; Vol. 28, No. 2. See the NIHR Funding and Awards website for further award information.
Keywords: DATA ACCURACY; EMBEDDED TRIALS; EVIDENCE-BASED MEDICINE; EVIDENCE-BASED MEDICINE/STANDARDS; HUMANS; METHODOLOGY; PATIENT RETENTION; PATIENT SELECTION; PRACTICE GUIDELINES; PRACTICE GUIDELINES AS TOPIC/STANDARDS; RANDOMISED CONTROLLED TRIALS AS TOPIC; RANDOMIZED CONTROLLED TRIALS; RESEARCH DESIGN; RESEARCH PARTICIPANTS; RESEARCH PERSONNEL; RESEARCH SUBJECTS; SAMPLE SIZE; STUDY WITHIN A TRIAL (SWAT).
A Study Within A Trial is a research study nested inside a larger ‘host trial’, promoting the use of Studies Within A Trial aimed to do Study Within A Trial routine practice in clinical trial units by funding and supporting at least 25 Studies Within A Trial. The best way to test health and social care treatments is to do a randomised controlled trial (‘trial’), where some patients get the treatment being tested and some do not. The results of different groups are compared to see if the treatment improves care. Recruiting patients and keeping them involved in trials is often very difficult. Research teams often do not know how best to recruit and keep patients engaged as the methods have not been tested to see if they work. The best way to test these methods is by doing a Study Within A Trial. We test a programme of Studies Within A Trial for recruiting and keeping patients engaged in trials. Trial teams were able to apply for funding of up to £5000 and receive support from Promoting the use of Study Within A Trial team to do Studies Within A Trial. We used our experience of doing Studies Within A Trial to outline lessons learnt for doing Studies Within A Trial. We funded 42 Studies Within A Trial and gave teams necessary advice to do them. We significantly increased the knowledge for both recruitment and retention strategies, and found ‘pre-notifying’ before sending questionnaires, sending pens and personalised text messages were all effective for increasing responses by participants. We tested Studies Within A Trial across several different trials at the same time to find out more quickly whether their methods worked. We highlight key lessons learnt to guide others doing Studies Within A Trial, including involving patient partners; picking the right strategy to test; getting ethical approvals; how to do and report Studies Within A Trial. Promoting the use of studies within a trial was successful and supported more Studies Within A Trial than planned. We hope our experience will support those doing Studies Within A Trial in the future.