In this article, we explain what adaptive trials are and why they were developed, and we explore both the advantages of adaptive designs and the concerns being raised by some in the healthcare community.
What are adaptive clinical trials?
Adaptive clinical trials enable researchers to change an aspect of a trial design at an interim assessment, while controlling the rate of type 1 errors (1). Interim assessments can help to determine whether a trial design is the most effective one for answering a specific research question, or if the accumulating data suggests that a trial should be stopped early for safety reasons (1).
How and why were adaptive clinical trials developed?
In 2004, the FDA published a report on the problems faced by the scientific community in developing new medical treatments (2). The report highlighted that the pace of innovation in biomedical science is outstripping the rate of advances in the available technologies and tools for evaluating new treatments. Outdated tools are being used to assess new treatments and there is a critical need to improve the effectiveness and efficiency of clinical trials (2).
The current process for developing new treatments is expensive, takes a long time and in some cases, the development process has to be stopped after significant amounts of time and resources have been invested (2). In 2006, the FDA published a “Critical Path Opportunities List” (3) that listed potential ways of reducing the time it takes to develop and approve new medical treatments (3). The use of novel designs for clinical trials (including adaptive trial designs) was one of the methods identified for achieving this aim, and the European Medicines Agency (EMA) and the FDA have published guidance on the use of adaptive clinical trials (1,4). Recently, the move towards the use of personalised (or precision) medicine has led to an increasing interest in adaptive trial designs with subgroup selection (5).
What are the benefits of adaptive clinical trials?
As discussed previously, adaptive trial designs allow for changes to be made to a clinical trial after an interim analysis of data from the trial itself (1) or from knowledge obtained from other clinical trials (1,6). The benefits of being able to do this include (6):
- Reducing the time it takes to develop a new medical product
- Correcting assumptions that were made at the start of the trial if they are subsequently found to be incorrect
- Helping to identify the treatments that show the most promise at an early stage in the development process
- Increasing the likelihood that the trial will be successful
Examples of adaptive trial designs include group sequential designs, response-adaptive designs and adaptive dose escalation designs. The specific benefits of these types of designs are listed below:
Group sequential designs
Researchers can stop a trial early (6) (for example, if an interim analysis shows that and experimental treatment is effective (7) or that the results are unlikely to be statistically significant (8).)
Response-adaptive designs (also known as outcome adaptive designs)
In these trials, patients are allocated dynamically to treatments depending on what the accumulating outcome data from the trial show (9,10). This means that more patients can be assigned to treatments that are more effective (10).
Adaptive dose escalation designs
These trials use a continual reassessment method (CRM) that’s based on dose toxicity models to establish what the maximum tolerated dose (MTD) of new drug is. This increases the likelihood of identifying the correct MTD and it’s also possible to add groups of participants to the trial after it has started (6).
What are the arguments against the use of adaptive clinical trials?
Adaptive clinical trials are appealing because of their flexibility, the potential to increase efficiency and the ability to identify which treatments are the most effective with limited resources (6). However, there are concerns that making changes to the design can introduce bias and may affect the integrity and validity of the trial (6,11).
Any major changes to a trial design may result in changing the target population, which means that the results from the trial may not be able to answer the question that the original trial was designed to investigate (6).
In response-adaptive trials the randomisation process is changed so that more patients are assigned to the treatment that is more effective. However, for ethical reasons, researchers should tell patients that they have more chance of being allocated to the treatment that’s more effective the later they enrol in the trial. Patients who are less unwell may choose to enrol later in the study (to increase their chances of being allocated to the treatment that’s more effective) and patients who are more unwell may enrol earlier because they need early access to the treatment. Thus, disease severity is a potential confounding factor and could introduce bias into the trial (6).
The use of accumulated clinical data in adaptive clinical trials may introduce operational bias, resulting in (6):
- p values that are incorrect
- Unreliable confidence intervals
- An inability to maintain the rate of type I errors at the significance level that was pre-specified before the start of the trial
Summary
Despite their flexibility, adaptive clinical trials should not be seen as a way to avoid the need for thorough planning, which is a requirement for conducting conventional clinical trials (1).
Researchers must be able to show that there is a robust justification for making any modifications to a clinical trial (1) and there is a need for more regulatory guidance on how to conduct specific types of adaptive clinical trials (6). The safety of participants in an adaptive trial is of utmost importance, and regulatory bodies should monitor the safety of participants throughout the trial period (4).
References
- European Medicines Agency. Committee for medicinal products for human use (CHMP). Reflection paper on methodological issues in confirmatory clinical trials planned with an adaptive design. October 2007. Available at: http://www.ema.europa.eu/docs/en_GB/document_ library/Scientific_guideline/2009/09/WC500003616.pdf Date accessed: April 2017
- United States Food and Drug Administration. (FDA). Challenge and Opportunity on the critical path to new medical products. March 2004. Available at: https://www.fda.gov/ScienceResearch/SpecialTopics/CriticalPathInitiative/CriticalPathOpportunitiesReports/ucm077262.htm Date accessed: April 2017
- United States Food and Drug Administration. (FDA). Critical path opportunities list. March 2006. Available at https://www.fda.gov/downloads/ ScienceResearch/SpecialTopics/CriticalPathInitiative/CriticalPathOpportunitiesReports/UCM077258.pdf Date accessed: April 2017
- US Food and Drugs Administration. Guidance for industry. Adaptive designs for medical device clinical studies. Guidance for industry and Food and Drug Administration staff. July 2016 Available at: https://www.fda.gov/ucm/groups/fdagov-public/@fdagov-meddev-gen/documents/ document/ucm446729.pdf Date accessed: April 2017
- Bauer P, Bretz F, Dragalin V, König F, Wassmer G. Twenty-five years of confirmatory adaptive designs: opportunities and pitfalls. Stat Med 2016 Feb 10;35(3):325-47 doi: 10.1002/sim.6472
- Chow S-C, Corey R. Benefits, challenges and obstacles of adaptive clinical trial designs. Orphanet J Rare Dis. 2011;6:79. doi:10.1186/1750-1172- 6-79.
- Stevely A, Dimairo M, Todd S, et al. An Investigation of the Shortcomings of the CONSORT 2010 Statement for the Reporting of Group Sequential Randomised Controlled Trials: A Methodological Systematic Review. Shamji M, ed. PLoS ONE. 2015;10(11):e0141104. doi:10.1371/journal. pone.0141104
- Sully BG, Julious SA, Nicholl J. An investigation of the impact of futility analysis in publicly funded trials. Trials. 2014;15:61. doi:10.1186/1745- 6215-15-61
- Lee JJ, Chen N, Yin G. Worth adapting? Revisiting the usefulness of outcome-adaptive randomization. Clin Cancer Res 2012;18(17):4498-4507. doi:10.1158/1078-0432.CCR-11-2555.
- Du Y, Wang X, Lee JJ. Simulation Study for Evaluating the Performance of Response-Adaptive Randomization. Contemp Clin Trials. 2015;40:15- 25. doi:10.1016/j.cct.2014.11.006.
- Elsäßer A, Regnstrom J, Vetter T, et al. Adaptive clinical trial designs for European marketing authorization: a survey of scientific advice letters from the European Medicines Agency. Trials. 2014;15:383. doi:10.1186/1745-6215-15-383.
