New FDA Guidance on Real World Evidence/Real World Data

As interest in the use of real-world data (RWD) and real-world evidence (RWE) continues to increase, the FDA is publishing draft guidance documents to help sponsors successfully navigate the submission of applications leveraging this “new” type of clinical information.

Growing Importance of Real-World Evidence and Real-World Data

Serious interest in the use of real-world data (RWD) and real-world evidence (RWE) to support drug development first arose when Congress passed the 21^st Century Cures Act of 2016.¹ The intent was to accelerate drug development and supplement traditional clinical trial data with data from a more diverse array of patients with wide-ranging comorbidities that receive treatment in a broader variety of treatment settings. The Cures Act required the U.S. Food and Drug Administration (FDA) to publish a framework for a program to evaluate the use of RWE in regulatory decision making, which the agency published in December 2018.²

During the COVID-19 pandemic, RWD and RWE were essential sources of information for the FDA to expedite approvals of COVID-19 vaccines and therapeutics and to allow other clinical studies to progress under the changing circumstances. Faced with limited access to traditional clinical trial data due to lockdowns, the agency rapidly pivoted from reluctance to willingness to rely on RWE for policy and regulatory decision making.³

Another driver of interest in RWD and RWE is the increasing use of FDA programs designed to accelerate the approval process, such as Breakthrough Therapy, Fast Track, and Accelerated Approval designations. In many cases, drug candidates with these designations are approved on the basis of limited clinical trial data and with the requirement that post-approval studies are performed, some of which may use RWE and RWD.⁴ However, there have been questions raised about the feasibility of using RWD/RWE for such post-approval studies.

The challenge for the FDA is ensuring that the right RWD used to generate RWE is selected and that they are of high quality, afford sufficient coverage,⁵ and — for post-approval studies in particular — are suitable for emulating the data obtained in actual clinical trials.⁴ There is greater variability in RWD and arguably a greater risk of data gaps.⁵ Some data, such as those collected by wearables and health apps, for instance, are not actually intended to serve as RWE but are being used for this application.

Some of these issues are being addressed by the rapidly growing array of RWE sources. An analysis of 90 examples of RWE used to support regulatory decisions on medical devices was published by the FDA in March 2021.⁶ The vast majority included registries or medical records, with just two relying on patient-generated data and three on digital health devices. Regardless of the source, the key to successful use of RWD and RWE is validating the data. Understanding and characterizing individual data sets and then organizing and integrating the data from multiple sources is a real challenge.⁵

New FDA Guidance in Late 2021

To flesh out its RWE/RWD framework, the FDA published three draft guidance documents in September, October, and November 2021. Further guidances are anticipated.

The first, Real-World Data: Assessing Electronic Health Records and Medical Claims Data To Support Regulatory Decision-Making for Drug and Biological Products Draft Guidance for Industry September 2021,⁸ assesses three primary factors when considering the use of electronic health records (EHRs) or medical claims data in clinical studies to support regulatory decisions on effectiveness or safety.

The second, Data Standards for Drug and Biological Product Submissions Containing Real-World Data,⁹ addresses the requirements that various types of RWD be presented in a standard electronic format that the FDA can process as part of a normal drug application evaluation.

The third, Real-World Data: Assessing Registries to Support Regulatory Decision-Making for Drug and Biological Products,¹⁰ outlines the FDA’s proposed approach to assessing the use of patient registries to support regulatory decisions.

Guidance on Using RWD

In the draft guidance on using EHR and medical claims data, the FDA does not specify particular data sources but focuses on providing general principles for the use of RWD.¹¹ The agency provides recommendations on how to select and validate data sources that appropriately address the study question in terms of study populations, exposure, outcomes of interest, and other factors; develop and validate definitions for study design elements; and maintain the provenance and quality of data during  “accrual, curation, and transformation into the final study-specific dataset.”

Importantly, the guidance makes clear that the FDA does not expect RWD/RWE to ever replace clinical trials, but that it has the potential to significantly supplement and augment clinical trial results.¹² The agency also strongly encourages drug developers to consider the use of RWD well in advance and to initiate dialogue and collaboration with regulators as early as possible. Furthermore, when electing to use EHR and medical claims data, the relevant method of data capture, potential missing data, and data validation must all be considered.

Notably, the agency views this draft guidance as a preliminary document and expects to provide updates as its experience with RWD and RWE increases.¹¹

Guidance on Data Standards

The second RWD/RWE draft guidance issued by the FDA in October 2021 focuses on what drug developers should do when submitting product study data in drug applications that are derived from real-world sources. Standardization of such data is a real challenge, because it comes from so many different sources that capture data in different formats.¹³ Data covered in this guidance include data from EHRs, medical claims data, data from product and disease registries; patient-generated data, including data from in-home-use settings; and data gathered from other sources that can inform on health status, such as mobile devices.¹⁴

The guidance provides examples of how to map RWD to the Clinical Data Interchange Standards Consortium (CDISC) Study Data Tabulation Model (SDTM). It also specifies that RWD must use the data standards set forth in the FDA’s Data Standards Catalog.¹⁵ Sponsors are again encouraged to contact the agency early on in the process to discuss the data and data transformation approaches that have been proposed, including the processes that will be in place to increase confidence in the RWD and the means by which those processes will be electronically documented.¹³

Guidance on the Use of Patient Registries

In the latest draft guidance issued in November 2021, the FDA focuses on patient registries as RWD/RWE sources, homing in on the factors that should be considered when determining if such data are fit for use in regulatory decision-making processes.¹⁶ Such factors include how the data will be used, the enrolled patient population, the type of data collected, how data sets are generated and maintained, how the data is curated and analyzed, and whether the data can be supplemented by data from other sources.

As in the other two draft guidances, the FDA stresses here the importance of early interaction with agency representatives before any study that will rely on RWD/RWE from patient registries is initiated. Ideally, sponsors will present proposed protocols and analysis strategies with clear explanations of how the reliability, relevance, and comprehensiveness of the data sources and methodologies used to validate key design elements and maintain quality during data accrual, curation, and transformation will be assured.¹⁶

References

1. PUBLIC LAW 114–255—DEC. 13, 2016. 21st Century Cures Act. U.S. Public Law 114–255. 13 Dec. 2016.
2. Framework for FDA’s Real-World Evidence Program. S. Food and Drug Administration. Dec. 2018.
3. Amin, Stacy Cline. “Can Real-World Evidence Transform Healthcare? Recent FDA Activities Indicate Yes.” Clinical Leader. 19 2021.
4. Wallach, Joshua D. et al. “Feasibility of Using Real-world Data to Emulate Postapproval Confirmatory Clinical Trials of Therapeutic Agents Granted US Food and Drug Administration Accelerated Approval.” JAMA Network Open. 4:e2133667 (2021).
5. Slabodkin, Greg. “FDA's real-world evidence push hampered by data challenges, 'million-dollar question.'” MedTechDive. 4 2021.
6. Sullivan, Thomas. “CDRH Report Provides Examples of Real-World Evidence in Medical Device Regulatory Decisions.” Policy & Medicine. 19 Apr. 2021.
7. Belen, Ozlem, John Concato and Stefanie Kraus. “FDA Approval Demonstrates the Role of Real-World Evidence in Regulatory Decision-Making on Drug Effectiveness.” FDA News. 24 Aug. 2021.
8. Real-World Data: Assessing Electronic Health Records and Medical Claims Data To Support Regulatory Decision-Making for Drug and Biological Products. Draft Guidance for Industry. U.S. Food and Drug Administration. Sep.
9. Data Standards for Drug and Biological Product Submissions Containing Real-World Data.” Draft Guidance for Industry. U.S. Food and Drug Administration. Oct. 2021.
10. Real-World Data: Assessing Registries to Support Regulatory Decision-Making for Drug and Biological Products. Draft Guidance for Industry. U.S. Food and Drug Administration. Nov. 2021.
11. Taylor, Phil. “FDA posts guidance on mining real-world data from health records.” Pharmaphorum. 30 Sep. 2021.
12. Trotter, Jeff. “It’s Getting Real: 5 Big Takeaways from 2021 FDA Guidance on Using Real-World Evidence.” Worldwide Clinical Trials. 13 Oct. 2021.
13. Craven, Jeff. “FDA drafts data standards guidance for RWD.” RAPS News. 22 Oct. 2021.
14. Begley, Anna. “FDA releases new guidance for drug and biological product data.” European Pharmaceutical Review. 25 Oct. 2021.
15. “Study Data Standards Resources.” U.S. Food and Drug Administration. Accessed 19 Nov. 2021.
16. Kupchyk, Areta and Tina Papagiannopoulos. “FDA Releases the Latest in a Series of Draft Guidance Documents on Real World Data.” Foley Hoag Alert. 3 Dec. 2021.