Real-World Data, Real-World Evidence and Advanced Analytics in Submissions


Real-World Data, Real-World Evidence and Advanced Analytics in Submissions

Real-World Data, Real-World Evidence and Advanced Analytics in Submissions

Context

The integration of digital systems, advanced analytics, and artificial intelligence (AI) has transformed the pharmaceutical industry, especially in the realm of regulatory affairs. With the rise of real-world data (RWD) and real-world evidence (RWE), regulatory bodies increasingly expect the incorporation of these elements into submissions. Consequently, professionals in Regulatory Affairs (RA), Chemistry, Manufacturing and Controls (CMC), and Labelling teams within the US, UK, and EU need to understand the regulatory frameworks and guidelines that govern these practices.

This article aims to provide a comprehensive overview of the relevant regulations, guidelines, and agency expectations surrounding digital systems and data integrity, particularly focusing on the implications of 21 CFR Part 11 compliance, EU Annex 11 requirements, and Good Automated Manufacturing Practice (GxP) standards in the context of AI and advanced analytics.

Legal/Regulatory Basis

The legal frameworks governing the use of digital systems in pharmaceutical submissions are primarily founded on regulations specified by the Food and Drug Administration (FDA), the European Medicines Agency (EMA), and the Medicines and Healthcare products Regulatory Agency (MHRA). Key regulations include:

  • 21 CFR Part 11: This regulation details the criteria under which
electronic records and electronic signatures are considered trustworthy, reliable, and equivalent to paper records.
  • EU Annex 11: Specifies the requirements for computerised systems used in GMP regulated activities. It necessitates validation and documentation that confirms the reliability and integrity of data generated by these systems.
  • GxP Regulations: Encompasses guidelines and requirements for Good Laboratory Practice (GLP), Good Clinical Practice (GCP), and Good Manufacturing Practice (GMP), all of which govern the quality and integrity of data throughout the product lifecycle.
  • In light of these regulations, companies must ensure that their digital infrastructure and processes are designed to uphold the integrity of data collected and presented in regulatory submissions.

    Documentation

    Documentation is a critical component of compliance when utilizing digital systems for RWD and RWE. The following documentation practices are essential:

    1. Validation Documentation

    Under both 21 CFR Part 11 and EU Annex 11, detailed validation documentation must be maintained to ensure that systems used for data collection and storage accurately perform their intended function. Key components include:

    • Validation Plan: Outlines the strategy for validating the electronic systems, addressing scope, roles, responsibilities, and methodologies.
    • Functional Specifications: Documents the specific functionalities of the system and any requirements related to its use in compliance with GxP.
    • User Requirements Document (URD): A critical artifact that captures the needs users expect from the system and how they will verify that those needs are met.

    2. Standard Operating Procedures (SOPs)

    Companies must establish SOPs that govern the use, management, and maintenance of their digital systems. These procedures should include:

    • Access controls and data security standards.
    • Data entry and retrieval processes.
    • Review and approval workflows for data derived from these systems.

    3. Audit Trails

    To comply with 21 CFR Part 11 requirements, electronic systems must maintain secure audit trails that chronologically capture all changes made to data. This includes:

    • Direct modifications to data entries.
    • Identities of users making changes.
    • Date and time of actions taken within the system.

    Review/Approval Flow

    The review and approval flow for submissions that incorporate RWD and RWE must adhere to structured processes aligned with regulatory body expectations. When preparing submissions, companies should consider the following key points:

    1. Submission Type Determination

    Regulatory submissions that incorporate RWD can vary significantly, necessitating careful consideration regarding whether to file as a new application, a variation, or supplementary information within existing submissions. Decision points include:

    • New Application: Filing a new application is warranted if the RWD/RWE supports a new indication, dosage, or major change in formulation.
    • Variation: Consider filing a variation if the RWE supports less critical changes, such as updates to product information or labelling. Engage with regulatory authorities early in the process to confirm categorization.

    2. Pre-Submission Meetings

    Pre-submission meetings with regulatory agencies, such as the FDA, EMA, or MHRA, can provide invaluable insights into the expectations and acceptance of RWD/RWE in submissions. Documentation prepared for these meetings should include:

    • Overview of the data sources and methodologies utilized in deriving RWE.
    • Preliminary findings and anticipated implications for product safety and efficacy.

    3. Addressing Agency Queries

    Frequently, regulatory agencies may return queries related to the integrity, robustness, and validity of RWD presented in submissions. To effectively address these, it is crucial to:

    • Provide Comprehensive Responses: Address all aspects of the inquiry and accompany responses with supporting documents and data.
    • Justify Bridging Data: Clearly explain the relevance of bridging studies or RWE to support the transition of data from clinical to real-world settings.

    Common Deficiencies

    <pEven with careful preparation, deficiencies may arise during regulatory review. Understanding common pitfalls can help organizations mitigate risks associated with their submissions:

    1. Insufficient Validation of Digital Systems

    Failure to adequately validate digital systems in compliance with 21 CFR Part 11 or EU Annex 11 can yield serious consequences. Examples include:

    • Lack of documented evidence supporting system functionality.
    • Inadequate user training records and access control measures.

    2. Inconsistent Data Formats

    Ineligible or inconsistent data formats can hinder the review process. Companies must enforce rigorous standards for:

    • Data reporting formats.
    • Metadata associated with submitted RWD/RWE.

    3. Poor Communication of Methodological Approaches

    Omission or vague descriptions of methodologies used to derive RWE can lead to regulatory scrutiny. Key considerations include:

    • Detailed explanations of data collection processes.
    • Clarity around the statistical methodologies employed.

    Practical Tips for Documentation, Justifications, and Responses

    To navigate the complex landscape of RWD/RWE submissions, professionals in Regulatory Affairs should follow these practical tips:

    1. Build a Collaborative Team

    Foster collaboration among teams, including Clinical, Quality Assurance (QA), and Data Science. Diverse expertise can enhance the integrity of submissions and provide insights that improve documentation and responses to agency queries.

    2. Engage Early with Regulatory Authorities

    Utilizing pre-submission meetings to clarify expectations ensures that submitted data aligns with agency requirements. Develop a collaborative dialogue with regulators to understand how RWE can strengthen your submission.

    3. Continuous Training on Regulatory Requirements

    Ensure that all team members are up to date with the latest regulations and guidelines from the FDA, EMA, and MHRA. Ongoing training programs can help streamline the review process and decrease the likelihood of deficiencies.

    4. Invest in Robust Data Management Systems

    Implement electronic systems that enhance data collection, integrity, and audit readiness. Systems should be designed to support traceability, enable audit trails, and ensure adherence to compliance standards.

    Conclusion

    The effective incorporation of real-world data and advanced analytics into regulatory submissions is paramount to achieving compliance and advancing public health objectives. By understanding regulatory frameworks, implementing rigorous documentation practices, and ensuring sound methodologies, organizations can enhance the robustness of their submissions and foster positive relationships with regulatory authorities.

    In conclusion, aligning with 21 CFR Part 11 compliance, EU Annex 11 requirements, and GxP regulations ensures that pharmaceutical companies not only meet regulatory expectations but also leverage the power of data and analytics to improve therapeutic outcomes.

    See also  Building Cross-Functional AI Governance Committees with RA Involvement