Data - Quality - Management - 26 APR 2022
Data - Quality - Management - 26 APR 2022
Data - Quality - Management - 26 APR 2022
1/2/2015
The audience for this course is Principal Investigators (PIs), investigators
and Research Coordinators (RCs) serving on the study team of human
clinical studies and trials.
This course consists of 4 modules and a knowledge quiz.
You must complete the entire course and successfully pass the quiz to
obtain credit for this course at the NIH.
On average this course takes 30 minutes to complete.
Once you have passed the course, download and retain your completion
certificate, and provide a copy to your Principal Investigator (PI) and/or
Institutional Review Board (IRB) as requested
Your completion record consisting of your Name, IC, and successful
completion date will be retained in the OHSRP HRPP Training database:
https://federation.nih.gov/ohsr/nih/investigator-training.php
Records in this database can be viewed by the NIH community and are
secured behind the NIH firewall. You have a right not to have your
records included in the database, but you will be responsible for
providing them upon request to your PI or IRB.
Purpose: This course provides an overview of data quality
management practices that support valid findings from
research studies.
Module 1- Why have Data Quality Management in
Clinical Research?
Module 2 – Good Clinical Practice (GCP) Requirements
and Elements of a Data Management Plan
Module 3 – The Research File and Regulatory Binder
Module 4 – QC/QA, Good Laboratory Practice (GLP),
Monitoring and Audits
Module 5- Bringing it All Together, Planning for
Success
Quiz
Investigators and institutions invest extensive resources, time and effort to conduct research
likely to result in important information to improve human health or conditions. Subjects
donate time and their materials to answer the questions researchers ask. Conducting research
involves a myriad of details and day to day, it can be easy to lose sight of the data quality in all
of this effort.
All research results in data to be analyzed which supports or refutes the study hypothesis. Poor
data results in a waste of effort and resources and puts subjects and ultimately patients at risk
of harm. It is for this reason that institutions, sponsors, and regulators invest such effort to
ensure that research data is of high quality and validity.
Good Clinical Practice (GCP) and Good Laboratory Practice Guidelines (GLP) are among the
most widely recognized standards for conducting well-run trials and for managing research
data and records. These standards are used by institutions, sponsors and regulatory
agencies, such as the FDA, to monitor the conduct of research and data collected on trials.
This course is based on FDA E6 GCP Guidelines. However, regardless of the type of research
conducted, these guidelines are the basis of effective Data Quality Management (DQM).
Institutions, Sponsors and Regulators use Auditing and Monitoring to ensure quality and
validity of research results. While there are many forms of monitoring (including auditing) the
primary focus tends to be on data collection and management. Below we describe the forms of
monitoring you may experience as you conduct research, including:
◦ Sponsor Monitoring – Sponsors monitor the study records and processes to ensure a well
run trial is being conducted and that the data being provided is of high quality and
validity. If the data is not valid, the Sponsor cannot use the data to support a marketing
application before the FDA. Expect Sponsor monitors to inspect your regulatory binders
(including informed consents and eligibility criteria) and study data (including source
documents and CRFs)
◦ IC Quality Assurance and Monitoring – The NIH is entrusted with public funds to conduct
research that will enhance human health and conditions. As result of this trust, the NIH
establishes quality assurance (QA) plans and conducts random and for–cause audits of
the research conducted by its investigators. Additionally, ICs conduct monitoring based
on level of risk (risk-based) or if asked by an IRB or IC leadership (for-cause).
Some other forms of monitoring/auditing include:
◦ Audits by Regulatory Authorities– Regulatory agencies such as the Food and Drug
Administration (FDA) or the Office for Human Research Protections (OHRP) conduct both
random and for-cause audits of protocols under their regulatory authority. Serious
issues revealed by a regulatory authority can have serious consequences including
stopping the study or in a worse-case scenario, debarment of an investigator.
What you need to know: While you may experience any of the types of monitoring listed
above, this course focuses on internal monitoring that the study team performs to ensure
the validity and integrity of the study data.
Monitoring is usually conducted by interested parties involved in the research
(investigators, institutions, sponsors) to identify issues and to improve processes. The goal
is quality control and quality improvement (QC/QI) and it is usually conducted on a
predetermined cycle unless it is for-cause. Monitoring often identifies deficiencies that
require a corrective and preventative action (sometimes referred to as a CAPA) plan.
What you need to know: The NIH Human Research Protection Program (HRPP) and ICs
establish annual QAQI plans which are implemented throughout each year. The focus may
change from year to year. It is likely that you will experience monitoring by your IC at one
point or another.
If you are conducting sponsored research, you will be monitored by your Sponsor, based on
your monitoring agreement.
Auditing by the FDA would only occur if you are conducting FDA-regulated research. This
type of auditing normally takes place at the end of Phase II or before submission of a
marketing application. If the FDA becomes aware of issues on a trial, they could conduct a
for-cause audit at any time.
Risk-based monitoring: If the risks of the study interventions are more than minimal then
the IC may always monitor your study, or it may put your study in a pool of more than
minimal risk studies to be randomly monitored.
Random monitoring: Because monitoring and auditing is a labor and resource intensive, it
is not feasible for institutions or regulatory agencies to monitor every study. Studies may
be selected randomly for monitoring or audit not because a particular issue or concern has
been identified.
What you need to know: It is important to understand some of the terminology and types of
audits a research study team could experience.
While you may experience any of the types of monitoring listed above, this course focuses
on data quality management that study teams can perform to ensure a well-run protocol
that will result in important information to further human health.
The next section provides some more definitions about data quality management.
Case Report Form (CRF): A CRF is a structured document for the collection of study data
extracted from the source documentation. The CRF may be a paper or electronic form
maintained in a clinical trial management system (CTMS) or remote data management system
(RDMS).
Data Monitoring Plan (DMP): The DMP describes the following: data to be collected; how and
where the data are captured and stored; process for reporting and handling corrections;
confidentiality and data sharing; common terminology and roles and responsibilities. The DMP
should be included in the protocol but may be elucidated in a Standard Operating Procedure
(SOP). Often the safety plan is combined with the DMP and is referred to as a Data and Safety
Monitoring Plan (DSMP).
Data Quality Management (DQM): A formal quality improvement process that ensures the
validity and integrity of data during collection, aggregation, storage and analysis.
Quality Assurance (QA): For the purposes of this course, QA a is planned and systematic activity
implemented as part of a quality system to ensure that quality requirements (validity) of the
data generated during the research will be fulfilled.
Quality Control (QC): For the purposes of this course, QC is a real-time review (monitoring) of
data to verify the accuracy and validity by study staff involved in the research.
Quality Improvement (QI): A systematic process including the analysis and correction of
gaps/issues for the improvement of a process such as data management.
Source Data: Raw, unprocessed data collected from the subject throughout the course of the
study including screening, H&P, laboratory, safety, procedural and survey data. These data may
be held in a variety of systems and records including the medical record.
Data quality management (DQM) is a formal process for managing the quality,
validity and integrity of the research data captured throughout the study from
the time it is collected, stored and transformed (processed) through analysis
and publication. This is achieved via two processes referred to as Quality
Assurance (QA) and Quality Control (QC) (Module 4).
DQM starts with a data management plan (DMP) that is specified in the protocol,
as a component of the data safety monitoring plan (DSMP) and approved by the
IRB and sponsor, as applicable, before the protocol starts. (Module 2)
DQM includes the organization and retention of key study documentation,
known collectively as the Regulatory File (or binder). The Regulatory File is
organized and retained to support monitoring and auditing by ICs, IRBs, the
HRPP, Sponsors or Contract Research Organizations (CROs) and regulatory
authorities. The regulatory file is maintained by the study staff. (Module 3)
QA is the activity that supports the generation of quality, validated data from the
research.
Inform your PI as soon as possible if QA procedures are not preventing errors.
Consult your biostatistician or epidemiologist for guidance as needed.
Quality Control (QC): For the purposes of this course, QC is a real-time review of
data to verify the accuracy and validity by study staff involved in the research.
Quality control (QC): of data collected in source documents and CRFs
Timeliness: QC should happen in real-time, close enough to the data collection to
ensure the validity of the data if clinical (such as laboratory results) ; or as soon as
feasible for complex or batched data (such as genomic or deep sequencing data)
Validation: should happen in real-time and not after the study has ended and
should be consistent with established QA processes.
Manual Corrections: should never obscure the original data. Use strike through
and write your initials for paper and audit trails for systems.
QC of raw and transformed data should be consistent with the DMP and should
not adversely impact the power or blinding. Consult your biostatistician or
epidemiologist for guidance.
Confidentiality :
Confidentiality of records that could identify subjects should be protected, respecting
the privacy and confidentiality rules in accordance with the applicable regulatory
requirement(s) (section 2.11).
Maintain security systems that prevent unauthorized access to the data (section
5.5.3(d).
Monitoring:
The investigator/institution should cooperate with monitoring and auditing by the
sponsor, and inspection by the appropriate regulatory authority(ies) (section 4.1.4).
GCP provides a comprehensive list of essential documents that should be retained in the
regulatory binder at each phase of the study:
Before the study commences
During the conduct of the trial
After completion/termination of the trial
Note that the records in the regulatory binders may contain the research
subject codes instead of subject identifiers. (It is possible that external
sponsors may not wish to view individually identifiable information)
What you need to know:
Regulatory binders may be audited by the sponsor or other regulatory
authorities as applicable.
Regulatory binders may be inspected during post-approval monitoring by
the IC and/or the Sponsor
The research files contain copies of the signed informed consents and
source documentation (e.g. medical records from treating physicians,
outside lab results or surveys).
The consent template in use at the NIH Clinical Center (CC) informs
subjects of the possibility that their private information might be seen
by others outside the research team including regulatory agencies. If
your research is not conducted at the CC, and there is a possibility that
the protocol will be monitored (such as with FDA-regulated research)
the consent document should inform subjects of this possibility.
The research team should establish a data quality management plan and a quality
control cycle before the research starts.
Case Report Forms/tools should be clearly defined based on the data needed to
validate the primary and secondary endpoints
Data systems should be consistent with Case Report Forms/tools and data
validation should be defined where ever possible to avoid spurious data and to
promote timely data validation. For example if you are collecting HbA1c’s in a data
field, make sure that the field captures only numerical values. When feasible set
expected ranges and force validation by the user if the data entered is out side the
expected range. Ensure the data system has an audit trail or place to capture notes.
What you need to know: A well-organized and precise set of data collection tools
promotes greater data accuracy and supports the interpretation of results
You can also work with your IC QA Contact to develop a plan or strategies, if you don’t
know who your contact is speak with your Clinical Director.
Quality Control (QC): QC is a real-time review of data to verify the accuracy and
validity by study staff involved in the research.
What you need to know: Quality Control should occur on a regular basis to
ensure accuracy and completeness of study data. As soon as feasible, clarify,
validate, and correct any unclear or out-of-range data.
To notify your IC CD and OHSRP if you are going to be audited by OHRP or the FDA
Provide a quiet space for your monitors/auditors to work and read-only access to
systems
To report any issues to the IRB and how they were resolved.
What should you expect during a monitoring visit?
You will be provided a list of records or binders to pull in preparation for and
during the visit
You may have very little notice of a visit; you may need to reschedule subjects
A report of the results from the monitoring, including a list of items to be corrected
or addressed ; including how soon you must respond (Note that this is called a
“483” when issued by the FDA)
Entire research team - If issues are identified notify the PI and resolve them
promptly.
What you need to know: You may not responsible for all the tasks above, but you are
still responsible for understanding your role and for the quality and integrity of the
data you collect, record or manage.
Use resources available to you: consult your IC QA contact, PI, statistician or data
managers for tips and best practices.
1. What type of monitoring can a study team perform to identify possible issues with data quality
or integrity?
2. Some elements of Data Quality Management (DQM) include establishing a Data Monitoring
Plan (DMP) in the protocol and maintaining the regulatory file. ____ True ____ False
5. Should copies of the signed informed consents be retained in the research file or
regulatory binder? __Yes __No
6. Regulatory files are not only for use by the research team, they may be inspected by
monitoring entities. ____ True ____ False
10. The entire research team has a role to play in Data Quality Management.
1. What type of monitoring can a study team perform to identify possible issues with
data quality or integrity?
____ c. Plan for QC/QI of raw and transformed data System: Partially correct,
this element and the definition of source documentation and CRFs are both
elements of a DMP.
4. Research staff is responsible for establishing and maintaining the regulatory files.
DHHS/NIH/OD/OIR/OHSRP 1
Data Quality Management Quiz Key
____ False System: That is incorrect. Investigators and/or research staff are
responsible for establishing and maintaining the regulatory files.
__No System: That is incorrect. Copies of the signed informed consents are
maintained as part of the research files or regulatory binder. At the NIH Clinical
Center (CC), the original signed consents obtained at the CC are provided to
Medical Records Department.
6. Regulatory files are not only for use by the research team, they may be inspected
by monitoring entities.
____ False System: That is incorrect. The regulatory files must be made
available for inspection by monitoring entities, (e.g. IC or Sponsor monitors, or
FDA inspectors/auditors.
8. The PI should promptly notify the IRB if protocol deviations are uncovered by the
monitoring of the study and what the corrective action plan is.
____ False System: That is incorrect. PI’s are required to report protocol
deviations to the IRB, regardless of how they are identified, per HRPP SOP 16 -
DHHS/NIH/OD/OIR/OHSRP 2
Data Quality Management Quiz Key
____ a. quality and integrity of study data and results System: That is partially
correct. GCP also covers: contents of the regulatory file, and rights, safety and
welfare of research subjects as well as other topics.
____ b. contents of the regulatory files System: That is partially correct. GCP
also covers: quality and integrity of study data/results and, rights and safety and
welfare of research subjects, as well as other topics.
____ e. a and c System: System: That is incorrect. GCP covers all of the
following: quality and integrity of study data/results, contents of the regulatory file,
and rights, safety and welfare of research subjects, as well as other topics.
10. The entire research team has a role to play in Data Quality Management.
____ False System: That is incorrect, the entire research team as a role to play.
DHHS/NIH/OD/OIR/OHSRP 3