AdvaMed CAPA Guide
AdvaMed CAPA Guide
JUNE 5, 2001
We also thank the officials in FDA’s Center for Devices and Radiological Health, CDRH’s Division of
Small Manufacturers Assistance, FDA’s Office of Regional Operations, and FDA’s field staff for
their time and effort in reviewing this document.
To help manufacturers comply with the requirements for corrective and preventive actions
(CAPA), AdvaMed has prepared this question and answer document. This document follows the
audit process described in FDA’s QSIT manual. In addition, two tables are provided (Appendices
5 and 6) that summarize the directions to FDA investigators under the CAPA subsystem of the
QSIT manual. Appendix 5 summarizes the procedures that the investigator is asked to review and
what should be found in them. Appendix 6 summarizes the records that should be reviewed
and what the investigator is asked to focus on.
CAPA Systems
The concept of CAPA is not restricted to the QS regulation or QSIT, but is a widely accepted
concept in most quality systems, whether based on GMP, ISO, or some other standard or
guideline. Since most modern quality systems strive to improve quality, there must be
mechanisms in place to recognize existing or potential quality issues, take the appropriate steps
necessary to investigate and resolve those issues, and, finally, make sure the same issues do not
recur.
An informal review by the authors of the year 2000 warning letters issued to medical device
companies revealed that approximately 15% of the cites (n=813) were concerned with the firm’s
CAPA system. As evidenced by the significant number of warning letter cites on the topic, firms
face many challenges in making the CAPA system work as intended. One of the main objectives
of this “Points to Consider” document is to provide firms with a means to assess their current
Page 3
CAPA system. Although directed toward a QSIT inspection, this document addresses other
quality systems inspections or audits, including ISO.
Firms should ensure that their CAPA system looks beyond product issues and considers other
quality issues, including problems associated with systems and processes. During failure
investigation or root cause analysis, firms will occasionally conclude their investigation when the
nonconforming part or material is identified and corrected. However it is important to note that an
important element of the CAPA system is to address processes and procedures. In many
instances, if a given process were working appropriately, it would be less likely for
nonconformities to be introduced into the system. Where practical, processes and procedures
should be reviewed and considered as potential root causes for product or quality issues.
CAPA systems are inherently data driven. This means that without adequate, relevant data, it can
be difficult to draw definitive conclusions about product or quality issues. There is an increasing
reliance on technology to help gather and sort data. One of the challenges facing many firms is
the proliferation of small, uncontrolled data repositories within the organization. Departments or
individuals now have the ability to create and manage databases that house important quality
information that is invisible to the rest of the organization. Where practical, firms should seek out
and use tools that allow for the collection of that information in a more centralized manner, while
still allowing those same departments and individuals to do their respective jobs. By doing so, the
organization has a better chance of recognizing and resolving quality issues. FDA and other
agencies recognize the increasing reliance on technology, and are promulgating regulations to
address the basic controls necessary to assure the trustworthiness and reliability of electronic
records. FDA’s regulations addressing these basic controls include 21 CFR Part 11 Electronic
Records; Electronic Signatures; and 21 CFR 820.70(i) Automated Processes. According to these
rules, software and software changes for all automated systems used as part of the quality system
must be validated.
As the quality system within an organization matures, there should be a natural shift in emphasis
from corrective action to preventive action. Issues that need to be corrected usually become
obvious. However, issues that have the potential for becoming a problem are less readily
recognizable. How can a firm sift through all its internal data to find those few situations that
might be the precursors of problems down the road? There is no easy answer. Firms will likely
turn to technology solutions to address this surveillance activity. In addition, there is increased
availability of public information through federal agencies, other government agencies, and
industry organizations that provide insight to product issues that may have direct relevance to a
firm’s products. Companies should consider looking to these external data sources as inputs to
their CAPA system.
A good CAPA system should be a “closed loop.” This is common terminology, yet it can be
difficult to define because of the process variability from firm to firm. In general, “closed loop”
refers to at least two elements of the CAPA system. First, it means there are sufficient
mechanisms in place to ensure that the CAPA process runs through all the required steps to
completion, and that management and those responsible for product quality have visibility and
input to the process. In addition, management with executive responsibility must be aware of and
review the outputs of the CAPA system. It is very easy for firms to focus on completing the
individual tasks of a particular corrective action, yet lose track of the original purpose of the
CAPA system. For example, a particular product problem may get resolved, yet no follow-up is
ever performed to make sure the documentation was complete or that the resolution was effective.
In this example, the loop was never closed.
Second, a good CAPA system “closes the loop” on many of the documented issues by directly
providing input into the design control requirements of its quality system. For example,
nonconforming product procedures are directed at assuring that the nonconforming product is
Page 4
identified and corrected prior to distribution or is prevented from being distributed. Frequently, a
correction or temporary change will be implemented to assure that the next lot of products does
not have the same nonconformity. A good CAPA system will pick up where the correction or
temporary change left off, looking for the root cause of the problem and conducting a corrective
action in an effort to ensure that the nonconformity doesn’t show up in any successive lots of the
same or similar products.
References
In compiling this document, we relied principally on the following sources: Federal Food, Drug,
and Cosmetic Act; the Quality System/Good Manufacturing Practice Regulation, 21 CFR Part
820; the Preamble to the Quality System Regulation, which provides insight into FDA’s
interpretation of the regulation (61 FR 52654); Trautman, K.A., FDA and Worldwide Quality
System Requirements Guidebook for Medical Devices, 1997, Milwaukee, Wisconsin; FDA’s
August 1999 “Guide to Inspections of Quality Systems”*; Compliance Program Guidance
Manual 7382_845; ANSI/ISO/ASQ Q9000-2000 – Quality Management Systems: Fundamentals
and Vocabulary; and other FDA publications available on their web site. See the appendices for
additional references and resources.
* NOTE: FDA’s August 1999 Guide to Inspections of Quality Systems can be accessed at:
http://www.fda.gov/ora/inspect_ref/igs/qsit/qsitguide.htm. The Compliance Program Guidance
Manual 7382_845 can be accessed at: http://www.fda.gov/ora/cpgm/default.htm.
Important Information
Please note that manufacturers can comply with the QS regulation requirements in different ways
depending on the type of product that the company manufactures, the size of the company and the
company culture. The examples included herein are meant to illustrate some of the ways a
corrective or preventive action might be performed. A firm may have a different process that is
equally effective. This document is not legal advice or a legal standard. Companies must
ensure that their individual practices and procedures comply with the requirements of 21 CFR
Parts 820, 803, 806, and 821, and may wish to obtain legal advice from a qualified attorney on
this topic. Contact Nancy Singer, Special Counsel at AdvaMed for more information.
Page 5
Questions and Answers
Q.1 What might be the elements of a CAPA system that address the requirements of the
quality system regulation?
Q.2 How might a firm define key terms relating to corrective and preventive action?
Page 6
q Corrective action – action to eliminate the cause(s) of a detected nonconformity
or other undesirable situation. See ISO Q9000:2000. The corrective action
should eliminate the recurrence of the issue.
q Effectiveness evaluation – documented process to establish that an action was
effective and accomplished the objective that was intended.
q Management review – process used by the management with executive
responsibility of a firm to determine that the quality system is appropriate,
suitable, effective and that adequate resources are being applied where needed.
See AdvaMed’s “Points to Consider When Preparing for an FDA Inspection
Under the QSIT Management Controls Subsystem” document. It can be found on
the Web at http://www.advamed.org/regulatory/index.shtml. Scroll down to the
“Points to Consider document issued” on the first page of Regulatory Issues.
q Nonconforming material – material that does not meet quality acceptance criteria
as defined by a specification or similar document or material that has been
determined to be not fit for use. See 21 CFR 820.90.
q Preventive action – action to eliminate the cause of a potential nonconformity or
other undesirable potential situation. See ISO Q9000:2000. The preventive
action should eliminate or prevent the occurrence of the potential issue.
q Quality audit – a systematic, independent evaluation to determine whether
quality activities and related results comply with written requirements and
whether these requirements are implemented effectively and are suitable to
achieve the stated objectives. See 21 CFR 820.3(t).
q Root cause analysis – the analysis necessary to determine the original or true
cause of a system, product, or process nonconformity. This effort extends beyond
the effects of a problem to discover its most fundamental cause.
q Timely – taking action in a timeframe commensurate with the risk and magnitude
of the issue and in a manner that would be taken by a reasonable company that is
concerned with protecting the public health.
q Trend – a sequence or pattern of data. Analysis of a trend is performed to detect
a special cause amidst the random variation of data.
Q.3 What are potential sources of data about product and quality issues?
A.3 Potential sources of data about product and quality issues might include:
q Acceptance activity records relating to component, in process, and finished
device testing
q Complaints
q Medical Device Reports (MDRs) and Vigilance Reports
q FDA 483s and Warning Letters
q Reports of system, process or product nonconformities
q Process monitoring data (e.g., statistical control charts, trends, run charts, etc.)
q Calibration and maintenance records
q Scrap, rework and “Use As Is” (UAI) records
Page 7
q Clinical adverse events
q Internal, external, supplier and third party audits*
q Returned products analysis
q Installation and/or repair reports
q Spare parts usage
q Customer and/or technical service requests
q Field service and/or warranty reports
q Customer feedback (e.g., surveys, polls, etc.)
q Historical records from previous corrections
q Corrective and preventive actions
q Lawsuits and other legal actions
q Published literature
q Reports from employees
*NOTE: In the course of an investigation, an FDA investigator may seek information on
how a particular nonconformity was detected. Under some circumstances, this could lead
to requests for information relating to internal audits, supplier audits, or management
reviews. Firms should develop an internal policy or procedure on how to handle these
requests. Internal audits, supplier audits, and management reviews are not typically
shared with an FDA investigator.
All of the above examples, with the exception of FDA 483s and Warning Letters,
lawsuits, and, published literature, are derived from the firm’s qua lity system, and are
defined as “quality records” by FDA. All quality records should be considered a potential
source of important system, product, and/or process-related information. Firms should
maintain an accurate inventory of data repositories so information can be effectively
analyzed. Wherever practical, firms should try to reduce isolated data sources and
consolidate or compare data from different sources to improve the likelihood of
recognizing existing or potential product or quality issues.
The Quality System regulation provides that the requirement to make records under the
Quality System regulation available for inspection and copying by FDA officials does not
apply to management reviews, internal audits, and supplier audits (21 CFR 820.180(c)).
However, comment 182 of the preamble to the Quality System regulation provides
that FDA may seek production of management reviews and quality audit reports
“…in litigation under applicable procedural rules or by inspection warrant where
access to the records is authorized by statute.” If quality audits or management
reviews are the only mechanism the firm uses to document their corrective and
preventive actions, those records may be open for FDA inspection. Firms should not rely
on quality audits and management review reports or minutes as the sole documentary
evidence of their corrective and preventive actions.
A designated FDA employee under 21 CFR 820.180(c) may request that, under the
requirements of the regulations, “management with executive responsib ility” certify in
writing that management reviews and quality system audits have been performed and
documented, the dates on which they were performed, and that “any required corrective
action has been undertaken.” If an FDA employee makes this request, seek the
assistance of legal counsel before providing this certification. When providing the
Page 8
certification concerning whether or not “any required corrective action has been
undertaken,” counsel should consider including language, “to the best of my knowledge,
on the basis of the facts before me, it appears that a good faith effort has been made to
ensure that any required corrective action deemed necessary by management has been
undertaken.”
Q.4 How might a firm demonstrate that data from these sources have been analyzed to
identify existing product or quality issues?
A.4 Firms should implement procedures that provide for the periodic analysis and review of
product and quality data to identify trends that may indicate action is warranted to correct
existing product or quality issues and to develop actions to prevent their recurrence.
Information that could lead to corrective actions may come from both internal and
external sources as described in Answer 3 (A.3) above. Data that are particularly useful
for identifying existing product or quality issues may come from:
q Complaints
q Medical Device Reports and Vigilance Reports
q FDA 483s and Warning Letters
q Reports of system, process or product nonconformities
q Scrap, rework and “Use As Is” records
q Clinical adverse events
q Internal, external, supplier, and third party audits (See NOTE in A.3 above)
q Returned products analysis
q Repair reports
q Field service and/or warranty reports
q Reports from employees
The firm should be able to demonstrate that the data were properly recorded and analyzed
according to procedure. If electronic systems are used to capture and analyze this
information, the software should be validated. Mechanisms should exist to demonstrate
that data from different sources are collectively and comparatively analyzed. Analysis
should include looking for outliers, comparing actual results to expected results
(including trends or expectations established through design or process validations), and
comparing them in relation to established and actual process parameters.
An example of a corrective action is located in Appendix 1.
Q.5 How can a firm demonstrate that product and quality data have been analyzed to
identify potential product or quality issues?
A.5 Firms should implement procedures that provide for the periodic analysis and review of
product and quality data to identify areas of improvement or preventive actions.
Information that could lead to preventive actions may come from both internal and
external sources as described in Answer 3 (A.3) above. Preventive actions allow firms to
take measures before product becomes nonconforming. Data that are particularly useful
for identifying potential product or quality issues include:
Page 9
q Acceptance activity records relating to component, in-process, and finished
device testing
q Process monitoring data (e.g., statistical control charts, trends, run charts, etc.)
q Calibration and maintenance records
q Internal, external, supplier, and third party audits (See NOTE in A.3)
q Customer feedback (e.g., surveys, polls, etc.)
In addition to procedures, firms should be able to demonstrate that the analysis activities
actually occurred. See Answer 4 (A.4) above.
Q.6 How can a firm demonstrate to an FDA investigator that CAPA data are complete,
accurate and timely?
A.6 An important aspect of the CAPA system is that the data coming into the system are
complete, accurate and timely. Firms should implement procedures that describe:
q What the sources of product and quality data are
q How the data are to be captured
q How the data are to be analyzed, including the method of analysis
q When the data are to be analyzed
q What steps are taken after analysis
Firms should also be able to demonstrate that the activities described above actually
occurred. In addition, process flow charts can be an effective tool to describe the process.
Significant potential or actual quality problems detected and corrected before they
resulted in misbranded or adulterated product reaching the marketplace may demonstrate
that a given analysis was timely. Where practical, firms should consider automating
certain activities, such as trending reports or other analyses, to run at predetermined time
intervals. When validated, automated activities provide one mechanism for ensuring
complete, accurate, and timely processes in the CAPA system. Automated activities
should be periodically reviewed to ensure they remain relevant and accurate in the
current operational environment.
Q.7 What types of statistical methods (where ne cessary) are appropriate for detecting
recurring quality issues?
Page 10
q Product survival analysis of incomplete life data
q Stress-fatigue analysis
q Graphical methods (histograms, scatter plots, etc.)
q Advanced methods (e.g., fitting models to frequency distributions, computing
and plotting hazard functions, etc.)
Statistical methods can also be useful when they are applied across different data sources
to analyze comparable issues. For example, by comparing manufacturing
nonconformances across multiple manufacturing sites, information regarding common
suppliers, or complaint information against customer service reports, the firm can achieve
a more complete perspective of the entire organization.
Although statistical techniques are powerful tools for analyzing product and quality
issues, they should not be the only mechanism used by firms. Non-statistical techniques
provide an opportunity to rely on corporate knowledge and expertise to recognize issues
sometimes before there is an observable trend. These techniques include:
q Management reviews
q Quality and/or material review boards
q Safety committees (internal or external)
q Employee suggestion programs
q Individual clinical, product or engineering expertise
q Other internal reviews
This type of review often helps to reduce any geographical or departmental bias that may
be introduced when identifying issues.
Appendix 3 lists useful references and web sites related to statistical methods.
Page 11
q Feeding information into FMEA (Failure Effects and Modes Analysis) or another
risk management tool and tying back to the risk analysis originally performed
during the design phase.
A thorough failure investigation needs to take into consideration design, process and
labeling deficiencies. “User error” or “use error” should not generally be considered a
root cause.
Appendix 4 lists useful references and web sites related to failure investigations.
Q.10 What factors might be taken into consideration when determining if a product or
quality issue is “significant”?
A.10 Typically, the following factors are taken into consideration in determining if a product
or quality issue is significant:
q Is there potential for user or patient safety issue? – Likelihood that the issue may
result in a death or serious injury, even if the cause is determined to be user error.
q What is the classification of the device? – Class II and III products tend to have
higher risks associated with them than Class I products.
q Is there a reliability issue? – Does the nonconformance or product issue affect
the product’s reliability?
q Did the product meet its specifications? – Does the nonconformance or product
issue cause the product to fall outside of established specifications?
q Was the product labeling involved? – Does the nonconformance or product issue
cause the product to be misbranded, adulterated, or otherwise not properly
identified?
Page 12
q Has the frequency of occurrence for a known issue changed? – Is the
nonconformance or product issue occurring at a higher rate than expected over a
given period?
q Is the issue difficult to detect? – A nonconformance or product issue that is
difficult to detect is less likely to be identified and corrected prior to causing a
problem.
Q.11 What evidence might be shown to an FDA investigator to demonstrate that the
CAPA system is functioning as intended?
A.11 Evidence to show an FDA investigator that the CAPA system is functioning properly
might include:
q CAPA inputs – Sources of product and quality data are routinely reviewed.
q Analysis – Documentation demonstrating that data were analyzed for possible
unfavorable trends or other indicators of product or quality issues.
q Investigations – Documentation demonstrating that qualified personnel have
investigated unfavorable trends, nonconformances, and product issues.
q Action records – Corrective or preventive action plans and other records
demonstrating action start and end dates.
q Effectiveness checks – “Before” and “After” product or process quality trend
reports or other analyses. These checks should establish that the action
effectively prevented the recurrence (or initial occurrence) of the
nonconformance.
q Verification checks – Engineering change orders (ECOs) or other control forms
for initiating a change to a product or process.
q Validation checks – Design verification, design validation, and process validation
protocols, and summary reports to ensure the actions were effective and that they
do not adversely affect the device.
q Control checks – Training records, product tracking information, segregation,
reprocessing, rework or final product disposition records with appropriate
authorizations.
q Timeliness checks – Tracking mechanisms to demonstrate that actions are
conducted in a timely manner.
q Management checks – Management review agendas and schedules, corrective/
preventive action status, aging and closeout reports.
An effective CAPA system should be a “closed-loop” process. There should be
mechanisms in place to assure that corrective actions are closed in a timely manner
consistent with the type of issue, the corrective action was effective in eliminating the
cause(s) of the nonconformance, the action has been reviewed by management with
executive responsibility, information has been disseminated to parties responsible for
product quality and other people affected by the action, and, if the action is not shown to
be effective, an evaluation is performed to determine if a quality issue continues to exist.
Page 13
Q.12 What evidence might be shown to an FDA investigator to demonstrate that
corrective and preventive actions for product and quality issues were implemented
and documented?
A.12 Evidence to show an FDA investigator to demonstrate that corrective and preventive
actions for product and quality issues were implemented and documented might include:
q Engineering change orders
q Process/product verification and validation records
q Training records
q Corrective or preventive action close-out reports
q Nonconformity close-out reports
q Effectiveness evaluations
q Current trends (or other indicators) that demonstrate actions were effective
Q.13 Do all nonconformities require a risk analysis, failure investigation, and corrective
action?
A.13 The preamble to the October 7, 1996 Quality System regulation provides insight into
FDA’s position on these matters. In comment 159 of the preamble , which relates to the
degree of corrective or preventive actions, FDA states “FDA cannot dictate in a
regulation the degree of action that should be taken because each circumstance will be
different, but FDA does expect the manufacturer to develop procedures for assessing the
risk, the actions that need to be taken for different levels of risk, and how to correct or
prevent the problem from recurring, depending on that risk assessment.” A CAPA system
should provide mechanisms to assess risk throughout the process.
Nonconformities should be evaluated as to their potential risk to patients and users. This
evaluation should be supported by a documented product risk assessment performed
under design controls or subsequently generated at the time the nonconformity is
identified. The determination whether or not to pursue failure investigation and/or
corrective action is based in part on the magnitude of the problem and any related risk,
and should be made by properly trained and qualified individuals. The determination and,
if appropriate, the rationale for not pursuing corrective action should be documented in
accordance with criteria defined in written procedures.
It is reasonable to assume that there will be nonconformities that have no hazard potential
or for which the root cause is unable to be determined or is attributed to purely random
circumstance. These conclusions should be well-documented and the rationale explained
in a written record. These situations may not require further action, but they should be
periodically reviewed and incorporated into the review of trend reports or other analyses
to ensure no recurrence or continuing problem exists. When the root cause cannot be
determined due to insufficient data, methods to acquire additional data should be
considered and incorporated into a formal action plan.
Page 14
Q.14 What evidence might be shown to an FDA investigator to demonstrate that
information regarding nonconforming product and quality issues and corrective
and preventive actions have been properly disseminated?
Q.15 What evidence might be shown to an FDA investigator to demonstrate that CAPA
information is an integral part of the management review process?
A.15 Evidence to show an FDA investigator that CAPA information is an integral part of the
management review process might include:
q Procedures for management reviews that contain standard agendas with headings
that discuss the review of corrective and preventive actions.
q Agendas relating to the management review of the quality system including
corrective and preventive actions, and certification that reviews were conducted.
q Completed or closed corrective and preventive actions* that resulted from the
management reviews.
q Schedules of management reviews (past and future).
q CAPA analysis reports submitted for Management Review.
*NOTE: In the course of an investigation, an FDA investigator may seek information on
how a particular nonconformity was detected. Under some circumstances, this could lead
to requests for information relating to internal audits, supplier audits or management
reviews. Firms should develop an internal policy or procedure on how to handle these
requests. Internal audits, supplier audits, and management reviews are not typically
shared with an FDA investigator.
Page 15
Q.16 What might be the elements of a Medical Device Reporting (MDR) system that
addresses the requirements of 21 CFR Part 803, Medical Device Reporting?
A.16 Elements of an MDR system addressing 21 CFR Part 803 might include:
q Procedures for the timely and effective identification, communication, and
investigation of events that may be subject to medical device reporting
requirements.
q Procedures that provide a standard mechanism to determine if an event meets the
criteria for MDR reporting and that require documentation of the information
evaluated and the conclusion drawn.
q Procedures for submitting complete and timely reports to FDA.
q Procedures for maintaining documents and other records related to the evaluation
and submission of MDR reports.
q Procedures for maintaining MDR event files and distinguishing them from other
complaint records.
Q.17 What evidence might be shown to an FDA investigator to demonstrate that the
MDR system is functioning in accordance with 21 CFR Part 803?
A.17 Evidence to show an FDA investigator that the MDR system is functioning in accordance
with 21 CFR Part 803 might include:
q MDR files that demonstrate a standard evaluation and review was completed and
the submission of MDR reports was done in accordance with written procedures
and the requirements of the rule.
q Complaint files for unreported events that demonstrate a standard evaluation and
review was completed, who completed the evaluation, and an adequate rationale
for not reporting the event.
Not all complaints are reportable under the regulation. The firm should establish written
procedures that describe how complaints are analyzed and what criteria are examined to
determine if the complaint is reportable. If the firm determines that an apparent device-
related death, serious injury, or malfunction is not reportable, the decision must be
documented and it must be made by an individual suitably qualified to make a medical
judgment (i.e., physician, nurse, risk manager, or biomedical engineer). Because there are
time constraints prescribed in this rule, the firm should be able to demonstrate that their
process allows for the timely evaluation of complaints.
Q.18 What evidence might be shown to an FDA investigator to demonstrate that the
firm’s management has implemented the reporting requirements of 21 CFR Part
806, Reports of Corrections and Removals?
A.18 Evidence to show an FDA investigator that the firm’s management has implemented the
reporting requirements of 21 CFR Part 806 might include:
q Written procedures for the evaluation of corrections and removals to determine if
they must be reported to FDA under the rule.
Page 16
q Files of reportable removals or corrections that show the firm submitted
complete, written reports to the appropriate FDA District Office within 10
working days of initiating the action.
q Files demonstrating that unreported removals or corrections have been processed
through the firm’s CAPA system, contain the required information, and all such
actions have been reviewed and evaluated in accordance with written procedures.
A written rationale why the removal or correction was not reportable under the
rule should be maintained.
Q.19 What evidence might be shown to an FDA investigator to demonstrate that a firm
that manufactures trackable products has the capability to meet the requirements of
21 CFR Part 821, Medical Device Tracking Requirements?
*NOTE: FDA’s policy relative to review of quality audit results is stated in “Compliance
Program Guidance” (CPG) Manual 7151.02 (CPG Manual Sub Chapter 130.300). This
policy prohibits FDA access to a firm’s quality audit results during a routine inspection or
investigation. However, the FDA reserves the right to these records in limited
circumstances as described in the CPG. This manual is posted on the Web at
http://www.fda.gov/ora/cpgm/default.htm.
Page 17
Appendix 1
Corrective Action – Example
Page 18
Appendix 2
Preventive Action – Example
Page 19
Appendix 3
Statistical Methods
Useful References:
1) Statistical Methods for Quality Improvement, Kume, Hitoshi (editor), 1987,
ISBN 4-906224-34-2. 231 pages
2) Quality Engineering Statistics, Dovich, Robert A., 1992,
ISBN 0-87389-141-4
3) Introduction to Statistical Quality Control, 4th Edition, Montgomery, Douglas C.,
2001, ISBN 0-471-31648-2. 816 pages.
4) ISO/TR 10017:1999, “Guidance on Statistical Techniques for ISO 9001:1994.”
5) Juran's Quality Control Handbook, J.M. Juran and Frank Gryna (eds.), 4th Edition,
1988, ISBN 0-07-033176-6.
Page 20
Appendix 4
Failure Investigations and Analysis
Useful References:
1) Failure Mode and Effect Analysis: FMEA from Theory to Execution, Stamatis, D.H.,
1995, ISBN: 0-87389-300-X. 494 pages.
2) The Basics of FMEA, McDermott , Robin, 1996, ISBN: 0527763209. 76 pages.
3) The Root Cause Analysis Handbook: A Simplified Approach to Identifying,
Correcting, and Reporting Workplace Errors, Ammerman, M., 1998, ISBN:
0527763268. 144 pages.
4) Root Cause Analysis Handbook: A Guide to Effective Incident Investigation,1999,
ISBN: 0865876584.
5) “ISO 14971 Medical Devices” – Application of risk management to medical devices.
(This document can be found at
https://www.aami.org/secure/marketplace/search.cfm. Enter 14971 as a Keyword and
search. Scroll down to ISO 14971:2000. Click on the box beside the title if you want
detailed information and purchase price.)
6) Root Cause Analysis: A Tool for Total Quality Management, 1993,
ISBN: 0-87389-163-5.
Page 21
Appendix 5
CAPA Procedure Review
The following table is a summary of the instructions provi ded to investigators in the “Guide to
Inspections of Quality Systems” (QSIT Manual). This table specifically addresses the procedures
investigators are asked to review.
Page 22
PROCEDURE TO REVIEW WHAT TO LOOK FOR
Tracking Procedure(s) - If firm is aware of requirements to:
- Notify FDA if it goes out of business and provide copies of
tracking records to FDA
- Transfer tracking records to firm purchasing its tracked
devices
- Continue tracking devices it stops manufacturing or importing
if it remains in business
- If system addresses the capability to:
- Identify location and other required data for devices
undistributed to patients within 3 working days after request
by FDA
- Identify location and other required data for devices
distributed to patients within 10 working days after request by
FDA
- If procedure(s) addresses remaining requirements of 21 CFR Part
821.25(a-c) for collection, maintenance, and auditing of tracking data
Audit Procedure(s) - If procedure(s) addresses:
- Functioning of tracking system
- Accuracy and completeness of data in tracking system
Page 23
Appendix 6
CAPA Records Review
The following table is a summary of the instructions provided to investigators in the “Guide to
Inspections of Quality Systems” (QSIT Manual). This table specifically addresses the records
investigators are asked to review.
NUMBER OF
RECORDS TO WHAT TO REVIEW WHAT TO LOOK FOR
REVIEW
Use sampling tables Records from one or two - If reviewed data were entered into CAPA system
quality data sources - If data entered are complete, accurate, and
entered in a timely manner
No number specified Historical records that may - If preventive actions have been taken regarding
show unfavorable trends unfavorable trends (e.g., product and quality
(e.g., trending data, improvements or use of statistical process control
corrective actions, acceptance techniques)
activities) - If data from in-conformance product are
analyzed to detect shifts
- If statistical process control techniques are being
used where applicable
Use sampling tables Failure investigation records - If failure investigation procedure is being
for more than one failure followed
mode (if possible) - If all reviewed failure modes are captured in data
summaries (e.g., reports, charts, spreadsheets, etc)
- If depth of investigation is sufficient to
determine the corrective action necessary
One record Significant failure - If root cause was identified so that verification or
investigation that resulted in validation could be accomplished
a corrective action
Use sampling tables Incomplete failure - Potential unresolved product nonconformances
investigations - Potential distribution of nonconforming product
Use sampling tables Records of nonconforming - Potential distribution of nonconforming product
product for which corrective
or preventive action was not
taken
Use sampling tables Concessions made for - If concessions were appropriate to product risk
nonconforming product - If quality system requirements were followed
- If concessions were made solely to fulfill
marketing needs
Page 24
Use sampling tables Significant corrective actions - If the change(s) could have extended beyond the
(e.g., a product or process action taken. If so, ask for rationale for not
change to correct a problem) extending the action beyond that taken.
- If the actions were effective:
- Look at subsequent trend results for
similar problems
- See if change was verified or validated to
ensure effectiveness and absence of
adverse effects
Use sampling tables Most recent corrective or - If they have been documented and implemented
preventive actions - If information related to problems was
disseminated to individuals directly responsible for
assuring product quality and prevention of
problems
One record Recent CAPA event - What records were submitted for management
review (Note: review raw data given to
management, not results of management review)
MDR System Records
Use sampling tables MDR event files - If M DR event files are prominently identified
and easy to access
- If MDR event files contain:
- information that describes a device-
related death, serious injury, or
malfunction
- evaluation of information including
decision to submit or not to submit an
MDR
- copies or references to supporting
documentation
- MDR reports (including any follow-ups),
baseline reports, and MDR-related
correspondence, as appropriate
Use sampling tables MDR reports submitted to - If written procedures were followed (e.g., with
FDA respect to timely reporting, complete investigation,
consistency, etc.)
Use sampling tables Complaints not reported as - If they contain information relating to MDR-
MDRs and records from one reportable events. If so, ask for rationale for not
additional source of quality submitting MDR reports.
data (e.g., service reports,
repair reports, returned goods
files, etc.)
Reports of Corrections and Removals Records
Use sampling tables Corrections or removals that - If correction or re moval was reported to FDA
have been reported to FDA within 10* days of its initiation
- If FDA was provided with all information
required by 21 CFR Part 806.10
*NOTE: The QSIT Manual does not
include the word “working” between 10
and days. FDA regulation 21 CFR
806.10(b) states “10 working days”.
Use sampling tables CAPA files - If CAPA files reveal apparent Class I or II
recalls that were not reported to FDA
Page 25
Use sampling tables Corrections or removals that - If all information required by 806.20 is present
did not need to be reported to - If information is retained for 2 years longer than
FDA per 21 CFR Part 806.20 the expected life of the device involved
- If these files reveal apparent Class I or II recalls
- If any claims for exemption from the reporting
requirements of 806 are well-founded
- If device was sold to another firm, confirm these
files were transferred to new manufacturer or
importer
Medical Device Tracking Records
No number specified Prior manufacturer’s tracking - Existence and maintenance of prior
records (if applicable) manufacturer’s tracking records or equivalent
information
One or two records Tracking files containing - If required information was provided in required
information requested by timeframe(s)
FDA
Based on length of Audit schedules - Audits of tracking system every six months for
time tracking has first three years and annually thereafter
been a requirement
for the firm
Page 26