Tools, Technologies and Training for Healthcare Laboratories

2019: CLIA proposed changes to PT acceptable limits

In February 2019, the Centers for Medicaid and Medicare issued proposed changes to the CLIA regulations. This is potentially the largest shake-up in US regulations in decades. PLEASE NOTE: The 2019 proposed goals were replaced by CLIA 2024 goals!

New CLIA Proposed Rules for Acceptance Limits for Proficiency Testing

 Part I. Background and Summary/Comparison

 James O. Westgard, PhD and Sten Westgard, MS
March 2019

IMPORTANT NOTE: The goals proposed by CLIA 2019 were replaced/supplanted by the goals officially entered into the Federal Register in 2022, goals which were to take official effect in 2024. Thus, CLIA 2024 goals are now the goals to pay attention to, not CLIA 2019.

https://www.westgard.com/2024-clia-requirements.htm

What follows below is of historial note, useful for context....

On February 4, 2019, new CLIA “proposed rules” were published in the Federal Register to expand the list of regulated analytes and define new criteria for acceptable performance for proficiency testing (PT) [1].  These changes were apparently initiated in 2008 by the Clinical Laboratory Improvement Advisory Committee’s (CLIAC) recommendation that the acceptance limits (ALs) for PT from the original 1992 publication of CLIA rules should be updated to reflect improvements in technology and changes in the utilization of laboratory tests.  Recall that the original ALs were developed in the late 1980s based on the observed variation in proficiency testing events.  Many ALs were estimated from the results of PT surveys and often stated in the form of the Target Value (mean of the group) ± 3 SD’s of the PT peer group.  In addition, the original CLIA list of regulated analytes was based on medical practice at that time and did not include tests such as HbA1c or PSA that are routine today. Thus, these changes in ALs and expansion of the list of regulated analytes are long overdue.

Some definitions of terms

  • Criteria for acceptable performance is the general language used in CLIA rules to describe Target Values (TV) and Acceptance Limits (AL) for scoring proficiency testing results.
  • Target Value generally refers to the mean result for a peer group of over 10 participants, but may also be established by definitive and reference methods.
  • Peer Group is a group of laboratories that have similar analytic methods (instruments, measurement procedures, reagent systems), but does not require the same reagent lot.
  • Acceptance Limit is defined as the symmetrical tolerance (plus and minus) around the Target Value. The preferred format is ± a percentage of TV, but sometimes ± concentration limit is also includes, particularly for performance at low concentrations.

According to the proposed rules, acceptance limits are intended to be used for scoring PT performance by PT programs and are not intended to be used by individual laboratories to satisfy the requirement… to establish performance specifications.  The implication is that the quality required for acceptable performance in PT programs is not necessarily the same as the quality required in laboratories for clinical services.  That suggests that the AL’s for PT performance may not be as demanding as needed for clinical services, even though the format of an AL as an Allowable Total Error (ATE) is commonly used for defining the quality requirements for laboratory tests.  In justifying the format for proposed ALs, the document states fixed ALs, either in percentages or concentration units, are preferred to SDs for PT…[because] they can be tied directly to objective goals for performance, such as goals for analytical accuracy and technical expectations.  Limits in the form of ATE are therefore preferred for PT rather than separate specifications for precision and bias.

Regulated analytes

            The proposed list of regulated analytes includes a few test deletions and many additions based on the following stated criteria:

  • Current availability of PT materials and the number of PT programs already offering PT;
  • Volume of patient testing being performed nationwide;
  • Impact on patient and/or public health; and
  • Cost and feasibility of implementation.

Analytes deleted include LDH isoenzymes, ethosuximide, quinidine, primidone, and procainamide. Proposed additions in general immunology include Anti-HBs, Anti-HCV, C-reactive protein (high sensitivity). Analytes added in routine chemistry include B-NP, Pro-BNP, Cancer antigen (CA) 125, Carbon dioxide, Carcinoembryonic antigen, Cholesterol low density lipoprotein, Ferritin, Gamma glutamyl transferase, Hemoglobin A1c, Phosphorus, Prostate specific antigen total, Total iron binding capacity, Troponin I, and Troponin T.  In endocrinology, additions include Estradiol, serum Folate, Follicle stimulating hormone, Luteinizing hormone, Progesterone, Prolactin, Parathyroid hormone, Testosterone, Vitamin B12. In toxicology, additions include serum Acetaminophen, Salicylate, and Vancomycin.

            The proposed rules also include extensive discussion of changes for microbiology, first by defining categories of testing (stains, susceptibility and resistance testing, antigen and/or toxin detection, and microbial identification and detection) and second by identifying major groups of microorganisms to be tested for bacteriology, mycobacteriology, mycology, parasitology, and virology. 

Acceptance Limits

Our intent here is to focus on the new recommendations for ALs for specific analytes or tests and to compare the new ALs with the old ALs from the original publication in 1992 [2] and the "Final" Rule published in 2003 [3].   In describing how the new ALs were determined, it appears that biologic variation has been considered together with “state of the art” performance.  The ATE quality goals from the Ricos database were considered to estimate ALs, followed by simulation of those ALs to determine the expected failure rate based on current PT survey performance and to assure “miss rates” of only 1 to 2 percent.  The exact process is difficult to assess from the description in the proposed rules, but this is our best guess based on the discussion on pages 1543 through 1545 in in the Federal Register [1].  It would have been helpful to have a few detailed examples to understand the exact process for setting ALs.  It would have also been useful to have more specific and up-to-date references, rather than to chapters in the 2006 and 2012 editions of the Tietz textbook (4th and 5th editions, vs current 2018 6th edition).  The references tend to reflect the ideas and recommendations at the start of this project a decade ago and ignore more recent discussions, particularly related to the 2014 Milan conference on analytical specifications.   

Summary and comparison tables

The tables are presented separately in our CLIA section, as well as below.

The five tables summarize the new proposed ALs for routine chemistry, immunology, endocrinology, toxicology and hematology and compare those values to the earlier ALs in the original CLIA rules. 

For immunology, ALs have been changed from TV ± 3SD to TV ± % for 8 tests and from TV ± 2 dilutions to TV ± 3SD for 4 others.  For 6 other tests, the ALs remain the same.

For chemistry, the list has 12 additions and now includes 37 regulated analytes.  The ALs for 15 tests have been tightened, 6 remain the same, and 2 are changed from TV ± 3SD to TV ±%.  For glucose, the discussion on page 1544 describes use of both percent and concentration limts (e.g., original 10% and 6 mg/dL, whichever is greater), but the new recommendation in the table in section §493.931 shows only TV ± 8% (greater) without stating any concentration. 

For chemistry, some of the recommendations for ALs already seem out-of-date.  For example, for HbA1c, an AL of 10% is recommended in the new proposed rule.  Compare that to the criteria that have been employed in the CAP PT surveys, where the AL was 15% in 2007, tightened to 12% in 2008, 10% in 2009, 8% in 2010, 7% in 2011, 6.0% in 2014, and is currently 5.0%.  Adding HbA1c to the list of regulated analytes is certainly important, but it is also important to set the AL to be consistent with global standards and practices, which are better aligned with the CAP recommendations, the NGSP requirements for certification of manufacturers’ methods, and the IFCC global standards. 

For endocrinology, there are 10 additions to the regulated list that now totals 18.  All tests have ALs in the form of TV ±% and 6 also include six tests have ALs that have changed from TV ± 3SD to TV ±%.  Likewise, all toxicology ALs are in the form TV ±% and have generally been tightened from 25% to 20% and 20% to 15%. 

The hematology list of regulated tests remains the same and the ALs for 4 of the 10 tests have been tightened. 

References

  1. CMS, CDC, HSS. Clinical Laboratory Improvement Amendments of 1988 (CLIA) Proficiency Testing Regulations Related to Analytes and Acceptable Performance. Fed Reg 2019; 84:1536-1567.
  2. US Department of Health and Social Services. Medicare, Medicaid, and CLIA Programs: Regulations implementing the Clinical Laboratory Improvement Amendments of 1988 (CLIA). Final Rule. Fed Regist `992 (Feb 28);57:7002-7186.
  3. US Centers for Medicare & Medicaid Services (CMS). Medicare, Medicaid, and CLIA Programs: Laboratory Requirements Relating to Quality Systems and Certain Personnel Qualifications. Final Rule.  Fed Regist Jan 24 2003;16:365-3714.

Chemistry

Routine Chemistry CLIA 2019    
Analyte or Test NEW Criteria for AP OLD AP
Alanine aminotransferase (ALT/SGPT) TV ± 15% TV ± 20%
Albumin TV ± 8% TV ± 10%
Alkaline Phosphatase TV ± 20% TV ± 30%
Amylase TV ± 10% TV ± 30%
Aspartate aminotransferase (AST) TV ± 15% TV ± 20%
Bilirubin, total TV ±20% TV  ± 20% or 0.4 mg/dL (greater)
Blood gas pCO2 TV ± 5mm Hg or ± 8% (greater) Same
Blood gas pO2 TV ± 15 mm Hg or ± 15% (greater) TV ± 3SD
Blood gas pH TV ± 0.04 Same
B-natriuretic peptide (BNP) TV ± 30% None
Pro B-natriuetic peptide (proBNP) TV ± 30% None
Calcium, total TV ± 1.0 mg/dL Same
Carbon dioxide TV ± 20% None
Chloride TV ± 5% Same
Cholesterol, total TV ± 10% Same
Cholesterol, high density liprotein TV ± 20% TV ± 30%
Cholesterol, low density lipoprotein (direct) TV ± 20% None
Creatine kinase (CK) TV ± 20% TV ± 30%
CK-MB isoenzymes MB elevated (presence or absence) Same
  or TV ± 25% (greater) or TV ± 3SD
Creatinine TV ± 0.2 mg/dL or ± 10% (greater) TV ± 0.3 mg/dL or ± 15% (greater)
Ferritin TV ± 20% None
Gamma glutamyl transferase TV ± 5 U/L or ±15% (greater) None
Glucose (excluding FDA home use) TV ± 8% TV ± 6 mg/dL or ± 10% (greater)
Hemoglobin A1c TV ± 10% None
Iron, total TV ± 15% TV ± 20%
Lactate dehydrogenase (LDH) TV ± 15% TV ± 20%
Magnesium TV ± 15% TV ± 25%
Phosphorus TV ± 0.3 mg/dL or 10% (greater) None
Potassium TV ± 0.3 mmol/L TV ± 0.5 mmol/L
Prostate Specific Antigen, total TV ± 0.2 ng/dL or 20% (greater) None
Sodium TV ± 4 mmol/L Same
Total Iron Binding Capacity (direct) TV ± 20% None
Total Protein TV ± 8% TV ± 10%
Triglycerides TV ± 15% TV ± 25%
Troponin I TV ± 0.9 ng/mL or 30% (greater) None
Troponin T TV ± 0.2 ng/ML or 30% (greater) None
Urea Nitrogen TV ± 2 mg/dL or ± 9% (greater) Same
Uric Acid TV ± 10% TV ± 17%

Immunology

Immunology CLIA 2019    
Analyte or Test NEW Criteria for AP OLD AP
Alpha-1 antitrypsin TV ± 20% or positive or negative TV ± 3 SD
Alpha-fetoprotein (tumor marker) TV ± 20% or positive or negative TV ± 3 SD
Antinuclear antibody TV ± 3 SD or positive or negative TV ± 2 dilutions or pos or neg
Antistreptolysin O TV ± 3 SD or positive or negative TV ± 2 dilutions or pos or neg
Anti-Human Immunodeficiency virus (HIV) Reactive (pos) or nonreactive (neg) Same
Complement C3 TV ± 15% or positive or negative TV ± 3 SD
Complement C4 TV ± 5 mg/dL or ± 20% (greater) TV ± 3 SD
C-reactive protein (HS) TV ± 1 mg/dL or ±  30% (greater) None
HBsAg Reactive (pos) or nonreactive (neg) Reactive (pos) or nonreactive (neg)
anti-HBc Reactive (pos) or nonreactive (neg) Reactive (pos) or nonreactive (neg)
HB3Ag Reactive (pos) or nonreactive (neg) Reactive (pos) or nonreactive (neg)
Anti-HBs Reactive (pos) or nonreactive (neg) Reactive (pos) or nonreactive (neg)
Anti-HCV Reactive (pos) or nonreactive (neg) Reactive (pos) or nonreactive (neg)
IgA TV ± 15% TV ± 3SD
IgE TV ± 20% TV ± 3SD
IgG TV ± 20% TV ± 3SD
IgM TV ± 20% TV ± 3SD
Infectious mononucleosis Positive or negative TV ± 2 dilutions or pos or neg
Rhematoid factor TV ± 3 SD or positive or negative TV ± 2 dilutions or pos or neg
Rubella TV ± 3 SD or positive or negative TV ± 2 dilutions or pos or neg

Endocrinology

Endocrinology CLIA 2019    
Analyte or Test NEW Criteria for AP OLD AP
Cancer antigen (CA) 125 TV ± 20% None
Carcinoembryonic antigen (CEA) TV ± 15% None
Cortisol TV ± 20% TV ± 25%
Estradiol TV ± 30% None
Folate, serum TV ± 1 ng/mL or ± 30% (greater) None
Follicle stimulating hormone TV ± 2 IU/L or ± 18% (greater) None
Free throxine TV ± 0.3 ng/dL or ± 15% (greater) TV ± 3SD
Human chorionic gonadotropin  TV ± 18% or positive or negative TV ± 3SD or positive or negative
Luteinizing hormone TV ± 20% None
Parathyroid hormone TV ± 30% None
Progesterone TV ± 25% None
Prolactin TV ± 20% None
Testosterone TV ± 20 ng/dL or ±30% (greater) None
T3 uptake TV ± 18% TV ± 3SD
Triiodothyronine TV ± 30% TV ± 3SD
Tyroid stimulating hormone TV ± 20% or ± 2 mIU/L (greater) TV ± 3SD
Thyroxine  TV ± 20% or ± 1.0 mcg/dL (greater) Same
Vitamin B12 TV ± 25% TV ± 30%

Toxicology

Toxicology CLIA 2019    
Analyte or Test NEW Criteria for AP OLD AP
Acetaminophen TV ± 15% None
Alcohol, blood TV ± 20% TV ± 25%
Blood lead TV ± 10% or 2mcg/dL (greater) TV ± 10% or ±4 mcg/dL (greater)
Carbamazepine TV ± 20% TV ± 25%
Digoxin TV ± 15% or ± 2 ng/mL  (greater) None
Gentamicin TV ± 25% Same
Lithium TV ± 15% TV ±  0.3 mmol/L or 20% (greater)
Phenobarbital TV ± 15% TV ± 20%
Phenytoin TV ± 15% or ± 2 mcg/dL (greater) TV ± 25%
Salicylate TV ± 15% None
Theophylline TV ± 20% TV ± 25%
Tobramycin TV ± 20% TV ± 25%
Valproic acid TV ±20% TV ± 25%
Vancomycin TV ± 15% or ± 2 mcg/dL (greater) None

Hematology

Hematology CLIA 2019    
Analyte or Test NEW Criteria for AP OLD AP
Cell identification 80% or greater consensus 90% or greater consensus
White blood cell differential TV ± 3 SD Same
Erythrocyte count TV ± 4% TV ± 6% 
Hematocrit TV ± 4% TV ± 6%
Hemoglobin TV ± 4% TV ± 7%
Leukocyte count TV ± 5% TV ± 15%
Platelet count TV ± 25% Same
Fibrinogen TV ± 20% Same
Partial thromboplastin time TV ± 15% Same
Prothrombin time TV ± 15% Same