Accuracy of Three Automated Systems (MicroScan WalkAway, VITEK, and VITEK 2) for Susceptibility Testing of Pseudomonas aeruginosa against Fi
http://www.100md.com
微生物临床杂志 2006年第3期
JMI Laboratories, North Liberty, Iowa 52317
Division of Infectious Diseases, Federal University of Sao Paulo, Sao Paulo, Brazil
Tufts University School of Medicine, Boston, Massachusetts 02111
ABSTRACT
One hundred recent clinical Pseudomonas aeruginosa isolates were used to assess the quantitative (MIC) and qualitative (susceptibility category) accuracies of the MicroScan WalkAway, VITEK, and VITEK 2 automated susceptibility test systems when five-broad spectrum -lactams, aztreonam, cefepime, ceftazidime, imipenem, and piperacillin-tazobactam, were tested. Isolates were selected so that the MICs for the isolates overrepresented the MICs near the breakpoints to assess precisely the agreement between the results obtained with the automated systems and the results obtained by the reference tests. The categorical and MIC results from the automated systems were compared to the consensus result of three reference methods: broth microdilution, agar dilution, and disk diffusion. The consensus categorical testing (susceptibility and resistance) rates were 47 and 27%, respectively, for aztreonam; 59 and 14%, respectively, for cefepime; 44 and 43%, respectively, for ceftazidime; 71 and 19%, respectively, for imipenem; and 50 and 50%, respectively, for piperacillin-tazobactam. All systems tested exhibited a high, unacceptable level of very major (false-susceptible) errors for piperacillin-tazobactam (19 to 27%). Major (false-resistant) error rates were generally acceptable (0 to 3%), but minor error rates were elevated (8 to 32%) for cefepime (VITEK 2 and VITEK) and for aztreonam (all three systems), leading to consistent trends toward false resistance. Manufacturer reevaluation of these automated systems for the testing of selected -lactams with current clinical isolates of P. aeruginosa that exhibit contemporary resistance mechanisms would be prudent to minimize the potential for serious reporting errors.
TEXT
Automated or semiautomated systems have been widely used for species identification and susceptibility testing due to the increasing volumes of clinical specimens processed by clinical laboratories, perceived cost-effectiveness, and convenient interfaces with laboratory and hospital information systems. These systems are able to decrease the in-laboratory turnaround time compared to that required for standardized methods and supply physicians with susceptibility profiles to help them guide antimicrobial therapy (8, 21). Each system has inherent strengths as well as recognized limitations. Unfortunately, reporting errors by any test system can have serious implications for the clinical outcome for patients (16). Numerous studies have reported on the accuracies of various automated systems when several organism-antimicrobial combinations are tested. The most frequently reported errors have involved Pseudomonas aeruginosa and select members of the family Enterobacteriaceae, especially when these organisms are tested against -lactam antimicrobial agents (1, 2, 4, 10-15, 19, 21, 22). Negative results of such studies have encouraged the updating of product software and the periodic issuance of manufacturer notices recommending alternative testing methods for certain organism-antimicrobial combinations.
Several mechanisms may lead to resistance to broad-spectrum -lactams among gram-negative bacteria, including (i) the hyperproduction of AmpC -lactamase or other broad-spectrum -lactamases, such as various carbapenemases; (ii) decreased outer membrane permeability (porin deletion); and (iii) active efflux. Some of these mechanisms may preferentially affect particular -lactam compounds, and some automated systems may have problems in correcting interpretive results (11, 13, 22). Variations in inoculum concentrations and incubation times may also affect the detection of resistance secondary to -lactamase production. Thus, rapid automated susceptibility testing systems may have difficulty in detecting resistance to some -lactam compounds for technical reasons, including the methodologies used by the test system and software calculations due to the underlying resistance mechanisms of the organism (1, 2, 7, 11).
Recent reports from an increasing number of hospitals of antibiogram inconsistencies between broad-spectrum cephalosporins and piperacillin-tazobactam when P. aeruginosa is tested drew our attention to possible technical problems with the prevailing automated test systems. In this study, we evaluated the antimicrobial susceptibility testing accuracies of three commonly used automated systems, the MicroScan WalkAway system (Dade Behring, Deerfield, IL) and the VITEK and VITEK 2 systems (bioMerieux, Hazelwood, MO), against a challenge collection of P. aeruginosa isolates and five antipseudomonal -lactams: aztreonam, cefepime, ceftazidime, imipenem, and piperacillin-tazobactam.
One hundred recent clinical strains of P. aeruginosa from hospitals worldwide were evaluated. The isolates were selected according to cefepime and piperacillin-tazobactam MIC results to overrepresent strains that fall within ±2 log2 dilutions of current Clinical and Laboratory Standards Institute (CLSI; formerly the National Committee for Laboratory Standards) susceptible and resistance breakpoints (Table 1) (5, 17, 18). This would allow the detection of systemic errors and facilitate the characterization of the errors in log2 dilution steps.
The susceptibilities of all isolates were tested by three reference methods, by two other manual standardized methods, and with the three cited automated systems. The broth microdilution (frozen panels), agar dilution, and disk diffusion methods were used as reference benchmarks to establish consensus categorical and MIC results for each organism-antimicrobial combination (5, 17, 18). In addition, commercially prepared dry-form panels (TREK Diagnostics, Cleveland, OH) and E-test (AB BIODISK, Solna, Sweden) were used to further confirm the consensus MIC, when needed. The MicroScan WalkAway tests were performed at a commercial laboratory (Weland Clinic, Cedar Rapids, IA) by using a gram-negative MIC panel type 30 (B1017-308). The VITEK 2 tests were performed at a university medical center laboratory (University of Washington, Seattle, WA) with GN09 susceptibility cards, and the results were analyzed with advanced expert system software, version WSVT2-R03.01. The VITEK and all reference and standardized test methods were performed at JMI Laboratories (North Liberty, IA). VITEK GNS-122 susceptibility cards were used with the VITEK system, and the data were interpreted by using software version WSVTK-R09.01. All tests by the reference and standardized methods and automated system susceptibility testing were performed in compliance with current CLSI methods (M7-A6 and M7-A8) (17, 18) and/or as recommended by the manufacturers' package inserts with the products. Quality control was monitored by using the following organisms: Staphylococcus aureus ATCC 29213, Enterococcus faecalis ATCC 29212, P. aeruginosa ATCC 27853 and Escherichia coli ATCC 25922 and ATCC 35218 (5).
Consensus categorical results were initially obtained by comparing the results of the frozen broth microdilution and agar dilution methods (5, 17), which were the methods used to establish and validate each automated method. The agreement between both methods was considered the "consensus result." If the results of these test methods did not agree, discords were resolved by the CLSI disk diffusion method (18). Categorical consensus results were obtainable for 100.0% of the strains by these three methods. The categorical results of each automated system were then compared to the consensus results. Categorical disagreements were classified as very major errors (false susceptibility), major errors (false resistance), and minor errors (involving the intermediate category interpretation).
The MIC consensus results were also calculated by the frozen broth microdilution and agar dilution methods. If the MIC results of these methods were different, the disk diffusion test result was consulted if a categorical shift was involved. As an example, if the ceftazidime results were 16 and 32 μg/ml and the disk diffusion provided a resistant result, the consensus MIC was established at 32 μg/ml. If a consensus MIC could not be achieved by these three methods, the dry-form broth microdilution and E-test results were sequentially compared to determine a log2 quantitative value.
Table 1 shows the distribution of the consensus MIC results for the P. aeruginosa strains. The proportions of MIC results within ±1 log2 dilution of the breakpoints were 90% for aztreonam, 75% for cefepime, 62% for ceftazidime, 64% for imipenem, and 59% for piperacillin-tazobactam (Table 1). Based upon the consensus results for P. aeruginosa, the rates of susceptibility and resistance were as follows: 47 and 27%, respectively, for aztreonam; 59 and 14%, respectively, for cefepime; 44 and 43%, respectively, for ceftazidime; 71 and 19%, respectively, for imipenem; and 50 and 50%, respectively, for piperacillin-tazobactam (Table 2).
The highest numbers of intermethod discords were detected when piperacillin-tazobactam was tested, with all automated systems showing a clear tendency toward false-susceptible results (very major errors). Piperacillin-tazobactam consensus susceptibility rates increased from 50% to 68% (MicroScan WalkAway system), 71% (VITEK system), and 78% (VITEK 2 system). Thus, the rates of very major errors when this agent was tested were 27% for the VITEK 2 system, 21% for the VITEK system, and 19% for the MicroScan WalkAway system, while major errors were detected only with the MicroScan WalkAway system (1%) (Table 3).
When cefepime was tested, the major error rates did not exceed 3% (the MicroScan WalkAway system results were at the upper end of acceptable performance) (Table 3). In contrast, however, the rates of minor errors were usually high for all combinations (8 to 32%), reflecting the high number of isolates whose breakpoints were within ±1 log2 dilution of the categorical breakpoints (Tables 1 and 3). When aztreonam was tested, a clear tendency toward less susceptible results was detected with the VITEK 2 system (a shift from susceptible to intermediate) and the VITEK system (a shift from intermediate to resistant) (Tables 2 and 3). A similar trend was discovered with cefepime, especially when it was tested on the MicroScan WalkAway system. The cefepime susceptibility rates dropped from 59% (consensus) to only 39% (MicroScan WalkAway system) and 44% (VITEK system), while the cefepime resistance rates increased from 14% (consensus) to 32% (MicroScan WalkAway system) and 21% (VITEK 2 and VITEK systems). In addition, a slight tendency toward more resistant results (a shift from intermediate to resistant) was observed when imipenem was tested with the VITEK system.
P. aeruginosa has become the most common gram-negative bacterial species associated with serious nosocomial infections in many hospitals, particularly within intensive care units (9, 23). The accurate determination of P. aeruginosa antimicrobial susceptibility is critical for both the immediate management of infected patients and the timely introduction of appropriate infection control measures. The attributable mortality rate associated with P. aeruginosa infection has been reported to be greater than 20%, and the rapid application of appropriate antimicrobial treatment has been associated with improved clinical outcomes. Conversely, other studies have demonstrated that inappropriate initial antimicrobial therapy is associated with higher rates of patient morbidity and mortality as a result of infections caused by P. aeruginosa (16).
The automated systems evaluated in this study are market leaders in the United States and many other countries (6, 19). A recent survey of the College of American Pathologists with a P. aeruginosa isolate indicated that 5.9% of respondents using an automated test system reported a false-susceptible result for a highly resistant challenge organism (6). That survey also indicated that 29.5% of responses from laboratories that used the VITEK 2 system (46 of 156 results) were falsely susceptible to piperacillin-tazobactam (MICs 64 μg/ml). This was an unacceptable level of performance for those laboratories reporting the organism as falsely susceptible to piperacillin-tazobactam, given that the P. aeruginosa strain had a piperacillin-tazobactam MIC of 1,024 μg/ml by reference methods (17). Those results were confirmed by our findings with the VITEK 2 system and the -lactamase inhibitor combination.
The results of this study dramatically demonstrated that the automated systems studied (the MicroScan WalkAway, VITEK 2, and VITEK systems) generally failed to accurately detect piperacillin-tazobactam resistance among clinically significant isolates of P. aeruginosa. All three systems showed high and unacceptable rates of very major errors (19 to 27%). It is important to emphasize that these results should be interpreted in light of the criteria used to select the strains (MICs close to the breakpoints or within the resistance range); this population was chosen to increase the sensitivity of detecting and quantifying significant categorical disagreements. It is also important that data from the SENTRY Antimicrobial Surveillance Program indicate that the majority of piperacillin-tazobactam-resistant strains (MICs 128 μg/ml) show piperacillin-tazobactam MIC results at or only 1 log2 dilution higher (128 to 256 μg/ml) than the resistance breakpoint, therefore emphasizing the importance of those errors and the validity of the strains selected for use in this experiment (Table 1). Among 397 P. aeruginosa strains evaluated by the USA SENTRY Program (2003), 34 (8.6%) were resistant to piperacillin-tazobactam; and 28 (82%) of those strains showed piperacillin-tazobactam MICs of 128 or 256 μg/ml (H. S. Sader, D. J. Biedenbach, T. R. Fritsche, and R. N. Jones. Abstr. 105th Gen. Meet. Am. Soc. Microbiol., abstr. C-007, 2005).
Earlier studies of P. aeruginosa isolates from cystic fibrosis patients (mucoid and nonmucoid isolates) have established the accuracies of the CLSI reference methods (20) and the agar diffusion methods (disk diffusion and E-test) (3) but recognized that the VITEK and the MicroScan WalkAway systems were not recommended for use for the testing of this species (4). The trends toward false-intermediate and -resistant results by automated methods with cefepime and aztreonam have also become a chronic problem (1, 2, 11, 19), leading to inaccuracies in local antibiograms and the selection of alternative agents for individual patient therapy. Thus, the high rates of false-susceptible and false-resistant results provided by the automated systems may have a significant impact on formulary positioning of antipseudomonal agents and, ultimately, guidelines for the empirical treatment of P. aeruginosa infections in medical centers worldwide. Reevaluation of the -lactam interpretative algorithms of these systems for tests with P. aeruginosa would be prudent to minimize or eliminate the biases detected and correct the various types of errors detected compared to the results of recognized reference methodologies (5, 17, 18).
ACKNOWLEDGMENTS
We thank B. Cookson and S. Swanzy from the University of Washington (Seattle, WA); C. J. Brace from Weland Clinics; and K. Fedler, D. Biedenbach, and M. Stilwell from JMI Laboratories for excellent technical support.
The study was supported by an educational/research grant from Elan Pharmaceuticals (San Diego, CA).
REFERENCES
Biedenbach, D. J., and R. N. Jones. 1995. Interpretive errors using an automated system for the susceptibility testing of imipenem and aztreonam. Diagn. Microbiol. Infect. Dis. 21:57-60.
Biedenbach, D. J., S. A. Marshal, and R. N. Jones. 1999. Accuracy of cefepime antimicrobial susceptibility testing results for Pseudomonas aeruginosa tested on the MicroScan WalkAway system. Diagn. Microbiol. Infect. Dis. 33:305-307.
Burns, J. L., L. Saiman, S. Whittier, D. Larone, J. Krzewinski, Z. Liu, S. A. Marshall, and R. N. Jones. 2000. Comparison of agar diffusion methodologies for antimicrobial susceptibility testing of Pseudomonas aeruginosa isolates from cystic fibrosis patients. J. Clin. Microbiol. 38:1818-1822.
Burns, J. L., L. Saiman, S. Whittier, J. Krzewinski, Z. Liu, D. Larone, S. A. Marshall, and R. N. Jones. 2001. Comparison of two commercial systems (Vitek and MicroScan-WalkAway) for antimicrobial susceptibility testing of Pseudomonas aeruginosa isolates from cystic fibrosis patients. Diagn. Microbiol. Infect. Dis. 39:257-260.
Clinical and Laboratory Standards Institute. 2005. Performance standards for antimicrobial susceptibility testing. Document M100-S15. Clinical and Laboratory Standards Institute, Wayne, Pa.
College of American Pathologists. 2004. Surveys 2004; D-C bacteriology final critique. Specimen D-17. College of American Pathologists, Chicago, Ill.
Doern, G. V., A. B. Brueggemann, R. Perla, J. Daly, D. Halkias, R. N. Jones, and M. A. Saubolle. 1997. Multicenter laboratory evaluation of the bioMerieux VITEK antimicrobial susceptibility testing system with 11 antimicrobial agents versus members of the family Enterobacteriaceae and Pseudomonas aeruginosa. J. Clin. Microbiol. 35:2115-2119.
Felmingham, D., and D. F. J. Brown. 2001. Instrumentation in antimicrobial susceptibility testing. J. Antimicrob. Chemother. 48(Suppl. S1):81-85.
Gales, A. C., R. N. Jones, J. Turnidge, R. Rennie, and R. Ramphal. 2001. Characterization of Pseudomonas aeruginosa isolates: occurrence rates, antimicrobial susceptibility patterns and molecular typing in the global SENTRY Antimicrobial Surveillance Program, 1997-1999. Clin. Infect. Dis. 32(Suppl. 2):S146-S155.
Jones, R. N. 2001. Method preferences and test accuracy of antimicrobial susceptibility testing. Arch. Pathol. Lab. Med. 125:1285-1289.
Jones, R. N., D. J. Biedenbach, S. A. Marshall, M. A. Pfaller, and G. V. Doern. 1998. Evaluation of the Vitek system to accurately test the susceptibility of Pseudomonas aeruginosa clinical isolates against cefepime. Diagn. Microbiol. Infect. Dis. 32:107-110.
Joyanes, P., M. Del Carmen-Conejo, L. Martinez-Martinez, and E. J. Perea. 2001. Evaluation of the VITEK 2 system for the identification and susceptibility testing of three species of nonfermenting gram-negative rods frequently isolated from clinical samples. J. Clin. Microbiol. 39:3247-3253.
Karlowsky, J. A., M. K. Weaver, C. Thornsberry, M. J. Dowzicky, M. E. Jones, and D. F. Sahm. 2003. Comparison of four antimicrobial susceptibility testing methods to determine the in vitro activities of piperacillin and piperacillin-tazobactam against clinical isolates of Enterobacteriaceae and Pseudomonas aeruginosa. J. Clin. Microbiol. 41:3339-3343.
Leverstein-van Hall, M. A., A. C. Fluit, A. Paaum, A. T. A. Box, S. Brisse, and J. Verhoef. 2002. Evaluation of the Etest ESBL and the BD Phoenix, VITEK 1, and VITEK 2 automated instruments for detection of extended-spectrum beta-lactamases in multiresistant Escherichia coli and Klebsiella spp. J. Clin. Microbiol. 40:3703-3711.
Ling, T. K. W., P. C. Tam, Z. K. Liu, and A. F. B. Cheng. 2001. Evaluation of VITEK 2 rapid identification and susceptibility testing system against gram-negative clinical isolates. J. Clin. Microbiol. 39:2964-2966.
Micek, S. T., A. E. Lloyd, D. J. Ritchie, R. M. Reichley, V. J. Fraser, and M. H. Kollef. 2005. Pseudomonas aeruginosa bloodstream infection: importance of appropriate initial antimicrobial treatment. Antimicrob. Agents Chemother. 49:1306-1311.
National Committee for Laboratory Standards. 2003. Methods for dilution antimicrobial susceptibility tests for bacteria that grow aerobically, M7-A6. National Committee for Clinical Laboratory Standards, Wayne, Pa.
National Committee for Laboratory Standards. 2003. Performance standards for antimicrobial disk susceptibility tests, M2-A8. National Committee for Clinical Laboratory Standards, Wayne, Pa.
Saegeman, V., P. Huynen, J. Colaert, P. Melin, and J. Verhaegen. 2005. Susceptibility testing of Pseudomonas aeruginosa by the Vitek 2 system: a comparison with E-test results. Acta Clin. Belg. 60:3-9.
Saiman, L., J. L. Burns, S. Whittier, J. Krzewinski, S. A. Marshall, and R. N. Jones. 1999. Evaluation of reference dilution test methods for antimicrobial susceptibility testing of Pseudomonas aeruginosa strains isolated from patients with cystic fibrosis. J. Clin. Microbiol. 37:2987-2991.
Sanders, C. C., M. Peyret, E. Smith Moland, C. Shubert, K. S. Thomson, J. Boeufgras, and W. E. Sanders, Jr. 2000. Ability of the VITEK 2 advanced expert system to identify -lactam phenotypes in isolates of Enterobacteriaceae and Pseudomonas aeruginosa. J. Clin. Microbiol. 38:570-574.
Steward, C. D., J. M. Mohammed, J. M. Swenson, S. H. Stocker, P. P. Williams, R. P. Gaynes, J. E. McGowan, Jr., and F. C. Tenover. 2003. Antimicrobial susceptibility testing of carbapenems: multicenter validity testing and accuracy levels of five antimicrobial test methods for detecting resistance in Enterobacteriaceae and Pseudomonas aeruginosa isolates. J. Clin. Microbiol. 41:351-358.
Streit, J. M., R. N. Jones, H. S. Sader, and T. R. Fritsche. 2004. Assessment of pathogen occurrences and resistance profiles among infected patients in the intensive care unit: report from the SENTRY Antimicrobial Surveillance Program (North America, 2001). Int. J. Antimicrob. Agents 24:111-118.(Helio S. Sader, Thomas R.)
Division of Infectious Diseases, Federal University of Sao Paulo, Sao Paulo, Brazil
Tufts University School of Medicine, Boston, Massachusetts 02111
ABSTRACT
One hundred recent clinical Pseudomonas aeruginosa isolates were used to assess the quantitative (MIC) and qualitative (susceptibility category) accuracies of the MicroScan WalkAway, VITEK, and VITEK 2 automated susceptibility test systems when five-broad spectrum -lactams, aztreonam, cefepime, ceftazidime, imipenem, and piperacillin-tazobactam, were tested. Isolates were selected so that the MICs for the isolates overrepresented the MICs near the breakpoints to assess precisely the agreement between the results obtained with the automated systems and the results obtained by the reference tests. The categorical and MIC results from the automated systems were compared to the consensus result of three reference methods: broth microdilution, agar dilution, and disk diffusion. The consensus categorical testing (susceptibility and resistance) rates were 47 and 27%, respectively, for aztreonam; 59 and 14%, respectively, for cefepime; 44 and 43%, respectively, for ceftazidime; 71 and 19%, respectively, for imipenem; and 50 and 50%, respectively, for piperacillin-tazobactam. All systems tested exhibited a high, unacceptable level of very major (false-susceptible) errors for piperacillin-tazobactam (19 to 27%). Major (false-resistant) error rates were generally acceptable (0 to 3%), but minor error rates were elevated (8 to 32%) for cefepime (VITEK 2 and VITEK) and for aztreonam (all three systems), leading to consistent trends toward false resistance. Manufacturer reevaluation of these automated systems for the testing of selected -lactams with current clinical isolates of P. aeruginosa that exhibit contemporary resistance mechanisms would be prudent to minimize the potential for serious reporting errors.
TEXT
Automated or semiautomated systems have been widely used for species identification and susceptibility testing due to the increasing volumes of clinical specimens processed by clinical laboratories, perceived cost-effectiveness, and convenient interfaces with laboratory and hospital information systems. These systems are able to decrease the in-laboratory turnaround time compared to that required for standardized methods and supply physicians with susceptibility profiles to help them guide antimicrobial therapy (8, 21). Each system has inherent strengths as well as recognized limitations. Unfortunately, reporting errors by any test system can have serious implications for the clinical outcome for patients (16). Numerous studies have reported on the accuracies of various automated systems when several organism-antimicrobial combinations are tested. The most frequently reported errors have involved Pseudomonas aeruginosa and select members of the family Enterobacteriaceae, especially when these organisms are tested against -lactam antimicrobial agents (1, 2, 4, 10-15, 19, 21, 22). Negative results of such studies have encouraged the updating of product software and the periodic issuance of manufacturer notices recommending alternative testing methods for certain organism-antimicrobial combinations.
Several mechanisms may lead to resistance to broad-spectrum -lactams among gram-negative bacteria, including (i) the hyperproduction of AmpC -lactamase or other broad-spectrum -lactamases, such as various carbapenemases; (ii) decreased outer membrane permeability (porin deletion); and (iii) active efflux. Some of these mechanisms may preferentially affect particular -lactam compounds, and some automated systems may have problems in correcting interpretive results (11, 13, 22). Variations in inoculum concentrations and incubation times may also affect the detection of resistance secondary to -lactamase production. Thus, rapid automated susceptibility testing systems may have difficulty in detecting resistance to some -lactam compounds for technical reasons, including the methodologies used by the test system and software calculations due to the underlying resistance mechanisms of the organism (1, 2, 7, 11).
Recent reports from an increasing number of hospitals of antibiogram inconsistencies between broad-spectrum cephalosporins and piperacillin-tazobactam when P. aeruginosa is tested drew our attention to possible technical problems with the prevailing automated test systems. In this study, we evaluated the antimicrobial susceptibility testing accuracies of three commonly used automated systems, the MicroScan WalkAway system (Dade Behring, Deerfield, IL) and the VITEK and VITEK 2 systems (bioMerieux, Hazelwood, MO), against a challenge collection of P. aeruginosa isolates and five antipseudomonal -lactams: aztreonam, cefepime, ceftazidime, imipenem, and piperacillin-tazobactam.
One hundred recent clinical strains of P. aeruginosa from hospitals worldwide were evaluated. The isolates were selected according to cefepime and piperacillin-tazobactam MIC results to overrepresent strains that fall within ±2 log2 dilutions of current Clinical and Laboratory Standards Institute (CLSI; formerly the National Committee for Laboratory Standards) susceptible and resistance breakpoints (Table 1) (5, 17, 18). This would allow the detection of systemic errors and facilitate the characterization of the errors in log2 dilution steps.
The susceptibilities of all isolates were tested by three reference methods, by two other manual standardized methods, and with the three cited automated systems. The broth microdilution (frozen panels), agar dilution, and disk diffusion methods were used as reference benchmarks to establish consensus categorical and MIC results for each organism-antimicrobial combination (5, 17, 18). In addition, commercially prepared dry-form panels (TREK Diagnostics, Cleveland, OH) and E-test (AB BIODISK, Solna, Sweden) were used to further confirm the consensus MIC, when needed. The MicroScan WalkAway tests were performed at a commercial laboratory (Weland Clinic, Cedar Rapids, IA) by using a gram-negative MIC panel type 30 (B1017-308). The VITEK 2 tests were performed at a university medical center laboratory (University of Washington, Seattle, WA) with GN09 susceptibility cards, and the results were analyzed with advanced expert system software, version WSVT2-R03.01. The VITEK and all reference and standardized test methods were performed at JMI Laboratories (North Liberty, IA). VITEK GNS-122 susceptibility cards were used with the VITEK system, and the data were interpreted by using software version WSVTK-R09.01. All tests by the reference and standardized methods and automated system susceptibility testing were performed in compliance with current CLSI methods (M7-A6 and M7-A8) (17, 18) and/or as recommended by the manufacturers' package inserts with the products. Quality control was monitored by using the following organisms: Staphylococcus aureus ATCC 29213, Enterococcus faecalis ATCC 29212, P. aeruginosa ATCC 27853 and Escherichia coli ATCC 25922 and ATCC 35218 (5).
Consensus categorical results were initially obtained by comparing the results of the frozen broth microdilution and agar dilution methods (5, 17), which were the methods used to establish and validate each automated method. The agreement between both methods was considered the "consensus result." If the results of these test methods did not agree, discords were resolved by the CLSI disk diffusion method (18). Categorical consensus results were obtainable for 100.0% of the strains by these three methods. The categorical results of each automated system were then compared to the consensus results. Categorical disagreements were classified as very major errors (false susceptibility), major errors (false resistance), and minor errors (involving the intermediate category interpretation).
The MIC consensus results were also calculated by the frozen broth microdilution and agar dilution methods. If the MIC results of these methods were different, the disk diffusion test result was consulted if a categorical shift was involved. As an example, if the ceftazidime results were 16 and 32 μg/ml and the disk diffusion provided a resistant result, the consensus MIC was established at 32 μg/ml. If a consensus MIC could not be achieved by these three methods, the dry-form broth microdilution and E-test results were sequentially compared to determine a log2 quantitative value.
Table 1 shows the distribution of the consensus MIC results for the P. aeruginosa strains. The proportions of MIC results within ±1 log2 dilution of the breakpoints were 90% for aztreonam, 75% for cefepime, 62% for ceftazidime, 64% for imipenem, and 59% for piperacillin-tazobactam (Table 1). Based upon the consensus results for P. aeruginosa, the rates of susceptibility and resistance were as follows: 47 and 27%, respectively, for aztreonam; 59 and 14%, respectively, for cefepime; 44 and 43%, respectively, for ceftazidime; 71 and 19%, respectively, for imipenem; and 50 and 50%, respectively, for piperacillin-tazobactam (Table 2).
The highest numbers of intermethod discords were detected when piperacillin-tazobactam was tested, with all automated systems showing a clear tendency toward false-susceptible results (very major errors). Piperacillin-tazobactam consensus susceptibility rates increased from 50% to 68% (MicroScan WalkAway system), 71% (VITEK system), and 78% (VITEK 2 system). Thus, the rates of very major errors when this agent was tested were 27% for the VITEK 2 system, 21% for the VITEK system, and 19% for the MicroScan WalkAway system, while major errors were detected only with the MicroScan WalkAway system (1%) (Table 3).
When cefepime was tested, the major error rates did not exceed 3% (the MicroScan WalkAway system results were at the upper end of acceptable performance) (Table 3). In contrast, however, the rates of minor errors were usually high for all combinations (8 to 32%), reflecting the high number of isolates whose breakpoints were within ±1 log2 dilution of the categorical breakpoints (Tables 1 and 3). When aztreonam was tested, a clear tendency toward less susceptible results was detected with the VITEK 2 system (a shift from susceptible to intermediate) and the VITEK system (a shift from intermediate to resistant) (Tables 2 and 3). A similar trend was discovered with cefepime, especially when it was tested on the MicroScan WalkAway system. The cefepime susceptibility rates dropped from 59% (consensus) to only 39% (MicroScan WalkAway system) and 44% (VITEK system), while the cefepime resistance rates increased from 14% (consensus) to 32% (MicroScan WalkAway system) and 21% (VITEK 2 and VITEK systems). In addition, a slight tendency toward more resistant results (a shift from intermediate to resistant) was observed when imipenem was tested with the VITEK system.
P. aeruginosa has become the most common gram-negative bacterial species associated with serious nosocomial infections in many hospitals, particularly within intensive care units (9, 23). The accurate determination of P. aeruginosa antimicrobial susceptibility is critical for both the immediate management of infected patients and the timely introduction of appropriate infection control measures. The attributable mortality rate associated with P. aeruginosa infection has been reported to be greater than 20%, and the rapid application of appropriate antimicrobial treatment has been associated with improved clinical outcomes. Conversely, other studies have demonstrated that inappropriate initial antimicrobial therapy is associated with higher rates of patient morbidity and mortality as a result of infections caused by P. aeruginosa (16).
The automated systems evaluated in this study are market leaders in the United States and many other countries (6, 19). A recent survey of the College of American Pathologists with a P. aeruginosa isolate indicated that 5.9% of respondents using an automated test system reported a false-susceptible result for a highly resistant challenge organism (6). That survey also indicated that 29.5% of responses from laboratories that used the VITEK 2 system (46 of 156 results) were falsely susceptible to piperacillin-tazobactam (MICs 64 μg/ml). This was an unacceptable level of performance for those laboratories reporting the organism as falsely susceptible to piperacillin-tazobactam, given that the P. aeruginosa strain had a piperacillin-tazobactam MIC of 1,024 μg/ml by reference methods (17). Those results were confirmed by our findings with the VITEK 2 system and the -lactamase inhibitor combination.
The results of this study dramatically demonstrated that the automated systems studied (the MicroScan WalkAway, VITEK 2, and VITEK systems) generally failed to accurately detect piperacillin-tazobactam resistance among clinically significant isolates of P. aeruginosa. All three systems showed high and unacceptable rates of very major errors (19 to 27%). It is important to emphasize that these results should be interpreted in light of the criteria used to select the strains (MICs close to the breakpoints or within the resistance range); this population was chosen to increase the sensitivity of detecting and quantifying significant categorical disagreements. It is also important that data from the SENTRY Antimicrobial Surveillance Program indicate that the majority of piperacillin-tazobactam-resistant strains (MICs 128 μg/ml) show piperacillin-tazobactam MIC results at or only 1 log2 dilution higher (128 to 256 μg/ml) than the resistance breakpoint, therefore emphasizing the importance of those errors and the validity of the strains selected for use in this experiment (Table 1). Among 397 P. aeruginosa strains evaluated by the USA SENTRY Program (2003), 34 (8.6%) were resistant to piperacillin-tazobactam; and 28 (82%) of those strains showed piperacillin-tazobactam MICs of 128 or 256 μg/ml (H. S. Sader, D. J. Biedenbach, T. R. Fritsche, and R. N. Jones. Abstr. 105th Gen. Meet. Am. Soc. Microbiol., abstr. C-007, 2005).
Earlier studies of P. aeruginosa isolates from cystic fibrosis patients (mucoid and nonmucoid isolates) have established the accuracies of the CLSI reference methods (20) and the agar diffusion methods (disk diffusion and E-test) (3) but recognized that the VITEK and the MicroScan WalkAway systems were not recommended for use for the testing of this species (4). The trends toward false-intermediate and -resistant results by automated methods with cefepime and aztreonam have also become a chronic problem (1, 2, 11, 19), leading to inaccuracies in local antibiograms and the selection of alternative agents for individual patient therapy. Thus, the high rates of false-susceptible and false-resistant results provided by the automated systems may have a significant impact on formulary positioning of antipseudomonal agents and, ultimately, guidelines for the empirical treatment of P. aeruginosa infections in medical centers worldwide. Reevaluation of the -lactam interpretative algorithms of these systems for tests with P. aeruginosa would be prudent to minimize or eliminate the biases detected and correct the various types of errors detected compared to the results of recognized reference methodologies (5, 17, 18).
ACKNOWLEDGMENTS
We thank B. Cookson and S. Swanzy from the University of Washington (Seattle, WA); C. J. Brace from Weland Clinics; and K. Fedler, D. Biedenbach, and M. Stilwell from JMI Laboratories for excellent technical support.
The study was supported by an educational/research grant from Elan Pharmaceuticals (San Diego, CA).
REFERENCES
Biedenbach, D. J., and R. N. Jones. 1995. Interpretive errors using an automated system for the susceptibility testing of imipenem and aztreonam. Diagn. Microbiol. Infect. Dis. 21:57-60.
Biedenbach, D. J., S. A. Marshal, and R. N. Jones. 1999. Accuracy of cefepime antimicrobial susceptibility testing results for Pseudomonas aeruginosa tested on the MicroScan WalkAway system. Diagn. Microbiol. Infect. Dis. 33:305-307.
Burns, J. L., L. Saiman, S. Whittier, D. Larone, J. Krzewinski, Z. Liu, S. A. Marshall, and R. N. Jones. 2000. Comparison of agar diffusion methodologies for antimicrobial susceptibility testing of Pseudomonas aeruginosa isolates from cystic fibrosis patients. J. Clin. Microbiol. 38:1818-1822.
Burns, J. L., L. Saiman, S. Whittier, J. Krzewinski, Z. Liu, D. Larone, S. A. Marshall, and R. N. Jones. 2001. Comparison of two commercial systems (Vitek and MicroScan-WalkAway) for antimicrobial susceptibility testing of Pseudomonas aeruginosa isolates from cystic fibrosis patients. Diagn. Microbiol. Infect. Dis. 39:257-260.
Clinical and Laboratory Standards Institute. 2005. Performance standards for antimicrobial susceptibility testing. Document M100-S15. Clinical and Laboratory Standards Institute, Wayne, Pa.
College of American Pathologists. 2004. Surveys 2004; D-C bacteriology final critique. Specimen D-17. College of American Pathologists, Chicago, Ill.
Doern, G. V., A. B. Brueggemann, R. Perla, J. Daly, D. Halkias, R. N. Jones, and M. A. Saubolle. 1997. Multicenter laboratory evaluation of the bioMerieux VITEK antimicrobial susceptibility testing system with 11 antimicrobial agents versus members of the family Enterobacteriaceae and Pseudomonas aeruginosa. J. Clin. Microbiol. 35:2115-2119.
Felmingham, D., and D. F. J. Brown. 2001. Instrumentation in antimicrobial susceptibility testing. J. Antimicrob. Chemother. 48(Suppl. S1):81-85.
Gales, A. C., R. N. Jones, J. Turnidge, R. Rennie, and R. Ramphal. 2001. Characterization of Pseudomonas aeruginosa isolates: occurrence rates, antimicrobial susceptibility patterns and molecular typing in the global SENTRY Antimicrobial Surveillance Program, 1997-1999. Clin. Infect. Dis. 32(Suppl. 2):S146-S155.
Jones, R. N. 2001. Method preferences and test accuracy of antimicrobial susceptibility testing. Arch. Pathol. Lab. Med. 125:1285-1289.
Jones, R. N., D. J. Biedenbach, S. A. Marshall, M. A. Pfaller, and G. V. Doern. 1998. Evaluation of the Vitek system to accurately test the susceptibility of Pseudomonas aeruginosa clinical isolates against cefepime. Diagn. Microbiol. Infect. Dis. 32:107-110.
Joyanes, P., M. Del Carmen-Conejo, L. Martinez-Martinez, and E. J. Perea. 2001. Evaluation of the VITEK 2 system for the identification and susceptibility testing of three species of nonfermenting gram-negative rods frequently isolated from clinical samples. J. Clin. Microbiol. 39:3247-3253.
Karlowsky, J. A., M. K. Weaver, C. Thornsberry, M. J. Dowzicky, M. E. Jones, and D. F. Sahm. 2003. Comparison of four antimicrobial susceptibility testing methods to determine the in vitro activities of piperacillin and piperacillin-tazobactam against clinical isolates of Enterobacteriaceae and Pseudomonas aeruginosa. J. Clin. Microbiol. 41:3339-3343.
Leverstein-van Hall, M. A., A. C. Fluit, A. Paaum, A. T. A. Box, S. Brisse, and J. Verhoef. 2002. Evaluation of the Etest ESBL and the BD Phoenix, VITEK 1, and VITEK 2 automated instruments for detection of extended-spectrum beta-lactamases in multiresistant Escherichia coli and Klebsiella spp. J. Clin. Microbiol. 40:3703-3711.
Ling, T. K. W., P. C. Tam, Z. K. Liu, and A. F. B. Cheng. 2001. Evaluation of VITEK 2 rapid identification and susceptibility testing system against gram-negative clinical isolates. J. Clin. Microbiol. 39:2964-2966.
Micek, S. T., A. E. Lloyd, D. J. Ritchie, R. M. Reichley, V. J. Fraser, and M. H. Kollef. 2005. Pseudomonas aeruginosa bloodstream infection: importance of appropriate initial antimicrobial treatment. Antimicrob. Agents Chemother. 49:1306-1311.
National Committee for Laboratory Standards. 2003. Methods for dilution antimicrobial susceptibility tests for bacteria that grow aerobically, M7-A6. National Committee for Clinical Laboratory Standards, Wayne, Pa.
National Committee for Laboratory Standards. 2003. Performance standards for antimicrobial disk susceptibility tests, M2-A8. National Committee for Clinical Laboratory Standards, Wayne, Pa.
Saegeman, V., P. Huynen, J. Colaert, P. Melin, and J. Verhaegen. 2005. Susceptibility testing of Pseudomonas aeruginosa by the Vitek 2 system: a comparison with E-test results. Acta Clin. Belg. 60:3-9.
Saiman, L., J. L. Burns, S. Whittier, J. Krzewinski, S. A. Marshall, and R. N. Jones. 1999. Evaluation of reference dilution test methods for antimicrobial susceptibility testing of Pseudomonas aeruginosa strains isolated from patients with cystic fibrosis. J. Clin. Microbiol. 37:2987-2991.
Sanders, C. C., M. Peyret, E. Smith Moland, C. Shubert, K. S. Thomson, J. Boeufgras, and W. E. Sanders, Jr. 2000. Ability of the VITEK 2 advanced expert system to identify -lactam phenotypes in isolates of Enterobacteriaceae and Pseudomonas aeruginosa. J. Clin. Microbiol. 38:570-574.
Steward, C. D., J. M. Mohammed, J. M. Swenson, S. H. Stocker, P. P. Williams, R. P. Gaynes, J. E. McGowan, Jr., and F. C. Tenover. 2003. Antimicrobial susceptibility testing of carbapenems: multicenter validity testing and accuracy levels of five antimicrobial test methods for detecting resistance in Enterobacteriaceae and Pseudomonas aeruginosa isolates. J. Clin. Microbiol. 41:351-358.
Streit, J. M., R. N. Jones, H. S. Sader, and T. R. Fritsche. 2004. Assessment of pathogen occurrences and resistance profiles among infected patients in the intensive care unit: report from the SENTRY Antimicrobial Surveillance Program (North America, 2001). Int. J. Antimicrob. Agents 24:111-118.(Helio S. Sader, Thomas R.)