当前位置: 首页 > 期刊 > 《家庭医学美国版》 > 2006年第2期 > 正文
编号:11027236
Acceptability of a Web-based Attention-deficit/Hyperactivity Disorder Scale (T-SKAMP) by Teachers: A Pilot Study
http://www.100md.com 《家庭医学美国版》
     Department of Psychiatry (VSB, LD, RE), Center for Rural Health Improvement, University of South Dakota School of Medicine, Sioux Falls, SD

    Department of Family Medicine (VSB, HBV, SP), Center for Rural Health Improvement, University of South Dakota School of Medicine, Sioux Falls, SD

    Background: The American Academy of Pediatrics (AAP) recommends that physicians obtain information directly from teachers or other school professionals as a part of the periodic assessment of children with attention-deficit/hyperactivity disorder (ADHD). This can be difficult for physicians, however, and despite the guideline, treatment decisions are often made without this key information. Hence, alternative means of obtaining data need to be considered. One alternative is using a Web-based instrument as described in this paper.

    Purpose: This pilot, qualitative study examined teacher acceptability of a Web-based version of an ADHD rating scale known as Swanson, Kotkin, Agler, M-Flynn and Pelham Scale-Teacher Version (T-SKAMP) for weekly monitoring of ADHD-impaired children relative to paper-based scales.

    Methods: Following a 2-month clinical trial using the Web-based T-SKAMP, we conducted a qualitative semi-structured interview known as the Teacher Preference Interview (TPI) to 19 teachers.

    Results: Seventeen of 19 teachers (89.5%) rated Web-based T-SKAMP to be easier, shorter, simpler, and more informative than paper-based scales. They further perceived this Web-based scale to be a time saver (both long and short term) and more flexible, efficient, and effective to use than paper-based scales.

    Conclusions: Teachers participating in this pilot study generally preferred a Web-based mechanism of relaying classroom behavioral data on ADHD-impaired children. Web-based T-SKAMP was found to be efficient and effective, and has the potential to improve communication between teachers and physicians. Enhanced communication and cooperation can facilitate increased adherence to established ADHD management guidelines and ultimately benefit affected children.

    Included in the American Academy of Pediatrics (AAP) practice guidelines for attention-deficit/hyperactivity disorder (ADHD) are 3 processes that require clinician-educator cooperation and communication.1,2 First, the AAP recommends that primary care physicians obtain information directly from the child’s teacher or another school professional about the expression of symptoms in the classroom. In fact, the Diagnostic and Statistical Manual for Mental Disorders (DSM-IV) requires that ADHD symptoms must be documented in at least 2 settings.3 Second, the AAP recommends that physicians, in cooperation with school professionals, base decisions concerning treatment on specific behavioral goals or target outcomes. Third, the AAP recommends that physicians periodically provide a systematic follow-up for a child with ADHD. This can be difficult, however, and despite these guidelines physician-teacher communication is often lacking ("educational-medical disconnect"), and many clinical decisions are made without teacher input.4–8 Hence, alternative means of obtaining data need to be considered6–9 and must necessarily be accepted by the teachers who provide the data. One alternative is using a Web-based instrument, as described in this article, and which we hypothesized would be judged to be a more efficient method.

    Discussions with personnel in the Sioux Falls school system revealed that treatment monitoring by physicians through the use of rating scales was infrequent beyond the initial assessment of a child. The purpose of this study was to collect pilot data on the acceptability of a Web-based version of an ADHD rating scale known as Swanson, Kotkin, Agler, M-Flynn and Pelham Scale-Teacher Version (T-SKAMP) relative to paper-based scales previously completed by teachers.7,10–14 The use of this rating scale is a major component of our Web-based classroom data collection system. The conceptualization of this system has been previously described6 and its use reported.7 A paper version of T-SKAMP is displayed in Table 3.

    The Board of Education of the Sioux Falls School District and the Avera-McKennan Hospital and University Health Center Institutional Review Board approved this study.

    Subjects and Assessed Instrument

    Nineteen elementary school teachers who had participated in a 2003 clinical trial involving the use of T-SKAMP were recruited for this study. We selected T-SKAMP for monitoring classroom behavior for several reasons.10–14 First, paper-based versions of T-SKAMP have been found to be quite useful and sensitive in monitoring short-term changes specific to ADHD in research studies, including, the landmark Multimodal Treatment study of children with ADHD (the MTA Study).12 Second, this is a brief instrument. The paper-based version of T-SKAMP can be completed in 5 minutes; thus, there is minimal respondent burden.12 Third, it focuses on assessment of functions specific to ADHD and the types of issues most relevant for classroom success. Fourth, the paper-based version of this scale is in the public domain.10 Fifth, it has moderate to good test-retest reliability over a single day.10–14 The main disadvantage of this scale is the lack of normative data.12 Without the normative data the application of this scale is limited to treatment monitoring, that is, it cannot be used for diagnostic assessment of ADHD.

    Process of Web-Assisted Data Collection

    Teachers completed the Web-based T-SKAMP weekly for 2 months. A care manager (social worker) coordinated collection of classroom data. Raw data were uploaded and converted into meaningful information. To assess overall academic and social functioning of the children, the social worker also conducted monthly structured interviews of teachers by telephone using an instrument called Clinical Global Impressions.15 To protect confidentiality, each student and teacher was assigned a number, obviating the need for transmitting any identifying information. As a further safeguard, we used encryption and passwords during the data collection process. The care manager processed the data on each child for review by a board certified child psychiatrist who prepared a feedback report for the treating primary care physician. The report included an assessment of how the child was doing and suggestions to either modify or not modify the medication regimen. The individualized recommendations were made based on the following: (1) assessment of the clinical data collected by the care manager, (2) a standardized and algorithm-based pharmacotherapy manual for ADHD adapted from current sources, and (3) the best clinical judgment of the child psychiatrist.

    Assessment of Teacher Acceptability of Web-based T-SKAMP

    Following the 2-month trial, we administered an internally developed qualitative semi-structured interview known as the Teacher Preference Interview (TPI) to the 19 participating teachers. Before administering the TPI, we explained that the purpose of the interview was to learn whether they preferred the Web-based Internet-based T-SKAMP or a paper-based scale for reporting classroom behavior of children with ADHD. The TPI begins with 3 open-ended questions. First, teachers are asked to describe their experiences with the Web-based T-SKAMP in general. Second, they are queried about their experience with paper-based ADHD scales. Third, they are asked to compare these experiences.

    A 10-item section followed with specific questions on the efficiency and effectiveness of the Web-based T-SKAMP relative to paper-based scales. The interview responses were anchored on a 6-point Likert scale as follows: disagree a lot (1); disagree (2); disagree a little (3); agree a little (4); agree (5); and agree a lot (6). Three interviewers were involved in data collection from each teacher. While the lead interviewer asked the questions, the other 2 professionals monitored the interviewer-teacher interaction. The purpose of this arrangement was to be sure teachers understood the questions and that the teacher-selected responses were accurately recorded.

    Of the 19 teachers enrolled in the study, all completed the interview. When asked to describe their experiences with ADHD scales, they reported limited past experience completing paper-based scales and no experience completing electronic-based scales before this study. The distribution of teacher responses to the 10 structured interview items of the TPI are summarized in Table 1.

    Seventeen out of 19 (89.5%) agreed a little, agreed, or agreed a lot that it was easier for them to complete the Web-based SKAMP than a similar paper-based scale. They perceived the Web-based scale to be shorter, simpler, quicker, and more efficient than paper-based scales. They found it easier to fit Web-based process into their schedule because of its flexibility. They believed that both the quality and frequency of physician-teacher information exchange could be improved by the use of Web-based SKAMP. They agreed that the physician-teacher communication needed to be improved for better adjustment of ADHD medication. One of the 2 teachers who preferred to manually complete a paper-based scale had little experience in using computers and was about to retire. The other teacher did not perceive the Web-based scale to be efficient and a time saver but was willing to support its use with some reservations.

    The majority of teachers in our sample preferred using a Web-based scale over a paper-based scale particularly when they were asked to complete a rating scale every week. They reported the Web-based T-SKAMP as easier and quicker to complete. This suggests that most teachers prefer a Web-based means of relaying information. Collection of classroom data by this method can potentially improve physician-teacher communication and practice-guideline adherence by physicians.

    A valid criticism of our study is that it did not involve a comparison of a paper-based T-SKAMP with the Web-based system. Although a paper-based version of SKAMP is available and, therefore, it would have been more appropriate to compare teacher perceptions of a paper-based version of T-SKAMP with the Web-based version, none of the teachers had experience with this scale. Typically, they are asked to complete the ADHD Evaluation Scale16 or one of the Conners’ rating scales17 for an initial evaluation because normative data for these scales are available. We were, however, interested in the acceptability of an electronic collection system compared with any paper-based scale. The fact that a great majority of teachers preferred the Web-based version of a scale, with which they were not familiar, over paper-based scales, with which they were familiar, suggests teachers would prefer the electronic version of T-SKAMP to a paper-based one. This would be an appropriate research question for a future study.

    Another factor that may affect study generalizability is that the use of a Web-based scale was well accepted by the great majority of teachers in our sample because they worked in a "highly wired" environment. The findings of this pilot study may also be limited by the possibility that TPI may have generated a positive-response bias among the teachers. For example, teachers may have provided more socially acceptable responses. Our findings need to be confirmed by a larger study with a more diverse sample (teachers, school systems). The very important question of physician preference also needs to be addressed by future investigations. Finally, regardless of teacher preference for Web-based or paper-based scales, not all classrooms have electronic communication capabilities. Our findings are relevant only for school systems in which computer and Internet access is readily available.

    Inadequate physician-teacher communication is a barrier to the best care of children with ADHD. Our pilot study suggests that the Internet can be an effective tool for documenting and relaying information. Displayed in the Table 3 is a paper version of T-SKAMP, an instrument that measures levels of ADHD-related impairment.10 Clinicians might consider using either a paper or an electronic version of T-SKAMP for monitoring classroom behavior of children with ADHD. Our study suggests that this instrument can gain acceptability in school systems as an efficient, effective mechanism for documenting and relaying classroom behavioral data, and has the potential to improve communication between teachers and physicians. Enhanced communication and cooperation can facilitate increased adherence to established ADHD management guidelines and ultimately benefit affected children.

    Suggestions for Setting-up Partnerships with Schools

    The method used by us to promote physician-teacher linkage had several components, including a Web-based rating scale, and collaboration of healthcare professionals (primary care physicians, a social worker care manager, and a child psychiatrist) (Table 2). This method may not be suitable for many communities. Hence, we have summarized several potential methods of setting physician-teacher linkages and physician-directed application of these methods (Table 2).9

    Funding: This study was supported by the Avera Research Institute and a National Institute of Mental Health K012 award (to VSB).

    Conflict of interest: none declared.

    Received for publication December 24, 2004. Revision received August 29, 2005. Accepted for publication September 6, 2005.

    References

    American Academy of Pediatrics, Committee on Quality Improvement and Subcommittee on Attention-Deficit/Hyperactivity Disorder: clinical practice guideline: treatment of the school-aged child with attention-deficit/hyperactivity disorder. Pediatrics 2001; 108: 1033–4.

    American Academy of Pediatrics, Committee on Quality Improvement and Subcommittee on Attention-Deficit/Hyperactivity Disorder. Diagnosis and evaluation of the child with attention-deficit/hyperactivity disorder. Pediatrics. 2000; 105: 1158–70.

    American Psychiatric Association. Diagnostic and Statistical Manual for Mental Disorders (DSM-IV). Washington DC: 1994, APA Press.

    Wolraich M. Current assessment and treatment practices in ADHD. In: Jensen PS, Cooper JR, editors. Attention deficit hyperactivity disorder: state of the science-best practices. Kingston (NJ): Civic Research Institute: 2002. p. 23/1–10.

    Swanson J, Lerner M, March J, Gresham F. Assessment and intervention for attention-deficit/hyperactivity disorder in the schools: lessons from the MTA study. Pediatr Clin North Am 1999; 46: 993–1009.

    Bhatara VS, Vogt HB, Ellis R, Alshari G, Patrick S. Web-based classroom data collection: a best practices case study. South Dakota J Med 2003; 56: 385–389.

    Bhatara VS. Web-based teacher SKAMPs [letter]. J Am Acad Child Adolesc Psychiatry 2004; 43: 132.[Medline]

    Zima BT, Hurlburt MS, Knapp P, et al. Quality of publicly-funded outpatient specialty mental health care for common childhood psychiatric disorders in California. J Am Acad Child Adolesc Psychiatry 2005; 44: 130–44.

    Marshall RM, Wuori DF, Carlson JE. Improving physician/teacher collaboration. J Dev Behav Pediatr 1984; 5: 241–5.

    Swanson JM, Lerner M, Wigal T, et al. The use of laboratory school protocol to evaluate concepts about efficacy and side effects of new formulations of stimulant medications. J Atten Disord 2002; 6(Suppl 1): S73–88.

    McBurnett K, Swanson JM, Pfiffner LJ, Tamm L. A measure of ADHD-related classroom impairment based on targets for behavioral intervention. J Atten Disord 1997; 2: 69–76.

    Collett BR, Ohan JL, Myers KM. Ten-year review of rating scales. V: Scales assessing attention deficit/ hyperactivity disorder. J Am Acad Child Adolesc Psychiatry 2003; 42: 1015–37.

    Wigal S, Gupta S, Guinta D, Swanson J. Reliability and validity of the SKAMP rating scale in a laboratory school setting. Psychopharmacology Bull 1998; 34: 47–53.

    Swanson JM. School-based assessments and interventions for ADD students. Irvine (CA): KC Publishing; 1992.

    National Institute of Mental Health. CGI (Clinical Global Impressions) scale. Psychopharmacology Bull 1985; 21: 839–43.

    McCarney SB. The attention deficit disorder evaluation scale, school version, technical manual, 2nd Ed. Columbia (MO): Hawthorne Educational Service; 1995.

    Conners CK: Conners’ rating scales-revised. North Tonawanda (NY): Multi-Health Systems; 1997.(Vinod S. Bhatara, MD, MS,)