当前位置: 首页 > 期刊 > 《临床癌症学报》 > 2006年第1期 > 正文
编号:11295602
Information Technology and Cancer Prevention
http://www.100md.com 《临床癌症学报》
     Dr. Jimbo is Clinical Assistant Professor, Department of Family Medicine, University of Michigan, Ann Arbor, MI.

    Dr. Nease is Associate Professor, Department of Family Medicine, University of Michigan, Ann Arbor, MI.

    Dr. Ruffin is Professor and Assistant Chair for Research, Department of Family Medicine, University of Michigan, Ann Arbor, MI.

    Ms. Rana is Clinical Librarian, Taubman Medical Library, University of Michigan, Ann Arbor, MI.

    ABSTRACT

    Information technology is rapidly advancing and making its way into many primary care settings. The technology may provide the means to increase the delivery of cancer preventive services. The aim of this systematic review is to examine the literature on information technology impacts on the delivery of cancer preventive services in primary care offices. Thirty studies met our selection criteria. Technology interventions studied to date have been limited to some type of reminder to either patients or providers. Patient reminders have been mailed before appointments, mailed unrelated to an appointment, mailed after a missed appointment, or given at the time of an appointment. Telephone call interventions have not used technology to automate the calls. Provider interventions have been primarily computer-generated reminders at the time of an appointment. However, there has been limited use of computer-generated audits, feedback, or report cards. The effectiveness of information technology on increasing cancer screening was modest at best. The full potential of information technology to unload the provider-patient face-to-face encounter has not been examined. There is critical need to study these new technologic approaches to understand the impact and acceptance by providers and patients.

    INTRODUCTION

    In 2000, an estimated 10 million new cancer diagnoses and 6 million cancer deaths occurred in the world. By 2020, the number of new cancers will grow by 15 million and cancer deaths may double.1 Cancer remains a major public health problem in the United States and other developed countries. Currently, one in four deaths in the United States is due to cancer.2 A total of 1,372,910 new cancer cases and 570,280 deaths are expected in the United States in 2005.2 Cancer has surpassed heart disease as the leading cause of death for persons younger than 85 since 1999.2 Cancer death rates decreased for all cancers combined (1.1% per year since 1993) and for many of the top 15 cancers occurring in men and women.3 This measurable minimal decline for overall cancer death rates reflects progress in the prevention, early detection, and treatment of cancer. However, there remains significant opportunity for improvement.

    For many of the top 15 cancers occurring in men and women in the United States, there are primary and secondary preventive service strategies that could significantly reduce the burden. However, primary care clinicians and health care systems face substantial barriers in delivering these preventive services. There have been numerous reviews4–11 on the efficacy of tools to increase delivery of cancer preventive services for primary care clinicians and health care systems as well as summaries of reviews.12 This vast array of data is best summarized in three areas. First, effective interventions to increase preventive services in primary care exist, but there is considerable variation in the level of change achieved. The effect size is usually very small to moderate. Second, tailoring interventions to address specific barriers to change appears to be important. Third, multifaceted interventions may be more effective than a single intervention, but the tools assessed to date have not been adequate in encompassing the complexity of such interventions.

    Information technology is rapidly advancing and making its way into many primary care settings. By "information technology," we mean any equipment, interconnected system, or subsystem of equipment used in the automatic acquisition, storage, manipula-tion, management, movement, control, display, switching, interchange, transmission, or reception of information. Information technology includes computers, ancillary equipment, software, firmware and similar procedures, services (including support services), and related resources. Family physicians using computers for medical practice activities increased from 33% to 45% during the 1980s.13,14 A recent survey of 9,466 internists reported that 82% use computers for personal or professional reasons.15 In professional settings, internists utilized computers to help administratively manage their practice. Internists were less likely to have computers with the functionality to clinically manage their patients.15 In contrast, others have noted that primary care physicians prefer to receive reminders regarding outpatient action items electronically rather than in a paper format.16,17

    Information technology may provide the platform to develop and test new interventions to increase the delivery of cancer preventive services that addresses multiple barriers and aspects of the interaction between clinicians and patients. The aim of this systematic review is to examine the literature on information technology impact on the delivery of cancer preventive services in primary care offices. The literature will be synthesized to direct future research and guide decisions by primary care clinicians with respect to information technology adoption and use in their practice.

    METHODS

    Model

    To provide a theoretical organizing framework for our evaluation of studies, we have adapted the 5A’s framework recommended by the US Preventive Services Task Force.18 Figure 1 illustrates our adapted framework with relevant examples.19 The 5A’s framework provides a helpful structure for understanding where individual technologies intervene and exert their influence on screening behavior.

    [PowerPoint slide for Educational Purposes]

    Study Identification

    The literature search was conducted for English language articles in five databases: MEDLINE (1980 to April 2005), CINAHL (1982 to April 2005); EMBASE (1988 to April 2005), Cochrane Central Register of Controlled Trials (CCRCT, second quarter, 2005), and Science Citation Index (SCI; 1980 to April 2005). The MEDLINE, CINAHL, EMBASE, and CCRCT searches were conducted via the Ovid interface. The majority of the topical search retrieval was obtained via MEDLINE using medical subject headings including: mass screening; medical informatics applications; neoplasms; reminder systems; physician’s practice patterns; and medical record systems, computerized. In addition, limited text word searching was utilized.

    Due to the large volume of literature and the variability of subject indexing among the databases, and for the purpose of organization, six discrete searches were selectively conducted in MEDLINE, CINAHL, and EMBASE. These searches focused on: screening of all information systems in office-based practice and primary care; broad/general search on screening and information systems; prevention and health promotion of cancer; use of the electronic health record and cancer screening/prevention; cancer prevention and physician practice patterns; and cancer screening and reminder systems. Corresponding key word searches with Boolean syntax were conducted in CCRCT and SCI.

    Three evaluators (MJ, DN, and MR) reviewed each of the identified articles independently to determine whether the study was relevant. Publications were rejected for consideration if the article was a review, opinion article, descriptive of a new technology, or was used in a health context not readily available in the United States (eg, follow-up contacts for Pap smears in a health system with the public health system following and contacting women outside of their physician’s office). A number of publications were found that were duplicate reports of a single study or serial reports from the same study. To avoid the undue effect of a single study, the most recent publication was evaluated in more detail. The cited literature referenced in relevant studies were also examined for possible studies.

    Study Classification

    The three evaluators then independently read each publication to classify it in each of the following areas:

    Primary author and year.

    Nature of intervention and comparison group.

    Intervention target (eg, patient, provider, or both).

    Timing of intervention (eg, before, during, or after an appointment).

    Target cancer prevention or control.

    Setting (eg, community or academic).

    Outcome measure and effectiveness of the intervention.

    Opportunistic or periodic prevention.

    Duration of intervention and follow up.

    "Opportunistic" refers to whether the intervention was targeting patient or provider at every possible contact point compared with just intervening at periodic or health maintenance examinations. The evaluators met as a group to review their classifications and discussed any disagreements and arrived at a consensus of opinion for all studies.

    RESULTS

    There were 30 studies identified meeting the criteria outlined above. The characteristics of the identified study are in Table 1. The target cancers have been primary breast, cervical, and colorectal. The studies have been primarily focused on either the patient or provider, with 14 of the studies limited to just providers. In 13 of the studies, the intervention is limited to during the time of the appointment. Half of the studies were conducted in academic or training sites with few of the studies examining implementation of a system across multiple office settings, which limits the generalizability to private practice or community settings. All of the studies have used opportunistic screening; none limited the intervention to periodic or health maintenance appointments. The duration of the interventions were 6 months to 5 years, with the most common being 1 year.

    The intervention and comparison used in each study are in Table 2 along with the effectiveness and effect size. The technology interventions studied to date have been limited to some type of reminder to either patients or providers. The patient reminders have been mailed before appointments, mailed unrelated to an appointment, mailed after a missed appointment, or given at the time of an appointment. There have been telephone calls, but these interventions have not used technology to automate the calls. The provider interventions have been primarily computer-generated reminders at the time of an appointment. There has been limited use of computer-generated audits, feedback, or report cards.27,37,44

    The effectiveness of the information technology on increasing cancer screening was modest at best. There are some limitations in making the comparison across study designs that range from pre- and postdesigns to randomized control trials.

    DISCUSSION

    First, due to the differences in current indexing practices in and among the electronic databases, an exhaustive identification of all published English-language studies on this topic is a complex task. Therefore, we cannot ensure that we have examined all of the published English language works in this area. Second, there are very likely numerous unpublished studies relevant to this area. It remains to be determined if the results of these studies would sway the assessment given that most unpublished studies contain negative findings. Third, the published data lack significant participation of community-based practices. Therefore, the conclusions one can draw may have no validity for community-based physicians. Finally, the limited amount of data published in this area highlight the need for more effort into this critical area of prevention.

    The published research using information technology to increase cancer screening is almost exclusively testing the impact of computer-generated reminders to either the provider or the patient. The delivery of the reminders is almost universally at the time of an appointment, regardless of the reason for the appointment. In addition, there is only so much that providers and patients can attend to during the appointment time, even if you include waiting room and departure time. A unique aspect of information technology is the ability to unload demands on appointment face-to-face time. However, no investigators have pushed into examining the impact of such an approach. There is a critical need to study these new technologic tools that push into areas such as before arriving at the office, in the waiting room, and after the office appointment, as highlighted in Figure 1. There is no need for yet another study of reminder systems unless the investigation examines the impact in community-based offices followed for longer than a year.

    The literature on this topic is somewhat limited, but studies using information technology in other areas of health care provide some guidance. Other health care issues studied include other preventive services, reducing no-show appointments, clinical decision making, chronic disease management, patient education, and risk assessment.50–53 The majority of the work has been on patient or provider point-of-service reminders. As in cancer prevention, the effect is modest. There remains essentially no exploration of information technology into other areas highlighted in Figure 1.

    Despite increasing recognition of the importance of preventive services, such services are not provided in primary care practice as often as recommended. One of the most important reasons is the lack of a systematic, organized approach within practices. The American Cancer Society Ad Hoc Advisory Group on Preventive Health Care Reminder Systems reviewed evidence-based reports and expert opinion to summarize current knowledge about office systems for clinical preventive service in 1996.54 This article describes the process of developing an office system for preventive care, beginning with writing a practice policy, auditing charts for baseline performance, developing and implementing a plan for efficient delivery of preventive care, involving office staff, and monitoring progress. The concepts presented in this report are critical to successfully introducing new information technology into primary care practices.

    Information technology interventions in primary care should be viewed contextually and not just in isolation. Several groups have used the "tools, teamwork, and tenacity" terms to emphasize that successful intervention in busy practices requires more than just tools.55,56 Busy primary care practices need to have functioning communication processes that allow them to prioritize preventive services and incorporate new approaches into their routine operational flow.

    This perspective is further reinforced by applying complexity science models to primary care practice.57,58 Briefly stated, primary care practices are complex, adaptive systems that evolve processes in response to multiple factors, often without being aware of why and how they have arrived at their current processes. Without the ability to reflectively incorporate new innovations and adapt them to their needs, practice innovations frequently result in a temporary change with rapid return to the practice’s previous way of doing things. For practices to be able to effectively implement and sustain technology-based interventions to enhance colorectal cancer screening, they must either already have developed their own functional reflective processes or be assisted in developing these processes.

    Information technology to enhance delivery of preventive services is ever-changing but is most broadly moving from stand-alone systems into modules that are integrated within commercial electronic health record systems (EHRs). Unfortunately, we were unable to find any studies reporting differential outcomes between EHRs and stand-alone systems. In the absence of reported studies, the challenges reported by others in reviewing clinical decision-support systems generalize to EHR-embedded modules as well.50,59 Systems that automatically prompt users, provide specific recommendations rather than assessments, and provide support at the time of decision making are most successful. A longitudinal, qualitative study of decision support also provides further confirmation of these principles.60 It remains to be seen whether EHR modules incorporate these design principles now or in the future.

    One primary care specialty society has placed a high focus on EHRs as a key component of "new model" care.61 With this focus, the specialty society hopes to use technology to improve the delivery of preventive services as well as improve disease management.

    What Should Clinicians Do Now?

    For primary care physicians and their staff, these are challenging times. There is an ever-increasing availability of electronic medical records, which contain a variety of approaches to managing the clinical aspects of one’s practice. The research on information technology and cancer prevention offers very little guidance at this time. There are a few pearls of wisdom from the literature reviewed. Requiring providers to respond to computer-generated reminders improves their compliance with preventive care protocols, especially for elderly patients, who had the lowest control physician compliance.34 Therefore, having the computer just generate a reminder is not sufficient. The reasons for not responding to the reminder include "not applicable" (test done elsewhere, patient too ill, no uterus), "next visit" (physician too busy, patient too ill), and "patient refuses" (test not necessary or too costly, patient too busy or fears result). Gathering this information can guide further evaluation of the practice and enhancements of the system.

    As with most technology, the ability to expand and be flexible will allow the system to better meet the physician’s needs. If a physician’s expectation is to buy a system with a single upfront investment and turn it on, he/she will be wasting their time and effort. To obtain any return on their investment or impact on their practice, a physician has to take a broader, more inclusive approach to group change and not just a single individual’s change. If a physician’s practice is more than 10 years old and has more than three providers, then look back in some of the thicker paper charts. A physician will see various efforts to alter practice patterns. Various flow sheets or paper reminder forms will represent these efforts. They were used by a few individuals within the practice and did not have widespread use or impact. The same could happen to computers if the effort to change does not involve the entire group from the front door to the back door.

    There will also be significant learning curves, which will cost time, money, and patience. These learning curves will keep reoccurring as new changes and updates are made. A physician has to be committed to career-long adaptation and changes. Many health systems and hospitals are developing, purchasing, and implementing various information technologies to improve practice.62 It remains to be determined how much effort primary care providers have put into participating in the decision-making process. If the leaders of the process only hear from the subspecialty, hospital-based providers, then the technology will never meet the needs of primary care providers.

    Gaps and Future Research

    We have limited our search to the role of interactive technology in improving established secondary prevention of cancer in the office setting; thus, this discussion will not address the gaps and future research in primary prevention such as smoking cessation, diet, and exercise. As previously discussed, the reviewed studies have been concentrated in academic practice settings, dealt almost exclusively with patient or physician reminders and prompts, and were short-term. Questions remain as to the long-term effectiveness, feasibility, and generalizability of the interventions. In particular, little empirical data are available on how the practices as organizations changed in response to the implementation of the technological intervention and how this affected the outcome. We know little about the unintended consequences and benefits of these interventions that may affect the practices, such as patient-physician communication and relationship, workflow, and the process of the screening itself (eg, follow up of abnormal screening results).

    Audit and feedback of professional activity have the potential to change practice. Information technology can facilitate audits and feedback. A recent review of the 85 studies suggests the effects are small to moderate. The effect is largest when the baseline adherence to recommended practice is low.9 Similarly, a review of 131 decision-aids studies reported variable effect. The aids improve people’s knowledge of options, create realistic expectations, reduce difficulty in decision making, and increase participation in the process, but the outcomes are only modestly increased in cancer screening. In addition, the resources needed for implementation of most decision aids is beyond those of most community-based primary care providers.10

    A review of interventions to implement prevention in primary care published in 1996 found 55 studies of 2,000 health professional involving 99,000 patients. The reviewers concluded that there was no solid basis for assuming that a particular intervention or package of interventions will work. Effective interventions to increase preventive activities in primary care exist, but there is considerable variation in the level of change achieved, with effect sizes usually small or moderate. Tailoring interventions to address specific barriers to change in a particular setting is probably important. Multifaceted interventions may be more effective than single interventions, because more barriers to change can be addressed.8

    Future research should thus incorporate the following:

    1) To address generalizability, strong consideration should be made to perform the studies in heterogeneous community practice settings, utilizing practice-based research networks.

    2) More emphasis should be placed on assessing the process outcomes, particularly the organizational structure (eg, workflow and personnel role changes) and the nature of the clinical encounters (eg, patient-physician communication, duration of the encounter, type of encounter such as periodic versus opportunistic, and issues addressed during the encounter) affected by the implementation of the interventions.

    3) Long-term effectiveness and viability should be addressed, including cost-effective-ness and cost-benefit analyses.

    4) Approaches other than prompts and reminders should be evaluated. Examples would include tying technology with behavioral interventions, such as tailored messages and decision aids that positively affect informed and shared decision making. The intervention should be founded on a strong theoretical framework.

    5) Various communication channels should be utilized, such as using practice Web sites (which may be personalized for each patient) and e-mails to enhance communication before and after the clinical encounters, computer kiosks in the waiting room, and the utilization of nonclinician staff to perform technology-assisted and enhanced interventions within or outside of the clinical encounters.

    6) The effect of intervention on the process of the screening practice itself should be evaluated. Examples would include gravitation to a particular screening modality (eg, increased incorporation of fecal occult blood tests compared with other colorectal cancer screening modalities) and follow up of abnormal screening results.

    REFERENCES

    Lopez A, Murray C. The Global Burden of Disease: a Comprehensive Assessment of Mortality and Ddisability from Diseases, Injuries, and Risk Factors in 1990 and Projected to 2020. Boston, MA: Harvard University Press; 1996.

    Jemal A, Murray T, Ward E, et al. Cancer statistics, 2005. CA Cancer J Clin 2005; 55: 10–30.

    Jemal A, Clegg LX, Ward E, et al. Annual report to the nation on the status of cancer, 1975-2001, with a special feature regarding survival. Cancer 2004; 101: 3–27.

    Dickey LL, Gemson DH, Carney P. Office system interventions supporting primary care-based health behavior change counseling. Am J Prev Med 1999; 17: 299–308.

    Edwards A, Unigwe S, Elwyn G, Hood K. Effects of communicating individual risks in screening programmes: Cochrane systematic review. BMJ 2003; 327: 703–709.

    Edwards A, Unigwe S, Elwyn G, Hood K. Personalised risk communication for informed decision making about entering screening programs. Cochrane Database Syst Rev 2003: CD001865.

    Glasgow RE, Marcus AC, Bull SS, Wilson KM. Disseminating effective cancer screening interventions. Cancer 2004; 101: 1239–1250.

    Hulscher ME, Wensing M, van Der Weijden T, Grol R. Interventions to implement prevention in primary care. Cochrane Database Syst Rev 2001: CD000362.

    Jamtvedt G, Young JM, Kristoffersen DT, et al. Audit and feedback: effects on professional practice and health care outcomes. Cochrane Database Syst Rev 2003: CD000259.

    O’Connor AM, Stacey D, Entwistle V, et al. Decision aids for people facing health treatment or screening decisions. Cochrane Database Syst Rev 2003: CD001431.

    Stone E, Morton S, Hulscher M, et al. Interventions that increase use of adult immunization and cancer screening services: a meta-analysis. Ann Intern Med 2002; 136: 641–651.

    Zapka J, Lemon S. Interventions for patients, providers, and healthcare organizations. Cancer 2004; 101: 1165–1187.

    Schmittling G. Computer use by family physicians in the United States. J Fam Pract 1984; 19: 93–97.

    Schmittling GT. Computer use by family physicians in the United States. J Fam Pract 1989; 29: 198–200.

    Lacher D. Computer use and needs of internists: a survey of members of the American College of Physicians-American Society of Internal Medicine. Proc AMIA Symp 2000; 453–456.

    Gandhi TK, Sequist TD, Poon EG, et al. Primary care clinician attitudes towards electronic clinical reminders and clinical practice guidelines. AMIA Annu Symp Proc 2003: 848.

    Sequist TD, Gandhi TK, Karson AS, et al. A randomized trial of electronic clinical reminders to improve quality of care for diabetes and coronary artery disease. J Am Med Inform Assoc 2005; 12: 431–437.

    Whitlock E, Orleans T, Pender N, Allan J. Evaluating primary care behavioral counseling interventions: an evidence-based approach. Am J Prev Med 2002; 22: 267–284.

    Glasgow RE, Bull SS, Piette JD, Steiner JF. Interactive behavior change technology. A partial solution to the competing demands of primary care. Am J Prev Med 2004; 27: 80–87.

    Becker DM, Gomez EB, Kaiser DL, et al. Improving preventive care at a medical clinic: how can the patient help? Am J Prev Med 1989; 5: 353–359.

    Burack RC, Gimotty PA, George J, et al. Promoting screening mammography in inner-city settings: a randomized controlled trial of computerized reminders as a component of a program to facilitate mammography. Med Care 1994; 32: 609–624.

    Burack RC, Gimotty PA, George J, et al. The effect of patient and physician reminders on use of screening mammography in a health maintenance organization. Results of a randomized controlled trial. Cancer 1996; 78: 1708–1721.

    Burack RC, Gimotty PA, George J, et al. How reminders given to patients and physicians affected pap smear use in a health maintenance organization: results of a randomized controlled trial. Cancer 1998; 82: 2391–2400.

    Burack RC, Gimotty PA, Simon M, et al. The effect of adding Pap smear information to a mammography reminder system in an HMO: results of randomized controlled trial. Prev Med 2003; 36: 547–554.

    Campbell E, Peterkin D, Abbott R, Rogers J. Encouraging underscreened women to have cervical cancer screening: the effectiveness of a computer strategy. Prev Med 1997; 26: 801–807.

    Chambers CV, Balaban DJ, Carlson BL, et al. Microcomputer-generated reminders. Improving the compliance of primary care physicians with mammography screening guidelines. J Fam Pract 1989; 29: 273–280.

    Fordham D, McPhee SJ, Bird JA, et al. The cancer prevention reminder system. MD Comput 1990; 7: 289–295.

    Frame PS, Zimmer JG, Werth PL, et al. Computer-based vs manual health maintenance tracking. A controlled trial. Arch Fam Med 1994; 3: 581–588.

    Garr DR, Ornstein SM, Jenkins R, Zemp LD. The effect of routine use of computer-generated preventive reminders in a clinical practice. Am J Prev Med 1993; 9: 55–61.

    Goldberg HI, Neighbor WE, Cheadle AD, et al. A controlled time-series trial of clinical reminders: using computerized firm systems to make quality improvement research a routine part of mainstream practice. Health Serv Res 2000; 34: 1519–1534.

    Goldberg D, Schiff GD, McNutt R, et al. Mailings timed to patients’ appointments: a controlled trial of fecal occult blood test cards. Am J Prev Med 2004; 26: 431–435.

    Harris RP, O’Malley ,MS, Fletcher SW, Knight BP. Prompting physicians for preventive procedures: a five-year study of manual and computer reminders. Am J Prev Med 1990; 6: 145–152.

    Landis SE, Hulkower SD, Pierson S. Enhancing adherence with mammography through patient letters and physician prompts. A pilot study. NC Med J 1992; 53: 575–578.

    Litzelman DK, Dittus RS, Miller ME, Tierney WM. Requiring physicians to respond to computerized reminders improves their compliance with preventive care protocols. J Gen Intern Med 1993; 8: 311–317.

    McDonald CJ, Hui SL, Smith DM, et al. Reminders to physicians from an introspective computer medical record. A two-year randomized trial. Ann Intern Med 1984; 100: 130–138.

    McDowell I, Newell C, Rosser W. Computerized reminders to encourage cervical screening in family practice. J Fam Pract 1989; 28: 420–424.

    McPhee SJ, Bird JA, Jenkins CN, Fordham D. Promoting cancer screening. A randomized, controlled trial of three interventions. Arch Intern Med 1989; 149: 1866–1872.

    McPhee SJ, Bird JA, Fordham D, et al. Promoting cancer prevention activities by primary care physicians. Results of a randomized, controlled trial. JAMA 1991; 266: 538–544.

    Murphy DJ, Gross R, Buchanan J. Computerized reminders for five preventive screening tests: generation of patient-specific letters incorporating physician preferences. Proc AMIA Symp 2000: 600–604.

    Nease Jr.,DE, Green ,LA. ClinfoTracker: a generalizable prompting tool for primary care. J Am Board Fam Pract 2003; 16: 115–123.

    Nguyen BH, Nguyen KP, McPhee SJ, et al. Promoting cancer prevention activities among Vietnamese physicians in California. J Cancer Educ 2000; 15: 82–85.

    Ornstein SM, Garr DR, Jenkins RG, et al. Computer-generated physician and patient reminders. Tools to improve population adherence to selected preventive services. J Fam Pract 1991; 32: 82–90.

    Tape TG, Campbell JR. Computerized medical records and preventive health care: success depends on many factors. Am J Med 1993; 94: 619–625.

    Tierney WM, Hui SL, McDonald CJ. Delayed feedback of physician performance versus immediate reminders to perform preventive care. Effects on physician compliance. Med Care 1986; 24: 659–666.

    Turner BJ, Day SC, Borenstein B. A controlled trial to improve delivery of preventive care: physician or patient reminders? J Gen Intern Med 1989; 4: 403–409.

    Turner RC, Peden Jr.JG, O’Brien K. Patient-carried card prompts vs computer-generated prompts to remind private practice physicians to perform health maintenance measures. Arch Intern Med 1994; 154: 1957–1960.

    Weingarten MA, Bazel D, Shannon HS. Computerized protocol for preventive medicine: a controlled self-audit in family practice. Fam Pract 1989; 6: 120–124.

    Williams RB, Boles M, Johnson RE. A patient-initiated system for preventive health care. A randomized trial in community-based pri-mary care practices. Arch Fam Med 1998; 7: 338–345.

    Yarnall KS, Rimer BK, Hynes D, et al. Computerized prompts for cancer screening in a community health center. J Am Board Fam Pract 1998; 11: 96–104.

    Kawamoto K, Houlihan CA, Balas EA, Lobach DF. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ 2005; 330: 765.

    Biem HJ, Turnell RW, D’Arcy ,C. Computer telephony: automated calls for medical care. Clin Invest Med 2003; 26: 259–268.

    Bodenheimer T, Wagner E, Grumbach K. Improving primary care for patients with chronic illness: the chronic care model, Part 2. JAMA 2002; 288: 1909–1914.

    Coulson AS, Glasspool DW, Fox J, Emery J. RAGs: A novel approach to computerized genetic risk assessment and decision support from pedigrees. Methods Inf Med 2001; 40: 315–322.

    Leininger LS, Finn L, Dickey L, et al. An office system for organizing preventive services: a report by the American Cancer Society Advisory Group on Preventive Health Care Reminder Systems. Arch Fam Med 1996; 5: 108–115.

    Carney PA, Dietrich AJ, Keller A, et al. Tools, teamwork, and tenacity: an office system for cancer prevention. J Fam Pract 1992; 35: 388–394.

    Carpiano R, Flocke S, Frank S, Stange K. Tools, teamwork, and tenacity: an examination of family practice office system influences on preventive service delivery. Preventive Medicine 2003; 36: 131–140.

    Miller WL, Crabtree BF, McDaniel R, Stange KC. Understanding change in primary care practice using complexity theory. J Fam Pract 1998; 46: 369–376.

    Miller WL, McDaniel Jr.,RR, Crabtree ,BF, Stange KC. Practice jazz: understanding variation in family practices using complexity science. J Fam Pract 2001; 50: 872–878.

    Garg AX, Adhikari NK, McDonald H, et al. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA 2005; 293: 1223–1238.

    Rousseau N, McColl E, Newton J, et al. Practice based, longitudinal, qualitative interview study of computerised evidence based guidelines in primary care. BMJ 2003; 326: 314.

    Martin JC, Avant RF, Bowman MA, et al. The Future of Family Medicine: a collaborative project of the family medicine community. Ann Fam Med 2004; 2: S3–S32.

    Neil N. Improving rates of screening and prevention by leveraging existing information systems. Jt Comm J Qual Saf 2003; 29: 610–618.(Masahito Jimbo, MD, PhD, )