You are seeing this message because your Web browser does not support basic Web standards. Find out more about why this message is appearing and what you can do to make your experience on this site better.


ABOUT ARCHIVES
Advanced Search

Welcome   | My Account | E-mail Alerts | Access Rights | Sign In


  Vol. 163 No. 1, January 13, 2003 TABLE OF CONTENTS
  Archives
  •  Online Features
  Original Investigation
 This Article
 •Abstract
 •PDF
 •Send to a friend
 • Save in My Folder
 •Save to citation manager
 •Permissions
 Citing Articles
 •Citation map
 •Citing articles on HighWire
 •Citing articles on Web of Science (130)
 •Contact me when this article is cited
 Related Content
 •Related letters
 •Similar articles in this journal
 Topic Collections
 •Patient-Physician Communication
 •Patient Education/ Health Literacy
 •Diabetes Mellitus
 •Alert me on articles by topic
 Social Bookmarking
  Add to CiteULike Add to Connotea Add to Del.icio.us Add to Digg Add to Reddit Add to Technorati Add to Twitter What's this?

Closing the Loop

Physician Communication With Diabetic Patients Who Have Low Health Literacy

Dean Schillinger, MD; John Piette, PhD; Kevin Grumbach, MD; Frances Wang, MS; Clifford Wilson; Carolyn Daher; Krishelle Leong-Grotz; Cesar Castro; Andrew B. Bindman, MD

Arch Intern Med. 2003;163:83-90.

ABSTRACT

Background  Patients recall or comprehend as little as half of what physicians convey during an outpatient encounter. To enhance recall, comprehension, and adherence, it is recommended that physicians elicit patients' comprehension of new concepts and tailor subsequent information, particularly for patients with low functional health literacy. It is not known how frequently physicians apply this interactive educational strategy, or whether it is associated with improved health outcomes.

Methods  We used direct observation to measure the extent to which primary care physicians working in a public hospital assess patient recall and comprehension of new concepts during outpatient encounters, using audiotapes of visits between 38 physicians and 74 English-speaking patients with diabetes mellitus and low functional health literacy. We then examined whether there was an association between physicians' application of this interactive communication strategy and patients' glycemic control using information from clinical and administrative databases.

Results  Physicians assessed recall and comprehension of any new concept in 12 (20%) of 61 visits and for 15 (12%) of 124 new concepts. Patients whose physicians assessed recall or comprehension were more likely to have hemoglobin A1c levels below the mean (<=8.6%) vs patients whose physicians did not (odds ratio, 8.96; 95% confidence interval, 1.1-74.9) (P = .02). After multivariate logistic regression, the 2 variables independently associated with good glycemic control were higher health literacy levels (odds ratio, 3.97; 95% confidence interval, 1.09-14.47) (P = .04) and physicians' application of the interactive communication strategy (odds ratio, 15.15; 95% confidence interval, 2.07-110.78) (P<.01).

Conclusions  Primary care physicians caring for patients with diabetes mellitus and low functional health literacy rarely assessed patient recall or comprehension of new concepts. Overlooking this step in communication reflects a missed opportunity that may have important clinical implications.



INTRODUCTION
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information 
 •References

A teacher, instructor; one who gives instruction in some branch of knowledge, or inculcates opinions or principles.—First entry for "doctor" in the Oxford English Dictionary (1989)

EDUCATING THE patient represents one of the 3 main functions of the medical encounter.1 Numerous studies2-5 have demonstrated that patients recall and comprehend as little as 50% of what they are told by their physicians. An important strategy for improving the effectiveness of physician communication is to ask the patient to restate information or instructions to ensure that they were understood and remembered5-7 or to assess patients' perceptions about key information and/or changes in management that were discussed.8-12 This technique, which we term the interactive communication loop (Figure 1), not only checks for lapses in recall and understanding but also can uncover health beliefs, reinforce and tailor health messages, and activate patients by opening a dialogue.13



View larger version (30K):
[in this window]
[in a new window]
Figure 1. The interactive communication loop in clinician-patient education. Only by assessing recall and comprehension can the clinician ensure that a key concept has been understood and remembered. Not uncommonly, a patient responds to an initial assessment by demonstrating poor recall, lack of understanding, or health beliefs that may interfere with integration of the concept. The clinician should then repeat, clarify, or tailor subsequent information. To ensure recall and comprehension of this tailored explanation, the clinician should reassess the patient's recall and comprehension until a common understanding has been achieved. Recall and comprehension have been shown to be predictive of subsequent adherence.11


Patients with low levels of functional health literacy (FHL) are especially likely to have difficulty recalling and comprehending medical information. Functional health literacy is a measure of a person's capacity to function in the health care setting as determined by literacy (comprehension of written health care materials) and numeracy (ability to understand and act on numerical health care instructions).14 Patients with low FHL levels may experience problems including reading labels on a pill bottle, interpreting blood glucose values or dosing schedules, comprehending appointment slips and educational brochures, and conceptualizing risk. Patients with low FHL have greater difficulties naming their medications and describing their indications,15 and more frequently hold health beliefs that may interfere with adherence.16 They also may have difficulties processing oral communication.17-18

Low FHL is common in public hospital settings and among Medicare-insured populations,19 and is independently associated with poor understanding of disease,20-21 worse health status,22-24 and higher use of services.25-26

Ensuring recall and comprehension may be especially important for patients with low FHL and chronic health conditions such as diabetes mellitus, because these patients typically must cope with complex treatment regimens, manage visits to multiple clinicians, monitor themselves for changes in health status, and initiate positive health behaviors. We used direct observation techniques to study the communication patterns of primary care physicians and their patients with type 2 diabetes mellitus and low FHL. We measured the extent to which these physicians assess patients' recall and comprehension of information and advice conveyed during outpatient medical encounters. We then examined whether use of the interactive communication loop was associated with better glycemic control.


METHODS
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information 
 •References

SETTING AND STUDY PARTICIPANTS

The study took place in 2 primary care clinics (a family practice and a general internal medicine clinic) at San Francisco General Hospital, the public hospital of the city and county of San Francisco. The clinics serve ethnically diverse and low-income patients. More than 90% of patients with type 2 diabetes mellitus at San Francisco General Hospital are cared for in a continuity fashion by University of California, San Francisco, faculty and resident primary care physicians.

The study was nested in a larger study whose aim is to examine the relationship between FHL and diabetes mellitus outcomes.24 Potential subjects were identified by querying the hospital system's computerized clinical and administrative database. Patients were eligible if they had type 2 diabetes mellitus (International Classification of Diseases, Ninth Revision, [ICD-9] and spoke English or Spanish fluently. Participants had to have a primary care physician in one of the clinics for at least 12 months and had to have visited this physician within the prior 6 months. To further ensure that patients had an established relationship with their physicians and that their physicians' communication behaviors would have had time to affect health outcomes, only patients of physicians who were senior residents or attending faculty were included. We excluded patients with any documented diagnosis of end-stage renal disease, psychotic disorder, dementia, or blindness (conditions that may interfere with accurate FHL measurement). We also provided primary care physicians with their list of eligible patients generated from the database and asked them to indicate patients meeting criteria for exclusion for an upcoming study of diabetes mellitus care at San Francisco General Hospital.

Between May 22, 2000, and December 19, 2000, all eligible patients were approached by research assistants in the waiting rooms before their clinic appointments and asked to participate in a study of diabetes mellitus care and for permission to audiotape an upcoming medical encounter. Patients were assured that the decision to participate would not affect their care and that the audiotaping could be stopped at any time during the encounter. Patients were offered $5 for their participation. Written and/or verbal consent to participate was obtained from patients before enrollment and from physicians before the study. The protocol was approved by the Human Subjects Committee of the University of California, San Francisco.

Patients who agreed to participate first had their visual acuity tested using a pocket vision screener (Rosenbaum, Granham-Field Surgical Co Inc, New York, NY); patients with a corrected visual acuity of 20/50 or worse were excluded. Patients were then administered a brief questionnaire to obtain demographic information and an abbreviated version of the Test of Functional Health Literacy in Adults, short form (s-TOFHLA) (14-point font),27 a reliable and validated instrument used to assess a patient's FHL level.28 The s-TOFHLA is a 36-item timed reading comprehension test that uses the modified cloze procedure; every fifth to seventh word in a passage is omitted, and 4 multiple choice options are provided. It contains 2 health care passages, the first selected from instructions for preparation for an upper gastrointestinal tract radiograph series (Gunning-Fog Index readability grade, 4.3) and the second from the patient's "Rights and Responsibilities" section of a Medicaid application (Gunning-Fog Index readability grade, 10.4).

By using established convention, we considered patients to have low FHL if their s-TOFHLA score was between 0 and 22 on a scale of 0 to 36. Only English-speaking patients with low FHL (s-TOFHLA score <23) were eligible for audiotaping. We then audiotaped an outpatient encounter between the patients and their physicians. Most audiotaped encounters (50 [68%] of 74) occurred immediately after the patient's enrollment, and the remainder took place during the next scheduled visit with the physician.

CODING AND ANALYSIS

Consistent with prior research,29-30 we chose a coding system designed to identify particular physician speech-related behaviors. Each audiotaped encounter was coded to identify new concepts conveyed by the physician and follow-up assessments used by the physician to assess recall and comprehension of the new concept. The duration of each encounter was also recorded.

A physician's statement was coded as a new concept if it related to a new piece of health information or advice for the patient or a significant change in management regarding the patient's medical condition. According to our protocol (coding manual available on request), new concepts were treated as critical events, such that we grouped statements into as few overarching concepts as possible. For example, the following physician statement contained a new health message and was coded as one new concept.

Physician: "It's important for you to understand that high blood pressure, especially when it is combined with your diabetes, can really damage your kidneys."

The following physician statements communicated a change in medical management or medical advice, and each was coded as a separate new concept.

Physician: "I'm going to increase your metformin to 3 times a day."

Physician: "I really think you should cut down on high-cholesterol foods."

Because of the importance of recall and comprehension on subsequent medication adherence,3, 11 we classified new concepts as medication-related changes in management or non–medication-related.

A physician's statement was coded as a follow-up assessment if it made reference to a new concept and met one of the following criteria: (1) it assessed the patient's recall and understanding by explicitly asking the patient to restate the new concept or (2) it elicited the patient's perceptions regarding the new concept. As with new concepts, follow-up assessments were treated as critical events; multiple queries that referred to a single new concept were counted as one follow-up assessment. The following discussion illustrates an attempt to assess patient recall and comprehension of a new concept (a change in management).

Physician: "So . . . let's make sure. What medications are we going to change?"

Patient: "I think we're going to stop this one (is it metformin?) . . . and I'm going to take glipizide twice a day. . . . I think that's the green one."

In the following example, after discussing hyperglycemia, the physician performed a follow-up assessment of this new concept by assessing the patient's perceptions regarding hyperglycemia.

Physician: "Do you know the symptoms of high blood sugar? Tell me."

Patient: "Dizzy, I think . . . . I'm not sure."

Two research assistants (C.W. and C.C.) coded the audiotapes. One (C.W.) coded all of the audiotapes in their entirety, then double coded a 15% sample so that we could assess intrarater reliability; the second research assistant (C.C.) coded an additional 15% of the sample to assess intercoder reliability. Differences in coding were reconciled at regular investigator meetings. The research assistants were unaware of patients' hemoglobin A1c (HbA1c) values at coding. To calculate reliability, we used the {kappa} score. The intrarater reliability was 0.72 for identifying new concepts and 0.85 for identifying follow-up assessments. The intercoder reliability was 0.82 for new concepts and 0.63 for follow-up assessments.

To measure the extent to which physicians applied the interactive communication strategy, we calculated the percentage of visits in which at least one follow-up assessment occurred and the percentage of all new concepts with a corresponding follow-up assessment. To estimate patients' recall and comprehension, we examined the concordance between their response and the content of a physician's prior instructions or advice on those occasions on which the physician assessed recall or comprehension of a new concept.

To examine whether the interactive communication technique was associated with improved glycemic control, we used data from visits during which at least one new concept was conveyed by the physician. We dichotomized visits into those with at least one follow-up assessment and those with no follow-up assessments. Glycemic control was obtained from the clinical database using the HbA1c value before the visit. We classified patients as having good vs poor glycemic control depending on whether their most recent HbA1c value was below or above the mean for the sample as a whole (ie, <=8.6% vs >8.6%). Logistic regression was used to assess the independent effect of physicians' use of the interactive communication strategy on patients' glycemic control, adjusting for potential patient confounders (age, sex, race or ethnicity, s-TOFHLA score, number of years with diabetes mellitus, insulin use, and number of new concepts conveyed) and physician confounders (sex, level of training, and specialty [eg, family practitioner vs general internist]). Because of the small sample size, we included variables that were significantly associated with HbA1c level at P<.25 in the bivariate analysis. To ensure that we did not exclude other potentially important variables, we added others in one at a time to explore their individual impact, and included those that appreciably altered the results. Standard errors were adjusted for the clustering of patients within physician using generalized estimating equations.31 In sensitivity analyses, we examined alternative cut points for HbA1c level, such as the median of the sample distribution.


RESULTS
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information 
 •References

Eight hundred fifty-eight patients were identified by the San Francisco General Hospital clinical database as potentially eligible for the larger cross-sectional study. One hundred forty-two patients were subsequently deemed ineligible by their noted primary care physician (Figure 2). Of the 716 remaining eligible patients, 250 did not make a primary care visit during the enrollment period. All of the remaining 466 patients were approached at a clinic appointment. Of these patients, 36 refused to participate. Four hundred thirty patients were recruited; 22 patients were subsequently excluded because they were too ill to participate, were intoxicated, had poor visual acuity (20/50 or worse), or had no HbA1cvalue on record. Four hundred eight patients completed the s-TOFHLA and the questionnaire. Of these patients, 105 were eligible for audiotaping by virtue of being English-speaking and having low FHL. Thirty encounters could not be audiotaped because the patient refused to be taped at the visit, the patient's physician refused to be taped, or the visit was not with the primary care physician (Figure 2). We audiotaped 75 outpatient encounters, of which 1 had to be eliminated because the tape was not clearly audible. The remaining 74 audiotapes represented visits between 74 patients and 38 physicians. Physicians were paired with as few as 1 and as many as 5 study patients (mean, 1.9).



View larger version (90K):
[in this window]
[in a new window]
Figure 2. Flow of study participants. FHL indicates functional health literacy; HbA1c, hemoglobin A1c.


The median s-TOFHLA score of audiotaped patients was 12, which roughly corresponds to a grade 4 to 6 reading level. On average, patients were aged 64 years, 36 (49%) were men, 63 (85%) were nonwhite, and 27 (36%) used insulin; the median time with diabetes mellitus was 8 years. The mean HbA1c value was 8.6%, and the median HbA1c value was 8.3%. Of the 74 patients, 28 (38%) received their primary care from a faculty-level physician, 40 (54%) from a female physician, and 58 (78%) from a general internist.

During audiotaped visits, physicians conveyed a total of 124 new concepts, with at least 1 new concept conveyed in 61 (82%) of 74 visits. Among these 61 visits, physicians conveyed a mean of 2 new concepts, more than half of which (56%) involved a medication change, such as the introduction of a new medication, the discontinuation of an established medication, or a change in the dosage or frequency of a medication.

Physicians assessed recall or comprehension at least once in 12 (20%) of the 61 visits that included a new concept. These follow-up assessments were distributed among 10 physicians and 12 patients. The mean number of follow-up assessments was 0.25 (range, 0-2). The visit duration did not significantly differ between visits that included at least one follow-up assessment and visits that did not include a follow-up assessment (20.3 vs 22.1 minutes; P = .50).

Physicians assessed patient recall or comprehension for 15 (12%) of the 124 new concepts presented. New concepts that involved changes in medication regimen were not significantly more likely to have a follow-up assessment than non–medication-related new concepts (13% [9/69] vs 11% [6/55]; P = .70).

Figure 3 illustrates the extent to which patients recalled and understood the information provided by their physicians, and the degree to which physicians tailored subsequent information and reassessed patients' comprehension in the event that the patient did not understand. When asked by physicians to restate or interpret new concepts, patients responded incorrectly 47% of the time (7 of 15 new concepts) (eg, failing to recall, misinterpreting the new concept, or stating health beliefs that could interfere with the integration of the information). In all 7 instances, the physician provided further tailored information, but in none did the physician perform a second follow-up assessment to ensure a common understanding. Overall, for only 8 (6%) of 124 new concepts could the physician be assured that the patient recalled or comprehended the new information and/or advice.



View larger version (30K):
[in this window]
[in a new window]
Figure 3. Failure to close the interactive educational loop in physician-patient communication. Among the 124 new concepts that were conveyed, physicians assessed recall or comprehension for 15. Of these 15 concepts, patients failed to recall or comprehend 7 (47%). Physicians provided further explanations for each of these 7 concepts, but did not reassess to ensure a common understanding for any of these 7 tailored explanations. For only 8 (6%) of the 124 new concepts could the physician be assured that the patient recalled or comprehended the information and advice conveyed during the medical encounter.


Eleven (92%) of 12 patients whose physicians assessed their recall or comprehension at least once had a HbA1c value of 8.6% or less compared with 27 (55%) of 49 patients whose physicians did not assess recall or comprehension (odds ratio, 8.96, 95% confidence interval, 1.1-74.9; P = .02). None of the other patient or physician variables was significantly associated with glycemic control in bivariate analyses (P<.05) (Table 1). After multivariate logistic regression, accounting for the clustering of patients within physicians (Table 1), the 2 variables independently associated with good glycemic control were s-TOFHLA score greater than 12 (odds ratio, 3.97, 95% confidence interval, 1.09-14.47; P = .04) and physicians' application of the interactive communication strategy (odds ratio, 15.15, 95% confidence interval, 2.07-110.78; P<.01). Use of the median HbA1c value of the sample as the cut point (8.3%) did not appreciably alter these results. We found no interaction between patients' FHL level and physicians' application of the interactive communication strategy in the prediction of patients' glycemic control.


View this table:
[in this window]
[in a new window]
Patient and Physician Variables, Stratified by Glycemic Control and Odds of Good Glycemic Control*


The elapsed time between HbA1c determination and audiotaped visit was no different between patients whose physicians assessed recall and comprehension and patients whose physicians did not (122 vs 123 days; P = .90). Moreover, the interval between patients' HbA1c determination and their audiotaped visit was unrelated to the HbA1c value.

In an attempt to examine whether improved glycemic control was attributable to the application of the interactive strategy or to a more participatory or patient-centered communication style in general, we repeated our analysis using the physician as the unit of analysis, categorizing physicians into those who ever assessed recall and comprehension (n = 10) vs those who never did (n = 26). (Two physicians did not convey new concepts, and thus are not included.) The adjusted odds of having good glycemic control among patients of physicians who ever used interactive communication vs those who never did was 2.7 (95% confidence interval, 0.92-7.66) (P = .07).


COMMENT
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information 
 •References

Our study attempts to measure the extent to which physicians assess patients' recall and understanding of information conveyed during an outpatient encounter, and examines the association of this communication strategy with patient outcomes. Primary care physicians caring for patients with low FHL and diabetes mellitus assessed patients' recall and comprehension in only 1 of 5 visits and for fewer than 1 of 8 new concepts. In addition, the rare physician who did assess the patient's comprehension never completely closed the loop for patients who demonstrated lack of understanding, by failing to reassess recall and comprehension of the tailored explanation to ensure a common understanding (Figure 3).

Most new concepts conveyed during the encounters involved a change in the patient's medication regimen. Despite the importance of medication adherence in diabetes mellitus care,32 physicians in our study ensured comprehension of medication changes only 13% of the time.

We found that the physician's assessment of recall and comprehension was associated with improved glycemic control among patients with diabetes mellitus and low FHL. While patients with the lowest FHL levels were more likely to have poor glycemic control, interactive communication was associated with good glycemic control regardless of the severity of the FHL problem.

Despite major advances in diabetes mellitus treatment,33-34 outcomes vary significantly across racial, ethnic, and sociodemographic lines.35-38 The prevalence of low FHL, especially among elderly persons, ethnic minorities, and the socioeconomically disadvantaged, coupled with the disproportionate burden that type 2 diabetes mellitus places on such individuals,39 suggests that problems with health communication may contribute to disparities. The infrequency and inconsistency of the application of the interactive educational strategy in our study represent a missed opportunity to improve physician-patient communication in the care of patients with communication barriers. Poor recall and comprehension are likely to be common among patients with low FHL. Low FHL seems to be a marker for an array of communication and information processing problems that extend beyond reading ability.2, 40-41 The consequences of poor recall and comprehension may be particularly detrimental for patients with low FHL, because they may not have the resources or skills to compensate for lapses in communication.20-21

Our finding that interactive communication was associated with improved glycemic control is consistent with prior research in physician-patient communication. Patients whose physicians asked them to restate the main concepts at the end of the encounter were more likely to retain the information than patients who received usual care.5 A randomized controlled trial42 of patient-directed communication skills training that included the promotion of information-verifying behavior by patients demonstrated that trained patients were more likely to be adherent with medications, behavioral treatments, and follow-up appointments than untrained patients. Increased information giving on the part of the physician and increased involvement on the part of the patient are associated with improved functional and physiologic status among diabetic patients.43 These studies and others44-45 provide insights into the potential benefits of targeting interventions to patients and physicians for improving retention and integration of key concepts in the clinical encounter. Such strategies may be particularly beneficial for populations with low FHL and chronic diseases, because health outcomes for these patients may be particularly sensitive to improvements in communication.46-47

There may be several reasons why physicians underused the interactive educational strategy. Most physicians have not received training about how to maximize teaching efforts48 and tend to underestimate patients' information needs and overestimate their own effectiveness in conveying information.44 Physicians may also avoid explicitly assessing patients' recall and comprehension for fear of opening a Pandora's box and of needing to spend more time with the patient. However, we found that encounters that included an assessment of patients' recall or comprehension were not longer than those that did not.

Our study has several limitations. First, the design of our study calls for caution in making causal inferences. Because we used patients' most recent HbA1c level as an indicator of their glycemic control rather than a test value obtained after the observed visit, we cannot rule out the possibility that physicians' communication was affected by their patients' most recent HbA1c results. While studies49-52 have demonstrated that physicians' communication style indeed is sensitive to the health status of their patients, physicians caring for healthier patients tend to engage in more social talk, whereas physicians caring for sicker patients engage in more questioning, information giving, facilitation, and partnership building. As such, it is unlikely that the application of the interactive communication strategy that we observed was simply an artifact of patients' improved glycemic control.

Second, we cannot exclude the possibility that unmeasured patient-related determinants of glycemic control, such as depression or social support, or physician-associated variables, such as affect, could have confounded our results. The timing of the HbA1c determination relative to the index visit also raises concerns about the confounding influence of time on HbA1c value. However, we found no relationship between the interval of HbA1c determination to index visit and the HbA1c value.

Third, because of the few physicians and patients in our sample, and the infrequency and inconsistency with which physicians assessed recall and comprehension, we were unable to ascertain whether improved glycemic control was directly attributable to the application of the interactive strategy or to a more participatory or patient-centered communication style in general.49-51 When we repeated our analysis using the physician as the unit of analysis, the strength of the association between interactive communication and glycemic control was attenuated, and of marginal statistical significance. While these results could be interpreted as confirming our findings that interactive communication, in specific, is associated with improved glycemic control, they also suggest that there still may be unmeasured physician characteristics for which interactive communication is simply a marker or that interactive communication is but one element of a more participatory style. Larger prospective studies would be needed to definitively answer this question.

Fourth, while our study demonstrated an association between interactive communication and glycemic control, the small sample size limited our ability to accurately quantify the strength of this association. Finally, because we chose to study English-speaking patients with low FHL cared for at a public hospital's clinics, our findings may not be generalizable to patients who have adequate FHL, do not speak English, or receive their care in different settings.

In conclusion, we found that primary care physicians caring for ethnically diverse patients with type 2 diabetes mellitus and low FHL in a public hospital rarely assessed patient recall or comprehension of new concepts conveyed during an outpatient encounter. Application of this technique can improve communication by providing an opportunity for patients to acknowledge gaps in understanding; by eliciting patients' feedback, perceptions, and questions; and by enabling education tailored to the unique needs of the patient.7, 12, 53 Patients whose physicians used this interactive communication strategy were more likely to have had better glycemic control regardless of the severity of their FHL limitations. Overlooking this critical step in the communication process reflects a missed opportunity to enhance patient care, particularly for this vulnerable population. Future studies should evaluate whether more consistent application of this communication technique improves patient recall, adherence, and health outcomes and, if so, how more clinicians can incorporate it into their communication with patients.


AUTHOR INFORMATION 
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information 
 •References

Corresponding author: Dean Schillinger, MD, Primary Care Research Center, San Francisco General Hospital, 995 Potrero Ave, Bldg 90, Ward 95, San Francisco, CA 94110 (e-mail: dean{at}itsa.ucsf.edu).

Accepted for publication May 6, 2002.

This study was supported by the Hellman Family Early Career Research Award from the University of California, San Francisco; the Health Literacy Research Award from Pfizer Inc, New York, NY; grants PO1HS/10856 and R18HS10281-01 from the Agency for Healthcare Research and Quality, Rockville, Md; the General Clinical Research Center, San Francisco General Hospital, University of California, San Francisco, and grant 5M01-RR00084-30 from the National Institutes of Health, National Center for Research Resources, Bethesda, Md.

We thank the patients and physicians at San Francisco General Hospital for allowing us to observe and study their clinical interactions.

From the Primary Care Research Center (Drs Schillinger, Grumbach, and Bindman, Mss Wang, Daher, and Leong-Grotz, and Messrs Wilson and Castro), the Department of Medicine (Drs Schillinger and Bindman), and the Department of Family and Community Medicine (Dr Grumbach), University of California, San Francisco; San Francisco General Hospital, San Francisco, Calif (Drs Schillinger, Grumbach, and Bindman, Mss Wang, Daher, and Leong-Grotz, and Messrs Wilson and Castro); VA Palo Alto Health Care System, Palo Alto, Calif (Dr Piette); and Department of Health Research and Social Policy, Stanford University School of Medicine, Stanford, Calif (Dr Piette). Dr Piette is now with the Center for Practice Management and Outcomes Research, VA Ann Arbor Healthcare System, and the University of Michigan Medical School, Ann Arbor.


REFERENCES
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information 
 •References

1. Lipkin M, Putnam SM, Lazare A. Three functions of the medical interview. In: The Medical Interview: Clinical Care, Education, and Research. New York, NY: Springer-Verlag NY Inc; 1995:3-19.
2. Roter DL. The outpatient medical encounter and elderly patients. Clin Geriatr Med. 2000;16:95-107. FULL TEXT | ISI | PUBMED
3. Rost K, Roter D. Predictors of recall of medication regimens and recommendations for lifestyle change in elderly patients. Gerontologist. 1987;27:510-515. ISI | PUBMED
4. Crane JA. Patient comprehension of doctor-patient communication on discharge from the emergency department. J Emerg Med. 1997;15:1-7. FULL TEXT | PUBMED
5. Bertakis KD. The communication of information from physician to patient: a method for increasing patient retention and satisfaction. J Fam Pract. 1977;5:217-222. ISI | PUBMED
6. Schwartzberg J. Health Literacy Introductory Kit. Chicago, Ill: American Medical Association; 2000.
7. Doak CC, Doak LG, Friedell GH, Meade CD. Improving comprehension for cancer patients with low literacy skills: strategies for clinicians. CA Cancer J Clin. 1998;48:151-162. ABSTRACT
8. Legg England S, Evans J. Patients' choices and perceptions after an invitation to participate in treatment decisions. Soc Sci Med. 1992;34:1217-1225.
9. Ong LM, de Haes JC, Hoos AM, Lammes FB. Doctor-patient communication: a review of the literature. Soc Sci Med. 1995;40:903-918.
10. Tuckett DA, Boulton M, Olson C. A new approach to the measurement of patients' understanding of what they are told in medical consultations. J Health Soc Behav. 1985;26:27-38. FULL TEXT | ISI | PUBMED
11. Ley P. Communicating With Patients: Improving Communication, Satisfaction, and Compliance. New York, NY: Croom Helm; 1988.
12. Osborne H. Communicating with people who have difficulty reading. In: Overcoming Communication Barriers in Patient Education. Gaithersburg, Md: Aspen Publishers Inc; 2001:1-12.
13. Greenfield S, Kaplan SH, Ware JE Jr, Yano EM, Frank HJ. Patients' participation in medical care: effects on blood sugar control and quality of life in diabetes. J Gen Intern Med. 1988;3:448-457. ISI | PUBMED
14. Ad Hoc Committee on Health Literacy for the Council on Scientific Affairs, American Medical Association. Health literacy: report of the Council on Scientific Affairs. JAMA. 1999;281:552-557. FREE FULL TEXT
15. Williams MV, Parker RM, Baker DW, Coates W, Nurss J. The impact of inadequate functional health literacy on patients' understanding of diagnosis, prescribed medications, and compliance [abstract]. Acad Emerg Med. 1995;2:386.
16. Kalichman SC, Ramachandran B, Catz S. Adherence to combination antiretroviral therapies in HIV patients of low health literacy. J Gen Intern Med. 1999;14:267-273. FULL TEXT | ISI | PUBMED
17. Doak CC, Doak LG, Root JH. Teaching Patients With Low Literacy Skills. Philadelphia, Pa: JB Lippincott; 1996.
18. Mayeaux EJ Jr, Murphy PW, Arnold C, Davis TC, Jackson RH, Sentell T. Improving patient education for patients with low literacy skills. Am Fam Physician. 1996;53:205-211. ISI | PUBMED
19. Gazmararian JA, Baker DW, Williams MV, et al. Health literacy among Medicare enrollees in a managed care organization. JAMA. 1999;281:545-551. FREE FULL TEXT
20. Williams MV, Baker DW, Parker RM, Nurss JR. Relationship of functional health literacy to patients' knowledge of their chronic disease: a study of patients with hypertension and diabetes. Arch Intern Med. 1998;158:166-172. FREE FULL TEXT
21. Williams MV, Baker DW, Honig EG, Lee TM, Nowlan A. Inadequate literacy is a barrier to asthma knowledge and self-care. Chest. 1998;114:1008-1015. FREE FULL TEXT
22. Kalichman SC, Rompa D. Functional health literacy is associated with health status and health-related knowledge in people living with HIV-AIDS. J Acquir Immune Defic Syndr. 2000;25:337-344.
23. Weiss BD, Hart G, McGee DL, D'Estelle S. Health status of illiterate adults: relation between literacy and health status among persons with low literacy skills. J Am Board Fam Pract. 1992;5:257-264.
24. Schillinger D, Grumbach K, Wang F, et al. Association of health literacy with diabetes outcomes. JAMA. 2002;288:475-482. FREE FULL TEXT
25. Baker DW, Parker RM, Williams MV, Clark WS. Health literacy and the risk of hospital admission. J Gen Intern Med. 1998;13:791-798. FULL TEXT | ISI | PUBMED
26. Baker DW, Parker RM, Williams MV, Clark WS, Nurss J. The relationship of patient reading ability to self-reported health and use of health services. Am J Public Health. 1997;87:1027-1030. FREE FULL TEXT
27. Baker DW, Williams MV, Parker RM, Gazmararian JA, Nurss J. Development of a brief test to measure functional health literacy. Patient Educ Couns. 1999;38:33-42. FULL TEXT | ISI | PUBMED
28. Parker RM, Baker DW, Williams MV, Nurss JR. The Test of Functional Health Literacy in Adults: a new instrument for measuring patients' literacy skills. J Gen Intern Med. 1995;10:537-541. ISI | PUBMED
29. Stiles W, Putnam S. Coding categories for investigating medical interviews: a metaclassification. In: Lipkin M, Putnam SM, Lazare A, eds. The Medical Interview: Clinical Care, Education, and Research. New York, NY: Springer-Verlag NY Inc; 1995:489-494.
30. Levinson W, Gorawara-Bhat R, Lamb J. A study of patient clues and physician responses in primary care and surgical settings. JAMA. 2000;284:1021-1027. FREE FULL TEXT
31. Burton P, Gurrin L, Sly P. Extending the simple linear regression model to account for correlated responses: an introduction to generalized estimating equations and multi-level mixed modelling. Stat Med. 1998;17:1261-1291. FULL TEXT | ISI | PUBMED
32. Kravitz RL, Hays RD, Sherbourne CD, et al. Recall of recommendations and adherence to advice among patients with chronic medical conditions. Arch Intern Med. 1993;153:1869-1878. FREE FULL TEXT
33. The Diabetes Control and Complications Trial Research Group. Lifetime benefits and costs of intensive therapy as practiced in the diabetes control and complications trial. JAMA. 1996;276:1409-1415. [published correction appears in JAMA. 1997;278:25].
34. UK Prospective Diabetes Study (UKPDS) Group. Intensive blood-glucose control with sulphonylureas or insulin compared with conventional treatment and risk of complications in patients with type 2 diabetes (UKPDS 33). Lancet. 1998;352:837-853. FULL TEXT | ISI | PUBMED
35. Harris MI. Racial and ethnic differences in health care access and health outcomes for adults with type 2 diabetes. Diabetes Care. 2001;24:454-459. FREE FULL TEXT
36. Vinicor F, Burton B, Foster B, Eastman R. Healthy People 2010: diabetes. Diabetes Care. 2000;23:853-855. FREE FULL TEXT
37. Centers for Disease Control and Prevention. National diabetes fact sheet: general information and national estimates on diabetes in the United States, 2000. Available at: http://www.cdc.gov/diabetes/pubs/factsheet.htm. Accessed October 26, 2001.
38. Fiscella K, Franks P, Gold MR, Clancy CM. Inequality in quality: addressing socioeconomic, racial, and ethnic disparities in health care. JAMA. 2000;283:2579-2584. FREE FULL TEXT
39. Harris MI, Eastman RC, Cowie CC, Flegal KM, Eberhardt MS. Racial and ethnic differences in glycemic control of adults with type 2 diabetes. Diabetes Care. 1999;22:403-408. ABSTRACT
40. Gomez R, Condon M. Central auditory processing ability in children with ADHD with and without learning disabilities. J Learn Disabil. 1999;32:150-158.
41. LeVine RA, Dexter E, Velasco P, et al. Maternal literacy and health care in three countries: a preliminary report. Health Transit Rev. 1994;4:186-191. PUBMED
42. Cegala DJ, Marinelli T, Post D. The effects of patient communication skills training on compliance. Arch Fam Med. 2000;9:57-64. FREE FULL TEXT
43. Kaplan SH, Greenfield S, Ware JE Jr. Assessing the effects of physician-patient interactions on the outcomes of chronic disease. Med Care. 1989;27(suppl):S110-S127. [published correction appears in Med Care. 1989;27:679]. FULL TEXT
44. Cegala DJ. A study of doctors' and patients' communication during a primary care consultation: implications for communication training. J Health Commun. 1997;2:169-194. FULL TEXT | ISI | PUBMED
45. McMahon SR, Rimsza ME, Bay RC. Parents can dose liquid medication accurately. Pediatrics. 1997;100:330-333. FREE FULL TEXT
46. Roter DL, Hall JA, Merisca R, Nordstrom B, Cretin D, Svarstad B. Effectiveness of interventions to improve patient compliance: a meta-analysis. Med Care. 1998;36:1138-1161. FULL TEXT | ISI | PUBMED
47. Funnell MM, Anderson RM. MSJAMA: the problem with compliance in diabetes. JAMA. 2000;284:1709. FREE FULL TEXT
48. AAMC Medical School Objectives Project: report III: communication in medicine [Association of American Medical Colleges Web Site]. Available at: http://www.aamc.org/meded/msop/msop3.pdf. Accessed February 12, 2001.
49. Stewart MA. What is a successful doctor-patient interview? a study of interactions and outcomes. Soc Sci Med. 1984;19:167-175.
50. Kinmonth AL, Woodcock A, Griffin S, Spiegal N, Campbell MJ for the Diabetes Care From Diagnosis Research Team. Randomised controlled trial of patient centred care of diabetes in general practice: impact on current wellbeing and future disease risk. BMJ. 1998;317:1202-1208. FREE FULL TEXT
51. Roter DL, Stewart M, Putnam SM, Lipkin M Jr, Stiles W, Inui TS. Communication patterns of primary care physicians. JAMA. 1997;277:350-356. FREE FULL TEXT
52. Hall JA, Roter DL, Milburn MA, Daltroy LH. Patients' health as a predictor of physician and patient behavior in medical visits: a synthesis of four studies. Med Care. 1996;34:1205-1218. FULL TEXT | ISI | PUBMED
53. Brown JB, Weston W, Stewart MA. Patient-centered interviewing: part II: finding common ground. Can Fam Physician. 1989;35:153-157. ISI


Add to CiteULike CiteULike   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati   Add to Twitter Twitter     What's this?

RELATED LETTERS

Who Actually Has the "Low Health Literacy"?
Joseph McCormick and Rajeev Jain
Arch Intern Med. 2003;163(14):1745-1746.
EXTRACT | FULL TEXT  

Who Actually Has the "Low Health Literacy"?—Reply
Dean Schillinger, Clifford Wilson, and Andrew Bindman
Arch Intern Med. 2003;163(14):1746.
EXTRACT | FULL TEXT  


THIS ARTICLE HAS BEEN CITED BY OTHER ARTICLES

Literacy and Learning in Health Care
Wolf et al.
Pediatrics 2009;124:S275-S281.
ABSTRACT | FULL TEXT  

Pediatricians and Health Literacy: Descriptive Results From a National Survey
Turner et al.
Pediatrics 2009;124:S299-S305.
ABSTRACT | FULL TEXT  

Health Literacy and Quality: Focus on Chronic Illness Care and Patient Safety
Rothman et al.
Pediatrics 2009;124:S315-S326.
ABSTRACT | FULL TEXT  

Health Literacy and Children: Recommendations for Action
Abrams et al.
Pediatrics 2009;124:S327-S331.
FULL TEXT  

A comparison of in-person home care, home care with telephone contact and home care with telemonitoring for disease management
Bowles et al.
J Telemed Telecare 2009;15:344-350.
ABSTRACT | FULL TEXT  

Psychometric Properties of a New Scale to Assess Family Violence in Older African American Women: The Family Violence Against Older Women (FVOW) Scale
Paranjape et al.
Violence Against Women 2009;15:1213-1226.
ABSTRACT  

Globalization, immigration and diabetes self-management: an empirical study amongst immigrants with type 2 diabetes mellitus in Ireland
Thabit et al.
QJM 2009;102:713-720.
ABSTRACT | FULL TEXT  

Brief Report: Parent's Health Literacy among High-Risk Adolescents with Insulin Dependent Diabetes
Janisse et al.
J Pediatr Psychol 2009;0:jsp077v1-jsp077.
ABSTRACT | FULL TEXT  

Health Care Disparities and Diabetes Care: Practical Considerations for Primary Care Providers
White et al.
Clin. Diabetes 2009;27:105-112.
ABSTRACT | FULL TEXT  

Palliative Care for Latino Patients and Their Families: Whenever We Prayed, She Wept
Smith et al.
JAMA 2009;301:1047-1057.
ABSTRACT | FULL TEXT  

The Diabetes Literacy and Numeracy Education Toolkit (DLNET): Materials to Facilitate Diabetes Education and Management in Patients With Low Literacy and Numeracy Skills
Wolff et al.
The Diabetes Educator 2009;35:233-245.
ABSTRACT | FULL TEXT  

Health Literacy: Communication Strategies to Improve Patient Comprehension of Cardiovascular Health
Oates and Paasche-Orlow
Circulation 2009;119:1049-1051.
FULL TEXT  

An Investigation of the Relationship Between Health Literacy and Social Communication Skills in Older Adults
Hester
Communication Disorders Quarterly 2009;30:112-119.
ABSTRACT  

Screening Questions to Predict Limited Health Literacy: A Cross-Sectional Study of Patients With Diabetes Mellitus
Jeppesen et al.
Ann Fam Med 2009;7:24-31.
ABSTRACT | FULL TEXT  

National Standards for Diabetes Self-Management Education
Funnell et al.
Diabetes Care 2009;32:S87-S94.
FULL TEXT  

Taking tablets for chronic illness: where next?
Farmer
Chronic Illness 2008;4:235-238.
 

Seeing in 3-D: Examining the Reach of Diabetes Self-Management Support Strategies in a Public Health Care System
Schillinger et al.
Health Educ Behav 2008;35:664-682.
ABSTRACT  

So Much to Do, So Little Time: Care for the Socially Disadvantaged and the 15-Minute Visit
Fiscella and Epstein
Arch Intern Med 2008;168:1843-1852.
ABSTRACT | FULL TEXT  

Comprehending Care in a Medical Home: A Usual Source of Care and Patient Perceptions about Healthcare Communication
DeVoe et al.
J Am Board Fam Med 2008;21:441-450.
ABSTRACT | FULL TEXT  

Health information for patients: time to look beyond patient information leaflets
Colledge et al.
JRSM 2008;101:447-453.
FULL TEXT  

Randomized Controlled Trial of a Pictogram-Based Intervention to Reduce Liquid Medication Dosing Errors and Improve Adherence Among Caregivers of Young Children
Yin et al.
Arch Pediatr Adolesc Med 2008;162:814-822.
ABSTRACT | FULL TEXT  

Because one shoe doesn't fit all: A repertoire of doctor-patient relationships
Lussier and Richard
cfp 2008;54:1089-1092.
FULL TEXT  

En l'absence de panacee universelle: Repertoire des relations medecin-patient
Lussier and Richard
cfp 2008;54:1096-1099.
FULL TEXT  

Functional Health Literacy in Patients With Glaucoma in Urban Settings
Juzych et al.
Arch Ophthalmol 2008;126:718-724.
ABSTRACT | FULL TEXT  

The implications of health literacy on patient-provider communication
Hironaka and Paasche-Orlow
Arch. Dis. Child. 2008;93:428-432.
ABSTRACT | FULL TEXT  

Coordinating Care -- A Perilous Journey through the Health Care System
Bodenheimer
NEJM 2008;358:1064-1071.
FULL TEXT  

Educational Disparities in Rates of Smoking Among Diabetic Adults: The Translating Research Into Action for Diabetes Study
Karter et al.
AJPH 2008;98:365-370.
ABSTRACT | FULL TEXT  

Patients Prefer the Method of "Tell Back- Collaborative Inquiry" to Assess Understanding of Medical Information
Kemp et al.
J Am Board Fam Med 2008;21:24-30.
ABSTRACT | FULL TEXT  

National Standards for Diabetes Self-Management Education
Funnell et al.
Diabetes Care 2008;31:S97-S104.
FULL TEXT  

Does Physician Communication Influence Older Patients' Diabetes Self-Management and Glycemic Control? Results From the Health and Retirement Study (HRS)
Heisler et al.
Journals of Gerontology Series A: Biological Sciences and Medical Sciences 2007;62:1435-1442.
ABSTRACT | FULL TEXT  

Coordinating Care: A Major (Unreimbursed) Task of Primary Care
Bodenheimer
ANN INTERN MED 2007;147:730-731.
FULL TEXT  

A 63-Year-Old Man With Multiple Cardiovascular Risk Factors and Poor Adherence to Treatment Plans
Bodenheimer
JAMA 2007;298:2048-2055.
ABSTRACT | FULL TEXT  

Impact of Primary Care Patient Visits on Racial and Ethnic Disparities in Preventive Care in the United States
Fiscella and Holt
J Am Board Fam Med 2007;20:587-597.
ABSTRACT | FULL TEXT  

Rethinking Health Numeracy: A Multidisciplinary Literature Review
Ancker and Kaufman
J. Am. Med. Inform. Assoc. 2007;14:713-721.
ABSTRACT | FULL TEXT  

The Contributing Role of Health-Care Communication to Health Disparities for Minority Patients With Asthma
Diette and Rand
Chest 2007;132:802S-809S.
ABSTRACT | FULL TEXT  

Behavioral Medicine Review: Strategic Management of Diabetes Risk
Terre
AMERICAN JOURNAL OF LIFESTYLE MEDICINE 2007;1:351-355.
ABSTRACT  

The Teamlet Model of Primary Care
Bodenheimer and Laing
Ann Fam Med 2007;5:457-461.
ABSTRACT | FULL TEXT  

National Standards for Diabetes Self-Management Education
Funnell et al.
The Diabetes Educator 2007;33:599-614.
FULL TEXT  

A Shared Decision-Making Primary Care Intervention for Type 2 Diabetes
Corser et al.
The Diabetes Educator 2007;33:700-708.
ABSTRACT | FULL TEXT  

National Standards for Diabetes Self-Management Education
Funnell et al.
Diabetes Care 2007;30:1630-1637.
FULL TEXT  

The Underuse of Screening Services Among Elderly Women With Diabetes
McBean and Yu
Diabetes Care 2007;30:1466-1472.
ABSTRACT | FULL TEXT  

Effect of Content and Format of Prescription Drug Labels on Readability, Understanding, and Medication Use: A Systematic Review
Shrank et al.
The Annals of Pharmacotherapy 2007;41:783-801.
ABSTRACT | FULL TEXT  

Overcoming Lifelong Habits: Making Medical Nutrition Therapy and Physical Activity Work for All Patients
Maryniuk
The Diabetes Educator 2007;33:82S-86S.
FULL TEXT  

Toward Shared Decision Making at the End of Life in Intensive Care Units: Opportunities for Improvement
White et al.
Arch Intern Med 2007;167:461-467.
ABSTRACT | FULL TEXT  

Misunderstanding Prescription Labels: The Genie Is Out of the Bottle
Schillinger
ANN INTERN MED 2006;145:926-928.
FULL TEXT  

Literacy and Misunderstanding Prescription Drug Labels
Davis et al.
ANN INTERN MED 2006;145:887-894.
ABSTRACT | FULL TEXT  

Navigating the Terrain between Research and Practice: A Collaborative Research Network (CRN) Case Study in Diabetes Research
Handley et al.
J Am Board Fam Med 2006;19:85-92.
ABSTRACT | FULL TEXT  

Patient adherence with COPD therapy
Rand
ERR 2005;14:97-101.
ABSTRACT | FULL TEXT  

Managing Abnormal Blood Lipids: A Collaborative Approach
Fletcher et al.
Circulation 2005;112:3184-3209.
ABSTRACT | FULL TEXT  

Tailored Education May Reduce Health Literacy Disparities in Asthma Self-Management
Paasche-Orlow et al.
Am. J. Respir. Crit. Care Med. 2005;172:980-986.
ABSTRACT | FULL TEXT  

Make Sure Your Patient Gets It
Brown and Baker
DOC News 2005;2:20-21.
FULL TEXT  

Patient-Provider Communication and Self-care Behavior Among Type 2 Diabetes Patients
Aikens et al.
The Diabetes Educator 2005;31:681-690.
ABSTRACT | FULL TEXT  

Identifying and Assisting Low-Literacy Patients with Medication Use: A Survey of Community Pharmacies
Praska et al.
The Annals of Pharmacotherapy 2005;39:1441-1445.
ABSTRACT | FULL TEXT  

Promoting Health Literacy
McCray
J. Am. Med. Inform. Assoc. 2005;12:152-163.
ABSTRACT | FULL TEXT  

Better systems, not guidelines, for glucose monitoring
Roach
BMJ 2004;329:E332-E332.
FULL TEXT  

Influence of Patient Literacy on the Effectiveness of a Primary Care-Based Diabetes Disease Management Program
Rothman et al.
JAMA 2004;292:1711-1716.
ABSTRACT | FULL TEXT  

Disparities in Diabetes Management Practice Between Racial and Ethnic Groups in the United States
Thackeray et al.
The Diabetes Educator 2004;30:665-675.
 

The Relationship Between Literacy and Glycemic Control in a Diabetes Disease-Management Program
Rothman et al.
The Diabetes Educator 2004;30:263-273.
 

Problems Paying Out-of-Pocket Medication Costs Among Older Adults With Diabetes
Piette et al.
Diabetes Care 2004;27:384-391.
ABSTRACT | FULL TEXT  

The Crucial Link between Literacy and Health
Wilson
ANN INTERN MED 2003;139:875-878.
FULL TEXT  

Functional Health Literacy and Medication Use: the Pharmacist's Role
Youmans and Schillinger
The Annals of Pharmacotherapy 2003;37:1726-1729.
FULL TEXT  

Who Actually Has the "Low Health Literacy"?--Reply
Schillinger et al.
Arch Intern Med 2003;163:1746-1746.
FULL TEXT  

Who Actually Has the "Low Health Literacy"?
McCormick and Jain
Arch Intern Med 2003;163:1745-1746.
FULL TEXT  

Information recall by patients
Chow
JRSM 2003;96:370-370.
FULL TEXT  





HOME | CURRENT ISSUE | PAST ISSUES | TOPIC COLLECTIONS | CME | SUBMIT | SUBSCRIBE | HELP
CONDITIONS OF USE | PRIVACY POLICY | CONTACT US | SITE MAP
 
© 2003 American Medical Association. All Rights Reserved.