Abstract
OBJECTIVES: An American Medical Association survey reported that more than half of physicians are subjects of either clinical or economic profiling. This multilevel meta-analysis was designed to assess the clinical effect of peer-comparison feedback intervention (profiles) in changing practice patterns.
METHODS: Systematic computerized and manual searches were combined to retrieve articles on randomized controlled clinical trials testing profiling reports. Eligible studies were randomized, controlled clinical trials that tested peer-comparison feedback intervention and measured utilization of clinical procedures. To use all available information, data were abstracted and analyzed on three levels: (1) direction of effects, (2)p value from the statistical comparison, and (3) odds ratio (OR).
MAIN RESULTS: In the 12 eligible trials, 553 physicians were profiled. The test result wasp<.05 for the vote-counting sign test of 12 studies (level 1) andp<.05 for the z-transformation test of 8 studies (level 2). There were 5 trials included in the OR analysis (level 3). The primary effect variable in two of the 5 trials had a nonsignificant OR. However, the overall OR calculated by the Mantel-Haenszel method was significant (1.091, confidence interval: 1.045 to 1.136).
CONCLUSIONS: Profiling has a statistically significant, but minimal effect on the utilization of clinical procedures. The results of this study indicate a need for controlled clinical evaluations before subjecting large numbers of physicians to utilization management interventions.
Similar content being viewed by others
References
Roos NP, Wennberg JE, McPhearson K. Using diagnosis related groups for studying variations in hospital admissions. Health Care Financing Rev. 1988;9(4):53–62.
Eddy DM. Variations in physician practice: the role of uncertainty. Health Aff. 1984;3(2):74–89.
Avorn J, Soumerai SB, Everitt DE, et al. A randomized trial of a program to reduce the use of psychoactive drugs in nursing homes. N Engl J Med. 1992;327:168–73.
Clementz GL, Aldag JC, Gladfelter TT, Barclay AM, Brooks HF. A randomized study of cancer screening in a family practice setting using a recall model. J Fam Pract. 1990;30:537–41.
Spencer DC, Balas EA, Nashelsky JE. Information management. In: Taylor RB, ed. Family Medicine: Principles and Practice. 4th ed. New York, NY: Springer-Verlag; 1993.
Lomas J, Enkin M, Anderson GM, Hannah WJ, Vayda E, Singer J. Opinion leaders vs. audit and feedback to implement practice guidelines. JAMA. 1991;265:2202–7.
Keller RB, Chapin AM, Soule DN. Informed inquiry into practice variations: The Maine Medical Assessment Foundation. Qual Assur Health Care. 1990;2:69–75.
Slomski AJ. Cut costs and improve care too? Med Econ. March 1990:48–53.
Emmons DW, Wozniak GD. Profiles and feedback: who measures physician performance? In: Gonzalez ML, ed. Socioeconomic Characteristics of Medical Practice, 1994. Chicago, Ill: American Medical Association; 1994.
Williams SV, Eisenberg JM. A controlled trial to decrease the unnecessary use of diagnostic tests. J Gen Intern Med. 1986;1:8–13.
Parrino TA. The nonvalue of retrospective peer comparison feedback in containing hospital antibiotic costs. Am J Med. 1989;86:442–8.
Eisenberg JM, Williams SV, Garner L, Viale R, Smits H. Computer-based audit to detect and correct overutilization of laboratory tests. Med Care. 1977;15(11):915–21.
Marton KI, Tul V, Sox HC. Modifying test-ordering behavior in the outpatient medical clinic: a controlled trial of two educational interventions. Arch Intern Med. 1985;145:816–21.
Reid RA, Hodges AG, Drucker RP. Utilization of computerized medical data system to assess and improve patient appointment keeping. In: Wist AO, ed. Proceedings of the First Annual Symposium on Computer Applications in Medical Care. New York, NY: Institute of Electrical and Electronic Engineers; 1977:194–8.
Wones RG. Failure of low-cost audits with feedback to reduce laboratory test utilization. Med Care. 1987;25:78–82.
Steele MA, Bess DT, Franse VL, Graber SE. Cost effectiveness of two interventions for reducing outpatient prescribing costs. DICP Ann Pharmacother. 1989;23:497–500.
Sacks HS, Berrier J, Reitman D, Ancona-Berk VA, Chalmers TC. Meta-analysis of randomized controlled trials. N Engl J Med. 1987;316:450–5.
Davis DA, Thomson MA, Oxman AD, Haynes RB. Evidence for the effectiveness of CME: a review of 50 randomized controlled trials. JAMA. 1992;268(9):1111–7.
Haynes RB, Walker CJ. Computer-aided quality assurance: a critical appraisal. Arch Intern Med. 1987;147:1297–1301.
Grimshaw JM, Russell IT. Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations. Lancet. 1993;342:1317–22.
Balas EA, Austin SM, Brown GD, Mitchell JA. Quality evaluation of controlled information service trials. In: Safran C, ed. Proceedings of the Seventeenth Annual Symposium on Computer Applications in Medical Care. New York, NY: McGraw-Hill; 1994;586–90.
Balas EA, Austin SM, Ewigman BG, Brown GD, Mitchell JA. Methods of randomized controlled clinical trials in health services research. Med Care. 1995;33(7):687–99.
Whiting-O’Keefe QE, Henke C, Simborg DW. Choosing the correct unit of analysis in medical care experiments. Med Care. 1984;22(12):1101–4.
Bushman BJ. Vote-counting procedures in meta-analysis. In: Cooper H, Hedges LV, eds. The Handbook of Research Synthesis. New York, NY: Russell Sage Foundation; 1994:193–214.
Hedges LV, Cooper H, Bushman BJ. Testing the null hypothesis in meta-analysis: a comparison of combined probability and confidence interval procedures. Psychol Bull. 1992;111(1):118–94.
Yusuf S, Peto R, Lewis J, Collins R, Sleight P. Beta blockade during and after myocardial infarction: an overview of the randomized trials. Prog Cardiovasc Dis. 1985;27:335–71.
Breslow NE, Day NE. Statistical Methods in Cancer Research: The Analysis of Case-Control Studies. Lyon, France: International Agency for Research on Cancer; 1980.
Rosenthal R. The “File Drawer Problem” and tolerance for null results. Psychol Bull. 1979;86(3):638–41.
Berwick DM, Coltin KL. Feedback reduces test use in a health maintenance organization. JAMA. 1986;255:1450–4.
Bird JA, McPhee SJ, Jenkins C, Fordham D. Three strategies to promote cancer screening. How feasible is wide-scale implementation? Med Care. 1990;28:1005–12.
Fordham D, McPhee SJ, Bird JA, Rodnick JE, Detmer WM. The cancer prevention reminder system. MD Comput. 1990;7:289–95.
Frazier LM, Brown JT, Divine GW, et al. Can physician education lower the cost of prescription drugs? A prospective controlled trial. Ann Intern Med. 1991;115:116–21.
Gama R, Nightingale PG, Broughton PMG, et al. Feedback of laboratory usage and cost data to clinicians: does it alter requesting behavior? Ann Clin Biochem. 1991;28:143–9.
Hershey CO, Goldberg HI, Cohen DI. The effect of computerized feedback coupled with a newsletter upon outpatient prescribing charges. Med Care. 1988;26:88–93.
Lassen LC, Kristensen FB. Peer comparison feedback to achieve rational and economical drug therapy in general practice: a controlled intervention study. Scand J Prim Health Care. 1992;10:76–80.
McPhee SJ, Bird JA, Jenkins C, Fordham D. Promoting cancer screening: a randomized controlled trial of three interventions. Arch Intern Med. 1989;149:1866–72.
Pugh JA, Frazier LM, DeLong E, Wallace AG, Ellenbogen P, Linfors E. Effect of a daily charge feedback on inpatient charges and physician knowledge and behavior. Arch Intern Med. 1989;149:426–9.
Reid RA, Lantz KH. Physician profiles in training the graduate internist. J Med Educ. 1977;52:301–7.
Winickoff RN, Coltin KL, Morgan MM, Buxbaum RC, Barnett GO. Improving physician performance through peer comparison feedback. Med Care. 1984;22(6):527–34.
Winickoff RN, Wilner S, Neisuler R, Barnett GO. Limitations of provider interventions in hypertension quality assurance. Am J Public Health. 1985;75(1):43–6.
Freeman R. Intrapartum fetal monitoring: a disappointing story. N Engl J Med. 1990;322:624–6.
Duffy SQ, Farley DE. The protracted demise of medical technology: the case of intermittent positive pressure breathing. Med Care. 1992;30(8):718–36.
Deming WE. Quality, Productivity, and Competitive Position. Cambridge, Mass: MIT Center for Advanced Engineering Study; 1982.
Deming WE. Out of the Crisis. Cambridge, Mass: MIT Center for Advanced Engineering Study; 1986.
Berwick DM. Continuous improvement as an ideal in health care. N Engl J Med. 1989;320(1):53–6.
Soumerai SB, Avorn J. Principles of education outreach (“academic detailing”) to improve clinical decision making. JAMA. 1990;263(4):549–56.
Austin SM, Balas EA, Mitchell JA, Ewigman BG. Effect of physician reminders on preventive care: meta-analysis of randomized clinical trials. JAMIA. 1994;(symposium suppl): 121–4.
Banks NJ, Palmer RH, Kane NM, Braun P, Feldstein ML, Harrington AM. Implementation and evaluation of a computerized reminder system in ambulatory care. In: Greenes RA, ed. Proceedings of the Annual Symposium on Computer Applications in Medical Care; 1988;12:753–7.
Porter D. Patient responses to computer counseling. Orthner FH, ed. In: Proceedings of the Annual Symposium on Computer Applications in Medical Care; 1978;2:233–7.
Spencer DC, Balas EA, Nashelsky JE. Information management. In: Taylor RB, ed. Family Medicine: Principles and Practice. 4th ed. New York, NY: Springer Verlag; 1994.
Author information
Authors and Affiliations
Additional information
Supported in part by the Agency for Health Care Policy and Research grant HS07715 and in part by National Library of Medicine grant LM05545.
Rights and permissions
About this article
Cite this article
Balas, E.A., Boren, S.A., Brown, G.D. et al. Effect of physician profiling on utilization. J Gen Intern Med 11, 584–590 (1996). https://doi.org/10.1007/BF02599025
Issue Date:
DOI: https://doi.org/10.1007/BF02599025