INTRODUCTION

Medicare Advantage, which encompasses more than one-quarter of Medicare beneficiaries and attracts an increasing share of new beneficiaries,1,2 relies on informed consumer cost-benefit decisions for its success as a market-based insurance model. The Centers for Medicare & Medicaid Services (CMS) publishes the Medicare Plan Finder website to provide beneficiaries with information about plan benefits, premiums, out-of-pocket costs, and star ratings reflecting quality to enable plan comparisons.3 Assigned on a 1-to-5 star scale, the star ratings incorporate more than 50 measures across several dimensions of quality: process-based quality via Healthcare Effectiveness Data and Information Set (HEDIS) measures, satisfaction via the Consumer Assessment of Healthcare Providers and Systems (CAHPS) surveys, health outcomes via the Health Outcomes Survey, and administrative quality via customer service, complaints and appeals.4 The star ratings have garnered attention from insurers and policymakers, owing to Affordable Care Act provisions and CMS policies providing bonuses for higher-rated plans via increased rebate percentages and year-long open enrollment periods for 5-star plans as of 2012.

Yet, reports suggest that beneficiaries’ use of the Plan Finder website and star ratings may be limited, due to challenges in accessing and interpreting the information there.5,6 Absent actionable plan information, choices may be informed by brand recognition, word of mouth, or other sources.79 When information is available, interpreting numerous complex options is challenging;1015 beneficiaries may not be equipped to weigh the worth of attributes, including quality.

Public reporting of plan benefits, costs, and quality in this large national program provides a unique opportunity to assess plan preferences though actual enrollments. Studies in the commercial market demonstrate associations between preferences and plans’ costs, benefits, and quality,7,16 and prior work demonstrates associations between Medicare Advantage star ratings and enrollment.17 However, the relative importance of cost and quality in Medicare Advantage choices is unknown.

In this study, we assess variation in Medicare Advantage enrollment decisions attributable to cost, quality, and market share and willingness to pay for quality.

METHODS

Study Design

We performed a beneficiary-level, cross-sectional analysis of Medicare Advantage and Prescription Drug (MAPD) plan choices for beneficiaries enrolling in Medicare Advantage for the first time in 2011. This was the first year of the combined overall star rating for MAPD plans incorporating both health and drug plan quality, and it preceded CMS policies beginning in 2012 that paid plans bonuses based on star ratings and provided year-long open enrollment for 5-star plans, which could confound associations between star ratings and enrollment. We focused on new enrollees to eliminate the influence of prior Medicare Advantage exposure. Employing a discrete choice approach, we assessed the proportion of enrollment variation explained by plan attributes and willingness to pay for quality.

Matching beneficiaries with their choice set of plans based on their county and capitalizing upon variation in plan attributes within and across choice sets, our design accounts for the Medicare Advantage market’s structure. Sponsoring organizations (e.g., Aetna, Humana) offer CMS contracts for specific coverage types (e.g., HMO, PPO) and geographic service areas varying from a single county to many counties or states. A contract includes one or more plans of differing cost-sharing and benefits. Beneficiaries in a given county select one plan from a common choice set containing plans from multiple sponsoring organizations and contracts of varying geographic breadth and overlap. Because star ratings are assigned at the contract-level, a single rating applies to all plans therein, across the entire service area. In 2011, three MAPD contracts received 5 stars and some contracts were unrated because they were too new or small to provide the requisite data.

Data

Data was derived from CMS’s Integrated Data Repository (enrollment and demographic data),18 CMS’s Health Plan Management System (premiums, benefits, out-of-pocket costs, and service areas),19 and public files (star ratings).20

Inclusion Criteria

We included all 2011 non-employer-sponsored MAPD enrollments for beneficiaries without prior Medicare Advantage enrollments with a United States address corresponding to a choice set with two or more MAPD contracts. We included only MAPD plans, because these represent the vast majority of Medicare Advantage enrollments, as opposed to plans without prescription coverage. Because costs would differ, we excluded beneficiaries deemed eligible for the low-income subsidy (N = 105,283; 11 %). To ensure accurate matching of beneficiaries with choice sets, we excluded beneficiaries with addresses that could not be definitively mapped to one county, out-of-service-area enrollment approvals, or enrolled plans whose service area excluded their address. To ensure a common choice set in each market, we excluded Special Needs, PACE, and employer plans. We excluded cost plans because their structure and coverage differ from Medicare Advantage plans, many had limitations on new enrollment, and none received overall star ratings in 2011.

Beneficiary-Level and Plan- Level Covariates

We accounted for beneficiary age, gender, race/ethnicity21 and urban versus rural residence.

We accounted for plan attributes from the Plan Finder website and the local market contributing to choices:16,22,23 costs, quality, benefits, and market share. Costs were represented as shown on the Plan Finder by health and drug plan premiums (i.e., Part B, C, and D Premiums, less any rebates) and average estimated combined Part C and D out-of-pocket costs. Quality was represented via the overall combined Part C and D star rating. Benefits were represented via categorical variables for coverage-type (HMO, HMO-POS, Private Fee-for-Service, Local PPO, or Regional PPO); maximum copayments or coinsurance for in-network primary care, specialist, and outpatient visits; Part C and D deductibles; and dental, vision, hearing, and prescription gap coverage. Sponsoring organization market share was represented via the percentage of Medicare Advantage enrollments (excluding PACE and employer plans) in December 2010 in each county for plans of a given sponsoring organization (i.e., the recognizable brand of a Medicare Advantage plan). Because a sponsoring organization may have more than one contract and plan in a service area, star ratings, premiums, and benefits may vary for a given sponsoring organization within a market. Analysis of plans attributes’ correlation was not concerning for multicollinearity (Appendix).

Regression Analyses

We used conditional logistic regression to assess associations between plan attributes and enrollment. Our data included all possible pairings of each beneficiary and each plan available in their choice set, from which each beneficiary enrolled in exactly one plan. Our outcome variable was 1 for the plan chosen and 0 for all others in choice set. Because willingness to pay for an increase in star rating may vary at different rating-levels, our model included the star rating itself, its quadratic transform, and an unrated plan indicator.

The conditional logit model estimates preferences based on the plans available in each beneficiary’s actual choice set, accounting for variation in choices-set size and in the attributes of plans therein. The model’s likelihood function is estimated on the basis of differences in attributes between pairwise sets of plans in each beneficiary’s choice set; that is, a beneficiary’s choice between plans only contributes to parameter estimates for a given plan attribute to the extent that the attribute varies between those plans. For example, if two plans in a choice set had the same contract and star rating, then a beneficiary’s choice between the two does not contribute to estimates for star ratings, but does contribute for other attributes (i.e., costs, benefits) on which the plans differ. Further, those plans may ultimately contribute to estimates for star ratings to the extent that ratings of other plans in the choice set differ.

Proportion of Variation Explained

To estimate the fraction of the overall variation in enrollment decisions explained by all the plan attributes in our model, we calculated a pseudo-R2. To assess plan attributes’ individual contributions to that explained variation in enrollment, we used the model parameter estimates to calculate the percentage of variance explained by covariate categories (premiums, out-of-pocket costs, quality, market share, and all other benefits in the model) relative to the cumulative variance explained by all the covariates in the model.

Willingness to Pay

We assessed marginal willingness to pay for quality— how much a beneficiary would pay for an increase in star rating to the next rating level—using the results of our conditional logit model (i.e., the ratio between the derivative of the choice probability with respect to star rating and the derivative of the choice probability with respect to cost). We assessed cumulative willingness to pay for a plan at each star rating-level by sequentially adding marginal willingness to pay for each increase in rating to the willingness to pay for an unrated plan. We used the total annual combined premiums and out-of-pocket costs to estimate willingness to pay via a single value encompassing both premiums and benefit generosity.

To estimate differential willingness to pay by beneficiary characteristics, we interacted beneficiary attributes (age, sex, race/ethnicity, rural/urban residence) with quality and cost in separate models. Because the conditional logit model estimates preferences for plan attributes based on variations within each beneficiary’s actual choice set, the willingness to pay estimated for each subgroup reflects the actual choices faced by that subgroup, and does not assume even distribution of plan attributes across subgroups.

RESULTS

Beneficiaries and Plans Included

After inclusion criteria, 847,069 enrollees comprised the study population. Choice sets varied in size and content, on average including 16.5 plans, of which 13.1 received a star rating and 2.1 were rated 4 stars or higher (Table 1). While some plans in these choice sets shared a common contract, and consequently a common star rating, more than 90 % of beneficiaries’ choice sets contained more than half as many contracts as plans and nearly 20 % contained more than three-quarters as many contracts as plans.

Table 1. Characteristics of First-Time Medicare Advantage Enrollees

Plans with higher star ratings, lower premiums, mid-range out-of-pocket costs, no drug deductible, and PPO coverage-types were more represented among enrolled plans than among all plans available across choice sets (Table 2).

Table 2. Characteristics of Plans Available Across Choice Sets and Actual Enrolled Plans

Enrollment Decision Variation

Our model accounts for 18.7 % of the overall variation in enrollment decisions, as assessed via a Psuedo-R2. Relative to the variation in enrollment decisions explained by our model, a plan’s sponsoring organization market share accounted for the largest fraction (35.3 %). Cost-related variables accounted for the next largest fractions (health and drug plan premiums 25.7 % and average estimated out-of-pocket costs 11.6 %) and star ratings for 13.6 % (Fig. 1).

Figure 1.
figure 1

Proportion of explained variation in first-time medicare advantage enrollees’ enrollments attributable to plan attributes.

Willingness to Pay for Quality

Beneficiaries were willing to pay more for higher-rated plans. Mean willingness to pay in total annual combined premiums and out-of-pocket costs varied from $4,154.93 for 2.5-star plans to $5,698.66 for 5-star plans (Table 3). Increases in willingness to pay diminished at higher ratings; the marginal increase in willingness to pay for an additional 0.5 stars varied from $549.27 (95 %CI $541.10 to $557.44) to go from a 2.5 to a 3-star plan to $68.22 (95 %CI $61.44 to $75.01) to go from a 4.5 to a 5-star plan. Compared to other ages, beneficiaries aged 64–65 years were more willing to pay for higher-rated plans (Fig. 2, Appendix). Black and rural beneficiaries were less willing to pay for higher-rated plans.

Table 3. Beneficiaries’ Estimated Willingness to Pay and Marginal Willingness to Pay in Annual Combined Health and Drug Plan Premiums and Out-of-Pocket Costs for Star Ratings
Figure 2.
figure 2

Beneficiary willingness to pay in annual combined health and drug plan premiums and out-of-pocket costs for star ratings, by subgroup.

Sensitivity Analyses

We performed several sensitivity analyses. Because estimated out-of-pocket costs may not resonate with beneficiaries, we estimated willingness to pay with premiums alone; the results were qualitatively similar. Because willingness to pay may differ for disabled versus aged beneficiaries, we repeated our analysis excluding beneficiaries younger than 64; the results did not substantively differ from our primary analysis. To assess whether modelling star ratings parametrically obscured features of beneficiary’s preferences, we assessed willingness to pay using a categorical star rating variable; while willingness to pay for a plan at a given rating-level varied, the overall pattern was qualitatively similar. Lastly, because HMOs tend to have higher star ratings but narrower provider networks that could influence willingness to pay relative to other coverage-types, we estimated willingness to pay for the HMO subset by interacting cost and quality variables with HMO versus other coverage-types; the results were similar to our primary analysis (Appendix).

DISCUSSION

We found Medicare Advantage enrollment decisions to be informed by tradeoffs between cost and quality and local market dynamics. Our model explains nearly one-fifth of the overall variation in choices. Sponsoring organization, or brand, market share accounts for the largest portion of the variation, and out-of-pocket costs and premiums together explained nearly three times the variation of star ratings. Beneficiaries were willing to pay more for a higher-rated plan, but increases in willingness to pay grew less steep at higher ratings and varied among subgroups.

Our findings represent cross-sectional associations, not causal relationships; we cannot know whether unobserved factors correlated with plan attributes were responsible for choices. Market share’s considerable contribution could reflect Medicare Advantage market consolidation or preferences for unmeasured attributes correlated with market share: trusted brands, word-of-mouth, or provider networks.1,5,8,2325 Quality, favorable provider networks, and choices are likely related; access to broad networks and preferred providers has been shown to influence plan choices.5,7,26 Market share and quality could also be interrelated, as larger contracts tend to have higher star ratings.27

Concordant with prior research, we observed associations between enrollment and plan cost and quality. Our model explains 18.7 % of the variation in plan choice, in line with other large observational studies, and suggests that while observable factors contribute to choices, much of what underlies individual preferences cannot be captured (e.g., provider networks, patient-provider relationships, health status, prior insurance experience, and market idiosyncrasies). Ultimately, in an efficient marketplace, price and quality would be more principal drivers of consumer choices than brand market power.

The diminishing marginal utility for quality among beneficiaries choosing Medicare Advantage plans may reflect the narrower range of options and preponderance of HMO plans at the highest ratings compared to mid-level ratings; as such, the best-rated plan may not always represent the best or most appealing choice for all beneficiaries. Alternatively, it may represent a stronger preference against the lowest-rated rather than for the highest-rated plans. This pattern may support subsequent CMS policies providing year-long open enrollment for 5-star plans and bonuses to highly-rated plans, if the resulting more generous benefits and greater opportunity to enroll attracts more beneficiaries to highly rated plans.

Lesser willingness to pay among rural and black beneficiaries could signify lesser awareness of star ratings or uncaptured priorities (i.e., geographically convenient or historically trusted providers in networks, respectively). Differences in willingness to pay for quality among minorities relative to white beneficiaries (greater for Hispanic beneficiaries and lesser for black beneficiaries) could reflect targeted marketing or historical enrollment patterns, given the disproportionate minority enrollment observed in some plans.28 Greater willingness to pay for quality among beneficiaries aged 64–65 years, who represent the first of the baby boomers aging into Medicare, could relate to greater internet use and insurance buying experience among this group.29

Policy Implications

Our findings suggest that opportunities exist to improve how Medicare Advantage choices are informed. Relying on alternative sources of plan information, beneficiaries report low awareness and use of the star ratings and Plan Finder website.5,6 While the Plan Finder communicates high-level information about plan costs, benefits, and quality with options for more detail, in accord with expert recommendations,3032 improvements are still needed. Given that many beneficiaries seeking plans face limitations in cognition, health literacy, internet access, and insurance purchasing experience, informing complex cost and quality comparisons between the many available plans is challenging.10,12,33 Efforts to increase awareness about the star ratings and the Plan Finder, to improve the Plan Finder’s user-friendliness (e.g., simple language, streamlined tools to filter options based on personal criteria), and to augment access to in-person decision-support may help.5

Ongoing improvement of the relevance and transparency of quality information provided is warranted.5 Market share’s association with enrollment underscores the importance of peer opinions; accordingly, CMS might consider including consumer reviews conveying key facets of quality. Conversely, market share’s contribution suggests a role for mechanisms to engage beneficiaries to revisit prior selections, especially those for whom a less costly or higher quality alternative exists. CMS’s letters to beneficiaries enrolled in persistently low-rated plans is an initial step, but more may be necessary.3,34 Better understanding of which dimensions of quality are most important to beneficiaries, which specific measures are most meaningful to beneficiaries, and which means of communication of quality information are most effective for reaching and supporting beneficiaries is needed.

If making the highest-quality plans more attractive for enrollment is the goal, the diminishing marginal utility for quality at higher star ratings and disparities in willingness to pay may argue for more education about high-quality plans. While the highest-rated plan may not always be the best-fit or highest-value option for a given beneficiary, differential willingness to pay for quality among key subgroups argues for targeted outreach and education. Moreover, by excluding beneficiaries eligible for the low-income subsidy, our analyses omit a population of beneficiaries for whom health literacy is likely more limited and for whom efforts at outreach and education to foster selection of high-quality and high-value plans may be most critical.

Limitations

Our study has limitations. Exclusion of beneficiaries choosing Special Needs, PACE, cost, employer-sponsored plans, or plans without prescription coverage limits generalizability to those to whom these appeal. Our focus on first-time Medicare Advantage enrollees eliminates prior enrollments’ potential influence, but limits generalizability to extant enrollees and precludes accounting for health status and utilization, which could influence preferences. Quality ratings are not assessed for traditional Medicare and our analysis cannot address the choice between traditional Medicare and Medicare Advantage. Income likely influences willingness to pay; however, beneficiary-level income data were unavailable and local averages would not primarily reflect Medicare beneficiaries; exclusion of beneficiaries deemed eligible for the low-income subsidy ameliorates this shortcoming somewhat, excluding those for whom higher-costs are likely more deterring. Finally, we cannot account for several factors that may influence choices or willingness to pay (i.e., provider networks, health status, income, health literacy); these warrant assessment in future work.

CONCLUSIONS

While Medicare Advantage plan’s costs and quality influence enrollment preferences, brand market share also contributes heavily to beneficiaries’ choices. As CMS strives to promote informed decisions in the Medicare Advantage marketplace, opportunities exist to refine the use and understanding of plan information by Medicare beneficiaries. Ensuring access to clear and compelling cost and quality data to inform decisions in the Medicare Advantage marketplace and other insurance exchanges will be important to the long-term success of these market-based systems.