Assessment of interventions to attract and retain health workers in rural Zambia: a discrete choice experiment

Abstract

Background

Workforce shortages, particularly in rural areas, limit the delivery of health services in Zambia. Policymakers and researchers co-created this study to identify potential non-monetary employment incentives and assess their cost-effectiveness to attract and retain public sector health workers to the rural areas of Zambia.

Methods

The study consisted of two key phases: a discrete choice experiment (DCE), preceded by a qualitative component to inform DCE questionnaire development. Firstly, in qualitative interviews with 25 health workers and focus group discussions (FGDs) with 253 health students, participants were asked to discuss job attributes and potential incentives that would influence their job choices. Based on this exercise and in consultation with policymakers, job attributes were selected for inclusion in a discrete choice experiment (DCE) questionnaire. Secondly, this questionnaire, consisting of hypothetical job “choice sets,” was presented to 474 practicing health workers and students. A conditional logit regression model was applied to the data from this DCE questionnaire to estimate preferences for various job attributes. Using administrative data, we estimated the cost of implementing potential attraction and retention strategies per health worker year worked.

Results

Although health workers preferred urban jobs to rural jobs (OR 1.39, 95% CI 1.11–1.75), employment incentives influenced health workers’ decision to choose rural jobs. If superior housing was offered in a rural area compared to a basic housing allowance in an urban job, participants would be five times as likely to choose the rural job (OR 5.04, 95% CI 4.12–6.18). Education incentives and facility-based improvements also increased the likelihood of rural job uptake. Housing benefits were estimated to have the lowest total costs per health worker year worked, and offer high value in terms of cost per percentage point increase in rural job uptake.

Conclusions

Non-monetary incentives such as housing, education, and facility improvements can be important motivators of health worker choice of location and could mitigate rural health workforce shortages. These results can provide valuable insight into the types of job attributes and incentives that are most likely to be effective in attracting and retaining health workers in rural areas.

Background

An adequate health workforce is critical to the delivery of health services. With approximately 61% of Zambia’s population living in rural areas [1], ensuring access to services in rural areas is central to achieving national health goals. Zambia suffers from a national human resources for health (HRH) shortage, with 11.2 doctors, nurses, and midwives per 10 000 persons, which is well below the WHO minimum recommended threshold of 22.8 doctors, nurses, and midwives per 10 000 persons [2]. As of 2017, approximately 10% of Zambia’s health workforce was lost each year to attrition [3]. Although there has been an overall increase in the number of clinical health workers since 2008, shortages remain highest in rural areas. While the majority of Zambia’s population live in rural areas, the total number of doctors, nurses, and midwives in rural areas stands at 7677 compared to 9285 in urban areas [2]. An analysis of the workforce in 2016 showed that 45% of doctors, clinical officers, nurses, and midwives were working in rural areas [2].

In 2003, the Ministry of Health (MOH) launched the Zambian Health Workers Retention Scheme (ZHWRS) pilot program to attract and retain medical doctors in rural and remote areas of the country. The scheme was expanded in 2007 to include environmental health technicians, nurses, medical teaching staff, medical consultants, medical licentiates, and clinical officers. The ZHWRS ranks districts by level of remoteness and offers various benefits to health worker in each district, such as hardship allowances, housing rehabilitation funds, vehicle loans, utility equipment (solar panels or a bore hole), radio equipment, and professional development priority [4]. Evaluations of the ZHWRS have suggested that the policy has had limited effectiveness and that none of the included incentives are significantly associated with higher retention in rural areas [5,6,7]. In response, the MOH developed the ZHWRS Sustainability Strategy (ZHWRS-SS) in 2014. The ZHWRS-SS called for an effectiveness evaluation and cost-benefit analysis of other potential non-monetary incentives in order to inform the selection of sustainable incentives that could replace those included in the ZHWRS.

The aim of this study was to identify policy-applicable strategies that are most likely to attract and retain health workers in rural areas of Zambia, and to examine the relative costs and benefits of the strategies. A multi-country study in South Africa, Kenya, and Thailand found that nurses’ preferences varied significantly across countries and recommended that intervention packages should be tailored to local conditions [8]. So while MOH policymakers in Zambia could gain general information from the global evidence base, data emerging from their specific context was critical. Furthermore, few past studies have rigorously examined the costs of proposed incentives and considered health worker preferences in light of costs per health worker year worked.

This study adopted a discrete choice experiment (DCE) design. In recent years, DCEs have emerged as an important tool for examining the potential effects of HRH interventions by understanding the preferences of health workers and the probability of uptake of defined jobs [9, 10]. Previous research has highlighted several key types of strategies or incentives for attracting and retaining health workers in rural areas [11,12,13], including educational opportunities, financial incentives, professional support and recognition, improved living conditions and personal transportation, regulatory policy change, and improved facility conditions. The details of these packages are, however, contextually dependent on the status quo, health worker preferences, and political and financial feasibility.

Methods

This study was approached through two phases: development of a DCE questionnaire based on interviews with health workers, focus group discussions (FGDs) with students, and government consultations, and execution and analysis of a DCE questionnaire to elicit information on preferences for attribute packages from practicing health workers and health professional students.

Qualitative data collection and questionnaire development

The purpose of the qualitative component was to inform the list of job attributes that would be used to construct the job choice sets included in the DCE [9, 14]. Semi-structured, in-depth interviews were held with 25 health workers employed in rural health centers. FGDs were conducted with students in their last year of training, including 16 doctors, 22 clinical officers, and 215 midwives and nurses. Locations for health worker interviews and training institutions for FGDs were selected to prioritize inclusion of health workers and students with experience in rural areas. In the interviews and FGDs, participants were asked to discuss sources of satisfaction or dissatisfaction in their past or current postings and possible incentives that could be offered to encourage them to take up or stay in postings in rural or remote areas. At the end of each interview or FGD session, participants were asked to review a list of job attributes and identify four that were most important. The qualitative phase of this study is described in detail in a separate technical report (Kamanga, A, et al. Push and Pull factors: Rural Retention of Health Workers in Zambia, manuscript in preparation.).

Responses from the ranking exercise were coded and categorized, and each attribute was given an overall rank based on participant input. Policymakers from the MOH considered the attribute rankings, as well as the feasibility of implementing various incentive strategies aimed at impacting these job attributes, and agreed that the DCE should include the following attributes: (1) salary-based incentives (to enable cost-benefit analysis), (2) educational opportunities, (3) housing (including references to utility status), (4) facility transportation, and (5) medical equipment. Within each attribute category, levels were created based on the qualitative descriptions from participants as well as implementation feasibility. An overview of the attributes and levels is shown in Table 1.

Table 1 Job characteristics presented in discrete choice experiment

A labeled design was used for this DCE, whereby each choice set included one rural and one urban job. The alternative label conveys information to participants that is not explicitly stated in the choice set and therefore provides preference results that are more realistic and less abstract [15]. A labeled design also provides the opportunity to create a restricted design, which limits certain attribute levels to only be available in rural or urban locations. Through a restricted design, the realism of the options provided was enhanced by avoiding implausible combinations (such as the government offering a rural allowance for an urban job).

The selected DCE attributes and levels were matched to create job choices using R software. Given the attributes and levels selected, a total of 2304 pairs of job sets were possible, and a fractional factorial design was used to select a fraction of the total job choice sets to be presented to participants to optimize D-efficiency, maximize level balance and orthogonality, and minimize overlap among attribute levels [9]. The questionnaire was organized into two blocks of 12 choice sets, and participants were randomly assigned to a block. In addition to the DCE choice sets, demographic and background questions were included. The final DCE questionnaire is included as Additional file 1.

Sampling and data collection

The questionnaire was tested with approximately 20 participants to ensure general comprehension of the instructions and questionnaire design. The anonymous questionnaire was completed by 474 participants between October 2016 and January 2017.

Participants were conveniently and purposefully sampled with the goal of obtaining a sample of participants with balanced representation of key demographic characteristics, and that was generally representative of the Zambian health workforce with regard to the health worker cadres represented. Given the focus on understanding retention of health workers, the sample was also designed to include primarily health workers with rural experience, since it was assumed that these individuals would be able to most realistically assess the value of incentives offered. The sample was recruited through three approaches: (1) Students in their final year of pre-service or up-grading training at five training institutions were invited to participate. (2) Active health workers were sampled from a nationwide series of training workshops for supervisors of community health assistants (CHAs) in five provinces: Luapula, Northern, Western, Northwestern, and Muchinga. Since the CHA cadre exclusively works in rural and remote areas, these workshops included staff currently working and residing in rural areas. (3) Health workers were selected from health facilities in rural districts of two additional provinces (Eastern and Central). Overall, participants were drawn from a total of 26 districts, of which 24 are classified as rural or remote by the Zambian Public Service Management Division (PSMD).

All survey participants provided written consent prior to participation. Data was collected using paper-based questionnaires. Data entry was conducted using EpiData, and 25% of the questionnaires were double entered to ensure accuracy.

Data analysis

Demographic, education, and work experience characteristics were analyzed using univariate, descriptive statistics. Bivariate logistic regression was used to explore associations between the stated likelihood of working in a rural area in the future and various demographic or background characteristics. A conditional logit model was used to investigate the preferences for job attributes among participants. Data were analyzed as categorical dummy variables that represented the existence of a certain attribute level in either a rural or an urban setting. These dummy variables can be thought of as interaction variables between the attribute level and the location; such an approach is made possible based on the labeled study design. Separate conditional logit models were used to explore differences in preferences among different cadre groups and other sub-groups, though the study was not specifically designed to examine differences in these groups because it is unlikely that the government would offer different incentives to different sub-groups of employees.

An uptake rate or preference impact measure was calculated to estimate the percentage of health workers that would prefer a job posting that offers a specific package of incentives as compared to other job postings [16]. Several validity tests were conducted to determine the appropriateness of model specifications. Specifically, we investigated dominance and internal or predictive validity. Dominance in a DCE means that a participant always selected job scenarios on the basis of one attribute (for example, a participant always chose rural jobs). Such behavior challenges the basic assumption of random utility theory that individuals make trade-offs between various characteristics in making choices [17]. In order to assess internal or predictive validity, we used the uptake prediction values for actual scenarios presented in the questionnaire to understand whether our predicted uptake for a job scenario matched the percentage of participants that actually chose that job scenario [18, 19]. All analyses were performed using Stata 13.

Results

Data was collected from 474 participants, including 259 (54.6%) active health workers (sampled from health facilities and regional in-service training) and 215 (45.4%) students (sampled from five training institutions). Table 2 presents the demographic characteristics of the participants. The sample is balanced across key demographic characteristics, and cadres are represented in a way that is roughly proportionate to their size within the national health workforce (see table notes).

Table 2 Sample demographic characteristics

Reported likelihood of working in a rural area

As shown in Table 2, over 73% of participants reported that they were likely or very likely to work in a rural area in the future. We explored the association between self-reported likelihood of working in a rural area and participant characteristics (Table 3). Participants were more likely to report likelihood of working in a rural area in the future if they had limited work experience (odds ratio (OR) 1.67, p value 0.02) or had limited rural work experience (OR 1.53, p value 0.05). Students were twice as likely to say they would take up a rural position compared to active health care workers (OR 2.04, p value < 0.01). Finally, participants who rated their past work experience in rural areas as excellent had 12 times higher odds of indicating likelihood of taking up a rural position (OR 12.38, p value < 0.01), and those who rated their experience as good had nearly six times higher odds (OR 5.90, p value < 0.01). Those who rated their past experience working in a rural area as fair had 3.85 times higher odds (3.85, p value < 0.01).

Table 3 Association between demographics and experiences with stated likelihood of working in a rural area in the future

Job attribute preferences

In total, 78 participants (16.5%) expressed a dominant preference for a certain job characteristic (rural job, 62 participants; urban job, 15 participants; education after 2 years with no scholarship, one respondent). Secondary analysis demonstrated that this is likely to represent true opinions of this group rather than a problem with survey comprehension because there was internal consistency between the job set responses of these participants and the responses they gave in the introductory section of the questionnaire about likelihood of working in rural areas.

The results from the conditional logit model showed that superior housing had the strongest influence on rural job choice (Table 4). Specifically, participants were 5.04 times more likely to select the rural job if superior housing was offered compared to a basic housing allowance (95% CI 4.12–6.18, p value < 0.01). The second most influential characteristic was a 100% scholarship to return to school for upgrading after 4 years of service. Participants were nearly twice as likely to take this option compared to a job with no scholarship but education leave after 2 years of services (OR 1.98, 95% CI 1.69–2.33, p value < 0.01). Superior housing was also offered in urban locations and was influential in those settings but to a lesser degree compared to rural settings (OR 2.21, 95% CI 1.86–2.62, p value < 0.01). In separate models, assessing responses across cadres and within sub-groups based on the level of rural work experience of participants (1 year or more versus less than 1 year), results were similar with no significant differences between groups.

Table 4 Determinants of job preferences for all cadres

Predicted job uptake

Using the results from the conditional logit model, we transformed the data to estimate the percentage of health workers that would choose the rural or urban job if specific attraction and retention strategies were implemented (Fig. 1). With the base or reference level of job characteristics in both the rural and urban job, 41.8% of health workers would take the rural job and 58.2% would take the urban job. If superior housing was offered in a rural job compared to the basic housing allowance in an urban job, 78.4% of health workers would be expected to take the rural job. In other words, an additional 36.6% of health workers would be convinced to take a rural job based on the provision of superior housing.

Fig. 1

Expected rural and urban job choice given various job characteristics. This figure assesses the impact of offering superior incentives in the rural job compared to the base level of each incentive category in an urban job

However, in practice, the choice that many health workers face is not between urban and rural job with the base level of all incentives. Instead, many health workers choose between a rural job with a 20% rural allowance and basic incentives compared to an urban job with access to transportation and good quality medical equipment, but basic job characteristics on all other counts. In this scenario, our model predicts that 32.0% of health workers would take the rural job under these circumstances.

Cost of job attributes

Understanding the costs of these incentives relative to their potential benefits is critical for policymakers. Costs were estimated using the salary and upgrading requirements of registered nurses and are calculated. Since attribute preferences are presented based on marginal benefits of one level over another, costs are calculated as marginal costs. Additional details about the assumptions made in costing these incentives are included in Additional file 2.

Overall, the housing options have the lowest total costs per working year (ranging from US$932 to US$1398), since houses can retain health care workers over a 25-year period despite high initial construction costs and continued maintenance costs. Individual education incentives have the largest total costs, with the main driver of costs being the salary paid while the health worker is on study leave. However, when considering the marginal costs of the higher-level incentives compared to the base, the marginal costs of the education incentives are low since delaying the return to school by 3 or 4 years (rather than 2) offsets the cost of the scholarship. In fact, one of the education incentives has a lower total cost than the base level leading to a negative marginal cost. By dividing the marginal costs of each job attribute by the estimated increase in rural job uptake (Fig. 1), estimates were developed for the cost per percentage point increase in rural job uptake (Table 5). This analysis shows that the cost of the education options per percentage point increase is low due to their low marginal costs. However, even though a chance of a 75% scholarship after 3 years is cheaper than the base level, it was not found to be a strong predictor of rural job uptake (Table 4). Aside from education, the options that offer the most benefit a lowest cost are in the housing category. Specifically, superior housing allowance offers an increase of 9.0 percentage points at a cost of $52 per percentage point increase, and superior housing offers an increase of 36.6 percentage points at a cost of $49 per percentage point increase.

Table 5 Cost per percentage point increase in rural job uptake

Discussion

The results of this study indicate that superior housing and education incentives in the form of a full scholarship for education are most likely to influence health worker job preferences. Additionally, improvements to facility quality and working environment can support health worker attraction and retention in rural areas. Against the backdrop of Zambia’s rural health workforce shortages, our findings provide evidence to enable retention policies to be shaped around health worker preference. Indeed, these results were considered for and incorporated into the prioritization of retention approaches in the 2018–2024 Zambia Human Resources for Health Strategic Plan [3].

While many DCEs have included some form of housing incentive, a limited number of DCEs have explored superior housing as an offering in comparison to basic housing. These studies did not find superior housing to be a highly influential attribute, though the definition of superior housing varies across studies [8, 20]. Still, in Zambia, superior housing was found to be extremely influential in health worker choices, with an effect estimate that was substantially higher than that of any other attribute, possibly pointing to differences in the local context and typical conditions confronted by health workers in Zambia. As with all potential strategies, the impact should be measured against the costs. When costs are considered on a per health worker year basis and relative to the percentage point increase in job uptake, housing is a cost-effective investment.

This study explored several dimensions of education incentives, including whether a scholarship was offered at all, whether the scholarship was guaranteed, and service time before receiving study leave. These results indicated that health workers are willing to delay study leave if some level of scholarship is offered and have a preference for waiting longer if the scholarship is guaranteed. The costing component of this study showed that the most significant costs associated with study leave are those required to pay salary and basic allowance while health workers are in school, rather than the scholarship itself. When study leave is delayed and those salary costs are distributed over a larger number of working years, costs are offset. As a result, delayed education incentives may offer substantial benefit at relatively low cost. When assessing the appropriateness and feasibility of educational incentives, it is also important to consider the demand for health workers with various levels of credentials. Based on the preferences of health workers, the cost of education, and the skills mix needed in Zambia, education incentives should be considered for a limited number of hard-to-fill positions, but should not be offered widely to all health workers in rural areas.

Enhancements to the facility can lead to important improvements in the quality of services offered to patients. Facility conditions are basic in most rural facilities in Zambia, so the base attribute level was designed to reflect this current reality, with higher-level attributes representing potential investments that could be made to enhance facility quality. Taken individually, facility-based improvements in working environment for health workers, in the form of transport for facility use or improved medical equipment, had limited impact on the job preferences of health workers in this study. However, other research suggests that a bundle of improvements to address multiple needs of health workers, including housing, educational opportunities, and improved working environment, are most likely to be effective in retaining health workers in the long term [21]. This study found that implementing multiple types of facility improvements together could have a larger influence on health worker preferences, and this impact can be increased by including housing and/or education incentives. The idea of facility bundles is in line with the policy direction of the ZHWRS Sustainability Strategy (ZHWRS-SS), which recommended investing in facility-based incentives over individual incentives. Beyond potential health worker recruitment and retention benefits, facility-level improvements are likely to have important and direct impacts on the accessibility and quality of patient care, but these benefits are not measured in this study. Although many health worker retention schemes internationally, including the ZHWRS in Zambia, have focused on the provision of financial incentives for rural service, results from this study indicate that non-monetary incentives such as education and housing benefits have more impact on health worker preferences than rural salary allowances. This is consistent with the results from other research, which indicates that increased salaries alone are not necessarily a sufficient tool for addressing poor retention and health worker motivation. For example, two studies in South Africa have demonstrated that higher salaries alone were not cost-effective in attracting health professionals to rural areas [22, 23] and other DCE studies have indicated that salary was not the most influential of job attributes [18]. Another analysis using data from multiple African countries found that wage differentials were not a major factor influencing health worker migration [24].

Although this study can offer valuable insights into the job preferences of health workers, several limitations should be considered. First, no questionnaire, including a DCE, can capture the full complexity of real-life choices. For example, reference to a “rural” job may invoke a range of different assumptions for various individuals, and other characteristics that are not addressed in this questionnaire, such as language or distance to one’s family home, may play a role in decision. Second, the sample for this DCE was selected using both convenient and purposeful sampling strategies and may not be representative of the national workforce in some ways. The sampling strategy aimed to and provided a sample that reflects the national workforce in several key demographic ways, such as in the cadre breakdown, and includes health workers from a wide range of geographic regions. Third, the DCE questionnaire included 10 possible incentives which were deemed administratively and financially feasible by policymakers in Zambia, but it is possible that other incentives or job characteristics not included here could have influence on health worker job preference. However, the purpose of the qualitative assessment and stakeholder consultations was to ensure that the DCE included the incentives most likely to be influential and feasible to implement. Fourth, this study was meant to examine the role of specific job characteristics in attracting and retaining health workers in rural service, but we are not able to differentiate the impact of job attributes at various time points in a health worker’s career. From a policy standpoint, the government is unlikely to offer different incentives to existing and new employees, so we opted for an approach that included current health workers and new graduates in the sample and where the survey was framed such that participants were asked to consider which job they would be more likely to choose and stay in. Finally, 16% of the participants in this study expressed a dominant preference for jobs with one characteristic. While the responses of these individuals were internally consistent with their responses to background questions, it was necessary to remove these individuals from the analysis because their responses violate model assumptions. Accordingly, our results represent the preferences of the 84% of participants that were willing to trade off between attributes or incentives. The preferences of other 16% of the participants are unlikely to be influenced by incentives provided.

This study focused on strategies that were feasible to be offered by the MOH. However, many factors well beyond the scope of the MOH will influence the quality of life of that health worker and his or her family, such as the job opportunities for spouses, reliability of public utilities, commercial life of the area, quality of the schools for dependents, and the quality of road networks. Therefore, rural development will require an effort from many governmental sectors. The MOH should explore opportunities to partner with other ministries that may be experiencing similar rural retention challenges, such as the Ministry of Education, in order to identify areas for collaboration.

Conclusion

There is an urgent need for new strategies to improve rural health worker attraction and retention in rural Zambia to address Zambia’s rural health workforce shortages. This study provides valuable evidence on the policy interventions that are most likely to be effective, relative to the cost of the investment. It builds on previous research which found that the salary incentives offered under the previous ZHWRS were not effective in improving health workers’ job satisfaction, likelihood of leaving, or frequency of considering leaving [7]. This study investigated a different set of interventions, developed and prioritized through qualitative research with health workers and students. The results indicate that housing incentives and educational scholarships for rural health workers are likely to be most effective in strengthening the rural health workforce, and based on an analysis of the costs of these incentives, housing incentives offer the best value for money. This study provides policymakers in Zambia with practical information that can be used to inform decisions about how to invest in strengthening the rural health workforce. Beyond Zambia, these results can inform policy discussions, though context-specific information is likely to be needed in other countries. Our approach to costing of incentives represents a unique view not taken in other published literature and could inform the methodology for studies in other locations.