A multimodal mentorship intervention to improve surgical quality in Tanzania’s Lake Zone: a convergent, mixed methods assessment

Abstract

Background

Safe, high-quality surgical care in many African countries is a critical need. Challenges include availability of surgical providers, improving quality of care, and building workforce capacity. Despite growing evidence that mentoring is effective in African healthcare settings, less is known about its role in surgery. We examined a multimodal approach to mentorship as part of a safe surgery intervention (Safe Surgery 2020) to improve surgical quality. Our goal was to distill lessons for policy makers, intervention designers, and practitioners on key elements of a successful surgical mentorship program.

Methods

We used a convergent, mixed-methods design to examine the experiences of mentees, mentors, and facility leaders with mentorship at 10 health facilities in Tanzania’s Lake Zone. A multidisciplinary team of mentors worked with surgical providers over 17 months using in-person mentorship, telementoring, and WhatsApp. We conducted surveys, in-depth interviews, and focus groups to capture data in four categories: (1) satisfaction with mentorship; (2) perceived impact; (3) elements of a successful mentoring program; and (4) challenges to implementing mentorship. We analyzed quantitative data using frequency analysis and qualitative data using the constant comparison method. Recurrent and unifying concepts were identified through merging the qualitative and quantitative data.

Results

Overall, 96% of mentees experienced the intervention as positive, 88% were satisfied, and 100% supported continuing the intervention in the future. Mentees, mentors, and facility leaders perceived improvements in surgical practice, the surgical ecosystem, and in reducing postsurgical infections. Several themes related to the intervention’s success emerged: (1) the intervention’s design, including its multimodality, side-by-side mentorship, and standardization of practices; (2) the mentee–mentor relationship, including a friendly, safe, non-hierarchical, team relationship, as well as mentors’ understanding of the local context; and (3) mentorship characteristics, including non-judgmental feedback, experience, and accessibility. Challenges included resistance to change, shortage of providers, mentorship dose, and logistics.

Conclusions

Our study suggests a multimodal mentorship approach is promising in building the capacity of surgical providers. By distilling the experiences of the mentees, mentors, and facility leaders, our lessons provide a foundation for future efforts to establish effective surgical mentorship programs that build provider capacity and ultimately improve surgical quality.

Background

Recently, the quality and safety of surgical services in African countries has received increasing attention [1,2,3]. Patients are twice as likely to die after surgery compared to the global average, and postsurgical infection rates are 2 to 10 times higher [2, 4, 5]. Poor surgical quality stems from the convergence of weak health systems, insufficient resources, and workforce challenges. The number of specialists such as surgeons, anesthesiologists, and obstetricians are estimated to be 20–50 times lower in African countries [6] than the recommended minimum needed to provide safe surgical care. (1) While necessary, bolstering the surgical workforce is neither feasible in the short term, nor sufficient on its own [7]. Research in African settings suggests that building the capacity of existing surgical care providers can improve surgical quality [8,9,10,11].

The most common method to build healthcare providers’ capacity in low-resource settings is training and supervision [12, 13]. However, research suggests that these alone are not sustainable [14] and do not effectively improve performance or quality [12, 15]. A multipronged strategy incorporating clinical training and practice at the worksite may be more effective [16]. In particular, mentorship, “the process through which an experienced and empathetic person who is proficient in her/his content area teaches and coaches another individual or group of individuals in person and/or virtually to ensure competent workplace performance and provide ongoing professional development” offers a promising strategy for improving surgical provider capacity [17]. Key elements include mutual trust and respect, shared learning objectives, building skills and confidence, and empowerment [18]. Evidence for mentorship’s effectiveness in African healthcare settings [19] includes improved infectious disease management [20,21,22], integrated management of childhood illnesses [23, 24], and improved quality of laboratory services [25, 26].

Using mentorship to build surgical care provider capacity in low-resource settings is quite recent but [9, 27, 28] holds promise for three reasons. First, mentorship may be more effective at transferring tacit knowledge and skills following initial training [29] through observation, coaching, and practical solutions in the local context. Second, mentorship may result in more sustainable changes, since it allows surgical providers to continue learning in their environment [30], balance learning with routine work [28], and participate in whole-team learning. Finally, mentorship that provides ongoing learning in smaller amounts spread over time (a “low-dose high frequency approach”), has been effective in adult learning [30, 31]; studies have shown that surgical providers in low-resource settings prefer this method [32].

In 2018, a multimodal mentorship component of a Safe Surgery 2020 (SS2020) intervention was implemented to build surgical care provider capacity in 10 health facilities in Tanzania’s Lake Zone. SS2020 had two goals: (1) improve surgical quality processes including safety practices, teamwork and communication, and data quality, and (2) reduce postsurgical infections [8, 9, 27, 33,34,35]. Mentorship was the final phase of SS2020 and was designed to support technical and non-technical skill development for non-specialist providers to improve surgical quality, following training [8]. In this paper, we report findings of a mixed-methods assessment of the intervention. By evaluating experiences of mentees, mentors, and facility leaders, our study aims to provide policymakers, intervention designers, and practitioners with information on key elements of a successful surgical mentorship program.

Methods

Study design

We used a convergent mixed-methods study design [36,37,38] as recommended by experts for the study of complex interventions [39]. We collected quantitative data from surveys and qualitative data from interviews and focus groups. Together, our analyses provided a fuller understanding of the lived experiences of mentees, mentors, and facility leaders with the mentorship intervention [40, 41]. We followed the consolidated reporting guidelines for qualitative research [42].

Setting

Our setting was ten SS2020 intervention facilities in the Mara and Kagera regions in Tanzania’s Lake Zone, a focus of national and international efforts, because they are among the most rural and poorest regions [43]. The intervention facilities (health centers, district hospitals, and regional referral hospitals) were selected based on a feasibility assessment conducted by SS2020 partners in 2018 [27]. Non-specialist surgical providers are the backbone of the surgical system, but they work in challenging circumstances: low-provider density and high patient ratios, inadequate surgical infrastructure, and limited training opportunities [44].

Participants

Our study participants included mentees, mentors, and facility leaders. Mentees were members of the surgical team, including surgical providers, anesthesia providers, theatre nurses, and nurses in postsurgical and postnatal wards. Mentors were a four-person team, including a surgeon or obstetrician/gynecologist, an anesthesia provider, a theatre nurse, and a labor or postoperative ward nurse. Facility leaders included either medical officers-in-charge or hospital matrons or patrons.

Selection and preparation

In the first year, all four mentors came from Bugando Medical Center (BMC), the zonal referral and teaching hospital in the Lake Zone. One year after implementation, for cost and sustainability, two mentors came from BMC and two from regional facilities. Mentors were selected based on their specialty, clinical experience, and interpersonal skills. BMC mentors participated in leadership and clinical trainings with mentees and received 3 days of training on mentorship. Regional mentors received 3 days of training on mentorship and worked side-by-side with BMC mentors for 6 months.

Multimodal delivery

A multimodal approach to mentorship (Table 1) was implemented starting June 2018. For in-person mentorship, the mentor team visited each facility bi-monthly for 2 days. Mentors debriefed with surgical teams on their progress with their surgical quality improvement plan—developed after leadership training—and any perioperative and organizational challenges. Next, each mentor focused on one of three tracks: (1) the clinical track included side-by-side coaching in the operating room (OR) on surgical skills, safety practices, and teamwork and communication. Mentors also participated in ward rounds and provided hands-on coaching on postoperative care; (2) the data track included reviewing patient files for completeness of documentation and quality of care and coaching on monitoring and use of data to improve surgical quality; and (3) the patient pathway track examined care from the facility gate to discharge. Mentors debriefed with the surgical team, facility leaders, and Council Health Management Teams, problem-solved, and developed an action plan identifying opportunities and strategies for improvement.

Table 1 Safe surgery 2020 multi-modal mentorship intervention

Telementoring was provided through the Project ECHO (Extension for Community Healthcare Outcomes) platform using a hub and spoke approach; mentors (the hub) partnered with surgical teams (the spokes) to facilitate sharing of knowledge and expertise through videoconferencing [45,46,47,48,49]. Biweekly 80-min telementoring sessions were open to all relevant staff. Mentors shared knowledge on a variety of topics through didactic presentations. Next, surgical teams presented cases on best practices or a challenging case related to that topic, followed by peer-to-peer and mentor feedback. Regional WhatsApp groups were established to facilitate further communication, sharing of knowledge and monthly surgical data, and real-time problem solving.

Data collection and analysis

Data collection

Members of the research team, (SA, MS) with experience in global health and implementation science developed a survey based on the goals of the intervention and from literature on mentorship in African healthcare settings [19]. The 57 items focused on six topics: (1) satisfaction with mentorship; (2) perceived impact; (3) experience with mentorship; (4) important mentor characteristics; (5) challenges to implementing mentorship; and (6) respondent characteristics (Additional file 1). The survey was tested in five health facilities in a neighboring region with surgical providers. A paper-based survey was administered 14 months after the start of the intervention to mentees who were interviewed. No survey identifiers were collected, and no incentives were offered for completion.

Two research assistants (NZ, MS) experienced in qualitative research with master’s degrees in global health conducted in-depth, semi-structured interviews with mentees, mentors, and facility leaders 14 months after initiation of the intervention. To recruit mentees and facility leaders, we identified the necessary stakeholders (one facility leader and two to three members of the surgical team); the facility or surgical team leaders identified the interviewees. Interviews were 30 min and conducted in a private space by a research team member; daily field notes were recorded after. Three protocols were used for mentees, mentors, and facility leaders and included questions about perceived impact, the multimodal approach, which areas of mentorship were most valued, mentee–mentor relationships, and challenges (Additional file 2). Interviews were conducted in English with translation to Kiswahili when required by Tanzanian SS2020 staff, audiotaped and transcribed. No interviewee ended the interview early or declined to participate. Transcripts were checked for accuracy and uploaded to NVivo V.11 (QSR International, Melbourne, Australia) for coding.

A research assistant (MS) conducted one focus group per facility 10 months after telementoring, with daily field notes. Focus groups included a range from 4 to 15 interviewees per site (facility leaders and members of the surgical team) and lasted 30 min. Questions covered perceived impact, most useful areas of mentoring support, what was best delivered through a virtual platform, challenges, and sustainability (Additional file 2).

Data analysis

We used descriptive statistics to summarize the percentage of responses on the Likert scale for each survey question. Denominators included the actual number of responses to the question. Statistical testing was not conducted as this was an exploratory study and the sample size was small (n = 25). All analyses were performed using Stata version 16.0, (StataCorp LLC. College Station, TX).

Qualitative data were analyzed by three researchers (NZ, DBA, SA) using the constant comparative method to understand the elements of a successful mentorship program [41, 50]. Researchers reviewed three transcripts to arrive at a preliminary codebook and tested it against nine new transcripts. As new data were coded, we compared the new text segments to those previously assigned the same code; codes were refined to ensure validity until no new codes emerged (i.e., theoretical saturation) [51, 52]. Development of the coding structure, coding definitions, and principles used in applying the codes were documented. Inter-rater reliability between two coders was high (κ = 0.87) [53], and all 45 transcripts were analyzed using the final codebook. Recurrent and unifying concepts were identified, and the qualitative and quantitative data were merged to identify the major patterns and themes.

Results

The ten facilities included regional hospitals, district hospitals, and health centers (Table 2). The typical facility was a 101–300 bed government-operated facility performing an average of 90 major surgeries per month. Our response rate for the survey was 82%. Interviewees (n = 45) included mentees (62.2%), mentors (17.8%), and facility leaders (20%).

Table 2 Characteristics of intervention facilities and participants, 2019

Below we present quantitative and qualitative results for our study, including perceptions related to the successful impact of mentoring, three themes, and eleven constituent subthemes that contributed to the successful impact and four challenges to implementing mentorship. Table 3 provides illustrative quotations for themes that emerged from the interviews. Quotations have been edited for conciseness.

Table 3 Illustrative quotations of themes about features of and challenges to a successful mentorship intervention

Perceived mentorship impact

Overall, 96% of mentees experienced the intervention as positive, 88% were satisfied, and 100% supported continuing the intervention in the future (Additional file 3). All mentees reported they had changed their surgical practices due to mentorship, and 86% of mentees said their facilities made positive changes (Additional file 4). One leader suggested that, in time, they could become mentor hospitals to other facilities.

Three quarters of all mentees reported mentorship had made a difference “to a great extent” in five areas: confidence, Safe Surgical Checklist (SSC) use, asking for case consultations, teamwork and communication, and clinical skills (Fig. 1). The qualitative data supported these positive survey findings. All participants perceived that mentorship helped mentees improve their confidence, surgical skills, safety practices, teamwork and communication, and safety culture.

Fig. 1

Perceived mentorship impact

Mentors also reported their own clinical skills, surgical practices, and teamwork and communication skills improved from participating in the SS2020 trainings and mentoring. In addition, they reported their leadership skills and confidence had increased.

All participants perceived improvements in the surgical ecosystem, such as better preoperative and postoperative care. In interviews, leaders and surgical providers mentioned increased revenue because of reduced referrals out, increased surgical volume, and improved best practices. Mentees reported improvements had a positive impact on patients, including reduced postsurgical infections, increased safety, improved communication, faster recovery, and reduced decision-to-incision times.

Below we present the themes and subthemes that contributed to the positive impact.

Valuable elements of the mentorship intervention

Multimodality of the mentorship intervention

In interviews, participants reported that the all three platforms—in-person mentorship, telementoring, and WhatsApp (Table 1)—were valuable, because they complemented and reinforced each other, contributing to continuous and deeper learning.

Participants explained that in-person mentorship was optimal for learning tacit knowledge and skills such as how to perform certain surgical techniques. In-person mentorship included side-by-side coaching allowing mentors to role-model important technical and non-technical skills to mentees; a few participants expressed this way of learning was particularly suited to their culture and allowed mentoring to be tailored to the facility’s individual context. Mentors said it allowed them to assess the team environment or the quality of their OR registers, follow-up on progress, problem-solve organizational or perioperative issues, and advocate for surgical priorities with facility, district, or regional management. Mentees reported that they valued the real-time communication with mentors to share experiences. There were two challenges of in-person mentorship: (1) it was resource intensive, and (2) a heavy caseload or the lack of a specific type of case on the day of mentoring may make it difficult to engage in mentorship activities.

Participants noted that telementoring was optimal for learning explicit knowledge, and it expanded their knowledge on safe surgery. It was perceived as time-efficient and less costly, since many people could learn together and mentors did not have to travel. It was also a valuable platform for learning about uncommon cases and convenient to bring in different experts. It was open to everyone which helped to create a learning community on safe surgery and promoted shared learning between surgical teams at different facilities with common contexts and challenges. Logistical challenges included after-work timing of sessions, poor internet connectivity, and lack of translation for English sessions by international faculty. Staff workload prevented some mentees from attending.

WhatsApp was a valuable platform for timely advice on patient management and coordination issues regardless of location. Participants highlighted its convenience, since texts or videos could be reviewed at any time. It also created a sense of community between the surgical teams at various facilities. However, some mentioned issues with confidentiality of information and inaccessibility to WhatsApp as disadvantages.

Supportive side-by-side clinical coaching

Mentees prioritized clinical skills highest among all areas of mentorship received. The top three areas mentees prioritized as “greatly important” were also the areas, where they received mentorship “to a great extent”: clinical skills (95.7% said it was “greatly important” and 76.2% said they received it “to a great extent”), SSC implementation (87% and 66.7%, respectively), and utilization of data (78.3% and 59%, respectively) (Additional file 5).

In interviews, mentees prioritized side-by-side clinical mentorship, because it provided practical, efficient, and direct teaching and feedback with tangible improvements, but there were some differences by discipline. Surgical providers, nurses, and leaders valued mentorship on clinical procedures the most, followed by the SSC, while anesthetists valued the SSC the most, followed by the patient pathway.

Standardization of surgical practices

Mentors noted that previously, surgical providers and mentors had their own surgical practices at their facilities; after the SS2020 trainings and mentorship, evidence-based practices became standardized. They perceived a culture of following standards improved the quality of care for patients and reduced postsurgical infections.

Helpful features of the mentee–mentor relationships

Relationship building

Mentees and mentors discussed how the mentors first invested in building relationships. Mentees felt that this approach opened the door for mentors to share their knowledge and skills, making it easier for mentees to ask questions and be receptive to feedback for improvement.

Friendliness

The term “friendly” was most often used by mentees to describe their relationship with mentors due to their non-hierarchical, collegial approach. Furthermore, they felt that the approach to feedback, where mentors started with positive feedback first before discussing areas for improvement reduced resistance. One mentor attributed their ability to build a friendly relationship with mentees to the leadership training they attended together.

Psychological safety

Mentees described their relationship with their mentors as psychologically safe, where they felt comfortable asking questions, seeking help, and admitting mistakes. Mentors said they were also comfortable discussing feedback with mentees. Mentees and mentors said they shared feedback with each other at the end of each visit, through annual mentor evaluations, and at an annual mentorship debriefing session.

Mentors as part of the surgical team

Importantly, mentees and facility leaders described their mentors as part of a team working together in the pursuit of surgical quality improvement. One facility leader explained that by becoming part of the team, mentors overcame the common challenge of getting people engaged and it was the sense of being one team that made mentoring a success.

Understanding of local context

Mentees and leaders felt that mentors understood their context, such as resources, staffing, and culture, and were able to help with their challenges. They noted that the patient pathway track, where mentors and mentees reviewed services from the gate to discharge provided mentors with a deeper understanding of their facility. This understanding of context allowed mentors to relate to mentees; as a result, knowledge and skills were transferred more easily.

Useful mentor characteristics

The top three mentor characteristics mentees prioritized as “greatly important” and exhibited “to a great extent” were interpersonal skills (90.4% felt these were “greatly important” and 81% felt mentors exhibited them “to a great extent”), role modeling (82.6% and 65.2%, respectively), and courtesy and respect (81% and 81%, respectively) (Additional file 6). In interviews, participants raised the importance of mentors who provided non-judgmental feedback, had sufficient experience, and were accessible.

Non-judgmental feedback

Mentees highly valued the mentors’ nonjudgmental feedback. Mentees mentioned mentors fostered a supportive environment by providing feedback, offered guidance and a chance to ask questions with the goal of learning and improvement.

Mentor experience level

When describing attributes, many mentees spoke very positively about the experience level of mentors. However, some felt that their mentors lacked sufficient experience in their discipline or in mentorship and were not able to be as helpful as a result.

Accessibility of the mentor

Mentees discussed they could reach out to their mentors outside mentorship visits if they had a difficult surgical case, which was very helpful. One leader provided an example of when the surgical team reached out to their mentors for advice on the care of a patient with a fistula and worked together as a team.

Challenges to mentorship

Four themes emerged as barriers to successful implementation of mentorship. First, while most mentees had a good attitude towards mentorship and welcomed it, participants mentioned there was resistance from some mentees. Reasons mentioned included: First, mentees initially perceiving it as another supervision program, less buy-in from mentees who had not attended the SS2020 trainings, and difficulty changing practice. Second, most facilities faced a shortage of surgical providers, so mentees were not prepared when mentors arrived or needed to attend to routine duties during mentorship; afterhours sessions were also unpaid. Third, while some mentees felt the mentorship ‘dose’ was just right, others felt the frequency and duration of mentorship was insufficient. Finally, there were logistical challenges including communication around timing of the mentorship visits, after work hours of telementoring sessions, poor internet connectivity, and language barriers with international faculty.

Discussion

We examined a multimodal approach to mentorship as part of a safe surgery intervention to improve surgical quality in Tanzania’s Lake Zone to distill lessons on its key elements of success (Box 4).

Box 4 Lessons for implementing a successful mentorship intervention to strengthen surgical services in low-resource settings

Our results suggest that mentorship can act as a vehicle to build capacity of surgical providers in low-resource settings. Mentees, mentors, and facility leaders perceived improvements in surgical practice and teamwork in the OR, strengthening of the surgical ecosystem, and a reduction in postsurgical infections; this is supported by our quantitative findings [8]. We attribute the success of the intervention to its multimodal design, collaborative relationships between mentees and mentors, and its grounding in local context.

Most studies examining mentorship in surgery are based in high-income countries [29]. While research on surgery in low-resource settings is sparse [19, 28, 54], our findings are consistent with the emerging evidence about elements of successful mentorship. Mentorship that follows training, uses a side-by-side approach, has high-quality mentee–mentor relationships, understands the local context, and provides nonjudgmental feedback leads to success in low-resource settings [17,18,19, 24, 55].

A key feature of the intervention was its multimodality. Our goal was to improve surgical quality, which required the development of technical and non-technical skills, behavior changes, and new ways of thinking. A multimodal mentorship approach offered a flexible journey to transform surgical practice and culture. In-person mentorship was optimal for transferring tacit knowledge and skills, telementoring for explicit knowledge, and WhatsApp for real-time problem-solving. This approach allowed for a balance of work and learning, attention to contextual factors, and integration of knowledge and practice. Our findings contribute to the evidence on the effectiveness of multimodal mentorship approaches [56,57,58,59,60].

Relationship building between mentees and mentors was also important for success. To build relationships, mentors presented themselves to mentees as a helper, not as an instructor or a manager. They created a safe, nonjudgmental environment, where mentees felt comfortable sharing their challenges and were receptive to feedback. Mentors from regional and local hospitals understood the local context and were perceived as colleagues. A team-based approach which provides discipline-specific mentorship (e.g., nurses mentoring other nurses), can also facilitate technical congruence [18]. Properly training mentors was crucial; during the COVID-19 pandemic mentorship became fully virtual, which required a different skill set than in-person mentoring. Preparation covered how to structure sessions, develop activities, and effectively facilitate virtual sessions.

Literature points to the importance of bridging the knowing-doing gap [34, 61,62,63]. While most mentees had a positive attitude towards mentoring, there was some resistance from others. It is important to cultivate buy-in by orienting the surgical team to the goals of mentorship, inviting their input on priorities, and training the whole team. Leadership engagement is also critical for successful and sustainable mentorship. Leaders can signal its priority, release staff time for mentorship activities, and create structures that build learning capacity [33, 64,65,66,67].

Sustainability requires policy support and a culture of mentorship. It is necessary to engage with national health system leaders to develop policy that integrates surgical mentorship into the existing health system and incorporates it in district plans and budget, including training and compensation for mentors. The concept of mentorship should be introduced during surgical training, incorporated into mentors’ regular responsibilities, and linked to continuing professional development [17].

Future research should consider experimental and longitudinal designs to identify which features of the mentorship program are associated with significant improvements in surgical quality. In addition, studies should examine the cost-effectiveness of multimodal mentorship approaches in comparison to unimodal approaches. Research should also consider what contextual factors are important for successful surgical mentorship in African settings.

Our study has limitations. Our findings should be confirmed in diverse contexts to generalize results. Our survey did not undergo formal testing to establish reliability and validity. Data were self-reported, so the findings may appear more positive due to social desirability bias [68], and language barriers may have limited the discussion. The qualitative data from interviews may be confounded by participant experiences with other SS2020 intervention components. A key strength of our research was its mixed methods approach, which allowed for a deeper understanding of participants’ experiences. Furthermore, the implementation facilitator and barriers found here offer a valuable learning opportunity as they likely apply to mentorship interventions in low-resource settings more generally.

Conclusions

In this paper, we report on the findings of a mixed-methods assessment of a multimodal mentorship intervention with surgical providers in Tanzania’s Lake Zone to improve surgical quality. We found that a multimodal design, high-quality mentee–mentor relationships, and understanding of local context can optimize mentorship. The themes identified offer insights and lessons that can inform policy makers, intervention designers, and practitioners about successful implementation of surgical mentorship interventions. Future research should examine the cost-effectiveness of multimodal mentorship approaches and the contextual factors that are important to optimize surgical mentorship in African settings.