- Open Access
- Open Peer Review
Seven years of the field epidemiology training programme (FETP) at Chennai, Tamil Nadu, India: an internal evaluation
© Bhatnagar et al.; licensee BioMed Central Ltd. 2012
- Received: 8 March 2011
- Accepted: 2 July 2012
- Published: 27 September 2012
During 2001–2007, the National Institute of Epidemiology (NIE), Chennai, Tamil Nadu, India admitted 80 trainees in its two-year Field Epidemiology Training Programme (FETP). We evaluated the first seven years of the programme to identify strengths and weaknesses.
We identified core components of the programme and broke them down into input, process, output and outcome. We developed critical indicators to reflect the logic model. We reviewed documents including fieldwork reports, abstracts listed in proceedings and papers published in Medline-indexed journals. We conducted an anonymous online survey of the graduates to collect information on self-perceived competencies, learning activities, field assignments, supervision, curriculum, relevance to career goals, strengths and weaknesses.
Of the 80 students recruited during 2001–2007, 69 (86%) acquired seven core competencies (epidemiology, surveillance, outbreaks, research, human subjects protection, communication and management) and graduated through completion of at least six field assignments. The faculty-to-student ratio ranged between 0.4 and 0.12 (expected: 0.25). The curriculum was continuously adapted with all resources available on-line. Fieldwork led to the production of 158 scientific communications presented at international meetings and to 29 manuscripts accepted in indexed, peer-reviewed journals. The online survey showed that while most graduates acquired competencies, unmet needs persisted in laboratory sciences, data analysis tools and faculty-to-student ratio.
NIE adapted the international FETP model to India. However, further efforts are required to scale up the programme and to develop career tracks for field epidemiologists in the country.
- Public Health Service
- Internet Protocol Address
- Public Health Decision
- Sree Chitra Tirunal Institute
- Supervision Visit
In 1951, the United States of America Centers for Disease Control and prevention (CDC) launched the Epidemic Intelligence Service (EIS) to recruit young professionals and train them in outbreak investigations and applied epidemiology . Fifty years later, the programme had become a reference [2, 3]. Later on, similar programmes started around the world under the name Field Epidemiology Training Programmes (FETP) and Public Health Schools without Walls (PHSWW) [4, 5]. FETPs retained the key elements of EIS in terms of learning-through-service during a two-year fellowship but also adapted themselves to fit into the national environments. International FETPs are now networked worldwide through the Training in Epidemiology and Public Health Interventions NETwork (TEPHINET) .
Few published articles are available that report evaluations of FETPs [7–9]. Evaluations may have been conducted at the request of various stakeholders or donors, but they have not been made available in the public domain through publications in peer-review journals.
In 2001, the National Institute of Epidemiology (NIE) under the Indian Council of Medical Research (ICMR) started a national, two-year FETP with its base in Chennai, Tamil Nadu, with initial support of the World Health Organization (WHO), CDC and the Australian FETP. In 2009, we decided to apply the principles we teach to our own activities and evaluated our FETP internally using a standard programme evaluation framework . Our objective was to identify the strengths and weaknesses of the programme so that we could improve it.
We described the programme through internal discussions and review of documents. We identified the core components of the programme and broke them down into input, process, output and outcome. We developed a limited set of critical indicators to reflect the logic model.
We collected information to document the indicators. First, we reviewed the programme documentation and records. Second, we reviewed fieldwork reports and final research project reports. Third, we reviewed abstracts listed in conference proceedings and papers accepted in Medline-indexed journals. Fourth, we surveyed the graduates. We used the graduates' e-mail forum to circulate a questionnaire with a majority of close-ended questions and three general open-ended questions for anonymous self-administration using an Internet-based survey tool (http://www.surveymonkey.com). The questionnaire addressed: (1) self-perceived competencies before and after FETP, (2) learning activities, (3) field assignments, (4) supervision, (5) curriculum, (6) relevance to career goals, (7) strengths, and (8) weaknesses. We informed graduates of the purpose of the survey, obtained on-line approval to participate and did not keep track of any direct (e.g., name) or indirect (e.g., age, sex, Internet protocol address) identifier. This evaluation of training activities was exempt from ethical committee review.
We captured the whole population of graduates and calculated indicators in proportions expressed in percentages.
The programme was a variant of the international FETP model that built on the learning-through-service EIS model and the academic roots of the PHSWWs. NIE is one of the institutes under ICMR, the autonomous medical research arm of the Department of Health Research of the Indian Ministry of Health and Family Welfare. The programme admitted graduates of Bachelor of Medicine and Bachelor of Surgery (MBBS) with at least three years of experience, most often nominated and sponsored by the states. Students, called “scholars”, entered the programme with a three-month induction course at NIE. This was followed by three six-month field postings in their district. There, they worked within the public health service, but as an epidemiologist-in-training, relieved of their former duties. After each of the first and the second field postings, students returned to NIE for a one-month contact session. After the third and last field posting, students came for a last one-month contact session to deliver their final reports.
The contact sessions at NIE consisted of theoretical classes, problem-solving case studies and practical exercises. From 2005 onward, the induction course included a field exercise consisting of a real investigation. Some of these field exercises resulted in publications [11–13]. From the second contact session onwards, they included peer-review sessions in which students received comments about their field project reports or protocols.
Each field posting was associated with the expected submission of deliverable(s). These included a situation analysis, a surveillance data analysis, a surveillance system evaluation, two critiques of scientific articles, a public health programme evaluation and an operational research project. During each of the three field postings, students were supposed to receive at least one supportive supervision visit from a NIE-based mentor. These supervision visits were either in the form of one-to-one student-mentor sessions or an on-site mini-contact session for states with more than one student. Finally, students had to investigate at least one outbreak of disease in two years.
Upon completion, students received a Master of Applied Epidemiology (MAE) degree from the Sree Chitra Tirunal Institute for Medical Sciences and Technology (SCTIMST), Thiruvanathapuram, Kerala, India. After graduation, they returned to their parent state and worked in public health. The institutional scientific advisory committee of NIE, an independent committee for MAE-FETP, called the Board of Studies (BoS) and a team from SCTIMST periodically reviewed the performance of the programme. Specifically, the BoS reviewed the academic conduct of the programme (i.e., curriculum, teaching and evaluation methods).
Logical model for the Field Epidemiology Training Programme (FETP), National Institute of Epidemiology (NIE), Chennai, Tamil Nadu, India, 2001–2007
· Scholars nominated by institutions
· Institutional recognition
· Faculty with institutional affiliation
· Mandate to investigate and/or access data
· Access to laboratory network
· Core competencies
· Field assignment of scholars
· Laboratory resources
· Equipment and supplies
· Selection process
· Curricular process
· Faculty development
· Learning-through-service field epidemiology projects
· Standardized procedures for laboratory confirmation
· Acquisition of competencies
· Documented, competency-based curriculum
· Qualified, experienced, autonomous team
· Disseminated field project reports
· Laboratory-documented investigations
· Candidates for faculty positions
· Workforce qualified in applied epidemiology
· Network of graduates
· Institutional training capacity
· Evidence-based public health decisions
· Self-sufficiency / sustainability of the programme
Evaluation indicators for the Field Epidemiology Training Programme (FETP), National Institute of Epidemiology (NIE), Chennai, Tamil Nadu, India, 2001-2007
▪ 86 applicants, of which 79 (92%) nominated by states
▪ Course recognized by Medical Council of India (MCI)
▪ Faculty with ICMR staff status
▪ Posting within the public health service
▪ Institutional links with ICMR and other Government laboratories
▪ 7 FETP-compatible core competenciesa
▪ Faculty -to- student ratio ranging from 0.40 to 0.12
▪ 75% of the time spent practicing in the field
▪ Laboratory resources
▪ Equipment and supplies
▪ All state-nominated candidates selectedb
▪ Curricular process documented and available on-line
▪ 1.3 supervision visits and 1.9 mini contact session/FETP course
▪ 76% to 100% fieldwork assignments rated at least “very useful” by graduates
▪ 66% graduates evaluating the laboratory component as insufficient
▪ 82% to 96% of learning activities rated “very useful” or better by graduates
▪ 63% graduates rating laboratory curriculum “fair” or less
▪ 69 graduates out of 80 students (86%)
▪ > 50% of graduates at least “proficient” for all competenciesc
▪ >50% of graduates rating supervisions as “good” or better
▪ 47 oral presentations
▪ 76/106 (72%) investigations with laboratory-confirmation
▪ 110 posters
▪ 29 publications
Self-assessed competencies among Field Epidemiology Training Programme (FETP) graduates, National Institute of Epidemiology (NIE), Chennai, Tamil Nadu, India, 2001–2007 a
Self assessed competency level
Before the programme
Upon completion of the programme
# with this answer
# with this answer
Core members of the faculty were ICMR staff (Table 2). The faculty-to-student ratio ranged between 0.4 (2002) and 0.12 per student (2007, expected standard: 0.25). In addition, a WHO technical adviser was present full-time for two years from 2004, half time for two years from 2006 and 10% of the time for one year from 2008. Graduates reported having been exposed to an average of 1.9 supervision visits and 1.3 mini-contact sessions in the field during their three field postings (against a theoretical expected total number of three). When asked to rate the supervision in its various forms according to time allocated, feedback quality, conviviality, usefulness and encouragements, the majority of students (mode and median) rated supervision as good (Second best behind exceptional on a scale of four) for all the criteria (Data not shown).
ICMR had its laboratory network, which allowed the sending of specimens to reference institutes. In addition, students developed links within their states, according to past collaboration histories. Laboratories covered the costs of testing. From 2005 onward, students also learned to work with the laboratory through a special laboratory-for-epidemiology module that was developed in collaboration with WHO headquarters and pilot tested in India. Twenty-four of 38 graduates (63%) from whom the information was available thought the laboratory component of the curriculum was relevant to their future career plans. However, 27/41 graduates (66%) assessed its quantity as “rather short” or “insufficient” and 26/41 (63%) assessed its quality as “fair” or less. Overall, of 106 outbreaks investigated, 91 (85%) had some form of laboratory documentation while 76 (72%) had a laboratory diagnosis (Table 2), without substantial variation over time (Data not shown).
All the programme graduates worked in state health departments in India. In 2009, six held leadership positions at the state level while the majority were working as programme managers at the district/sub-district level . The qualitative component of the survey reflected this as most graduates considered that the FETP had “somewhat advanced their career”. Since 2008, a formal network of graduates led to activities, including an e-mail forum. The development of the institutional training capacity in the context of the ICMR school of Public Health led NIE to also start a Master of Public Health in 2008. As of 2009, publication of FETP investigations of outbreaks of cholera , typhoid [16, 17], malaria [18, 19], hepatitis E  and measles [21, 22] provided shareable evidence of the use of epidemiological data to make public health decisions . While WHO funded the first two cohorts, the Government of India fully funded the programme from 2003 onwards to ensure sustainability. WHO, however, provided a technical adviser during 2004–2009.
During 2001–2007, the programme established itself and grew, using standard competencies . If the second cohort is left aside (start-up years faced initial difficulties), the number of graduates increased from 9 to 26 between 2003 and 2007 (+288% in five years). In states such as West Bengal, Orissa and Himachal Pradesh, the graduates played a crucial role, advocating with state governments for them to nominate candidates. The programme continued to achieve its objectives despite the increase in students. In addition to the acquisition of competencies, public health service was delivered through the production of information for action, some of which was reflected in conference presentations and publications. An excessive focus on such products could send the wrong message to public health managers who might perceive the programme as excessively academic. However, the constant increase in scientific production indicated that the quality was compatible with international standards. Moreover, as per prior studies, such products represent a useful indicator of future career success . Senior State level health managers acknowledged the contribution of the students towards improvements in health services either to the faculty member during the field supervision (Himachal Pradesh, Orissa) or at national level meetings (West Bengal) . Finally, the Indian public health system managed to retain this trained workforce in field positions even after graduation. This is similar to the experience of the EIS programme, wherein EIS officers assigned to the field had a tendency to stay in the field after graduation [8, 9].
Aside from strengths, we identified areas for improvement. One weakness was the faculty-to-student ratio that dropped under the level of 0.25 per student initially pledged. While this did not affect the programme quality according to the indicators examined, it placed the faculty under a pressure that could have longer-term adverse effects. Conscious of this issue, the management decreased the number of admissions from 26 in 2007 to 15 from 2008 onwards. In 2009, the management also implemented a new system to screen state-nominated applicants through a selection process. This will (1) restrict admissions to the best applicants and (2) advocate for the quality of the programme. This, in turn, may generate higher quality applications. Laboratory support was another area identified for improvement. Institutionalization of the collaboration between epidemiologists and laboratory scientists is key to a functional disease prevention system . From 2005 onwards, an increased utilization of the laboratory network of the Indian Integrated Disease Surveillance Project (IDSP) provided additional opportunities of laboratory confirmations. Finally, the use of computer programs to analyze data deserved more attention. This component of the curriculum faced a number of challenges, including (1) the heterogeneity of the target audience in terms of baseline computer skills, (2) the need for computers and statistical software and (3) the need for substantial faculty/tutor time.
Our evaluation suffered from three main limitations. First, for the purpose of this evaluation, the students self-assessed their competencies in the on-line survey. This could have over-estimated the competency level actually achieved. Second, this evaluation was only internal. Hence, we may have been subjective. To address this issue, we selected indicators that were as objective as possible and used a generic framework proposed by the United States CDC for FETPs. We also added a survey of graduates. Overall, we may have overlooked some of our limitations or generated an overly optimistic picture. However, our internal evaluation allowed us to identify areas that need improvement, which was our main objective. Third, our evaluation mainly focussed on input, process and output indicators of the programme. It did not address longer term outcomes and impact such as changes brought to the health system. These aspects will require a longer term perspective, maybe in the context of an external evaluation that our programme is willing to conduct in the future.
The establishment of a first FETP in India constitutes a proof of concept documenting that this approach was possible. Key innovations that this FETP brought to India included (1) the learning-through-service principle by which students in training deliver public health service and (2) the use of field epidemiology methods to investigate outbreaks using a sequence of descriptive and analytical epidemiology. Future work will need to focus on continuing investments in human resources to ensure a sufficient faculty-to-student ratio and additional curriculum innovations in the area of the laboratory and the use of statistical software. Most importantly, the FETP needs to be scaled up as the current number of graduates barely reaches about 10% of all the districts of the country that need a qualified epidemiologist. To provisionally address this gap, a shorter, two-week course was developed in 2008 to build basic epidemiological capacity in a lower-tier of professionals. This approach was also used in Germany  and Central America . The National Centre for Disease Control (formerly National Institute of Communicable Disease) in Delhi scaled up this two-week course to train district epidemiologists in the country and also started a Master of Public Health in Field Epidemiology in 2006. However, to reach a critical mass of field epidemiologists and scale up the various initiatives successfully into a full-dimension national FETP, additional organizations and institutions must participate, possibly involving MD (Community Medicine) programmes that have always been a reference in terms of public health training in India. Such partnership will require quality assurance and possibly, an accreditation mechanism. In parallel to scaling up efforts, additional work is needed so that the competencies identified, developed and taught in the context of the FETP can become professional competencies recognized and sought in the public health workforce in India .
The FETP India is funded by the Government of India, including the Indian Council of Medical Research (ICMR) and the Government of the various participating states. The WHO technical adviser to the FETP was funded by the United States Centers for Disease Control and Prevention (CDC). TEPHINET and WHO provided financial assistance to support the travel of FETP students to international conferences.
Dr Mohamed Patel and his colleagues from the Australian FETP (Master of Applied Epidemiology, Australian National University) provided key technical assistance at the beginning of the programme. We are grateful to Dr Ron Moolenaar (United States CDC) for comments on the manuscript.
- Koplan JP, Thacker SB: Fifty years of epidemiology at the Centers for Disease Control and Prevention: significant and consequential. Am J Epidemiol. 2001, 154: 982-984. 10.1093/aje/154.11.982.View ArticlePubMedGoogle Scholar
- Vastag B: Disease detectives celebrate 50 years of successful sleuthing. JAMA. 2001, 285: 1947-1949. 10.1001/jama.285.15.1947.View ArticlePubMedGoogle Scholar
- Thacker SB, Dannenberg AL, Hamilton DH: Epidemic intelligence service of the Centers for Disease Control and Prevention: 50 years of training and service in applied epidemiology. Am J Epidemiol. 2001, 154: 985-992. 10.1093/aje/154.11.985.View ArticlePubMedGoogle Scholar
- Music SI, Schultz MG: Field epidemiology training programs. New international health resources. JAMA. 1990, 263: 3309-3311. 10.1001/jama.1990.03440240099024.View ArticlePubMedGoogle Scholar
- Nsubuga P, White M, Fontaine R, Simone P: Training programmes for field epidemiology. Lancet. 2008, 371: 630-631. 10.1016/S0140-6736(08)60281-0.View ArticlePubMedGoogle Scholar
- White ME, McDonnell SM, Werker DH, Cardenas VM, Thacker SB: Partnerships in international applied epidemiology training and service, 1975–2001. Am J Epidemiol. 2001, 154: 993-999. 10.1093/aje/154.11.993.View ArticlePubMedGoogle Scholar
- Petersen LR, Ammon A, Hamouda O, Breuer T, Kiessling S, Bellach B, Niemer U, Bindert FJ, Ostroff S, Kurth R: Developing national epidemiologic capacity to meet the challenges of emerging infections in Germany. Emerg Infect Dis. 2000, 6: 576-584. 10.3201/eid0606.000605.View ArticlePubMedPubMed CentralGoogle Scholar
- Ragan P, Rowan A, Schulte J, Wiersma S: Florida Epidemic Intelligence Service Program: the first five years, 2001–2006. Publ Health Rep. 2008, 123 (Suppl 1): 21-27.Google Scholar
- Moolenaar RL, Thacker SB: Evaluation of field training in the epidemic intelligence service: publications and job choices. Am J Prev Med. 2004, 26: 299-306. 10.1016/j.amepre.2003.12.014.View ArticlePubMedGoogle Scholar
- CDC: Framework for program evaluation in public health. MMWR. 1999, 48: RR-11-Google Scholar
- Kumar MS, Murhekar MV, Hutin Y, Subramanian T, Ramachandran V, Gupte MD: Prevalence of posttraumatic stress disorder in a coastal fishing village in Tamil Nadu, India, after the December 2004 tsunami. Am J Public Health. 2007, 97: 99-101. 10.2105/AJPH.2005.071167.View ArticlePubMedPubMed CentralGoogle Scholar
- Seyler T, Hutin Y, Ramanchandran V, Ramakrishnan R, Manickam P, Murhekar M: Estimating the burden of disease and the economic cost due to chikungunya, Andhra Pradesh, India, 2005–2006. Trans RSoc Trop Med Hyg. 2010, 104: 133-138. 10.1016/j.trstmh.2009.07.014.View ArticleGoogle Scholar
- Kaur P, Ponniah M, Murhekar MV, Ramachandran V, Ramachandran R, Raju HK, Perumal V, Mishra AC, Gupte MD: Chikungunya outbreak, South India, 2006. Emerg Infect Dis. 2008, 14: 1623-1625. 10.3201/eid1410.070569.View ArticlePubMedPubMed CentralGoogle Scholar
- Murhekar MV: Ten years of Field Epidemiology Training Programme at National Institute of Epidemiology. South East Asia Regional Conference on Epidemiology. 2010, New Delhi, India,http://www.searo.who.int/en/Section10/Section2612_15287.htm,Google Scholar
- Das A, Manickam P, Hutin Y, Pattanaik B, Pal BB, Chhotray GP, Kar SK, Gupte MD: Two sequential outbreaks in two villages illustrate the various modes of transmission of cholera. Epidemiol Infect. 2009, 137: 906-912. 10.1017/S0950268808001611.View ArticlePubMedGoogle Scholar
- Sharma PK, Ramakrishnan R, Hutin Y, Manickam P, Gupte MD: Risk factors for typhoid in Darjeeling, West Bengal, India: evidence for practical action. Trop Med Int Health. 2009, 14: 696-702. 10.1111/j.1365-3156.2009.02283.x.View ArticlePubMedGoogle Scholar
- Bhunia R, Hutin Y, Ramakrishnan R, Pal N, Sen T, Murhekar M: A typhoid fever outbreak in a slum of South Dumdum municipality, West Bengal, India, 2007: evidence for foodborne and waterborne transmission. BMC Publ Health. 2009, 9: 115-10.1186/1471-2458-9-115.View ArticleGoogle Scholar
- Sharma PK, Ramakrishnan R, Hutin YJ, Gupte MD: Increasing incidence of malaria in Kurseong, Darjeeling District, West Bengal, India, 2000–2004. Trans R Soc Trop Med Hyg. 2009, 103: 691-697. 10.1016/j.trstmh.2008.07.019.View ArticlePubMedGoogle Scholar
- Sarkar J, Murhekar MV, Shah NK, Hutin Y: Risk factors for malaria deaths in Jalpaiguri district, West Bengal. India: evidence for further action. Malar J. 2009, 8: 133-10.1186/1475-2875-8-133.View ArticlePubMedPubMed CentralGoogle Scholar
- Sailaja B, Murhekar MV, Hutin YJ, Kuruva S, Murthy SP, Reddy KS, Rao GM, Gupte MD: Outbreak of waterborne hepatitis E in Hyderabad, India, 2005. Epidemiol Infect. 2009, 137: 234-240. 10.1017/S0950268808000952.View ArticlePubMedGoogle Scholar
- Mohan A, Murhekar MV, Wairgkar NS, Hutin YJ, Gupte MD: Measles transmission following the tsunami in a population with a high one-dose vaccination coverage, Tamil Nadu, India 2004–2005. BMC Infect Dis. 2006, 6: 143-10.1186/1471-2334-6-143.View ArticlePubMedPubMed CentralGoogle Scholar
- National Institute of Epidemiology (NIE): Meeting of the Third Epidemiology Forum: Networking of existing and prospective WHO collaborating institutes for epidemiology training in India. 2005, Chennai: NIEGoogle Scholar
- López A, Cáceres VM: Central America Field Epidemiology Training Program (CA FETP): a pathway to sustainable public health capacity development. Hum Resour Health. 2008, 6: 27-10.1186/1478-4491-6-27.View ArticlePubMedPubMed CentralGoogle Scholar
- Miner KR, Childers WK, Alperin M, Cioffi J, Hunt N: The MACH Model: from competencies to instruction and performance of the public health workforce. Public Health Rep. 2005, 120 (Suppl 1): 9-15.PubMedPubMed CentralGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.