Skip to main content

Task shifting in primary eye care: how sensitive and specific are common signs and symptoms to predict conditions requiring referral to specialist eye personnel?

Abstract

Background

The inclusion of primary eye care (PEC) in the scope of services provided by general primary health care (PHC) workers is a ‘task shifting’ strategy to help increase access to eye care in Africa. PEC training, in theory, teaches PHC workers to recognize specific symptoms and signs and to treat or refer according to these. We tested the sensitivity of these symptoms and signs at identifying significant eye pathology.

Methods

Specialized eye care personnel in three African countries evaluated specific symptoms and signs, using a torch alone, in patients who presented to eye clinics. Following this, they conducted a more thorough examination necessary to make a definite diagnosis and manage the patient. The sensitivities and specificities of the symptoms and signs for identifying eyes with conditions requiring referral or threatening sight were calculated.

Results

Sensitivities of individual symptoms and signs to detect sight threatening pathology ranged from 6.0% to 55.1%; specificities ranged from 8.6 to 98.9. Using a combination of symptoms or signs increased the sensitivity to 80.8 but specificity was 53.2.

Conclusions

In this study, the sensitivity and specificity of commonly used symptoms and signs were too low to be useful in guiding PHC workers to accurately identify and refer patients with eye complaints. This raises the question of whether this task shifting strategy is likely to contribute to reducing visual loss or to providing an acceptable quality service.

Résumé

Contexte

L’inclusion des soins de la vue primaires dans la liste des services offerts par les fournisseurs de soins de santé primaires s’inscrit dans une stratégie de « délégation de tâches » visant à améliorer l’accès aux soins de la vue en Afrique. En théorie, la formation en soins de la vue primaires enseigne à ces fournisseurs à reconnaître des signes et symptômes précis ainsi qu’à traiter et à aiguiller les cas en fonction de ceux-ci. Nous avons mesuré la sensibilité et la spécificité de ces signes et symptômes permettant de détecter les pathologies oculaires importantes.

Méthodes

Des employés spécialisés en soins de la vue de trois pays africains ont évalué, à l’aide d’une lampe, les signes et symptômes particuliers que présentaient les patients qui s’étaient rendus à leur clinique. Ils ont ensuite procédé à un examen plus complet, nécessaire pour établir des diagnostics définitifs et gérer les cas en question. On a ainsi mesuré la sensibilité et la spécificité des signes et symptômes permettant de détecter les pathologies oculaires nécessitant un aiguillage vers un spécialiste ou menaçant la vue du patient.

Résultats

La sensibilité permettant de détecter les pathologies menaçant la vue allait de 6,0 % à 55,1 % selon le signe ou le symptôme; la spécificité, quant à elle, allait de 8,6 % à 98,9 % selon le signe ou le symptôme. Si l’on combinait tous les signes et symptômes, la sensibilité montait à 80,8 %, mais la spécificité était de 53,2 %.

Conclusions

Dans le cadre de cette étude, la sensibilité et la spécificité des signes et symptômes courants étaient trop faibles pour être utiles aux fournisseurs de soins de santé primaires, qui doivent détecter avec précision les pathologies oculaires et aiguiller les patients. À la lumière de ces résultats, on peut se demander si la stratégie de délégation de tâches peut aider à réduire l’incidence de la perte de la vue ou à offrir des services d’une qualité acceptable.

Background

Blindness and visual impairment constitute a public health problem in sub-Saharan African countries. In response to this, and recognizing that about 80% of blindness is avoidable, the World Health Organization (WHO) and the International Agency for the Prevention of Blindness (IAPB) have elaborated and launched “VISION 2020 – The Right to Sight” for the elimination of avoidable blindness by the year 2020 [1]. One of the important constraints to achieving this goal is the shortage of health workers trained in eye care [2]. In an effort to overcome this, primary eye care (PEC) as an integral part of primary health care (PHC) has been recommended as a key strategy. PEC means different things in different parts of the world [3]. In settings with more resources, “primary eye care” refers to services delivered by nurses and health assistants who are trained for and work more or less exclusively in eye care, such as ophthalmic clinical officers or ophthalmic nurses and assistants. These “dedicated eye workers” exist in sub-Saharan Africa, but are usually considered “mid-level” eye care workers, stationed at secondary or even tertiary centers. PEC, in sub-Saharan Africa, is considered to be eye care delivered at the primary health care level, by general PHC workers who are also responsible for immunization, maternal child health, and other primary health care duties [3]. Thus PEC is an example of “task shifting,” i.e., shifting the provision of basic eye services from dedicated eye workers to general health workers at the primary level. One presumed advantage of this is to make eye services more accessible at the community level.

Since managing ocular complaints is a small part of their workload, PHC workers will have limited expertise in eye care. There is evidence that PHC workers sometimes overstep their competence in treating conditions, and ready availability of ocular antibiotics can lead to a false sense of security in “treating” patients with eye problems [4, 5]. Easy access to antibiotic eye ointment such as tetracycline was possibly useful in an era when trachomatous conjuctivitis was very common, but trachoma has declined in many parts of Africa [6]. PEC training for PHC workers, although not standardized, usually focuses on the recognition of specific signs and symptoms as triggers for treatment or referral. These are signs and symptoms that are emphasized in most ophthalmology textbooks and that can indicate serious problems when considered in the context of patient history and further examination. Symptoms include complaints of difficulty seeing or pain; signs include reduced visual acuity, redness (hyperemia), lack of corneal clarity, and abnormal appearance of the pupils. Most training in primary eye care emphasizes the importance of some or all of these and they are presumed to be relatively easy to evaluate by history taking and examination with a torch.

To our knowledge, the sensitivity and specificity of basic symptoms and signs included in PEC training to guide management has not been quantified; but this knowledge would be key to know how well we can expect PHC workers to use these to provide a reasonable standard of eye care. We undertook this study in order to test the sensitivity and specificity of several symptoms and signs when evaluated by experienced eye care providers. We chose to test the value of the signs and symptoms when evaluated by experienced eye care providers rather than by PEC workers in order to test the intrinsic value of the signs and symptoms and not the ability of the PHC workers to evaluate them.

Methods

The study was conducted prospectively in the context of routine examinations of new patients who presented consecutively to eye clinics, without special referrals. The clinics were in eye departments in general hospitals and all accepted walk-in, self-referred patients; thus they represent patients who present to first line health care workers. The examiners were ophthalmologists and ophthalmic clinical officers employed in 11 eye clinics (5 in Madagascar, 3 in Malawi and 3 in Rwanda). Each examiner was asked to enroll at least 100 new patients sequentially. Standardized forms were used to collect the information.

The visual acuity was measured and recorded on the form before the examination began. The examiner then asked the patient specifically if he had a problem with distance or near vision, pain, discharge or itching in either eye. Then the examiner assessed whether the eyes were red, pupil was black, eyes were straight, and lids closed normally, using only a torch. Examiners were instructed to try to conduct this examination as objectively as possible.

After these data were recorded, the examiner conducted an examination according to his usual practices, using a slit lamp, ophthalmoscope, and dilation of the pupil or whatever else he judged necessary to make a definite diagnosis and manage the patient. After this more thorough examination, he recorded the diagnosis for each eye as normal or selected all that applied of the following 10 diagnoses: cataract, glaucoma, conjunctivitis, keratitis, uveitis, retinal disease, eyelid disease, neuro-ophthalmologic disease, refractive error, and “other”. “Normal” eyes had to have a visual acuity of 6/18 or better. Examiners were instructed not to go back and make any changes in the initial torch exam following their more thorough examination and management decision.

Forms were sent by post to one center for data entry and analysis. Double data entry was performed using Epi Data and data entry errors were reconciled. Then data were imported into Stata 11 for tabulation of frequencies of the signs and symptoms and of final diagnoses; these were used to calculate sensitivity, specificity and predictive values.

We defined “serious” eye diagnoses as those that would require referral to specialist eye care personnel for management. This included all diagnoses except “normal” and conjunctivitis. We calculated sensitivity, specificity, and predictive values (positive and negative) for identifying serious diagnoses for each of the subjective symptoms and the signs recorded from the torch examination. We also combined signs and symptoms into “referral criteria” and tested the sensitivity of these.

Recognizing that there might be other definitions of “serious” in ocular pathology, we calculated sensitivity, specificity, and predictive values of the signs and symptoms to identify sight threatening (ST) and non-sight threatening (NST) conditions, where the latter included diagnoses of normal, conjunctivitis or refractive error (including presbyopia).

Results

We collected observations on 494, 313, and 490 patients (total = 1297) from Madagascar, Malawi, and Rwanda, respectively. The mean ages were 40.8, 37.4, and 36.9 years; males comprised 42.3%, 42.5%, and 44.4% of the populations, respectively, for Madagascar, Malawi, and Rwanda. The Malagasy patients were more likely to have refractive errors (including presbyopia) than the patients in Malawi and Rwanda but the frequency of other diagnoses was similar. We analysed right and left eyes separately; they were very similar so we report only on right eyes.

Table 1 shows the sensitivity, specificity, and predictive value for individual signs and symptoms. In this population, a complaint of “poor near vision” was the most sensitive sign of a diagnosis requiring specialist care, but sensitivity was only 52.9%. All other signs and symptoms had lower sensitivities, ranging from 4.1% to 47.4%.

Table 1 Value of signs and symptoms for differentiating "serious" from "non-serious" eye conditions

Table 2 illustrates the results when referral criteria #1 (VA<6/18 or pain) and referral criteria #2 (VA<6/18 or pain or red eye) were used. These provided sensitivities of 64.0% and 69.1%, respectively, while specificities were 60.4% and 50.6%.

Table 2 Sensitivity, specificity and predictive value for two other referral criteria

Table 3 shows the sensitivity, specificity, and predictive values for identifying “sight threatening conditions” as defined in the methods above. A complaint of poor distance vision had the highest sensitivity (51.9%). Table 4 shows the results of using referral criteria # 1 or #2 to identify “sight threatening conditions.” These criteria provided sensitivities of 74.5% and 80.9%, respectively.

Table 3 Value of signs and symptoms for differentiating "sight threatening" from "non-sight threatening" eye conditions
Table 4 Sensitivity, specificity and predictive value for two other referral criteria

There were no significant differences in the sensitivities and specificities among the three countries.

Discussion

Task shifting from a higher trained to a lesser trained cadre is one suggested solution to the health workforce shortage in Africa. The success of this strategy will depend on many factors including, but not limited to, proper supervision [7] and the existence of proven indicators (tests or criteria) that can be used by health care workers without the benefit of much experience, to make good management decisions. The latter requirement, that there be reliable indicators, is critical in any scheme to shift tasks from highly competent specialist medical personnel with in-depth knowledge to generalist health workers with limited specialist knowledge, experience, and equipment, while avoiding an unacceptable decrease in quality of care. The development of successful algorithms and training for primary health care workers is based on likelihoods that specific, easily identifiable signs (indicators) reflect certain pathophysiologic processes. The existence and identification of such indicators determines to a large extent whether it is reasonable to expect a minimally experienced generalist cadre to manage specialist medical conditions. If such indicators cannot be identified then it may not be reasonable to expect “task shifting” to be successful. Useful indicators need to be simple to use and should have high sensitivity and specificity. Sensitivity and specificity are measures of the accuracy of a diagnostic test to detect a condition and, unlike predictive value, do not depend on the prevalence of the condition in the population [8].

In this study, we considered several symptoms and signs that are indicative of eye health and would likely be included in training of PHC workers to help with decision making. We treated these signs and symptoms as diagnostic tests to see how accurately they predicted whether patients in an eye clinic had “serious” eye conditions requiring referral for specialist care. These signs and symptoms are regularly considered by ophthalmic professionals to evaluate patients, however they are supplemented by a considerable body of additional knowledge of the many and varied pathological conditions that can affect the eye. Furthermore, ophthalmic professionals depend on a number of sophisticated instruments and tests in order to detect redness (inflammation), or a pupil that is not “black,” or eyes that are not straight. The possibility of correctly diagnosing many eye conditions, particularly at an early stage, depends on examination with instruments more complex than a torch. The sensitivity of the single symptoms and signs we tested here, evaluated with a torch alone, even by experienced ophthalmic professionals, was very low. High sensitivity (identifying a high percentage of people who have a problem) is particularly important in order to avoid missing conditions that require further evaluation and treatment.

While combinations of symptoms and signs (referral criteria #1 and #2) improved the sensitivity somewhat, the resulting sensitivities were still unacceptably low. As more symptoms and signs are included in the criteria for referral, the sensitivity will increase further, however the specificity will become negligible, resulting in a situation where nearly all patients would be referred. Not only is this inefficient and counterproductive, but it could undermine any confidence of the community in the PHC workers providing eye care.

It is interesting to note that the sensitivity and specificity of these common symptoms and signs has not been tested before in view of the frequent calls for scaling up PEC in Africa. The sensitivity and specificity for several other ocular tests used by non-ophthalmic health personnel including the red reflex, confrontation visual fields, and penlight test for photophobia to detect “serious” pathology has been measured with various results [913]. Recognition of the difficulty in determining when an eye is “red” has required investigators interested in conjunctival hyperemia to develop different grading schemes [14, 15].

Experience over time, as well as more sophisticated instruments, informs ophthalmic professionals’ decision making. PHC workers might improve their decision making ability with time, however, considering the wide variety of conditions they are expected to deal with every day (many life threatening), it is unrealistic to expect them to gain a lot of experience with eye care patients. We have previously documented that PHC centers in a study in Tanzania see only three eye patients per month on average [16]. It is higher than this in some settings (unpublished data) but still constitutes a minor part of the PHC workers’ duties. Thus, opportunities to practice skills are very limited and experience will remain low amongst this cadre.

The VISION 2020 initiative focuses on cataract since this is responsible for around 50% of blindness in Africa [17]. While a white pupil is indeed a very specific sign for cataract, this sign only indicates very advanced cataracts, when visual acuity has deteriorated to the level of ability to detect light only; this is below the World Health Organization definition of blindness (less than 3/60). Increasingly, patients want and need surgery well before this stage, but diagnosis at earlier stages requires an ophthalmoscope.

There are several limitations to this study. Calculation of sensitivity and specificity depends on having a gold standard. In this case we assumed that the diagnoses made by a group of experienced ophthalmologists or ophthalmic clinical officer would be correct. We did not, however, measure interobserver agreement in diagnoses among our “gold standards” nor provide strict diagnostic criteria. Some data forms were not filled in completely, as evidenced by the missing data in the Tables. Another limitation is that we determined what would constitute “serious” disease post hoc, after data collection but before analysis, partly to decrease the potential for bias among the examiners; however we do not expect either of the two definitions we used to be particularly controversial among ophthalmologists. Finally, the population in this study may not be representative of those patients who would present at PHC centers; on the other hand, since these were all new patients to the eye clinics, and no referrals were required, they may be reasonably representative of problems in the community.

In spite of the limitations, we believe that this work raises important questions about the current concept of PEC as a strategy to achieve VISION 2020 goals in sub-Saharan Africa. More testing of the validity of this concept is required. This includes a number of interrelated issues including testing PEC curricula for their usefulness in informing patient management, testing PHC workers’ ability to reliably detect key symptoms and signs, testing how well PEC management guidelines are adhered to by PHC workers, and exploring community attitudes towards PEC delivered at PHC centers. The second issue is described in a companion paper in this issue.

Conclusions

The sensitivity of symptoms and signs commonly used to help PHC workers to manage eye disease was unacceptably low in this study. These findings need to be tested in other settings and more rigorously. Case identification and proper referral are pillars of primary care; if tools that allow general PHC workers to provide this are not being used, or do not exist, then we need to reconsider whether primary eye care is better provided by a more specialized cadre. PHC workers could be more usefully trained to focus on eye health education messages and less on clinical diagnosis and management of patients.

Abbreviations

DFATD:

Foreign Affairs, Trade and Development Canada

GHRI:

Global Health Research Initiative

IDRC:

International Development Research Centre

NPV:

negative predictive value

NST:

non-sight threatening

PEC:

primary eye care

PHC:

primary health care

PPV:

positive predictive value

ST:

sight threatening

VA:

visual acuity

References

  1. McGavin DD: The global initiative for the elimination of avoidable blindness - vision 2020: the right to sight. Community Eye Health. 1999, 12 (30): 32-

    PubMed Central  CAS  PubMed  Google Scholar 

  2. Resnikoff S, Felch W, Gauthier TM, Spivey B: The number of ophthalmologists in practice and training worldwide: a growing gap despite more than 200,000 practitioners. Br J Ophthalmol. 2012, 96 (6): 783-787. 10.1136/bjophthalmol-2011-301378.

    Article  PubMed  Google Scholar 

  3. Courtright P, Seneadza A, Mathenge W, Eliah E, Lewallen S: Primary eye care in sub-Saharan African: do we have the evidence needed to scale up training and service delivery?. Ann Trop Med Parasitol. 2010, 104 (5): 361-367. 10.1179/136485910X12743554760225.

    Article  CAS  PubMed  Google Scholar 

  4. Al-Attas AH, Williams CD, Pitchforth EL, O'Callaghan CO, Lewallen S: Understanding delay in accessing specialist emergency eye care in a developing country: Eye trauma in Tanzania. Ophthalmic Epidemiol. 2010, 17 (2): 103-112. 10.3109/09286580903453522.

    Article  PubMed  Google Scholar 

  5. Statham MO, Sharma A, Pane AR: Misdiagnosis of acute eye diseases by primary health care providers: incidence and implications. Med J Aust. 2008, 189 (7): 402-404.

    PubMed  Google Scholar 

  6. Burton MJ, Mabey DC: The global burden of trachoma: a review. PLoS Negl Trop Dis. 2009, 3 (10): e460-10.1371/journal.pntd.0000460.

    Article  PubMed Central  PubMed  Google Scholar 

  7. Bosch-Capblanch X, Garner P: Primary health care supervision in developing countries. Trop Med Int Health. 2008, 13 (3): 369-383. 10.1111/j.1365-3156.2008.02012.x.

    Article  PubMed  Google Scholar 

  8. Akobeng AK: Understanding diagnostic tests 1: sensitivity, specificity and predictive values. Acta Paediatr. 2007, 96 (3): 338-341. 10.1111/j.1651-2227.2006.00180.x.

    Article  PubMed  Google Scholar 

  9. Yaphe J, Pandher KS: The predictive value of the penlight test for photophobia for serious eye pathology in general practice. Fam Pract. 2003, 20 (4): 425-427. 10.1093/fampra/cmg416.

    Article  PubMed  Google Scholar 

  10. Pon JA, Bevin TH, Herbison P, Taylor BJ, Sanderson G: A novel instrument for assessing the retinal red reflex for non-ophthalmic health professionals. Clin Exp Optom. 2005, 88 (3): 160-164. 10.1111/j.1444-0938.2005.tb06689.x.

    Article  PubMed  Google Scholar 

  11. Kerr NM, Chew SS, Eady EK, Gamble GD, Danesh-Meyer HV: Diagnostic accuracy of confrontation visual field tests. Neurology. 2010, 74 (15): 1184-1190. 10.1212/WNL.0b013e3181d90017.

    Article  CAS  PubMed  Google Scholar 

  12. Saiju R, Yun S, Yoon PD, Shrestha MK, Shrestha UD: Bruckner red light reflex test in a hospital setting. Kathmandu Univ Med J (KUMJ). 2012, 10 (38): 23-26.

    CAS  Google Scholar 

  13. Gole GA, Douglas LM: Validity of the Bruckner reflex in the detection of amblyopia. Aust N Z J Ophthalmol. 1995, 23 (4): 281-285. 10.1111/j.1442-9071.1995.tb00177.x.

    Article  CAS  PubMed  Google Scholar 

  14. Murphy PJ, Lau JS, Sim MM, Woods RL: How red is a white eye? Clinical grading of normal conjunctival hyperaemia. Eye (Lond). 2007, 21 (5): 633-638.

    CAS  Google Scholar 

  15. Papas EB: Key factors in the subjective and objective assessment of conjunctival erythema. Invest Ophthalmol Vis Sci. 2000, 41 (3): 687-691.

    CAS  PubMed  Google Scholar 

  16. Byamukama E, Courtright P: Knowledge, skills, and productivity in primary eye care among health workers in Tanzania: need for reassessment of expectations?. International Health. 2010, 2 (4): 247-252. 10.1016/j.inhe.2010.07.008.

    Article  PubMed  Google Scholar 

  17. Pascolini D, Mariotti SP: Global estimates of visual impairment: 2010. Br J Ophthalmol. 2012, 96 (5): 614-618. 10.1136/bjophthalmol-2011-300539.

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

This work was carried out with support from the Global Health Research Initiative (GHRI), a research funding partnership composed of the Canadian Institutes of Health Research, Foreign Affairs, Trade and Development Canada, and the International Development Research Centre.

This work was carried out with the aid of a grant from the International Development Research Centre (IDRC), Ottawa, Canada, and with the financial support of the Government of Canada provided through Foreign Affairs, Trade and Development Canada (DFATD).

The following individuals examined patients and provided data for this study: Dr. Richard Andriamampihantona, Dr. Jean Baptiste Randrianaivo, Dr. Diarimirindra Lazaharivony Tendrisoa, Dr. Philippe Rakotondrajoa, Dr. Lucia Soatsara, Mr Fidèle Kayisire, Ms Marie Josée Uwisunze, and Mr Ladislas Nshimiyimana.

Declarations

The publication costs associated with this article are funded by Foreign Affairs, Trade and Development Canada and the International Development Research Centre through the Global Health Research Initiative.

This article has been published as part of Human Resources for Health Volume 12 Supplement 1, 2014: Addressing the human resources for health crisis through task-shifting and retention: results from the Africa Health Systems Initiative's research component. The full contents of the supplement are available online at http://www.human-resources-health.com/supplements/12/S1

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Susan Lewallen.

Additional information

Competing interests

None of the authors have any competing interests.

Authors’ contributions

All authors were involved in designing the study. HHM, WM, and KK implemented the study and supervised data collection. SL and PC analysed data. All authors contributed to the final manuscript.

Rights and permissions

Open Access  This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made.

The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.

To view a copy of this licence, visit https://creativecommons.org/licenses/by/4.0/.

The Creative Commons Public Domain Dedication waiver (https://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Andriamanjato, H.H., Mathenge, W., Kalua, K. et al. Task shifting in primary eye care: how sensitive and specific are common signs and symptoms to predict conditions requiring referral to specialist eye personnel?. Hum Resour Health 12 (Suppl 1), S3 (2014). https://doi.org/10.1186/1478-4491-12-S1-S3

Download citation

  • Published:

  • DOI: https://doi.org/10.1186/1478-4491-12-S1-S3