|Year : 2020 | Volume
| Issue : 1 | Page : 36-42
Restructuring the modified Faine's criteria for the diagnosis of leptospirosis in monsoon: A study from south Gujarat
UC Samudyatha, Vipul Chaudhari, Naresh Chauhan, Rahul Damor, JK Kosambiya, Rikita Munshi
Department of Community Medicine, Government Medical College, Surat, Gujarat, India
|Date of Submission||27-Apr-2019|
|Date of Acceptance||21-Nov-2019|
|Date of Web Publication||14-Jan-2020|
Dr. U C Samudyatha
Department of Community Medicine, Government Medical College, Surat, Gujarat, India
Source of Support: None, Conflict of Interest: None
| Abstract|| |
Context: Clinical and epidemiological variables in the modified Faine's criteria offered low validity in our study setting. Aims: Restructuring and validating modified Faine's criteria for leptospirosis to better suit health scenario of south Gujarat. Subjects and Methods: Clinical, epidemiological, and laboratory features of derivation cohort (1216 suspected leptospirosis cases) admitted at a tertiary care hospital of south Gujarat (2007–2015) that significantly correlated with confirmed leptospirosis were used in binary logistic regression to derive scoring models and receiver operating characteristic to determine cutoff values. Validity and net reclassification improvement (NRI) were estimated in validation cohort (82 cases, 2016–2017) and algorithm for diagnosis was prepared. Results: Screening model consisted of the presence of conjunctival suffusion, calf tenderness, raised serum creatinine, headache with conjunctival suffusion and/or jaundice, and dyspnea/meningism. Area under curve (AUC) for screening model was 0.590 (standard error [SE] ±0.017) and cutoff score ≥9 gave sensitivity 79.16%, specificity 50%. The confirmatory model consisted of laboratory parameters, namely polymerase chain reaction, immunoglobulin M ELISA, and microscopic agglutination test and gave AUC 0.998 (SE ± 0.001), sensitivity 89.58%, specificity 85.29%, positive predictive value 89.58%, and negative predictive value 85.29% at cutoff score ≥100. Net sensitivity of algorithm was 98.27% at the point of screening (screening model and rapid test) and net specificity 87.89% at the point of confirmation (screening followed by confirmatory model) in validation cohort. Conclusions: Simultaneous use of screening model and rapid test gave NRI 81.25% and sequential use of confirmatory test gave NRI 47.18% compared to corresponding parts of the modified Faine's criteria.
Keywords: Microscopic agglutination test, modified Faine's criteria, net reclassification improvement, polymerase chain reaction
|How to cite this article:|
Samudyatha U C, Chaudhari V, Chauhan N, Damor R, Kosambiya J K, Munshi R. Restructuring the modified Faine's criteria for the diagnosis of leptospirosis in monsoon: A study from south Gujarat. Indian J Community Med 2020;45:36-42
|How to cite this URL:|
Samudyatha U C, Chaudhari V, Chauhan N, Damor R, Kosambiya J K, Munshi R. Restructuring the modified Faine's criteria for the diagnosis of leptospirosis in monsoon: A study from south Gujarat. Indian J Community Med [serial online] 2020 [cited 2020 Jan 18];45:36-42. Available from: http://www.ijcm.org.in/text.asp?2020/45/1/36/275944
| Introduction|| |
Leptospirosis is an anthropozoonosis, endemic in several parts of the world, including south Gujarat, India. It has a strong association with annual rainfall in the given region., The clinical features of leptospirosis are highly variable and are broadly classified into four categories:,
- A mild, infectious-like illness
- Weil's syndrome, characterized by jaundice, renal failure, hemorrhage, and myocarditis
- Pulmonary hemorrhage with respiratory failure.
However, the pattern and combinations of these clinical features can be varied. Moreover, these clinical features are common to a number of other common diseases such as dengue, malaria, typhoid, tuberculosis, scrub typhus, influenza, pneumonia, urinary tract infections, sepsis, and viral hepatitis. This makes the early diagnosis of leptospirosis a challenge, especially in a season like monsoon.
While the laboratory diagnosis of leptospirosis is relatively conclusive with the advent of advanced microbiological tests like polymerase chain reaction (PCR) and microscopic agglutination test (MAT), these are not used as the first line of investigations in resource-poor settings. Moreover, these tests require time to yield results. All these, together, lead to delay in the initiation of specific management in these cases. Furthermore, different case definitions,,,, have further made the confirmation of leptospirosis nonuniform.
To ease the diagnosis of leptospirosis, the WHO introduced the Faine's criteria. This was later modified as per the Indian scenario [Table 1]. However, our experience and some studies showed that modified Faine's criteria had positive predictive value (PPV) of 21%–25%. Hence, we conceptualized this study with following aim and objectives:
|Table 1: Modified Faine's criteria (2012) (scores) for the diagnosis of leptospirosis in cases of acute febrile illness|
Click here to view
Restructuring the modified Faine's criteria to improve its utility as both screening tool and confirmatory tool.
- Identify the variables that are associated with the diagnosis of leptospirosis and restructure modified Faine's criteria
- To develop a diagnostic algorithm to make the practical use of these screening and confirmatory models for the diagnosis of leptospirosis.
| Subjects and Methods|| |
This diagnostic study was conducted in a tertiary care hospital in south Gujarat, India, where leptospirosis is endemic, and the Department of Community Medicine is nodal agency for routine leptospirosis surveillance. A prestructured format predominantly including variables in the modified Faine's criteria [Table 1] was prepared to compile the data required for the study from this leptospirosis control program data (2007–2017). The data compilation and analysis were carried out in October–December 2017.
The following case definitions were used in this study:
- Suspected case of leptospirosis was defined as a case of febrile illness presenting with the clinical symptoms of leptospirosis as mentioned. Patients who had clear cut diagnostic features of other diseases at the time of admission were excluded from the study.
Several studies, have used the definition given by the WHO for suspected leptospirosis, which includes the presence of acute febrile illness with headache, myalgia, and prostration associated with any other clinical signs. However, in this study, these were taken as additional symptoms and not as case defining symptoms, to decrease the false negatives.
- Confirmed case of leptospirosis (Leptospirosis Burden Epidemiology Reference Group [LERG-2] criteria) was defined as a suspected case of leptospirosis with any of the following:
- Four-fold rise in MAT titer in acute and convalescent serum samples
- MAT titer ≥1:400 in single or paired serum samples
- Isolation of pathogenic leptospira in the clinical sample
- Detection of leptospira species in the clinical sample
- Pathogenic leptospira species DNA detected by PCR.
In the first phase, data of 46 cases of suspected leptospirosis patients who were admitted in 2017 were collected to evaluate the accuracy of different existing diagnostic criteria of leptospirosis (modified Faine's criteria, immunoglobulin M ELISA, MAT, and PCR) with LERG-2 criteria as the reference standard.
In the second phase, data of all cases of suspected leptospirosis admitted between 2007 and 2017 were included in the study. This being a diagnostic study, we were required to have a derivation cohort consisting of a large data set or participants. The features (variables) of these participants and the final diagnosis had to be correlated. The significantly correlated variables could be used as predictors in binary logistic regression equation for the final diagnosis and the prediction model could be developed. To check the validity of the prediction model, the model had to be applied to a smaller, new set of participants known as validation cohort. In this study, the cases from 2007 to 2015 (1216 cases) were included in the derivation cohort and cases from 2016 to 17 (82 cases) in the validation cohort. All cases which had confirmatory diagnosis of nonleptospirosis fever on admission were excluded from the study.
The screening model was developed by including those features that could be assessed in the peripheral health centers such as clinical features, epidemiological features, and minimal laboratory investigations. The confirmatory model included microbiological tests done at tertiary care hospitals. The features were correlated with confirmed diagnosis of leptospirosis. The features that positively and significantly correlated with the diagnosis of leptospirosis were used in binary logistic regression models (enter method). The b-coefficients of these variables were rounded off to the nearest integer and multiplied by a common factor of 10, which was designated as the score of the variable. Regression was done to derive the scores, and hence, the positively correlated variables that had clinical significance were included in the final models, even if the odds ratio was insignificant. Apart from these, “presence of Dyspnea or Meningism” was included as a variable in screening model to account for the transition in clinical manifestations of the disease over the past 10 years. The sensitivity, specificity, predictive values, and area under curve (AUC) were obtained from the derivation cohort. The models were validated in the validation cohort.
An algorithm for screening and confirming leptospirosis was prepared using results.
To know the benefit of the new algorithm over the existing modified Faine's criteria, net reclassification improvement (NRI) was calculated using the formula:
NRI = (up∣confirmed leptospirosis) − (down∣confirmed leptospirosis) +
(down∣nonleptospirosis fever) − (up∣nonleptospirosis fever).
where (up ∣ confirmed Leptospirosis fever) referred to the proportion of confirmed cases that were previously considered as nonleptospirosis using modified Faine's criteria but reclassified as cases of leptospirosis using the models derived in the study. The other terms were defined similarly. The data were entered in Microsoft Excel 2007 (Microsoft Corp., Washington, USA) and analyzed using IBM SPSS Statistics for Windows, Version 23 (IBM Corp., Armonk, N.Y., USA)
The study was approved by the Institutional Review Board.
| Results|| |
The existing diagnostic criteria and tools for leptospirosis can be divided into those that can be assessed in peripheral health centers (clinical, epidemiological, and minimal laboratory) and those that can be assessed in tertiary care hospitals (microbiological). [Table 2] shows that those existing criteria that can be used at peripheral health centers offer either low sensitivity or low predictive values. Similarly, the criteria that can be used at tertiary care (which must be confirmatory) offer low specificity.
|Table 2: Validity of different diagnostic criteria of leptospirosis (with Leptospirosis Burden Epidemiology Reference Group-2 criteria as reference standard)|
Click here to view
The age–sex distribution and proportion of confirmed cases in the derivation and validation cohorts were similar (P > 0.05).
In the derivation cohort, correlation of various signs, symptoms, and laboratory investigations with leptospirosis and nonleptospirosis fever was done. Along with the variables in the modified Faine's criteria, the presence of some of these symptoms in combination was also considered [Table 3].
Conjunctival suffusion, myalgia, raised serum creatinine, the presence of headache with conjunctival suffusion or jaundice or both were found to be significantly and positively correlated to leptospirosis, and they were included in the screening model [Table 3].
The receiver operating characteristic (ROC) of the screening model is denoted by curve C in [Figure 1].
The AUC of ROC of the screening model was 0.590 (standard error [SE] ±0.017). The cutoff score value was determined to be ≥9.
A score of 10 was given for a positive rapid test (b coefficient 1.047).
The confirmatory model was developed by including the microbiological tests [Table 3].
The ROC for the confirmatory model is depicted by curve E in [Figure 1].
The AUC of the confirmatory model was 0.998 (SE ± 0.001). To get higher specificity, the cutoff value was set at 100.
Validation of the screening model, leptospirosis rapid test, and confirmation model in derivation and validation cohorts was done [Table 4].
|Table 4: Validity of the models with Leptospirosis Burden Epidemiology Reference Group-2 as reference standard in derivation and validation cohorts|
Click here to view
It was found that the addition of scores of screening model, leptospirosis rapid test, and confirmatory model yielded higher sensitivity and similar specificity when compared to the use of confirmatory model alone in the derivation cohort. To derive higher sensitivity at the point of screening and higher specificity at the point of confirmation, we developed an algorithm [Figure 2].
The net sensitivity of simultaneous use of screening model and leptospirosis rapid test was calculated as 84.92% in the derivation cohort and 98.27% in the validation cohort. The specificity reduced to 31% and 17%, respectively. However, the sequential use of screening model and leptospirosis rapid test followed by confirmatory model gave net sensitivity 80% and 88% and net specificity of 99.5% and 87.89% in derivation and validation cohorts, respectively.
The NRI of screening model over the modified Faine's criteria parts A + B was 43.99% and 41.79% when the rapid test was used. When both screening model and rapid test were used simultaneously, the NRI was 81.25% [Table 5].
|Table 5: Net reclassification improvement following the use of algorithm compared to modified Faine's criteria in validation cohort|
Click here to view
The simultaneous use of the screening model and rapid test with sequential use of confirmatory test has an NRI of 47.18% over the modified Faine's criteria parts A, B, and C.
| Discussion|| |
South Gujarat is located in the western part of the Indian peninsula. Leptospirosis is endemic in this region. It is an established fact that the Leptospirosis is a zoonotic disease and the transmission occurs through a variety of animal contact or contact with the contaminated environment such as in rainy season (monsoon), and during floods. However when dealing with patients with fever from one geographical area who have all been exposed to rainfall/flood and history of animal contact is often vague, not recollected or unnoticed, the exposure to epidemiological factors (part B of modified Faine's criteria) cannot be used in a scoring system to distinguish leptospirosis from nonleptospirosis fever in monsoon.
We found that restructuring modified Faine's criteria by changing some variables and assigning new weights (scores) to features (variables) helped to improve diagnostic accuracy and its usefulness as screening and confirmatory tool. The algorithm we have developed based on this study provides a net sensitivity of 84.92% at the point of screening (using screening model and leptospirosis rapid test). Thus, more patients were correctly diagnosed at the point of screening when compared to modified Faine's criteria (part A + B), with NRI of 81.25%. At the point of confirmation, net specificity of 99.52% at the point of confirmation (sequential use of screening followed by confirmatory model) was achieved with NRI of 47.18% over modified Faine's criteria (part A + B + C).
Both the screening and confirmatory models have obtained higher accuracy when compared to modified Faine's criteria. Rajpakse et al. carried out a prospective study and developed a model that included a history of exposure to contaminated source and laboratory investigations such as serum creatinine, neutrophil differential percentage, serum bilirubin, and platelet count. They achieved a sensitivity of 80.3%, specificity 60.2%, PPV 54%, and NPV 84%. Similarly, THAI-LEPTO score used hypotension, jaundice, muscle pain, AKI, low hemoglobin, and hypokalemia with hyponatremia and neutrophilia and obtained a sensitivity 78%, specificity 73%, PPV 87%, and NPV 58%. Both these studies obtained higher validity than the screening model of the present study and similar sensitivity as the simultaneous use of screening models and leptospirosis rapid test. Screening tests are most useful if they can be readily used when the patient reaches the health-care center. To incorporate this attribute to the screening model, the first set of symptoms noted by the patient and the first reported laboratory findings were used to build the model. In this study, we have also aimed at minimizing laboratory investigations in the screening tool to facilitate the utilization of the models in primary health-care settings. Hence we recommend the use of the algorithm to screen the patients of suspected leptospirosis by defining the leptospirosis probable case during monsoon as a patient with acute febrile illness with a screening model score ≥9 or a positive leptospirosis rapid test or both at primary health care setting.
However, at tertiary care hospitals where microbiological tests are available, the addition of scores of screening model, leptospirosis rapid test, and confirmatory model with a cutoff value of 110 can provide higher accuracy, as given in [Table 4].
The limitation of this study is that some studies have shown that the sensitivity of rapid test kits available for leptospirosis is in a range of 78.7% – 93.81% in acute phase and 87.87% in convalescent phase. Most of the rapid kits procured by the government hospitals for leptospirosis in India claim a sensitivity and specificity of about 90%. However, in this study, the validity of rapid test differed in derivation and validation cohort, probably because the change of commercial kits over 10 years. Hence, the actual sensitivity and specificity of the algorithm could be higher than calculated as seen in the validation cohort.
| Conclusions|| |
The changing serovars of leptospira can alter the symptoms and hence the scores. This being a hospital-based study is nonrepresentative of the whole population. However, this model is capable and feasible for the early diagnosis of leptospirosis in this part of the country, especially in primary health-care settings. Hence, its utility needs to be expanded to peripheral centers of this region. This would help in the early diagnosis and prompt treatment of leptospirosis. We plan to determine the external validity of these models and algorithms in the hospitals and villages of south Gujarat and improve it accordingly.
We are grateful to Additional Director (Public Health) and Deputy Director (Epidemic), Government of Gujarat for guidance and permission. We would like to acknowledge the Regional Deputy Director and Chief District Health Officer of Surat District for support. We would also like to acknowledge the Medical Superintendent of New Civil Hospital Surat, Department of Medicine and Department of Microbiology of Government Medical College, Surat.
Financial support and sponsorship
Conflicts of interest
There are no conflicts of interest.
| References|| |
Sambasiva RR, Naveen G, P
B, Agarwal SK. Leptospirosis in India and the rest of the world. Braz J Infect Dis 2003;7:178-93.
Costa F, Hagan JE, Calcagno J, Kane M, Torgerson P, Martinez-Silveira MS, et al
. Global morbidity and mortality of leptospirosis: A systematic review. PLoS Negl Trop Dis 2015;9:e0003898.
World Health Organization. Human leptospirosis: Guidance for diagnosis, surveillance and control. World Health Organization. Geneva. 2003. Available from: https://apps.who.int/iris/handle/10665/42667
. [Last accessed on 2019 Feb 21].
Dupont H, Dupont-Perdrizet D, Perie JL, Zehner-Hansen S, Jarrige B, Daijardin JB. Leptospirosis: Prognostic factors associated with mortality. Clin Infect Dis 1997;25:720-4.
Rajapakse S, Rodrigo C, Handunnetti SM, Fernando SD. Current immunological and molecular tools for leptospirosis: Diagnostics, vaccine design, and biomarkers for predicting severity. Ann Clin Microbiol Antimicrob 2015;14:2.
Suputtamongkol Y, Pongtavornpinyo W, Lubell Y, Suttinont C, Hoontrakul S, Phimda K, et al
. Strategies for diagnosis and treatment of suspected leptospirosis: A cost-benefit analysis. PLoS Negl Trop Dis 2010;4:e610.
World Health Organization. Report of the Second Meeting of the Leptospirosis Burden Epidemiology Reference Group; 2011.
Taylor AJ, Paris DH, Newton PN. A systematic review of the mortality from untreated leptospirosis. PLoS Negl Trop Dis 2015;9:e0003866.
Bhatia M, Umapathy BL, Navaneeth BV. Evaluation of diagnostic utility of modified Faine's criteria in leptospirosis – Experience from a tertiary care hospital. Natl J Integr Res Med 2015;6:20-6.
Rajapakse S, Weeratunga P, Niloofa R, Fernando N, de Silva NL, Rodrigo C, et al
. A diagnostic scoring model for leptospirosis in resource limited settings. PLoS Negl Trop Dis 2016;10:e0004513.
Bandara K, Weerasekera MM, Gunasekara C, Ranasinghe N, Marasinghe C, Fernando N. Utility of modified Faine's criteria in diagnosis of leptospirosis. BMC Infect Dis 2016;16:446.
Pencina MJ, D'Agostino RB Sr., D'Agostino RB Jr., Vasan RS. Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond. Stat Med 2008;27:157-72.
Gordis L. Assessing the validity and reliability of diagnostic and screening tests. In: Epidemiology. 5th
ed. Philadelphia: Elsevier; 2014. p. 91-6.
Mwachui MA, Crump L, Hartskeerl R, Zinsstag J, Hattendorf J. Environmental and behavioural determinants of leptospirosis transmission: A systematic review. PLoS Negl Trop Dis 2015;9:e0003843.
Bhardwaj P, Kosambiya JK, Desai VK. A case control study to explore the risk factors for acquisition of leptospirosis in Surat city, after flood. Indian J Med Sci 2008;62:431-8.
] [Full text]
Sukmark T, Lumlertgul N, Peerapornratana S, Khositrangsikun K, Tungsanga K, Sitprija V, et al
. Thai-Lepto-on-admission probability (THAI-LEPTO) score as an early tool for initial diagnosis of leptospirosis: Result from Thai-Lepto AKI study group. PLoS Negl Trop Dis 2018;12:e0006319.
Sehgal SC, Vijayachari P, Sharma S, Sugunan AP. LEPTO Dipstick: A rapid and simple method for serodiagnosis of acute leptospirosis. Trans R Soc Trop Med Hyg 1999;93:161-4.
Panwala T, Mulla S, Patel P. Seroprevalence of leptospirosis in south Gujarat region by evaluating the two rapid commercial diagnostic jits against MAT Test for detection of antibodies to leptospira interrogans. Nat J Community Med 2011;2:64-70.
[Figure 1], [Figure 2]
[Table 1], [Table 2], [Table 3], [Table 4], [Table 5]