(C) PLOS One [1]. This unaltered content originally appeared in journals.plosone.org.
Licensed under Creative Commons Attribution (CC BY) license.
url:https://journals.plos.org/plosone/s/licenses-and-copyright

------------



Test accuracy of polymerase chain reaction methods against conventional diagnostic techniques for Cutaneous Leishmaniasis (CL) in patients with clinical or epidemiological suspicion of CL: Systematic 

['Luz Estella Mesa', 'Pecet- Medical Research Institute', 'School Of Medicine', 'University Of Antioquia-Udea', 'Calle', 'Epidemiology', 'Biostatistic', 'Universidad Ces Calle', 'Rubén Manrique', 'Carlos Muskus']

Date: 2022-01 

Abstract Background Molecular diagnostic tests, notably polymerase chain reaction (PCR), are highly sensitive test for Leishmania detection, which is especially relevant in chronic cutaneous lesion with lower parasite load. An accurate diagnosis is essential because of the high toxicity of the medications for the disease. Nevertheless, diagnosis of cutaneous leishmaniasis (CL) is hampered by the absence of a reference standard. Assuming that the PCR-based molecular tools are the most accurate diagnostic method, the objective of this systematic review was to assess the diagnostic accuracy of PCR-based molecular tools in a meta-analysis of the published literature. Methodology/Principal findings A search of the published literature found 142 papers of which only 13 studies met the selection criteria, including conventional PCR, real-time PCR, Loop-mediated isothermal amplification (LAMP), recombinase polymerase amplification (RPA), polymorphism-specific PCR (PS-PCR). The sensitivities of the individual studies ranged from 61% to 100%, and specificities ranged from 11% to 100%. The pooled sensitivities of PCR in smears were 0.95 (95% CI, 0.90 to 0.98), and the specificity was 0.91(95% CI, 0.70 to 0.98). In general population, estimates were lower in aspirates, skin biopsies and swab samples with 0.90 (95% CI, 0.80 to 0.95) and 0.87 (95% CI, 0.76 to 0.94) for sensitivity and specificity, respectively. The specificity was lower in consecutive studies, at 0.88 (95% CI, 0.59 to 0.98) and its CI were wider. Conclusions/Significance No statistically significant differences between the accuracy in smears, aspirate, skin biopsies or swabs samples were observed. Therefore, a simple smear sample run by PCR, instead more invasive samples, may be enough to obtain a positive diagnosis of CL. The results for PCR in all samples type confirm previous reports that consider PCR as the most accurate method for the diagnosis of CL.

Author summary This systematic review and meta-analysis confirmed that PCR is the most accurate methods for the diagnosis of CL. The summary of the estimates for sensitivity and specificity in all readout methods of the index test were high. No statistically differences between the accuracy in smears, aspirate, skin biopsies or swabs samples suggesting that a simple smears sample run by PCR instead more invasive samples is enough to obtain a positive diagnosis of CL.

Citation: Mesa LE, Manrique R, Muskus C, Robledo SM (2020) Test accuracy of polymerase chain reaction methods against conventional diagnostic techniques for Cutaneous Leishmaniasis (CL) in patients with clinical or epidemiological suspicion of CL: Systematic review and meta-analysis. PLoS Negl Trop Dis 14(1): e0007981. https://doi.org/10.1371/journal.pntd.0007981 Editor: Mitali Chatterjee, Institute of Postgraduate Medical Education and Research, INDIA Received: June 26, 2019; Accepted: December 9, 2019; Published: January 21, 2020 Copyright: © 2020 Mesa et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Data Availability: All relevant data are within the manuscript and its Supporting Information files. Funding: This work received financial support of the Colombian Administrative Department of Science, Technology and Innovation - Colciencias (Code: 617499847785; CT-695-2014). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. Competing interests: The authors have declared that no competing interests exist.

Introduction Leishmaniases are vector-borne infections caused by protozoa of genus Leishmania, affecting mammals. More than 30 Leishmania species are recognized, of which 20 are considered infective for humans and other mammals [1]. The ability to distinguish between Leishmania species is crucial for differentiation of the different clinical manifestations of the disease (visceral, cutaneous or mucocutaneus) to establish correct diagnosis and prognosis of the disease as well as to support decision-making regarding administration of the appropriate treatment. The rapid and accurate diagnosis of cutaneous leishmaniasis (CL) and the identification of the species involved in the infection are crucial for the therapeutic regimen and control of the disease. The diagnosis of CL is based on the detection of the parasite in the sample collected directly from the patient´s lesions. The methods include direct microscope test, culture of aspirates and histopathology biopsies. Although the specificity of these methods is high, varying from 86% [1] to 100% [2], they have important drawbacks mainly related to their sensitivity and time consuming due to the high subjective component. The direct test’s sensitivity can vary depending of the type of tissue where the sample is collected, amount of sample obtained, as well as the technique used for the sampling and processing. The evolution time of the lesion and the previous use of treatments may also interfere with the sensitivity of the direct methods [3]. For all these reasons the sensitivity reported varies from 78.3% to 90.4% in samples taken from the active edge of the lesion vs. the base of the ulcer, respectively [4]. However, other studies have reported sensitivities as low as 32.7% and 37% in samples from the active edge of the lesion [5,6]. On the other hand, the culture-based and histopathology test has lower sensitivity than direct test and therefore they do not have an important role in the diagnosis of CL [3]. The inaccuracies in diagnosis prevent timely access to treatment and the establishment of guided strategies for the control and reduction of morbidity for leishmaniasis, affecting finally the patient welfare. To overcome these drawbacks, different molecular tests are proposed for the diagnosis of CL by detecting the parasite genetic material (DNA or RNA), to improve (contrast) the accuracy of the traditional microscopic-based parasitological diagnosis. These molecular techniques include multilocus enzyme electrophoresis (MLEE), conventional polymerase chain reaction (PCR) based assays, quantitative Real Time PCR or simplified PCR methods. In addition, available tools for species identification and phylogenetic analysis include DNA sequencing analysis, restriction fragment length polymorphism (RFLP) analysis, and PCR-fingerprinting techniques as well as novel methods such as multilocus sequence typing (MLST) and multi‐ locus microsatellite typing (MLMT). The PCR based assays, are rapid, sensitive and discriminative at species or even strain level. They offer high flexibility and utility together with its sensitivity and specificity. Nevertheless, the complexity and cost are limiting factors for its routine application in clinics, restricting its use to research laboratory environments. However, there is an urgent need for standardization, optimization and simplification of PCR based applications to be used mainly in endemic areas around the world which will have an impact in disease control. Providing clear evidence on the diagnostic accuracy of molecular tests allows to clarify the role of molecular techniques in epidemiological contexts. Here the importance of knowing the diagnostic accuracy of molecular tests so that public health institutions and those in charge of making decisions may implement the use of theses test for the control of CL. Based on the hypothesis that the PCR-based molecular tools are the most accurate diagnostic method, the objective of this systematic review was to assess the diagnostic attributes of PCR-based molecular tools in a meta-analysis of the published literature, with the purpose of contribute to the improvement of CL control.

Methods The review protocol was registered on PROSPERO 2017 and is available from: http://www.crd.york.ac.uk/PROSPERO/display_record.php?ID=CRD42017055859. This systematic literature review was performed based on recommendations by the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) [7]. Study scope and definition of the reference standard This systematic review answers the question: what is the accuracy of the PCR-based methods in the diagnosis of CL in patients with potential infection attending health care services in endemic areas? For this purpose, the reference standard was defined as a compatible clinical lesion in addition to the demonstration of amastigotes through direct microscopic test or in combination with culture isolation of Leishmania parasites from lesion material. Other types of composite reference standards were not included. The confirmatory diagnostic of LC was based on the observation of intra- or extracellular Leishmania amastigotes through direct microscopic observation and/or promastigote isolation in cultures media. Literature search To identify all relevant studies, we performed an electronic search using key terms in the following databases: PubMed, EMBASE and LILACS. These databases were selected because of their coverage of the literature and because we believe they will provide a representative sample of the published studies of diagnostic molecular tests from January 1990 to December 2018. In February 2019, The following MeSH terms were generated: “(((((((((((("Leishmaniasis, Cutaneous") OR "Leishmaniasis, Diffuse Cutaneous")) OR ("cutaneous leishmaniasis" OR "diffuse cutaneous leishmaniasis" OR "skin leishmaniasis"))) AND (("Polymerase Chain Reaction") OR ("Polymerase chain reaction" OR PCR))))) AND (((((((("Sensitivity and Specificity") OR "Sensitivity and Specificity/standards")) OR ("sensitivity OR specificity" OR "sensitivity OR specificity/standards" OR "sensitivity" OR "specificity"))) OR (screening OR "false positive" OR "false negative" OR accuracy)) OR (((("Predictive Value of Tests") OR "Predictive Value of Tests/standards")) OR ("Predictive Value of Tests" OR "Predictive Value of Tests/standards" OR "predictive value" OR "predictive values of tests" OR "reference value" OR "references values"))) OR (("ROC Curve") OR ("ROC Curve" OR ROC "Receiver operating characteristics" OR "roc analysis" OR "roc analyses" OR "ROC and" OR "ROC area" OR "ROC auc" OR "ROC characteristics" OR "ROC curve method" OR "ROC curves" OR "ROC estimated" OR "ROC evaluation" OR "ROC likelihood ratio"))))) AND ("direct exam" OR "direct test" OR "direct tests" OR "direct microscopy" OR smear)) AND Humans). The limitations were the language (English/Spanish) and publication date (from 1990/01/01 to 2018/12/31), the search was limited to that period because it corresponds with the period where most of the molecular tests were developed. The search was also limited to those studies performed in humans. Inclusion criteria In this review only prospective cohort studies were included (meaning, those studies including patients consecutively recruited, and those where all patients were submitted to the index test and the reference test), retrospective and cross-sectional studies; in some studies, re-counts of the same patients were performed to analyze different diagnostic techniques based on PCR (Table 1). All studies met the following criteria: (i) patients with clinical suspicion of cutaneous leishmaniasis, (ii) use of the molecular test for the diagnosis of CL, (iii) use of clinical samples isolated from humans, (iv) comparison with the reference standard “direct microscopic test alone or in combination with culture”, (v) capacity of completion of a 2x2 contingency table. Those studies with patients suspicious of other leishmaniasis forms such as post kala-azar dermal leishmaniasis were excluded. PPT PowerPoint slide

PNG larger image

TIFF original image Download: Table 1. Characteristics of the studies selected and test properties calculated after creating a 2 x 2 table. https://doi.org/10.1371/journal.pntd.0007981.t001 Analysis of the selected papers Two of the authors screened the titles and abstracts identified through the search strategy (SR- Professor of Immunology and LEM-PhD candidate student) and selected those studies potentially relevant for this review. For all relevant articles, the full text version was read to determine the presence of the inclusion criteria defined previously. Two independent reviewers read the full text articles (CM-Professor of Molecular Biology and LEM-PhD candidate student). In case of disagreement in any of the phases of evaluation, a third reviewer was consulted for the final decision (SR-Professor of Immunology). A set of standard data from each study was collected using a data extraction form; two reviewers performed a pilot test with the initial form using 3 of the included publications; the data extraction form was modified and improved according to the information derived from the pilot test. In the case of studies where only one subgroup of participants was eligible, such as studies where different types of reference tests are analyzed simultaneously, only the data of the analysis comparing the reference standard defined previously were extracted. Two reviewers independently extracted the data and completed the predefined data extraction form (CM and LEM), any disagreements were resolved through the discussion with a third reviewer (SR), and the extracted data included general information such as reference, study location, index tests, reference standard, sample, study type, control group, and any another relevant information. We evaluated the methodological quality of the included studies using QUADAS-2 (Quality Assessment of Diagnostic Accuracy Studies). This tool is designed to assess the quality of primary diagnostic accuracy studies; consist of 4 key domains that discuss patient selection, index test, reference standard, and flow of patients through the study and timing of the index tests and reference standard (flow and timing); it is not designed to replace the data extraction process but complement the data extraction process of a systematic review. The researchers involved in the data extraction process were trained in the use of the QUADAS-2 tool [8]. Data extraction and quality assessment were done independently by two reviewers (CM and LEM). Any discrepancies were resolved by consulting (SR). For 10% of the included studies, data extraction was also done by (SR). The decision regarding which studies would be included in the meta-analysis was primarily resolved using criteria related to the test methodology. Anticipated sources of heterogeneity First, the selected papers were separated according to the reference standard used (direct microscopic test alone or in combination with culture) to define diseased and non-diseased subjects. Secondly, the type of PCR sample analyzed, study design, polymerase chain reaction target, size of the amplicons (pb), primes were considered. The DNA extraction methods that used commercial kits or phenol-extraction techniques were considered similar for human tissue samples that were stored in filter paper, paraffin embedded or frozen [9]; in addition, the studies that used primers that amplify multiple copy genes were considered similar too [9]. Searching to avoid heterogeneity among diagnostic test accuracy (DTA) studies, was focused on selecting a more homogeneous set of studies, however, heterogeneity is great among DTA studies and it is often difficult to strictly control biases. In order to achieve accurate review results, we used a first subgroup analysis that included studies that used exclusively the direct microscopic test as a reference standard. A second subgroup analysis was done with those studies where the reference standard included both direct microscopic test and/or culture but with comparable or similar methodologies. Statistical analysis For all studies, estimates of sensitivity, specificity, positive and negative predictive value and 95% confidence intervals (CI) were expressed in forest plots in Review Manager version 5.3. We therefore investigated sources of heterogeneity by adding the following covariates to the mixed-effects logistic regression model: (i) the index tests, (ii) PCR sample, (iii) the study design, (iv) the reference standard and (v) the target gene (single or multicopy gene) using the command xtmelogit in STATA version 14. A covariate was assumed to have a significant effect on the estimates of sensitivity and specificity and thus to explain some of the heterogeneity in the studies included in meta-analysis if the P value was < 0.05. We used two methods of meta-analyzing diagnostic accuracy data, which are statistically rigorous: the hierarchical summary receiver operating characteristic (HSROC) model [10] and the bivariate logit-normal random-effects meta-analysis model [11] to obtain a summary estimate of sensitivity and specificity, statistical analysis using xtmelogit in STATA version 14. Diagnostic accuracies between various readout methods for PCR (index tests), PCR samples, the study design and reference standard, were compared using Chi-square test with the programme STATA version 14.

Discussion Molecular test with high quality sensitivity has been widely used for diagnosing of CL. PCR is suitable when there are atypical lesion of CL and few numbers of parasites, or when the microscopic method is negative, molecular diagnosis appears to be the solution to the short-falls on traditional diagnostic methods. In this systematic review, we analyzed and summarized data from diagnostic accuracy studies of molecular test in the diagnosis of CL. After to identify all relevant studies from the available literature, we were able to assess the accuracy of PCR tests in smears, aspirate, skin biopsies and swab. The finding the high estimates for sensitivity and specificity on smears samples and low estimates on aspirate, skin biopsies and swab samples in general population, allows us to believe that a simple smears sample would suffice instead of taking more invasive skin biopsies or aspirate samples. This finding is important from patient’s point of view because highlighting the use of non-invasive sampling procedures, which generate greater stigmatization in patients due to the permanent scars. The low specificities found in all readout methods of the index test, can be attributed, in part, to the fact that the controls in case-control studies are often healthy persons, whereas controls in consecutive studies are in fact suspected patients; variation in the controls were one of the most frequent points of heterogeneity among the studies [8]. The high number of positive PCR tests in suspected patients with a negative reference standard may be explained by a proportion of the false positives being true positive when we take into consideration that the reference standard for CL is imperfect and that the sensitivity of PCR test is superior to the reference standard. Consecutive studies better reflect the diagnosis situation and are thus of higher methodological quality than case-control studies [23]. We therefore recommend that future diagnostic accuracy studies should use a consecutive design to determine whether our findings about specificity are reproducible and to obtain valid estimates. This meta-analysis shows that the molecular methods are very sensitive tools for the detection of Leishmania parasites in smears samples instead of invasive skin biopsies or aspirate samples, for which, we found lower pooled estimated for sensitivity, as well as specificity. Though due to limited data, it was not possible to provide summary estimates for consecutive studies and case-control studies separately on aspirate, skin biopsies and swab samples. Regarding to the future diagnostic accuracy studies, we highlight the fact of leave out the case-control studies to avoid that diagnostic accuracy being overestimated and consider the results for PCR in simple smears sample such as the most accurate method for the diagnosis of CL instead more invasive samples [24]. The results of this systematic review and meta-analysis have important implications in public health because the diagnostic of CL through direct microscopic test is a highly operator dependent method. This means that the results depend of skills of who performs the test; therefore, the molecular methods can help to avoid this bias and permit obtain improve diagnostics and ensure the adequate treatments in patients. It is also important that the sensitivity of the molecular methods for the diagnosis of CL be high in a simple smear samples instead of invasive samples, because the scars left by the disease already stigmatize the patients and obtaining a sample through invasive methods would be useless. Conclusions Results suggest that the molecular methods are very sensitive tools for the detection of Leishmania parasites in smears samples instead of invasive skin biopsies or aspirate samples, we no found statistically differences between the accuracy in smears, aspirate, skin biopsies or swabs samples. Therefore, we consider that a simple smear sample run by PCR instead more invasive sample is enough to obtain a positive diagnosis of CL. The results for PCR in all samples type confirm previous reports that consider PCR as the most accurate method for the diagnosis of CL. Limitations Many studies in our meta-analysis suffer from poor quality. Thirty-one percent of the included studies had a case-control study type and this design is reputed to introduce selection bias, as the cases are confirmed patients and the controls are healthy volunteers or patients with other skin diseases similar to CL. Imperfect reference standard bias is an important issue in diagnostic accuracy studies. In the case of CL, there is a risk of underestimates the specificity of a new test when comparing it to current methods that have low sensitivity and high specificity, such as reference standard. QUADAS-2 assessment showed that 85% of the studies, the conduct or interpretation of the index test and the reference standard could have introduced bias when judged against these definitions. The analysis of heterogeneity done or all studies combined did not show a significant difference between studies that used standard A, reference standard and studies that used a composite reference standard B, reference standard and/or culture. Neither were significant differences between the readout methods of the index test. Nevertheless, subgroups were analyzed separately: “all readout methods of the index test except LAMP and real-time PCR” and “all readout methods of the index test without exception”. The lack of standardization is another limitation when you want to compare diagnostic accuracy studies for molecular tools. These different protocols are evidenced in the Table 1. An additional problem encountered during all process of studies selection, data extraction, and quality assessment of the included studies, were incomplete reporting of studies. This is due to the not use of the STARD guidelines for reporting diagnostic accuracy studies.

[END]

[1] Url: https://journals.plos.org/plosntds/article?id=10.1371/journal.pntd.0007981

(C) Plos One. "Accelerating the publication of peer-reviewed science."
Licensed under Creative Commons Attribution (CC BY 4.0)
URL: https://creativecommons.org/licenses/by/4.0/


via Magical.Fish Gopher News Feeds:
gopher://magical.fish/1/feeds/news/plosone/