|Year : 2015 | Volume
| Issue : 3 | Page : 152-157
Options for a health system researcher to choose in Meta Review (MR) approaches-Meta Narrative (MN) and Meta Triangulation (MT)
Sanjeev Davey1, Anuradha Davey2, Jai Vir Singh1
1 Department of Community Medicine, Muzaffarnagar Medical College, Muzaffarnagar, Uttar Pradesh, India
2 Department of Community Medicine, Subharti Medical College, Meerut, Uttar Pradesh, India
|Date of Submission||12-Sep-2013|
|Date of Acceptance||20-Jun-2014|
|Date of Web Publication||16-Jun-2015|
B-197, 3rd Floor, Prashant Vihar, Sec-14, Rohini, Delhi - 110085
Source of Support: None, Conflict of Interest: None
| Abstract|| |
Two new approaches in systematic reviewing i.e. Meta-narrative review(MNR) (which a health researcher can use for topics which are differently conceptualized and studied by different types of researchers for policy decisions) and Meta-triangulation review(MTR) (done to build theory for studying multifaceted phenomena characterized by expansive and contested research domains) are ready for penetration in an arena of health system research. So critical look at which approach in Meta-review is better i.e. Meta-narrative review or Meta-triangulation review, can give new insights to a health system researcher. A systematic review on 2 key words-"meta-narrative review" and "meta-triangulation review" in health system research, were searched from key search engines, such as Pubmed, Cochrane library, Bio-med Central and Google Scholar etc till 21st March 2014 since last 20 years. Studies from both developed and developing world were included in any form and scope to draw final conclusions. However unpublished data from thesis was not included in systematic review. Meta-narrative review is a type of systematic review which can be used for a wide range of topics and questions involving making judgments and inferences in public health. On the other hand Meta-triangulation review is a three-phased, qualitative meta-analysis process which can be used to explore variations in the assumptions of alternative paradigms, gain insights into these multiple paradigms at one point of time and addresses emerging themes and the resulting theories.
Keywords: Meta-narrative review (MNR), Meta-triangulation review (MTR), health system research (HSR)
|How to cite this article:|
Davey S, Davey A, Singh JV. Options for a health system researcher to choose in Meta Review (MR) approaches-Meta Narrative (MN) and Meta Triangulation (MT). Indian J Community Med 2015;40:152-7
|How to cite this URL:|
Davey S, Davey A, Singh JV. Options for a health system researcher to choose in Meta Review (MR) approaches-Meta Narrative (MN) and Meta Triangulation (MT). Indian J Community Med [serial online] 2015 [cited 2022 Jul 6];40:152-7. Available from: https://www.ijcm.org.in/text.asp?2015/40/3/152/158843
| Background|| |
We must not forget the fact that, the field of secondary research is now growing very fastly. Various approaches of systematic review, each with a power and potential in different situations has been described for a researcher.  But all public health researchers know very well that meta-analysis; for purposes of identifying patterns among study results focuses in contrasting and combining results from different studies, sources of disagreement among those results. It also takes out interesting relationships among multiple studies by way of identification of a common measure of effect size, i.e. weighted average of the output of the studies.  Therefore, Meta-analyses are usually an important part of a systematic review procedure as they can be done on several clinical trials of a medical treatment to get a better understanding of how well the treatment can work in public health setting.
In meta reviews, Meta Narrative Review [MNR] and Meta Traingulation Review [MTR] are new upcoming field in health system research, so they can be explored further. Therefore authors have explored this area via critical systematic review on these new tools for their role in health system research.
| Materials and Methods|| |
Study designs used
Previous systematic reviews and exploratory research on role of MNR and MTR in HSR is the main study design considered.
Systematic review on two key words: "meta-narrative review [MNR] and meta-triangulation review [MTR] in HSR" was done from main search engines, that is, PubMed, Cochrane library, Biomed Central, and Google Scholar, etc., in all forms till 21 st March 2014 since last 20 years. From 50 articles which were searched, 27 articles finally met the inclusion criteria. This study is unique in sense that, as only very few authors has performed systematic review in this related area.
Studies from both developed and developing world were included; of any kind, on role of MNR and MTR in HSR.
Unpublished data from thesis/dissertation was not taken on both these reviews.
| Results|| |
The summary of results of this systematic review are given in [Table 1] as given below; for the emerging common themes and concepts from this systematic review.
Theme 01: Emerging role of Qualitative Meta-Synthesis in health system research
The growing popularity of qualitative approach in health system research is now compelling its proper incorporation into the evidence based research in health system.  Meta-synthesis, the so called "science of summing up0" is now becoming a building block in public health in its two approach i.e. meta-analysis as quantitative approach and meta-ethnography as qualitative approach. , Utility of these approaches has been described to make decisions on the massive and increasing volume of research evidence. , Therefore they are placed as building blocks for research required in a specific area of health system by "finding, evaluating and synthesizing evidence from research studies". , Evidence based practice in public health is therefore looking beyond the established models of research synthesis for innovative approaches, but still a lot of work needs to be done in developing and applying these appropriate methodologies for health system research. ,
Under the umbrella of methodological pluralism, multi method synthesis of the literature is knocking the door of research, especially in areas of nursing research and evidence-based medicine , These methodologically different approaches are one of the ideal tools found in the field of healthcare Information Technology [IT] researchers, who understand both the complexity of the healthcare domain and increasingly sophisticated inter-organizational multi-actor usage of healthcare information systems. , Also research synthesis now used for management and organization studies in health system consisting of a combination of narrative synthesis, meta-ethnographic, meta-narrative, and realist approaches. , The Interpretive Synthesis [IS] field also includes a meta-triangulation approach, which is a form of qualitative meta-analysis. ,
Theme 02: Meta- Narrative Review Vs Meta Triangulation Review: What to choose??
Meta-Narrative Review Approach
The Meta Narrative Review [MTR] approach is used as a synonym for meta-narrative synthesis. Meta synthesis is the way of combining qualitative results from different investigations for use in clinical practice and health policy formulation.  It has recently been developed in order to synthesize heterogeneous research literature on a complex topic as described by Greenhalgh et al.  This method not only allows us, to tease out a number of different streams of research at one point of time, but also show how seminal books and papers in each tradition has inspired programmes of theory building and empirical research. At the same time it has also proved to compare and contrast these traditions in a structured way systematically to identify the distorted concepts and flawed reasoning in them. 
Kuhn's notion has applied scientific paradigms to map the meta-narratives [over-arching storylines] of research as they had unfolded in different research traditions. Thus revealing how 'normal science on topic has been differently defined and explored by different groups of scholars over time. , New approaches are now available to carry out Mixed Method Literature Reviews [MMLR] which include qualitative and quantitative evidence and can also identify the mechanisms by which the programs reach their goal. ,,,
Meta-Triangulation Review Approach
Meta-Triangulation Review [MTR] is a type of qualitative meta-analysis that helps researchers to recognize, cultivate, and accommodate diverse paradigmatic insights. It is in fact "a strategy of applying typical diversity to foster greater insight and creativity".  In one study by Jasperson JS for relationships between power and IT by meta-paradigmatic approach helped authors to understand, delimit, and carefully describe the conceptualization of power that they are adopting when studying IT.  At a deeper level meta-paradigmatic approach helped them to surface anomalies and paradoxes, the process of reconciling these anomalies and paradoxes, thus allowing the researchers to build and test richer theories of complex relationships. 
Theme 03: Problems with Systematic reviews and Meta- analysis
Systematic reviews are considered one of the strongest form of medical evidence. But in a review of 300 studies, it was found that not all systematic reviews were reliable, and their reporting can be improved only by a universally agreed standards and guidelines.  Even in meta- analysis approach; there are many problems like meta-analysis of several small studies does not predict the results of a single large study.  Sources of bias are not controlled by meta analysis method. Moreover, a good meta-analysis of badly designed studies can result in a bad statistics i.e. only methodologically sound studies should be included in a meta-analysis, a practice called as 'best evidence synthesis'. 
Theme 04: Emergence of Multi-Method Research [MMR] in HSR
Although MMR covers many types of methods under its umbrella ranging from: Qualitative/quantitative to empirical/synthesis types, but mainly focus on use of qualitative approach. One of the emerging method under MMR is Methodologically Inclusive Research Synthesis [MIRS]. It includes various methods like meta-ethnography, meta-synthesis, meta-study, qualitative meta-analysis, qualitative synthesis, aggregated analysis, and synthesis of qualitative research. , Greenhalgh et al had described use of MMR approach in review of electronic patient records.  It was published in a health policy journal and only seven of the health-related references from over 100 studies reviewed were from Association for Information System Top Basket journals.
Theme 05: Meta Narrative Reviews [MNR]: An upcoming research tools
Meta-reviews of MNR variety basically look historically at how particular research traditions or epistemic traditions have unfolded over a period of time and shaped the 'normal science' of a topic area. MNR has ability to show how heterogeneous topic areas can have contrasting and complementary paths at the same time. Thus, it highlights the strengths and limitations of different research approaches in the topic.  MNR is used where topics/questions involves making judgments and inferences rather than checking against or following a technical checklist. But it is not possible to be prescriptive of what may be done in a review.
The method of MNR was developed in 2004 & 2005 in response to challenges which emerged in a review on diffusion of service-level in healthcare innovations. , Recently RAMESES [Realist And Meta-narrative Evidence Syntheses: Evolving Standards] project has given training materials and quality standards for the use of MNR. ,[ 19] 6 guiding principles and 3 phases of MNR has been mentioned by various authors in their studies and their key features are shown in [Table 2]. ,,,, Six guiding principles are:
Three phases of MNR are:
- Principle of pragmatism;
- Principle of pluralism;
- Principle of historicity;
- Principle of contestation;
- Principle of reflexivity;
- Principle of peer review.
Thus, MNR has potential to add value to the synthesis of heterogeneous bodies of literature, in which different groups of scientists have conceptualized and investigated the 'same' problem in different ways and produced seemingly contradictory ﬁndings.  Key features of meta-narrative review as found from many studies are given in [Table 2] given above. ,,,,[ 24]
- Planning phase;
- Search phase;
- Mapping and inclusion phase.
Theme 06: Triangulation approach in Health System Research
Triangulation method in HSR is based on the laws of trigonometry to determine the location of the fixed point. These laws state that if one side and two angles of a triangle are known, the other two sides and angle of that triangle can be calculated. So, "Triangulation" is an approach to synthesizing multiple, diverse sources of data at the level of interpretation.
Theme 07: Meta-Triangulation Review [MTR] method
MTR is a theory-building process that assists researchers in recognizing, cultivating, and accommodating diverse paradigmatic insights. It is used to articulate the paradigms underlying extant theory and to derive richer theoretical bases for understanding the phenomenon being studied. ,,, Meta-triangulation review is considered similar to evidence mapping & realist critical interpretive synthesis which summarizes:
It demands critical interpretive synthesis to build theory that explains observations. ,,,
- How do we get to where we are &
- What we need to do next.
The meta triangulation process actually consists of a three-phased model [groundwork, data analysis, and theory building] to explore variations in the assumptions of alternative paradigms as shown in [Table 3]. , Four other types of triangulation approaches useful in HSR apart from MTR are suggested by Rutherford W et al  :
Although the main goal of triangulation approach is to inform public health decisions, but it can also be used to assess the external validity of observed trends as well as to examine the effectiveness of widely disseminated interventions on multiple outcomes such as knowledge, attitudes, behaviors and actual disease incidence at the population level, which can also be served by meta-triangulation approach.
- Data triangulation: Data gathered through different samples and at different times are compared;
- Investigator triangulation: More than one investigator examines the same question and results are compared;
- Theory triangulation: Different theoretical constructs are applied to the same observed data and
- Method triangulation: Phenomena are examined using different methods
Limitations of MNR and MTR
MNR - here confusion often prevails among researchers, journal editors, peer reviewers and funders regarding a high quality meta-narrative review. ,,,,, Meta-narrative reviews are infact not 'linear' reviews. A general rule is that , if a recommended item is excluded from the write-up of a meta-narrative review, a justification must be given. Some meta-narrative reviews are not flagged in the title and/or they are inconsistently indexed, so they are difficult to locate in searches. ,,,,,
MTR - It does not formally demonstrate causality in the same manner as a purposefully designed randomized controlled trial but rather offers a rational explanation or interpretation of the data at the other hand. Therefore, MTR on should not displace formal evaluation of interventions, carefully constructed surveillance systems or formal monitoring and evaluation activities. ,
| Conclusions|| |
Since many systematic reviews are designed to inform policy and practice in health system research , it is important to select a method/type that can produce the kind of conclusions needed by a health system researcher. But this is not always simple or even possible to achieve in practice. Both MNR and MTR are a new research method that has been developed to synthesize diverse types of literature with an ability to identify the 'story lines of research' within and across disciplinary boundaries e.g. sociology, psychology, health system, geography etc in a systematic way.
Meta-narrative review [synthesis] approach elucidates the fact that research can and should be assessed for its quality. It also enables us to identify meta-narratives of each discipline and to analyze the different 'discourses' and languages of 'community'. On the other hand, the meta-triangulation review approach offer an opportunity to compare and contrast the data generated by these activities with the end of improving public health outcomes. Meta-triangulation is found to be now an excellent tool for understanding theoretical perspectives in MIS research. Therefore, further research is still required on these upcoming field if we want to use, both these tools in public health research commonly as both types of tools have their advantages as per requirements in health system research. So, we offer this systematic-review as a preliminary contribution to the debate on this area, not as the last word on it.
| References|| |
Potts HW. Meta-narrative review. Presented at: 5 th
ESRC Research Methods Festival, Oxford; 2012.
Greenland S, O'Rourke K. Meta-Analysis. In: Rothman KJ, Greenland S, Lash T, editors. Modern Epidemiology. 3 rd
ed. Philadelphia: Lippincott Williams and Wilkins; 2008. p. 652.
Barbour RS, Barbour M. Evaluating and synthesizing qualitative research: The need to develop a distinctive approach. J Eval Clin Pract 2003;9:179-86.
Booth A. Cochrane or cock-eyed? how should we conduct systematic reviews of qualitative research?[Paper presented at the Qualitative Evidence-based Practice Conference, Taking a Critical Stance. Coventry University]; 2001. p. 14-16.
Finfgeld-Connett D. Generalizability and transferability of meta-synthesis research findings. J Adv Nurs 2010;66:246-54.
Greenhalgh T, Potts WW, Wong G, Bark P, Swinglehurst D. Tensions and paradoxes in electronic patient record research [A systematic literature review using the meta-narrative method]. Research Report [UK NHS SDO Programme, Medical Research Council, Department of Health]; 2005.
Kuhn TS. The structure of scientific revolutions. Chicago: University of Chicago Press; 1962.
Wong G, Greenhalgh T, Westhorp G, Buckingham J, Pawson R. RAMESES publication standards: Meta-narrative reviews. BMC Med 2013;11:20.
Barnett-Page E, Thomas J. Methods for the synthesis of qualitative research: A critical review. BMC Med Res Methodol 2009;9:59.
Gough D, Thomas J, Oliver S. Clarifying differences between review designs and methods. Syst Rev 2012;1:28.
Sandelowski M, Voils CI, Leeman J, Crandell JL. Mapping the mixed methods-mixed research synthesis terrain. J Mixed Method Res 2012;6:317-31.
Saunders C, Carte AT, Butler BS. Lessons from the Trenches of Meta-triangulation Research. Commun Assoc Inf Syst 2003;11:245-70.
Jasperson JS, Carte, T.A., Saunders, C.S., Butler, B.S., Croes, H.J.P., and Zheng, W. Review: Power and information technology research: A meta-triangulation review. MIS Q 2002;26: 397-459.
Hagen-Zanker J, Duvendack M, Mallett R, Slater R, Carpenter S, Tromme M. Making systematic reviews work for international development research. Overseas Development Institute; 2012.
Hunter JL, Schmidt FL, Jackson GB, John E. Meta-analysis: Cumulating research findings across studies. Beverly Hills; Sage; 1982.
Glass GV, McGaw B, Smith ML. Meta-analysis in social research. Beverly Hills; Sage: 1981.
Mays N, Pope C, Popay J. Systematically reviewing qualitative and quantitative evidence to inform management and policy-making in the health field. J Health Serv Res Policy 2005;10:6-20.
Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organisations: Systematic literature review and recommendations for future research. Milbank Q 2004;82:581-629.
Greenhalgh T, Wong G, Westhorp G, Pawson R. Protocol - realist and meta-narrative evidence synthesis: Evolving standards [RAMESES]. BMC Med Res Methodol 2011;11:115.
Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O, Peacock R. Storylines of research in diffusion of innovation: A meta-narrative approach to systematic review. Soc Sci Med 2005;61:417-30.
Garces J PD. Eliciting patient perspective in patient-centered outcomes research: A meta narrative systematic review. Mayo Clin 2012;1-163.
Davey S, Davey A, Singh J. Meta narrative review: Current status and opportunities for public health research. Int J Health Syst Disaster Manage 2013;1:59-63.
Lewis MW, Grimes AJ. Meta-triangulation: Building theory from multiple paradigms. Acad Manage Rev 1999;24:672-90.
Bertotti M, Jamal F, Harden A,Sheridan K,Guewara GB and Atim L. Wellbeing and regeneration project: A meta-narrative review of conceptualizations and meanings of 'community' within and across research traditions. 2011;1-31.
Moher D, Tetzlaff J, Tricco AC, Sampson M, Altman DG. Epidemiology and reporting characteristics of systematic reviews. PLoS Med 2007;4:e78.
Environmental Evidence. [Internet] c2013. Available from: http://www.environmentalevidence.org [Last accessed on 2013 Jul 01, Last cited on 2013 Jul 17].
Rutherford GW, McFarland W, Spindler H, White K, Patel SV, Aberle-Grasse J. Public health triangulation: Approach and application to synthesizing data to understand national and local HIV epidemics. BMC Public Health 2010;10:447.
[Table 1], [Table 2], [Table 3]
|This article has been cited by|
||Nurturing professionalism in medical schools. A systematic scoping review of training curricula between 1990–2019
| ||Yun Ting Ong,Cheryl Shumin Kow,Yao Hao Teo,Lorraine Hui En Tan,Ahmad Bin Hanifah Marican Abdurrahman,Nicholas Wei Sheng Quek,Kishore Prakash,Clarissa Wei Shuen Cheong,Xiu Hui Tan,Wei Qiang Lim,Jiaxuan Wu,Laura Hui Shuen Tan,Kuang Teck Tay,Annelissa Chin,Ying Pin Toh,Stephen Mason,Lalit Kumar Radha Krishna |
| ||Medical Teacher. 2020; 42(6): 636 |
|[Pubmed] | [DOI]|
||Assessing mentoring: A scoping review of mentoring assessment tools in internal medicine between 1990 and 2019
| ||Yong Xiang Ng,Zachary Yong Keat Koh,Hong Wei Yap,Kuang Teck Tay,Xiu Hui Tan,Yun Ting Ong,Lorraine Hui En Tan,Annelissa Mien Chew Chin,Ying Pin Toh,Sushma Shivananda,Scott Compton,Stephen Mason,Ravindran Kanesvaran,Lalit Krishna,Abdallah M. Samy |
| ||PLOS ONE. 2020; 15(5): e0232511 |
|[Pubmed] | [DOI]|