The Art of Writing & Reporting a Systematic Review
- 1. Department of Biosciences, COMSATS University Islamabad, Pakistan
- 2. Department of Medical Laboratory Technology, Islamabad Medical & Dental College, Islamabad, Pakistan
Abstract
Within the pyramid of evidence, systematic reviews are at the top. Systematic review articles must be carefully crafted if they are to convey the broad range of research activities effectively and briefly. This necessitates close consideration of methodological and statistical components. The Abstract section should provide a concise and organized summary, enabling editorial authorities, peer reviewers, and the audience to quickly understand basic systematic review facets. It is essential to accurately assess internal and external validity quickly and wisely. The Abstract must be self-sufficient, providing a thorough and standalone summary without the need to read the entire document. Systematic reviews and several other types of research manuscripts can be structurally organized using the traditional IMRaD (Introduction, Methods, Results, and Discussion) framework.
For systematic reviewers, navigating the restrictions of word limits imposed by journals may be a difficult and unfair task. The abundance of supplemental online appendices, however, offers the chance to discuss methodological paradigms, empirical findings, and other pertinent aspects, enabling the creation of condensed printed or PDF-rendered articles. Contrary to the task of writing a lengthy exposition, the creation of a concise manuscript requires increased effort and academic rigor. The main goal of the current review is to provide advice to inexperienced systematic reviewers regarding the explicit and implicit standards that support scholarly composition. By incorporating these outlined recommendations, reviewers’ scholarly output will be of higher quality, which will advance the field of medicine.
Keywords
• IMRAD; Systematic Review; Research
CITATION
Kamran M, Noman M, Tariq H, Balqees A (2024) The Art of Writing & Reporting a Systematic Review. J Family Med Community Health 11(1): 1201.
INTRODUCTION
Based on a comprehensive analysis of thoroughly collected study data, a significant increase in the number of systematic reviews is being observed in medical and allied health sciences. As a result, the importance of systematic reviews as a reliable and rigorous source of evidence has increased [1]. The inherent objective of literature reviews is to conduct a thorough and systematic assessment of existing scholarly works, thereby enabling evidence-based clinical decision-making [2]. There has been a noticeable shift towards the adoption of a more accessible writing style to improve the dissemination of clinically effective information. The precise expression of systematic review articles, which entails carefully choosing words to summarize the extensive research scope, is of utmost significance. The act of composing with precision involves a careful focus on small details, specifically in relation to methodological and statistical complexities [3]. The utilization of scientifically established terminology, as illustrated in (Table 1), improves the precision and clarity of communication.
Table 1: Research terminologies.
Terminology |
Explanation |
Systematic reviews |
Academic research involves the synthesis of evidence about a well-defined inquiry using transparent methodologies for identifying, selecting, and evaluating pertinent studies. Additionally, this process entails the extraction, compilation, and presentation of the research findings. |
Transparency |
The practice of openly and comprehensively reporting reviews with clarity, accuracy, honesty, and completeness. The content encompasses a wide range of subjects, such as the disclosure of funding sources and conflicts of interest. |
Meta-analysis |
The utilization of a statistical methodology to integrate and consolidate the findings of multiple studies that investigate a common research question, to generate a comprehensive and concise outcome. The inclusion of a meta-analysis is not a necessary component of a high-quality systematic review. |
Core outcomes |
The minimum collection of crucial and significant outcomes, which have gathered agreement to evaluate what is clinically applicable. |
Evidence synthesis |
A methodical approach to gathering relevant data to look into a particular research question. In the field of evidence synthesis, guidelines, similar methodologies, and systematic reviews and meta-analyses coexist with umbrella reviews, network meta- analyses, and similar reviews. |
An exemplary illustration of such differentiation can be observed in the delineation between “meta analysis” and “systematic review.” The former is specifically focused on statistical analysis, whereas the latter adopts a broader approach. The lack of accuracy in written composition leads to uncertainty and the possibility of misunderstanding [4].
Currently, certain systematic review articles are characterized by excessive verbosity, the omission of relevant details, the inclusion of irrelevant data, and occasionally inaccurate titles [5]. The difficulty of this challenge is further exacerbated by the absence of a universally acknowledged framework for the documentation of articles within this field, primarily due to misunderstandings surrounding the concept of originality. Additionally, it is important to note that different journals may impose varying word limits. For example, reviews published in the Cochrane Library may have more flexibility in terms of length compared to traditional journal submissions, which are often limited by more stringent word count restrictions. Systematic reviews play a crucial role in the research endeavors of emerging scholars, often being incorporated into their postgraduate theses, and their findings are frequently published in peer-reviewed journals [6]. There are instances in which articles submitted to biomedical journals bear a resemblance to chapters found in postgraduate theses, despite the differences in readership between these two types of publications. In comparison, the process of crafting a succinct article requires greater diligence and extended dedication when compared to longer manuscripts. Systematic review authors who invest extra effort in producing manuscripts that exhibit clarity and accuracy are more likely to receive positive reception from editors to readers [7].
It is anticipated that inexperienced individuals conducting systematic reviews will incorporate both the overt and covert criteria for publication-quality outlined in this discussion [8]. Adherence to these guidelines enhances the likelihood of manuscript acceptance upon initial submission, thereby reducing the cycle of rejection and subsequent resubmission. Biomedical journals of a diverse nature present discernible variations in terms of word limits and requirements for manuscript formatting [9].
Reporting of Systematic Review and Avoiding Plagiarism
The length of the manuscript is constrained by specific limitations. In current scholarly conventions, limitations may be imposed on the inclusion of tables and figures in a printed manuscript, typically presented in the form of a PDF file. Publishers endeavor to achieve a harmonious equilibrium between the dissemination of relevant information and the management of costs associated with printing and electronic production. Respondents commonly express satisfaction with the practice of augmenting printed manuscripts through the utilization of appendices to provide supplementary information. Prospective registration involves the act of pre-registering a study or research project before its implementation, as opposed to registering it retrospectively [10]. All systematic reviews should undergo pre-registration to prevent duplication of efforts among various research teams. The purpose of such registration is to ensure compliance with the original protocol and requires the disclosure of any deviations from the protocol in the manuscript that is published, thereby enhancing transparency. Hence, it is imperative to provide a thorough explanation of the registration process in the manuscript. Prospero and OSF are digital platforms that provide opportunities for user registration [11].
Maintaining a high level of vigilance in preventing plagiarism is of utmost importance. Plagiarism refers to the act of presenting someone else’s written work as one’s own, particularly when the subject matter overlaps with that of the primary sources being referenced [12]. The implementation of electronic plagiarism detection tools can effectively address this issue by assessing the level of similarity between manuscripts before their submission. Numerous scholarly publications utilize automated plagiarism detection software such as CrossCheck or iThenticate to identify instances of replicated material. The extensive inclusion of plagiarized content frequently results in the rejection of a manuscript before undergoing the peer review process [5,13].
Abstract Section
The Abstract holds a position of utmost importance in the manuscript, as it is consistently the section that receives initial attention from editors, peer reviewers, and the broader readership. Consistent with the frequently referenced saying, a favorable first impression has long-lasting effects [14]. Acknowledging the significant importance of the Abstract in the manuscript, it is advisable to avoid delaying its composition until the last moment before submission. Instead, a prudent strategy entails giving priority to the creation of the Abstract from the beginning and continuously improving it in conjunction with the progression of the primary manuscript content [15]. The usual practice in contemporary scholarly literature involves the adoption of a structured abstract.
The incorporation of this element aligns with the structure of the main body of the document, allowing the initial Abstract to serve as a fundamental element for the progression of the primary text [16]. To enhance the accessibility and effectiveness of understanding the central message, it is advisable that the Abstract exclusively encompasses the principal discoveries and concluding remarks. It is advisable to include details about prospective registration within the Abstract [17]. It is crucial to acknowledge that the Abstract should have the capacity to operate autonomously, enabling full understanding without the need to consult the main body of the article [18].
INTRODUCTION SECTION
It is usual for the main content of such manuscripts to follow the established organizational structure used for original articles, which consists of the IMRAD structure. The integration of subheadings within the sections of Methods, Results, and Discussion can enhance the organization and structure of academic writing, leading to a reduction in repetitive content. The primary objective of the Introduction section is to furnish a thorough and inclusive synopsis of the clinical matter addressed in the article while emphasizing its importance [19].
The purpose of this section is to present a rationale for undertaking the systematic review. If a prior review about the same subject matter has been disseminated, the Introduction section must explicate the underlying reasons for the need to conduct a revised review. This may involve incorporating recent and significant studies that have been published after the previous review [20]. Considering the profusion of existing literature on the topic, it is essential to undertake a rigorous assessment of preceding reviews. The Introduction section of the document does not allocate adequate space for a comprehensive description of the evaluation. Hence, it is advisable to incorporate an appendix that provides a tabulated evaluation of the preceding reviews utilizing methodologies such as AMSTAR-2 or ROBIS [21].
To effectively conclude the Introduction section academically, it is advisable for the authors to clearly articulate the research question utilizing a structured format, while concurrently establishing the health outcomes in advance [22]. The primary focus of the main article will be on core outcomes, which are the essential and significant outcomes that are considered clinically relevant by both patients and practitioners. Appendices will be utilized to report non-core outcome data [23].
METHODOLOGY SECTION
The Methodology section should begin by including the relevant registration information and describing the specifications used for reporting purposes. The development of the search strategy is predicated upon the establishment of wellstructured questions [24]. The documentation and reporting of the precise combination of search terms employed, as well as the databases that were queried, in conjunction with their respective dates, are of utmost importance. The degree of reproducibility at this level guarantees that the search process can be faithfully replicated and validated by external parties [25]. It is essential to present a comprehensive description of the criteria for inclusion and exclusion of articles in the systematic review. It is essential to provide a comprehensive description of the instrument utilized to assess the study’s quality, along with the methodology employed for data extraction. Furthermore, it is imperative to record the methodology employed in resolving any inconsistencies among the systematic reviewers [26].
REPORTING OF RESULTS
Assessing and recording the level of agreement among systematic reviewers holds significant importance. The manuscript ought to incorporate a comprehensive account of the statistical methodologies utilized, including but not limited to data pooling, sensitivity analysis, subgroup analysis, and assessment of bias [27]. If public participation has been integrated into the review process, it is essential to include this information in the Methods section of the report. It is important to understand that any changes made to the systematic review after its initial registration, such as a switch to a scoping review as a result of new information learned during the review process, must be fully justified in the study’s Methods section [28]. Supplementary appendices are of paramount importance in augmenting the comprehensiveness of reporting by offering supplementary information, including the search strategy, rationales for excluding specific studies, and the checklist employed for data extraction and quality assessment. If deemed necessary, these specificities can undergo additional examination by peer reviewers and readers [29].
The inclusion of a flow chart in the Results section is recommended to visually depict the sequential steps involved in the article search process, as well as the subsequent inclusion and exclusion of articles in the systematic review. Furthermore, it is imperative to furnish a succinct overview of the incorporated articles. The incorporation of studies within the analysis allows for the evaluation of the comprehensiveness of the literature search by peer reviewers and readers. Additionally, it enables an assessment of the extent to which the findings from the review can be applied to external contexts [28,30]. The data can be effectively communicated by employing a 100% stacked bar chart, which visually depicts the distribution of studies based on their specific characteristics. The generation of this chart can be conveniently facilitated through the utilization of spreadsheet software. The chart prominently displays the absolute quantity of studies associated with each feature, effectively represented within the bars. To enhance spatial efficiency, it is recommended to incorporate tables that encompass distinct study attributes and evaluations of quality as supplementary materials [31].
The main results should be presented as the primary outcomes, with subsequent findings related to secondary outcomes presented thereafter. It is advisable to incorporate Forrest plots for the main outcomes. The provision of a succinct report on the results obtained from sensitivity or subgroup analyses, along with an assessment of potential publication bias, holds significant importance. Moreover, all results obtained from these analyses must be presented in the appendices. This will enable individuals who are concerned with maintaining the integrity of the review to comprehensively analyze the findings [32]. The titles of appendices, tables, and figures need to provide sufficient information so that they can be easily understood and stand alone. By employing this methodology, the systematic review can be effectively presented in its entirety within the limitations of the accepted article without surpassing the allowable print space [33].
DISCUSSION SECTION
The recommended length for the Discussion section is generally limited to a maximum of four to five paragraphs. The introductory paragraph of the systematic review should offer a succinct overview of the main findings and any pertinent clinical implications for healthcare practice [34]. Following this, a comprehensive examination of the advantages and limitations of the systematic review shall be provided [35]. The succeeding passage should analyze the implications of the conclusions in light of the existing body of literature about the subject matter [36]. While the primary emphasis of the systematic review may not be centered on cost-effectiveness, it is crucial to acknowledge that any examination of the results should incorporate a concise evaluation of this factor [37]. The following section should include an analysis of the potential impact on clinical practice and recommendations for future research [38,39].
CONCLUSION SECTION
The concluding paragraph should encapsulate the systematic review’s findings pertaining exclusively to the predetermined primary outcome(s) discussed earlier. Writers should exercise caution when exaggerating the findings of a review, especially when combining data from different studies [35].
The principles of integrity and transparency hold significant importance across diverse domains. To ensure adherence to the principles of transparency and uphold public trust in scientific research, it is crucial to provide comprehensive disclosure of the authors’ roles and contributions, potential conflicts of interest, acknowledgments, sources of funding, and any other pertinent information [35]. The dedication to transparency is consistent with the prioritization of fostering public confidence in the scientific community. The enhancement of transparency in reporting is achieved by comprehensively presenting the aforementioned information while adhering to the criteria and forms established by the International Committee of Medical Journal Editors. If deemed necessary, these criteria and forms may be included as appendices. It is advisable to include reporting checklists as an appendix to demonstrate the degree to which the article conforms to or reasonably deviates from, the standards for transparent reporting [40] (Figure 1).
Figure 1: A typical hierarchy of evidence pyramid showing systematic reviews at the top of the evidence hierarchy (By Alan Davies).
Addressing Peer Review Comments
Timely submission of comments within the specified timeframe mandated by the overseeing editors is of utmost importance. If authors are unable to meet the prescribed deadline for submission, it is advisable for them to formally communicate with the journal office to request an extension of time. It is imperative to furnish the rationale for the request. The requirement to respond to peer review feedback often involves undertaking further research [41]. In such cases, the editors are likely to be understanding and flexible if the need for an extension is based on this rationale.
To enhance the editor’s evaluation and monitoring of revisions made to the manuscript, it is imperative to systematically list each comment and furnish a suitable response, while emphasizing any alterations implemented [42]. When confronted with a substantial volume of comments, such as those obtained from multiple peer reviewers, it is beneficial to utilize tabulation as a method of demonstrating the methodical and comprehensive response to the received critiques [43]. It is imperative to acknowledge that to effectively persuade, it is crucial to provide a comprehensive response to comments received from editors and peer reviewers. To bolster the assertions put forth, it is crucial to furnish corroborating sources and scientific justifications [44].
Diverse perspectives may emerge concerning the suitable methodology for tackling issues, such as the task of clarifying heterogeneity. In specific cases, the occurrence of unexplained heterogeneity may be unavoidable. The assignment may require the construction of a comprehensive table consisting of numerous responses [45]. Under specific circumstances, it is conceivable for the response document to surpass the length of the manuscript. Authors are required to demonstrate conciseness and precision in their responses. However, the application of strict word limits, as observed in manuscripts, is not uniformly enforced. There is a possibility that, in the future, there will be a growing inclination towards the public dissemination of peer reviews as a means to augment transparency [46].
CONCLUSION
The process of generating concise and accurate written material necessitates substantial exertion and entails a substantial investment of time. To uphold the internal and external validity of systematic reviews, editors, peer reviewers, and readers must possess the capacity to critically assess them promptly [40]. The importance of the intelligibility of systematic reviews cannot be overstated, as it is essential for effectively utilizing the information, they offer to inform clinical practice and policy decisions, even when faced with limitations on the number of words allowed. It is crucial to create a wellorganized abstract that reflects the structure of the main text to effectively communicate information. The IMRaD acronym, denoting the conventional framework for the primary content in scholarly articles, is equally applicable to systematic reviews, laboratory experiments, and clinical trials, among other research methodologies [47]. The accurate presentation of the collected data can be achieved by presenting the findings of the systematic review in a concise manuscript, accompanied by comprehensive and transparent supplementary files [48].
AUTHOR CONTRIBUTION
MK and RF have equal contributions: designing and data curation, writeup, MN, AB, HT: proofreading, editing, structure
AVAILABILITY OF DATA AND MATERIALS
The data that support the findings of this study are openly available on request.
REFERENCES
- Fried T, Foltz C, Lendner M, Vaccaro AR. How to Write an Effective Introduction. Clin Spine Surg. 2019; 32: 111-112.
- Jawaid SA, Jawaid M. How to write introduction and discussion. Saudi J Anaesth. 2019; 13: S18-S19.
- Nundy S, Kakar A, Bhutta ZA, Nundy S, Kakar A, Bhutta Z, et al. How to Write the Introduction to a Scientific Paper? 2022: 193-199.
- Bahadoran Z, Jeddi S, Mirmiran P, Ghasemi A. The Principles of Biomedical Scientific Writing: Introduction. Int J Endocrinol Metab. 2018; 16: e84795.
- Arrom LM, Huguet J, Errando C, Breda A, Palou JJAUE. How to write an original article. Actas Urol Esp (Engl Ed). 2018; 42: 545-550.
- Meo S. Anatomy and physiology of a scientific paper. Saudi J Biol Sci. 2018; 25: 1278-1283.
- Behzadi P, Gajdács M. Writing a strong scientific paper in medicine and the biomedical sciences: a checklist and recommendations for early career researchers. Biol Futur. 2021; 72: 395-407.
- Aga SS, Nissar S. Essential Guide to Manuscript Writing for Academic Dummies: An Editor’s Perspective. Biochem Res Int. 2022; 2022: 1492058.
- Peterson TC, Kleppner SR, Botham CMJPCB. Ten simple rules for scientists: Improving your writing productivity. PLoS Comput Biol. 2018; 14: e1006379.
- Balch CM, McMasters KM, Klimberg VS, Pawlik TM, Posner MC, Roh M, et al. Steps to getting your manuscript published in a high-quality medical journal. Ann Surg Oncol. 2018; 25: 850-855.
- Behzadi P, Gajdács MJBf. Writing a strong scientific paper in medicine and the biomedical sciences: a checklist and recommendations for early career researchers. Biol Futur. 2021; 72: 395-407.
- Saad HBJLTm. Scientific medical writing in practice: the «IMR@ D®» format. Tunis Med. 2019; 97: 407-25.
- Behzadi P, Gajdács M, Immunology. Dos and don’ts of a successfully peer-reviewed publication: From A–Z. Eur J Microbiol Immunol (Bp). 2020; 10: 125-130.
- Nundy S, Kakar A, Bhutta ZA, Bundy S, Kakar A, Bhutta ZAJHtPAM, et al. How to Write an Abstract? 2022: 179-84.
- Sanganyado EJSA. How to write an honest but effective abstract for scientific papers. 2019; 6: e00170.
- Drury A, Pape E, Dowling M, Miguel S, Fernández-Ortega P, Papadopoulou C, et al. editors. How to write a comprehensive and informative research abstract. Semin Oncol Nurs. 2023; 39: 151395.
- Bougioukas KI, Bouras E, Apostolidou-Kiouti F, Kokkali S, Arvanitidou M, Haidich A-BJJoCE. Reporting guidelines on how to write a complete and transparent abstract for overviews of systematic reviews of health care interventions. J Clin Epidemiol. 2019; 106: 70-79.
- Tullu MSJSjoa. Writing the title and abstract for a research paper: Being concise, precise, and meticulous is the key. Saudi J Anaesth. 2019; 13: S12-S17.
- Seppelt R, Beckmann M, Václavík T, Volk MJTiE, Evolution. The art of scientific performance. Trends Ecol Evol. 2018; 33: 805-809.
- Shankar S, Arun H. Writing Manuscripts Better: Part I (The introduction, methods, results, and discussion format). 2022; 17: S292-S297.
- Aga SS, Nissar S. Essential Guide to Manuscript Writing for Academic Dummies: An Editor’s Perspective. Biochem Res Int. 2022; 2022: 1492058.
- Lamanauskas V. Scientific article preparation: Title, abstract and keywords. 2019; 77: 456-462.
- Lamanauskas V. Scientific article preparation: A comprehensive introduction. 2019; 77: 688-694.
- Erdemir F. How to write a materials and methods section of a scientific article? Turk J Urol. 2013; 39: 10-15.
- Ghasemi A, Bahadoran Z, Zadeh-Vakili A, Montazeri SA, Hosseinpanah FJIJoE. The principles of biomedical scientific writing: Materials and methods. Int J Endocrinol Metab. 2019; 17: e88155.
- Albert T. Winning the publications game: the smart way to write your paper and get it published: CRC Press; 2018; 156.
- Bahadoran Z, Mirmiran P, Zadeh-Vakili A, Hosseinpanah F, Ghasemi A. The Principles of Biomedical Scientific Writing: Results. Int J Endocrinol Metab. 2019; 17: e92113.
- Snyder N, Foltz C, Lendner M, Vaccaro AR. How to write an effective results section. Clin Spine Surg. 2019; 32: 295-296.
- Snyder N, Foltz C, Lendner M, Vaccaro AR. How to Write an Effective Results Section. Clinical spine surgery. 2019; 32: 295-296.
- Kanda T. [A Beginners’ Guide to Scientific Writing and Critical Reading]. Brain nerve. 2022; 74: 319-328.
- Marmotti A, Peretti GM, Mangiavini L, de Girolamo L, Tarella C, Bonasia DE, et al. Tips and tricks for writing a scientific manuscript. J Biol Regul Homeost Agents. 2020; 34: 441-449.
- Özçakar L, Rizzo JR, Franchignoni F, Negrini S, Frontera WR. Let’s Write a Manuscript: A Primer With Tips and Tricks for Penning an Original Article. Am J Phys Med Rehabil. 2022; 101: 698-701.
- Seals DR. Publishing particulars: Part 2. Tips for effective manuscript development. Am J Physiol Regul Integr Comp Physiol. 2023; 324: R393-R408.
- What’s in a Discussion section? Exploiting 2-dimensionality in the online world…. Bioessays. 2016; 38: 1185.
- Makar G, Foltz C, Lendner M, Vaccaro AR. How to write effective discussion and conclusion sections. Clin Spine Surg. 2018; 31: 345- 346.
- Kearney MH. The Discussion Section Tells Us Where We Are. Res Nurs Health. 2017; 40: 289-291.
- Ghasemi A, Bahadoran Z, Mirmiran P, Hosseinpanah F, Shiva N, Zadeh-Vakili A. The Principles of Biomedical Scientific Writing: Discussion. Int J Endocrinol Metab. 2019; 17: e95415.
- Vieira RF, Lima RCd, Mizubuti E. How to write the discussion section of a scientific article. 2019; 41.
- Masic I. How to write an efficient discussion? Med Arch. 2018; 72: 306-307.
- Faryadi Q. PhD Thesis Writing Process: A Systematic Approach-How to Write Your Methodology, Results and Conclusion. 2019; 10: 766- 783.
- Watling C, Shaw J, Field E, Ginsburg SJME. ‘For the most part it works’: Exploring how authors navigate peer review feedback. Med Educ. 2023; 57: 151-60.
- Conn VS. Strategies to Manage Unclear Peer Reviewer Comments. West J Nurs Res. 2022; 44: 991.
- Weinstein R. Surviving peer review. J Clin Apher. 2020; 35: 469-76.
- Gerwing TG, Allen Gerwing AM, Avery-Gomm S, Choi C-Y, Clements JC, Rash J, et al. Quantifying professionalism in peer review. Res Integr Peer Rev. 2020; 5: 1-8.
- Bahadoran Z, Mirmiran P, Kashfi K, Ghasemi AJIJoE, Metabolism. Scientific publishing in Biomedicine: Revising a peer-reviewed manuscript. Int J Endocrinol Metab. 2022; 20: e120366.
- Hong Y, Tantithamthavorn C, Thongtanunam P, Aleti A, editors. Commentfinder: a simpler, faster, more accurate code review comments recommendation. Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering. 2022.
- Sheldon E. Dialogic spaces of knowledge construction in research article Conclusion sections written by English L1, English L2 and Spanish L1 writers. 2018; 35: 13-40.
- Johnson JL, Adkins D, Chauvin S. A review of the quality indicators of rigor in qualitative research. Am J Pharm Educ. 2020; 84: 71201.