An official website of the United States government
Official websites use .gov A .gov website belongs to an official government organization in the United States.
Secure .gov websites use HTTPS A lock ( Lock Locked padlock icon ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.
- Publications
- Account settings
- Advanced Search
- Journal List
Systematically Reviewing the Literature: Building the Evidence for Health Care Quality
Suzanne austin boren , phd, david moxley , mlis.
- Author information
- Copyright and License information
Contact: [email protected]
Corresponding author.
There are important research and non-research reasons to systematically review the literature. This article describes a step-by-step process to systematically review the literature along with links to key resources. An example of a graduate program using systematic literature reviews to link research and quality improvement practices is also provided.
Introduction
Systematic reviews that summarize the available information on a topic are an important part of evidence-based health care. There are both research and non-research reasons for undertaking a literature review. It is important to systematically review the literature when one would like to justify the need for a study, to update personal knowledge and practice, to evaluate current practices, to develop and update guidelines for practice, and to develop work related policies. 1 A systematic review draws upon the best health services research principles and methods to address: What is the state of the evidence on the selected topic? The systematic process enables others to reproduce the methods and to make a rational determination of whether to accept the results of the review. An abundance of articles on systematic reviews exist focusing on different aspects of systematic reviews. 2 – 9 The purpose of this article is to describe a step by step process of systematically reviewing the health care literature and provide links to key resources.
Systematic Review Process: Six Key Steps
Six key steps to systematically review the literature are outlined in Table 1 and discussed here.
Systematic Review Steps
1. Formulate the Question and Refine the Topic
When preparing a topic to conduct a systematic review, it is important to ask at the outset, “What exactly am I looking for?” Hopefully it seems like an obvious step, but explicitly writing a one or two sentence statement of the topic before you begin to search is often overlooked. It is important for several reasons; in particular because, although we usually think we know what we are searching for, in truth our mental image of a topic is often quite fuzzy. The act of writing something concise and intelligible to a reader, even if you are the only one who will read it, clarifies your thoughts and can inspire you to ask key questions. In addition, in subsequent steps of the review process, when you begin to develop a strategy for searching the literature, your topic statement is the ready raw material from which you can extract the key concepts and terminology for your strategies. The medical and related health literature is massive, so the more precise and specific your understanding of your information need, the better your results will be when you search.
2. Search, Retrieve, and Select Relevant Articles
The retrieval tools chosen to search the literature should be determined by the purpose of the search. Questions to ask include: For what and by whom will the information be used? A topical expert or a novice? Am I looking for a simple fact? A comprehensive overview on the topic? Exploration of a new topic? A systematic review? For the purpose of a systematic review of journal research in the area of health care, PubMed or Medline is the most appropriate retrieval tool to start with, however other databases may be useful ( Table 2 ). In particular, Google Scholar allows one to search the same set of articles as PubMed/MEDLINE, in addition to some from other disciplines, but it lacks a number of key advanced search features that a skilled searcher can exploit in PubMed/MEDLINE.
Examples of Electronic Bibliographic Databases Specific to Health Care
Note: These databases may be available through university or hospital library systems.
An effective way to search the literature is to break the topic into different “building blocks.” The building blocks approach is the most systematic and works the best in periodical databases such as PubMed/MEDLINE. The “blocks” in a “building blocks” strategy consist of the key concepts in the search topic. For example, let’s say we are interested in researching about mobile phone-based interventions for monitoring of patient status or disease management. We could break the topic into the following concepts or blocks: 1. Mobile phones, 2. patient monitoring, and 3. Disease management. Gather synonyms and related terms to represent each concept and match to available subject headings in databases that offer them. Organize the resulting concepts into individual queries. Run the queries and examine your results to find relevant items and suggest query modifications to improve your results. Revise and re-run your strategy based on your observations. Repeat this process until you are satisfied or further modifications produce no improvements. For example in Medline, these terms would be used in this search and combined as follows: cellular phone AND (ambulatory monitoring OR disease management), where each of the key word phrases is an official subject heading in the MEDLINE vocabulary. Keep detailed notes on the literature search, as it will need to be reported in the methods section of the systematic review paper. Careful noting of search strategies also allows you to revisit a topic in the future and confidently replicate the same results, with the addition of those subsequently published on your topic.
3. Assess Quality
There is no consensus on the best way to assess study quality. Many quality assessment tools include issues such as: appropriateness of study design to the research objective, risk of bias, generalizability, statistical issues, quality of the intervention, and quality of reporting. Reporting guidelines for most literature types are available at the EQUATOR Network website ( http://www.equator-network.org/ ). These guidelines are a useful starting point; however they should not be used for assessing study quality.
4. Extract Data and Information
Extract information from each eligible article into a standardized format to permit the findings to be summarized. This will involve building one or more tables. When making tables each row should represent an article and each column a variable. Not all of the information that is extracted into the tables will end up in the paper. All of the information that is extracted from the eligible articles will help you obtain an overview of the topic, however you will want to reserve the use of tables in the literature review paper for the more complex information. All tables should be introduced and discussed in the narrative of the literature review. An example of an evidence summary table is presented in Table 3 .
Example of an evidence summary table
Notes: BP = blood pressure, HbA1c = Hemoglobin A1c, Hypo = hypoglycemic, I = Internet, NS = not significant, PDA = personal digital assistant, QOL = quality of life, SMBG = self-monitored blood glucose, SMS = short message service, V = voice
5. Analyze and Synthesize Data and information
The findings from individual studies are analyzed and synthesized so that the overall effectiveness of the intervention can be determined. It should also be observed at this time if the effect of an intervention is comparable in different studies, participants, and settings.
6. Write the Systematic Review
The PRISMA 12 and ENTREQ 13 checklists can be useful resources when writing a systematic review. These uniform reporting tools focus on how to write coherent and comprehensive reviews that facilitate readers and reviewers in evaluating the relative strengths and weaknesses. A systematic literature review has the same structure as an original research article:
TITLE : The systematic review title should indicate the content. The title should reflect the research question, however it should be a statement and not a question. The research question and the title should have similar key words.
STRUCTURED ABSTRACT: The structured abstract recaps the background, methods, results and conclusion in usually 250 words or less.
INTRODUCTION: The introduction summarizes the topic or problem and specifies the practical significance for the systematic review. The first paragraph or two of the paper should capture the attention of the reader. It might be dramatic, statistical, or descriptive, but above all, it should be interesting and very relevant to the research question. The topic or problem is linked with earlier research through previous attempts to solve the problem. Gaps in the literature regarding research and practice should also be noted. The final sentence of the introduction should clearly state the purpose of the systematic review.
METHODS: The methods provide a specification of the study protocol with enough information so that others can reproduce the results. It is important to include information on the:
Eligibility criteria for studies: Who are the patients or subjects? What are the study characteristics, interventions, and outcomes? Were there language restrictions?
Literature search: What databases were searched? Which key search terms were used? Which years were searched?
Study selection: What was the study selection method? Was the title screened first, followed by the abstract, and finally the full text of the article?
Data extraction: What data and information will be extracted from the articles?
Data analysis: What are the statistical methods for handling any quantitative data?
RESULTS: The results should also be well-organized. One way to approach the results is to include information on the:
Search results: What are the numbers of articles identified, excluded, and ultimately eligible?
Study characteristics: What are the type and number of subjects? What are the methodological features of the studies?
Study quality score: What is the overall quality of included studies? Does the quality of the included studies affect the outcome of the results?
Results of the study: What are the overall results and outcomes? Could the literature be divided into themes or categories?
DISCUSSION: The discussion begins with a nonnumeric summary of the results. Next, gaps in the literature as well as limitations of the included articles are discussed with respect to the impact that they have on the reliability of the results. The final paragraph provides conclusions as well as implications for future research and current practice. For example, questions for future research on this topic are revealed, as well as whether or not practice should change as a result of the review.
REFERENCES: A complete bibliographical list of all journal articles, reports, books, and other media referred to in the systematic review should be included at the end of the paper. Referencing software can facilitate the compilation of citations and is useful in terms of ensuring the reference list is accurate and complete.
The following resources may be helpful when writing a systematic review:
CEBM: Centre for Evidence-based Medicine. Dedicated to the practice, teaching and dissemination of high quality evidence based medicine to improve health care Available at: http://www.cebm.net/ .
CITING MEDICINE: The National Library of Medicine Style Guide for Authors, Editors, and Publishers. This resource provides guidance in compiling, revising, formatting, and setting reference standards. Available at http://www.ncbi.nlm.nih.gov/books/NBK7265/ .
EQUATOR NETWORK: Enhancing the QUAlity and Transparency Of health Research. The EQUATOR Network promotes the transparent and accurate reporting of research studies. Available at: http://www.equator-network.org/ .
ICMJE RECOMMENDATIONS: International Committee of Medical Journal Editors Recommendations for the Conduct, Reporting, Editing and Publication of Scholarly Work in Medical Journals. The ICJME recommendations are followed by a large number of journals. Available at: http://www.icmje.org/about-icmje/faqs/icmje-recommendations/ .
PRISMA STATEMENT: Preferred Reporting Items for Systematic Reviews and Meta-Analyses. Authors can utilize the PRISMA Statement checklist to improve the reporting of systematic reviews and meta-analyses. Available at: http://prisma-statement.org .
THE COCHRANE COLLABORATION: A reliable source for making evidence generated through research useful for informing decisions about health. Available at: http://www.cochrane.org/ .
Examples of Systematic Reviews To Link Research and Quality Improvement
Over the past 17 years more than 300 learners, including physicians, nurses, and health administrators have completed a course as part of a Master of Health Administration or a Master of Science in Health Informatics degree at the University of Missouri. An objective of the course is to educate health informatics and health administration professionals about how to utilize a systematic, scientific, and evidence-based approach to literature searching, appraisal, and synthesis. Learners in the course conduct a systematic review of the literature on a health care topic of their choosing that could suggest quality improvement in their organization. Students select topics that make sense in terms of their core educational competencies and are related to their work. The categories of topics include public health, leadership, information management, health information technology, electronic medical records, telehealth, patient/clinician safety, treatment/screening evaluation cost/finance, human resources, planning and marketing, supply chain, education/training, policies and regulations, access, and satisfaction. Some learners have published their systematic literature reviews 14 – 15 . Qualitative comments from the students indicate that the course is well received and the skills learned in the course are applicable to a variety of health care settings.
Undertaking a literature review includes identification of a topic of interest, searching and retrieving the appropriate literature, assessing quality, extracting data and information, analyzing and synthesizing the findings, and writing a report. A structured step-by-step approach facilitates the development of a complete and informed literature review.
Suzanne Austin Boren, PhD, MHA, (above) is Associate Professor and Director of Academic Programs, and David Moxley, MLIS, is Clinical Instructor and Associate Director of Executive Programs. Both are in the Department of Health Management and Informatics at the University of Missouri School of Medicine.
None reported.
- 1. Polit DF, Beck CT. Nursing Research: principles and methods. 9th edition. Lippincott, Williams & Wilkins; Philadelphia: 2011. [ Google Scholar ]
- 2. Bruce J, Mollison J. Reviewing the literature: adopting a systematic approach. Journal of Family Planning and Reproductive Health Care. 2004;30(1) doi: 10.1783/147118904322701901. [ DOI ] [ PubMed ] [ Google Scholar ]
- 3. Cronin P, Ryan F, Coughlin M. Undertaking a literature review: A step-by-step approach. British Journal of Nursing. 2008;17(1):38–43. doi: 10.12968/bjon.2008.17.1.28059. [ DOI ] [ PubMed ] [ Google Scholar ]
- 4. Crowther DM. A clinician’s guide to systematic reviews. Nutr Clin Pract. 2013;28:459–462. doi: 10.1177/0884533613490742. [ DOI ] [ PubMed ] [ Google Scholar ]
- 5. Hasse SC. Systematic reviews and meta-analysis. Plast Reconstr Surg. 2011;127:955–966. doi: 10.1097/PRS.0b013e318200afa9. [ DOI ] [ PubMed ] [ Google Scholar ]
- 6. Mandrekar JN, Mandreker SJ. Systematic reviews and meta analysis of published studies: An over view and best practices. J Thorac Oncol. 2011;6(8):1301–1303. doi: 10.1097/JTO.0b013e31822461b0. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
- 7. Ng KH, Peh WC. Writing a systematic review. Singapore Med J. 2010 May;51(5):362–6. [ PubMed ] [ Google Scholar ]
- 8. Price B. Guidance on conducting a literature search reviewing mixed literature. Nursing Standard. 2009;23(24):43–49. doi: 10.7748/ns2009.02.23.24.43.c6829. [ DOI ] [ PubMed ] [ Google Scholar ]
- 9. Engberg S. Systematic reviews and meta-analysis: Studies of studies. J Wound Ostomy Continence Nurs. 2008;35(3):258–265. doi: 10.1097/01.WON.0000319122.76112.23. [ DOI ] [ PubMed ] [ Google Scholar ]
- 10. Benhamou PY, Melki V, Boizel R, et al. One-year efficacy and safety of Web-based follow-up using cellular phone in type 1 diabetic patients under insulin pump therapy: the PumpNet study. Diabetes & Metabolism. 2007;33(3):220–6. doi: 10.1016/j.diabet.2007.01.002. [ DOI ] [ PubMed ] [ Google Scholar ]
- 11. Marquez Contreras E, de la Figuera von Wichmann M, Gil Guillen V, Ylla-Catala A, Figueras M, Balana M, Naval J. Effective news of an inter vention to provide information to patients with hypertension as short text messages and reminder sent to their mobile phone [Spanish] Aten Primaria. 2004;34(8):399–405. doi: 10.1016/S0212-6567(04)78922-2. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
- 12. Moher D, Liberati A, Tetzlaff J, Altman DG The PRISMA Group. Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. Ann Intern Med. 2009;151(4):264–269. W64. doi: 10.7326/0003-4819-151-4-200908180-00135. [ DOI ] [ PubMed ] [ Google Scholar ]
- 13. Tong A, Flemming K, McInnes E, Oliver S, Craig J. Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ. BMC Med Res Methodol. 2012;12(1):181. doi: 10.1186/1471-2288-12-181. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
- 14. Hart MD. Informatics competency and development within the US nursing population workforce. CIN: Computers, Informatics, Nursing. 2008;26(6):320–329. doi: 10.1097/01.NCN.0000336462.94939.4c. [ DOI ] [ PubMed ] [ Google Scholar ]
- 15. Bryan C, Boren SA. The use and effectiveness of electronic clinical decision support tools in the ambulatory, primary care setting: A systematic review of the literature. Informatics in Primary Care. 2008 Jun;16(2):79–91. doi: 10.14236/jhi.v16i2.679. [ DOI ] [ PubMed ] [ Google Scholar ]
- PDF (510.6 KB)
- Collections
Similar articles
Cited by other articles, links to ncbi databases.
- Download .nbib .nbib
- Format: AMA APA MLA NLM
Add to Collections
Health (Nursing, Medicine, Allied Health)
- Find Articles/Databases
- Reference Resources
- Evidence Summaries & Clinical Guidelines
- Drug Information
- Health Data & Statistics
- Patient/Consumer Facing Materials
- Images and Streaming Video
- Grey Literature
- Mobile Apps & "Point of Care" Tools
- Tests & Measures This link opens in a new window
- Citing Sources
- Selecting Databases
- Framing Research Questions
- Crafting a Search
- Narrowing / Filtering a Search
- Expanding a Search
- Cited Reference Searching
- Saving Searches
- Term Glossary
- Critical Appraisal Resources
- What are Literature Reviews?
- Conducting & Reporting Systematic Reviews
- Finding Systematic Reviews
- Tutorials & Tools for Literature Reviews
- Finding Full Text
What are Systematic Reviews? (3 minutes, 24 second YouTube Video)
Systematic Literature Reviews: Steps & Resources
These steps for conducting a systematic literature review are listed below .
Also see subpages for more information about:
- The different types of literature reviews, including systematic reviews and other evidence synthesis methods
- Tools & Tutorials
Literature Review & Systematic Review Steps
- Develop a Focused Question
- Scope the Literature (Initial Search)
- Refine & Expand the Search
- Limit the Results
- Download Citations
- Abstract & Analyze
- Create Flow Diagram
- Synthesize & Report Results
1. Develop a Focused Question
Consider the PICO Format: Population/Problem, Intervention, Comparison, Outcome
Focus on defining the Population or Problem and Intervention (don't narrow by Comparison or Outcome just yet!)
"What are the effects of the Pilates method for patients with low back pain?"
Tools & Additional Resources:
- PICO Question Help
- Stillwell, Susan B., DNP, RN, CNE; Fineout-Overholt, Ellen, PhD, RN, FNAP, FAAN; Melnyk, Bernadette Mazurek, PhD, RN, CPNP/PMHNP, FNAP, FAAN; Williamson, Kathleen M., PhD, RN Evidence-Based Practice, Step by Step: Asking the Clinical Question, AJN The American Journal of Nursing : March 2010 - Volume 110 - Issue 3 - p 58-61 doi: 10.1097/01.NAJ.0000368959.11129.79
2. Scope the Literature
A "scoping search" investigates the breadth and/or depth of the initial question or may identify a gap in the literature.
Eligible studies may be located by searching in:
- Background sources (books, point-of-care tools)
- Article databases
- Trial registries
- Grey literature
- Cited references
- Reference lists
When searching, if possible, translate terms to controlled vocabulary of the database. Use text word searching when necessary.
Use Boolean operators to connect search terms:
- Combine separate concepts with AND (resulting in a narrower search)
- Connecting synonyms with OR (resulting in an expanded search)
Search: pilates AND ("low back pain" OR backache )
Video Tutorials - Translating PICO Questions into Search Queries
- Translate Your PICO Into a Search in PubMed (YouTube, Carrie Price, 5:11)
- Translate Your PICO Into a Search in CINAHL (YouTube, Carrie Price, 4:56)
3. Refine & Expand Your Search
Expand your search strategy with synonymous search terms harvested from:
- database thesauri
- reference lists
- relevant studies
Example:
(pilates OR exercise movement techniques) AND ("low back pain" OR backache* OR sciatica OR lumbago OR spondylosis)
As you develop a final, reproducible strategy for each database, save your strategies in a:
- a personal database account (e.g., MyNCBI for PubMed)
- Log in with your NYU credentials
- Open and "Make a Copy" to create your own tracker for your literature search strategies
4. Limit Your Results
Use database filters to limit your results based on your defined inclusion/exclusion criteria. In addition to relying on the databases' categorical filters, you may also need to manually screen results.
- Limit to Article type, e.g.,: "randomized controlled trial" OR multicenter study
- Limit by publication years, age groups, language, etc.
NOTE: Many databases allow you to filter to "Full Text Only". This filter is not recommended . It excludes articles if their full text is not available in that particular database (CINAHL, PubMed, etc), but if the article is relevant, it is important that you are able to read its title and abstract, regardless of 'full text' status. The full text is likely to be accessible through another source (a different database, or Interlibrary Loan).
- Filters in PubMed
- CINAHL Advanced Searching Tutorial
5. Download Citations
Selected citations and/or entire sets of search results can be downloaded from the database into a citation management tool. If you are conducting a systematic review that will require reporting according to PRISMA standards, a citation manager can help you keep track of the number of articles that came from each database, as well as the number of duplicate records.
In Zotero, you can create a Collection for the combined results set, and sub-collections for the results from each database you search. You can then use Zotero's 'Duplicate Items" function to find and merge duplicate records.
- Citation Managers - General Guide
6. Abstract and Analyze
- Migrate citations to data collection/extraction tool
- Screen Title/Abstracts for inclusion/exclusion
- Screen and appraise full text for relevance, methods,
- Resolve disagreements by consensus
Covidence is a web-based tool that enables you to work with a team to screen titles/abstracts and full text for inclusion in your review, as well as extract data from the included studies.
- Covidence Support
- Critical Appraisal Tools
- Data Extraction Tools
7. Create Flow Diagram
The PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analyses) flow diagram is a visual representation of the flow of records through different phases of a systematic review. It depicts the number of records identified, included and excluded. It is best used in conjunction with the PRISMA checklist .
Example from: Stotz, S. A., McNealy, K., Begay, R. L., DeSanto, K., Manson, S. M., & Moore, K. R. (2021). Multi-level diabetes prevention and treatment interventions for Native people in the USA and Canada: A scoping review. Current Diabetes Reports, 2 (11), 46. https://doi.org/10.1007/s11892-021-01414-3
- PRISMA Flow Diagram Generator (ShinyApp.io, Haddaway et al. )
- PRISMA Diagram Templates (Word and PDF)
- Make a copy of the file to fill out the template
- Image can be downloaded as PDF, PNG, JPG, or SVG
- Covidence generates a PRISMA diagram that is automatically updated as records move through the review phases
8. Synthesize & Report Results
There are a number of reporting guideline available to guide the synthesis and reporting of results in systematic literature reviews.
It is common to organize findings in a matrix, also known as a Table of Evidence (ToE).
- Reporting Guidelines for Systematic Reviews
- Download a sample template of a health sciences review matrix (GoogleSheets)
Steps modified from:
Cook, D. A., & West, C. P. (2012). Conducting systematic reviews in medical education: a stepwise approach. Medical Education , 46 (10), 943–952.
- << Previous: Critical Appraisal Resources
- Next: What are Literature Reviews? >>
- Last Updated: Nov 14, 2024 5:37 PM
- URL: https://guides.nyu.edu/health
Health and Social Care
- Getting Started
- Professional and Web-based Sources
- NHS Scotland Knowledge Network
- Literature reviewing - The process
- Recommended reading
Literature reviewing - the overview
- What is a literature review?
- How are literature reviews relevant to health and social care?
- Types of Literature Review
- Reporting and Conducting Guidance
- What's in a good literature review?
- Common mistakes?
A literature review:
- Finds existing literature/sources published on a specific topic/to answer a review question.
- Brings together the literature sources into a single body of literature.
- Makes comparisons between the different included sources to identify both patterns/similarities and conflicts/differences.
Within healthcare literature reviews are often known as 'evidence synthesis reviews' and usually have specific methods and processes which are detailed in more depth in the section below titled 'Literature reviewing - the process'. This can differ from other field areas so if you have not done a healthcare evidence synthesis review before you may find it very different to previous expectations or experiences.
There are also a number of different types of evidence synthesis reviews within healthcare and the type of review impacts the purpose and methods. The next tab gives more information about different types of review. If you are doing a review as part of an academic assignment then please ensure you follow the requirements and any methods set out in your assignment brief.
Taking a Systematic Approach
Within healthcare evidence synthesis reviews there is an expectation that the approach taken, no matter what type of review is being done, is systematic. Whilst a systematic review is a specific review type, any review type can still take a systematic approach which strengths the quality of the methods, and therefore also strengthens the quality of the findings, write up, and usefulness/applicability of the review.
- Wakefield, A.(2014). Searching and critiquing the research literature. Nursing Standard, 28(39), 49-57
- Kable, A. K., Pich, J., & Maslin-Prothero, S. E. (2012). A structured approach to documenting a search strategy for publication: a 12 step guideline for authors. Nurse Education Today, 32(8), 878-886
- Smith, J., Noble, H. (2016) Reviewing the literature. Evidence Based Nursing, 19 (1), 2-3.
Literature reviews are a form of evidence synthesis, which is how research and other sources are analysed, evaluated, and brought together in order to form bodies of literature. This strengthens the evidence to then allow it to be used to implement changes though an evidence-based practice approach. In order to implement evidence in practice we need to be confident of its reliability and accuracy, which healthcare reviews address through the appraisal and synthesis of multiple sources of evidence. We cannot rely on a single source of evidence to implement changes, we need a large body of evidence to be confident to apply it.
The hierarchy of evidence below demonstrates how literature reviews and other forms of evidence synthesis, such as guidelines, appear at the top of the hierarchy. Secondary sources that analyse and synthesise literature are stronger than individual studies or other sources.
In health and social care there are a number of different types of review. The resources below give an outline of the different types and outline the differences between them:
Grant, M. J., & Booth, A. (2009). A typology of reviews: an analysis of 14 review types and associated methodologies. Health Information and Libraries Journal , 26 (2), 91–108. https://doi.org/10.1111/j.1471-1842.2009.00848.x
Sutton, A., Clowes, M., Preston, L., & Booth, A. (2019). Meeting the review family: exploring review types and associated information retrieval requirements. Health Information and Libraries Journal , 36 (3), 202–222. https://doi.org/10.1111/hir.12276
If you are doing a literature review as part of an academic assignment then please ensure you follow the requirements and any methods set out in your assignment brief. You may be advised to do a specific type of review, but when reading the guidance of how to conduct one find that it differs from your assignment brief. If so, discuss this with your supervisor or module leader.
Choosing a Review Type
You need to understand the purpose of different review types and match this up with what you are intending to achieve from carrying out your review in order to select the most appropriate type. You can include this explanation and justification within your write up. As well as the guidance above please see some further resources below to support your decision making.
Munn, Z., Peters, M. D. J., Stern, C., Tufanaru, C., McArthur, A., & Aromataris, E. (2018). Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Medical Research Methodology , 18 (1), 143–143. https://doi.org/10.1186/s12874-018-0611-x
Jonkoping University. (n.d.). Which review is right for you? https://guides.library.ju.se/c.php?g=690269&p=4943634
Right Review. (2024). Right Review Tool. https://rightreview.knowledgetranslation.net/
There are a number of published reporting and conducting guidelines and handbooks to support you in both carrying out and writing up your review. These help to ensure the quality and transparency of your review by ensuring you have included and conducted your review in a way that meets established methodological expectations.
Reporting guidelines give information on what you need to include in the write up of the review. Conducting guidelines provide more methodological guidance on how to carry out and undertake each stage of a review, not just stating what you need to include/report. When using these they need to be cited and referenced and the wording you would use needs to distinguish if it is a reporting or conducting resource, and therefore how it has been used. Examples:
'this review/protocol was reported using . . . '
'the conducting of this review was guided by . . . '
A lot of these were designed for quantitative systematic reviews of interventions, however a number of resources now exist for different types of evidence synthesis reviews. Below are resources of some of the most commonly used guidelines.
The PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) statement consists of a 27-item checklist that covers the elements needed in the write up of a systematic review, and a flow diagram.
There is an article giving further explanation of every element of the checklist and a glossary of terms .
PRISMA also have guidance for reporting protocols, known as the PRISMA-P extension.
There is also a checklist extension for Scoping Reviews called PRISMA- ScR , which is very similar to the Systematic Review checklist but with some key differences.
Also a more in-depth explanatory paper for this checklist as well.
The Cochrane Handbook for Systematic Reviews of Interventions needs to be followed if you were to publish a review or review protocol in the Cochrane Library of Systematic Reviews.
There are a set a reporting guidelines for both review protocols and full reviews .
Key aspects of the Cochrane handbook are collated as the Methodological Expectations for Cochrane Intervention Reviews – takes you through steps needed to conduct.
The Cochrane Handbook Chapter V also details methodology for conducting Overviews of Reviews.
The Cochrane Qualitative and Implementation Methods Group have published a series of 6 papers covering qualitative evidence synthesis methods .
The Cochrane Rapid Reviews Methods Group and Cochrane Qualitative and Implementation Methods Group (CQIMG) have published a recent article on guidance for rapid qualitative evidence synthesis .
Other Guides
The JBI Manual for Evidence Synthesis separates SRs out by types of evidence included, as well as having chapters on Mixed Methods Reviews, Scoping Reviews and Umbrella Reviews.
RAMSES reporting can be used for realist reviews and meta-narrative reviews.
The ENTREQ checklist can be used to report reviews of qualitative literature, alongside a fuller article explaining the development of the checklist .
Further reporting and conducting guidelines can be found on this useful page from the University of Illinois .
Booth, A. (2016). EVIDENT Guidance for reviewing the evidence: a compendium of methodological literature and websites. https://www.researchgate.net/publication/292991575_EVIDENT_Guidance_for_Reviewing_the_Evidence_a_compendium_of_methodological_literature_and_websites
A good literature review should:
- Address a focused, explicit research question.
- Take a systematic approach to the searching of the literature.
- Document the search process so that it is replicable by others (often a requirement for publication within many academic journals)
- Demonstrate that a wide range of sources have been searched.
- Undertake a critical analysis of the retrieved literature, not merely describe what has been read.
- Justify why particular items of literature are being referred to. They should summarise the current state of research, perhaps debates that have taken place over a period of time within that topic or arguments for and against a particular aspect of the topic.
- Relate the question to the larger body of knowledge within which your topic sits, and to put your work into context.
- Summarise the current state of the research evidence.
- Identify the gap in the literature that your research question is going to answer.
Common Mistakes
- Review is too descriptive. No critiquing or critical evaluation of the evidence. No identification of strengths and weaknesses. It becomes an essay, not a review. It does not set the foundation for your own research process.
- It becomes a dumping ground to write down everything you know about the topic or is presented as a series of quotes from the papers you have read.
- Not enough time has been allocated to searching and reviewing the literature. Do your literature reviewing early. It helps inform your final research question, future methodologies and identifies whether there is indeed a "gap" in the current research literature that your queston is going to answer.
- Literature used is not from scholarly peer reviewed sources.
- There is no documentation or explanation of how the search was undertaken and the key terms used. No explanation of inclusion/exclusion criteria.
- Referencing does not follow the School guidelines. It is not consistent in style or presentation.
- There has been no revision or proof reading. Thinking develops as you write. Go back over what you have written a few days after you have done it. Check grammar and language – give it to someone else to proof read.
Here are 5 top tips towards a stress free literature review
- Top tips for literature reviewing
- << Previous: NHS Scotland Knowledge Network
- Next: Literature reviewing - The process >>
- Last Updated: Oct 8, 2024 10:00 AM
- URL: https://libguides.napier.ac.uk/shsc
You are in: Europe Change location
You are here
PLEASE NOTE: Sage UK Distribution including UK Books Customer Services will be closed for a stocktake from 27th November to 29th November. This affects only book orders and queries from the UK. Any orders placed during this period; or queries emailed, will be dealt with as normal when service resumes on 2nd December. Thank you for your patience and we apologise for any inconvenience caused.
Disable VAT on Taiwan
Unfortunately, as of 1 January 2020 SAGE Ltd is no longer able to support sales of electronically supplied services to Taiwan customers that are not Taiwan VAT registered. We apologise for any inconvenience. For more information or to place a print-only order, please contact [email protected] .
Doing a Literature Review in Nursing, Health and Social Care
- Michael Coughlan - Trinity College Dublin, Ireland
- Patricia Cronin - Trinity College Dublin, Ireland
- Description
A clear and practical guide to completing a literature review in nursing and healthcare studies.
Providing students with straightforward guidance on how to successfully carry out a literature review as part of a research project or dissertation, this book uses examples and activities to demonstrate how to complete each step correctly, from start to finish, and highlights how to avoid common mistakes.
The third edition includes:
- Expert advice on selecting and researching a topic
- A chapter outlining the different types of literature review
- Increased focus on Critical Appraisal Tools and how to use them effectively
- New real-world examples presenting best practice
- Instructions on writing up and presenting the final piece of work
Perfect for any nursing or healthcare student new to literature reviews and for anyone who needs a refresher in this important topic.
Praise for the previous edition:
'This book is an excellent resource for practitioners wishing to develop their knowledge and understanding of reviewing literature and the processes involved. It uses uncomplicated language to signpost the reader effortlessly through key aspects of research processes. Practitioners will find this an invaluable companion for navigating through evidence to identify quality literature applicable to health and social care practice.'
'Students often struggle with writing an effective literature review and this invaluable guide will help to allay their concerns. Key terms are clearly explained, and the inclusion of learning outcomes is a helpful feature for students and lecturers alike. The examples are also very helpful, particularly for less confident students. This is an accessible yet authoritative guide which I can thoroughly recommend.'
'A must have - this book provides useful information and guidance to students and professionals alike. It guides the reader through various research methods in a theoretical and pragmatic manner.'
' It's a very readable, concise, and accessible introduction to undertaking a literature review in the field of healthcare. The book’s layout has a logical format which really helped me to think methodically about my research question. An excellent reference for undergraduates who are about to undertake their first literature review.'
'This book is an essential resource for students. Clearly written and excellently structured, with helpful study tools throughout, it takes the reader step by step through the literature review process in an easy, informative and accessible manner. This text gives students the skills they need to successfully complete their own review.'
'The updating of the chapters will be exceptionally helpful given the rapid changes in online availability of resources and open-access literature.'
Excellent resource. Useful for any stage of studying
Excellent text for masters and doctoral level students
An excellent primer to help the level 7 students write their systemised review for the assignment.
This book provides a comprehensive overview of the practical process of literature review in healthcare. It contains all details required to conduct a review by students.
This is an excellent clear and concise book on undertaking literature reviews being particularly good at demystifying jargon. It is timely given the move to student dissertations being primarily literature reviews in the current Covid pandemic. However nearly all the examples are drawn from nursing and health making the text less useful for social care and social work. A little disappointing given the title. SW students are likely to gravitate to texts where their subject is more prominent for a primary text.
Accessible, informative, step to step guide
This is a really helpful, accessible text for students and academic staff alike.
A really good addition to the repertoire of skills and techniques for understanding the essential process of literature reviewing.
Preview this book
Available in sage catalyst : the ultimate social science textbook collection, for instructors.
Please select a format:
Select a Purchasing Option
- Electronic Order Options VitalSource Amazon Kindle Google Play eBooks.com Kobo
Related Products
Log in using your username and password
- Search More Search for this keyword Advanced search
- Latest content
- Current issue
- Write for Us
- BMJ Journals More You are viewing from: Google Indexer
You are here
- Volume 19, Issue 1
- Reviewing the literature
- Article Text
- Article info
- Citation Tools
- Rapid Responses
- Article metrics
- Joanna Smith 1 ,
- Helen Noble 2
- 1 School of Healthcare, University of Leeds , Leeds , UK
- 2 School of Nursing and Midwifery, Queens's University Belfast , Belfast , UK
- Correspondence to Dr Joanna Smith , School of Healthcare, University of Leeds, Leeds LS2 9JT, UK; j.e.smith1{at}leeds.ac.uk
https://doi.org/10.1136/eb-2015-102252
Statistics from Altmetric.com
Request permissions.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.
Implementing evidence into practice requires nurses to identify, critically appraise and synthesise research. This may require a comprehensive literature review: this article aims to outline the approaches and stages required and provides a working example of a published review.
Are there different approaches to undertaking a literature review?
What stages are required to undertake a literature review.
The rationale for the review should be established; consider why the review is important and relevant to patient care/safety or service delivery. For example, Noble et al 's 4 review sought to understand and make recommendations for practice and research in relation to dialysis refusal and withdrawal in patients with end-stage renal disease, an area of care previously poorly described. If appropriate, highlight relevant policies and theoretical perspectives that might guide the review. Once the key issues related to the topic, including the challenges encountered in clinical practice, have been identified formulate a clear question, and/or develop an aim and specific objectives. The type of review undertaken is influenced by the purpose of the review and resources available. However, the stages or methods used to undertake a review are similar across approaches and include:
Formulating clear inclusion and exclusion criteria, for example, patient groups, ages, conditions/treatments, sources of evidence/research designs;
Justifying data bases and years searched, and whether strategies including hand searching of journals, conference proceedings and research not indexed in data bases (grey literature) will be undertaken;
Developing search terms, the PICU (P: patient, problem or population; I: intervention; C: comparison; O: outcome) framework is a useful guide when developing search terms;
Developing search skills (eg, understanding Boolean Operators, in particular the use of AND/OR) and knowledge of how data bases index topics (eg, MeSH headings). Working with a librarian experienced in undertaking health searches is invaluable when developing a search.
Once studies are selected, the quality of the research/evidence requires evaluation. Using a quality appraisal tool, such as the Critical Appraisal Skills Programme (CASP) tools, 5 results in a structured approach to assessing the rigour of studies being reviewed. 3 Approaches to data synthesis for quantitative studies may include a meta-analysis (statistical analysis of data from multiple studies of similar designs that have addressed the same question), or findings can be reported descriptively. 6 Methods applicable for synthesising qualitative studies include meta-ethnography (themes and concepts from different studies are explored and brought together using approaches similar to qualitative data analysis methods), narrative summary, thematic analysis and content analysis. 7 Table 1 outlines the stages undertaken for a published review that summarised research about parents’ experiences of living with a child with a long-term condition. 8
- View inline
An example of rapid evidence assessment review
In summary, the type of literature review depends on the review purpose. For the novice reviewer undertaking a review can be a daunting and complex process; by following the stages outlined and being systematic a robust review is achievable. The importance of literature reviews should not be underestimated—they help summarise and make sense of an increasingly vast body of research promoting best evidence-based practice.
- ↵ Centre for Reviews and Dissemination . Guidance for undertaking reviews in health care . 3rd edn . York : CRD, York University , 2009 .
- ↵ Canadian Best Practices Portal. http://cbpp-pcpe.phac-aspc.gc.ca/interventions/selected-systematic-review-sites / ( accessed 7.8.2015 ).
- Bridges J , et al
- ↵ Critical Appraisal Skills Programme (CASP). http://www.casp-uk.net / ( accessed 7.8.2015 ).
- Dixon-Woods M ,
- Shaw R , et al
- Agarwal S ,
- Jones D , et al
- Cheater F ,
Twitter Follow Joanna Smith at @josmith175
Competing interests None declared.
IMAGES
VIDEO
COMMENTS
This article describes a step-by-step process to systematically review the literature along with links to key resources. An example of a graduate program using systematic literature reviews to link research and quality improvement practices is also provided.
What are Literature Reviews? The different types of literature reviews, including systematic reviews and other evidence synthesis methods. Conducting & Reporting Systematic Reviews. Finding Systematic Reviews. Tools & Tutorials. Literature Review & Systematic Review Steps. Develop a Focused Question. Scope the Literature (Initial Search)
Literature reviews are becoming more and more important and favoured in the evidencebased practice (EBP) of health and social care1. Healthcare professionals require updated information regarding research and development to inform their practice.
Understanding the landscape in which you are working will enable you to make a valuable contribution to your field. Writing a literature review requires a range of skills to gather, sort, evaluate and summarise peer-reviewed published data into a relevant and informative unbiased narrative.
What is a literature review? How are literature reviews relevant to health and social care? Types of Literature Review; Reporting and Conducting Guidance; What's in a good literature review? Common mistakes? Top Tips
This fourth edition includes:• A broad range of real life examples of how to overcomechallenges in the process• How to get your question right• Updated guidance on following a clear search...
A clear and practical guide to completing a literature review in nursing and healthcare studies. Providing students with straightforward guidance on how to successfully carry out a literature review as part of a research project or dissertation, this book uses examples and activities to demonstrate how to complete each step correctly, from ...
Scoping reviews are often used to map the literature in a broad context prior to undertaking a more focused systematic review. 2 Rapid evidence assessments are used to summarise and synthesise research findings within the constraints of time and resources, and differ from systematic review in relation to the extensiveness of the search strategie...
Nursing, Health AND Social Care. 3rd. edition. michael coughlan & patricia cronin. Critically Appraising the Literature. Learning Outcomes. The aim of this chapter is to help you: Compare and contrast related findings in the literature. Differentiate between articles using a post-positivist and a naturalistic research methodology.
With real-life examples of written research and succinct summaries at the end of each chapter, A Post-Graduate’s Guide to Doing a Literature Review in Health and Social Care is the ideal...