• Privacy Policy

Research Method

Home » Critical Analysis – Types, Examples and Writing Guide

Critical Analysis – Types, Examples and Writing Guide

Table of Contents

Critical Analysis

Critical Analysis

Definition:

Critical analysis is a process of examining a piece of work or an idea in a systematic, objective, and analytical way. It involves breaking down complex ideas, concepts, or arguments into smaller, more manageable parts to understand them better.

Types of Critical Analysis

Types of Critical Analysis are as follows:

Literary Analysis

This type of analysis focuses on analyzing and interpreting works of literature , such as novels, poetry, plays, etc. The analysis involves examining the literary devices used in the work, such as symbolism, imagery, and metaphor, and how they contribute to the overall meaning of the work.

Film Analysis

This type of analysis involves examining and interpreting films, including their themes, cinematography, editing, and sound. Film analysis can also include evaluating the director’s style and how it contributes to the overall message of the film.

Art Analysis

This type of analysis involves examining and interpreting works of art , such as paintings, sculptures, and installations. The analysis involves examining the elements of the artwork, such as color, composition, and technique, and how they contribute to the overall meaning of the work.

Cultural Analysis

This type of analysis involves examining and interpreting cultural artifacts , such as advertisements, popular music, and social media posts. The analysis involves examining the cultural context of the artifact and how it reflects and shapes cultural values, beliefs, and norms.

Historical Analysis

This type of analysis involves examining and interpreting historical documents , such as diaries, letters, and government records. The analysis involves examining the historical context of the document and how it reflects the social, political, and cultural attitudes of the time.

Philosophical Analysis

This type of analysis involves examining and interpreting philosophical texts and ideas, such as the works of philosophers and their arguments. The analysis involves evaluating the logical consistency of the arguments and assessing the validity and soundness of the conclusions.

Scientific Analysis

This type of analysis involves examining and interpreting scientific research studies and their findings. The analysis involves evaluating the methods used in the study, the data collected, and the conclusions drawn, and assessing their reliability and validity.

Critical Discourse Analysis

This type of analysis involves examining and interpreting language use in social and political contexts. The analysis involves evaluating the power dynamics and social relationships conveyed through language use and how they shape discourse and social reality.

Comparative Analysis

This type of analysis involves examining and interpreting multiple texts or works of art and comparing them to each other. The analysis involves evaluating the similarities and differences between the texts and how they contribute to understanding the themes and meanings conveyed.

Critical Analysis Format

Critical Analysis Format is as follows:

I. Introduction

  • Provide a brief overview of the text, object, or event being analyzed
  • Explain the purpose of the analysis and its significance
  • Provide background information on the context and relevant historical or cultural factors

II. Description

  • Provide a detailed description of the text, object, or event being analyzed
  • Identify key themes, ideas, and arguments presented
  • Describe the author or creator’s style, tone, and use of language or visual elements

III. Analysis

  • Analyze the text, object, or event using critical thinking skills
  • Identify the main strengths and weaknesses of the argument or presentation
  • Evaluate the reliability and validity of the evidence presented
  • Assess any assumptions or biases that may be present in the text, object, or event
  • Consider the implications of the argument or presentation for different audiences and contexts

IV. Evaluation

  • Provide an overall evaluation of the text, object, or event based on the analysis
  • Assess the effectiveness of the argument or presentation in achieving its intended purpose
  • Identify any limitations or gaps in the argument or presentation
  • Consider any alternative viewpoints or interpretations that could be presented
  • Summarize the main points of the analysis and evaluation
  • Reiterate the significance of the text, object, or event and its relevance to broader issues or debates
  • Provide any recommendations for further research or future developments in the field.

VI. Example

  • Provide an example or two to support your analysis and evaluation
  • Use quotes or specific details from the text, object, or event to support your claims
  • Analyze the example(s) using critical thinking skills and explain how they relate to your overall argument

VII. Conclusion

  • Reiterate your thesis statement and summarize your main points
  • Provide a final evaluation of the text, object, or event based on your analysis
  • Offer recommendations for future research or further developments in the field
  • End with a thought-provoking statement or question that encourages the reader to think more deeply about the topic

How to Write Critical Analysis

Writing a critical analysis involves evaluating and interpreting a text, such as a book, article, or film, and expressing your opinion about its quality and significance. Here are some steps you can follow to write a critical analysis:

  • Read and re-read the text: Before you begin writing, make sure you have a good understanding of the text. Read it several times and take notes on the key points, themes, and arguments.
  • Identify the author’s purpose and audience: Consider why the author wrote the text and who the intended audience is. This can help you evaluate whether the author achieved their goals and whether the text is effective in reaching its audience.
  • Analyze the structure and style: Look at the organization of the text and the author’s writing style. Consider how these elements contribute to the overall meaning of the text.
  • Evaluate the content : Analyze the author’s arguments, evidence, and conclusions. Consider whether they are logical, convincing, and supported by the evidence presented in the text.
  • Consider the context: Think about the historical, cultural, and social context in which the text was written. This can help you understand the author’s perspective and the significance of the text.
  • Develop your thesis statement : Based on your analysis, develop a clear and concise thesis statement that summarizes your overall evaluation of the text.
  • Support your thesis: Use evidence from the text to support your thesis statement. This can include direct quotes, paraphrases, and examples from the text.
  • Write the introduction, body, and conclusion : Organize your analysis into an introduction that provides context and presents your thesis, a body that presents your evidence and analysis, and a conclusion that summarizes your main points and restates your thesis.
  • Revise and edit: After you have written your analysis, revise and edit it to ensure that your writing is clear, concise, and well-organized. Check for spelling and grammar errors, and make sure that your analysis is logically sound and supported by evidence.

When to Write Critical Analysis

You may want to write a critical analysis in the following situations:

  • Academic Assignments: If you are a student, you may be assigned to write a critical analysis as a part of your coursework. This could include analyzing a piece of literature, a historical event, or a scientific paper.
  • Journalism and Media: As a journalist or media person, you may need to write a critical analysis of current events, political speeches, or media coverage.
  • Personal Interest: If you are interested in a particular topic, you may want to write a critical analysis to gain a deeper understanding of it. For example, you may want to analyze the themes and motifs in a novel or film that you enjoyed.
  • Professional Development : Professionals such as writers, scholars, and researchers often write critical analyses to gain insights into their field of study or work.

Critical Analysis Example

An Example of Critical Analysis Could be as follow:

Research Topic:

The Impact of Online Learning on Student Performance

Introduction:

The introduction of the research topic is clear and provides an overview of the issue. However, it could benefit from providing more background information on the prevalence of online learning and its potential impact on student performance.

Literature Review:

The literature review is comprehensive and well-structured. It covers a broad range of studies that have examined the relationship between online learning and student performance. However, it could benefit from including more recent studies and providing a more critical analysis of the existing literature.

Research Methods:

The research methods are clearly described and appropriate for the research question. The study uses a quasi-experimental design to compare the performance of students who took an online course with those who took the same course in a traditional classroom setting. However, the study may benefit from using a randomized controlled trial design to reduce potential confounding factors.

The results are presented in a clear and concise manner. The study finds that students who took the online course performed similarly to those who took the traditional course. However, the study only measures performance on one course and may not be generalizable to other courses or contexts.

Discussion :

The discussion section provides a thorough analysis of the study’s findings. The authors acknowledge the limitations of the study and provide suggestions for future research. However, they could benefit from discussing potential mechanisms underlying the relationship between online learning and student performance.

Conclusion :

The conclusion summarizes the main findings of the study and provides some implications for future research and practice. However, it could benefit from providing more specific recommendations for implementing online learning programs in educational settings.

Purpose of Critical Analysis

There are several purposes of critical analysis, including:

  • To identify and evaluate arguments : Critical analysis helps to identify the main arguments in a piece of writing or speech and evaluate their strengths and weaknesses. This enables the reader to form their own opinion and make informed decisions.
  • To assess evidence : Critical analysis involves examining the evidence presented in a text or speech and evaluating its quality and relevance to the argument. This helps to determine the credibility of the claims being made.
  • To recognize biases and assumptions : Critical analysis helps to identify any biases or assumptions that may be present in the argument, and evaluate how these affect the credibility of the argument.
  • To develop critical thinking skills: Critical analysis helps to develop the ability to think critically, evaluate information objectively, and make reasoned judgments based on evidence.
  • To improve communication skills: Critical analysis involves carefully reading and listening to information, evaluating it, and expressing one’s own opinion in a clear and concise manner. This helps to improve communication skills and the ability to express ideas effectively.

Importance of Critical Analysis

Here are some specific reasons why critical analysis is important:

  • Helps to identify biases: Critical analysis helps individuals to recognize their own biases and assumptions, as well as the biases of others. By being aware of biases, individuals can better evaluate the credibility and reliability of information.
  • Enhances problem-solving skills : Critical analysis encourages individuals to question assumptions and consider multiple perspectives, which can lead to creative problem-solving and innovation.
  • Promotes better decision-making: By carefully evaluating evidence and arguments, critical analysis can help individuals make more informed and effective decisions.
  • Facilitates understanding: Critical analysis helps individuals to understand complex issues and ideas by breaking them down into smaller parts and evaluating them separately.
  • Fosters intellectual growth : Engaging in critical analysis challenges individuals to think deeply and critically, which can lead to intellectual growth and development.

Advantages of Critical Analysis

Some advantages of critical analysis include:

  • Improved decision-making: Critical analysis helps individuals make informed decisions by evaluating all available information and considering various perspectives.
  • Enhanced problem-solving skills : Critical analysis requires individuals to identify and analyze the root cause of a problem, which can help develop effective solutions.
  • Increased creativity : Critical analysis encourages individuals to think outside the box and consider alternative solutions to problems, which can lead to more creative and innovative ideas.
  • Improved communication : Critical analysis helps individuals communicate their ideas and opinions more effectively by providing logical and coherent arguments.
  • Reduced bias: Critical analysis requires individuals to evaluate information objectively, which can help reduce personal biases and subjective opinions.
  • Better understanding of complex issues : Critical analysis helps individuals to understand complex issues by breaking them down into smaller parts, examining each part and understanding how they fit together.
  • Greater self-awareness: Critical analysis helps individuals to recognize their own biases, assumptions, and limitations, which can lead to personal growth and development.

About the author

' src=

Muhammad Hassan

Researcher, Academic Writer, Web developer

You may also like

Cluster Analysis

Cluster Analysis – Types, Methods and Examples

Data collection

Data Collection – Methods Types and Examples

Delimitations

Delimitations in Research – Types, Examples and...

Discriminant Analysis

Discriminant Analysis – Methods, Types and...

Research Process

Research Process – Steps, Examples and Tips

Research Design

Research Design – Types, Methods and Examples

Banner

Writing a Critical Analysis

What is in this guide, definitions, putting it together, tips and examples of critques.

  • Background Information
  • Cite Sources

Library Links

  • Ask a Librarian
  • Library Tutorials
  • The Research Process
  • Library Hours
  • Online Databases (A-Z)
  • Interlibrary Loan (ILL)
  • Reserve a Study Room
  • Report a Problem

This guide is meant to help you understand the basics of writing a critical analysis. A critical analysis is an argument about a particular piece of media. There are typically two parts: (1) identify and explain the argument the author is making, and (2), provide your own argument about that argument. Your instructor may have very specific requirements on how you are to write your critical analysis, so make sure you read your assignment carefully.

research methods of critical analysis

Critical Analysis

A deep approach to your understanding of a piece of media by relating new knowledge to what you already know.

Part 1: Introduction

  • Identify the work being criticized.
  • Present thesis - argument about the work.
  • Preview your argument - what are the steps you will take to prove your argument.

Part 2: Summarize

  • Provide a short summary of the work.
  • Present only what is needed to know to understand your argument.

Part 3: Your Argument

  • This is the bulk of your paper.
  • Provide "sub-arguments" to prove your main argument.
  • Use scholarly articles to back up your argument(s).

Part 4: Conclusion

  • Reflect on  how  you have proven your argument.
  • Point out the  importance  of your argument.
  • Comment on the potential for further research or analysis.
  • Cornell University Library Tips for writing a critical appraisal and analysis of a scholarly article.
  • Queen's University Library How to Critique an Article (Psychology)
  • University of Illinois, Springfield An example of a summary and an evaluation of a research article. This extended example shows the different ways a student can critique and write about an article
  • Next: Background Information >>
  • Last Updated: Feb 14, 2024 4:33 PM
  • URL: https://libguides.pittcc.edu/critical_analysis
  • Search Menu
  • Browse content in Arts and Humanities
  • Browse content in Archaeology
  • Anglo-Saxon and Medieval Archaeology
  • Archaeological Methodology and Techniques
  • Archaeology by Region
  • Archaeology of Religion
  • Archaeology of Trade and Exchange
  • Biblical Archaeology
  • Contemporary and Public Archaeology
  • Environmental Archaeology
  • Historical Archaeology
  • History and Theory of Archaeology
  • Industrial Archaeology
  • Landscape Archaeology
  • Mortuary Archaeology
  • Prehistoric Archaeology
  • Underwater Archaeology
  • Urban Archaeology
  • Zooarchaeology
  • Browse content in Architecture
  • Architectural Structure and Design
  • History of Architecture
  • Residential and Domestic Buildings
  • Theory of Architecture
  • Browse content in Art
  • Art Subjects and Themes
  • History of Art
  • Industrial and Commercial Art
  • Theory of Art
  • Biographical Studies
  • Byzantine Studies
  • Browse content in Classical Studies
  • Classical Literature
  • Classical Reception
  • Classical History
  • Classical Philosophy
  • Classical Mythology
  • Classical Art and Architecture
  • Classical Oratory and Rhetoric
  • Greek and Roman Archaeology
  • Greek and Roman Epigraphy
  • Greek and Roman Law
  • Greek and Roman Papyrology
  • Late Antiquity
  • Religion in the Ancient World
  • Digital Humanities
  • Browse content in History
  • Colonialism and Imperialism
  • Diplomatic History
  • Environmental History
  • Genealogy, Heraldry, Names, and Honours
  • Genocide and Ethnic Cleansing
  • Historical Geography
  • History by Period
  • History of Agriculture
  • History of Education
  • History of Emotions
  • History of Gender and Sexuality
  • Industrial History
  • Intellectual History
  • International History
  • Labour History
  • Legal and Constitutional History
  • Local and Family History
  • Maritime History
  • Military History
  • National Liberation and Post-Colonialism
  • Oral History
  • Political History
  • Public History
  • Regional and National History
  • Revolutions and Rebellions
  • Slavery and Abolition of Slavery
  • Social and Cultural History
  • Theory, Methods, and Historiography
  • Urban History
  • World History
  • Browse content in Language Teaching and Learning
  • Language Learning (Specific Skills)
  • Language Teaching Theory and Methods
  • Browse content in Linguistics
  • Applied Linguistics
  • Cognitive Linguistics
  • Computational Linguistics
  • Forensic Linguistics
  • Grammar, Syntax and Morphology
  • Historical and Diachronic Linguistics
  • History of English
  • Language Variation
  • Language Families
  • Language Acquisition
  • Language Evolution
  • Language Reference
  • Lexicography
  • Linguistic Theories
  • Linguistic Typology
  • Linguistic Anthropology
  • Phonetics and Phonology
  • Psycholinguistics
  • Sociolinguistics
  • Translation and Interpretation
  • Writing Systems
  • Browse content in Literature
  • Bibliography
  • Children's Literature Studies
  • Literary Studies (Modernism)
  • Literary Studies (Asian)
  • Literary Studies (European)
  • Literary Studies (Eco-criticism)
  • Literary Studies (Romanticism)
  • Literary Studies (American)
  • Literary Studies - World
  • Literary Studies (1500 to 1800)
  • Literary Studies (19th Century)
  • Literary Studies (20th Century onwards)
  • Literary Studies (African American Literature)
  • Literary Studies (British and Irish)
  • Literary Studies (Early and Medieval)
  • Literary Studies (Fiction, Novelists, and Prose Writers)
  • Literary Studies (Gender Studies)
  • Literary Studies (Graphic Novels)
  • Literary Studies (History of the Book)
  • Literary Studies (Plays and Playwrights)
  • Literary Studies (Poetry and Poets)
  • Literary Studies (Postcolonial Literature)
  • Literary Studies (Queer Studies)
  • Literary Studies (Science Fiction)
  • Literary Studies (Travel Literature)
  • Literary Studies (War Literature)
  • Literary Studies (Women's Writing)
  • Literary Theory and Cultural Studies
  • Mythology and Folklore
  • Shakespeare Studies and Criticism
  • Browse content in Media Studies
  • Browse content in Music
  • Applied Music
  • Dance and Music
  • Ethics in Music
  • Ethnomusicology
  • Gender and Sexuality in Music
  • Medicine and Music
  • Music Cultures
  • Music and Culture
  • Music and Religion
  • Music and Media
  • Music Education and Pedagogy
  • Music Theory and Analysis
  • Musical Scores, Lyrics, and Libretti
  • Musical Structures, Styles, and Techniques
  • Musicology and Music History
  • Performance Practice and Studies
  • Race and Ethnicity in Music
  • Sound Studies
  • Browse content in Performing Arts
  • Browse content in Philosophy
  • Aesthetics and Philosophy of Art
  • Epistemology
  • Feminist Philosophy
  • History of Western Philosophy
  • Metaphysics
  • Moral Philosophy
  • Non-Western Philosophy
  • Philosophy of Action
  • Philosophy of Law
  • Philosophy of Religion
  • Philosophy of Science
  • Philosophy of Language
  • Philosophy of Mind
  • Philosophy of Perception
  • Philosophy of Mathematics and Logic
  • Practical Ethics
  • Social and Political Philosophy
  • Browse content in Religion
  • Biblical Studies
  • Christianity
  • East Asian Religions
  • History of Religion
  • Judaism and Jewish Studies
  • Qumran Studies
  • Religion and Education
  • Religion and Health
  • Religion and Politics
  • Religion and Science
  • Religion and Law
  • Religion and Art, Literature, and Music
  • Religious Studies
  • Browse content in Society and Culture
  • Cookery, Food, and Drink
  • Cultural Studies
  • Customs and Traditions
  • Ethical Issues and Debates
  • Hobbies, Games, Arts and Crafts
  • Lifestyle, Home, and Garden
  • Natural world, Country Life, and Pets
  • Popular Beliefs and Controversial Knowledge
  • Sports and Outdoor Recreation
  • Technology and Society
  • Travel and Holiday
  • Visual Culture
  • Browse content in Law
  • Arbitration
  • Browse content in Company and Commercial Law
  • Commercial Law
  • Company Law
  • Browse content in Comparative Law
  • Systems of Law
  • Competition Law
  • Browse content in Constitutional and Administrative Law
  • Government Powers
  • Judicial Review
  • Local Government Law
  • Military and Defence Law
  • Parliamentary and Legislative Practice
  • Construction Law
  • Contract Law
  • Browse content in Criminal Law
  • Criminal Procedure
  • Criminal Evidence Law
  • Sentencing and Punishment
  • Employment and Labour Law
  • Environment and Energy Law
  • Browse content in Financial Law
  • Banking Law
  • Insolvency Law
  • History of Law
  • Human Rights and Immigration
  • Intellectual Property Law
  • Browse content in International Law
  • Private International Law and Conflict of Laws
  • Public International Law
  • IT and Communications Law
  • Jurisprudence and Philosophy of Law
  • Law and Society
  • Law and Politics
  • Browse content in Legal System and Practice
  • Courts and Procedure
  • Legal Skills and Practice
  • Primary Sources of Law
  • Regulation of Legal Profession
  • Medical and Healthcare Law
  • Browse content in Policing
  • Criminal Investigation and Detection
  • Police and Security Services
  • Police Procedure and Law
  • Police Regional Planning
  • Browse content in Property Law
  • Personal Property Law
  • Study and Revision
  • Terrorism and National Security Law
  • Browse content in Trusts Law
  • Wills and Probate or Succession
  • Browse content in Medicine and Health
  • Browse content in Allied Health Professions
  • Arts Therapies
  • Clinical Science
  • Dietetics and Nutrition
  • Occupational Therapy
  • Operating Department Practice
  • Physiotherapy
  • Radiography
  • Speech and Language Therapy
  • Browse content in Anaesthetics
  • General Anaesthesia
  • Neuroanaesthesia
  • Browse content in Clinical Medicine
  • Acute Medicine
  • Cardiovascular Medicine
  • Clinical Genetics
  • Clinical Pharmacology and Therapeutics
  • Dermatology
  • Endocrinology and Diabetes
  • Gastroenterology
  • Genito-urinary Medicine
  • Geriatric Medicine
  • Infectious Diseases
  • Medical Oncology
  • Medical Toxicology
  • Pain Medicine
  • Palliative Medicine
  • Rehabilitation Medicine
  • Respiratory Medicine and Pulmonology
  • Rheumatology
  • Sleep Medicine
  • Sports and Exercise Medicine
  • Clinical Neuroscience
  • Community Medical Services
  • Critical Care
  • Emergency Medicine
  • Forensic Medicine
  • Haematology
  • History of Medicine
  • Medical Ethics
  • Browse content in Medical Dentistry
  • Oral and Maxillofacial Surgery
  • Paediatric Dentistry
  • Restorative Dentistry and Orthodontics
  • Surgical Dentistry
  • Browse content in Medical Skills
  • Clinical Skills
  • Communication Skills
  • Nursing Skills
  • Surgical Skills
  • Medical Statistics and Methodology
  • Browse content in Neurology
  • Clinical Neurophysiology
  • Neuropathology
  • Nursing Studies
  • Browse content in Obstetrics and Gynaecology
  • Gynaecology
  • Occupational Medicine
  • Ophthalmology
  • Otolaryngology (ENT)
  • Browse content in Paediatrics
  • Neonatology
  • Browse content in Pathology
  • Chemical Pathology
  • Clinical Cytogenetics and Molecular Genetics
  • Histopathology
  • Medical Microbiology and Virology
  • Patient Education and Information
  • Browse content in Pharmacology
  • Psychopharmacology
  • Browse content in Popular Health
  • Caring for Others
  • Complementary and Alternative Medicine
  • Self-help and Personal Development
  • Browse content in Preclinical Medicine
  • Cell Biology
  • Molecular Biology and Genetics
  • Reproduction, Growth and Development
  • Primary Care
  • Professional Development in Medicine
  • Browse content in Psychiatry
  • Addiction Medicine
  • Child and Adolescent Psychiatry
  • Forensic Psychiatry
  • Learning Disabilities
  • Old Age Psychiatry
  • Psychotherapy
  • Browse content in Public Health and Epidemiology
  • Epidemiology
  • Public Health
  • Browse content in Radiology
  • Clinical Radiology
  • Interventional Radiology
  • Nuclear Medicine
  • Radiation Oncology
  • Reproductive Medicine
  • Browse content in Surgery
  • Cardiothoracic Surgery
  • Gastro-intestinal and Colorectal Surgery
  • General Surgery
  • Neurosurgery
  • Paediatric Surgery
  • Peri-operative Care
  • Plastic and Reconstructive Surgery
  • Surgical Oncology
  • Transplant Surgery
  • Trauma and Orthopaedic Surgery
  • Vascular Surgery
  • Browse content in Science and Mathematics
  • Browse content in Biological Sciences
  • Aquatic Biology
  • Biochemistry
  • Bioinformatics and Computational Biology
  • Developmental Biology
  • Ecology and Conservation
  • Evolutionary Biology
  • Genetics and Genomics
  • Microbiology
  • Molecular and Cell Biology
  • Natural History
  • Plant Sciences and Forestry
  • Research Methods in Life Sciences
  • Structural Biology
  • Systems Biology
  • Zoology and Animal Sciences
  • Browse content in Chemistry
  • Analytical Chemistry
  • Computational Chemistry
  • Crystallography
  • Environmental Chemistry
  • Industrial Chemistry
  • Inorganic Chemistry
  • Materials Chemistry
  • Medicinal Chemistry
  • Mineralogy and Gems
  • Organic Chemistry
  • Physical Chemistry
  • Polymer Chemistry
  • Study and Communication Skills in Chemistry
  • Theoretical Chemistry
  • Browse content in Computer Science
  • Artificial Intelligence
  • Computer Architecture and Logic Design
  • Game Studies
  • Human-Computer Interaction
  • Mathematical Theory of Computation
  • Programming Languages
  • Software Engineering
  • Systems Analysis and Design
  • Virtual Reality
  • Browse content in Computing
  • Business Applications
  • Computer Games
  • Computer Security
  • Computer Networking and Communications
  • Digital Lifestyle
  • Graphical and Digital Media Applications
  • Operating Systems
  • Browse content in Earth Sciences and Geography
  • Atmospheric Sciences
  • Environmental Geography
  • Geology and the Lithosphere
  • Maps and Map-making
  • Meteorology and Climatology
  • Oceanography and Hydrology
  • Palaeontology
  • Physical Geography and Topography
  • Regional Geography
  • Soil Science
  • Urban Geography
  • Browse content in Engineering and Technology
  • Agriculture and Farming
  • Biological Engineering
  • Civil Engineering, Surveying, and Building
  • Electronics and Communications Engineering
  • Energy Technology
  • Engineering (General)
  • Environmental Science, Engineering, and Technology
  • History of Engineering and Technology
  • Mechanical Engineering and Materials
  • Technology of Industrial Chemistry
  • Transport Technology and Trades
  • Browse content in Environmental Science
  • Applied Ecology (Environmental Science)
  • Conservation of the Environment (Environmental Science)
  • Environmental Sustainability
  • Environmentalist Thought and Ideology (Environmental Science)
  • Management of Land and Natural Resources (Environmental Science)
  • Natural Disasters (Environmental Science)
  • Nuclear Issues (Environmental Science)
  • Pollution and Threats to the Environment (Environmental Science)
  • Social Impact of Environmental Issues (Environmental Science)
  • History of Science and Technology
  • Browse content in Materials Science
  • Ceramics and Glasses
  • Composite Materials
  • Metals, Alloying, and Corrosion
  • Nanotechnology
  • Browse content in Mathematics
  • Applied Mathematics
  • Biomathematics and Statistics
  • History of Mathematics
  • Mathematical Education
  • Mathematical Finance
  • Mathematical Analysis
  • Numerical and Computational Mathematics
  • Probability and Statistics
  • Pure Mathematics
  • Browse content in Neuroscience
  • Cognition and Behavioural Neuroscience
  • Development of the Nervous System
  • Disorders of the Nervous System
  • History of Neuroscience
  • Invertebrate Neurobiology
  • Molecular and Cellular Systems
  • Neuroendocrinology and Autonomic Nervous System
  • Neuroscientific Techniques
  • Sensory and Motor Systems
  • Browse content in Physics
  • Astronomy and Astrophysics
  • Atomic, Molecular, and Optical Physics
  • Biological and Medical Physics
  • Classical Mechanics
  • Computational Physics
  • Condensed Matter Physics
  • Electromagnetism, Optics, and Acoustics
  • History of Physics
  • Mathematical and Statistical Physics
  • Measurement Science
  • Nuclear Physics
  • Particles and Fields
  • Plasma Physics
  • Quantum Physics
  • Relativity and Gravitation
  • Semiconductor and Mesoscopic Physics
  • Browse content in Psychology
  • Affective Sciences
  • Clinical Psychology
  • Cognitive Neuroscience
  • Cognitive Psychology
  • Criminal and Forensic Psychology
  • Developmental Psychology
  • Educational Psychology
  • Evolutionary Psychology
  • Health Psychology
  • History and Systems in Psychology
  • Music Psychology
  • Neuropsychology
  • Organizational Psychology
  • Psychological Assessment and Testing
  • Psychology of Human-Technology Interaction
  • Psychology Professional Development and Training
  • Research Methods in Psychology
  • Social Psychology
  • Browse content in Social Sciences
  • Browse content in Anthropology
  • Anthropology of Religion
  • Human Evolution
  • Medical Anthropology
  • Physical Anthropology
  • Regional Anthropology
  • Social and Cultural Anthropology
  • Theory and Practice of Anthropology
  • Browse content in Business and Management
  • Business History
  • Business Strategy
  • Business Ethics
  • Business and Government
  • Business and Technology
  • Business and the Environment
  • Comparative Management
  • Corporate Governance
  • Corporate Social Responsibility
  • Entrepreneurship
  • Health Management
  • Human Resource Management
  • Industrial and Employment Relations
  • Industry Studies
  • Information and Communication Technologies
  • International Business
  • Knowledge Management
  • Management and Management Techniques
  • Operations Management
  • Organizational Theory and Behaviour
  • Pensions and Pension Management
  • Public and Nonprofit Management
  • Strategic Management
  • Supply Chain Management
  • Browse content in Criminology and Criminal Justice
  • Criminal Justice
  • Criminology
  • Forms of Crime
  • International and Comparative Criminology
  • Youth Violence and Juvenile Justice
  • Development Studies
  • Browse content in Economics
  • Agricultural, Environmental, and Natural Resource Economics
  • Asian Economics
  • Behavioural Finance
  • Behavioural Economics and Neuroeconomics
  • Econometrics and Mathematical Economics
  • Economic Methodology
  • Economic Systems
  • Economic History
  • Economic Development and Growth
  • Financial Markets
  • Financial Institutions and Services
  • General Economics and Teaching
  • Health, Education, and Welfare
  • History of Economic Thought
  • International Economics
  • Labour and Demographic Economics
  • Law and Economics
  • Macroeconomics and Monetary Economics
  • Microeconomics
  • Public Economics
  • Urban, Rural, and Regional Economics
  • Welfare Economics
  • Browse content in Education
  • Adult Education and Continuous Learning
  • Care and Counselling of Students
  • Early Childhood and Elementary Education
  • Educational Equipment and Technology
  • Educational Strategies and Policy
  • Higher and Further Education
  • Organization and Management of Education
  • Philosophy and Theory of Education
  • Schools Studies
  • Secondary Education
  • Teaching of a Specific Subject
  • Teaching of Specific Groups and Special Educational Needs
  • Teaching Skills and Techniques
  • Browse content in Environment
  • Applied Ecology (Social Science)
  • Climate Change
  • Conservation of the Environment (Social Science)
  • Environmentalist Thought and Ideology (Social Science)
  • Natural Disasters (Environment)
  • Social Impact of Environmental Issues (Social Science)
  • Browse content in Human Geography
  • Cultural Geography
  • Economic Geography
  • Political Geography
  • Browse content in Interdisciplinary Studies
  • Communication Studies
  • Museums, Libraries, and Information Sciences
  • Browse content in Politics
  • African Politics
  • Asian Politics
  • Chinese Politics
  • Comparative Politics
  • Conflict Politics
  • Elections and Electoral Studies
  • Environmental Politics
  • European Union
  • Foreign Policy
  • Gender and Politics
  • Human Rights and Politics
  • Indian Politics
  • International Relations
  • International Organization (Politics)
  • International Political Economy
  • Irish Politics
  • Latin American Politics
  • Middle Eastern Politics
  • Political Theory
  • Political Methodology
  • Political Communication
  • Political Philosophy
  • Political Sociology
  • Political Behaviour
  • Political Economy
  • Political Institutions
  • Politics and Law
  • Public Administration
  • Public Policy
  • Quantitative Political Methodology
  • Regional Political Studies
  • Russian Politics
  • Security Studies
  • State and Local Government
  • UK Politics
  • US Politics
  • Browse content in Regional and Area Studies
  • African Studies
  • Asian Studies
  • East Asian Studies
  • Japanese Studies
  • Latin American Studies
  • Middle Eastern Studies
  • Native American Studies
  • Scottish Studies
  • Browse content in Research and Information
  • Research Methods
  • Browse content in Social Work
  • Addictions and Substance Misuse
  • Adoption and Fostering
  • Care of the Elderly
  • Child and Adolescent Social Work
  • Couple and Family Social Work
  • Developmental and Physical Disabilities Social Work
  • Direct Practice and Clinical Social Work
  • Emergency Services
  • Human Behaviour and the Social Environment
  • International and Global Issues in Social Work
  • Mental and Behavioural Health
  • Social Justice and Human Rights
  • Social Policy and Advocacy
  • Social Work and Crime and Justice
  • Social Work Macro Practice
  • Social Work Practice Settings
  • Social Work Research and Evidence-based Practice
  • Welfare and Benefit Systems
  • Browse content in Sociology
  • Childhood Studies
  • Community Development
  • Comparative and Historical Sociology
  • Economic Sociology
  • Gender and Sexuality
  • Gerontology and Ageing
  • Health, Illness, and Medicine
  • Marriage and the Family
  • Migration Studies
  • Occupations, Professions, and Work
  • Organizations
  • Population and Demography
  • Race and Ethnicity
  • Social Theory
  • Social Movements and Social Change
  • Social Research and Statistics
  • Social Stratification, Inequality, and Mobility
  • Sociology of Religion
  • Sociology of Education
  • Sport and Leisure
  • Urban and Rural Studies
  • Browse content in Warfare and Defence
  • Defence Strategy, Planning, and Research
  • Land Forces and Warfare
  • Military Administration
  • Military Life and Institutions
  • Naval Forces and Warfare
  • Other Warfare and Defence Issues
  • Peace Studies and Conflict Resolution
  • Weapons and Equipment

The Oxford Handbook of Qualitative Research

A newer edition of this book is available.

  • < Previous chapter
  • Next chapter >

9 Critical Approaches to Qualitative Research

Kum-Kum Bhavnani, Department of Sociology, University of California at Santa Barbara

Peter Chua, Department of Sociology, San José State University

Dana Collins, Department of Sociology, California State University, Fullerton

  • Published: 04 August 2014
  • Cite Icon Cite
  • Permissions Icon Permissions

This chapter reflects on critical strategies in qualitative research. It examines the meanings and debates associated with the term “critical,” in particular, contrasting liberal and dialectical notions and practices in relation to social analysis and qualitative research. The chapter also explores how critical social research may be synonymous with critical ethnography in relation to issues of power, positionality, representation, and the production of situated knowledges. It uses Bhavnani’s framework to draw on Dana Collins’ research as a specific case to suggest how the notion of the “critical” relates to ethnographic research practices: ensuring feminist and queer accountability, resisting reinscription, and integrating lived experience.

Qualitative research is now ubiquitous and fairly well-respected throughout the human sciences. That Oxford University Press is producing this much-needed volume is further testament to that notion, and one which we applaud. However, although there are different approaches to conducting qualitative research, what is often not addressed are the philosophical notions underlying such research. And that is where the “critical” enters. Indeed, “critical,” used as an adjective and applied, within the academy, to methods of research is also a familiar phrase. The question is, therefore: what does “critical” mean, and how might it be translated such that present and future researchers could draw on some of its fundamentals as they plan their research studies in relation to progressive political activism?

The popularity of critical research is not predictable. Although the 1960s and early 1970s did offer a number of publications that engaged with critical research traditions (e.g., Gouldner, 1970 ), and the 1990s also led to a resurgence of interest in this area (e.g., Harvey, 1990 ; Thomas, 1993 ), it is now two decades since explicit discussions of critical research have been widely discussed within the social sciences (see Smith, 1999 ; Madison, 2012 , as exceptions).

In this chapter, we first outline meanings associated with “critical.” We then suggest that the narratives of critical ethnography are best suited for an overview chapter such as this. We consider critical ethnography to be virtually synonymous with critical social research as we discuss it in this chapter. In the final section of our chapter, we discuss Dana Collins’ specific research studies to suggest how her approach embraces the notion of “critical” ( Collins, 2005 ; 2007 ; 2009 ).

The “Critical” in Critical Approaches

“Critical” is used in many ways. In everyday use, the term can refer, among other definitions, to an assessment that points out flaws and mistakes (“a critical approach to the design”), or to being close to a crisis (“a critical illness”). On the positive side, it can refer to a close reading (“a critical assessment of Rosa Luxembourg’s writings”) or as being essential (“critical for effective educational strategies”). A final definition is that the word can be used to either denote considerable praise (“the playwright’s work was critically acclaimed”) or to indicate a particular turning point (“this is a critical time to vote”). It is this last definition that is closest to our approach as we reflect on “critical” in the context of qualitative research. That is, drawing from the writings of Marx, the Frankfurt School, and others (see Delanty, 2005 ; Marx, 1845/1976 ; Strydom, 2011 ), we suggest that critical approaches to qualitative methods do not signify only a particular way of thinking about the methods we use in our research studies, but that “critical approaches” also signify a turning point in how we think about the conduct of research across the human sciences, including its dialectical relations to the progressive and systematic transformation of social relations and social institutions.

The most straightforward notion of “critical” in this context is that it refers to (at the least) or insists (at its strongest) that research—and all ways by which knowledge is created—is firmly grounded within an understanding of social structures (social inequalities), power relationships (power inequalities), and the agency of human beings (an engagement with the fact that human beings actively think about their worlds). Critical approaches are most frequently associated with Marxist, feminist, and antiracist, indigenous, and Third World perspectives. At its most succinct, therefore, we argue that “critical” in this context refers to issues of epistemology, power, micropolitics, and resistance.

What does this mean, both theoretically and for how we conduct our research? Most would agree that whereas qualitative research does not, by definition, insist on a nonpositivist way of examining the social world, for critical approaches to be truly critical, an antipositivist approach is the sine qua non of critical research. Furthermore, it is evident as we survey critical empirical research that issues of reflexive and subjective techniques in data collection and the researcher’s relationship with research subjects also frame both the practices and the theories associated with research.

The following section begins by drawing attention to developments and debates involving the more restricted use the term critical as related to Marxism and then explores the ramifications for varying attempts to conduct critical qualitative research.

The Critical Debates

Karl Marx, Friedrich Engels, and their contemporaries (see Engels, 1877/1969 ; Harvey, 1996 ; Lenin, 1915/1977 ; Mao, 1990 ; Ollman, 2003 ) developed dialectical materialist notions of critique and “critical” that were substantively different from prior notions. They incorporated these dialectical materialist notions to develop Marxist theories and politics.

Dialectical materialism refers to an outlook on reality that emphasizes the importance of process and change that are inherent to things (such as objects, phenomena, and situations), as well as of the importance of human practices in making change. Significantly, human struggle over existing conditions and contradictions in things creates not only new conditions, but also new contradictions. This outlook serves as an analytical tool over idealist and old-fashioned materialist worldviews and as a source of strength for exploited peoples in their struggle against ruling elites and classes. It emphasizes that correct ideas, knowledge, and theoretical abstractions are established initially, and perhaps inevitably, through practice.

Dialectical materialism may be used to examine two aspects of the research process and the production of academic knowledge. The first aspect involves the writing process as it is carried out among multiple authors. At the drafting phase, the authors craft their distinct ideas into textual form. Contradictions in ideas are bound to exist in the draft. In doing revisions, some contradictions may become intensified and remain unresolved, yet, most frequently (and hopefully!), many are addressed in the form of clearer, more solid, and coherent arguments, thus resolving the earlier contradictions in the text. Yet, new struggles and contradictions emerge. The synthesis of ideas and argument in the final manuscript may again, however, engage in new struggles with the prevailing arguments being discussed.

The second aspect involves the relationship and interaction between the researcher and the interviewee. As their relationship begins, contradictions and differences usually exist between them, for instance, in terms of their prior experiences and knowledge, their material interests in the research project, and their communication skills in being persuasive and forging consent. The struggle of these initial contradictions could result in new conditions and contradictions. For example, this could lead to

the establishment of quality rapport between them, allowing the interview to be completed while the researcher maintains control over the situation;

the abrupt end of the interview due to the interviewee refusing and asserting her or his right to comply with the interview process; or

an explicit set of negotiations that address the unevenness in power relations between them, along with an invitation for both to be part of the research team and to collaborate in the collection and analysis of data and in the forging of new theories and knowledges.

In the first possibility, the prevailing power relations in interviews remain but shift to beneath the surface of the relationship, under the guise of “rapport.” In the second possibility, power relations in the interview process and initial contradictions are heightened, resulting in new conditions and contradictions that the researcher and research participant have to address, jointly and singly. In the third possibility, the research subject is transformed into a researcher as well, and the relationship between the two is transformed into a more active co-learning and co-teaching relationship. Still, new conflicts and contradictions may emerge as the research process continues to unfold. 1 In short, dialectical materialism stresses the analysis of change in the essence (1), practice (2), and struggle (3). Such analyses are at the root of how change may be imagined within the practices of social research.

Dialectical materialism, which forms the basis of the concept of “critical,” emphasizes the need to engage with power, inequality, and social relations in the arenas of the social, political, economic, cultural, and ideological. Based on this status, it is argued that an analysis of societies and ways of life demands a more comprehensive approach, one that does not view society and social institutions merely as a singular unit of analysis but rather as ones that are replete with history. Dialectical materialism directs its criticism against prevailing views or hegemonies, and, within the context of academic endeavors, engages in debates against positivism and neo-Kantian forms of social inquiry. It is this basis of “critical” that defines it in the context of research as a deep questioning of science, objectivity, and rationality. Thus, the meaning of the term “critical,” based on the idea of “critique,” emerges from the practice and application of dialectical materialism.

Historical materialism emerges from and is based on dialectical materialism. That is, any application of the dialectic to material realities is historical materialism. For example, any study of human society, its history, its development, and its process of change demands a dialectical approach rooted in historical materialism. This involves delving deeper into past and present social phenomena to thereby determine how people change the essence of social phenomena, and, simultaneously, transform their contradictions.

Dialectical materialism regards positivism as a crude and naïve endeavor to seek knowledge and explain phenomena and as one that assumes it is the task of social researchers to determine the laws of social relationships by relying solely on observations (i.e., by assuming there is a primacy of external conditions and actions). In addition, positivism separates the subject (the seemingly unbiased, detached observer) and object (the phenomenon/a under consideration) of study. Dialectical materialism overcomes the shortcomings of positivism by offering a holistic understanding of (a) the essence of phenomena; (b) the processes of internal changes, the handling of contradictions, and the development of knowledge; (c) the unity of the subject and object in the making of correct ideas; and (d) the role of practice and politics in knowledge creation.

Dialectical materialism directs its criticism against dominant standpoints. These standpoints can offer a simplistic form of idealism and philosophical materialism. Within the context of academic endeavors, the methods of dialectical materialism engage in debates against positivism and neo-Kantian forms of social inquiry. This approach challenges assertions that science, objectivity, and rationality are the sine qua non of research and that skepticism and liberalism are the only appropriate analytical positionings by which a research project can be defined as “critical.”

For instance, Auguste Comte and Emile Durkheim, in developing sociological positivism, argued for a new science to study society, one that adopted the methods of the natural sciences, such as skeptical empiricism and the practices of induction. In adopting these methods, approaches relying on early positivism sought to craft knowledge based on seemingly affirmative verification rather than being based on judgmental evaluation and transformative distinctions.

Positivism and dialectical materialism were both developed in response to Kantian and idealist philosophy. In the context of the European Enlightenment, in the late 1700s, Immanuel Kant inaugurated the philosophy of critique. Positivism challenged Kant’s philosophy of critique as the basis for the theory of knowledge.

Kant developed his notion of critique to highlight the workings of human reason and judgment, to illuminate its limitations, and to consolidate its application in order to secure a stable foundation for morality, religion, and metaphysical concerns. Politically, Kantian philosophy provided justification for both a traditionalism derived from earlier periods and a liberalism developed during the ascendance of the Enlightenment.

Kant sought to settle philosophical disputes between a narrow notion of empiricism (that relies on pure observation, perception, and experience as the basis for knowledge) and a narrow notion of rationalism (that relies on pure reason and concepts as the basis for knowledge). He argued that the essence (termed “thing-in-itself”) is unknowable, countering David Hume’s skeptical empiricism, and he was convinced that there is no knowledge outside of innate conceptual categories. For Kant, “concepts without perceptions are empty; perceptions without concepts are blind” (1781/1965, pp. A 51/B 75).

The method of dialectical materialism challenges Kant’s idealism for (what is claimed to be) its faulty assertion that correct ideas and knowing about the “thing-in-itself” can only emerge from innate conceptual categories, ones that are universal and transcendental. In Kantian philosophy, there is no reality (out there) to be known. Rather, it is the experience of reality itself that provides for human reason and consciousness.

Dialectical materialism overcomes Kant’s idealism with its recognition of the existence of concrete phenomena, outside and independent of human reason. Dialectical materialism stresses that social reality and concrete phenomena reflect on and determine the content of human consciousness (and also, we would argue, vice versa). Dialectical materialism also emphasizes the role of practice and politics in knowledge development, instead of merely centering the primacy of ideas and the meanings of objects.

In sum, the core debate against positivism centers on the practices of science. Dialectical materialism regards positivist approaches as crude and naïve endeavors that seek to determine unchangeable laws of nature, rely solely on observations and “sense experience” of phenomena as the basis for knowledge, highlight the primacy of external conditions and actions to explain phenomena, and separate the subject from the object of study. That is, dialectical materialism views positivism as a form of mechanical, as distinct from historical, materialism.

This abridged account of dialectical materialism and the critiques it offers of Kantian idealism and sociological positivism can allow for the formation of a preliminary set of criteria for what may constitute the “critical.” We argue that qualitative research may be critical if it makes clear conceptually and analytically:

The essence and root cause of any social phenomena (e.g., youth and politics);

The relationship between the essence of the social phenomena under consideration to the general social totality (such as how youth and their views of politics are related to wider systems within society, such as education, age, exploitation);

The contradictions within this social phenomenon (such as how young people are expressing their discontent),

and, therefore,

How to conduct more reflexive practices that interrelate data generation, data analysis, and political engagement that challenge existing relations of power.

Contemporary debates between neo-Kantian idealists and dialectical materialists have often been friendly regarding the direction for carving out what is meant by a critical project in qualitative social research. These debates bring to the fore issues of politics, ethics, research design, and the collection and analysis of data. They have also prompted a variety of ways in which “critical” may be used in relation to qualitative research. For the purposes of this chapter, we suggest four substantial ways in which “critical” is used in the context of qualitative research: (a) critical as a form of liberalism, (b) critical as a counterdisciplinary perspective, (c) critical as an expansion of politics, and (d) critical as a professionalized research endeavor and perspective.

Critical as a form of Kantian liberalism is one of the more conventional uses of the term in qualitative research. This use of critical is generally contrasted against the dogmatism of positivist approaches within social scientific research. Yet, to use critical in this way means that we embrace a liberalism that ends up promoting idealism in outlook and pluralism in practice. That is, Kantian liberalism presents itself as a “critical” and novel analysis by combining eclectic ideas and theories while not making known its political stand and its material interests. As a result, it supports prevailing modes of thinking that emphasize abstraction over concrete reality, and it succumbs to relativistist and pragmatist practices in research, such as “anything goes” in collecting data. In terms of methods, this use of “critical” promotes looseness and leniency in ethics and data collection and analysis, often without a structured accountability to the many constituencies that underlie all social research. Furthermore, the use of, for example, phrases such as “critical spaces,” when applied to social research, may be better understood as a celebration of method above theory and meta-theory and an engagement with some (of the often rather) excessive approaches to reflexivity and meta-reflexivity. In sum, this understanding of “critical” lacks appropriate structures of ethics and accountability and often tends to reject dialectic materialism.

The second use of “critical” in regards to qualitative research proposes a more analytical disagreement with conventional scholarly disciplines and, in so doing, seeks to take up counterdisciplinary positions ( Burawoy, 1998 ; 2003 ; Carroll, 2004 ; Smith, 2007 ). There are two main strands in this use of “critical.” One strand argues that “critical” is a means of exposing the weaknesses of conventional academic disciplines such as anthropology, political science, psychology, and sociology. At the same time, this strand maintains the viability of these core social science disciplines. For instance, academic feminists have continually highlighted the masculinist and heterosexist bias in what is considered top-tier scholarship and the need for these disciplines to be more inclusive in terms of perspectives and methodological techniques (e.g., Fonow & Cook, 1991 ; Harding, 1991 ; Ray, 2006 ). Yet such an approach may not inevitably focus on the fundamental problems, such as a neglect of the study of power inequalities (e.g., Boserup 1970 ; and see examples in Reinharz & Davidman, 1992 ). This second strand seeks to carve out interdisciplinary and multidisciplinary fields such as women studies, cultural studies, and area studies to overcome the paradigmatic and fundamental crises within core disciplines ( Bhavnani, Foran, & Kurian, 2003 ; March, 1995 ; Mohanty, 2003 ). Many of these interdisciplinary and multidisciplinary fields have often been more historical and qualitative in their approaches, seeking to go beyond positivist limitations and present a more nuanced and thorough analysis. However, even these multi-, inter-, and antidisciplinary fields have an uneven impact on dominant and conventional knowledge.

Moreover, both strands have not been able to overcome the increasing corporatization and neoliberalization of academic institutions. This issue addresses the increasing restructuring of public education into a private domain, one that relies on privatized practices and funding of both teaching and research. The neoliberalization of the academy is found in the ties of academic research to corporate grants, individualized career advancement, excessive publishing demands and citation indices, and the use of outsourcing for transcription, interviewing, online education, and private research spaces that are “rented” by public institutions, to name a few. These neoliberal conditions of research usually push out those critical researchers who attempt to avoid such exploitative avenues for research, writing, and collaboration. This use of “critical,” however, does expose that critical research is taking shape within contemporary processes of neoliberalism and the increasing privatization of the academy ( Giroux, 2009 ; Greenwood, 2012 ; Pavlidis, 2012 ).

The third and less familiar approach is to view “critical” as invigorating politics through the practices of feminist, antiracist, and participatory action research. This approach, for example, highlights the importance of analyzing power in research, as in terms of the conduct of inquiry, in political usefulness, and in affecting relations of power and material relations. Yet this view of “critical” is dogmatic because this approach demands that every research study meet all criteria of criticality comprehensively and perfectly.

A final use of “critical” emerges from the many scholarly and professionalized approaches that engage with the politics of academic knowledge construction while making visible the limits of positivism. “Critical” is used here as a means to focus primarily on revitalizing scholarship and research endeavors. However, we argue that even this use of “critical” ossifies the separation of the making of specialized knowledge from an active engagement to transform social life. Such a separation is antithetical to dialectical materialism. Often, this fourth form of the term “critical” is based on the logics of the Frankfurt School of critical theory (such as that of Adorno [1973] , Habermas [1985] , and Marcuse [1968] ) and other Western neo-Marxisms (from Lukacs [1971] and Gramsci [1971] to Negri [1999] ). Critical ethnographers and other critical social researchers, drawing from this tradition, often develop public intellectual persona by writing and talking about politics through scholarly and popular forms of publishing and speaking presentations and are even seen to take part in political mobilizations. Yet they can also shy away from infusing their research with a deep engagement in political processes outside the academy.

Later in this chapter, we discuss how to avoid some of the pitfalls of these four types of “critical,” but suffice it to say, in short, that it is the politics and the explicit situatedness of research projects that can permit research to remain “critical.”

Is Critical Ethnography the Same as Critical Research?

George Marcus (1998) argues that the ethnographer is a midwife who, through words, gives birth to what is happening in the lives of the oppressed. Beverley Skeggs (1994) has proposed that ethnography is, in itself, “a theory of the research process,” and Asad (1973) offered the now-classic critique of anthropology as the colonial encounter. However, although many approaches to and definitions of ethnography abound, it is the case that they all agree on one aspect: namely, that ethnographies offer an “insider’s” perspective on the social phenomena under consideration. It is often suggested that the best ethnographies, whether defined as critical or not, offer detailed descriptions of how people see, and inhabit, their social worlds and cultures (e.g., Behar, 1993 ; Ho, 2009 ; Kondo, 1990 ; Zinn, 1979 ).

It is evident from our argument so far that we do not think of ethnographic approaches to knowledge construction as being, in and of themselves, critical. This is because an ethnographic study, although not in opposition to critical ethnography or to critical research in general, has practices rooted in social anthropology. Therefore, its assumptions are often in line with anthropological assumptions (see Harvey [1990] for a recounting of some of these assumptions). Concepts such as “insider” versus “outsider,” “going native,” “gaining access,” and even conceptualizations of a homogenized and/or exoticized “field” that is out there ready to be examined by research remain as significant lenses of methodological conceptualization in much ethnographic research.

Despite, or perhaps because of, the move to reflexivity in ethnographic research, there remain enduring assumptions about best practices. As a result, a certain fetishization of research methods transpires, one that is often epitomized as reflexivity. In this instance, ethnographic and qualitative research become an ideal set of practices for extracting information. In sum, “best research practices,” as ways to extract information, reproduce core power dynamics of racism, gender, class, imperialism, and heteronormativity, which, in turn, reproduce the oppressive dynamics of noncritical qualitative research.

Furthermore, when presenting research merely as reflexive research, it is the case that the researcher can lose sight of the broader social structural and historical materialist context. In addition, a static notion of reflexivity can lead to the researcher not looking outward to assess the wider interconnections among the micropolitics of the research. That is, reflexivity is a dialectic among the researcher, the research process, and the analysis ( Jordan & Yeomans, 1995 ), but it is often presented simply as a series of apparently unchangeable/essential facets of the researcher. Our final point is that for theory to be critical in the development of research paradigms, it has to explicitly engage with lived experiences and cultures for, without that engagement, it remains as formalism (see, e.g., the work of Guenther [2009] and Kang [2010] as examples of critical qualitative research). We are very much in tune with Hesse-Biber and Leavy, who have suggested that (grounded) theory building is a “dynamic dance routine” in which “there is no one right dance, no set routine to follow. One must be open to discovery” (2006, p. 76).

An example of the limitation of conventionally reflexive research is in the area of lesbian and gay research methods that focus on the experiences of gay men and lesbians conducting qualitative research. It also offers a commentary on the role that non-normative sexuality plays in social research. By looking inward (see the earlier comment on “reflexivity”), these methodological frameworks focus on the researcher’s and participants’ lesbian/gay identifications. In so doing, this can fabricate a shared social structural positionality with research participants who have been labeled “gay” or “lesbian.” Such an approach to reflexivity overlooks the fabricated nature of positionalities and ignores the sometimes more significant divisions between researchers and participants that are expressed along the lines of race, class, gender, and nationality. Reflexivity is used only as a way to forge a connection for the exchange of information. A grave mistake is made in this rush to force similarity along the lines of how people practice non-normative sexualities ( Lewin & Leap, 1996 ; for a more successful engagement with queer intersectionality in research, see Browne & Nash, 2010 ).

The point to be made is that critical researchers should not merely ask “how does this knowledge engage with social structure?” Critical researchers, when contemplating the question “What is this?” as they set up and analyze their research, could also ask, “What could this be?” ( Carspecken, 1996 ; Degiuli, 2007 ; Denzin, 2001 ; Noblit, Flores, & Murillo, 2004 , all cited in Degiuli, 2007 ). Perhaps, borrowing from Karen O’Reilly’s thoughts on critical ethnography, one may think of critical research as “an approach that is overtly political and critical, exposing inequalities in an effort to effect change” ( Reilly, 2009 , p. 51). That is, in order for qualitative research to be critical, it must be grounded in the material relationships of history, as may be seen in the work of Carruyo (2011) , Chua (2001 ; 2006 ; 2007 ; 2012 ), Collins (2005 ; 2007 ; 2009 ), Lodhia (2010) , and Talcott (2010) .

Quantz (1992) , in his discussion of critical ethnography, suggests that five aspects are central to the discussion of critical research/ethnography: knowledge, values, society, history, and culture. So far in this chapter, we have discussed knowledge and its production, values/reflexivity and qualitative research/ethnography, society and unequal social relationships, and history as a method of historical and dialectical materialism in order to better understand social and institutional structures. What we have not discussed, however, is the notion of culture, nor, indeed, the predicament of culture ( Clifford, 1998 ): “Culture is an ongoing political struggle around the meaning given to actions of people located within unbounded asymmetrical power relations” ( Quantz, 1992 , p. 483).

Quantz elaborates by stating that culture develops as people struggle together to name their experiences (see Comaroff & Comaroff, 2012 , for a sophisticated and elegant discussion of this thinking). For example, one key task of critical research is to tease out how disempowerment is achieved, undermined, or resisted. That is, the job of the researcher is to see how the disempowerment—economic, political, cultural—of subordinated groups manifests itself within culture, and, indeed, whether the subordinated groups even recognize their disempowerment. For example, “the hand that rocks the cradle rules the world” is one example of how the material disempowerment of many groups of women is presented, in fact, as a strength of women, and yet it takes the gaze away from seeing the subordination of women by ostensibly emphasizing women’s hidden social power.

It is critical qualitative research that has to simultaneously analyze how our research can identify processes and expressions of disempowerment and can then lead to a restructuring of these relationships of disempowerment. At times, critical social researchers engage in long-term projects that involve policy advocacy and community solidarity to link community-driven research with social empowerment and community change (see Bonacich, 1998 ; Bonacich & Wilson, 2008 ; Hondagneu-Sotelo, 2007 ; Stoecker, 2012 ).

The key point is that critical qualitative research parts company with positivistic approaches because it is argued that positivism is only able to offer a superficial set of findings. Critical qualitative research hones research concepts, practices, and analyses into finer points of reference so that societal relationships may be not only understood, but also so that social power inequalities can be undermined. In short, critical social research has a Foucauldian notion of power at its very core and may thus be thought of as offering insights into people’s lived experiences ( Williams, 1976 ) as they negotiate asymmetrical societal power relations (see e.g., Novelli, 2006 ).

The Practices of Critical Qualitative Research

Within our current era of enduring global inequalities, what could constitute a truly critical approach to qualitative research? More than twenty years ago, in “Tracing the Contours” ( Bhavnani, 1993 ), it was argued that if all knowledge is historically contingent and, therefore, that the processes of knowledge production are situated, then this must apply to all research practices as well. 2 This argument was based on Haraway’s (1988) idea that the particularities of knowledge production do not lie in the characteristics of individuals. Rather, knowledge production is “about communities, not about isolated individuals” (p. 590). Building on this, Haraway discussed the significance of partiality and its relationship to objectivity. She suggested that it is the researcher’s knowledge of her own “limited location” that creates objectivity. In other words, knowing the limitations of one’s structural position as a researcher contributes to objective research because there is no objectivity that is omniscient, one from which all can be revealed (Haraway discusses this as the “god trick,” which is like “seeing everything from nowhere,” p. 582).

It is from Haraway’s insights that we develop our argument that situated knowledges are not synonymous with the static reflexivity we describe earlier. This is because, in this latter scenario, the researcher implies that all research knowledge is based on and derives from an individual’s personal historical and biographical perspectives. That is, researchers note their racial/ethnic identity, sex/gender, sexuality, age, class, and ability (i.e., biographical aspects of themselves), which are presented as essential and unchanging factors and that determine the knowledge created by the research. This has also been called “absolute relativism” ( Bhavnani, 1993 ) or “extreme relativism” ( Alcoff & Potter, 1993 ).

We suggest that the three elements central to research being “critical” are partiality, positionality, and accountability. Partiality leads to critical research interrogating prevailing representations as the research is conducted, and this builds on difference. Positionality is not about being reflexive, but about understanding the sociohistorical/political context from which research is created and thus engages with the micropolitics of a research endeavor. Accountability makes it evident that there are many constituencies to which all academic researchers are accountable—for example, their discipline, intellectual integrity, their institution and academic colleagues, the idea of rigorous scientific research, and academic freedom in research—as well as being accountable to the people with whom the research is being conducted. It is accountability that leads to a critical research project interrogating how the lived experiences and cultures of the research participants are inscribed within the research (see Stoecker, 2012 ).

What might the necessary elements be for ensuring that our research practices retain the criticality we have discussed earlier? We offer four possibilities that could form a filter through which one could decide if research is critical, using our definition of the term. First, all critical qualitative researchers should interrogate the history of ethnographic research that has led to the systematic domination of the poor; working classes; ethnic, racialized, sexual Others; women; and colonized peoples. That is, critical qualitative researchers must begin research with an understanding of how previous research, including their own, may continue to play a part in the subordination of peoples around the world, for example, by reinscribing them into predictable and stereotypical roles. Second, critical qualitative researchers should work to develop a consciousness of what might constitute critical research practices—without fetishizing methods—that challenge the system of domination often present in social research. Third, researchers who embrace critical qualitative approaches must develop comfort with the notion that they are conducting research with a purpose; that is, researchers grapple with and comprehend that critical research demands that they engage with the idea that they conduct research into research inequalities in order to undo these inequalities. Finally, critical qualitative researchers comprehend that their level of comfort can extend into the idea that research does not simply capture social realities; rather, the critical research approach is generative of narratives and knowledges. Once this last idea is accepted—namely, that knowledge is created in a research project and not merely captured—it is then a comparatively straightforward task to see the need for a researcher’s accountability for the narratives and knowledges he or she ultimately produces. In so doing, it is possible to recognize that all representations have a life of their own outside of any intentions and that representations can contribute to histories of oppression and subordination.

We propose that it is the actual practice of research, and, perhaps, even the idea of researcher as witness ( Fernandes, 2003 ), and not a notion of “best practices,” that keeps the politics of research at the center of the work we do. This includes insights into the redistribution of power, representation, and knowledge production. We suggest that critical research is work that shifts research away from the production of knowledge for knowledge’s sake and edges or nudges it toward a more transformative vision of social justice (see Burawoy, 1998 ; Choudry, 2011 ; D’Souza, 2009 ; Hussey, 2012 ; Hunter, Emerald, & Martin, 2013 ).

Thoughts from the Field

Here, based on Collins’s fieldwork, we highlight a set of critical methodological lessons that became prominent while she was conducting her field research in Malate, in the city of Manila, the Philippines, currently a tourist destination but once famous as a sex district. We define her work as a critical research practice.

Since 1999, Dana Collins has conducted urban ethnographic work in Malate, exploring gay men’s production of urban sexual place. She has been interested in the role of “desire” in urban renewal, and, in particular, how informal sexual laborers (whom she terms “gay hospitality workers,” a nomenclature drawn from their own understandings of their labor and lives) use “desire” to forge their place in a gentrifying district that is also displacing them. This displacement has involved analyzing urban tourism development, city-directed urban renewal, and gay-led gentrification, as well as informal sexual labor.

The research has involved her precarious immersion in an urban sexual field. She undertook participant observation of gay night life in the streets, as well as in private business establishments, and conducted in-depth and in-field interviews with gay business owners, city officials, conservationists, gay tourists, and gay-identified sexual laborers. In addition, she drew on insights from visual sociology and also completed extensive archival work and oral history interviewing. In all of this, she explored the collective memories of Malate as a freeing urban sexual space.

There exist multiple and shifting positionalities of power, knowledge, exchange, and resistance in her research. For one, she points out that she occupies multiple social locations as a white, lesbian-identified feminist ethnographer from a US university, one who forges complicated relationships with urban sexual space, sex workers, and both gay Filipino men and gay tourists.

A critical research practice at heart involves the shifting of epistemological foundations of social science research by addressing core questions of how we know what we know, how power shapes the practices of research, how we can better integrate research participants and communities as central producers of knowledge in our research, and how we can better conceptualize the relationship between the research we do and the social justice we are working toward in this world. 3 Such questions function as a call to action for critical researchers not only to examine the power relations present in research, but to generate new ways of researching that can confront the realities of racism, gender and class oppression, imperialism, and homophobia. This is about not only becoming better researchers, but also about seeking ways to shift the very paradigm of qualitative research and ensuring its service to social change. We have learned to use these questions as a central and ongoing part of the research we do.

Feminist and Queer Accountability to the Micropolitics of the Field

One of the primary tenets of critical qualitative research is that researchers must work with a wider understanding and application of the politics of research. For Kum-Kum Bhavnani (1993) , this means that one needs to be accountable to the micropolitics of research because such accountability destabilizes the tendency to conduct and present research from a transcendent position—the “all knowing” ethnographer, the “outsider” going in to understand the point of view of “insiders,” the attempt to (avoid) “go(ing) native,” and the researcher who aims to “gain access” at all costs and in the interests of furthering research. Micropolitics is not only the axis of inequality that shapes contemporary field relations; it is also the historical materialist relationship that constitutes the field and informs the basis of critical qualitative research. Micropolitics therefore is a critical framework that questions the essentializing and power-laden perceptions of research spaces and people because it encourages both a reflexive inquiry into the limited locations of research, and it involves the more critical practice of the researcher turning outward, to comprehend what Bhavnani calls the “interconnections” among researcher, research participants, and the social structural spaces of “the field.”

Micropolitics illuminates how all research is conducted from the limited locations of gender, race, class, sexual identification, and nationality, as well as illuminating the interconnections among all of these locations. This is not a simplistic reflexive practice of taking a moment in research to account for one’s positionality and then moving on to conduct normative field work; Bhavnani has been critical of such moments of inward inspection that lack substantial accountability to the wider micropolitics of the field. Rather, this move requires an ongoing interrogation of the limited locations of research that show how knowledge is not transcendent. Furthermore, when used reflexively, limited locations offer a more critical framework from which to practice research.

Micropolitics encouraged Collins’ attention to the limited location of a global feminist ethnographer doing research on gay male urban sexual space in Manila. For one, she moved among different positionalities throughout her research—of woman, queer-identified, white, US academic, tourist, ate (Tagalog term for older sister)—and none of these positions was either a transcendent or more authentic standpoint from which to conduct ethnographic work. So, for instance, as a white tourist, she moved easily among the gentrifying gay spaces because these spaces were increasingly designed to encourage her movement around Malate. This limited location showed the increasing establishment of white consumer space, which encouraged the movement of consumers like herself yet dissuaded the movement of the informal sexual laborers with whom she was also spending time—the gay hosts. Her limited location as a white woman researcher from a major US university meant that gay hosts sometimes shared their spaces and meanings of urban gay life with her, yet many times those particular spaces and dialogues were closed—she was not allowed into the many public sexual spaces (parks and avenues for cruising and sex late at night), yet gay hosts treated her as an audience for their many romantic stories about the boyfriends they met in the neighborhood.

Hosts emphasized that they gained much from hosting foreigners in terms of friendship, love, desire, and cultural capital. Yet they monitored the information they shared because she remained to them a US researcher who wielded the power of representation over their lives, despite her closeness with a group of five gay hosts. Hence, gay hosts often chose to remain silent about their difficult memories of sex work or any information that could frame them as one-dimensional “money boys,” as distinct from the “gay”-identified Filipino men who migrated to Malate to take part in a gay urban community.

Micropolitics challenges the authenticity of any one positionality over another; it was Collins’ movement among all of them, as well as her ongoing consideration of their social structural places, that provided her with a more critical orientation to the research. She suggests that she was not essentially a better “positioned” researcher to study “gay” life in Manila because she too is gay. Rather she found that differences of race, class, gender, and nationality tended to serve as more enduring, limited locations that influenced relationships within this research and that required ongoing critical reflexive engagement.

We want to add that a queer micropolitics of the field also offers critical insight into how identities are not stagnant but rather can be fabricated and performative during the research process. This moves researchers away from an essentialist take on their standpoint because an essentialist mind-set can lead to a search for the authentic insider and outsider. It can also lead to an essentialist social positionality that is more conducive for researching. Queer micropolitics show that research is made up of a collection of productive relations and identities. So, for example, her lesbian identification did not create a more authentic connection with gay hosts in Manila; rather, she often fabricated a shared “gay” positionality. This was a performance that served as a point of departure for her many conversations, from which she could proceed to share meanings of what it meant to be “gay” in the Manila and the United States.

Some of the productive relations that arise in research are the continuum of intimacies that develop while doing research. So, like feminists before her, she chose to develop close friendships with hosts where they genuinely loved (in a familial way) as they spoke of love. While learning about gay life in Malate, she stroked egos, offered advice, cried over broken hearts and life struggles, and built and maintained familial relations. Queer micropolitics shows, however, the limitations of such intimacies because intimacy does not equal similarity—the differing social locations of class, race, gender, and nationality meant that the experiences of urban gay life varied immensely. Thus, building such intimacies across these differences requires both the recognition and respect for boundaries that hosts constructed. She had to learn to see and know that when hosts became quiet and pulled away these were acts of self-preservation as well as acts of defiance against the many misrepresentations of their lives that had taken shape in academic research and journalistic renderings of their place in “exotic” sex districts.

A queer micropolitics also shows how research is an embodied practice: researchers are gendered, racialized, classed, and sexualized in the field. This became most apparent as she walked alone at night in the “field” and developed a keen awareness of the deeply gendered aspects of Malate’s urban spaces. For one, her embodiment was a peculiar presence because women in Manila do not walk alone at night. This includes women sex workers who publicly congregate in groups or with clients and escorts; otherwise, they are subject to police harassment. Hence, her very movement in the field as a sole woman felt like a transgression into masculine urban space because her feminine body was treated as “out-of-place” in the public spaces of the streets at night—she was flirted with, name called, followed, and sexually handled as she walked to gay bars for her research. As much as her queer location afforded her an understanding of how gender is a discursive production on the body, replete with the possibility of her being able to transcend and destabilize the gendered body as a biological “reality,” she confronted the discomfort of being read as a real woman in what became predominantly men’s spaces at night.

Yet this gendered embodiment, in part, shaped her knowledge of the district as she developed quick and knowledgeable movement through the streets, a queer micropolitical reading of urban space that arose out of this limited gender location. She was aware of the spacing of blocks, the alleys, the street lighting, and the time of night when crowds spilled out from the bars and onto the streets, allowing her to realize that a socially vibrant street life actually facilitated her movement. This queer micropolitical reading of urban space showed how both researchers and research participants do not simply exist in a neutral way in city space; rather, gender leads to our use and misuse of urban space. She has juxtaposed her experience with those of research participants in her study. The latter spoke at length about their exploratory and liberatory experiences of urban space, replete with their access to masculine sexual spaces—parks for cruising and sex, city blocks for meeting clients or picking up male sex workers, and alleys, movie theaters, and mall bathrooms for anonymous sex.

This queer micropolitical read of Malate’s gentrified space showed how very different was her access to the newly opening bars, restaurants, cafés, and lifestyle stores. Her whiteness signaled assumptions of her class location and positioned her as part of the international presence that this gentrifying space was targeting and whose movement among establishments was encouraged. She received free entry, free drinks, exceptional hospitality, and invitations to private parties, and her movements were closely monitored as she entered and exited establishments for the sake of “protecting a foreign tourist from street harassment” (interview with bar owner).

Overall, she experienced whiteness and class as equally embodied because these locations signaled her power as a “legitimate” consumer, allowing access to urban consumer sites and a privileged movement among gentrified spaces. This embodied experience of gentrified space differed from that of her gay hosts, who were often denied access to these establishments for being Filipino, young, working class, gay, and interested in foreigners. Contrarily, their bodies were constructed as a “threat” to urban renewal in the district.

Resisting Reinscription

Critical qualitative research is also concerned with the politics of representation in research. This requires a hard look at the implicit imperialisms of ethnographic work, including the tendency to go in and get out with abundant factual information, as well as the lasting impact of objectificatory research practices on fields of study. Such practices are evident in the now global rhetoric about the so-called Third World prostitute, who in both academic and journalistic renderings tends to be sensationalized and sexually Othered. This rendering is part of a long history of exoticization that has denied subjectivity and rendered invisible the lived experiences of sexual laborers around the world.

Such failed representations are part of what Kum-Kum Bhavnani (1993) has called “reinscription”—the tendency in research to freeze research participants and sites in time and space, thus rendering them both exotic and silenced. Reinscription denies agency to research participants and renders invisible the dynamic lived experiences of those same research participants. Doing research in both postcolonial and sexual spaces means that researchers must grapple with how our research participates in histories of reinscription—we both enter into and potentially contribute to a field that has been already “examined,” overstudied, and often exoticized. Thus, a critical qualitative approach is one that begins with a thorough understanding of these histories of representation so that we are not entering fields naïvely, as spaces only of exploration. Rather, we enter with knowledge of how the field has already been constituted for us through reinscription. A critical orientation has a core objective of understanding how our representations of research at all levels of the research process could contribute to exoticization by reinscribing participants and sites.

The issue of reinscription became particularly apparent when Dana Collins interviewed gay hosts and grappled with what appeared to be their elaboration of a contradictory picture of their sexual labor, as well as of their lives. In short, hosts tended to “lie,” remain silent, embellish “truths,” and articulate contradictory allusions to their life and labor in Malate. When Collins began her interviewing, she held the implicit objective of obtaining the “truth” about hosts’ lives, which she believed resided in “what they do” in the tourism industry. She was concerned with the “facts” about their lives, even though gay hosts were more likely to express their desire—desire for relations with foreigners, desire to migrate to a “gay” urban district, desire for rewarding work, and desire for community and social change. She struggled with many uncertainties about the discussions: how could they hold a range of “jobs” and attend school, yet spend most of their days and nights in Malate? How could they understand gay tourists as both boyfriends and clients? Why resist the label “sex worker” yet refer to themselves as “working boys” and claim to have “clients?” She struggled to make sense of the meanings that hosts offered even as she simultaneously felt misled concerning the “real” relations of hospitality.

Interviewing hosts about sexualized labor—as a way to produce a representation of sex work—did not facilitate the flow of candid information; hosts later expressed their view that sex work and their lives were already “overstudied.” Many researchers had previously descended on Malate to study sex work, and the district was a prime location for the outreach of HIV/AIDS organizations, some of which had breached the confidence of the gay host community. In short, Dana mistakenly started her research without the knowledge of Malate as a hyperrepresented field, and her research risked reinscribing gay hosts’ lives within that field as static and unchanging.

Importantly, those gay hosts who resisted becoming the “good research subjects” who give accurate and bountiful information, prompted a radical shift in her research framework. They told her stories about their imagined social lives, which encouraged her to rethink her commitment to researching sex work because the transformation of the discourses offered another view of the district, their work, and lives, one that offered a more visionary perspective. She began to focus less on “misinformation” and instead followed how hosts framed their lives. She treated these framings as social imaginings in which Malate features prominently in their understandings of gay identity, community, belonging, and change. In short, their social imaginings functioned as counternarratives to reinscription and offered their lived experience of urban gay place. Such imaginations expressed hope, fear, critique, and desire—in short, they present a utopic vision of identity, community, and urban change.

Integrating Lived Experience

Finally, critical qualitative research is a call to study lived experience, which is a messy, contradictory realm, but a deeply important one if we as critical researchers are truly interested in working against a history of research that has silenced those “under study” (see Weis & Fine, 2012 ). Paying attention to lived experience allows us to better engage with the contradictions mentioned earlier because lived experience is about understanding the meanings that research participants choose to share with researchers, and it is also about respecting their silences. As Kum-Kum Bhavnani (1993) has argued, silences can be as eloquent as words. Finally, integrating lived experience can take a critical qualitative project further because lived experience allows researchers to explore the epistemological relationship of the meanings and imaginings offered by research participants and to be explicit about the project of knowledge production. In other words, a central guiding question of critical qualitative research is how can research participants speak and shape epistemology, rather than solely being spoken about or being the subjects of epistemology?

Collins used hosts’ social imaginings as an epistemological contribution because their imaginings showed how hosts draw from experiences of urban gay community to articulate their desires for change, despite their simultaneous experiences of inequality and exclusion. We read social imaginings as a subjective rendering of urban place—the hosts’ social imaginings expressed their history, identity, subversive uses of urban space, and, ultimately, the symbolic reconstitution of that urban space. In this way, hosts were refiguring transnational urban space by writing themselves and their labor back into the district’s meaning, even as the global forces of tourism and urban renewal threatened to displace them.

In conclusion, we seek to highlight how critical research insists on the interplay of reflexivity, process, and practice. In particular, we encourage critical researchers to be mindful of the multiple meanings and usages of the term “critical” so that we can make more explicit our political interests and stand within our disciplines, the academy, our community, and the world. We offer dialectical materialism as a distinct mode of critical analysis that emphasizes an analysis of change in essence, practice, and struggle. We also suggest that, for researchers to be critical in their research, they should strive to take up research questions and projects that study change, contradictions, struggle, and practice in order to counter dominant interests and advance the well-being of the world’s majority. We should strive to build new research relationships—such as overcoming the faulty divides between researchers and research participants and by promoting systems of community accountability—that dialectically fuse research, political activism, and progressive social change.

Furthermore, we suggest that critical research can agitate against the homogeneity of ethnographic representation, allowing for the realities of people’s lives to come into view. Critical researchers recognize the contested fields of research; yet this requires our critical engagement with the research process, as a reflexive, empathetic, collective, self-altering, socially transformative, and embedded exercise in knowledge production. Therefore, critical research can resist imperialist research practices that are disembodied and that assume a singular social positioning. We use an imperative here to say that we must conduct research as embodied subjects who shift between multiple and limited locations. We also have to find more ways to remain accountable to our communities of research as a way to undo implicit imperialisms in social research. Critical research can work against the remnants of an objectivist and truth-seeking method that supports prevailing interests, classes, and groups while embracing research from social locations that offer situated knowledges and the possibility for greater shared understandings. Finally, critical research can engage the micropolitics of research and foreground the need for the accountability of researchers to resist reproducing epistemic violence.

This last is an idealist imagining of what should happen. However, a number of research projects have approximated closely to these goals.

Parts of our argument have appeared in some of our earlier work (e.g., Bhavnani & Talcott, 2011 ; Collins, 2009 ; 2002 ; Chua, 2001 ).

Although we, as the chapter’s three authors, do not usually use “we” in our writing as a general pronoun, it is the most direct way to offer our insights in this section.

Adorno, T. W. ( 1973 ). Negative dialectics . London: Routledge and Kegan Paul.

Google Scholar

Google Preview

Alcoff, L. , & Potter, E. (Eds.). ( 1993 ). Feminist epistemologies . New York: Routledge.

Asad, T. (Ed.). ( 1973 ). Anthropology and the colonial encounter . London: Ithaca Press.

Behar, R. ( 1993 ). Translated women: Crossing the border with Esperanza’s story . Boston: Beacon Press.

Bhavnani, K. -K. ( 1993 ). Tracing the contours: Feminist research and feminist Objectivity.   Women’s Studies International Forum , 16 (2), 95–104.

Bhavnani, K. -K. , Foran, J. , & Kurian, P. (Eds.). ( 2003 ). Feminist futures: Re-imagining women, culture, and development . London: Zed Books.

Bhavnani, K. -K. , & Talcott, M. ( 2011 ). Interconnections and configurations: Towards a global feminist ethnography. In S. N. Hesse-Biber (Ed.), Handbook of feminist research: Theory and praxis (pp. 176–186). Thousand Oaks, CA: Sage Publications.

Bonacich, E. ( 1998 ). Reflections on union activism.   Contemporary Sociology , 27 (2), 129–132.

Bonacich, E. , & Wilson, J. B. ( 2008 ). Getting the goods: Ports, labor, and logistics revolution . Cornell, NY: Cornell University Press.

Boserup, E.   1970 . Women’s Role in Economic Development . New York: St. Martin’s Press.

Browne, K. , & Nash, C. J. (Eds.). ( 2010 ). Queer methods and methodologies: Intersecting queer theories and social science research . Burlington, VA: Ashgate Publishing Company.

Burawoy, M. ( 1998 ). The extended case method.   Sociological Theory , 16 (1), 4–33.

Burawoy, M. ( 2003 ). Revisits: Outline of a theory of reflexive ethnography.   American Sociological Review , 68 , 645–679.

Carroll, W. (Ed.). ( 2004 ). Critical strategies for social research . Ontario: Canadian Scholars Press.

Carspecken, P. F. ( 1996 ). Critical Ethnography in Educational Research: A theoretical and practical guide . New York: Routledge.

Carruyo, L. ( 2011 ). Producing knowledge, protecting forests: Rural encounters with gender, ecotourism, and international aid in the Dominican Republic . Philadelphia: Penn State University Press.

Choudry, A. ( 2011 ). On knowledge, learning and research in struggle. In C. Fanelli & P. Lefebvre (Eds.), Uniting struggles: Critical social research in critical times (pp. 175– 194). Ontario: Red Quill Books.

Clifford, J. ( 1998 ). The predicament of culture: Twentieth-century ethnography, literature, and art . Cambridge, MA: Harvard University Press.

Chua, P. (2001). Condom matters and social inequalities: Inquiries into condom production, exchange, and advocacy practices . PhD. dissertation, Department of Sociology, University of California, Santa Barbara, CA.

Chua, P. ( 2006 ). Bloodshed and coercive communal peace negotiations. In R. Tolentino & S. Raymundo (Eds.), Kontra-gahum: Academics against political killings (pp. 42–57). Quezon City, Philippines: IBON Publishing.

Chua, P. ( 2007 ). Corporatizing public education in the Philippines: The case of USAID and the Ayala Foundation. In B. Lumbera , R. Guillermo , & A. Alamon (Eds.), Mula Tore Patungong Palengke: Neoliberal education in the Philippines (pp. 115–125). Quezon City, Philippines: IBON Publishing.

Chua, P. ( 2012 ). National schooling in crisis: Neoliberal policies and the 2011 justice campaign for the PGCPS Filipino overseas contract teachers.   Pingkian , 1 (1), 45–58.

Collins, D. M. (2002). Laboring districts, pleasuring sites: Hospitality, “gay” life, and the production of urban sexual space in Manila . Ph.D. dissertation, Department of Sociology, University of California, Santa Barbara, CA.

Collins, D. ( 2005 ). Identity, mobility, and urban placemaking: Exploring gay life in Manila.   Gender and Society , 19 (2), 180–198.

Collins, D. ( 2007 ). When sex work isn’t “work”: Hospitality, gay life, and the production of desiring labor.   Tourist Studies , 7 (2), 115–139.

Collins, D. ( 2009 ). “ We’re there and queer”: Homonormative mobility and lived experience among gay expatriates in Manila.   Gender and Society , 23 (4), 465–493.

Comaroff, J. , & Comaroff, J. L. ( 2012 ). Theory from the South: How Euro-America is evolving towards Africa . Boulder, CO: Paradigm Publishers.

D’Souza, R. ( 2009 ). The prison houses of knowledge: Activist scholarship and revolution in the era of globalization.   McGill Journal of Education , 44 (1), 19–38.

Degiuli, F. ( 2007 ). A job with no boundaries: Home eldercare work in Italy.   European Journal of Women’s Studies , 14 (3), 193–207.

Delanty, G. ( 2005 ). Social science: Philosophical and methodological foundations (2nd ed.). Berkshire, UK: Open University Press.

Denzin, N. K. ( 2001 ). Interpretive interactionism . Thousand Oaks, CA. Sage Publications.

Engels, F. (1877/ 1969 ). Anti-Dühring . London: Lawrence and Wishart.

Fernandes, L. ( 2003 ). Transforming feminist practice: Non-violence, social justice, and the possibilities of a spiritualized feminism . San Francisco: Aunt Lute Books.

Fonow, M. M. , & Cook, J. A. (Eds.). ( 1991 ). Beyond methodology: Feminist scholarship as lived research . Bloomington: Indiana University Press.

Giroux, H. A. ( 2009 ). Democracy’s nemesis. The rise of the corporate university.   Cultural Studies ↔ Critical Methodologies , 9 (5), 669–695.

Gouldner, A. ( 1970 ). The coming crisis of American sociology . New York: Basic Books.

Gramsci, A. ( 1971 ). Selections from the prison notebooks of Antonio Gramsci . ( Q. Hoare & G. N. Smith , Eds. & Trans.). New York: International Publishers.

Greenwood, D. J. ( 2012 ). Doing and learning action research in the neo-liberal world of contemporary higher education.   Action Research , 10 (2), 115–132.

Guenther, K. M. ( 2009 ). The impact of emotional opportunities on the emotion cultures of feminist organizations.   Gender and Society , 23 (3), 337–362.

Habermas, J. ( 1985 ). The theory of communicative action: vol. 2: Lifeword and system: A critique of functionalist reason . Boston: Beacon Press.

Haraway, D. ( 1988 ). Situated knowledges: The science question in feminism and the privilege of partial perspective.   Feminist Studies , 14 (3), 575–599.

Harding, S. ( 1991 ). Whose science? Whose knowledge? Ithaca: Cornell University Press.

Harvey, D. ( 1996 ). Justice, nature, and the geography of difference . Cambridge, MA: Blackwell Publisher.

Harvey, L. ( 1990 ). Critical social research . London: Routledge.

Hesse-Biber, S. N. , & Leavy, P. ( 2006 ). The practice of qualitative research . Thousand Oaks, CA: Sage Publications.

Ho, K. ( 2009 ). Liquidated: An Ethnography of Wall Street . Durham: Duke University Press.

Hondagneu-Sotelo, P. ( 2007 ). Domestica: Immigrant workers cleaning and caring in the shadows of affluence (2nd ed.). Berkeley: University of California Press.

Hunter, L. , Emerald, E. , & Martin, G. ( 2013 ). Participatory activist research in the globalised world . Düsseldorf: Springer.

Hussey, I. ( 2012 ). “Political activist as ethnographer” revisited.   Canadian Journal of Sociology , 37 (1), 1–23.

Jordan, S. , & Yeomans, D. ( 1995 ). Critical ethnography: Problems in contemporary theory and practice.   British Journal of Sociology of Education , 16 (3), 389–408.

Kant, I. (1781/ 1965 ). The critique of pure reason . New York: St. Martins Press.

Kang, M. ( 2010 ). The managed hand: Race, gender, and the body in beauty service work . Berkeley: University of California Press.

Kondo, D. K. ( 1990 ). Crafting selves: Power, gender, and discourses of identity in a Japanese workplace . Chicago: University of Chicago Press.

Lenin, V. I. (1915/ 1977 ). On the question of dialectics. In Collected works (vol. 38, pp. 357–361). Moscow: Progress Publishers.

Lewin, E. , & Leap, W. L. (Eds.). ( 1996 ). Out in the field: Reflections of lesbian and gay anthropologists . Champaign, IL: University of Illinois Press.

Lodhia, S. ( 2010 ). Constructing an imperfect citizen-subject: Globalization, national “security,” and violence against South Asian women.   Women’s Studies Quarterly , 38 (1), 161–177.

Lukacs, G. ( 1971 ). History and class consciousness . ( R. Livingstone ,)Trans.. Cambridge, MA: MIT Press.

Mao, Z. ( 1990 ). Lecture notes on dialectical materialism . In N. Knight (Ed.), Mao Zedong on dialectical materialism: Writings on philosophy, 1937 (pp. 84–131). Armonk, NY: M. E. Sharpe.

Madison, D. S. ( 2012 ). Critical ethnography: Method, ethics, and performance (2nd ed.). Thousand Oaks, CA: Sage Publications.

Marchand, M. H. ( 1995 ). Latin American women speak on development: Are we listening yet? In M. H. Marchand & J. L. Parpart (Eds.), Feminism/postmodernism/development (pp. 56–72). London: Routledge.

Marcus, G. E. ( 1998 ). Ethnography through thick and thin . Princeton, NJ: Princeton University Press.

Marcuse, H. ( 1968 ). Negations: Essays in critical theory . Boston: Beacon Press.

Marx, K. (1845/ 1976 ). Thesis on Feuerbach. In Marx and Engels collected works (vol. 5, pp. 3–9). New York: International Publishers.

Mohanty, C. T. ( 2003 ). Feminism without borders: Decolonizing theory, practicing solidarity . Durham, NC: Duke University Press.

Reinharz, S. , & Davidman, L. (Eds.). ( 1992 ). Feminist methods in social research . New York: Oxford University Press.

Negri, A. ( 1999 ). Insurgencies: Constituent power and the modern state . Minneapolis, MN: University of Minnesota Press.

Noblit, G. W. , Flores, S. Y. , & Murillo, E. G. ( 2004 ). Postcritical ethnography: Reinscribing critique . New York: Hampton Press.

Novelli, M. ( 2006 ). Imagining research as solidarity and grassroots globalisation: A response to Appadurai (2001).   Globalisation, Societies and Education , 4 (2), 275–286.

Ollman, B. ( 2003 ). Dance of the dialectic: Steps in Marx’s method . Champaign, IL: University of Illinois Press.

Pavlidis, P. ( 2012 ). The antinomic condition of the university: “Universal labour” beyond “academic capitalism.”   Journal for Critical Education Policy Studies , 10 (2), 139–159.

Ray, R. ( 2006 ). Is the revolution missing or are we looking in the wrong places?   Social Problems , 53 (4), 459–465.

Reilly, K. ( 2009 ). Key concepts in ethnography . London: Sage Publications.

Quantz, R. A. ( 1992 ). On critical ethnography (with some postmodern considerations). In M. S. Lecompte , W. L. Millroy , & J. Preissle (Eds.), Handbook of qualitative research in education (pp. 447–505). San Diego, CA: Academic Press.

Skeggs, B. ( 1994 ). Situating the production of feminist ethnography. In M. Maynard (Ed.), Researching women’s lives from a feminist perspective (pp. 72–81). London: Routledge.

Smith, D. ( 2007 ). Institutional ethnography: From a sociology for women to a sociology of the people. In S. N. Hesse-Biber (Ed.), Handbook of feminist research: Theory and praxis (pp. 409–416). Thousand Oaks, CA: Sage Publications.

Smith, L. T. ( 1999 ). Decolonizing methodologies . London: Zed Books.

Stoecker, R. ( 2012 ). Research methods for community change: A project based approach (2nd ed.). Thousand Oaks, CA: Sage Publications.

Strydom, P. ( 2011 ). Contemporary critical theory and methodology . London: Routledge.

Talcott, M. ( 2010 ). As neoliberal crises persist, indigenous-led movements resist: Examining the current social and political-economic conjuncture in southern Mexico. In R. A. Dello Buono & D. Fasenfest (Eds.), Social change, resistance and social practices (pp. 131–148). Boston: Brill Publishers.

Thomas, J. ( 1993 ). Doing critical ethnography . Thousand Oaks, CA: Sage Publications.

Weis, L. , & Fine, M. ( 2012 ). Critical bifocality and circuits of privilege: Expanding critical ethnographic theory and design.   Harvard Educational Review , 82 (2), 173–201.

Williams, R. ( 1976 ). Keywords: A vocabulary of culture and society . New York: Oxford University Press.

Zinn, M. B. ( 1979 ). Field research in minority communities: Ethical, methodological and political observations by an insider.   Social Problems , 27 (2), 209–219.

  • About Oxford Academic
  • Publish journals with us
  • University press partners
  • What we publish
  • New features  
  • Open access
  • Institutional account management
  • Rights and permissions
  • Get help with access
  • Accessibility
  • Advertising
  • Media enquiries
  • Oxford University Press
  • Oxford Languages
  • University of Oxford

Oxford University Press is a department of the University of Oxford. It furthers the University's objective of excellence in research, scholarship, and education by publishing worldwide

  • Copyright © 2024 Oxford University Press
  • Cookie settings
  • Cookie policy
  • Privacy policy
  • Legal notice

This Feature Is Available To Subscribers Only

Sign In or Create an Account

This PDF is available to Subscribers Only

For full access to this pdf, sign in to an existing account, or purchase an annual subscription.

Have a language expert improve your writing

Run a free plagiarism check in 10 minutes, automatically generate references for free.

  • Knowledge Base
  • Methodology
  • Critical Discourse Analysis | Definition, Guide & Examples

Critical Discourse Analysis | Definition, Guide & Examples

Published on 5 May 2022 by Amy Luo . Revised on 5 December 2022.

Discourse analysis is a research method for studying written or spoken language in relation to its social context. It aims to understand how language is used in real-life situations.

When you do discourse analysis, you might focus on:

  • The purposes and effects of different types of language
  • Cultural rules and conventions in communication
  • How values, beliefs, and assumptions are communicated
  • How language use relates to its social, political, and historical context

Discourse analysis is a common qualitative research method in many humanities and social science disciplines, including linguistics, sociology, anthropology, psychology, and cultural studies. It is also called critical discourse analysis.

Table of contents

What is discourse analysis used for, how is discourse analysis different from other methods, how to conduct discourse analysis.

Conducting discourse analysis means examining how language functions and how meaning is created in different social contexts. It can be applied to any instance of written or oral language, as well as non-verbal aspects of communication, such as tone and gestures.

Materials that are suitable for discourse analysis include:

  • Books, newspapers, and periodicals
  • Marketing material, such as brochures and advertisements
  • Business and government documents
  • Websites, forums, social media posts, and comments
  • Interviews and conversations

By analysing these types of discourse, researchers aim to gain an understanding of social groups and how they communicate.

Prevent plagiarism, run a free check.

Unlike linguistic approaches that focus only on the rules of language use, discourse analysis emphasises the contextual meaning of language.

It focuses on the social aspects of communication and the ways people use language to achieve specific effects (e.g., to build trust, to create doubt, to evoke emotions, or to manage conflict).

Instead of focusing on smaller units of language, such as sounds, words, or phrases, discourse analysis is used to study larger chunks of language, such as entire conversations, texts, or collections of texts. The selected sources can be analysed on multiple levels.

Discourse analysis is a qualitative and interpretive method of analysing texts (in contrast to more systematic methods like content analysis ). You make interpretations based on both the details of the material itself and on contextual knowledge.

There are many different approaches and techniques you can use to conduct discourse analysis, but the steps below outline the basic structure you need to follow.

Step 1: Define the research question and select the content of analysis

To do discourse analysis, you begin with a clearly defined research question . Once you have developed your question, select a range of material that is appropriate to answer it.

Discourse analysis is a method that can be applied both to large volumes of material and to smaller samples, depending on the aims and timescale of your research.

Step 2: Gather information and theory on the context

Next, you must establish the social and historical context in which the material was produced and intended to be received. Gather factual details of when and where the content was created, who the author is, who published it, and whom it was disseminated to.

As well as understanding the real-life context of the discourse, you can also conduct a literature review on the topic and construct a theoretical framework to guide your analysis.

Step 3: Analyse the content for themes and patterns

This step involves closely examining various elements of the material – such as words, sentences, paragraphs, and overall structure – and relating them to attributes, themes, and patterns relevant to your research question.

Step 4: Review your results and draw conclusions

Once you have assigned particular attributes to elements of the material, reflect on your results to examine the function and meaning of the language used. Here, you will consider your analysis in relation to the broader context that you established earlier to draw conclusions that answer your research question.

Cite this Scribbr article

If you want to cite this source, you can copy and paste the citation or click the ‘Cite this Scribbr article’ button to automatically add the citation to our free Reference Generator.

Luo, A. (2022, December 05). Critical Discourse Analysis | Definition, Guide & Examples. Scribbr. Retrieved 22 April 2024, from https://www.scribbr.co.uk/research-methods/discourse-analysis-explained/

Is this article helpful?

Amy Luo

Other students also liked

Case study | definition, examples & methods, how to do thematic analysis | guide & examples, content analysis | a step-by-step guide with examples.

Biology 231 - Research Methods

  • Verifying If An Article Is Peer-Reviewed
  • Should I Trust Internet Sources?
  • Suggested Databases for Finding Sources
  • Critical Analysis
  • Creating an Annotated Bibliography
  • Creating a Literature Review
  • Resources for Writing Research Proposals
  • Off-Campus Access

Introduction

Critical analysis may or may not be a component of this particular course's evaluation, but it is an important component of any research process. 

Inquiry-based learning

Critical thinking is at the heart of scientific inquiry. A good scientist is one who never stops asking why things happen, or how things happen. Science makes progress when we find data that contradicts our current scientific ideas.

Scientific inquiry includes three key areas:

         1.  Identifying a problem and asking questions about that problem          2.  Selecting information to respond to the problem and evaluating it          3.  Drawing conclusions from the evidence

Hart, T. (2018, 18 October) Teaching critical thinking in science - the key to students' future success.  Brighter Thinking Blog . https://www.cambridge.org/us/education/blog/2018/10/18/teaching-critical-thinking-science-key-students-future-success/

  • Writing Critical Analysis Papers

Links and tips on how to conduct a critical analysis

  • Critical Thinking & the Scientific Method "Critical thinking involves constantly asking questions, examining information and evidence, and figuring out conclusions. All of these actions are the basis for the scientific method, which then gives good evidence on which to base conclusions."
  • How to Write a Critical Analysis (with examples and tips) "Critical analysis is the detailed examination and evaluation of another person's ideas or work. It is subjective writing as it expresses your interpretation and analysis of the work by breaking down and studying its parts... Good critical analysis evaluates the ideas or work in a balanced way that highlights its positive and negative qualities."
  • CQ Researcher Online This link opens in a new window Addresses controversial topics in a balanced, unbiased manner, with regular reports on topics in health, international affairs, education, the environment, technology and the U.S. economy.

Also available in NebraskAccess

  • << Previous: I Found All These Sources. Now What?!?
  • Next: Creating an Annotated Bibliography >>
  • Last Updated: Apr 16, 2024 1:18 PM
  • URL: https://guides.library.unk.edu/BIO231
  • University of Nebraska Kearney
  • Library Policies
  • Accessibility
  • Research Guides
  • Citation Guides
  • A to Z Databases
  • Open Nebraska
  • Interlibrary Loan

2508 11th Avenue, Kearney, NE 68849-2240

Circulation Desk:  308-865-8599 Main Office:  308-865-8535

  Ask A Librarian

A critical analysis of research methods and experimental models to study working length determination and the performance of apex locators - A narrative review with recommendations for the future

Affiliations.

  • 1 Division of Endodontology, Department of Conservative Dentistry and Periodontology, University of Tübingen, Tübingen, Germany.
  • 2 Department of Periodontology, Endodontology and Cariology, University Center for Dental Medicine Basel UZB, University of Basel, Basel, Switzerland.
  • 3 Adult Dental Health, Cardiff University, Cardiff, UK.
  • 4 Conservative Dentistry and Endodontology, University of Tübingen, Tübingen, Germany.
  • PMID: 35347726
  • DOI: 10.1111/iej.13738

Outcome studies have repeatedly shown that the apical endpoint of root canal preparation and filling is a determinate factor for the outcome of root canal treatment. Accurate determination of root canal length enhances the efficacy of chemo-mechanical disinfection and prevents over-/under-instrumentation and over-/under-filling in relation to the canal terminus. Long and short root canal fillings are consistently reported to be associated with higher rates of post-treatment endodontic disease. Although standards for undertaking and reporting diagnostic accuracy studies are available, publications dealing with the determination of root canal length are highly heterogeneous and describe procedures inconsistently. The aim of this review is to critically assess the methodology of publications in the past three decades. The process of planning, performing and analysing working length studies are presented stepwise with suggestions to optimize research methods.

Keywords: Study error; accuracy tolerance; endodontic working length; experimental design; review; root canal length determination.

© 2022 British Endodontic Society. Published by John Wiley & Sons Ltd.

Publication types

  • Dental Pulp Cavity*
  • Models, Theoretical
  • Odontometry
  • Root Canal Preparation*
  • Root Canal Therapy

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • View all journals
  • My Account Login
  • Explore content
  • About the journal
  • Publish with us
  • Sign up for alerts
  • Open access
  • Published: 05 March 2024

A systematic review of the methodology of trade-off analysis in agriculture

  • Timo S. Breure   ORCID: orcid.org/0000-0001-5695-8064 1 ,
  • Natalia Estrada-Carmona   ORCID: orcid.org/0000-0003-4329-5470 2 ,
  • Athanasios Petsakos   ORCID: orcid.org/0000-0003-0224-4087 3 ,
  • Elisabetta Gotor   ORCID: orcid.org/0000-0003-0533-3077 3 ,
  • Boris Jansen   ORCID: orcid.org/0000-0002-4493-1734 4 &
  • Jeroen C. J. Groot   ORCID: orcid.org/0000-0001-6516-5170 1  

Nature Food volume  5 ,  pages 211–220 ( 2024 ) Cite this article

4652 Accesses

33 Altmetric

Metrics details

  • Agroecology
  • Ecological modelling
  • Ecosystem services
  • Environmental impact
  • Sustainability

Trade-off analysis (TOA) is central to policy and decision-making aimed at promoting sustainable agricultural landscapes. Yet, a generic methodological framework to assess trade-offs in agriculture is absent, largely due to the wide range of research disciplines and objectives for which TOA is used. In this study, we systematically reviewed 119 studies that have implemented TOAs in landscapes and regions dominated by agricultural systems around the world. Our results highlight that TOAs tend to be unbalanced, with a strong emphasis on productivity rather than environmental and socio-cultural services. TOAs have mostly been performed at farm or regional scales, rarely considering multiple spatial scales simultaneously. Mostly, TOAs fail to include stakeholders at study development stage, disregard recommendation uncertainty due to outcome variability and overlook risks associated with the TOA outcomes. Increased attention to these aspects is critical for TOAs to guide agricultural landscapes towards sustainability.

Similar content being viewed by others

research methods of critical analysis

Long-term evidence for ecological intensification as a pathway to sustainable agriculture

research methods of critical analysis

An interactive model to assess pathways for agriculture and food sector contributions to country-level net-zero targets

research methods of critical analysis

Ecological sensitivity within human realities concept for improved functional biodiversity outcomes in agricultural systems and landscapes

Contemporary agriculture should not only provide food, fibre, feed and fuel but also environmental and socio-economic benefits for rural communities and beyond 1 . To ensure that agriculture delivers multiple services while minimizing its negative impacts, society must be aware of the trade-offs and synergies that may arise. The nature of these trade-offs depends on location-specific natural, social and cultural conditions that place constraints on the inputs and outputs of an agricultural system. For example, market-based farmers are concerned with enhancing commodity production, whereas the priority of subsistence farmers lies with improving food security 2 . The global imperative to achieve the United Nations Sustainable Development Goals (SDGs) underscores the need to reduce the environmental impact of land use practices and strengthen equitable social outcomes at both landscape and community levels. However, achieving the SDGs might require sacrifices to primary productivity and economic revenues. Thus, to reconcile the demands of agriculture and inform decision-making, an analysis is required of potential trade-offs measured against agronomic, environmental, economic and social indicators 3 .

Trade-off analysis (TOA) was established as a concept to generate quantitative information on competing (trade-offs) or complementary (synergies) indicators that can be used to guide policy and decision-making 4 . A typical TOA project starts with three preparatory steps: formulation of the research question, identification of which indicators to assess, and formulation of hypotheses about the relationships between the indicators and the associated trade-offs and synergies. Subsequently, the management, policy or technological changes that affect the TOA indicators can be identified and included in the analysis framework. Then, the trade-offs and synergies under changing conditions or scenarios can be quantified and, finally, the results are communicated to relevant stakeholders to inform decision-making and policy 4 . Since its first implementation in the context of agriculture, a wide range of methods have been used to conduct TOAs, including optimization, simulations, qualitative, econometric and narrative-based approaches. In some cases, these approaches are deployed in a spatially explicit manner with the support of geographic information systems (GIS) 5 .

Although important advances have been made regarding TOA in agricultural contexts, researchers have expressed concerns about the scope and methodological limitations of published studies. These concerns relate to the limited transfer of the academic knowledge generated by TOA into decision- and policy-making due to the inability to take into account social and cultural factors 6 , the sparsity of multi- and cross-scale assessments 3 , 5 , 6 , 7 , and the limited representation of uncertainty 8 , 9 and risk analysis 5 .

The concerns reported in the literature on the limitations of TOA analysis can indeed have important implications. First, failure to recognize the importance of scale (spatial, temporal, jurisdictional and legislative) in TOA may lead to erroneous inferences on how the relationships between trade-offs and indicators develop across scales. Multiple scales can be analysed without interactions between them or a cross-scale analysis can be performed that accounts for interactions between scales 10 . Furthermore, adverse effects appearing outside the TOA case study area (off-site effects) may offset any gains stemming from a TOA-informed policy 11 . Second, recognition of social interactions and cultural values is needed to assure representation of beneficiaries and non-beneficiaries relevant to the topic at hand, that is, distributional justice 9 , 10 . Representation among stakeholders and their involvement in the design and implementation of a TOA can increase the legitimacy of its findings, assure that the data used are relevant to the context and thus enhance adoption of a study’s findings 12 . Third, validation and acknowledgement of uncertainty in both data and model estimates increase the robustness of a TOA and can facilitate risk-based decision-making 13 , 14 , 15 .

Previous literature reviews on TOA in agriculture adopted a ‘storytelling’ approach, where key studies were selected from the literature to discuss research trends. However, given the wide scope of TOAs applied in the context of agriculture, a systematic review could reveal the variety of approaches used and potential knowledge gaps, as well as the indicators that were studied and by which methods, ultimately facilitating the comparability of results.

Here we report on the TOA indicators, methodology and analysis used in 119 peer-reviewed articles. Descriptive statistics are used to characterize articles based on the extent to which they considered (1) indicators relevant to environmental and socio-economic services, (2) multiple spatial scales and their interactions, (3) the comprehensive involvement of stakeholders, and (4) the validity of trade-offs and recommendations in the context of associated uncertainties and risks (see Table 1 for further details). Finally, a cluster analysis shows which indicators were frequently studied together and which TOA methods were associated with each cluster.

The aim of this study was thus to provide an overview of the peer-reviewed literature on TOA in the context of agriculture using a systematic approach. For this purpose, we sought to define how trade-offs in agriculture are conceptualized, characterized and analysed in the TOA literature. Based on these findings, we have identified common gaps in the implementation of TOA.

The distribution of publication dates for the articles in the sample was mainly centred in the years 2015–2021 (Extended Data Fig. 1a ). Specifically, 73% of the articles were published after 2014, which indicates an increasing research effort directed towards TOAs in an agricultural context (Extended Data Fig. 1b ).

Common interrelationships and co-occurrences among TOA indicators

The articles examined included a median of 3.8 ± 1.9 (s.d.) TOA indicators, ranging from 1 to 10. Based on the cumulative distribution, 52% of the articles included three or fewer TOA indicators, while 90% included six or fewer TOA indicators (Extended Data Fig. 2a ). The most prevalent indicators across all articles were ‘profitability’ (57%, economic), ‘yield’ (44%, agronomic) and ‘water quantity’ (34%, sustainable resource management). The second most common set of indicators encompassed a selection of biophysical (for example, ‘water quality’ and ‘greenhouse gases’), agronomic (for example, ‘input efficiency’ and ‘land use efficiency’) and economic indicators (for example, ‘assets’), ranging between 13% and 21% (Fig. 1 ). The remaining TOA indicators were used less frequently and related to economic (that is, ‘labour productivity’ and ‘poverty’), human health (for example, ‘nutrition’, ‘health’ or ‘food security’) and agronomic (that is, ‘self-sufficiency’) aspects, representing a share of 5–6% (Fig. 1 ). Rarely considered TOA indicators (less than 5%) included ‘market supply or demand’ (economic), ‘yield stability’ (agronomic), ‘empowerment’ and ‘gender equity’ (both human health; Fig. 1 ).

figure 1

Percentage of articles that include a TOA indicator (black dotted line and circles) and the share of each TOA method M1–M9 used to study that indicator (coloured bars). The prefixes of the TOA indicators refer to their class association (A, E, H, S) and number of occurrence within that class as provided in Table 1 . Table 1 also describes the TOA methods M1–M9.

The articles were grouped into 11 clusters, depending on which TOA indicators were assessed (left y -axis dendrogram in Fig. 2 ). These clusters show a dominant theme based on the co-occurrence of TOA indicators (right y- axis in Fig. 2 ). For example, in cluster 7, ‘poverty’ was studied in conjunction with ‘soil nutrients’, whereas in cluster 5, ‘poverty’ was studied in conjunction with ‘profitability’, ‘food security’ and ‘nutrition’. The clustering of articles by TOA indicator reveals which TOA indicators are often studied together. Indicators of ‘profitability’ and ‘yield’ were the most commonly used (Figs. 1 and 2 ) and were generally combined with case-specific environmental and social indicators (Fig. 2 ). This suggests that agronomic and economic viability are conditional for the exploration of improvements in agricultural system sustainability. The cluster with the largest number of articles (cluster 6, Fig. 2 ) concerned agricultural production and water quality. This highlights the strong focus on solving pressing issues related to pollution by surplus nutrients from fertilizers and manure.

figure 2

The articles were clustered by TOA indicator (row-wise) and TOA indicator clusters (column-wise). The associations of articles with clusters are indicated by the colours and labels on the left of the figure; the colours are arbitrary. TOA indicator clusters (top x axis) are specified by colour, corresponding to the main indicator categories (legend in top left of the figure), and their name (bottom x axis). The matrix indicates whether a TOA indicator has been included in an article (red) or not (beige). The labels on the right list the main TOA indicators included in each cluster. GHG, greenhouse gases; SOC, soil organic carbon; supp./dem., supply or demand.

The clustering of TOA indicators (top x -axis dendrogram in Fig. 2 ) shows that for 50% of the indicators, the indicator closest in the dendrogram belongs to the same category (sustainable resource management, agronomic, economic or human health). In particular, four out of five human health indicators were studied in isolation from other indicators, forming closely paired branches (top x -axis dendrogram, orange colour, in Fig. 2 ).

The application of TOA methods varied across different TOA indicators and clusters. For example, the TOA indicators ‘labour productivity’, ‘empowerment’, ‘gender equity’ and ‘yield stability’ lacked cases involving spatially explicit methods (M1 or M8; Fig. 1 ). This same observation applies to the clusters in which these TOA indicators belong (Fig. 3 ). While the absence of spatially explicit methods for social indicators such as ‘empowerment’ and ‘gender equity’ is expected, given that their spatial dimension is often disregarded, it is worth noting that gender and empowerment may relate to the spatial distribution of fields and resources in the landscape. For instance, their distance from the location of the homestead or decision-making processes regarding the (distribution of) use and ownership of these resources. Clusters of articles associated with ‘yield’, ‘energy’, ‘biodiversity’ and ‘land use’ exhibited a high use of GIS (M8), qualitative (M6) and other (M9) methods, with fewer articles applying optimization methods (M3; Fig. 3 ). Lastly, an interesting anomaly is the ‘health’ indicator, where methods M1–M3, encompassing (spatially explicit) simulations and optimization methods, were conspicuously absent (Fig. 1 ).

figure 3

Cluster associations are as per Fig. 2 and the number of articles within each cluster is given by n .

Frequency of criteria levels

The majority of TOAs were conducted at regional (65%) and farm (17%) scales, followed by field (7%) and national (6%) scales. The TOAs conducted at multi-country (4%) and global scales, along with ‘other’, accounted for only a small proportion of the analyses (Fig. 4a ). The spatial scales for TOAs differed from the scales at which modelling was performed or data were collected, with the farm and field scale contributing to a combined share of 48%. Of the articles considered, 12% implemented cross-scale analyses and 17% considered off-site effects (Fig. 4a ). Case study areas were predominantly delineated using administrative borders (54%), followed by biophysical delineation (24%), with 18% of the articles using both methods (Fig. 4b ).

figure 4

a , Criteria related to the scale of the analysis. TOA: the spatial scale at which the TOA was conducted. The numbers refer to the spatial scales of field (1), farm (2), regional (3), national (4), multi-country (5) and global (6). Off-site: whether off-site effects have been considered in the TOA. Discipline: the spatial scale at which modelling or data collection was performed for a discipline. The numbers refer to the spatial scales detailed above for TOA. Cross-scale: whether aggregative (1), interactive (2) or no cross-scale modelling was performed (3). b , Criteria related to the TOA framework. TOA method: the methods used to perform the TOAs. The numbers refer to the TOA methods M1–M9 defined in Table 1 . System border: which boundaries were used to define the TOA case study area. Scenario: whether the article considered a scenario and, if so, which type of scenario. The numbers refer to the scenarios 1–8 defined in Table 1 . c , Criteria related to stakeholders. Type: whether local beneficiaries and non-beneficiaries, experts, government, farmers, distant beneficiaries and non-beneficiaries, academics, private organizations or environmental organizations were involved. Inclusion: whether the study included stakeholders. Implementation: whether stakeholders were involved in consultation, co-development, valuation or validation. d , Criteria related to TOA robustness: whether the article performed a validation, risk analysis or acknowledged uncertainty. e , The frequency (shown in the circles) for each spatial scale at which the modelling or data collection was performed for a given discipline. f , The frequency (shown in the circles) at which an article considered a given scenario in TOA for each spatial scale. The scenario numbers 1–8 are defined in Table 1 .

Including a scenario in the TOA allows investigation of the effect of a postulated event or driver on the TOA indicators. In our analysis, scenarios focusing on climate, behavioural or demographic change accounted for 14% of the articles, while scenarios involving alternative intensities of resource use constituted 37% of the articles. Scenarios were absent in 25% of the articles (Fig. 4b ). Over half of the articles included stakeholders in their analysis, with a relatively equal spread across stakeholder types, except for ‘distant beneficiaries and non-beneficiaries’, which were under-represented. Farmers and experts constituted a larger share (48%) compared to other categories (Fig. 4c ). Stakeholders were mainly involved in consultation and valuation, with co-development and validation implemented in less than 25% of the articles considered (Fig. 4c ). Overall, the robustness of the TOA results was not widely considered, as the criteria ‘uncertainty’ and ‘validation’ were logged for less than 50% of the articles. Articles incorporating risk analysis constituted 12% of the sample (Fig. 4d ).

Links between spatial scales and criteria

Of the articles considered, ‘livestock’, ‘fisheries’ and ‘forestry’ accounted for a relatively small share (16%) compared with ‘crop’, ‘economic’ and ‘environmental’ disciplines. For the livestock discipline, modelling and data collection were predominantly carried out at the farm scale, while for forestry, they were primarily conducted at the field or regional scale (Fig. 4e ). For the economic discipline, modelling and data collection were evenly distributed between the farm ( n  = 34) and regional ( n  = 34) scales (Fig. 4e ), in contrast to the overall share of these scales across all of the articles, where ‘regional’ constituted 65% and ‘farm’ constituted 17% of the articles (Fig. 4a ). In general, for a large share of the reviewed articles, data were collected and modelling was performed at the field and farm scales, but the TOA was conducted at the regional scale. These findings show that, before the TOA, some form of aggregation occurs in the majority of the reviewed articles. Regarding the spatial scale at which the TOA was conducted for articles including a scenario, two observations can be made. First, all of the scenarios (except the resource use scenario) were rarely studied at scales larger than the national scale. Second, the climate, behavioural and demographic change scenarios were almost exclusively studied at the regional scale (Fig. 4f ). These results show that few studies investigated how scenarios unfolding at smaller or larger scales affect the indicators at the TOA scale.

Multi-scale, cross-scale and robustness criteria

Figure 5 shows the percentage of articles that include a TOA indicator (black line, the same as shown in Fig. 1 ). The articles were then divided into subsets according to whether they included a cross-scale, multi-scale or robustness criterion. The coloured lines represent the percentage of articles in the subset that include a specific TOA indicator. With the exception of indicators rarely included in all articles (for example, those related to nutrition or health), most TOA indicators were present in articles adopting a cross-scale modelling framework (Fig. 5a ). These findings occur despite the overall low number of articles (<20%) reporting cross-scale analyses (Fig. 5a ). Notably, articles applying an interactive modelling framework did not include ‘water quality’, ‘soil erosion’, ‘soil organic carbon’ and ‘biodiversity’, despite these indicators having a relatively high frequency across all articles (Fig. 5a ).

figure 5

The percentages of all reviewed articles and subsets of articles that include specific TOA indicators. a – c , The subsets comprise articles that included cross-scale ( a ), multi-scale ( b ) and robustness ( c ) criteria. In b , TOA refers to articles in which the TOA was conducted on multiple spatial scales, ‘Discipline’ refers to articles that considered multiple spatial scales for modelling or data collection, and ‘Off-site’ refers to articles in which effects outside the TOA case study area were considered.

Across all articles, 17% considered off-site effects (Fig. 4a ). Notably, the ‘poverty’ and ‘soil erosion’ indicators were under-represented in articles considering off-site effects (Fig. 5b ). Eight indicators were excluded in articles considering multiple spatial scales in modelling or data collection (‘discipline’ in Fig. 5b ). This finding is particularly striking for ‘biodiversity’, given that it constitutes a large share of spatially explicit TOA methods (Fig. 1 ).

Thirteen per cent of articles reported TOA on multiple spatial scales, with seven indicators excluded in these cases (‘TOA’ in Fig. 5b ). Among the excluded indicators, those related to human health dominated (except for ‘nutrition’). For certain indicators, these findings are to be expected. For instance, market supply or demand (economic) is irrelevant at low geographical scales (field and farm) as prices are determined at the regional (local), national or international scale. The articles that included a risk analysis showed stark contrasts between TOA indicators with respect to their representation relative to all articles. Economic and human health indicators were particularly over-represented, while ‘yield’, ‘input efficiency’ and a set of biophysical indicators were under-represented (Fig. 5c ). For articles in which uncertainty was acknowledged or validation was performed, no indicators were over- or under-represented relative to their inclusion across all articles (Fig. 5c ).

Limitations on the inclusion of TOA indicators

Recent reviews on TOA have stated that there is little to no representation of indicators related to social interactions, justice and gender issues in TOAs for agricultural systems 5 , 6 . These studies referred in particular to intra-household equity, asset ownership, health, education and nutrition. Our results also demonstrate that social and cultural TOA indicators are largely absent, mostly considered in isolation and studied by statistical approaches. These findings are probably a result of the limited data availability and the inability of TOA methods to include socio-cultural indicators for features and processes that are difficult to capture quantitatively 16 , 17 . We further note a similarly low frequency for the following indicators: food security, self-sufficiency and yield stability. These findings raise questions about the rationale behind the selection of TOA indicators. That is, the prevalent use of profitability and crop yield as primary indicators reflects the focus on profit and crop yield maximization in the literature 5 . The outcomes and priorities of a TOA depend on the chosen objectives and indicators. Alternative indicators might therefore facilitate a more comprehensive analysis of the delivery of environmental, economic and socio-cultural services from agriculture. One illustrative example is the metric ‘nutritional yield’, defined as “the number of hectares required to provide sufficient quantity to fulfil 100% of dietary reference intake for a nutrient for one adult” 2 . Nutritional yield thus allows the assessment of land use efficiency in both agronomic and social terms. Integrating nutritional yield into TOA in the context of subsistence agriculture could unveil the need for changes in farmers’ crop plans to balance food security and economic profitability objectives.

TOA methodologies

The formulation of research objectives, questions and methodology determines the information base that a TOA can provide 16 , 18 . Decisions regarding TOA objectives and methodology determine the degree to which scales, disciplines and indicators are compartmentalized. In addition, these decisions influence the range of interventions and scenarios explored for alternative agro-environmental management of land, resources and technologies 7 , 18 . The results of our analysis reveal associations between TOA methods and indicators, indicating common gaps, such as the absence of articles reporting the use of spatially explicit methods to study the indicators ‘human health’ and ‘yield stability’. Studying these indicators in a spatially explicit manner could allow for targeted land use planning at the local scale. For instance, Prestele and Verburg demonstrated that spatially explicit analysis of climate-smart agriculture adoptions unveils local-scale trade-offs affecting yield and soil carbon sequestration at an aggregated scale 19 . Our results also underscore expected patterns, with socio-economic indicators predominantly studied through statistical approaches and qualitative methods. These methods, static and based on existing datasets, differ from mechanistic models, which allow extrapolation and ex ante assessment under alternative future scenarios. Simulations based on mechanistic models hold the potential to explore scenarios that minimize trade-offs between indicators 3 , 7 . However, the validity of this kind of optimization depends on having sufficient understanding of relevant processes and feedbacks in the socio-environmental system 3 . For example, while crop models vary in their capacity to assess climate change impacts, they share common limitations, such as inadequate representation of low-intensity agricultural systems 20 . We found that a description of study limitations in the context of the TOA framework, for example, excluded aspects, was often absent. Ideally, models and associated uncertainties would be assessed in the design phase of the TOA. This could ensure the availability of adequate information for quantifying all desired parameters at the desired resolution, allowing the study to comprehensively represent the agricultural system. Such an approach is crucial to guide planning in future management decisions aligned with research objectives 17 .

Involvement of stakeholders and practical application of TOA results

One recurring concern in the literature is the frequent omission of stakeholders at the onset of the TOA, potentially limiting the practical application of TOA results 6 , 8 . Our findings partially support these concerns, given that co-development with stakeholders was observed in only 10% of the articles. However, making a definitive statement on equal representation among stakeholders proved challenging as there was generally an absence of a systematic inventory outlining the relevance of different stakeholders to the decision-making process based on their interests and influence 21 . Our analysis shows that farmers and experts were the primary stakeholders included in the articles. Nonetheless, the omission of distant beneficiaries and non-beneficiaries is noteworthy as they are likely to be relevant to the decision-making process in numerous cases, especially when off-site effects are considered in TOAs conducted on multiple scales.

Multi- and cross-scale analysis

Depending on the research objectives, the TOA literature underscores the importance of acknowledging processes across scales and including them in research 3 , 6 , 7 , 8 , 9 , 22 . In many of the articles, data were collected or modelling was performed at field and farm scales, yet the TOA was conducted at the regional scale. This highlights an opportunity for multi-scale TOA analysis, potentially enhancing the relevance of TOA studies to policy. For example, bilevel optimization is a promising approach to facilitating nested decision-making processes at different scales. In this approach, the solution at the higher level (for example, larger spatial scale) depends on the solution at the lower level (for example, smaller spatial scale). Bostian et al. demonstrated the application of this methodology in recognizing multiple spatial scales inherent to non-point pollution regulation 23 . However, the restricted application of cross-scale analysis in our sample (12%) shows the limited extent to which TOA in agriculture captures the hierarchical nature of social, cultural, environmental, economic and agronomic processes.

Furthermore, 17% of the articles considered effects outside the TOA case study area, considering off-site effects in a diverse array of subjects, including transnational emission permits, water trading and increased demand for scarce resources, anticipated to influence their shadow prices 24 , 25 , 26 . However, off-site effects might have feedbacks, such as dependencies between alternative production systems within a supply chain 27 . In such cases, the delineation of the system boundary must be considered in the context of these feedbacks to ensure their inclusion within the system. In cases where off-site effects do not have feedbacks, these can be classified as ‘teleconnections’, denoting processes whose cause and effect are widely separated 28 . A case in point is a study of the water quality of the Danube River, in which distant beneficiaries and non-beneficiaries, represented by an international committee, were considered in the TOA 29 . The results also show that climate, behavioural and demographic scenarios were rarely assessed at lower or higher scales (compared to the regional scale). This underscores that the extent to which these scales are relevant to TOA is understudied and merits further research. For example, generic methods, such as the carbon 30 or water 31 footprint, can provide a broad assessment of which off-site effects at larger scales are relevant to TOA outcomes. These approaches may facilitate the inclusion of underlying causes, the involvement of more inclusive stakeholders and account for leakage effects, such as the expansion of agricultural lands beyond the TOA case study area 32 .

Ideally, a TOA methodological framework is conceptualized such that (1) it recognizes multi- and cross-scale interactions where applicable, (2) the system boundary aligns with substantiated biophysical and relevant socio-institutional boundaries, and (3) it recognizes the heterogeneity in which scales and associated consequences are perceived as well as valued by different stakeholders 10 .

Robustness of TOA results

The risk associated with TOA extends across spatial, temporal and jurisdictional scales, carrying implications for the dissemination of TOA results 13 . The under-representation of ‘yield’ in articles considering risk analysis highlights the dichotomy between yield and profitability as the most prominent indicators. That is, risk analysis appears to be mainly associated with the economic domain 5 . However, it is important to recognize that the evaluation of risk and the formulation of relevant strategies (risk aversion, mitigation or offsetting) are critical for farmers adopting system transformations, such as alternative forms of land use to mitigate inputs and associated greenhouse gas emissions. Integrating risk into TOA enables the study of the policies and incentives necessary for achieving whole-system transformations towards sustainable agricultural practices 13 , 14 . Decision-making under uncertainty becomes interpretable when recommendations are accompanied by an assessment of associated risks. Ideally, these risks are context-specific. For example, Hochman et al. provided TOA results on crop rotations alongside a minimum risk threshold quantified as the highest gross margin for the poorest 20% of years 33 .

While a moderate number of the articles considered uncertainty, only a few articles quantified changes in trade-offs as a function of uncertainty. The inclusion of stochastic components and the associated uncertainty inherent in biological systems could facilitate a more realistic description of outcomes, proving valuable for decision-making 13 , 15 . Varying input data or model parameterization within an expected range could reveal the sensitivity of results. For instance, when climate scenarios are used, realizations of these scenarios can be used to assess the stochasticity of the objectives for which the TOA is implemented 34 . This approach enables the acknowledgement of both the frequency and pattern of stochastic events, including extreme weather events, and their impact on TOA outcomes. Consequently, an analysis of the adaptability of a farming system would not solely rely on optimal solutions given the mean output but would also account for associated variability and unexpected events 15 . However, it is crucial to contextualize the effect of stochasticity. For example, the relative impact of model or parameter uncertainty on optimization outcomes has been shown to vary depending on the prioritization of objectives and site conditions 35 .

Limitations of this study

An important limitation of our review lies in the use of ‘trade-off analysis’ as a single term in our Web of Science search string. There are research areas that address trade-offs and synergies across various disciplines, scales and methods without explicitly using the term ‘trade-off analysis’ to describe their research objectives. Examples include the ‘food–energy–water nexus’ literature 36 , as well as research under the auspices of the Agricultural Model Intercomparison and Improvement Project (AgMIP) ( https://agmip.org/ ) and the Food, Agriculture, Biodiversity, Land-Use and Energy (FABLE) Consortium 37 . Both AgMIP and FABLE are particularly concerned with the relevance of TOA to policy. AgMIP explicitly states the use of “multiple scenarios and models to assess and probabilistically manage risk” 38 . Given the focus of these studies on global and regional assessments, we anticipate that our findings for those spatial scales could be affected. Indeed, the identified gaps in TOA implementation need to be viewed in the context of our sample, which mostly comprises studies in which modelling or data analysis was performed up to the regional level and TOA at the regional scale.

The method used to log the occurrence of pre-set criteria not only affects the variance within a criterion but also influences its abundance. For example, Sanon et al. included a large number of TOA indicators that were all classified under ‘biodiversity’ 29 . Thus, binary criteria logging does not capture the intensity with which a criterion is considered, a well-known phenomenon in the field of ecology 39 . This limitation may have resulted in the underestimation of both the intensity with which certain TOA indicators and their classes have been studied (Fig. 1 ) and the total number of TOA indicators considered per article (Extended Data Fig. 2 ).

Conclusions

Based on our analysis, it is possible to identify some actions that would increase the contribution of TOAs to SDG-aligned agricultural landscapes.

For instance, future studies should include multi- and cross-scale effects when relevant to the research objectives. We have identified an opportunity for multi-scale analysis, given that many studies aggregated farm- or field-scale data before performing TOA at a regional scale. As the inclusion of multiple scales, indicators and methods may in some cases reduce the generalizability of results and make them more context-specific, an alternative would be to discuss the anticipated implications of multi- and cross-scale effects on the study findings.

Furthermore, the relevance of TOA to society and policy can be improved by formulating research objectives such that TOA indicators lie within the scope of frameworks such as the SDGs. The most frequent indicators were biophysical or informed by profit maximization theory (for example, profitability and yield). However, indicators relevant to human well-being, security and farm resilience (for example, empowerment, nutrition and yield stability) occurred less frequently. To aid the interpretation of TOA results, the rationale behind the TOA methodology that is used to assess indicators should be listed together with a critical review of how the agricultural system under study is represented and what is excluded as a consequence.

In the reviewed articles, the most consulted stakeholders were farmers and experts, stakeholder co-development and validation were rare, and scenarios were predominantly based on resource use with little consideration of off-site effects. These findings suggest that TOAs mostly explore alternative management across a set of farms rather than policies and incentives that would facilitate whole landscape and food system transformations.

Agricultural policy- and decision-making carry an inherent risk. TOAs will become more operational when they evaluate associated risks and list strategies to manage these risks. This process could promote the robustness of quantified trade-offs with respect to the associated uncertainty of data and variability in outcomes. Finally, an inventory of stakeholders that are relevant to the decision-making process and their respective roles in the study would provide legitimacy of results. While this element has already been recognized in the literature 12 , 29 , some of the shortcomings that we have identified here would probably occur less frequently, particularly the lack of stakeholder inclusion and the over-representation of specific stakeholder types and methods of stakeholder engagement.

Closer adherence to these guidelines could enhance the relevance of TOA to the scientific community, policy-makers and farmers.

We followed the approach of Lautenbach et al. and Seppelt et al. in their systematic review of the literature on ecosystem services 9 , 22 . The generic structure involved (1) the identification, screening and selection of relevant peer-reviewed literature from a global repository, (2) formulation of the criteria against which to evaluate each article (Table 1 and Supplementary Table 1 ), and (3) descriptive statistics and cluster analysis to assess common interrelationships between criteria and identify knowledge gaps.

We used the following search string “ALL=agricultur* AND (“trade off* analysis” OR “trade-off* analysis” OR “tradeoff* analysis”)” in the Web of Science (on 14 September 2021) to identify peer-reviewed articles in English reporting TOA. We found 153 articles with publication dates spanning from 1993 to 2021. We excluded studies that mentioned the existence of trade-offs but did not assess relationships between indicators. For this reason, review and opinion papers were considered off-topic and were excluded from the search results. Furthermore, methodological papers that did not involve a case study were also excluded, leading to a total sample of 119 articles.

We selected criteria based on current TOA research 5 , 6 , 7 , 8 , 9 , 16 , 22 and recorded information on these criteria that were relevant to the conceptualization, characterization and analysis of trade-offs in agriculture (research objective 1). Briefly, the criteria included the type of TOA methods used, the spatial scales at which the analyses were performed and/or data collected, the indicators assessed in the TOA, which stakeholder types were included as well as how the stakeholders were engaged in the case study, whether the case study included alternative scenarios and of what type, how the case study area was delineated, whether effects outside the case study area were considered, and whether the case study acknowledged and accounted for uncertainty, validated results or performed a risk analysis. To assess whether cross-scale analyses were performed in case studies, we adopted the definition of Kanter et al., who distinguished between model frameworks that aggregate outputs at lower scales to use as inputs at higher scales (aggregative) and model frameworks that have submodels operating at different spatial and temporal resolutions (interactive) 6 . Thus, whereas an aggregative model framework follows a sequential approach, an interactive model framework performs analysis across scales simultaneously, allowing for interactions between scales and emergent indicators at higher levels. Furthermore, descriptive information was collected for three criteria: the agricultural system(s) studied, agricultural activities and knowledge gaps reported in the discussion section of the article. All of the criteria are listed in Table 1 with a generic description. We refer the reader to Supplementary Table 1 for more detailed information on the criteria. Based on these criteria, knowledge gaps were then assessed through descriptive statistics and cluster analysis (research objective 2).

The decision of which TOA indicators to include is a major methodological decision in TOA as it determines which interrelations are considered and analysed, and therefore which trade-offs and synergies can be identified. We anticipated thematic clusters of TOA indicators based on the discipline, scale, geography and method considered. To identify co-occurrences between TOA indicators, we performed hierarchical Ward clustering to group articles by TOA indicators as well as the TOA indicators themselves based on the Jaccard similarity coefficient 40 . Through the use of the Jaccard similarity metric, we accounted for the double-zero problem. Namely, the absence of a TOA indicator in two articles does not indicate a similarity, whereas its presence does 9 . For the clustering of articles by the TOA indicators used, the number of clusters to be retained was decided by the ‘elbow’ method based on the Mantel correlation between the data for each cluster and the raw distance matrix 40 . For the clustering of TOA indicators, the dendrogram was not cut to visualize common co-occurrences for all of the TOA indicators.

Criteria were logged in a Microsoft Office Excel (2021) spreadsheet (Supplementary Data 1 ). The data collected during this systematic review were further analysed and visualized in R (ref. 41 ). Data handling, visualizations and analysis were performed using the following R packages: tidyverse 42 , dendextend 43 , cluster 44 , vegan 45 and pheatmap 46 .

Reporting summary

Further information on research design is available in the Nature Portfolio Reporting Summary linked to this article.

Data availability

The dataset created has been made available as extended data.

Code availability

The code created for data handling, analysis and visualizations is available on request.

Renting, H. et al. Exploring multifunctional agriculture. A review of conceptual approaches and prospects for an integrative transitional framework. J. Environ. Manag. 90 , 112–123 (2009).

Article   Google Scholar  

DeFries, R. et al. Synergies and trade-offs for sustainable agriculture: nutritional yields and climate-resilience for cereal crops in Central India. Glob. Food Sec. 11 , 44–53 (2016).

Seppelt, R., Lautenbach, S. & Volk, M. Identifying trade-offs between ecosystem services, land use, and biodiversity: a plea for combining scenario analysis and optimization on different spatial scales. Curr. Opin. Environ. Sustain. 5 , 458–463 (2013).

Stoorvogel, J. J., Antle, J. M., Crissman, C. C. & Bowen, W. The tradeoff analysis model: integrated bio-physical and economic modeling of agricultural production systems. Agric. Syst. 80 , 43–66 (2004).

Antle, J. M. & Valdivia, R. O. Trade-off analysis of agri-food systems for sustainable research and development. Q Open https://doi.org/10.1093/qopen/qoaa005 (2021).

Kanter, D. R. et al. Evaluating agricultural trade-offs in the age of sustainable development. Agric. Syst. 163 , 73–88 (2018).

Groot, J. C. J. et al. On the contribution of modelling to multifunctional agriculture: learning from comparisons. J. Environ. Manag. 90 , 147–160 (2009).

Klapwijk, C. J. et al. Analysis of trade-offs in agricultural systems: current status and way forward. Curr. Opin. Environ. Sustain. 6 , 110–115 (2014).

Lautenbach, S. et al. Blind spots in ecosystem services research and challenges for implementation. Reg. Environ. Change 19 , 2151–2172 (2019).

Cash, D. W. et al. Scale and cross-scale dynamics: governance and information in a multilevel world. Ecol. Soc . https://www.jstor.org/stable/26265993 (2006).

Gibson, R. B. Sustainability assessment: basic components of a practical approach. Impact Assess. Proj. Apprais. 24 , 170–182 (2006).

Cash, D. W. et al. Knowledge systems for sustainable development. Proc. Natl Acad. Sci. USA 100 , 8086–8091 (2003).

Article   ADS   CAS   PubMed   PubMed Central   Google Scholar  

Anderson, J. R. Risk in rural development: challenges for managers and policy makers. Agric. Syst. 75 , 161–197 (2003).

Hardaker, J. B., Lien, G., Anderson, J. R. & Huirne, R. B. Coping with Risk in Agriculture: Applied Decision Analysis (Cabi, 2015).

Uusitalo, L., Lehikoinen, A., Helle, I. & Myrberg, K. An overview of methods to evaluate uncertainty of deterministic models in decision support. Environ. Model. Softw. 63 , 24–31 (2015).

Thornton, P. K. et al. A framework for priority-setting in climate smart agriculture research. Agric. Syst. 167 , 161–175 (2018).

Jones, J. W. et al. Toward a new generation of agricultural system data, models, and knowledge products: state of agricultural systems science. Agric. Syst. 155 , 269–288 (2017).

Article   PubMed   PubMed Central   Google Scholar  

Morrison-Saunders, A. & Pope, J. Conceptualising and managing trade-offs in sustainability assessment. Environ. Impact Assess. Rev. 38 , 54–63 (2013).

Prestele, R. & Verburg, P. H. The overlooked spatial dimension of climate‐smart agriculture. Glob. Change Biol. 26 , 1045–1054 (2020).

Article   ADS   Google Scholar  

Ewert, F. et al. Crop modelling for integrated assessment of risk to food production from climate change. Environ. Model. Softw. 72 , 287–303 (2015).

Norström, A. V. et al. Principles for knowledge co-production in sustainability research. Nat. Sustain. 3 , 182–190 (2020).

Seppelt, R., Dormann, C. F., Eppink, F. V., Lautenbach, S. & Schmidt, S. A quantitative review of ecosystem service studies: approaches, shortcomings and the road ahead. J. Appl. Ecol. 48 , 630–636 (2011).

Bostian, M., Whittaker, G., Barnhart, B., Fare, R. & Grosskopf, S. Valuing water quality tradeoffs at different spatial scales: an integrated approach using bilevel optimization. Water Res. Econ. 11 , 1–12 (2015).

Google Scholar  

Popp, A. et al. The economic potential of bioenergy for climate change mitigation with special attention given to implications for the land system. Environ. Res. Lett . https://doi.org/10.1088/1748-9326/6/3/034017 (2011).

Hayha, T., Franzese, P. P., Paletto, A. & Fath, B. D. Assessing, valuing, and mapping ecosystem services in Alpine forests. Ecosyst. Serv. 14 , 12–23 (2015).

Maraseni, T., An-Vo, D. A., Mushtaq, S. & Reardon-Smith, K. Carbon smart agriculture: an integrated regional approach offers significant potential to increase profit and resource use efficiency, and reduce emissions. J. Clean. Prod . https://doi.org/10.1016/j.jclepro.2020.124555 (2021).

Modongo, O. & Kulshreshtha, S. N. Economics of mitigating greenhouse gas emissions from beef production in western Canada. Agric. Syst. 162 , 229–238 (2018).

Kinzig, A. P. in The Princeton Guide to Ecology (eds Levin, S. A. et al.) 573–670 (Princeton Univ. Press, 2012).

Sanon, S., Hein, T., Douven, W. & Winkler, P. Quantifying ecosystem service trade-offs: the case of an urban floodplain in Vienna, Austria. J. Environ. Manag. 111 , 159–172 (2012).

Wright, L. A., Kemp, S. & Williams, I. ‘Carbon footprinting’: towards a universally accepted definition. Carbon Manag. 2 , 61–72 (2011).

Chapagain, A. K. & Hoekstra, A. Y. The water footprint of Morocco and the Netherlands: global water use as a result of domestic consumption of agricultural commodities. Ecol. Econ. 64 , 109–118 (2007).

Lambin, E. F. & Meyfroidt, P. Global land use change, economic globalization, and the looming land scarcity. Proc. Natl Acad. Sci. USA 108 , 3465–3472 (2011).

Hochman, Z. et al. Cropping system yield gaps can be narrowed with more optimal rotations in dryland subtropical Australia. Agric. Syst. 184 , 102896 (2020).

Karner, K., Schmid, E., Schneider, U. A. & Mitter, H. Computing stochastic Pareto frontiers between economic and environmental goals for a semi-arid agricultural production region in Austria. Ecol. Econ . https://doi.org/10.1016/j.ecolecon.2021.107044 (2021).

Holzkämper, A., Klein, T., Seppelt, R. & Fuhrer, J. Assessing the propagation of uncertainties in multi-objective optimization for agro-ecosystem adaptation to climate change. Environ. Model. Softw. 66 , 27–35 (2015).

D’Odorico, P. et al. The global food–energy–water nexus. Rev. Geophys. 56 , 456–531 (2018).

FABLE Consortium. Pathways to Sustainable Land-Use and Food Systems. 2020 Report of the FABLE Consortium (International Institute of Applied Systems Analysis and Sustainable Development Solutions Network, 2020); https://doi.org/10.22022/ESM/12-2020.16896

Agricultural Model Intercomparison and Improvement Project. Approach. Track 2: Climate change multi-model assessment AgMIP https://agmip.org/approach-4/ (2023).

Royle, J. A. & Nichols, J. D. Estimating abundance from repeated presence–absence data or point counts. Ecology 84 , 777–790 (2003).

Legendre, P. & Legendre, L. Numerical Ecology (Elsevier, 2012).

R Core Team. R: A language and environment for statistical computing. R package version 4.1.2. https://www.R-project.org/ (2021).

Wickham, H. et al. Welcome to the tidyverse. J. Open Source Softw . https://doi.org/10.21105/joss.01686 (2019).

Galili, T. dendextend: an R package for visualizing, adjusting, and comparing trees of hierarchical clustering. Bioinformatics 31 , 3718–3720 (2015).

Article   CAS   PubMed   PubMed Central   Google Scholar  

Maechler, M., Rousseeuw, P., Struyf, A., Hubert, M. & Hornik, K. cluster: Cluster analysis basics and extensions. R package version 2.1.2 (2021).

Oksanen, J. et al. vegan: Community ecology package. R package version 2.5-7 https://CRAN.R-project.org/package=vegan (2020).

Kolde, R. pheatmap: Pretty heatmaps. R package version 1.0.12 https://CRAN.R-project.org/package=pheatmap (2019).

Download references

Acknowledgements

We acknowledge R. Seppelt for his comments on the initial methodology. This work was made possible by the CGIAR Research Program on Roots, Tubers and Bananas (RTB) and the One CGIAR Initiatives ‘Nexus Gains—Realizing Multiple Benefits Across Water, Energy, Food and Ecosystems’ and ‘Nature Positive Solutions’, together with all of the donors who supported this research through their contributions to the CGIAR and One CGIAR Fund. For a list of One CGIAR Fund donors, please see http://www.cgiar.org/our-funders . This research was partly funded by the United States Agency for International Development (USAID; AID-BFS-G-11-00002) as part of the US government’s Feed the Future Initiative. The contents of this Article are the responsibility of the producing organizations and do not necessarily reflect the opinion of USAID or the US government.

Author information

Authors and affiliations.

Farming Systems Ecology, Wageningen University and Research, Wageningen, The Netherlands

Timo S. Breure & Jeroen C. J. Groot

Bioversity International, Montpellier, France

Natalia Estrada-Carmona

Bioversity International, Rome, Italy

Athanasios Petsakos & Elisabetta Gotor

Institute for Biodiversity and Ecosystem Dynamics, University of Amsterdam, Amsterdam, The Netherlands

Boris Jansen

You can also search for this author in PubMed   Google Scholar

Contributions

T.S.B. conceived and designed the study, led and performed the review and data analyses, interpretations and writing. N.E.-C. contributed to the study’s design, interpretations and writing. A.P., E.G. and B.J. contributed to interpretations and writing. J.C.J.G. contributed to the study’s design, analysis, interpretations and writing.

Corresponding author

Correspondence to Jeroen C. J. Groot .

Ethics declarations

Competing interests.

The authors declare no competing interests.

Peer review

Peer review information.

Nature Food thanks John Antle and Emma Stephens for their contribution to the peer review of this work.

Additional information

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Extended data

Extended data fig. 1 articles per year of publication..

Number of articles by publication year ( a ) and its cumulative distribution ( b ).

Extended Data Fig. 2 Figures on the number of trade-off analysis (TOA) indicators considered.

Cumulative distribution of articles per number of TOA indicators included within an article ( a ). Frequency (%) of the number of TOA indicators included within an article, color-coded by cluster as specified in Fig. 2 in the main text ( b ).

Supplementary information

Supplementary information.

Supplementary Table 1, Figs. 1–9 and a list of articles included in the systematic review.

Reporting Summary

Supplementary data 1.

Criteria assessed in the systematic review. This file was used to perform the analysis and create the figures.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ .

Reprints and permissions

About this article

Cite this article.

Breure, T.S., Estrada-Carmona, N., Petsakos, A. et al. A systematic review of the methodology of trade-off analysis in agriculture. Nat Food 5 , 211–220 (2024). https://doi.org/10.1038/s43016-024-00926-x

Download citation

Received : 25 August 2022

Accepted : 15 January 2024

Published : 05 March 2024

Issue Date : March 2024

DOI : https://doi.org/10.1038/s43016-024-00926-x

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

Quick links

  • Explore articles by subject
  • Guide to authors
  • Editorial policies

Sign up for the Nature Briefing: Anthropocene newsletter — what matters in anthropocene research, free to your inbox weekly.

research methods of critical analysis

The overall stability of a partially unstable reservoir bank slope to water fluctuation and rainfall based on Bayesian theory

  • Technical Note
  • Published: 25 April 2024

Cite this article

research methods of critical analysis

  • Wengang Zhang 1 , 2 , 3 , 5 , 6 ,
  • Songlin Liu 1 ,
  • Luqi Wang   ORCID: orcid.org/0000-0001-5108-250X 1 , 2 , 3 ,
  • Weixing Sun 1 ,
  • Yuwei He 1 ,
  • Yankun Wang 4 &
  • Guanhua Sun 6  

11 Accesses

Explore all metrics

In geotechnical analysis, the factor of safety (FOS) is crucial for slope stability assessment. Traditional methods often overlook the nuances of partial slope instability. Accurately determining geotechnical parameters for FOS in complex simulations is challenging and resource-intensive. The limit equilibrium method (LEM), considering unit weight, cohesion, and internal friction angle, is used to address this. This study focuses on the Jiuxianping landslide, analyzing its stability and failure behavior. Utilizing the Bayesian theorem, the study back-analyzes shear strength parameters, considering partial instability and uncertainties in the Janbu corrected method. The parameters’ posterior distribution is determined using the Markov Chain Monte Carlo (MCMC) method and Multivariate Adaptive Regression Splines (MARS) for efficient sampling. These parameters are then used for precise FOS calculation at the critical point of partial instability, corroborated by 2021 data from the Jiuxianping landslide. The study finds that while the entire slope remains stable, partial instability caused by long-term water erosion significantly lowers the FOS about 10.9%, highlighting its critical impact on overall slope stability.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price includes VAT (Russian Federation)

Instant access to the full article PDF.

Rent this article via DeepDyve

Institutional subscriptions

research methods of critical analysis

Data availability

Data available on request from the authors.

Abramson LW, Lee TS, Sharma S, Boyce GM et al (2002) Slope stability and stabilization methods. Wiley, New York

Google Scholar  

Chakraborti S, Konietzky H, Walter K (2012) A comparative study of different approaches for factor of safety calculations by shear strength reduction technique for non-linear Hoek-Brown failure criterion. Geotech Geol Eng 30(4):925–934

Article   Google Scholar  

Duncan J, Wright S (1980) The accuracy of equilibrium methods of slope stability analysis. Eng Geol 16(1–2):5–17

Ering P, Babu GLS (2016) Probabilistic back analysis of rainfall induced landslide-a case study of malin landslide, India. Eng Geol 208:154–164

Falae PO, Agarwal E, Pain A, Dash RK, Kanungo DP (2021) A data driven efficient framework for the probabilistic slope stability analysis of Pakhi landslide. Garhwal Himalaya J Earth Syst Sci 130(3):167

Friedman JH (1991) Multivariate adaptive regression splines. The Annals of Statistics 19(1)

Ghaderi A, Shahri AA, Larsson S (2022) A visualized hybrid intelligent model to delineate Swedish fine-grained soil layers using clay sensitivity. CATENA 214(7):106289

He CC, Hu XL, Tannant DD, Tan FL, Zhang YM, Zhang H (2018) Response of a landslide to reservoir impoundment in model tests. Eng Geol 247:84–93

He XZ, Xu HD, Sheng DS (2023) Ready-to-use deep-learning surrogate models for problems with spatially variable inputs and outputs. Acta Geotech 18:1681–1698

Hoffman MD, Gelman A (2014) The No-U-turn sampler: adaptively setting path lengths in Hamiltonian Monte Carlo. arXiv (Cornell University) 15(1):1593–1623

Huang D, Gu DM, Song YX, Cen DF, Zeng B (2018) Towards a complete understanding of the triggering mechanism of a large reactivated landslide in the Three Gorges Reservoir. Eng Geol 238:36–51

Huang ML, Sun DA, Wang CH, Keleta Y (2020) Reliability analysis of unsaturated soil slope stability using spatial random field-based Bayesian method. Landslides 18(3):1177–1189

Ivanescu AE, Li P, George B, Brown AW, Keith SW, Raju D, Allison DB (2015) The importance of prediction model validation and assessment in obesity and nutrition research. Int J Obesity 40(6):887–894

Jian WX, Xu Q, Yang HF, Wang FW (2014) Mechanism and failure process of Qianjiangping landslide in the Three Gorges Reservoir. China Environ Earth Sci 72(8):2999–3013

Jiang JW, Ehret D, Xiang W, Rohn J, Huang L, Yan SJ, Bi RN (2010) Numerical simulation of Qiaotou landslide deformation caused by drawdown of the Three Gorges Reservoir. China Environ Earth Sci 62(2):411–419

Jiang SH, Wang L, Ouyang S, Huang JS, Liu Y (2021) A comparative study of Bayesian inverse analyses of spatially varying soil parameters for slope reliability updating. Georisk: Assessment and Management of Risk for Engineered Systems and Geohazards 16(4):746–765

Kelly R, Huang JS (2015) Bayesian updating for one-dimensional consolidation measurements. Can Geotech J 52(9):1318–1330

Li YR, Wen BP, Aydin A (2013) Ring shear tests on slip zone soils of three giant landslides in the Three Gorges Project area. Eng Geol 154:106–115

Li SJ, Zhao HB, Ru ZL, Sun QC (2016) Probabilistic back analysis based on Bayesian and multi-output support vector machine for a high cut rock slope. Eng Geol 203(3):178–190

Pan M, Jiang SH, Liu X, Song GQ, Huang JS (2023) Sequential probabilistic back analyses of spatially varying soil parameters and slope reliability prediction under rainfall. Eng Geol 328:107372

Shahri AA, Malehmir A, Juhlin C (2015) Soil classification analysis based on piezocone penetration test data — a case study from a quick-clay landslide site in Southwestern Sweden. Eng Geol 189(4):32–47

Si XF, Luo Y, Gong FQ, Huang JC, Han KF (2024) Temperature effect of rockburst in granite caverns: insights from reduced-scale model true-triaxial test. Geomech Geophys Geo-energ Geo-resour 10:26

Song K, Wang FW, Yi QL, Lu SQ (2018) Landslide deformation behavior influenced by water level fluctuations of the Three Gorges Reservoir (China). Eng Geol 247:58–68

Sun DL, Xu JH, Wen HJ (2021) Assessment of landslide susceptibility mapping based on Bayesian hyperparameter optimization: a comparison between logistic regression and random forest. Eng Geol 281:105972

Tang HM, Wasowski J, Juang CH (2019) Geohazards in the three Gorges Reservoir Area, China – Lessons learned from decades of research. Eng Geol 261:105267

Wang L, Hwang JH, Luo Z, Juang CH, Xiao JH (2013) Probabilistic back analysis of slope failure – a case study in Taiwan. Comput Geotech 51:12–23

Wang YK, Huang JS, Tang HM, Zeng C (2020) Bayesian back analysis of landslides considering slip surface uncertainty. Landslides 17(9):2125–2136

Wang LQ, Wang L, Zhang WG, Meng XY, Liu SL, Zhu C (2024) Time series prediction of reservoir bank landslide failure probability considering the spatial variability of soil properties. J Rock Mech Eng. https://doi.org/10.1016/j.jrmge.2023.11.040

Xu WH, Kang YF, Chen LC, Wang LQ, Qin CB, Zhang LT, Liang D, Wu CZ, Zhang WG (2022) Dynamic assessment of slope stability based on multi-source monitoring data and ensemble learning approaches: a case study of Jiuxianping landslide. Geol J 58(6):2353–2371

Xue Y, Miao FS, Wu YP, Dias D, Li LW (2023) Combing soil spatial variation and weakening of the groundwater fluctuation zone for the probabilistic stability analysis of a riverside landslide in the Three Gorges Reservoir Area. Landslides 20(5):1013–1029

Yang GH, Zhang YC, Ye J, Zhong ZH (2012) Identification of landslide type and determination of optimal reinforcement site based on stress field and displacement field. Chi J Rock Mech Eng 31(9):1879–1887

Zhang LL, Zhang J, Zhang LM, Tang WH (2010) Back analysis of slope failure with Markov chain Monte Carlo simulation. Comput Geotech 37(7–8):905–912

Zhang WG, Zhang RH, Wang W, Zhong F, Goh A (2019) A multivariate adaptive regression splines model for determining horizontal wall deflection envelope for braced excavations in clays. Tunn Undergr Sp Tech 84:461–471

Zhang WG, Tang LB, Wang LHR, L, Cheng LF, Zhou TQ, Chen X, (2020a) Probabilistic stability analysis of Bazimen landslide with monitored rainfall data and water level fluctuations in Three Gorges Reservoir. China Front Struct Civ Eng 14(5):1247–1261

Zhang WG, Zhang RH, Wu CZ, Goh ATC, Lacasse S, Liu ZQ, Liu HL (2020b) State-of-the-art review of soft computing applications in underground excavations. Geosci Front 11(4):1095–1106

Zhang YG, Zhang Z, Xue S, Wang RJ, Xiao M (2020c) Stability analysis of a typical landslide mass in the Three Gorges Reservoir under varying reservoir water levels. Environ Earth Sci 79(1):42

Zhang WG, Lin SC, Wang LQ, Wang L, Jiang X, Wang S (2024) A novel creep contact model for rock and its implement in discrete element simulation. Comput Geoch 167:106054

Zhao LH, Yang F, Zhang YB, Dan HC, Liu WZ (2015a) Effects of shear strength reduction strategies on safety factor of homogeneous slope based on a general nonlinear failure criterion. Comput Geotech 63:215–228

Zhao LH, Zuo SZ, Lin YL, Li L, Zhang YB (2015b) Reliability back analysis of shear strength parameters of landslide with three-dimensional upper bound limit analysis theory. Landslides 13(4):711–724

Zhou C, Hu YJ, Xiao T, Ou Q, Wang LQ (2023) Analytical model for reinforcement effect and load transfer of pre-stressed anchor cable with bore deviation. Constr Build Mater 379:131219

Zhu H, Griffiths DV, Fenton GA, Zhang LM (2015) Undrained failure mechanisms of slopes in random soil. Eng Geol 191:31–35

Download references

The authors are grateful to the financial supports from Cooperation projects between Chongqing University, Chinese Academy of Sciences and other institutes (HZ2021001), and Transportation Science and Technology project of Sichuan Province (2018-ZL-01).

Author information

Authors and affiliations.

School of Civil Engineering, Chongqing University, Chongqing, 400045, China

Wengang Zhang, Songlin Liu, Luqi Wang, Weixing Sun & Yuwei He

Key Laboratory of New Technology for Construction of Cities in Mountain Area, Ministry of Education, Chongqing University, Chongqing, 400045, China

Wengang Zhang & Luqi Wang

National Joint Engineering Research Center of Geohazards Prevention in the Reservoir Areas, Chongqing University, Chongqing, 400045, China

School of Geosciences, Yangtze University, Wuhan, 430100, China

Yankun Wang

Sichuan Yanjiang Panning Expressway Co., Ltd, Xichang, 615000, China

Wengang Zhang

Institute of Rock and Soil Mechanics, Chinese Academy of Sciences, Wuhan, 430071, China

Wengang Zhang & Guanhua Sun

You can also search for this author in PubMed   Google Scholar

Contributions

Methodology, SL; validation, LW; software, YH; resources, SW; supervision, WZ and GS. All authors have read and agreed to the published version of the manuscript.

Corresponding author

Correspondence to Luqi Wang .

Ethics declarations

Competing interests.

The authors declare no competing interests.

Additional information

Overall stability of a partially unstable reservoir slope based on Bayesian theory.

Rights and permissions

Reprints and permissions

About this article

Zhang, W., Liu, S., Wang, L. et al. The overall stability of a partially unstable reservoir bank slope to water fluctuation and rainfall based on Bayesian theory. Landslides (2024). https://doi.org/10.1007/s10346-024-02250-8

Download citation

Received : 11 April 2023

Accepted : 14 March 2024

Published : 25 April 2024

DOI : https://doi.org/10.1007/s10346-024-02250-8

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

  • Jiuxianping landslide stability analysis
  • Bayesian theory
  • Multivariate Adaptive Regression Splines
  • Markov Chain Monte Carlo (MCMC) method
  • Find a journal
  • Publish with us
  • Track your research

IMAGES

  1. Writing a critical analysis of an article. How To Write An Analysis Of

    research methods of critical analysis

  2. 🐈 Critical analysis paper format. Critical Response Paper : Format

    research methods of critical analysis

  3. A framework for critical research methodology.

    research methods of critical analysis

  4. How to Write a Critical Analysis Essay Step by Step

    research methods of critical analysis

  5. What Is a Critical Analysis Essay? Simple Guide With Examples

    research methods of critical analysis

  6. Easy Ways to Write Your Critical Analysis

    research methods of critical analysis

VIDEO

  1. The scientific approach and alternative approaches to investigation

  2. Critical Literature Review by Maryam Khursheed

  3. BSN

  4. Osteopathic Research Methods

  5. Central Limit Theorem

  6. 5 Tips for Critical Analysis

COMMENTS

  1. Critical Analysis: The Often-Missing Step in Conducting Literature

    A critical analysis approach has the methodological rigor necessary for making meaningful contributions to the field and can be applied no matter what literature review method authors choose. The research process for conducting a critical analysis literature review has three phases ; (a) the deconstruction phase in which the individually ...

  2. Critical Analysis

    Critical analysis is a process of examining a piece of work or an idea in a systematic, objective, and analytical way. It involves breaking down complex ideas, concepts, or arguments into smaller, more manageable parts to understand them better. ... Research Methods: The research methods are clearly described and appropriate for the research ...

  3. PDF Step'by-step guide to critiquing research. Part 1: quantitative research

    critiquing the literature, critical analysis, reviewing the literature, evaluation and appraisal of the literature which are in essence the same thing (Bassett and Bassett, 2003). Terminology in research can be confusing for the novice research reader where a term like 'random' refers to an organized manner of selecting items or participants ...

  4. PDF Methods of Analysis Critical Analysis

    With analysts adopting and mixing these methods, criticism, critique, critical analysis, and critical inquiry have since been used interchangeably or generalized as "critical method." For example, Marcuse's (1958) Soviet Marxism is subtitled A Critical Analysis but the method, from the first sentence forward, is "immanent critique" (p ...

  5. Qualitative Research Methods: A Critical Analysis

    Abstract. Creswell (2014) noted that qualitative research is an approach for exploring and understanding the meaning individuals or groups ascribe to a social or human problem. The article embodies a critical analysis of chapters one to twelve of Stake (2010). In chapter one, Qualitative research: How things work is seen as qualitative, is ...

  6. Writing a Critical Analysis

    A critical analysis is an argument about a particular piece of media. There are typically two parts: (1) identify and explain the argument the author is making, and (2), provide your own argument about that argument. Your instructor may have very specific requirements on how you are to write your critical analysis, so make sure you read your ...

  7. 9 Critical Approaches to Qualitative Research

    That is, drawing from the writings of Marx, the Frankfurt School, and others (see Delanty, 2005; Marx, 1845/1976; Strydom, 2011), we suggest that critical approaches to qualitative methods do not signify only a particular way of thinking about the methods we use in our research studies, but that "critical approaches" also signify a turning ...

  8. Critical Discourse Analysis

    Critical discourse analysis (or discourse analysis) is a research method for studying written or spoken language in relation to its social context. It aims to understand how language is used in real life situations. When you conduct discourse analysis, you might focus on: The purposes and effects of different types of language.

  9. Critical Analysis: The Often-Missing Step in Conducting Literature

    Analysis refers to the assessment, or critique, of the literature (p. 274) The critical reflection Callahan (2014) described is simi-lar to the reflexivity required when conducting a qualitative study (Dodgson, 2019). It is not traditional for authors of literature review research to critically reflect on their assump-tions, beliefs or values ...

  10. An Introduction to Critical Approaches

    The critical approach has, at its heart, an abiding interest in issues of justice, equity and equality. The critical nature of this approach allows for it to be used not merely as an approach to conducting qualitative research, but also as a method and, in some cases, as a methodology in its own right.

  11. (PDF) Critical Analysis of Clinical Research Articles: A Guide for

    Abstract. Critical evaluation is used to identify the strengths and weaknesses of an article, in order to evaluate the usefulness and validity of research results. The components of the critical ...

  12. Learning to Do Qualitative Data Analysis: A Starting Point

    For many researchers unfamiliar with qualitative research, determining how to conduct qualitative analyses is often quite challenging. Part of this challenge is due to the seemingly limitless approaches that a qualitative researcher might leverage, as well as simply learning to think like a qualitative researcher when analyzing data. From framework analysis (Ritchie & Spencer, 1994) to content ...

  13. (PDF) Qualitative Research Methods: A Critical Analysis

    Allen (2017) mentioned that critical analysis referred to as. critical discourse analysis or critical discourse studies, is. an approach to research investigating the relationship. between ...

  14. Critical Analysis

    Good critical analysis evaluates the ideas or work in a balanced way that highlights its positive and negative qualities." CQ Researcher Online This link opens in a new window Addresses controversial topics in a balanced, unbiased manner, with regular reports on topics in health, international affairs, education, the environment, technology and ...

  15. (PDF) Methods of critical discourse analysis ...

    A New Research Agenda in Critical Discourse Analysis: Theory and Interdisciplinarity , (Amsterdam/Philadelphia: John Benjamins, 2005), pp. 19-51. Chomsky, N. Aspects of the Theory of Syntax .

  16. Critical Discourse Analysis

    How language use relates to its social, political, and historical context. Discourse analysis is a common qualitative research method in many humanities and social science disciplines, including linguistics, sociology, anthropology, psychology, and cultural studies. It is also called critical discourse analysis.

  17. Applying critical realism in qualitative research: methodology meets method

    Abstract. Critical realism (CR) is a useful philosophical framework for social science; however, little guidance is available on which precise methods - including methods of data collection, coding, and analysis - are best suited to applied CR research.

  18. Research Methods

    Research methods are specific procedures for collecting and analyzing data. Developing your research methods is an integral part of your research design. When planning your methods, there are two key decisions you will make. First, decide how you will collect data. Your methods depend on what type of data you need to answer your research question:

  19. SAGE Research Methods: Find resources to answer your research methods

    Learn about the theory and practice of critical discourse analysis, a method for studying language and power in social contexts, from SAGE Publications.

  20. Full article: Methodology or method? A critical review of qualitative

    Study design. The critical review method described by Grant and Booth (Citation 2009) was used, which is appropriate for the assessment of research quality, and is used for literature analysis to inform research and practice.This type of review goes beyond the mapping and description of scoping or rapid reviews, to include "analysis and conceptual innovation" (Grant & Booth, Citation 2009 ...

  21. SAGE Research Methods: Find resources to answer your research methods

    <iframe fetchpriority="high" src="https://www.googletagmanager.com/ns.html?id=GTM-TTVZ3L" height="0" width="0" style="display:none;visibility:hidden"></iframe>

  22. Learning critical feminist research: A brief introduction to feminist

    For example, social constructionists and standpoint theorists might be interested in the experiences or meanings of femininity, and while their focus (i.e. research questions and associated methods of analysis) would likely vary, both would assume that these are socio-culturally and historically located.

  23. Critical Analysis

    Good critical analysis evaluates the ideas or work in a balanced way that highlights its positive and negative qualities." CQ Researcher Online This link opens in a new window Addresses controversial topics in a balanced, unbiased manner, with regular reports on topics in health, international affairs, education, the environment, technology and ...

  24. Full article: Occupational therapy students' experiences and

    Introduction. Journal clubs are fora where research articles are discussed and criticised [Citation 1].They can be used as a learning activity for developing students' skills in critical appraisal and data analysis and for introducing them to various methodologies and current research [Citation 1].Moreover, journal clubs are perceived as suitable for increasing students' exposure to ...

  25. A critical analysis of research methods and experimental models to

    A critical analysis of research methods and experimental models to study working length determination and the performance of apex locators - A narrative review with recommendations for the future Int Endod J. 2022 Apr;55 Suppl 2:281-294. doi: 10.1111/iej.13738. ...

  26. Critical Realism and Qualitative Research: An introductory Overview

    Abstract. This chapter introduces a critical realist approach to qualitative research. Critical realist research methods are primarily focused on understanding, rather than merely describing ...

  27. A systematic review of the methodology of trade-off analysis in

    We selected criteria based on current TOA research 5,6,7,8,9,16,22 and recorded information on these criteria that were relevant to the conceptualization, characterization and analysis of trade ...

  28. The overall stability of a partially unstable reservoir bank slope to

    In geotechnical analysis, the factor of safety (FOS) is crucial for slope stability assessment. Traditional methods often overlook the nuances of partial slope instability. Accurately determining geotechnical parameters for FOS in complex simulations is challenging and resource-intensive. The limit equilibrium method (LEM), considering unit weight, cohesion, and internal friction angle, is ...