qualitative case study guidelines

Qualitative Case Study Guidelines

Baškarada, S. (2014). Qualitative case studies guidelines. The Qualitative Report, 19(40), 1-25

25 Pages Posted: 4 Feb 2015

Sasa Baskarada

Defence Science and Technology Organisation

Date Written: October 19, 2014

Although widely used, the qualitative case study method is not well understood. Due to conflicting epistemological presuppositions and the complexity inherent in qualitative case-based studies, scientific rigor can be difficult to demonstrate, and any resulting findings can be difficult to justify. For that reason, this paper discusses methodological problems associated with qualitative case-based research and offers guidelines for overcoming them. Due to its nearly universal acceptance, Yin’s six-stage case study process is adopted and elaborated on. Moreover, additional principles from the wider methodological literature are integrated and explained. Finally, some modifications to the dependencies between the six case study stages are suggested. It is expected that following the guidelines presented in this paper may facilitate the collection of the most relevant data in the most efficient and effective manner, simplify the subsequent analysis, as well as enhance the validity of the resulting findings. The paper should be of interest to students (honour, masters, doctoral), academics, and practitioners involved with conducting and reviewing qualitative case-based studies.

Keywords: Qualitative Research, Case Study, Guidelines, Validity

Suggested Citation: Suggested Citation

Sasa Baskarada (Contact Author)

Defence science and technology organisation ( email ).

PO Box 1500 24 Scherger Drive Canberra, SA ACT 2610 Australia 61396267916 (Phone)

Do you have a job opening that you would like to promote on SSRN?

Paper statistics, related ejournals, cognitive social science ejournal.

Subscribe to this fee journal for more curated articles on this topic

Rhetoric & Writing Education eJournal

Subscribe to this free journal for more curated articles on this topic

• Corpus ID: 6277592

Qualitative Case Study Guidelines

• Sasa Baskarada
• Published 19 October 2014
• The Qualitative Report

571 Citations

Case study method: a step-by-step guide for business researchers, collecting qualitative data for information systems studies: the reality in practice, categorization of case in case study research method: new approach, qualitative case study research as empirical inquiry.

• Highly Influenced

METHODOLOGICAL CREATIVITY IN PEDAGOGICAL RESEARCH – GLOBAL CHALLENGE

Using illustrations to make decisions on the most appropriate qualitative research methodology: the industry 4.0 scenario, ethnographic research in software engineering: a critical review and checklist, some guidance on conducting and reporting qualitative studies.

• 10 Excerpts

Perceptions of conducting academic ELT research: the case of Iranian graduate-level students

The pedagogic possibilities of student-generated case studies: moving through the looking glass, 96 references, a purposeful approach to the constant comparative method in the analysis of qualitative interviews, successfully completing case study research: combining rigour, relevance and pragmatism.

• Highly Influential
• 13 Excerpts

Processes of a case study methodology for postgraduate research in marketing

Qualitative case study methodology: study design and implementation for novice researchers, rigor in information systems positivist case research: current practices, validity and generalization in future case study evaluations, five misunderstandings about case-study research, conducting case study research in operations management, what is a case study and what is it good for.

• 15 Excerpts

Case study evaluations

Related papers.

Showing 1 through 3 of 0 Related Papers

The Ultimate Guide to Qualitative Research - Part 1: The Basics

• Introduction and overview
• What is qualitative research?
• What is qualitative data?
• Examples of qualitative data
• Qualitative vs. quantitative research
• Mixed methods
• Qualitative research preparation
• Theoretical perspective
• Theoretical framework
• Literature reviews

Research question

• Conceptual framework
• Conceptual vs. theoretical framework

Data collection

• Qualitative research methods
• Focus groups
• Observational research

What is a case study?

Applications for case study research, what is a good case study, process of case study design, benefits and limitations of case studies.

• Ethnographical research
• Ethical considerations
• Confidentiality and privacy
• Power dynamics
• Reflexivity

Case studies

Case studies are essential to qualitative research , offering a lens through which researchers can investigate complex phenomena within their real-life contexts. This chapter explores the concept, purpose, applications, examples, and types of case studies and provides guidance on how to conduct case study research effectively.

Whereas quantitative methods look at phenomena at scale, case study research looks at a concept or phenomenon in considerable detail. While analyzing a single case can help understand one perspective regarding the object of research inquiry, analyzing multiple cases can help obtain a more holistic sense of the topic or issue. Let's provide a basic definition of a case study, then explore its characteristics and role in the qualitative research process.

Definition of a case study

A case study in qualitative research is a strategy of inquiry that involves an in-depth investigation of a phenomenon within its real-world context. It provides researchers with the opportunity to acquire an in-depth understanding of intricate details that might not be as apparent or accessible through other methods of research. The specific case or cases being studied can be a single person, group, or organization – demarcating what constitutes a relevant case worth studying depends on the researcher and their research question .

Among qualitative research methods , a case study relies on multiple sources of evidence, such as documents, artifacts, interviews , or observations , to present a complete and nuanced understanding of the phenomenon under investigation. The objective is to illuminate the readers' understanding of the phenomenon beyond its abstract statistical or theoretical explanations.

Characteristics of case studies

Case studies typically possess a number of distinct characteristics that set them apart from other research methods. These characteristics include a focus on holistic description and explanation, flexibility in the design and data collection methods, reliance on multiple sources of evidence, and emphasis on the context in which the phenomenon occurs.

Furthermore, case studies can often involve a longitudinal examination of the case, meaning they study the case over a period of time. These characteristics allow case studies to yield comprehensive, in-depth, and richly contextualized insights about the phenomenon of interest.

The role of case studies in research

Case studies hold a unique position in the broader landscape of research methods aimed at theory development. They are instrumental when the primary research interest is to gain an intensive, detailed understanding of a phenomenon in its real-life context.

In addition, case studies can serve different purposes within research - they can be used for exploratory, descriptive, or explanatory purposes, depending on the research question and objectives. This flexibility and depth make case studies a valuable tool in the toolkit of qualitative researchers.

Remember, a well-conducted case study can offer a rich, insightful contribution to both academic and practical knowledge through theory development or theory verification, thus enhancing our understanding of complex phenomena in their real-world contexts.

What is the purpose of a case study?

Case study research aims for a more comprehensive understanding of phenomena, requiring various research methods to gather information for qualitative analysis . Ultimately, a case study can allow the researcher to gain insight into a particular object of inquiry and develop a theoretical framework relevant to the research inquiry.

Why use case studies in qualitative research?

Using case studies as a research strategy depends mainly on the nature of the research question and the researcher's access to the data.

Conducting case study research provides a level of detail and contextual richness that other research methods might not offer. They are beneficial when there's a need to understand complex social phenomena within their natural contexts.

The explanatory, exploratory, and descriptive roles of case studies

Case studies can take on various roles depending on the research objectives. They can be exploratory when the research aims to discover new phenomena or define new research questions; they are descriptive when the objective is to depict a phenomenon within its context in a detailed manner; and they can be explanatory if the goal is to understand specific relationships within the studied context. Thus, the versatility of case studies allows researchers to approach their topic from different angles, offering multiple ways to uncover and interpret the data .

The impact of case studies on knowledge development

Case studies play a significant role in knowledge development across various disciplines. Analysis of cases provides an avenue for researchers to explore phenomena within their context based on the collected data.

This can result in the production of rich, practical insights that can be instrumental in both theory-building and practice. Case studies allow researchers to delve into the intricacies and complexities of real-life situations, uncovering insights that might otherwise remain hidden.

Types of case studies

In qualitative research , a case study is not a one-size-fits-all approach. Depending on the nature of the research question and the specific objectives of the study, researchers might choose to use different types of case studies. These types differ in their focus, methodology, and the level of detail they provide about the phenomenon under investigation.

Understanding these types is crucial for selecting the most appropriate approach for your research project and effectively achieving your research goals. Let's briefly look at the main types of case studies.

Exploratory case studies

Exploratory case studies are typically conducted to develop a theory or framework around an understudied phenomenon. They can also serve as a precursor to a larger-scale research project. Exploratory case studies are useful when a researcher wants to identify the key issues or questions which can spur more extensive study or be used to develop propositions for further research. These case studies are characterized by flexibility, allowing researchers to explore various aspects of a phenomenon as they emerge, which can also form the foundation for subsequent studies.

Descriptive case studies

Descriptive case studies aim to provide a complete and accurate representation of a phenomenon or event within its context. These case studies are often based on an established theoretical framework, which guides how data is collected and analyzed. The researcher is concerned with describing the phenomenon in detail, as it occurs naturally, without trying to influence or manipulate it.

Explanatory case studies

Explanatory case studies are focused on explanation - they seek to clarify how or why certain phenomena occur. Often used in complex, real-life situations, they can be particularly valuable in clarifying causal relationships among concepts and understanding the interplay between different factors within a specific context.

Intrinsic, instrumental, and collective case studies

These three categories of case studies focus on the nature and purpose of the study. An intrinsic case study is conducted when a researcher has an inherent interest in the case itself. Instrumental case studies are employed when the case is used to provide insight into a particular issue or phenomenon. A collective case study, on the other hand, involves studying multiple cases simultaneously to investigate some general phenomena.

Each type of case study serves a different purpose and has its own strengths and challenges. The selection of the type should be guided by the research question and objectives, as well as the context and constraints of the research.

The flexibility, depth, and contextual richness offered by case studies make this approach an excellent research method for various fields of study. They enable researchers to investigate real-world phenomena within their specific contexts, capturing nuances that other research methods might miss. Across numerous fields, case studies provide valuable insights into complex issues.

Critical information systems research

Case studies provide a detailed understanding of the role and impact of information systems in different contexts. They offer a platform to explore how information systems are designed, implemented, and used and how they interact with various social, economic, and political factors. Case studies in this field often focus on examining the intricate relationship between technology, organizational processes, and user behavior, helping to uncover insights that can inform better system design and implementation.

Health research

Health research is another field where case studies are highly valuable. They offer a way to explore patient experiences, healthcare delivery processes, and the impact of various interventions in a real-world context.

Case studies can provide a deep understanding of a patient's journey, giving insights into the intricacies of disease progression, treatment effects, and the psychosocial aspects of health and illness.

Asthma research studies

Specifically within medical research, studies on asthma often employ case studies to explore the individual and environmental factors that influence asthma development, management, and outcomes. A case study can provide rich, detailed data about individual patients' experiences, from the triggers and symptoms they experience to the effectiveness of various management strategies. This can be crucial for developing patient-centered asthma care approaches.

Other fields

Apart from the fields mentioned, case studies are also extensively used in business and management research, education research, and political sciences, among many others. They provide an opportunity to delve into the intricacies of real-world situations, allowing for a comprehensive understanding of various phenomena.

Case studies, with their depth and contextual focus, offer unique insights across these varied fields. They allow researchers to illuminate the complexities of real-life situations, contributing to both theory and practice.

Whatever field you're in, ATLAS.ti puts your data to work for you

Download a free trial of ATLAS.ti to turn your data into insights.

Understanding the key elements of case study design is crucial for conducting rigorous and impactful case study research. A well-structured design guides the researcher through the process, ensuring that the study is methodologically sound and its findings are reliable and valid. The main elements of case study design include the research question , propositions, units of analysis, and the logic linking the data to the propositions.

The research question is the foundation of any research study. A good research question guides the direction of the study and informs the selection of the case, the methods of collecting data, and the analysis techniques. A well-formulated research question in case study research is typically clear, focused, and complex enough to merit further detailed examination of the relevant case(s).

Propositions

Propositions, though not necessary in every case study, provide a direction by stating what we might expect to find in the data collected. They guide how data is collected and analyzed by helping researchers focus on specific aspects of the case. They are particularly important in explanatory case studies, which seek to understand the relationships among concepts within the studied phenomenon.

Units of analysis

The unit of analysis refers to the case, or the main entity or entities that are being analyzed in the study. In case study research, the unit of analysis can be an individual, a group, an organization, a decision, an event, or even a time period. It's crucial to clearly define the unit of analysis, as it shapes the qualitative data analysis process by allowing the researcher to analyze a particular case and synthesize analysis across multiple case studies to draw conclusions.

Argumentation

This refers to the inferential model that allows researchers to draw conclusions from the data. The researcher needs to ensure that there is a clear link between the data, the propositions (if any), and the conclusions drawn. This argumentation is what enables the researcher to make valid and credible inferences about the phenomenon under study.

Understanding and carefully considering these elements in the design phase of a case study can significantly enhance the quality of the research. It can help ensure that the study is methodologically sound and its findings contribute meaningful insights about the case.

Ready to jumpstart your research with ATLAS.ti?

Conceptualize your research project with our intuitive data analysis interface. Download a free trial today.

Conducting a case study involves several steps, from defining the research question and selecting the case to collecting and analyzing data . This section outlines these key stages, providing a practical guide on how to conduct case study research.

Defining the research question

The first step in case study research is defining a clear, focused research question. This question should guide the entire research process, from case selection to analysis. It's crucial to ensure that the research question is suitable for a case study approach. Typically, such questions are exploratory or descriptive in nature and focus on understanding a phenomenon within its real-life context.

Selecting and defining the case

The selection of the case should be based on the research question and the objectives of the study. It involves choosing a unique example or a set of examples that provide rich, in-depth data about the phenomenon under investigation. After selecting the case, it's crucial to define it clearly, setting the boundaries of the case, including the time period and the specific context.

Previous research can help guide the case study design. When considering a case study, an example of a case could be taken from previous case study research and used to define cases in a new research inquiry. Considering recently published examples can help understand how to select and define cases effectively.

Developing a detailed case study protocol

A case study protocol outlines the procedures and general rules to be followed during the case study. This includes the data collection methods to be used, the sources of data, and the procedures for analysis. Having a detailed case study protocol ensures consistency and reliability in the study.

The protocol should also consider how to work with the people involved in the research context to grant the research team access to collecting data. As mentioned in previous sections of this guide, establishing rapport is an essential component of qualitative research as it shapes the overall potential for collecting and analyzing data.

Collecting data

Gathering data in case study research often involves multiple sources of evidence, including documents, archival records, interviews, observations, and physical artifacts. This allows for a comprehensive understanding of the case. The process for gathering data should be systematic and carefully documented to ensure the reliability and validity of the study.

Analyzing and interpreting data

The next step is analyzing the data. This involves organizing the data , categorizing it into themes or patterns , and interpreting these patterns to answer the research question. The analysis might also involve comparing the findings with prior research or theoretical propositions.

Writing the case study report

The final step is writing the case study report . This should provide a detailed description of the case, the data, the analysis process, and the findings. The report should be clear, organized, and carefully written to ensure that the reader can understand the case and the conclusions drawn from it.

Each of these steps is crucial in ensuring that the case study research is rigorous, reliable, and provides valuable insights about the case.

The type, depth, and quality of data in your study can significantly influence the validity and utility of the study. In case study research, data is usually collected from multiple sources to provide a comprehensive and nuanced understanding of the case. This section will outline the various methods of collecting data used in case study research and discuss considerations for ensuring the quality of the data.

Interviews are a common method of gathering data in case study research. They can provide rich, in-depth data about the perspectives, experiences, and interpretations of the individuals involved in the case. Interviews can be structured , semi-structured , or unstructured , depending on the research question and the degree of flexibility needed.

Observations

Observations involve the researcher observing the case in its natural setting, providing first-hand information about the case and its context. Observations can provide data that might not be revealed in interviews or documents, such as non-verbal cues or contextual information.

Documents and artifacts

Documents and archival records provide a valuable source of data in case study research. They can include reports, letters, memos, meeting minutes, email correspondence, and various public and private documents related to the case.

These records can provide historical context, corroborate evidence from other sources, and offer insights into the case that might not be apparent from interviews or observations.

Physical artifacts refer to any physical evidence related to the case, such as tools, products, or physical environments. These artifacts can provide tangible insights into the case, complementing the data gathered from other sources.

Ensuring the quality of data collection

Determining the quality of data in case study research requires careful planning and execution. It's crucial to ensure that the data is reliable, accurate, and relevant to the research question. This involves selecting appropriate methods of collecting data, properly training interviewers or observers, and systematically recording and storing the data. It also includes considering ethical issues related to collecting and handling data, such as obtaining informed consent and ensuring the privacy and confidentiality of the participants.

Data analysis

Analyzing case study research involves making sense of the rich, detailed data to answer the research question. This process can be challenging due to the volume and complexity of case study data. However, a systematic and rigorous approach to analysis can ensure that the findings are credible and meaningful. This section outlines the main steps and considerations in analyzing data in case study research.

Organizing the data

The first step in the analysis is organizing the data. This involves sorting the data into manageable sections, often according to the data source or the theme. This step can also involve transcribing interviews, digitizing physical artifacts, or organizing observational data.

Categorizing and coding the data

Once the data is organized, the next step is to categorize or code the data. This involves identifying common themes, patterns, or concepts in the data and assigning codes to relevant data segments. Coding can be done manually or with the help of software tools, and in either case, qualitative analysis software can greatly facilitate the entire coding process. Coding helps to reduce the data to a set of themes or categories that can be more easily analyzed.

Identifying patterns and themes

After coding the data, the researcher looks for patterns or themes in the coded data. This involves comparing and contrasting the codes and looking for relationships or patterns among them. The identified patterns and themes should help answer the research question.

Interpreting the data

Once patterns and themes have been identified, the next step is to interpret these findings. This involves explaining what the patterns or themes mean in the context of the research question and the case. This interpretation should be grounded in the data, but it can also involve drawing on theoretical concepts or prior research.

Verification of the data

The last step in the analysis is verification. This involves checking the accuracy and consistency of the analysis process and confirming that the findings are supported by the data. This can involve re-checking the original data, checking the consistency of codes, or seeking feedback from research participants or peers.

Like any research method , case study research has its strengths and limitations. Researchers must be aware of these, as they can influence the design, conduct, and interpretation of the study.

Understanding the strengths and limitations of case study research can also guide researchers in deciding whether this approach is suitable for their research question . This section outlines some of the key strengths and limitations of case study research.

Benefits include the following:

• Rich, detailed data: One of the main strengths of case study research is that it can generate rich, detailed data about the case. This can provide a deep understanding of the case and its context, which can be valuable in exploring complex phenomena.
• Flexibility: Case study research is flexible in terms of design , data collection , and analysis . A sufficient degree of flexibility allows the researcher to adapt the study according to the case and the emerging findings.
• Real-world context: Case study research involves studying the case in its real-world context, which can provide valuable insights into the interplay between the case and its context.
• Multiple sources of evidence: Case study research often involves collecting data from multiple sources , which can enhance the robustness and validity of the findings.

On the other hand, researchers should consider the following limitations:

• Generalizability: A common criticism of case study research is that its findings might not be generalizable to other cases due to the specificity and uniqueness of each case.
• Time and resource intensive: Case study research can be time and resource intensive due to the depth of the investigation and the amount of collected data.
• Complexity of analysis: The rich, detailed data generated in case study research can make analyzing the data challenging.
• Subjectivity: Given the nature of case study research, there may be a higher degree of subjectivity in interpreting the data , so researchers need to reflect on this and transparently convey to audiences how the research was conducted.

Being aware of these strengths and limitations can help researchers design and conduct case study research effectively and interpret and report the findings appropriately.

Ready to analyze your data with ATLAS.ti?

See how our intuitive software can draw key insights from your data with a free trial today.

Designing and Conducting Case Studies

This guide examines case studies, a form of qualitative descriptive research that is used to look at individuals, a small group of participants, or a group as a whole. Researchers collect data about participants using participant and direct observations, interviews, protocols, tests, examinations of records, and collections of writing samples. Starting with a definition of the case study, the guide moves to a brief history of this research method. Using several well documented case studies, the guide then looks at applications and methods including data collection and analysis. A discussion of ways to handle validity, reliability, and generalizability follows, with special attention to case studies as they are applied to composition studies. Finally, this guide examines the strengths and weaknesses of case studies.

Definition and Overview

Case study refers to the collection and presentation of detailed information about a particular participant or small group, frequently including the accounts of subjects themselves. A form of qualitative descriptive research, the case study looks intensely at an individual or small participant pool, drawing conclusions only about that participant or group and only in that specific context. Researchers do not focus on the discovery of a universal, generalizable truth, nor do they typically look for cause-effect relationships; instead, emphasis is placed on exploration and description.

Case studies typically examine the interplay of all variables in order to provide as complete an understanding of an event or situation as possible. This type of comprehensive understanding is arrived at through a process known as thick description, which involves an in-depth description of the entity being evaluated, the circumstances under which it is used, the characteristics of the people involved in it, and the nature of the community in which it is located. Thick description also involves interpreting the meaning of demographic and descriptive data such as cultural norms and mores, community values, ingrained attitudes, and motives.

Unlike quantitative methods of research, like the survey, which focus on the questions of who, what, where, how much, and how many, and archival analysis, which often situates the participant in some form of historical context, case studies are the preferred strategy when how or why questions are asked. Likewise, they are the preferred method when the researcher has little control over the events, and when there is a contemporary focus within a real life context. In addition, unlike more specifically directed experiments, case studies require a problem that seeks a holistic understanding of the event or situation in question using inductive logic--reasoning from specific to more general terms.

In scholarly circles, case studies are frequently discussed within the context of qualitative research and naturalistic inquiry. Case studies are often referred to interchangeably with ethnography, field study, and participant observation. The underlying philosophical assumptions in the case are similar to these types of qualitative research because each takes place in a natural setting (such as a classroom, neighborhood, or private home), and strives for a more holistic interpretation of the event or situation under study.

Unlike more statistically-based studies which search for quantifiable data, the goal of a case study is to offer new variables and questions for further research. F.H. Giddings, a sociologist in the early part of the century, compares statistical methods to the case study on the basis that the former are concerned with the distribution of a particular trait, or a small number of traits, in a population, whereas the case study is concerned with the whole variety of traits to be found in a particular instance" (Hammersley 95).

Case studies are not a new form of research; naturalistic inquiry was the primary research tool until the development of the scientific method. The fields of sociology and anthropology are credited with the primary shaping of the concept as we know it today. However, case study research has drawn from a number of other areas as well: the clinical methods of doctors; the casework technique being developed by social workers; the methods of historians and anthropologists, plus the qualitative descriptions provided by quantitative researchers like LePlay; and, in the case of Robert Park, the techniques of newspaper reporters and novelists.

Park was an ex-newspaper reporter and editor who became very influential in developing sociological case studies at the University of Chicago in the 1920s. As a newspaper professional he coined the term "scientific" or "depth" reporting: the description of local events in a way that pointed to major social trends. Park viewed the sociologist as "merely a more accurate, responsible, and scientific reporter." Park stressed the variety and value of human experience. He believed that sociology sought to arrive at natural, but fluid, laws and generalizations in regard to human nature and society. These laws weren't static laws of the kind sought by many positivists and natural law theorists, but rather, they were laws of becoming--with a constant possibility of change. Park encouraged students to get out of the library, to quit looking at papers and books, and to view the constant experiment of human experience. He writes, "Go and sit in the lounges of the luxury hotels and on the doorsteps of the flophouses; sit on the Gold Coast settees and on the slum shakedowns; sit in the Orchestra Hall and in the Star and Garter Burlesque. In short, gentlemen [sic], go get the seats of your pants dirty in real research."

But over the years, case studies have drawn their share of criticism. In fact, the method had its detractors from the start. In the 1920s, the debate between pro-qualitative and pro-quantitative became quite heated. Case studies, when compared to statistics, were considered by many to be unscientific. From the 1930's on, the rise of positivism had a growing influence on quantitative methods in sociology. People wanted static, generalizable laws in science. The sociological positivists were looking for stable laws of social phenomena. They criticized case study research because it failed to provide evidence of inter subjective agreement. Also, they condemned it because of the few number of cases studied and that the under-standardized character of their descriptions made generalization impossible. By the 1950s, quantitative methods, in the form of survey research, had become the dominant sociological approach and case study had become a minority practice.

Educational Applications

The 1950's marked the dawning of a new era in case study research, namely that of the utilization of the case study as a teaching method. "Instituted at Harvard Business School in the 1950s as a primary method of teaching, cases have since been used in classrooms and lecture halls alike, either as part of a course of study or as the main focus of the course to which other teaching material is added" (Armisted 1984). The basic purpose of instituting the case method as a teaching strategy was "to transfer much of the responsibility for learning from the teacher on to the student, whose role, as a result, shifts away from passive absorption toward active construction" (Boehrer 1990). Through careful examination and discussion of various cases, "students learn to identify actual problems, to recognize key players and their agendas, and to become aware of those aspects of the situation that contribute to the problem" (Merseth 1991). In addition, students are encouraged to "generate their own analysis of the problems under consideration, to develop their own solutions, and to practically apply their own knowledge of theory to these problems" (Boyce 1993). Along the way, students also develop "the power to analyze and to master a tangled circumstance by identifying and delineating important factors; the ability to utilize ideas, to test them against facts, and to throw them into fresh combinations" (Merseth 1991).

In addition to the practical application and testing of scholarly knowledge, case discussions can also help students prepare for real-world problems, situations and crises by providing an approximation of various professional environments (i.e. classroom, board room, courtroom, or hospital). Thus, through the examination of specific cases, students are given the opportunity to work out their own professional issues through the trials, tribulations, experiences, and research findings of others. An obvious advantage to this mode of instruction is that it allows students the exposure to settings and contexts that they might not otherwise experience. For example, a student interested in studying the effects of poverty on minority secondary student's grade point averages and S.A.T. scores could access and analyze information from schools as geographically diverse as Los Angeles, New York City, Miami, and New Mexico without ever having to leave the classroom.

The case study method also incorporates the idea that students can learn from one another "by engaging with each other and with each other's ideas, by asserting something and then having it questioned, challenged and thrown back at them so that they can reflect on what they hear, and then refine what they say" (Boehrer 1990). In summary, students can direct their own learning by formulating questions and taking responsibility for the study.

Types and Design Concerns

Researchers use multiple methods and approaches to conduct case studies.

Types of Case Studies

Under the more generalized category of case study exist several subdivisions, each of which is custom selected for use depending upon the goals and/or objectives of the investigator. These types of case study include the following:

Illustrative Case Studies These are primarily descriptive studies. They typically utilize one or two instances of an event to show what a situation is like. Illustrative case studies serve primarily to make the unfamiliar familiar and to give readers a common language about the topic in question.

Exploratory (or pilot) Case Studies These are condensed case studies performed before implementing a large scale investigation. Their basic function is to help identify questions and select types of measurement prior to the main investigation. The primary pitfall of this type of study is that initial findings may seem convincing enough to be released prematurely as conclusions.

Cumulative Case Studies These serve to aggregate information from several sites collected at different times. The idea behind these studies is the collection of past studies will allow for greater generalization without additional cost or time being expended on new, possibly repetitive studies.

Critical Instance Case Studies These examine one or more sites for either the purpose of examining a situation of unique interest with little to no interest in generalizability, or to call into question or challenge a highly generalized or universal assertion. This method is useful for answering cause and effect questions.

Identifying a Theoretical Perspective

Much of the case study's design is inherently determined for researchers, depending on the field from which they are working. In composition studies, researchers are typically working from a qualitative, descriptive standpoint. In contrast, physicists will approach their research from a more quantitative perspective. Still, in designing the study, researchers need to make explicit the questions to be explored and the theoretical perspective from which they will approach the case. The three most commonly adopted theories are listed below:

Individual Theories These focus primarily on the individual development, cognitive behavior, personality, learning and disability, and interpersonal interactions of a particular subject.

Organizational Theories These focus on bureaucracies, institutions, organizational structure and functions, or excellence in organizational performance.

Social Theories These focus on urban development, group behavior, cultural institutions, or marketplace functions.

Two examples of case studies are used consistently throughout this chapter. The first, a study produced by Berkenkotter, Huckin, and Ackerman (1988), looks at a first year graduate student's initiation into an academic writing program. The study uses participant-observer and linguistic data collecting techniques to assess the student's knowledge of appropriate discourse conventions. Using the pseudonym Nate to refer to the subject, the study sought to illuminate the particular experience rather than to generalize about the experience of fledgling academic writers collectively.

For example, in Berkenkotter, Huckin, and Ackerman's (1988) study we are told that the researchers are interested in disciplinary communities. In the first paragraph, they ask what constitutes membership in a disciplinary community and how achieving membership might affect a writer's understanding and production of texts. In the third paragraph they state that researchers must negotiate their claims "within the context of his sub specialty's accepted knowledge and methodology." In the next paragraph they ask, "How is literacy acquired? What is the process through which novices gain community membership? And what factors either aid or hinder students learning the requisite linguistic behaviors?" This introductory section ends with a paragraph in which the study's authors claim that during the course of the study, the subject, Nate, successfully makes the transition from "skilled novice" to become an initiated member of the academic discourse community and that his texts exhibit linguistic changes which indicate this transition. In the next section the authors make explicit the sociolinguistic theoretical and methodological assumptions on which the study is based (1988). Thus the reader has a good understanding of the authors' theoretical background and purpose in conducting the study even before it is explicitly stated on the fourth page of the study. "Our purpose was to examine the effects of the educational context on one graduate student's production of texts as he wrote in different courses and for different faculty members over the academic year 1984-85." The goal of the study then, was to explore the idea that writers must be initiated into a writing community, and that this initiation will change the way one writes.

The second example is Janet Emig's (1971) study of the composing process of a group of twelfth graders. In this study, Emig seeks to answer the question of what happens to the self as a result educational stimuli in terms of academic writing. The case study used methods such as protocol analysis, tape-recorded interviews, and discourse analysis.

In the case of Janet Emig's (1971) study of the composing process of eight twelfth graders, four specific hypotheses were made:

• Twelfth grade writers engage in two modes of composing: reflexive and extensive.
• These differences can be ascertained and characterized through having the writers compose aloud their composition process.
• A set of implied stylistic principles governs the writing process.
• For twelfth grade writers, extensive writing occurs chiefly as a school-sponsored activity, or reflexive, as a self-sponsored activity.

In this study, the chief distinction is between the two dominant modes of composing among older, secondary school students. The distinctions are:

• The reflexive mode, which focuses on the writer's thoughts and feelings.
• The extensive mode, which focuses on conveying a message.

Emig also outlines the specific questions which guided the research in the opening pages of her Review of Literature , preceding the report.

Designing a Case Study

After considering the different sub categories of case study and identifying a theoretical perspective, researchers can begin to design their study. Research design is the string of logic that ultimately links the data to be collected and the conclusions to be drawn to the initial questions of the study. Typically, research designs deal with at least four problems:

• What questions to study
• What data are relevant
• What data to collect
• How to analyze that data

In other words, a research design is basically a blueprint for getting from the beginning to the end of a study. The beginning is an initial set of questions to be answered, and the end is some set of conclusions about those questions.

Because case studies are conducted on topics as diverse as Anglo-Saxon Literature (Thrane 1986) and AIDS prevention (Van Vugt 1994), it is virtually impossible to outline any strict or universal method or design for conducting the case study. However, Robert K. Yin (1993) does offer five basic components of a research design:

• A study's questions.
• A study's propositions (if any).
• A study's units of analysis.
• The logic that links the data to the propositions.
• The criteria for interpreting the findings.

In addition to these five basic components, Yin also stresses the importance of clearly articulating one's theoretical perspective, determining the goals of the study, selecting one's subject(s), selecting the appropriate method(s) of collecting data, and providing some considerations to the composition of the final report.

Conducting Case Studies

To obtain as complete a picture of the participant as possible, case study researchers can employ a variety of approaches and methods. These approaches, methods, and related issues are discussed in depth in this section.

Method: Single or Multi-modal?

To obtain as complete a picture of the participant as possible, case study researchers can employ a variety of methods. Some common methods include interviews , protocol analyses, field studies, and participant-observations. Emig (1971) chose to use several methods of data collection. Her sources included conversations with the students, protocol analysis, discrete observations of actual composition, writing samples from each student, and school records (Lauer and Asher 1988).

Berkenkotter, Huckin, and Ackerman (1988) collected data by observing classrooms, conducting faculty and student interviews, collecting self reports from the subject, and by looking at the subject's written work.

A study that was criticized for using a single method model was done by Flower and Hayes (1984). In this study that explores the ways in which writers use different forms of knowing to create space, the authors used only protocol analysis to gather data. The study came under heavy fire because of their decision to use only one method.

Participant Selection

Case studies can use one participant, or a small group of participants. However, it is important that the participant pool remain relatively small. The participants can represent a diverse cross section of society, but this isn't necessary.

For example, the Berkenkotter, Huckin, and Ackerman (1988) study looked at just one participant, Nate. By contrast, in Janet Emig's (1971) study of the composition process of twelfth graders, eight participants were selected representing a diverse cross section of the community, with volunteers from an all-white upper-middle-class suburban school, an all-black inner-city school, a racially mixed lower-middle-class school, an economically and racially mixed school, and a university school.

Often, a brief "case history" is done on the participants of the study in order to provide researchers with a clearer understanding of their participants, as well as some insight as to how their own personal histories might affect the outcome of the study. For instance, in Emig's study, the investigator had access to the school records of five of the participants, and to standardized test scores for the remaining three. Also made available to the researcher was the information that three of the eight students were selected as NCTE Achievement Award winners. These personal histories can be useful in later stages of the study when data are being analyzed and conclusions drawn.

Data Collection

There are six types of data collected in case studies:

• Archival records.
• Interviews.
• Direct observation.
• Participant observation.

In the field of composition research, these six sources might be:

• A writer's drafts.
• School records of student writers.
• Transcripts of interviews with a writer.
• Transcripts of conversations between writers (and protocols).
• Videotapes and notes from direct field observations.
• Hard copies of a writer's work on computer.

Depending on whether researchers have chosen to use a single or multi-modal approach for the case study, they may choose to collect data from one or any combination of these sources.

Protocols, that is, transcriptions of participants talking aloud about what they are doing as they do it, have been particularly common in composition case studies. For example, in Emig's (1971) study, the students were asked, in four different sessions, to give oral autobiographies of their writing experiences and to compose aloud three themes in the presence of a tape recorder and the investigator.

In some studies, only one method of data collection is conducted. For example, the Flower and Hayes (1981) report on the cognitive process theory of writing depends on protocol analysis alone. However, using multiple sources of evidence to increase the reliability and validity of the data can be advantageous.

Case studies are likely to be much more convincing and accurate if they are based on several different sources of information, following a corroborating mode. This conclusion is echoed among many composition researchers. For example, in her study of predrafting processes of high and low-apprehensive writers, Cynthia Selfe (1985) argues that because "methods of indirect observation provide only an incomplete reflection of the complex set of processes involved in composing, a combination of several such methods should be used to gather data in any one study." Thus, in this study, Selfe collected her data from protocols, observations of students role playing their writing processes, audio taped interviews with the students, and videotaped observations of the students in the process of composing.

It can be said then, that cross checking data from multiple sources can help provide a multidimensional profile of composing activities in a particular setting. Sharan Merriam (1985) suggests "checking, verifying, testing, probing, and confirming collected data as you go, arguing that this process will follow in a funnel-like design resulting in less data gathering in later phases of the study along with a congruent increase in analysis checking, verifying, and confirming."

It is important to note that in case studies, as in any qualitative descriptive research, while researchers begin their studies with one or several questions driving the inquiry (which influence the key factors the researcher will be looking for during data collection), a researcher may find new key factors emerging during data collection. These might be unexpected patterns or linguistic features which become evident only during the course of the research. While not bearing directly on the researcher's guiding questions, these variables may become the basis for new questions asked at the end of the report, thus linking to the possibility of further research.

Data Analysis

As the information is collected, researchers strive to make sense of their data. Generally, researchers interpret their data in one of two ways: holistically or through coding. Holistic analysis does not attempt to break the evidence into parts, but rather to draw conclusions based on the text as a whole. Flower and Hayes (1981), for example, make inferences from entire sections of their students' protocols, rather than searching through the transcripts to look for isolatable characteristics.

However, composition researchers commonly interpret their data by coding, that is by systematically searching data to identify and/or categorize specific observable actions or characteristics. These observable actions then become the key variables in the study. Sharan Merriam (1988) suggests seven analytic frameworks for the organization and presentation of data:

• The role of participants.
• The network analysis of formal and informal exchanges among groups.
• Historical.
• Thematical.
• Ritual and symbolism.
• Critical incidents that challenge or reinforce fundamental beliefs, practices, and values.

There are two purposes of these frameworks: to look for patterns among the data and to look for patterns that give meaning to the case study.

As stated above, while most researchers begin their case studies expecting to look for particular observable characteristics, it is not unusual for key variables to emerge during data collection. Typical variables coded in case studies of writers include pauses writers make in the production of a text, the use of specific linguistic units (such as nouns or verbs), and writing processes (planning, drafting, revising, and editing). In the Berkenkotter, Huckin, and Ackerman (1988) study, for example, researchers coded the participant's texts for use of connectives, discourse demonstratives, average sentence length, off-register words, use of the first person pronoun, and the ratio of definite articles to indefinite articles.

Since coding is inherently subjective, more than one coder is usually employed. In the Berkenkotter, Huckin, and Ackerman (1988) study, for example, three rhetoricians were employed to code the participant's texts for off-register phrases. The researchers established the agreement among the coders before concluding that the participant used fewer off-register words as the graduate program progressed.

Composing the Case Study Report

In the many forms it can take, "a case study is generically a story; it presents the concrete narrative detail of actual, or at least realistic events, it has a plot, exposition, characters, and sometimes even dialogue" (Boehrer 1990). Generally, case study reports are extensively descriptive, with "the most problematic issue often referred to as being the determination of the right combination of description and analysis" (1990). Typically, authors address each step of the research process, and attempt to give the reader as much context as possible for the decisions made in the research design and for the conclusions drawn.

This contextualization usually includes a detailed explanation of the researchers' theoretical positions, of how those theories drove the inquiry or led to the guiding research questions, of the participants' backgrounds, of the processes of data collection, of the training and limitations of the coders, along with a strong attempt to make connections between the data and the conclusions evident.

Although the Berkenkotter, Huckin, and Ackerman (1988) study does not, case study reports often include the reactions of the participants to the study or to the researchers' conclusions. Because case studies tend to be exploratory, most end with implications for further study. Here researchers may identify significant variables that emerged during the research and suggest studies related to these, or the authors may suggest further general questions that their case study generated.

For example, Emig's (1971) study concludes with a section dedicated solely to the topic of implications for further research, in which she suggests several means by which this particular study could have been improved, as well as questions and ideas raised by this study which other researchers might like to address, such as: is there a correlation between a certain personality and a certain composing process profile (e.g. is there a positive correlation between ego strength and persistence in revising)?

Also included in Emig's study is a section dedicated to implications for teaching, which outlines the pedagogical ramifications of the study's findings for teachers currently involved in high school writing programs.

Sharan Merriam (1985) also offers several suggestions for alternative presentations of data:

• Prepare specialized condensations for appropriate groups.
• Replace narrative sections with a series of answers to open-ended questions.
• Present "skimmer's" summaries at beginning of each section.
• Incorporate headlines that encapsulate information from text.
• Prepare analytic summaries with supporting data appendixes.
• Present data in colorful and/or unique graphic representations.

Issues of Validity and Reliability

Once key variables have been identified, they can be analyzed. Reliability becomes a key concern at this stage, and many case study researchers go to great lengths to ensure that their interpretations of the data will be both reliable and valid. Because issues of validity and reliability are an important part of any study in the social sciences, it is important to identify some ways of dealing with results.

Multi-modal case study researchers often balance the results of their coding with data from interviews or writer's reflections upon their own work. Consequently, the researchers' conclusions become highly contextualized. For example, in a case study which looked at the time spent in different stages of the writing process, Berkenkotter concluded that her participant, Donald Murray, spent more time planning his essays than in other writing stages. The report of this case study is followed by Murray's reply, wherein he agrees with some of Berkenkotter's conclusions and disagrees with others.

As is the case with other research methodologies, issues of external validity, construct validity, and reliability need to be carefully considered.

Commentary on Case Studies

Researchers often debate the relative merits of particular methods, among them case study. In this section, we comment on two key issues. To read the commentaries, choose any of the items below:

Strengths and Weaknesses of Case Studies

Most case study advocates point out that case studies produce much more detailed information than what is available through a statistical analysis. Advocates will also hold that while statistical methods might be able to deal with situations where behavior is homogeneous and routine, case studies are needed to deal with creativity, innovation, and context. Detractors argue that case studies are difficult to generalize because of inherent subjectivity and because they are based on qualitative subjective data, generalizable only to a particular context.

Flexibility

The case study approach is a comparatively flexible method of scientific research. Because its project designs seem to emphasize exploration rather than prescription or prediction, researchers are comparatively freer to discover and address issues as they arise in their experiments. In addition, the looser format of case studies allows researchers to begin with broad questions and narrow their focus as their experiment progresses rather than attempt to predict every possible outcome before the experiment is conducted.

Emphasis on Context

By seeking to understand as much as possible about a single subject or small group of subjects, case studies specialize in "deep data," or "thick description"--information based on particular contexts that can give research results a more human face. This emphasis can help bridge the gap between abstract research and concrete practice by allowing researchers to compare their firsthand observations with the quantitative results obtained through other methods of research.

Inherent Subjectivity

"The case study has long been stereotyped as the weak sibling among social science methods," and is often criticized as being too subjective and even pseudo-scientific. Likewise, "investigators who do case studies are often regarded as having deviated from their academic disciplines, and their investigations as having insufficient precision (that is, quantification), objectivity and rigor" (Yin 1989). Opponents cite opportunities for subjectivity in the implementation, presentation, and evaluation of case study research. The approach relies on personal interpretation of data and inferences. Results may not be generalizable, are difficult to test for validity, and rarely offer a problem-solving prescription. Simply put, relying on one or a few subjects as a basis for cognitive extrapolations runs the risk of inferring too much from what might be circumstance.

High Investment

Case studies can involve learning more about the subjects being tested than most researchers would care to know--their educational background, emotional background, perceptions of themselves and their surroundings, their likes, dislikes, and so on. Because of its emphasis on "deep data," the case study is out of reach for many large-scale research projects which look at a subject pool in the tens of thousands. A budget request of $10,000 to examine 200 subjects sounds more efficient than a similar request to examine four subjects.

Ethical Considerations

Researchers conducting case studies should consider certain ethical issues. For example, many educational case studies are often financed by people who have, either directly or indirectly, power over both those being studied and those conducting the investigation (1985). This conflict of interests can hinder the credibility of the study.

The personal integrity, sensitivity, and possible prejudices and/or biases of the investigators need to be taken into consideration as well. Personal biases can creep into how the research is conducted, alternative research methods used, and the preparation of surveys and questionnaires.

A common complaint in case study research is that investigators change direction during the course of the study unaware that their original research design was inadequate for the revised investigation. Thus, the researchers leave unknown gaps and biases in the study. To avoid this, researchers should report preliminary findings so that the likelihood of bias will be reduced.

Concerns about Reliability, Validity, and Generalizability

Merriam (1985) offers several suggestions for how case study researchers might actively combat the popular attacks on the validity, reliability, and generalizability of case studies:

• Prolong the Processes of Data Gathering on Site: This will help to insure the accuracy of the findings by providing the researcher with more concrete information upon which to formulate interpretations.
• Employ the Process of "Triangulation": Use a variety of data sources as opposed to relying solely upon one avenue of observation. One example of such a data check would be what McClintock, Brannon, and Maynard (1985) refer to as a "case cluster method," that is, when a single unit within a larger case is randomly sampled, and that data treated quantitatively." For instance, in Emig's (1971) study, the case cluster method was employed, singling out the productivity of a single student named Lynn. This cluster profile included an advanced case history of the subject, specific examination and analysis of individual compositions and protocols, and extensive interview sessions. The seven remaining students were then compared with the case of Lynn, to ascertain if there are any shared, or unique dimensions to the composing process engaged in by these eight students.
• Conduct Member Checks: Initiate and maintain an active corroboration on the interpretation of data between the researcher and those who provided the data. In other words, talk to your subjects.
• Collect Referential Materials: Complement the file of materials from the actual site with additional document support. For example, Emig (1971) supports her initial propositions with historical accounts by writers such as T.S. Eliot, James Joyce, and D.H. Lawrence. Emig also cites examples of theoretical research done with regards to the creative process, as well as examples of empirical research dealing with the writing of adolescents. Specific attention is then given to the four stages description of the composing process delineated by Helmoltz, Wallas, and Cowley, as it serves as the focal point in this study.
• Engage in Peer Consultation: Prior to composing the final draft of the report, researchers should consult with colleagues in order to establish validity through pooled judgment.

Although little can be done to combat challenges concerning the generalizability of case studies, "most writers suggest that qualitative research should be judged as credible and confirmable as opposed to valid and reliable" (Merriam 1985). Likewise, it has been argued that "rather than transplanting statistical, quantitative notions of generalizability and thus finding qualitative research inadequate, it makes more sense to develop an understanding of generalization that is congruent with the basic characteristics of qualitative inquiry" (1985). After all, criticizing the case study method for being ungeneralizable is comparable to criticizing a washing machine for not being able to tell the correct time. In other words, it is unjust to criticize a method for not being able to do something which it was never originally designed to do in the first place.

Annotated Bibliography

Armisted, C. (1984). How Useful are Case Studies. Training and Development Journal, 38 (2), 75-77.

This article looks at eight types of case studies, offers pros and cons of using case studies in the classroom, and gives suggestions for successfully writing and using case studies.

Bardovi-Harlig, K. (1997). Beyond Methods: Components of Second Language Teacher Education . New York: McGraw-Hill.

A compilation of various research essays which address issues of language teacher education. Essays included are: "Non-native reading research and theory" by Lee, "The case for Psycholinguistics" by VanPatten, and "Assessment and Second Language Teaching" by Gradman and Reed.

Bartlett, L. (1989). A Question of Good Judgment; Interpretation Theory and Qualitative Enquiry Address. 70th Annual Meeting of the American Educational Research Association. San Francisco.

Bartlett selected "quasi-historical" methodology, which focuses on the "truth" found in case records, as one that will provide "good judgments" in educational inquiry. He argues that although the method is not comprehensive, it can try to connect theory with practice.

Baydere, S. et. al. (1993). Multimedia conferencing as a tool for collaborative writing: a case study in Computer Supported Collaborative Writing. New York: Springer-Verlag.

The case study by Baydere et. al. is just one of the many essays in this book found in the series "Computer Supported Cooperative Work." Denley, Witefield and May explore similar issues in their essay, "A case study in task analysis for the design of a collaborative document production system."

Berkenkotter, C., Huckin, T., N., & Ackerman J. (1988). Conventions, Conversations, and the Writer: Case Study of a Student in a Rhetoric Ph.D. Program. Research in the Teaching of English, 22, 9-44.

The authors focused on how the writing of their subject, Nate or Ackerman, changed as he became more acquainted or familiar with his field's discourse community.

Berninger, V., W., and Gans, B., M. (1986). Language Profiles in Nonspeaking Individuals of Normal Intelligence with Severe Cerebral Palsy. Augmentative and Alternative Communication, 2, 45-50.

Argues that generalizations about language abilities in patients with severe cerebral palsy (CP) should be avoided. Standardized tests of different levels of processing oral language, of processing written language, and of producing written language were administered to 3 male participants (aged 9, 16, and 40 yrs).

Bockman, J., R., and Couture, B. (1984). The Case Method in Technical Communication: Theory and Models. Texas: Association of Teachers of Technical Writing.

Examines the study and teaching of technical writing, communication of technical information, and the case method in terms of those applications.

Boehrer, J. (1990). Teaching With Cases: Learning to Question. New Directions for Teaching and Learning, 42 41-57.

This article discusses the origins of the case method, looks at the question of what is a case, gives ideas about learning in case teaching, the purposes it can serve in the classroom, the ground rules for the case discussion, including the role of the question, and new directions for case teaching.

Bowman, W. R. (1993). Evaluating JTPA Programs for Economically Disadvantaged Adults: A Case Study of Utah and General Findings . Washington: National Commission for Employment Policy.

"To encourage state-level evaluations of JTPA, the Commission and the State of Utah co-sponsored this report on the effectiveness of JTPA Title II programs for adults in Utah. The technique used is non-experimental and the comparison group was selected from registrants with Utah's Employment Security. In a step-by-step approach, the report documents how non-experimental techniques can be applied and several specific technical issues can be addressed."

Boyce, A. (1993) The Case Study Approach for Pedagogists. Annual Meeting of the American Alliance for Health, Physical Education, Recreation and Dance. (Address). Washington DC.

This paper addresses how case studies 1) bridge the gap between teaching theory and application, 2) enable students to analyze problems and develop solutions for situations that will be encountered in the real world of teaching, and 3) helps students to evaluate the feasibility of alternatives and to understand the ramifications of a particular course of action.

Carson, J. (1993) The Case Study: Ideal Home of WAC Quantitative and Qualitative Data. Annual Meeting of the Conference on College Composition and Communication. (Address). San Diego.

"Increasingly, one of the most pressing questions for WAC advocates is how to keep [WAC] programs going in the face of numerous difficulties. Case histories offer the best chance for fashioning rhetorical arguments to keep WAC programs going because they offer the opportunity to provide a coherent narrative that contextualizes all documents and data, including what is generally considered scientific data. A case study of the WAC program, . . . at Robert Morris College in Pittsburgh demonstrates the advantages of this research method. Such studies are ideal homes for both naturalistic and positivistic data as well as both quantitative and qualitative information."

---. (1991). A Cognitive Process Theory of Writing. College Composition and Communication. 32. 365-87.

No abstract available.

Cromer, R. (1994) A Case Study of Dissociations Between Language and Cognition. Constraints on Language Acquisition: Studies of Atypical Children . Hillsdale: Lawrence Erlbaum Associates, 141-153.

Crossley, M. (1983) Case Study in Comparative and International Education: An Approach to Bridging the Theory-Practice Gap. Proceedings of the 11th Annual Conference of the Australian Comparative and International Education Society. Hamilton, NZ.

Case study research, as presented here, helps bridge the theory-practice gap in comparative and international research studies of education because it focuses on the practical, day-to-day context rather than on the national arena. The paper asserts that the case study method can be valuable at all levels of research, formation, and verification of theories in education.

Daillak, R., H., and Alkin, M., C. (1982). Qualitative Studies in Context: Reflections on the CSE Studies of Evaluation Use . California: EDRS

The report shows how the Center of the Study of Evaluation (CSE) applied qualitative techniques to a study of evaluation information use in local, Los Angeles schools. It critiques the effectiveness and the limitations of using case study, evaluation, field study, and user interview survey methodologies.

Davey, L. (1991). The Application of Case Study Evaluations. ERIC/TM Digest.

This article examines six types of case studies, the type of evaluation questions that can be answered, the functions served, some design features, and some pitfalls of the method.

Deutch, C. E. (1996). A course in research ethics for graduate students. College Teaching, 44, 2, 56-60.

This article describes a one-credit discussion course in research ethics for graduate students in biology. Case studies are focused on within the four parts of the course: 1) major issues, 2 )practical issues in scholarly work, 3) ownership of research results, and 4) training and personal decisions.

DeVoss, G. (1981). Ethics in Fieldwork Research. RIE 27p. (ERIC)

This article examines four of the ethical problems that can happen when conducting case study research: acquiring permission to do research, knowing when to stop digging, the pitfalls of doing collaborative research, and preserving the integrity of the participants.

Driscoll, A. (1985). Case Study of a Research Intervention: the University of Utah’s Collaborative Approach . San Francisco: Far West Library for Educational Research Development.

Paper presented at the annual meeting of the American Association of Colleges of Teacher Education, Denver, CO, March 1985. Offers information of in-service training, specifically case studies application.

Ellram, L. M. (1996). The Use of the Case Study Method in Logistics Research. Journal of Business Logistics, 17, 2, 93.

This article discusses the increased use of case study in business research, and the lack of understanding of when and how to use case study methodology in business.

Emig, J. (1971) The Composing Processes of Twelfth Graders . Urbana: NTCE.

This case study uses observation, tape recordings, writing samples, and school records to show that writing in reflexive and extensive situations caused different lengths of discourse and different clusterings of the components of the writing process.

Feagin, J. R. (1991). A Case For the Case Study . Chapel Hill: The University of North Carolina Press.

This book discusses the nature, characteristics, and basic methodological issues of the case study as a research method.

Feldman, H., Holland, A., & Keefe, K. (1989) Language Abilities after Left Hemisphere Brain Injury: A Case Study of Twins. Topics in Early Childhood Special Education, 9, 32-47.

"Describes the language abilities of 2 twin pairs in which 1 twin (the experimental) suffered brain injury to the left cerebral hemisphere around the time of birth and1 twin (the control) did not. One pair of twins was initially assessed at age 23 mo. and the other at about 30 mo.; they were subsequently evaluated in their homes 3 times at about 6-mo intervals."

Fidel, R. (1984). The Case Study Method: A Case Study. Library and Information Science Research, 6.

The article describes the use of case study methodology to systematically develop a model of online searching behavior in which study design is flexible, subject manner determines data gathering and analyses, and procedures adapt to the study's progressive change.

Flower, L., & Hayes, J. R. (1984). Images, Plans and Prose: The Representation of Meaning in Writing. Written Communication, 1, 120-160.

Explores the ways in which writers actually use different forms of knowing to create prose.

Frey, L. R. (1992). Interpreting Communication Research: A Case Study Approach Englewood Cliffs, N.J.: Prentice Hall.

The book discusses research methodologies in the Communication field. It focuses on how case studies bridge the gap between communication research, theory, and practice.

Gilbert, V. K. (1981). The Case Study as a Research Methodology: Difficulties and Advantages of Integrating the Positivistic, Phenomenological and Grounded Theory Approaches . The Annual Meeting of the Canadian Association for the Study of Educational Administration. (Address) Halifax, NS, Can.

This study on an innovative secondary school in England shows how a "low-profile" participant-observer case study was crucial to the initial observation, the testing of hypotheses, the interpretive approach, and the grounded theory.

Gilgun, J. F. (1994). A Case for Case Studies in Social Work Research. Social Work, 39, 4, 371-381.

This article defines case study research, presents guidelines for evaluation of case studies, and shows the relevance of case studies to social work research. It also looks at issues such as evaluation and interpretations of case studies.

Glennan, S. L., Sharp-Bittner, M. A. & Tullos, D. C. (1991). Augmentative and Alternative Communication Training with a Nonspeaking Adult: Lessons from MH. Augmentative and Alternative Communication, 7, 240-7.

"A response-guided case study documented changes in a nonspeaking 36-yr-old man's ability to communicate using 3 trained augmentative communication modes. . . . Data were collected in videotaped interaction sessions between the nonspeaking adult and a series of adult speaking."

Graves, D. (1981). An Examination of the Writing Processes of Seven Year Old Children. Research in the Teaching of English, 15, 113-134.

Hamel, J. (1993). Case Study Methods . Newbury Park: Sage. .

"In a most economical fashion, Hamel provides a practical guide for producing theoretically sharp and empirically sound sociological case studies. A central idea put forth by Hamel is that case studies must "locate the global in the local" thus making the careful selection of the research site the most critical decision in the analytic process."

Karthigesu, R. (1986, July). Television as a Tool for Nation-Building in the Third World: A Post-Colonial Pattern, Using Malaysia as a Case-Study. International Television Studies Conference. (Address). London, 10-12.

"The extent to which Television Malaysia, as a national mass media organization, has been able to play a role in nation building in the post-colonial period is . . . studied in two parts: how the choice of a model of nation building determines the character of the organization; and how the character of the organization influences the output of the organization."

Kenny, R. (1984). Making the Case for the Case Study. Journal of Curriculum Studies, 16, (1), 37-51.

The article looks at how and why the case study is justified as a viable and valuable approach to educational research and program evaluation.

Knirk, F. (1991). Case Materials: Research and Practice. Performance Improvement Quarterly, 4 (1 ), 73-81.

The article addresses the effectiveness of case studies, subject areas where case studies are commonly used, recent examples of their use, and case study design considerations.

Klos, D. (1976). Students as Case Writers. Teaching of Psychology, 3.2, 63-66.

This article reviews a course in which students gather data for an original case study of another person. The task requires the students to design the study, collect the data, write the narrative, and interpret the findings.

Leftwich, A. (1981). The Politics of Case Study: Problems of Innovation in University Education. Higher Education Review, 13.2, 38-64.

The article discusses the use of case studies as a teaching method. Emphasis is on the instructional materials, interdisciplinarity, and the complex relationships within the university that help or hinder the method.

Mabrito, M. (1991, Oct.). Electronic Mail as a Vehicle for Peer Response: Conversations of High and Low Apprehensive Writers. Written Communication, 509-32.

McCarthy, S., J. (1955). The Influence of Classroom Discourse on Student Texts: The Case of Ella . East Lansing: Institute for Research on Teaching.

A look at how students of color become marginalized within traditional classroom discourse. The essay follows the struggles of one black student: Ella.

Matsuhashi, A., ed. (1987). Writing in Real Time: Modeling Production Processes Norwood, NJ: Ablex Publishing Corporation.

Investigates how writers plan to produce discourse for different purposes to report, to generalize, and to persuade, as well as how writers plan for sentence level units of language. To learn about planning, an observational measure of pause time was used" (ERIC).

Merriam, S. B. (1985). The Case Study in Educational Research: A Review of Selected Literature. Journal of Educational Thought, 19.3, 204-17.

The article examines the characteristics of, philosophical assumptions underlying the case study, the mechanics of conducting a case study, and the concerns about the reliability, validity, and generalizability of the method.

---. (1988). Case Study Research in Education: A Qualitative Approach San Francisco: Jossey Bass.

Merry, S. E., & Milner, N. eds. (1993). The Possibility of Popular Justice: A Case Study of Community Mediation in the United States . Ann Arbor: U of Michigan.

". . . this volume presents a case study of one experiment in popular justice, the San Francisco Community Boards. This program has made an explicit claim to create an alternative justice, or new justice, in the midst of a society ordered by state law. The contributors to this volume explore the history and experience of the program and compare it to other versions of popular justice in the United States, Europe, and the Third World."

Merseth, K. K. (1991). The Case for Cases in Teacher Education. RIE. 42p. (ERIC).

This monograph argues that the case method of instruction offers unique potential for revitalizing the field of teacher education.

Michaels, S. (1987). Text and Context: A New Approach to the Study of Classroom Writing. Discourse Processes, 10, 321-346.

"This paper argues for and illustrates an approach to the study of writing that integrates ethnographic analysis of classroom interaction with linguistic analysis of written texts and teacher/student conversational exchanges. The approach is illustrated through a case study of writing in a single sixth grade classroom during a single writing assignment."

Milburn, G. (1995). Deciphering a Code or Unraveling a Riddle: A Case Study in the Application of a Humanistic Metaphor to the Reporting of Social Studies Teaching. Theory and Research in Education, 13.

This citation serves as an example of how case studies document learning procedures in a senior-level economics course.

Milley, J. E. (1979). An Investigation of Case Study as an Approach to Program Evaluation. 19th Annual Forum of the Association for Institutional Research. (Address). San Diego.

The case study method merged a narrative report focusing on the evaluator as participant-observer with document review, interview, content analysis, attitude questionnaire survey, and sociogram analysis. Milley argues that case study program evaluation has great potential for widespread use.

Minnis, J. R. (1985, Sept.). Ethnography, Case Study, Grounded Theory, and Distance Education Research. Distance Education, 6.2.

This article describes and defines the strengths and weaknesses of ethnography, case study, and grounded theory.

Nunan, D. (1992). Collaborative language learning and teaching . New York: Cambridge University Press.

Included in this series of essays is Peter Sturman’s "Team Teaching: a case study from Japan" and David Nunan’s own "Toward a collaborative approach to curriculum development: a case study."

Nystrand, M., ed. (1982). What Writers Know: The Language, Process, and Structure of Written Discourse . New York: Academic Press.

Owenby, P. H. (1992). Making Case Studies Come Alive. Training, 29, (1), 43-46. (ERIC)

This article provides tips for writing more effective case studies.

---. (1981). Pausing and Planning: The Tempo of Writer Discourse Production. Research in the Teaching of English, 15 (2),113-34.

Perl, S. (1979). The Composing Processes of Unskilled College Writers. Research in the Teaching of English, 13, 317-336.

"Summarizes a study of five unskilled college writers, focusing especially on one of the five, and discusses the findings in light of current pedagogical practice and research design."

Pilcher J. and A. Coffey. eds. (1996). Gender and Qualitative Research . Brookfield: Aldershot, Hants, England.

This book provides a series of essays which look at gender identity research, qualitative research and applications of case study to questions of gendered pedagogy.

Pirie, B. S. (1993). The Case of Morty: A Four Year Study. Gifted Education International, 9 (2), 105-109.

This case study describes a boy from kindergarten through third grade with above average intelligence but difficulty in learning to read, write, and spell.

Popkewitz, T. (1993). Changing Patterns of Power: Social Regulation and Teacher Education Reform. Albany: SUNY Press.

Popkewitz edits this series of essays that address case studies on educational change and the training of teachers. The essays vary in terms of discipline and scope. Also, several authors include case studies of educational practices in countries other than the United States.

---. (1984). The Predrafting Processes of Four High- and Four Low Apprehensive Writers. Research in the Teaching of English, 18, (1), 45-64.

Rasmussen, P. (1985, March) A Case Study on the Evaluation of Research at the Technical University of Denmark. International Journal of Institutional Management in Higher Education, 9 (1).

This is an example of a case study methodology used to evaluate the chemistry and chemical engineering departments at the University of Denmark.

Roth, K. J. (1986). Curriculum Materials, Teacher Talk, and Student Learning: Case Studies in Fifth-Grade Science Teaching . East Lansing: Institute for Research on Teaching.

Roth offers case studies on elementary teachers, elementary school teaching, science studies and teaching, and verbal learning.

Selfe, C. L. (1985). An Apprehensive Writer Composes. When a Writer Can't Write: Studies in Writer's Block and Other Composing-Process Problems . (pp. 83-95). Ed. Mike Rose. NMY: Guilford.

Smith-Lewis, M., R. and Ford, A. (1987). A User's Perspective on Augmentative Communication. Augmentative and Alternative Communication, 3, 12-7.

"During a series of in-depth interviews, a 25-yr-old woman with cerebral palsy who utilized augmentative communication reflected on the effectiveness of the devices designed for her during her school career."

St. Pierre, R., G. (1980, April). Follow Through: A Case Study in Metaevaluation Research . 64th Annual Meeting of the American Educational Research Association. (Address).

The three approaches to metaevaluation are evaluation of primary evaluations, integrative meta-analysis with combined primary evaluation results, and re-analysis of the raw data from a primary evaluation.

Stahler, T., M. (1996, Feb.) Early Field Experiences: A Model That Worked. ERIC.

"This case study of a field and theory class examines a model designed to provide meaningful field experiences for preservice teachers while remaining consistent with the instructor's beliefs about the role of teacher education in preparing teachers for the classroom."

Stake, R. E. (1995). The Art of Case Study Research. Thousand Oaks: Sage Publications.

This book examines case study research in education and case study methodology.

Stiegelbauer, S. (1984) Community, Context, and Co-curriculum: Situational Factors Influencing School Improvements in a Study of High Schools. Presented at the annual meeting of the American Educational Research Association, New Orleans, LA.

Discussion of several case studies: one looking at high school environments, another examining educational innovations.

Stolovitch, H. (1990). Case Study Method. Performance And Instruction, 29, (9), 35-37.

This article describes the case study method as a form of simulation and presents guidelines for their use in professional training situations.

Thaller, E. (1994). Bibliography for the Case Method: Using Case Studies in Teacher Education. RIE. 37 p.

This bibliography presents approximately 450 citations on the use of case studies in teacher education from 1921-1993.

Thrane, T. (1986). On Delimiting the Senses of Near-Synonyms in Historical Semantics: A Case Study of Adjectives of 'Moral Sufficiency' in the Old English Andreas. Linguistics Across Historical and Geographical Boundaries: In Honor of Jacek Fisiak on the Occasion of his Fiftieth Birthday . Berlin: Mouton de Gruyter.

United Nations. (1975). Food and Agriculture Organization. Report on the FAO/UNFPA Seminar on Methodology, Research and Country: Case Studies on Population, Employment and Productivity . Rome: United Nations.

This example case study shows how the methodology can be used in a demographic and psychographic evaluation. At the same time, it discusses the formation and instigation of the case study methodology itself.

Van Vugt, J. P., ed. (1994). Aids Prevention and Services: Community Based Research . Westport: Bergin and Garvey.

"This volume has been five years in the making. In the process, some of the policy applications called for have met with limited success, such as free needle exchange programs in a limited number of American cities, providing condoms to prison inmates, and advertisements that depict same-sex couples. Rather than dating our chapters that deal with such subjects, such policy applications are verifications of the type of research demonstrated here. Furthermore, they indicate the critical need to continue community based research in the various communities threatened by acquired immuno-deficiency syndrome (AIDS) . . . "

Welch, W., ed. (1981, May). Case Study Methodology in Educational Evaluation. Proceedings of the Minnesota Evaluation Conference. Minnesota. (Address).

The four papers in these proceedings provide a comprehensive picture of the rationale, methodology, strengths, and limitations of case studies.

Williams, G. (1987). The Case Method: An Approach to Teaching and Learning in Educational Administration. RIE, 31p.

This paper examines the viability of the case method as a teaching and learning strategy in instructional systems geared toward the training of personnel of the administration of various aspects of educational systems.

Yin, R. K. (1993). Advancing Rigorous Methodologies: A Review of 'Towards Rigor in Reviews of Multivocal Literatures.' Review of Educational Research, 61, (3).

"R. T. Ogawa and B. Malen's article does not meet its own recommended standards for rigorous testing and presentation of its own conclusions. Use of the exploratory case study to analyze multivocal literatures is not supported, and the claim of grounded theory to analyze multivocal literatures may be stronger."

---. (1989). Case Study Research: Design and Methods. London: Sage Publications Inc.

This book discusses in great detail, the entire design process of the case study, including entire chapters on collecting evidence, analyzing evidence, composing the case study report, and designing single and multiple case studies.

Related Links

Consider the following list of related Web sites for more information on the topic of case study research. Note: although many of the links cover the general category of qualitative research, all have sections that address issues of case studies.

• Sage Publications on Qualitative Methodology: Search here for a comprehensive list of new books being published about "Qualitative Methodology" http://www.sagepub.co.uk/
• The International Journal of Qualitative Studies in Education: An on-line journal "to enhance the theory and practice of qualitative research in education." On-line submissions are welcome. http://www.tandf.co.uk/journals/tf/09518398.html
• Qualitative Research Resources on the Internet: From syllabi to home pages to bibliographies. All links relate somehow to qualitative research. http://www.nova.edu/ssss/QR/qualres.html

Becker, Bronwyn, Patrick Dawson, Karen Devine, Carla Hannum, Steve Hill, Jon Leydens, Debbie Matuskevich, Carol Traver, & Mike Palmquist. (2005). Case Studies. Writing@CSU . Colorado State University. https://writing.colostate.edu/guides/guide.cfm?guideid=60

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

• Advanced Search
• Journal List
• Sage Choice

Continuing to enhance the quality of case study methodology in health services research

Shannon l. sibbald.

1 Faculty of Health Sciences, Western University, London, Ontario, Canada.

2 Department of Family Medicine, Schulich School of Medicine and Dentistry, Western University, London, Ontario, Canada.

3 The Schulich Interfaculty Program in Public Health, Schulich School of Medicine and Dentistry, Western University, London, Ontario, Canada.

Stefan Paciocco

Meghan fournie, rachelle van asseldonk, tiffany scurr.

Case study methodology has grown in popularity within Health Services Research (HSR). However, its use and merit as a methodology are frequently criticized due to its flexible approach and inconsistent application. Nevertheless, case study methodology is well suited to HSR because it can track and examine complex relationships, contexts, and systems as they evolve. Applied appropriately, it can help generate information on how multiple forms of knowledge come together to inform decision-making within healthcare contexts. In this article, we aim to demystify case study methodology by outlining its philosophical underpinnings and three foundational approaches. We provide literature-based guidance to decision-makers, policy-makers, and health leaders on how to engage in and critically appraise case study design. We advocate that researchers work in collaboration with health leaders to detail their research process with an aim of strengthening the validity and integrity of case study for its continued and advanced use in HSR.

Introduction

The popularity of case study research methodology in Health Services Research (HSR) has grown over the past 40 years. 1 This may be attributed to a shift towards the use of implementation research and a newfound appreciation of contextual factors affecting the uptake of evidence-based interventions within diverse settings. 2 Incorporating context-specific information on the delivery and implementation of programs can increase the likelihood of success. 3 , 4 Case study methodology is particularly well suited for implementation research in health services because it can provide insight into the nuances of diverse contexts. 5 , 6 In 1999, Yin 7 published a paper on how to enhance the quality of case study in HSR, which was foundational for the emergence of case study in this field. Yin 7 maintains case study is an appropriate methodology in HSR because health systems are constantly evolving, and the multiple affiliations and diverse motivations are difficult to track and understand with traditional linear methodologies.

Despite its increased popularity, there is debate whether a case study is a methodology (ie, a principle or process that guides research) or a method (ie, a tool to answer research questions). Some criticize case study for its high level of flexibility, perceiving it as less rigorous, and maintain that it generates inadequate results. 8 Others have noted issues with quality and consistency in how case studies are conducted and reported. 9 Reporting is often varied and inconsistent, using a mix of approaches such as case reports, case findings, and/or case study. Authors sometimes use incongruent methods of data collection and analysis or use the case study as a default when other methodologies do not fit. 9 , 10 Despite these criticisms, case study methodology is becoming more common as a viable approach for HSR. 11 An abundance of articles and textbooks are available to guide researchers through case study research, including field-specific resources for business, 12 , 13 nursing, 14 and family medicine. 15 However, there remains confusion and a lack of clarity on the key tenets of case study methodology.

Several common philosophical underpinnings have contributed to the development of case study research 1 which has led to different approaches to planning, data collection, and analysis. This presents challenges in assessing quality and rigour for researchers conducting case studies and stakeholders reading results.

This article discusses the various approaches and philosophical underpinnings to case study methodology. Our goal is to explain it in a way that provides guidance for decision-makers, policy-makers, and health leaders on how to understand, critically appraise, and engage in case study research and design, as such guidance is largely absent in the literature. This article is by no means exhaustive or authoritative. Instead, we aim to provide guidance and encourage dialogue around case study methodology, facilitating critical thinking around the variety of approaches and ways quality and rigour can be bolstered for its use within HSR.

Purpose of case study methodology

Case study methodology is often used to develop an in-depth, holistic understanding of a specific phenomenon within a specified context. 11 It focuses on studying one or multiple cases over time and uses an in-depth analysis of multiple information sources. 16 , 17 It is ideal for situations including, but not limited to, exploring under-researched and real-life phenomena, 18 especially when the contexts are complex and the researcher has little control over the phenomena. 19 , 20 Case studies can be useful when researchers want to understand how interventions are implemented in different contexts, and how context shapes the phenomenon of interest.

In addition to demonstrating coherency with the type of questions case study is suited to answer, there are four key tenets to case study methodologies: (1) be transparent in the paradigmatic and theoretical perspectives influencing study design; (2) clearly define the case and phenomenon of interest; (3) clearly define and justify the type of case study design; and (4) use multiple data collection sources and analysis methods to present the findings in ways that are consistent with the methodology and the study’s paradigmatic base. 9 , 16 The goal is to appropriately match the methods to empirical questions and issues and not to universally advocate any single approach for all problems. 21

Approaches to case study methodology

Three authors propose distinct foundational approaches to case study methodology positioned within different paradigms: Yin, 19 , 22 Stake, 5 , 23 and Merriam 24 , 25 ( Table 1 ). Yin is strongly post-positivist whereas Stake and Merriam are grounded in a constructivist paradigm. Researchers should locate their research within a paradigm that explains the philosophies guiding their research 26 and adhere to the underlying paradigmatic assumptions and key tenets of the appropriate author’s methodology. This will enhance the consistency and coherency of the methods and findings. However, researchers often do not report their paradigmatic position, nor do they adhere to one approach. 9 Although deliberately blending methodologies may be defensible and methodologically appropriate, more often it is done in an ad hoc and haphazard way, without consideration for limitations.

Cross-analysis of three case study approaches, adapted from Yazan 2015

Dimension of interest	Yin	Stake	Merriam
Case study design	Logical sequence = connecting empirical data to initial research question Four types: single holistic, single embedded, multiple holistic, multiple embedded	Flexible design = allow major changes to take place while the study is proceeding	Theoretical framework = literature review to mold research question and emphasis points
Case study paradigm	Positivism	Constructivism and existentialism	Constructivism
Components of study		“Progressive focusing” = “the course of the study cannot be charted in advance” (1998, p 22) Must have 2-3 research questions to structure the study
Collecting data	Quantitative and qualitative evidentiary influenced by:	Qualitative data influenced by:	Qualitative data research must have necessary skills and follow certain procedures to:
Data collection techniques
Data analysis	Use both quantitative and qualitative techniques to answer research question	Use researcher’s intuition and impression as a guiding factor for analysis	“it is the process of making meaning” (1998, p 178)
Validating data		Use triangulation	Increase internal validity Ensure reliability and increase external validity

The post-positive paradigm postulates there is one reality that can be objectively described and understood by “bracketing” oneself from the research to remove prejudice or bias. 27 Yin focuses on general explanation and prediction, emphasizing the formulation of propositions, akin to hypothesis testing. This approach is best suited for structured and objective data collection 9 , 11 and is often used for mixed-method studies.

Constructivism assumes that the phenomenon of interest is constructed and influenced by local contexts, including the interaction between researchers, individuals, and their environment. 27 It acknowledges multiple interpretations of reality 24 constructed within the context by the researcher and participants which are unlikely to be replicated, should either change. 5 , 20 Stake and Merriam’s constructivist approaches emphasize a story-like rendering of a problem and an iterative process of constructing the case study. 7 This stance values researcher reflexivity and transparency, 28 acknowledging how researchers’ experiences and disciplinary lenses influence their assumptions and beliefs about the nature of the phenomenon and development of the findings.

Defining a case

A key tenet of case study methodology often underemphasized in literature is the importance of defining the case and phenomenon. Researches should clearly describe the case with sufficient detail to allow readers to fully understand the setting and context and determine applicability. Trying to answer a question that is too broad often leads to an unclear definition of the case and phenomenon. 20 Cases should therefore be bound by time and place to ensure rigor and feasibility. 6

Yin 22 defines a case as “a contemporary phenomenon within its real-life context,” (p13) which may contain a single unit of analysis, including individuals, programs, corporations, or clinics 29 (holistic), or be broken into sub-units of analysis, such as projects, meetings, roles, or locations within the case (embedded). 30 Merriam 24 and Stake 5 similarly define a case as a single unit studied within a bounded system. Stake 5 , 23 suggests bounding cases by contexts and experiences where the phenomenon of interest can be a program, process, or experience. However, the line between the case and phenomenon can become muddy. For guidance, Stake 5 , 23 describes the case as the noun or entity and the phenomenon of interest as the verb, functioning, or activity of the case.

Designing the case study approach

Yin’s approach to a case study is rooted in a formal proposition or theory which guides the case and is used to test the outcome. 1 Stake 5 advocates for a flexible design and explicitly states that data collection and analysis may commence at any point. Merriam’s 24 approach blends both Yin and Stake’s, allowing the necessary flexibility in data collection and analysis to meet the needs.

Yin 30 proposed three types of case study approaches—descriptive, explanatory, and exploratory. Each can be designed around single or multiple cases, creating six basic case study methodologies. Descriptive studies provide a rich description of the phenomenon within its context, which can be helpful in developing theories. To test a theory or determine cause and effect relationships, researchers can use an explanatory design. An exploratory model is typically used in the pilot-test phase to develop propositions (eg, Sibbald et al. 31 used this approach to explore interprofessional network complexity). Despite having distinct characteristics, the boundaries between case study types are flexible with significant overlap. 30 Each has five key components: (1) research question; (2) proposition; (3) unit of analysis; (4) logical linking that connects the theory with proposition; and (5) criteria for analyzing findings.

Contrary to Yin, Stake 5 believes the research process cannot be planned in its entirety because research evolves as it is performed. Consequently, researchers can adjust the design of their methods even after data collection has begun. Stake 5 classifies case studies into three categories: intrinsic, instrumental, and collective/multiple. Intrinsic case studies focus on gaining a better understanding of the case. These are often undertaken when the researcher has an interest in a specific case. Instrumental case study is used when the case itself is not of the utmost importance, and the issue or phenomenon (ie, the research question) being explored becomes the focus instead (eg, Paciocco 32 used an instrumental case study to evaluate the implementation of a chronic disease management program). 5 Collective designs are rooted in an instrumental case study and include multiple cases to gain an in-depth understanding of the complexity and particularity of a phenomenon across diverse contexts. 5 , 23 In collective designs, studying similarities and differences between the cases allows the phenomenon to be understood more intimately (for examples of this in the field, see van Zelm et al. 33 and Burrows et al. 34 In addition, Sibbald et al. 35 present an example where a cross-case analysis method is used to compare instrumental cases).

Merriam’s approach is flexible (similar to Stake) as well as stepwise and linear (similar to Yin). She advocates for conducting a literature review before designing the study to better understand the theoretical underpinnings. 24 , 25 Unlike Stake or Yin, Merriam proposes a step-by-step guide for researchers to design a case study. These steps include performing a literature review, creating a theoretical framework, identifying the problem, creating and refining the research question(s), and selecting a study sample that fits the question(s). 24 , 25 , 36

Data collection and analysis

Using multiple data collection methods is a key characteristic of all case study methodology; it enhances the credibility of the findings by allowing different facets and views of the phenomenon to be explored. 23 Common methods include interviews, focus groups, observation, and document analysis. 5 , 37 By seeking patterns within and across data sources, a thick description of the case can be generated to support a greater understanding and interpretation of the whole phenomenon. 5 , 17 , 20 , 23 This technique is called triangulation and is used to explore cases with greater accuracy. 5 Although Stake 5 maintains case study is most often used in qualitative research, Yin 17 supports a mix of both quantitative and qualitative methods to triangulate data. This deliberate convergence of data sources (or mixed methods) allows researchers to find greater depth in their analysis and develop converging lines of inquiry. For example, case studies evaluating interventions commonly use qualitative interviews to describe the implementation process, barriers, and facilitators paired with a quantitative survey of comparative outcomes and effectiveness. 33 , 38 , 39

Yin 30 describes analysis as dependent on the chosen approach, whether it be (1) deductive and rely on theoretical propositions; (2) inductive and analyze data from the “ground up”; (3) organized to create a case description; or (4) used to examine plausible rival explanations. According to Yin’s 40 approach to descriptive case studies, carefully considering theory development is an important part of study design. “Theory” refers to field-relevant propositions, commonly agreed upon assumptions, or fully developed theories. 40 Stake 5 advocates for using the researcher’s intuition and impression to guide analysis through a categorical aggregation and direct interpretation. Merriam 24 uses six different methods to guide the “process of making meaning” (p178) : (1) ethnographic analysis; (2) narrative analysis; (3) phenomenological analysis; (4) constant comparative method; (5) content analysis; and (6) analytic induction.

Drawing upon a theoretical or conceptual framework to inform analysis improves the quality of case study and avoids the risk of description without meaning. 18 Using Stake’s 5 approach, researchers rely on protocols and previous knowledge to help make sense of new ideas; theory can guide the research and assist researchers in understanding how new information fits into existing knowledge.

Practical applications of case study research

Columbia University has recently demonstrated how case studies can help train future health leaders. 41 Case studies encompass components of systems thinking—considering connections and interactions between components of a system, alongside the implications and consequences of those relationships—to equip health leaders with tools to tackle global health issues. 41 Greenwood 42 evaluated Indigenous peoples’ relationship with the healthcare system in British Columbia and used a case study to challenge and educate health leaders across the country to enhance culturally sensitive health service environments.

An important but often omitted step in case study research is an assessment of quality and rigour. We recommend using a framework or set of criteria to assess the rigour of the qualitative research. Suitable resources include Caelli et al., 43 Houghten et al., 44 Ravenek and Rudman, 45 and Tracy. 46

New directions in case study

Although “pragmatic” case studies (ie, utilizing practical and applicable methods) have existed within psychotherapy for some time, 47 , 48 only recently has the applicability of pragmatism as an underlying paradigmatic perspective been considered in HSR. 49 This is marked by uptake of pragmatism in Randomized Control Trials, recognizing that “gold standard” testing conditions do not reflect the reality of clinical settings 50 , 51 nor do a handful of epistemologically guided methodologies suit every research inquiry.

Pragmatism positions the research question as the basis for methodological choices, rather than a theory or epistemology, allowing researchers to pursue the most practical approach to understanding a problem or discovering an actionable solution. 52 Mixed methods are commonly used to create a deeper understanding of the case through converging qualitative and quantitative data. 52 Pragmatic case study is suited to HSR because its flexibility throughout the research process accommodates complexity, ever-changing systems, and disruptions to research plans. 49 , 50 Much like case study, pragmatism has been criticized for its flexibility and use when other approaches are seemingly ill-fit. 53 , 54 Similarly, authors argue that this results from a lack of investigation and proper application rather than a reflection of validity, legitimizing the need for more exploration and conversation among researchers and practitioners. 55

Although occasionally misunderstood as a less rigourous research methodology, 8 case study research is highly flexible and allows for contextual nuances. 5 , 6 Its use is valuable when the researcher desires a thorough understanding of a phenomenon or case bound by context. 11 If needed, multiple similar cases can be studied simultaneously, or one case within another. 16 , 17 There are currently three main approaches to case study, 5 , 17 , 24 each with their own definitions of a case, ontological and epistemological paradigms, methodologies, and data collection and analysis procedures. 37

Individuals’ experiences within health systems are influenced heavily by contextual factors, participant experience, and intricate relationships between different organizations and actors. 55 Case study research is well suited for HSR because it can track and examine these complex relationships and systems as they evolve over time. 6 , 7 It is important that researchers and health leaders using this methodology understand its key tenets and how to conduct a proper case study. Although there are many examples of case study in action, they are often under-reported and, when reported, not rigorously conducted. 9 Thus, decision-makers and health leaders should use these examples with caution. The proper reporting of case studies is necessary to bolster their credibility in HSR literature and provide readers sufficient information to critically assess the methodology. We also call on health leaders who frequently use case studies 56 – 58 to report them in the primary research literature.

The purpose of this article is to advocate for the continued and advanced use of case study in HSR and to provide literature-based guidance for decision-makers, policy-makers, and health leaders on how to engage in, read, and interpret findings from case study research. As health systems progress and evolve, the application of case study research will continue to increase as researchers and health leaders aim to capture the inherent complexities, nuances, and contextual factors. 7

• Privacy Policy

Home » Case Study – Methods, Examples and Guide

Case Study – Methods, Examples and Guide

Table of Contents

A case study is a research method that involves an in-depth examination and analysis of a particular phenomenon or case, such as an individual, organization, community, event, or situation.

It is a qualitative research approach that aims to provide a detailed and comprehensive understanding of the case being studied. Case studies typically involve multiple sources of data, including interviews, observations, documents, and artifacts, which are analyzed using various techniques, such as content analysis, thematic analysis, and grounded theory. The findings of a case study are often used to develop theories, inform policy or practice, or generate new research questions.

Types of Case Study

Types and Methods of Case Study are as follows:

Single-Case Study

A single-case study is an in-depth analysis of a single case. This type of case study is useful when the researcher wants to understand a specific phenomenon in detail.

For Example , A researcher might conduct a single-case study on a particular individual to understand their experiences with a particular health condition or a specific organization to explore their management practices. The researcher collects data from multiple sources, such as interviews, observations, and documents, and uses various techniques to analyze the data, such as content analysis or thematic analysis. The findings of a single-case study are often used to generate new research questions, develop theories, or inform policy or practice.

Multiple-Case Study

A multiple-case study involves the analysis of several cases that are similar in nature. This type of case study is useful when the researcher wants to identify similarities and differences between the cases.

For Example, a researcher might conduct a multiple-case study on several companies to explore the factors that contribute to their success or failure. The researcher collects data from each case, compares and contrasts the findings, and uses various techniques to analyze the data, such as comparative analysis or pattern-matching. The findings of a multiple-case study can be used to develop theories, inform policy or practice, or generate new research questions.

Exploratory Case Study

An exploratory case study is used to explore a new or understudied phenomenon. This type of case study is useful when the researcher wants to generate hypotheses or theories about the phenomenon.

For Example, a researcher might conduct an exploratory case study on a new technology to understand its potential impact on society. The researcher collects data from multiple sources, such as interviews, observations, and documents, and uses various techniques to analyze the data, such as grounded theory or content analysis. The findings of an exploratory case study can be used to generate new research questions, develop theories, or inform policy or practice.

Descriptive Case Study

A descriptive case study is used to describe a particular phenomenon in detail. This type of case study is useful when the researcher wants to provide a comprehensive account of the phenomenon.

For Example, a researcher might conduct a descriptive case study on a particular community to understand its social and economic characteristics. The researcher collects data from multiple sources, such as interviews, observations, and documents, and uses various techniques to analyze the data, such as content analysis or thematic analysis. The findings of a descriptive case study can be used to inform policy or practice or generate new research questions.

Instrumental Case Study

An instrumental case study is used to understand a particular phenomenon that is instrumental in achieving a particular goal. This type of case study is useful when the researcher wants to understand the role of the phenomenon in achieving the goal.

For Example, a researcher might conduct an instrumental case study on a particular policy to understand its impact on achieving a particular goal, such as reducing poverty. The researcher collects data from multiple sources, such as interviews, observations, and documents, and uses various techniques to analyze the data, such as content analysis or thematic analysis. The findings of an instrumental case study can be used to inform policy or practice or generate new research questions.

Case Study Data Collection Methods

Here are some common data collection methods for case studies:

Interviews involve asking questions to individuals who have knowledge or experience relevant to the case study. Interviews can be structured (where the same questions are asked to all participants) or unstructured (where the interviewer follows up on the responses with further questions). Interviews can be conducted in person, over the phone, or through video conferencing.

Observations

Observations involve watching and recording the behavior and activities of individuals or groups relevant to the case study. Observations can be participant (where the researcher actively participates in the activities) or non-participant (where the researcher observes from a distance). Observations can be recorded using notes, audio or video recordings, or photographs.

Documents can be used as a source of information for case studies. Documents can include reports, memos, emails, letters, and other written materials related to the case study. Documents can be collected from the case study participants or from public sources.

Surveys involve asking a set of questions to a sample of individuals relevant to the case study. Surveys can be administered in person, over the phone, through mail or email, or online. Surveys can be used to gather information on attitudes, opinions, or behaviors related to the case study.

Artifacts are physical objects relevant to the case study. Artifacts can include tools, equipment, products, or other objects that provide insights into the case study phenomenon.

How to conduct Case Study Research

Conducting a case study research involves several steps that need to be followed to ensure the quality and rigor of the study. Here are the steps to conduct case study research:

• Define the research questions: The first step in conducting a case study research is to define the research questions. The research questions should be specific, measurable, and relevant to the case study phenomenon under investigation.
• Select the case: The next step is to select the case or cases to be studied. The case should be relevant to the research questions and should provide rich and diverse data that can be used to answer the research questions.
• Collect data: Data can be collected using various methods, such as interviews, observations, documents, surveys, and artifacts. The data collection method should be selected based on the research questions and the nature of the case study phenomenon.
• Analyze the data: The data collected from the case study should be analyzed using various techniques, such as content analysis, thematic analysis, or grounded theory. The analysis should be guided by the research questions and should aim to provide insights and conclusions relevant to the research questions.
• Draw conclusions: The conclusions drawn from the case study should be based on the data analysis and should be relevant to the research questions. The conclusions should be supported by evidence and should be clearly stated.
• Validate the findings: The findings of the case study should be validated by reviewing the data and the analysis with participants or other experts in the field. This helps to ensure the validity and reliability of the findings.
• Write the report: The final step is to write the report of the case study research. The report should provide a clear description of the case study phenomenon, the research questions, the data collection methods, the data analysis, the findings, and the conclusions. The report should be written in a clear and concise manner and should follow the guidelines for academic writing.

Examples of Case Study

Here are some examples of case study research:

• The Hawthorne Studies : Conducted between 1924 and 1932, the Hawthorne Studies were a series of case studies conducted by Elton Mayo and his colleagues to examine the impact of work environment on employee productivity. The studies were conducted at the Hawthorne Works plant of the Western Electric Company in Chicago and included interviews, observations, and experiments.
• The Stanford Prison Experiment: Conducted in 1971, the Stanford Prison Experiment was a case study conducted by Philip Zimbardo to examine the psychological effects of power and authority. The study involved simulating a prison environment and assigning participants to the role of guards or prisoners. The study was controversial due to the ethical issues it raised.
• The Challenger Disaster: The Challenger Disaster was a case study conducted to examine the causes of the Space Shuttle Challenger explosion in 1986. The study included interviews, observations, and analysis of data to identify the technical, organizational, and cultural factors that contributed to the disaster.
• The Enron Scandal: The Enron Scandal was a case study conducted to examine the causes of the Enron Corporation’s bankruptcy in 2001. The study included interviews, analysis of financial data, and review of documents to identify the accounting practices, corporate culture, and ethical issues that led to the company’s downfall.
• The Fukushima Nuclear Disaster : The Fukushima Nuclear Disaster was a case study conducted to examine the causes of the nuclear accident that occurred at the Fukushima Daiichi Nuclear Power Plant in Japan in 2011. The study included interviews, analysis of data, and review of documents to identify the technical, organizational, and cultural factors that contributed to the disaster.

Application of Case Study

Case studies have a wide range of applications across various fields and industries. Here are some examples:

Business and Management

Case studies are widely used in business and management to examine real-life situations and develop problem-solving skills. Case studies can help students and professionals to develop a deep understanding of business concepts, theories, and best practices.

Case studies are used in healthcare to examine patient care, treatment options, and outcomes. Case studies can help healthcare professionals to develop critical thinking skills, diagnose complex medical conditions, and develop effective treatment plans.

Case studies are used in education to examine teaching and learning practices. Case studies can help educators to develop effective teaching strategies, evaluate student progress, and identify areas for improvement.

Social Sciences

Case studies are widely used in social sciences to examine human behavior, social phenomena, and cultural practices. Case studies can help researchers to develop theories, test hypotheses, and gain insights into complex social issues.

Law and Ethics

Case studies are used in law and ethics to examine legal and ethical dilemmas. Case studies can help lawyers, policymakers, and ethical professionals to develop critical thinking skills, analyze complex cases, and make informed decisions.

Purpose of Case Study

The purpose of a case study is to provide a detailed analysis of a specific phenomenon, issue, or problem in its real-life context. A case study is a qualitative research method that involves the in-depth exploration and analysis of a particular case, which can be an individual, group, organization, event, or community.

The primary purpose of a case study is to generate a comprehensive and nuanced understanding of the case, including its history, context, and dynamics. Case studies can help researchers to identify and examine the underlying factors, processes, and mechanisms that contribute to the case and its outcomes. This can help to develop a more accurate and detailed understanding of the case, which can inform future research, practice, or policy.

Case studies can also serve other purposes, including:

• Illustrating a theory or concept: Case studies can be used to illustrate and explain theoretical concepts and frameworks, providing concrete examples of how they can be applied in real-life situations.
• Developing hypotheses: Case studies can help to generate hypotheses about the causal relationships between different factors and outcomes, which can be tested through further research.
• Providing insight into complex issues: Case studies can provide insights into complex and multifaceted issues, which may be difficult to understand through other research methods.
• Informing practice or policy: Case studies can be used to inform practice or policy by identifying best practices, lessons learned, or areas for improvement.

Advantages of Case Study Research

There are several advantages of case study research, including:

• In-depth exploration: Case study research allows for a detailed exploration and analysis of a specific phenomenon, issue, or problem in its real-life context. This can provide a comprehensive understanding of the case and its dynamics, which may not be possible through other research methods.
• Rich data: Case study research can generate rich and detailed data, including qualitative data such as interviews, observations, and documents. This can provide a nuanced understanding of the case and its complexity.
• Holistic perspective: Case study research allows for a holistic perspective of the case, taking into account the various factors, processes, and mechanisms that contribute to the case and its outcomes. This can help to develop a more accurate and comprehensive understanding of the case.
• Theory development: Case study research can help to develop and refine theories and concepts by providing empirical evidence and concrete examples of how they can be applied in real-life situations.
• Practical application: Case study research can inform practice or policy by identifying best practices, lessons learned, or areas for improvement.
• Contextualization: Case study research takes into account the specific context in which the case is situated, which can help to understand how the case is influenced by the social, cultural, and historical factors of its environment.

Limitations of Case Study Research

There are several limitations of case study research, including:

• Limited generalizability : Case studies are typically focused on a single case or a small number of cases, which limits the generalizability of the findings. The unique characteristics of the case may not be applicable to other contexts or populations, which may limit the external validity of the research.
• Biased sampling: Case studies may rely on purposive or convenience sampling, which can introduce bias into the sample selection process. This may limit the representativeness of the sample and the generalizability of the findings.
• Subjectivity: Case studies rely on the interpretation of the researcher, which can introduce subjectivity into the analysis. The researcher’s own biases, assumptions, and perspectives may influence the findings, which may limit the objectivity of the research.
• Limited control: Case studies are typically conducted in naturalistic settings, which limits the control that the researcher has over the environment and the variables being studied. This may limit the ability to establish causal relationships between variables.
• Time-consuming: Case studies can be time-consuming to conduct, as they typically involve a detailed exploration and analysis of a specific case. This may limit the feasibility of conducting multiple case studies or conducting case studies in a timely manner.
• Resource-intensive: Case studies may require significant resources, including time, funding, and expertise. This may limit the ability of researchers to conduct case studies in resource-constrained settings.

About the author

Muhammad Hassan

Researcher, Academic Writer, Web developer

You may also like

Qualitative Research Methods

Questionnaire – Definition, Types, and Examples

Phenomenology – Methods, Examples and Guide

Textual Analysis – Types, Examples and Guide

Experimental Design – Types, Methods, Guide

Focus Groups – Steps, Examples and Guide

-->

> > . This involves the researcher immersing him or herself in the daily lives and routines of those being studied.  This often requires extensive work in the setting being studied.  This is called fieldwork. Observation provides insight into the behavior patterns and social organizations that operate and constitute a particular bounded system or case. . Researchers will learn about the person or persons that are part of the case by speaking with these people.  Talking with informants is called interviewing.  The types of interviews conducted by researchers vary in degree of formality (informal interview to semi-structured to structured interviews). . Researchers may also learn about a bounded system by collecting and studying artifacts (e.g. written protocols, charts, flowsheets, educational handouts) - materials used by members of the system or case being studied.  - aimed at understanding a particular case because the case itself is of interest (e.g. how one person managed a stroke).  A case may be of interest because it has particular features or because it is ordinary. - aimed at providing insight into an issue or problem or to refine a theory.  In this instance, understanding the complexities of the case is secondary to understanding something else (e.g. case study of 'Sally' provides insights into the problems with healthcare in the US). - a number of cases are studies jointly in order to understand a phenomenon, population or general condition.  Often referred to as a multiple-case study (e.g. 15 primary care practices are studied as single but conjoined cases in order to understand how obesity is discussed in this setting). (2nd edition, pp. 293-312). Thousand Oaks, CA. Sage Publications. . PL Munhall (Ed.) pp. 359-384. Boston, MA: Jones and Bartlett Publishers. . San Francisco: Jossey-Bass. (2nd ed.) Newbury Park, CA: Sage Publications. (pp. 236-247). Thousand Oaks, Sage Publications. . Thousand Oaks, CA: Sage Publications. (2nd ed.). Newbury Park, CA: Sage Publications. to return to Common Research Traditions

	© RWJF 2008 P.O. Box 2316 College Road East and Route 1 Princeton, NJ 08543	-->Citation: Cohen D, Crabtree B. "Qualitative Research Guidelines Project." July 2006.

Enhancing the QUAlity and Transparency Of health Research

• Courses & events
• Librarian Network
• Search for reporting guidelines

Browse for reporting guidelines by selecting one or more of these drop-downs:

Displaying 52 reporting guidelines found.

Key reporting guidelines, shaded green, are displayed first. Show the most recently added records first .

• Standards for reporting qualitative research: a synthesis of recommendations
• Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ
• Consolidated criteria for reporting qualitative research (COREQ) : a 32-item checklist for interviews and focus groups
• Supporting best practice in reflexive thematic analysis reporting in Palliative Medicine: A review of published research and introduction to the Reflexive Thematic Analysis Reporting Guidelines (RTARG)
• The RETRIEVE Checklist for Studies Reporting the Elicitation of Stated Preferences for Child Health -Related Quality of Life
• Introducing So NHR-Reporting guidelines for Social Networks In Health Research
• ACCORD (ACcurate COnsensus Reporting Document): A reporting guideline for consensus methods in biomedicine developed via a modified Delphi
• Best practice guidelines for citizen science in mental health research: systematic review and evidence synthesis
• Improving the Reporting of Primary Care Research: Consensus Reporting Items for Studies in Primary Care-the CRISP Statement
• Initial Standardized Framework for Reporting Social Media Analytics in Emergency Care Research
• The adapted Autobiographical interview: A systematic review and proposal for conduct and reporting
• Development, explanation, and presentation of the Physical Literacy Interventions Reporting Template (PLIRT)
• Reporting guidelines for allergy and immunology survey research
• Preferred Reporting Items for Complex Sample Survey Analysis (PRICSSA)
• CONFERD-HP : recommendations for reporting COmpeteNcy FramEwoRk Development in health professions
• Development of the ASSESS tool: a comprehenSive tool to Support rEporting and critical appraiSal of qualitative, quantitative, and mixed methods implementation reSearch outcomes
• Guiding document analyses in health professions education research
• Social Accountability Reporting for Research (SAR 4Research): checklist to strengthen reporting on studies on social accountability in the literature
• Establishing reporting standards for participant characteristics in post-stroke aphasia research: An international e -Delphi exercise and consensus meeting
• Advising on Preferred Reporting Items for patient-reported outcome instrument development: the PRIPROID
• Recommendations for reporting the results of studies of instrument and scale development and testing
• The Do CTRINE Guidelines: Defined Criteria To Report INnovations in Education
• A scoping review of the use of ethnographic approaches in implementation research and recommendations for reporting
• Conceptual Ambiguity Surrounding Gamification and Serious Games in Health Care: Literature Review and Development of Game -Based Intervention Reporting Guidelines (GAMING)
• Six practical recommendations for improved implementation outcomes reporting
• Guidance for publishing qualitative research in informatics
• COSMIN reporting guideline for studies on measurement properties of patient-reported outcome measures
• Ensuring best practice in genomics education and evaluation: reporting item standards for education and its evaluation in genomics (RISE 2 Genomics)
• A Consensus -Based Checklist for Reporting of Survey Studies (CROSS)
• Journal article reporting standards for qualitative primary, qualitative meta-analytic, and mixed methods research in psychology: The APA Publications and Communications Board task force report
• Stakeholder analysis in health innovation planning processes: A systematic scoping review
• Pa CIR : A tool to enhance pharmacist patient care intervention reporting
• Criteria for describing and evaluating training interventions in healthcare professions – CRe-DEPTH
• Consolidated criteria for strengthening reporting of health research involving indigenous peoples: the CONSIDER statement
• Improving reporting of Meta -Ethnography : The e MERGe Reporting Guidance
• Reporting guidelines for implementation research on nurturing care interventions designed to promote early childhood development
• Standards for UNiversal reporting of patient Decision Aid Evaluation studies: the development of SUNDAE Checklist
• GRIPP 2 reporting checklists: tools to improve reporting of patient and public involvement in research
• Standards for Reporting Implementation Studies (StaRI) Statement
• Using theory of change to design and evaluate public health interventions: a systematic review
• RAMESES II reporting standards for realist evaluations
• Developing a methodological framework for organisational case studies: a rapid review and consensus development process
• A checklist to improve reporting of group-based behaviour-change interventions
• A reporting guide for studies on individual differences in traffic safety
• A consensus approach toward the standardization of back pain definitions for use in prevalence studies
• Minimum data elements for research reports on CFS
• Qualitative research review guidelines – RATS
• Evolving guidelines for publication of qualitative research studies in psychology and related fields
• Revealing the wood and the trees: reporting qualitative research
• Qualitative research: standards, challenges, and guidelines
• Capturing momentary, self-report data: a proposal for reporting guidelines
• Guidelines for conducting and reporting mixed research in the field of counseling and beyond

Reporting guidelines for main study types

Translations

Some reporting guidelines are also available in languages other than English. Find out more in our Translations section .

• About the Library

For information about Library scope and content, identification of reporting guidelines and inclusion/exclusion criteria please visit About the Library .

Visit our Help page for information about searching for reporting guidelines and for general information about using our website.

Library index

• What is a reporting guideline?
• Browse reporting guidelines by specialty
• Reporting guidelines under development
• Translations of reporting guidelines
• EQUATOR Network reporting guideline manual
• Reporting guidelines for animal research
• Guidance on scientific writing
• Guidance developed by editorial groups
• Research funders’ guidance on reporting requirements
• Professional medical writing support
• Research ethics, publication ethics and good practice guidelines
• Links to other resources

Information

• Author Services

Initiatives

You are accessing a machine-readable page. In order to be human-readable, please install an RSS reader.

All articles published by MDPI are made immediately available worldwide under an open access license. No special permission is required to reuse all or part of the article published by MDPI, including figures and tables. For articles published under an open access Creative Common CC BY license, any part of the article may be reused without permission provided that the original article is clearly cited. For more information, please refer to https://www.mdpi.com/openaccess .

Feature papers represent the most advanced research with significant potential for high impact in the field. A Feature Paper should be a substantial original Article that involves several techniques or approaches, provides an outlook for future research directions and describes possible research applications.

Feature papers are submitted upon individual invitation or recommendation by the scientific editors and must receive positive feedback from the reviewers.

Editor’s Choice articles are based on recommendations by the scientific editors of MDPI journals from around the world. Editors select a small number of articles recently published in the journal that they believe will be particularly interesting to readers, or important in the respective research area. The aim is to provide a snapshot of some of the most exciting work published in the various research areas of the journal.

Original Submission Date Received: .

• Active Journals
• Find a Journal
• Proceedings Series
• For Authors
• For Reviewers
• For Editors
• For Librarians
• For Publishers
• For Societies
• For Conference Organizers
• Open Access Policy
• Institutional Open Access Program
• Special Issues Guidelines
• Editorial Process
• Research and Publication Ethics
• Article Processing Charges
• Testimonials
• Preprints.org
• SciProfiles
• Encyclopedia

Article Menu

• Subscribe SciFeed
• Recommended Articles
• Google Scholar
• on Google Scholar
• Table of Contents

Find support for a specific problem in the support section of our website.

Please let us know what you think of our products and services.

Visit our dedicated information section to learn more about MDPI.

JSmol Viewer

College students with adhd: a selective review of qualitative studies.

1. Introduction

1.1. qualitative research methods, 1.2. the present study, 2. materials and methods, 2.1. search strategy, 2.2. study selection, 2.3. variable identification, 3.1. quantitative results, 3.2. qualitative results, 3.2.1. the college experience of students with adhd, 3.2.2. interventions, 3.2.3. cognitive and academic functioning, 3.2.4. self-functioning, 4. discussion, 5. conclusions, author contributions, conflicts of interest, appendix a. summaries of included studies, appendix a.1. the college experience of students with adhd, appendix a.1.1. college transitions, appendix a.1.2. adhd as an identity, appendix a.1.3. race, appendix a.1.4. community college, appendix a.2. interventions, appendix a.2.1. coaching, appendix a.2.2. strategies, appendix a.2.3. medication, appendix a.3. cognitive and academic functioning, appendix a.4. self-functioning.

• Chung, W.; Jiang, S.F.; Paksarian, D.; Nikolaidis, A.; Castellanos, F.X.; Merikangas, K.R.; Milham, M.P. Trends in the prevalence and incidence of attention-deficit/hyperactivity disorder among adults and children of different racial and ethnic groups. JAMA Netw. Open 2009 , 2 , e1914344. [ Google Scholar ] [ CrossRef ]
• Digest of Education Statistics. Available online: https://nces.ed.gov/programs/digest/d21/tables/dt21_311.10.asp (accessed on 4 April 2024).
• Characteristics and Outcomes of Undergraduates with Disabilities. Available online: https://nces.ed.gov/pubs2018/2018432.pdf (accessed on 4 April 2024).
• DuPaul, G.J.; Gormley, M.J.; Anastopoulos, A.D.; Weyandt, L.L.; Labban, J.; Sass, A.J.; Postler, K.B. Academic trajectories of college students with and without ADHD: Predictors of four-year outcomes. J. Clin. Child. Adolesc. Psychol. 2021 , 50 , 828–843. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• O’Rourke, S.R.; Bray, A.C.; Anastopoulos, A.D. Anxiety symptoms and disorders in college students with ADHD. J. Atten. Disord. 2020 , 24 , 1764–1774. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Anastopoulos, A.D.; Langberg, J.M.; Eddy, L.D.; Silvia, P.J.; Labban, J.D. A randomized controlled trial examining CBT for college students with ADHD. J. Consult. Clin. Psychol. 2021 , 89 , 21–33. [ Google Scholar ] [ CrossRef ]
• Francis, A.R.; Weyandt, L.L.; Anastopoulos, A.D.; DuPaul, G.J.; Shepard, E. Outcomes and predictors of stimulant misuse in college students with and without ADHD. J. Atten. Disord. 2022 , 26 , 779–793. [ Google Scholar ] [ CrossRef ]
• APA Dictionary of Psychology. Available online: https://dictionary.apa.org/qualitative-research (accessed on 15 January 2024).
• Sabnis, S.V.; Newman, D.S.; Whitford, D.; Mossing, K. Publication and characteristics of qualitative research in School Psychology journals between 2006 and 2021. Sch. Psychol. 2023 , 38 , 330–336. [ Google Scholar ] [ CrossRef ]
• Drew, C.J.; Hardman, M.L.; Hosp, J.L. Designing and Conducting Research in Education ; Sage: Thousand Oaks, CA, USA, 2008. [ Google Scholar ]
• Schonfeld, I.S.; Mazzola, J.J. Strengths limitations of qualitative approaches to research in occupational health psychology. In Research Methods in Occupational Health Psychology: State of the Art in Measurement, Design, and Data Analysis ; Tetrick, L., Sinclair, R., Wang, M., Eds.; Routledge: London, UK, 2012; pp. 268–289. [ Google Scholar ]
• Camic, P.M. Qualitative Inquiry in Psychological Research, Expanding Perspectives in Methodology and Design , 2nd ed.; American Psychological Association: Washington, DC, USA, 2021; pp. 3–26. [ Google Scholar ]
• Leko, M.M.; Cook, B.G.; Cook, L. Qualitative methods in special education research. Learn. Disabil. Res. Pract. 2021 , 36 , 278–286. [ Google Scholar ] [ CrossRef ]
• Page, M.J.; McKenzie, J.E.; Bossuyt, P.M.; Boutron, I.; Hoffmann, T.C.; Mulrow, C.D.; Moher, D. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ 2021 , 372 , 71. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Madaus, J.W.; Gelbar, N.; Dukes, L.L., III; Lalor, A.R.; Lombardi, A.; Kowitt, J.; Faggella-Luby, M.N. Literature on postsecondary disability services: A call for research guidelines. J. Divers. High. Educ. 2018 , 11 , 133ff. [ Google Scholar ] [ CrossRef ]
• Madaus, J.W.; Dukes, L.L., III; Lalor, A.R.; Aquino, K.; Faggella-Luby, M.; Newman, L.A.; Wessel, R.D. Research Guidelines for Higher Education and Disability. J. Postsecond. Educ. Disabil. 2020 , 33 , 319–338. [ Google Scholar ]
• Lewandowski, L.J.; Lovett, B.J.; Codding, R.S.; Gordon, M. Symptoms of ADHD and academic concerns in college students with and without ADHD diagnoses. J. Atten. Disord. 2008 , 12 , 156–161. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Suhr, J.A.; Johnson, E.E. First do no harm: Ethical issues in pathologizing normal variations in behavior and functioning. Psychol. Inj. Law 2022 , 15 , 253–267. [ Google Scholar ] [ CrossRef ]
• Nelson, J.M.; Lovett, B.J. Assessing ADHD in college students: Integrating multiple evidence sources with symptom and performance validity data. Psychol. Assess. 2019 , 31 , 793–804. [ Google Scholar ] [ CrossRef ]
• Gascon, A.; Gamache, D.; St-Laurent, D.; Stipanicic, A. Do we over-diagnose ADHD in North America? A critical review and clinical recommendations. J. Clin. Psychol. 2022 , 78 , 2363–2380. [ Google Scholar ] [ CrossRef ]
• Meaux, J.B.; Green, A.; Broussard, L. ADHD in the college student: A block in the road. J. Psychiatr. Ment. Health Nurs. 2009 , 16 , 248–256. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Morgan, K. The College Transition Experience of Students with ADHD. Ph.D. Thesis, Kansas State University, Manhattan, KS, USA, 2012. [ Google Scholar ]
• McCall, Z.A. The transition experiences, activities, and supports of four college students with disabilities. Career Dev. 2015 , 38 , 162–172. [ Google Scholar ] [ CrossRef ]
• Denson, T.C. The Transitioning Experiences of First-Year Students with ADHD into College: A Case Study. Ph.D. Thesis, Northcentral University, Phoenix, AZ, USA, 2021. [ Google Scholar ]
• Stevens, A.E. Perspectives from College Students with ADHD: A Qualitative Examination of Parental Support and the Parent-Child Relationship in the Transition to College. Ph.D. Thesis, University of Wyoming, Laramie, WY, USA, 2020. [ Google Scholar ]
• Mullins, L.; Preyde, M. The lived experience of students with an invisible disability at a Canadian university. Disabil. Soc. 2013 , 28 , 147–160. [ Google Scholar ] [ CrossRef ]
• Johnston, V. University Students Diagnosed with Attention Deficit Hyperactivity Disorder: A Hermeneutical Phenomenological Study of Challenges and Successes. Ph.D. Thesis, Liberty University, Richmond, VA, USA, 2013. [ Google Scholar ]
• Lux, S.J. The Lived Experiences of College Students with a Learning Disability and/or Attention Deficit Hyperactivity Disorder. Ph.D. Thesis, Iowa State University, Des Moines, IA, USA, 2016. [ Google Scholar ]
• Alabdulwahab, R. Postsecondary Education for International Undergraduate Students with Learning Disabilities in the United States. Ph.D. Thesis, University of Northern Colorado, Greely, CO, USA, 20 December 2016. [ Google Scholar ]
• Bolourian, Y.; Zeedyk, S.M.; Blacher, J. Autism and the university experience: Narratives from students with neurodevelopmental disorders. J. Autism Dev. Disord. 2018 , 48 , 3330–3343. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Bonomi, A.; Nichols, E.; Kammes, R.; Green, T. Sexual violence and intimate partner violence in college women with a mental health and/or behavior disability. J. Women’s Health 2018 , 27 , 359–368. [ Google Scholar ]
• Pirozzi, M. The Perception of the College Experience for Students with ADHD. In Proceedings of the IHSES 2022—International Conference on Humanities, Social and Education Sciences, Los Angeles, CA, USA, 21–24 April 2022 ; Noroozi, O., Sahin, I., Eds.; ISTES Organization: Los Angeles, CA, USA, 2022; pp. 18–32. [ Google Scholar ]
• Poe, M.A. A Phenomenological Study of the Educational Learning Experiences of African American College Students with Attention Deficit Hyperactivity Disorder (ADHD). Ph.D. Thesis, Capella University, Minneapolis, MN, USA, 2011. [ Google Scholar ]
• Mills, M.C. The Learning Experiences in a College Environment for African American Students Diagnosed with Attention Deficit Hyperactivity Disorder (ADHD): A Qualitative Case Study. Ph.D. Thesis, Capella University, Minneapolis, MN, USA, 2015. [ Google Scholar ]
• Young, E.W.D.M. Understanding the Psycho-Social and Cultural Factors that Influence the Experience of Attention-Deficit/Hyperactivity Disorder (ADHD) in Chinese American college students: A Systems Approach. Ph.D. Thesis, University of Southern California, Los Angeles, CA, USA, 2012. [ Google Scholar ]
• Coon, H.L. Community College Students with Attention-Deficit/Hyperactivity Disorder (AD/HD): A Student Perspective. Ph.D. Thesis, Capella University, Minneapolis, MN, USA.
• Flowers, L. Navigating and Accessing Higher Education: The Experiences of Community College Students with Attention Deficit Hyperactivity Disorder. Ph.D. Thesis, University of Southern California, Los Angeles, CA, USA, 2012. [ Google Scholar ]
• Reaser, A.L. ADHD Coaching and College Students. Ph.D. Thesis, Florida State University, Tallahassee, FL, USA, 2008. [ Google Scholar ]
• Parker, D.R.; Boutelle, K. Executive function coaching for college students with learning disabilities and ADHD: A new approach for fostering self-determination. Learn. Disabil. Res. Pract. 2009 , 24 , 204–215. [ Google Scholar ] [ CrossRef ]
• Prevatt, F.; Smith, S.M.; Diers, S.; Marshall, D.; Coleman, J.; Valler, E.; Miller, N. ADHD coaching with college students: Exploring the processes involved in motivation and goal completion. J. Coll. Stud. Psychother. 2017 , 31 , 93–111. [ Google Scholar ] [ CrossRef ]
• Kreider, C.M.; Medina, S.; Koedam, H.M. (Dis)ability-informed mentors support occupational performance for college students with learning disabilities and attention-deficit/hyperactivity disorders through problem-solving and a focus on strengths. Br. J. Occup. Ther. 2021 , 84 , 263–270. [ Google Scholar ] [ CrossRef ]
• Melara, C.A. Factors Influencing the Academic Persistence of College Students with ADHD. Ph.D. Thesis, University of Southern California, Los Angeles, CA, USA, 2012. [ Google Scholar ]
• Bartlett, R.; Rowe, T.S.; Shattell, M.M. Perspectives of college students on their childhood ADHD. MCN Am. J. Matern. Child Nurs. 2010 , 35 , 226–231. [ Google Scholar ] [ CrossRef ] [ PubMed ]
• Davis-Berman, J.L.; Pestello, F.G. Medicating for ADD/ADHD: Personal and social issues. Int. J. Ment. Health Addict. 2010 , 8 , 482–492. [ Google Scholar ] [ CrossRef ]
• Meaux, J.B.; Hester, C.; Smith, B.; Shoptaw, A. Stimulant medications: A trade-off? J. Spec. Ped. Nurs. 2006 , 11 , 214–226. [ Google Scholar ] [ CrossRef ]
• Loe, M.; Cuttino, L. Grappling with the medicated self: The case of ADHD college students. Symb. Interact. 2008 , 31 , 303–323. [ Google Scholar ] [ CrossRef ]
• Judd, A.D. Function, Visualization, and Mathematical Thinking for College Students with Attention Deficit Hyperactivity Disorder. Ph.D. Thesis, University of Northern Colorado, Denver, CO, USA, 2008. [ Google Scholar ]
• Lee, K.S.; Osborne, R.E.; Carpenter, D.N. Testing accommodations for university students with AD/HD: Computerized vs. paper-pencil/regular vs. extended time. J. Educ. Comput. Res. 2010 , 42 , 443–458. [ Google Scholar ] [ CrossRef ]
• Hood, M.R. A Phenomenological Study: How College Students with ADHD are Affected by Fragmentation and Dissassociation. Ph.D. Thesis, Concordia University, Portland, OR, USA, 2018. [ Google Scholar ]
• Nash-Luckenbach, D. Exploring Learning Style Preferences of College Age Students with Attention Deficit Hyperactive Disorder (ADHD). Ph.D. Thesis, Seton Hall University, South Orange, NJ, USA, 2019. [ Google Scholar ]
• Rodriguez, E. Time, Schedules, and the College Student with ADHD. Ph.D. Thesis, Syracuse University, Syracuse, NY, USA, 2020. [ Google Scholar ]
• Fox, K.A., Jr. Attention Deficit Hyperactivity Disorder: Perceived Impact on College Students’ Motivation to Learn. Ph.D. Thesis, Grand Canyon University, Phoenix, AZ, USA, 2021. [ Google Scholar ]
• Kreider, C.M.; Luna, C.; Lan, M.F.; Wu, C.T. Disability advocacy messaging and conceptual links to underlying disability identity development among college students with learning disabilities and attention disorders. Disabil. Health J. 2020 , 13 , 100827. [ Google Scholar ] [ CrossRef ]
• Waite, R.; Tran, M. Explanatory models and help-seeking behavior for Attention-Deficit/Hyperactivity Disorder among a cohort of postsecondary students. Arch. Psychiat. Nurs. 2010 , 24 , 247–259. [ Google Scholar ] [ CrossRef ]
• Driggers, J.A.G. Resiliency in Undergraduate College Students Diagnosed with Attention-Deficit/Hyperactivity Disorder (ADHD). Ph.D. Thesis, Walden University, Saint Paul, MN, USA, 2013. [ Google Scholar ]
• Roper, L.G. Self-Advocacy Among College Students with Learning Disabilities and/or Attention-Deficit Hyperactivity Disorders. Ph.D. Thesis, University of Kentucky, Lexington, KY, USA, 2016. [ Google Scholar ]
• Webb, K. Self-Efficacy in College Students with Attention Deficit/Hyperactivity Disorder. Ph.D. Thesis, Massachusetts School of Professional Psychology, Boston, MA, USA, 2018. [ Google Scholar ]
• Tse, M. Social Skills and Self-Esteem of College Students with ADHD. Ph.D. Thesis, University of Southern California, Los Angeles, CA, USA, 2012. [ Google Scholar ]
• Haig, J.D. The Role of Self-Regulation Strategies on Two- and Four-Year College Students with ADHD. Ph.D. Thesis, University of Southern California, Los Angeles, CA, USA, 2012. [ Google Scholar ]

Click here to enlarge figure

The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

Cohen, S.L.; Shavel, K.; Lovett, B.J. College Students with ADHD: A Selective Review of Qualitative Studies. Disabilities 2024 , 4 , 658-677. https://doi.org/10.3390/disabilities4030041

Cohen SL, Shavel K, Lovett BJ. College Students with ADHD: A Selective Review of Qualitative Studies. Disabilities . 2024; 4(3):658-677. https://doi.org/10.3390/disabilities4030041

Cohen, Shira L., Katie Shavel, and Benjamin J. Lovett. 2024. "College Students with ADHD: A Selective Review of Qualitative Studies" Disabilities 4, no. 3: 658-677. https://doi.org/10.3390/disabilities4030041

Article Metrics

Article access statistics, further information, mdpi initiatives, follow mdpi.

Subscribe to receive issue release notifications and newsletters from MDPI journals

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings
• My Bibliography
• Collections
• Citation manager

Save citation to file

Email citation, add to collections.

• Create a new collection
• Add to an existing collection

Add to My Bibliography

Your saved search, create a file for external citation management software, your rss feed.

• Search in PubMed
• Search in NLM Catalog
• Add to Search

Use of qualitative research in World Health Organisation guidelines: a document analysis

Affiliations.

• 1 Department of Clinical Sciences, Liverpool School of Tropical Medicine, Liverpool, UK. [email protected].
• 2 Department of Clinical Sciences, Liverpool School of Tropical Medicine, Liverpool, UK.
• 3 EPPI-Centre, Social Science Research Unit, UCL Institute of Education, University College London, London, UK.
• 4 Africa Centre for Evidence, Faculty of Humanities, University of Johannesburg, Johannesburg, South Africa.
• 5 Department of International Public Health, Liverpool School of Tropical Medicine, Liverpool, UK.
• PMID: 38576035
• PMCID: PMC10996230
• DOI: 10.1186/s12961-024-01120-y

Background: Guidelines depend on effect estimates, usually derived from randomised controlled trials, to inform their decisions. Qualitative research evidence may improve decisions made but where in the process and the methods to do this have not been so clearly established. We sought to describe and appraise how qualitative research has been used to inform World Heath Organization guidance since 2020.

Methods: We conducted a document analysis of WHO guidelines from 2020 to 2022. We purposely sampled guidelines on the topics of maternal and newborn health (MANH) and infectious diseases, as most of the qualitative synthesis to date has been conducted on these topics, likely representing the 'best case' scenario. We searched the in-built repository feature of the WHO website and used standardised search terms to identify qualitative reporting. Using deductive frameworks, we described how qualitative evidence was used to inform guidelines and appraised the standards of this use.

Results: Of the 29 guidelines, over half used qualitative research to help guide decisions (18/29). A total of 8 of these used qualitative research to inform the guideline scope, all 18 to inform recommendations, and 1 to inform implementation considerations. All guidelines drew on qualitative evidence syntheses (QES), and five further supplemented this with primary qualitative research. Qualitative findings reported in guidelines were typically descriptive, identifying people's perception of the benefits and harms of interventions or logistical barriers and facilitators to programme success. No guideline provided transparent reporting of how qualitative research was interpreted and weighed used alongside other evidence when informing decisions, and only one guideline reported the inclusion of qualitative methods experts on the panel. Only a few guidelines contextualised their recommendations by indicating which populations and settings qualitative findings could be applied.

Conclusions: Qualitative research frequently informed WHO guideline decisions particularly in the field of MANH. However, the process often lacked transparency. We identified unmet potential in informing implementation considerations and contextualisation of the recommendations. Use in these areas needs further methods development.

Keywords: Guideline development; Qualitative evidence synthesis; Qualitative research.

© 2024. The Author(s).

PubMed Disclaimer

Conflict of interest statement

The authors declare they have no competing interests.

Matrix of how qualitative research…

Matrix of how qualitative research can contribute to guideline development

Overview of guideline search process

Illustration of how WHO guidelines…

Illustration of how WHO guidelines used qualitative research according to their role

Similar articles

• Qualitative Evidence Synthesis (QES) for Guidelines: Paper 3 - Using qualitative evidence syntheses to develop implementation considerations and inform implementation processes. Glenton C, Lewin S, Lawrie TA, Barreix M, Downe S, Finlayson KW, Tamrat T, Rosenbaum S, Tunçalp Ö. Glenton C, et al. Health Res Policy Syst. 2019 Aug 8;17(1):74. doi: 10.1186/s12961-019-0450-1. Health Res Policy Syst. 2019. PMID: 31391071 Free PMC article.
• The future of Cochrane Neonatal. Soll RF, Ovelman C, McGuire W. Soll RF, et al. Early Hum Dev. 2020 Nov;150:105191. doi: 10.1016/j.earlhumdev.2020.105191. Epub 2020 Sep 12. Early Hum Dev. 2020. PMID: 33036834
• Folic acid supplementation and malaria susceptibility and severity among people taking antifolate antimalarial drugs in endemic areas. Crider K, Williams J, Qi YP, Gutman J, Yeung L, Mai C, Finkelstain J, Mehta S, Pons-Duran C, Menéndez C, Moraleda C, Rogers L, Daniels K, Green P. Crider K, et al. Cochrane Database Syst Rev. 2022 Feb 1;2(2022):CD014217. doi: 10.1002/14651858.CD014217. Cochrane Database Syst Rev. 2022. PMID: 36321557 Free PMC article.
• Survivor, family and professional experiences of psychosocial interventions for sexual abuse and violence: a qualitative evidence synthesis. Brown SJ, Carter GJ, Halliwell G, Brown K, Caswell R, Howarth E, Feder G, O'Doherty L. Brown SJ, et al. Cochrane Database Syst Rev. 2022 Oct 4;10(10):CD013648. doi: 10.1002/14651858.CD013648.pub2. Cochrane Database Syst Rev. 2022. PMID: 36194890 Free PMC article. Review.
• Barriers and facilitators to the implementation of lay health worker programmes to improve access to maternal and child health: qualitative evidence synthesis. Glenton C, Colvin CJ, Carlsen B, Swartz A, Lewin S, Noyes J, Rashidian A. Glenton C, et al. Cochrane Database Syst Rev. 2013 Oct 8;2013(10):CD010414. doi: 10.1002/14651858.CD010414.pub2. Cochrane Database Syst Rev. 2013. PMID: 24101553 Free PMC article. Review.
• Sackett DL, Rosenberg WMC, Gray JAM, Haynes RB, Richardson WS. Evidence based medicine: what it is and what it isn’t. BMJ. 1996;312(7023):71–2. doi: 10.1136/bmj.312.7023.71. - DOI - PMC - PubMed
• Lewin S, Glenton C. Are we entering a new era for qualitative research? Using qualitative evidence to support guidance and guideline development by the World Health Organization. Int J Equity Health. 2018;17(1):126. doi: 10.1186/s12939-018-0841-x. - DOI - PMC - PubMed
• Isaacs A. An overview of qualitative research methodology for public health researchers. Int J Med Public Health. 2014;4(4):318. doi: 10.4103/2230-8598.144055. - DOI
• Gopinathan U, Buse K. How can WHO transform its approach to social determinants of health? BMJ. 2022;8:376. - PMC - PubMed
• Dahlgren GWM. Policies and strategies to promote social equity in health. Sweden: Stockholm; 1991.
• Search in MeSH

Related information

Grants and funding.

• 300342-104/Foreign, Commonwealth and Development Office

LinkOut - more resources

Full text sources.

• BioMed Central
• Europe PubMed Central
• PubMed Central

• Citation Manager

NCBI Literature Resources

MeSH PMC Bookshelf Disclaimer

The PubMed wordmark and PubMed logo are registered trademarks of the U.S. Department of Health and Human Services (HHS). Unauthorized use of these marks is strictly prohibited.

• Study Protocol
• Open access
• Published: 11 September 2024

A new patient-reported outcome measure for the evaluation of ankle instability: description of the development process and validation protocol

• Pietro Spennacchio 1 , 2 ,
• Eric Hamrin Senorski 3 ,
• Caroline Mouton 1 , 2 ,
• Jan Cabri 2 ,
• Romain Seil 1 , 2 &
• Jon Karlsson 4  

Journal of Orthopaedic Surgery and Research volume  19 , Article number:  557 ( 2024 ) Cite this article

Metrics details

Acute ankle sprains represent one of the most common traumatic injuries to the musculoskeletal system. Many individuals with these injuries experience unresolved symptoms such as instability and recurrent sprains, leading to chronic ankle instability (CAI), which affects their ability to maintain an active lifestyle. While rehabilitation programs focusing on sensorimotor, neuromuscular, strength and balance training are primary treatments, some patients require surgery when rehabilitation fails. A critical analysis of the patient-reported outcome tools (PROs) used to assess CAI surgical outcomes raises some concerns about their measurement properties in CAI patients, which may ultimately affect the quality of evidence supporting current surgical practice. The aim of this research is to develop and validate a new PRO for the assessment of ankle instability and CAI treatment outcomes, following recent methodological guidelines, with the implicit aim of contributing to the generation of scientifically meaningful evidence for clinical practice in patients with ankle instability.

Following the COnsensus-based Standards for the selection of Health Measurement Instruments (COSMIN), an Ankle Instability Treatment Index (AITI) will be developed and validated. The process begins with qualitative research based on face‒to‒face interviews with CAI individuals to explore the subjective experience of living with ankle instability. The data from the interviews will be coded following an inductive approach and used to develop the AITI content. The preliminary version of the scale will be refined through an additional round of face‒to‒face interviews with a new set of CAI subjects to define the AITI content coverage, relevance and clarity. Once content validity has been examined, the AITI will be subjected to quantitative analysis of different measurement properties: construct validity, reliability and responsiveness.

The development of AITI aims to address the limitations of existing instruments for evaluating surgical outcomes in patients with CAI. By incorporating patient input and adhering to contemporary standards for validity and reliability, this tool seeks to provide a reliable and meaningful assessment of treatment effects.

Trial registration

Not applicable.

Acute ankle ligament injuries are among the most common musculoskeletal injuries in both the general and sports populations [ 14 ]. A significant number of people who have suffered a first ankle ligament injury have unresolved posttraumatic symptoms lasting more than 1 year, such as feelings of instability (33–55%), recurrent episodes of ‘giving way’ and sprains (3–35%), and, in some cases, pain [ 17 , 39 ]. This condition is referred to as chronic ankle instability (CAI), a multifaceted syndrome that is associated with functional and/or structural deficiencies and impaired quality of life and decreased physical activity [ 2 , 15 ].

CAI patients are primarily treated with a comprehensive rehabilitation program that emphasizes ankle sensorimotor, strength and balance training. Rehabilitation has been reported to improve subjective symptoms and functional limitations and reduce the risk of ankle reinjury in CAI patients [ 1 , 9 ]. However, despite prolonged functional rehabilitation, some patients with CAI continue to experience significant activity restrictions due to ankle problems. When rehabilitation fails, surgery appears to be a viable therapeutic option for restoring joint function by targeting and correcting the mechanical deficiency of the injured ankle–ligament complex [ 5 ]. The current scientific literature supports the use of different surgical strategies for treating ankle instability, ranging from anatomical repair of the native ligamentous complex to the use of different graft reconstruction techniques, performed via open surgery, minimally invasive and arthroscopic techniques [ 13 , 22 , 37 ]. Unfortunately, there is poor agreement on the surgical standard of care for CAI, and guidelines for determining the surgeon’s choice are still lacking [ 23 , 41 ].

To compare and select appropriate surgical options for treating CAI properly, a combination of reliable tools, including both patient-related and clinician-generated parameters, must be considered [ 35 ]. Patient-reported outcome measures (PROs) are recognized modalities for accounting for the patient’s perspective on his/her current condition. This subjective view is of primary importance for the evaluation of any given treatment and should also ideally contribute in a positive manner to the clinical decision-making process. The ability of a PRO to produce clinically meaningful data is embodied in the multifaceted concept of validity, which can generally be defined as the ability of the instrument to measure the construct it purports to measure [ 6 ]. However, a critical analysis of the literature reveals that validity is an issue for current PROs used to assess CAI surgical outcomes [ 7 , 20 ], raising some concerns about the quality of the evidence supporting clinical practice in patients with ankle instability.

The primary aim of this research was to address this knowledge gap by developing a new patient-reported outcome tool, following methodological guidelines, specifically designed to assess ankle instability and changes following therapeutic interventions. This study protocol describes the process of developing and validating a new tool to evaluate ankle instability, the Ankle Instability Treatment Index (AITI).

Why a new scale?

The best available evidence about the clinimetric properties of PROs in the specific CAI population suggests the use of the Foot and Ankle Ability Measure (FAAM), the Foot and Ankle Outcome Score (FAOS), and the Karlsson score as the most appropriate PROs for evaluating surgical outcomes in CAI patients [ 7 , 12 , 16 ]. The FAAM and the FAOS were originally conceived as region-specific scores to evaluate functional limitations associated with a variety of foot and ankle problems [ 21 , 31 ]. Only retrospective evidence of validation has been obtained for patients suffering from ankle instability [ 3 , 11 , 30 ]. Both PROs thus do not specifically assess symptoms of ankle joint instability, which raises concerns about their ability to tap an essential disease-specific feature representing a primary target of any ankle stabilization procedure [ 40 ].

The Karlsson score was developed in 1991 to assess joint function after treatment for lateral ankle ligament injuries [ 16 ]. Since its inception, the scale has served as a useful tool in research dealing with the treatment of ankle instability, as evidenced by the frequent use of the scale to report the results of CAI surgery [ 34 ]. However, a systematic review published in 2007 on the available PROs in foot and ankle research area highlighted that the scale lacked evidence on important aspects of validity, such as content validity, reliability and responsiveness [ 20 ]. Since this observation, to the best of the authors’ knowledge, there has been no further analysis of the scale’s validity.

On the basis of these observations, the authors believe that the development of a new PRO for the evaluation of CAI surgical outcome, following the most recent guidelines on PRO properties, is justified by the current state of knowledge.

What should the scale measure?

A focus group consisting of all the authors of this publication (Dr. Pietro Spennacchio, Professor Jon Karlsson, Professor Romain Seil, Dr. Caroline Mouton and Dr. Eric Hamrin Senorski) with recognized expertise and previous publications in the field of ankle instability and outcome tools met initially to discuss the purpose and basic concepts of the new scale. The experts agreed that the main purpose of the project would be to develop an evaluative tool capable of assessing, through direct patient feedback, the symptomatic state of the CAI subject as well as its modification with treatment, according to what is most important to the patient.

The described development procedure adheres to the minimum requirements of validity and reliability as set forth by the latest version of the COnsensus based Standards for the selection of Health Status Measurements INstruments [COSMIN] [ 24 ]. The process of developing the new rating scale is shown in Fig.  1 . It is a multistage process that involves iteratively and interactively, experts and patients in various qualitative and quantitative stages of development to produce a clinically meaningful scale [ 4 ]. To ensure the development of an instrument with high content validity, the process begins with a qualitative research phase aimed at exploring the subjective feelings and formulations of CAI subjects through individual face‒to-face interviews. The qualitative part of the research belongs to the “phenomenology” design type and can be related to the following question: “What do people with chronic ankle instability experience? “, with the aim of allowing participants to provide an insightful perspective on their subjective experience of living with ankle instability [ 18 , 33 ]. The subjective feedback from the CAI subjects will then be used to support the definition of the construct to be assessed by the new scale.

Flow diagram showing the multiphase process of AITI development. AITI: Ankle Instability Treatment Scale. CAI: Chronic ankle instability. PROs: patient-reported outcomes

Participants and recruitment

The inclusion criteria for participation in the development and validation of the new score are detailed in Table  1 . The clinical diagnosis of chronic ankle instability reported in this study is consistent with the Position Statement on Selection Criteria for CAI subjects in Research defined by the International Ankle Consortium [ 12 ]. Recruitment will be conducted in a single center by a member of the focus group, who is an experienced foot and ankle surgeon (PS). In line with the stated phenomenological qualitative study design, sampling will be carried out via a criterion sampling strategy, with the most prominent criterion being the participant’s experience of the phenomenon of ankle instability, as supported by the diagnostic criteria outlined in Table  1 [ 18 ].

Patient interviews and data collection

Written informed consent will be obtained from all participants before the face-to-face interviews begin. A preliminary list of clinical features of ankle instability, derived from the experience of the developers and the content of PROs commonly used in the research dealing with ankle instability, will be defined to provide prior theoretical knowledge that will serve as a testing ground for the information emerging from the interviews. The interviews follow a framework of open-ended questions designed to encourage discussion of the patient’s subjective experience of the different dimensions of the pathology, as well as the change expected from a treatment designed to improve their current disease (Table  2 ). The interviewer will take special care to avoid any specific guidance or influence on the answers, to allow the participant to express his/her own feelings, perceptions and thoughts, using his/her own words as freely as possible.

The qualitative interviews will be conducted, transcribed verbatim and progressively coded by one researcher (PS). The raw data will be analyzed repeatedly from the first interviews onwards via an inductive coding scheme [ 8 ]. The aim is to define data with labels that will allow them to be grouped into preliminary categories that will allow the progressive coding of all the content collected during the interviews. The emerging categories will be analyzed for similarities in content and finally grouped into higher categories to establish a preliminary framework of the phenomenon of ankle instability, which comprises the different dimensions of the condition experienced by CAI patients [ 18 ]. The emerging categories and their content will be reported to the focus group. Any missing points suggested by comparisons with existing knowledge and the developers’ experience in treating ankle instability will be explored further with additional questions in subsequent interviews to iteratively configure the conceptual framework of ankle instability of the new scale.

The interviews will continue until saturation is reached, defined as the point at which no additional codes or insights emerge in three consecutive interviews, confirming clear data redundancy. On the basis of practical guidelines and estimates from previous qualitative phenomenological studies, a minimum of 10 face‒to‒face interviews are expected [ 24 , 32 ].

Item generation, scale refinement and content validity

The conceptual framework developed will be used to design the domains and items of the new scale in its preliminary version. The information from the previous interviews will be used to generate relevant items, paying particular attention to the wording spontaneously evoked by the patient to ensure clarity and the patient-reported nature of the instrument.

The preliminary scale will be tested through a new round of face‒to‒face interviews with a minimum of 30 new participants not involved in the previous qualitative interviews who meet the same inclusion criteria, as described in Table  1 [ 24 ]. The purpose of the interviews will be to confirm the clarity of each instruction, item and response option. In the case of any unclear item or wording, the participant will be asked to explain his uncertainties and to suggest modifications that are able to improve the clarity of the question. Any possible missed aspects of the ankle instability construct will be further investigated through dedicated probing to explore the patient’s perspective on the content coverage of the scale. During the interview, a quantitative assessment of the content relevance of the scale will be carried out to confirm the instrument’s ability to analyze what matters to patients diagnosed with CAI [ 24 , 28 ]. The respondents will be asked to rate the relevance of the items on a 4-point scale to calculate the content validity ratio for the item’s relevance and appropriateness of the scaling options [ 19 ].

The relevance of the items and the comprehensiveness of the instrument will be further investigated from the perspective of professionals (Orthopaedics and Physiotherapists) )with established experience in the treatment of ankle instability outside the development team. The AITI with a dedicated rating form will be emailed to these professionals, and they will be asked to rate the relevance of each item to the construct of ankle instability. The raters will also be asked to comment on whether any aspects of the construct of instability have been omitted.

How does the instrument work?

After content validity has been examined, the AITI will be subjected to an analysis of different measurement properties, as outlined below.

Construct validity

The construct validity of the AITI will be examined by defining its internal consistency, which is the extent to which the scale items are correlated with each other, thus measuring the same construct and supporting the derivation of a composite score from the sum of the items [ 38 ]. The cohort size of the subjects required to adequately determine the construct validity will be further defined when preliminary data will be available on a sample of 20 CAI patients to ensure statistical power for each analysis.

The correlation between items is defined by calculating the Cronbach’s α. Internal consistency between the items between 0.70 and 0.95 is considered acceptable [ 26 ]. To ensure a clear interpretation of the internal consistency statistics, the dimensionality of the scale will be tested with a confirmatory factor analysis [ 25 ]. The number of items making up the scale will also determine the appropriate recruitment size for internal consistency analysis, with a sample size of at least six times the number of items retained [ 24 ].

The construct validity of the AITI will be further explored by testing the hypothesis of an expected relationship with 2 scores commonly selected by researchers to assess CAI surgical outcomes in a minimum of 50 CAI patients [ 24 ]: the Karlsson scale [ 16 ] and the FAAM sports subscale [ 3 ]. The available evidence for the validation of the comparator instruments in CAI population subjects supports an expected relationship in the midrange of 0.4–0.8, as defined by the calculation of Pearson’s product‒moment correlation coefficients (parametric data) or Spearman’s r (rank correlation) coefficients (nonparametric correlation) [ 36 ].

• Reliability

In addition to the definition of internal consistency described above, the reliability of the AITI will be further investigated by determining test reproducibility and measurement error in a sample size of CAI participants, which will be further defined once preliminary data are available with the new instrument. In accordance with the COSMIN guidelines, a minimum of 50 CAI subjects will be included in this analysis [ 24 ]. Reproducibility (test‒retest reliability) is the extent to which repeated measurements in stable individuals yield similar responses [ 38 ]. Patients participating in this step of validation will complete the new outcome scale twice, with a 10–14-day interval between the two administrations. In line with the definition of a PRO as information that comes directly from patients without interpretation by a clinician [ 27 ], the questionnaire will be administered in a strict self-administered mode without external support, which may introduce bias related to caregiver interpretation.

Evaluation of the test–retest reliability of the scale will be performed by calculating the intraclass correlation coefficient (ICC-agreement) with 95% confidence intervals (CI) [ 10 ]. On the basis of the ICC values, the standard error of measurement (SEM) and the minimal detectable change (MDC) will be calculated.

Responsiveness

Responsiveness is defined as the ability of a questionnaire to detect clinically important changes over time, even if these changes are small [ 36 ]. This is a fundamental property for any instrument purporting to evaluate the effect of a therapeutic intervention (evaluative instrument). The instrument responsiveness will be the last property to be analyzed, only after all the facets of validity outlined above have finally been proven to be at least as adequate [ 24 ]. A new group of minimum 30 CAI patients [ 24 ] will be analyzed using the instrument before and after an ankle stabilization procedure at a minimum follow-up of 1 year, a time point that is expected to show a modification of the preoperative patient’s health state. The effect size (ES) and the standardized response mean (SRM) will be determined as indicators of the ability of the new instrument to detect real changes [ 36 ].

The most important direct patient perspective on a given treatment, captured through valid and reliable PROs, is considered an essential outcome for generating the data necessary to incorporate effective and meaningful treatment strategies into clinical practice [ 29 ]. The authors noted that the existing evidence on CAI surgical outcomes is mainly based on PROs with limited evidence of validity, which casts doubt on the consistency and reliability of the data supporting current treatment algorithms [ 20 , 34 ].

This study protocol describes the process of developing and validating a new disease-specific patient-reported tool for the evaluation of ankle instability treatment, the AITI. The focus on patient input in defining scale content and adherence to the latest consensus-based standards for PRO validity and reliability represent the strategy for developing an instrument with appropriate measurement properties in CAI patients. The authors believe that this process is a necessary step in the search for scientifically sound data ensuring a reliable, evidence-based standard of care for patients suffering from ankle instability.

Data availability

No datasets were generated or analysed during the current study.

Abbreviations

Ankle Instability Treatment Index

Chronic Ankle Instability

Effect Size

Foot and Ankle Ability Measure

Foot and Ankle Outcome Score

Intraclass Correlation Coefficient

Minimal Detectable Change

Patient-reported Outcome Measures

Standard Error of Measurement

Standardized Response Mean

Al Attar WSA, Bakhsh JM, Khaledi EH, Ghulam H, Sanders RH. Injury prevention programs that include plyometric exercises reduce the incidence of anterior cruciate ligament injury: a systematic review of cluster randomised trials. J Physiother. 2022;68:255–61.

Article   PubMed   Google Scholar  

Arnold BL, Wright CJ, Ross SE. Functional ankle instability and health-related quality of life. J Athl Train. 2011;46:634–41.

Article   PubMed   PubMed Central   Google Scholar  

Carcia CR, Martin RL, Drouin JM. Validity of the foot and ankle ability measure in athletes with chronic ankle instability. J Athl Train. 2008;43:179–83.

Creswell JWPCV. Designing and conducting mixed methods research. 2nd edn. Los Angeles (CA): Sage, 2011.; 2011.

de Vries JS, Krips R, Sierevelt IN, Blankevoort L, van Dijk CN. (2011) Interventions for treating chronic ankle instability. Cochrane Database Syst Rev;10.1002/14651858.CD004124.pub3CD004124.

Deshpande PR, Rajan S, Sudeepthi BL, Abdul Nazir CP. Patient-reported outcomes: a new era in clinical research. Perspect Clin Res. 2011;2:137–44.

Eechaute C, Vaes P, Van Aerschot L, Asman S, Duquet W. The clinimetric qualities of patient-assessed instruments for measuring chronic ankle instability: a systematic review. BMC Musculoskelet Disord. 2007;8:6.

Elo S, Kyngas H. The qualitative content analysis process. J Adv Nurs. 2008;62:107–15.

Fakontis C, Iakovidis P, Kasimis K, Lytras D, Koutras G, Fetlis A, et al. Efficacy of resistance training with elastic bands compared to proprioceptive training on balance and self-report measures in patients with chronic ankle instability: a systematic review and meta-analysis. Phys Ther Sport. 2023;64:74–84.

Fitzpatrick R, Davey C, Buxton MJ, Jones DR. Evaluating patient-based outcome measures for use in clinical trials. Health Technol Assess. 1998;2:i–iv.

Article   CAS   PubMed   Google Scholar  

Goulart Neto AM, Maffulli N, Migliorini F, de Menezes FS, Okubo R. Validation of foot and ankle ability measure (FAAM) and the foot and ankle outcome score (FAOS) in individuals with chronic ankle instability: a cross-sectional observational study. J Orthop Surg Res. 2022;17:38.

Gribble PA, Delahunt E, Bleakley CM, Caulfield B, Docherty CL, Fong DT, et al. Selection criteria for patients with chronic ankle instability in controlled research: a position statement of the International Ankle Consortium. J Athl Train. 2014;49:121–7.

Guelfi M, Zamperetti M, Pantalone A, Usuelli FG, Salini V, Oliva XM. Open and arthroscopic lateral ligament repair for treatment of chronic ankle instability: a systematic review. Foot Ankle Surg. 2018;24:11–8.

Herzog MM, Kerr ZY, Marshall SW, Wikstrom EA. Epidemiology of ankle sprains and chronic ankle instability. J Athl Train. 2019;54:603–10.

Houston MN, Hoch JM, Hoch MC. Patient-reported outcome measures in individuals with chronic ankle instability: a systematic review. J Athl Train. 2015;50:1019–33.

Karlsson JPL. (1991) Evaluation of the ankle joint function: the use of a scoring scale. Foot 15–9.

Kemler E, Thijs KM, Badenbroek I, van de Port IG, Hoes AW, Backx FJ. Long-term prognosis of acute lateral ankle ligamentous sprains: high incidence of recurrences and residual symptoms. Fam Pract. 2016;33:596–600.

Korstjens I, Moser A. Series: practical guidance to qualitative research. Part 2: context, research questions and designs. Eur J Gen Pract. 2017;23:274–9.

Lynn MR. Determination and quantification of content validity. Nurs Res. 1986;35:382–5.

Martin RL, Irrgang JJ. A survey of self-reported outcome instruments for the foot and ankle. J Orthop Sports Phys Ther. 2007;37:72–84.

Martin RL, Irrgang JJ, Burdett RG, Conti SF, Van Swearingen JM. Evidence of validity for the foot and ankle ability measure (FAAM). Foot Ankle Int. 2005;26:968–83.

Matsui K, Burgesson B, Takao M, Stone J, Guillo S, Glazebrook M, et al. Minimally invasive surgical treatment for chronic ankle instability: a systematic review. Knee Surg Sports Traumatol Arthrosc. 2016;24:1040–8.

Michels F, Pereira H, Calder J, Matricali G, Glazebrook M, Guillo S, et al. Searching for consensus in the approach to patients with chronic lateral ankle instability: ask the expert. Knee Surg Sports Traumatol Arthrosc. 2018;26:2095–102.

Mokkink LB, Prinsen CA, Patrick DL, Alonso J, Bouter LM, De Vet HC, Terwee CB. (2019) COSMIN Study Design checklist for Patient-reported outcome measurement instruments. Amsterdam, The Netherlands:1–32.

Mokkink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, et al. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol. 2010;10:22.

Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63:737–45.

Patrick DL, Burke LB, Powers JH, Scott JA, Rock EP, Dawisha S, et al. Patient-reported outcomes to support medical product labeling claims: FDA perspective. Value Health. 2007;10(Suppl 2):S125–137.

Polit DF, Beck CT. The content validity index: are you sure you know what’s being reported? Critique and recommendations. Res Nurs Health. 2006;29:489–97.

Porter ME. What is value in health care? N Engl J Med. 2010;363:2477–81.

Roos EM, Brandsson S, Karlsson J. Validation of the foot and ankle outcome score for ankle ligament reconstruction. Foot Ankle Int. 2001;22:788–94.

Roos EM, Roos HP, Lohmander LS, Ekdahl C, Beynnon BD. Knee Injury and Osteoarthritis Outcome score (KOOS)--development of a self-administered outcome measure. J Orthop Sports Phys Ther. 1998;28:88–96.

Sandelowski M. Theoretical Saturation. 2008.

Sierakowski K, Dean NR, Pusic AL, Cano SJ, Griffin PA, Bain GI, et al. International multiphase mixed methods study protocol to develop a cross-cultural patient-reported outcome and experience measure for hand conditions (HAND-Q). BMJ Open. 2019;9:e025822.

Spennacchio P, Meyer C, Karlsson J, Seil R, Mouton C, Senorski EH. Evaluation modalities for the anatomical repair of chronic ankle instability. Knee Surg Sports Traumatol Arthrosc. 2020;28:163–76.

Spennacchio P, Seil R, Mouton C, Scheidt S, Cucchi D. Anatomic reconstruction of lateral ankle ligaments: is there an optimal graft option? Knee Surg Sports Traumatol Arthrosc. 2022. https://doi.org/10.1007/s00167-022-07071-7 .

Streiner DL, Norman GR, Cairney J. Health measurment scales: a practical guide to their development and use. 2015 fifth edition, Oxford University Press.

Takao M, Oae K, Uchio Y, Ochi M, Yamamoto H. Anatomical reconstruction of the lateral ligaments of the ankle with a Gracilis autograft: a new technique using an interference fit anchoring system. Am J Sports Med. 2005;33:814–23.

Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42.

van Rijn RM, van Os AG, Bernsen RM, Luijsterburg PA, Koes BW, Bierma-Zeinstra SM. What is the clinical course of acute ankle sprains? A systematic literature review. Am J Med. 2008;121:324–31. e326.

Vuurberg G, Kluit L, van Dijk CN. The Cumberland Ankle Instability Tool (CAIT) in the Dutch population with and without complaints of ankle instability. Knee Surg Sports Traumatol Arthrosc. 2018;26:882–91.

Wilke AJ, Martin R, Bates NA, Jastifer JR, Martin KD. (2023) Technique variation in the Surgical treatment of lateral ankle instability. Foot Ankle Spec;10.1177/1938640023120202919386400231202029.

Download references

Acknowledgements

Author information, authors and affiliations.

Department of Orthopaedic Surgery, Centre Hospitalier de Luxembourg – Clinique d’Eich, 78 Rue d’Eich, Luxembourg, L-1460, Luxembourg

Pietro Spennacchio, Caroline Mouton & Romain Seil

Luxembourg Institute of Research in Orthopaedics, Sports Medicine and Science (LIROMS), Luxembourg, Luxembourg

Pietro Spennacchio, Caroline Mouton, Jan Cabri & Romain Seil

Unit of Physiotherapy, Department of Health and Rehabilitation, Institute of Neuroscience and Physiology, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden

Eric Hamrin Senorski

Department of Orthopaedics, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden

Jon Karlsson

You can also search for this author in PubMed   Google Scholar

Contributions

All authors contributed to the study protocol. PS wrote this study protocol manuscript with assistance from JK. All authors read and approved the final version.

Corresponding author

Correspondence to Pietro Spennacchio .

Ethics declarations

Ethics approval and consent to participate, consent for publication, competing interests.

The authors declare no competing interests.

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/ .

Reprints and permissions

About this article

Cite this article.

Spennacchio, P., Senorski, E.H., Mouton, C. et al. A new patient-reported outcome measure for the evaluation of ankle instability: description of the development process and validation protocol. J Orthop Surg Res 19 , 557 (2024). https://doi.org/10.1186/s13018-024-05057-4

Download citation

Received : 24 June 2024

Accepted : 03 September 2024

Published : 11 September 2024

DOI : https://doi.org/10.1186/s13018-024-05057-4

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Chronic ankle instability
• Patient-reported outcomes
• Surgical treatment
• Scale development

Journal of Orthopaedic Surgery and Research

ISSN: 1749-799X

• Submission enquiries: [email protected]