research methods help

News alert: UC Berkeley has announced its next university librarian

Secondary menu

Log in to your Library account
Hours and Maps
Connect from Off Campus
UC Berkeley Home

Search form

Research methods--quantitative, qualitative, and more: overview.

Quantitative Research
Qualitative Research
Data Science Methods (Machine Learning, AI, Big Data)
Text Mining and Computational Text Analysis
Evidence Synthesis/Systematic Reviews
Get Data, Get Help!

About Research Methods

This guide provides an overview of research methods, how to choose and use them, and supports and resources at UC Berkeley.

As Patten and Newhart note in the book Understanding Research Methods , "Research methods are the building blocks of the scientific enterprise. They are the "how" for building systematic knowledge. The accumulation of knowledge through research is by its nature a collective endeavor. Each well-designed study provides evidence that may support, amend, refute, or deepen the understanding of existing knowledge...Decisions are important throughout the practice of research and are designed to help researchers collect evidence that includes the full spectrum of the phenomenon under study, to maintain logical rules, and to mitigate or account for possible sources of bias. In many ways, learning research methods is learning how to see and make these decisions."

The choice of methods varies by discipline, by the kind of phenomenon being studied and the data being used to study it, by the technology available, and more. This guide is an introduction, but if you don't see what you need here, always contact your subject librarian, and/or take a look to see if there's a library research guide that will answer your question.

Suggestions for changes and additions to this guide are welcome!

START HERE: SAGE Research Methods

Without question, the most comprehensive resource available from the library is SAGE Research Methods. HERE IS THE ONLINE GUIDE to this one-stop shopping collection, and some helpful links are below:

SAGE Research Methods
Little Green Books (Quantitative Methods)
Little Blue Books (Qualitative Methods)
Dictionaries and Encyclopedias
Case studies of real research projects
Sample datasets for hands-on practice
Streaming video--see methods come to life
Methodspace- -a community for researchers
SAGE Research Methods Course Mapping

Library Data Services at UC Berkeley

Library Data Services Program and Digital Scholarship Services

The LDSP offers a variety of services and tools ! From this link, check out pages for each of the following topics: discovering data, managing data, collecting data, GIS data, text data mining, publishing data, digital scholarship, open science, and the Research Data Management Program.

Be sure also to check out the visual guide to where to seek assistance on campus with any research question you may have!

Library GIS Services

Other Data Services at Berkeley

D-Lab Supports Berkeley faculty, staff, and graduate students with research in data intensive social science, including a wide range of training and workshop offerings Dryad Dryad is a simple self-service tool for researchers to use in publishing their datasets. It provides tools for the effective publication of and access to research data. Geospatial Innovation Facility (GIF) Provides leadership and training across a broad array of integrated mapping technologies on campu Research Data Management A UC Berkeley guide and consulting service for research data management issues

General Research Methods Resources

Here are some general resources for assistance:

Assistance from ICPSR (must create an account to access): Getting Help with Data , and Resources for Students
Wiley Stats Ref for background information on statistics topics
Survey Documentation and Analysis (SDA) . Program for easy web-based analysis of survey data.

Consultants

D-Lab/Data Science Discovery Consultants Request help with your research project from peer consultants.
Research data (RDM) consulting Meet with RDM consultants before designing the data security, storage, and sharing aspects of your qualitative project.
Statistics Department Consulting Services A service in which advanced graduate students, under faculty supervision, are available to consult during specified hours in the Fall and Spring semesters.

Related Resourcex

IRB / CPHS Qualitative research projects with human subjects often require that you go through an ethics review.
OURS (Office of Undergraduate Research and Scholarships) OURS supports undergraduates who want to embark on research projects and assistantships. In particular, check out their "Getting Started in Research" workshops
Sponsored Projects Sponsored projects works with researchers applying for major external grants.
Next: Quantitative Research >>
Last Updated: Apr 25, 2024 11:09 AM
URL: https://guides.lib.berkeley.edu/researchmethods

Have a language expert improve your writing

Run a free plagiarism check in 10 minutes, automatically generate references for free.

Knowledge Base
Methodology

Research Methods | Definition, Types, Examples

Research methods are specific procedures for collecting and analysing data. Developing your research methods is an integral part of your research design . When planning your methods, there are two key decisions you will make.

First, decide how you will collect data . Your methods depend on what type of data you need to answer your research question :

Qualitative vs quantitative : Will your data take the form of words or numbers?
Primary vs secondary : Will you collect original data yourself, or will you use data that have already been collected by someone else?
Descriptive vs experimental : Will you take measurements of something as it is, or will you perform an experiment?

Second, decide how you will analyse the data .

For quantitative data, you can use statistical analysis methods to test relationships between variables.
For qualitative data, you can use methods such as thematic analysis to interpret patterns and meanings in the data.

Methods for collecting data, examples of data collection methods, methods for analysing data, examples of data analysis methods, frequently asked questions about methodology.

Data are the information that you collect for the purposes of answering your research question . The type of data you need depends on the aims of your research.

Qualitative vs quantitative data

Your choice of qualitative or quantitative data collection depends on the type of knowledge you want to develop.

For questions about ideas, experiences and meanings, or to study something that can’t be described numerically, collect qualitative data .

If you want to develop a more mechanistic understanding of a topic, or your research involves hypothesis testing , collect quantitative data .

You can also take a mixed methods approach, where you use both qualitative and quantitative research methods.

Primary vs secondary data

Primary data are any original information that you collect for the purposes of answering your research question (e.g. through surveys , observations and experiments ). Secondary data are information that has already been collected by other researchers (e.g. in a government census or previous scientific studies).

If you are exploring a novel research question, you’ll probably need to collect primary data. But if you want to synthesise existing knowledge, analyse historical trends, or identify patterns on a large scale, secondary data might be a better choice.

Descriptive vs experimental data

In descriptive research , you collect data about your study subject without intervening. The validity of your research will depend on your sampling method .

In experimental research , you systematically intervene in a process and measure the outcome. The validity of your research will depend on your experimental design .

To conduct an experiment, you need to be able to vary your independent variable , precisely measure your dependent variable, and control for confounding variables . If it’s practically and ethically possible, this method is the best choice for answering questions about cause and effect.

Prevent plagiarism, run a free check.

Your data analysis methods will depend on the type of data you collect and how you prepare them for analysis.

Data can often be analysed both quantitatively and qualitatively. For example, survey responses could be analysed qualitatively by studying the meanings of responses or quantitatively by studying the frequencies of responses.

Qualitative analysis methods

Qualitative analysis is used to understand words, ideas, and experiences. You can use it to interpret data that were collected:

From open-ended survey and interview questions, literature reviews, case studies, and other sources that use text rather than numbers.
Using non-probability sampling methods .

Qualitative analysis tends to be quite flexible and relies on the researcher’s judgement, so you have to reflect carefully on your choices and assumptions.

Quantitative analysis methods

Quantitative analysis uses numbers and statistics to understand frequencies, averages and correlations (in descriptive studies) or cause-and-effect relationships (in experiments).

You can use quantitative analysis to interpret data that were collected either:

During an experiment.
Using probability sampling methods .

Because the data are collected and analysed in a statistically valid way, the results of quantitative analysis can be easily standardised and shared among researchers.

Quantitative research deals with numbers and statistics, while qualitative research deals with words and meanings.

Quantitative methods allow you to test a hypothesis by systematically collecting and analysing data, while qualitative methods allow you to explore ideas and experiences in depth.

In mixed methods research , you use both qualitative and quantitative data collection and analysis methods to answer your research question .

A sample is a subset of individuals from a larger population. Sampling means selecting the group that you will actually collect data from in your research.

For example, if you are researching the opinions of students in your university, you could survey a sample of 100 students.

Statistical sampling allows you to test a hypothesis about the characteristics of a population. There are various sampling methods you can use to ensure that your sample is representative of the population as a whole.

The research methods you use depend on the type of data you need to answer your research question .

If you want to measure something or test a hypothesis , use quantitative methods . If you want to explore ideas, thoughts, and meanings, use qualitative methods .
If you want to analyse a large amount of readily available data, use secondary data. If you want data specific to your purposes with control over how they are generated, collect primary data.
If you want to establish cause-and-effect relationships between variables , use experimental methods. If you want to understand the characteristics of a research subject, use descriptive methods.

Methodology refers to the overarching strategy and rationale of your research project . It involves studying the methods used in your field and the theories or principles behind them, in order to develop an approach that matches your objectives.

Methods are the specific tools and procedures you use to collect and analyse data (e.g. experiments, surveys , and statistical tests ).

In shorter scientific papers, where the aim is to report the findings of a specific study, you might simply describe what you did in a methods section .

In a longer or more complex research project, such as a thesis or dissertation , you will probably include a methodology section , where you explain your approach to answering the research questions and cite relevant sources to support your choice of methods.

Is this article helpful?

Research Methods: What are research methods?

What are research methods?
Searching specific databases

What are research methods

Research methods are the strategies, processes or techniques utilized in the collection of data or evidence for analysis in order to uncover new information or create better understanding of a topic.

There are different types of research methods which use different tools for data collection.

Types of research

Qualitative Research
Quantitative Research
Mixed Methods Research

Qualitative Research gathers data about lived experiences, emotions or behaviours, and the meanings individuals attach to them. It assists in enabling researchers to gain a better understanding of complex concepts, social interactions or cultural phenomena. This type of research is useful in the exploration of how or why things have occurred, interpreting events and describing actions.

Quantitative Research gathers numerical data which can be ranked, measured or categorised through statistical analysis. It assists with uncovering patterns or relationships, and for making generalisations. This type of research is useful for finding out how many, how much, how often, or to what extent.

Mixed Methods Research integrates both Q ualitative and Quantitative Research . It provides a holistic approach combining and analysing the statistical data with deeper contextualised insights. Using Mixed Methods also enables Triangulation, or verification, of the data from two or more sources.

Finding Mixed Methods research in the Databases

“mixed model*” OR “mixed design*” OR “multiple method*” OR multimethod* OR triangulat*

Data collection tools

Sage research methods.

SAGE research methods online This link opens in a new window Research methods tool to help researchers gather full-text resources, design research projects, understand a particular method and write up their research. Includes access to collections of video, business cases and eBooks,

Help and Information

Next: Finding qualitative research >>
Last Updated: Apr 18, 2024 11:16 AM
URL: https://libguides.newcastle.edu.au/researchmethods

Reference management. Clean and simple.

What is research methodology?

The basics of research methodology

Why do you need a research methodology, what needs to be included, why do you need to document your research method, what are the different types of research instruments, qualitative / quantitative / mixed research methodologies, how do you choose the best research methodology for you, frequently asked questions about research methodology, related articles.

When you’re working on your first piece of academic research, there are many different things to focus on, and it can be overwhelming to stay on top of everything. This is especially true of budding or inexperienced researchers.

If you’ve never put together a research proposal before or find yourself in a position where you need to explain your research methodology decisions, there are a few things you need to be aware of.

Once you understand the ins and outs, handling academic research in the future will be less intimidating. We break down the basics below:

A research methodology encompasses the way in which you intend to carry out your research. This includes how you plan to tackle things like collection methods, statistical analysis, participant observations, and more.

You can think of your research methodology as being a formula. One part will be how you plan on putting your research into practice, and another will be why you feel this is the best way to approach it. Your research methodology is ultimately a methodological and systematic plan to resolve your research problem.

In short, you are explaining how you will take your idea and turn it into a study, which in turn will produce valid and reliable results that are in accordance with the aims and objectives of your research. This is true whether your paper plans to make use of qualitative methods or quantitative methods.

The purpose of a research methodology is to explain the reasoning behind your approach to your research - you'll need to support your collection methods, methods of analysis, and other key points of your work.

Think of it like writing a plan or an outline for you what you intend to do.

When carrying out research, it can be easy to go off-track or depart from your standard methodology.

Tip: Having a methodology keeps you accountable and on track with your original aims and objectives, and gives you a suitable and sound plan to keep your project manageable, smooth, and effective.

With all that said, how do you write out your standard approach to a research methodology?

As a general plan, your methodology should include the following information:

Your research method. You need to state whether you plan to use quantitative analysis, qualitative analysis, or mixed-method research methods. This will often be determined by what you hope to achieve with your research.
Explain your reasoning. Why are you taking this methodological approach? Why is this particular methodology the best way to answer your research problem and achieve your objectives?
Explain your instruments. This will mainly be about your collection methods. There are varying instruments to use such as interviews, physical surveys, questionnaires, for example. Your methodology will need to detail your reasoning in choosing a particular instrument for your research.
What will you do with your results? How are you going to analyze the data once you have gathered it?
Advise your reader. If there is anything in your research methodology that your reader might be unfamiliar with, you should explain it in more detail. For example, you should give any background information to your methods that might be relevant or provide your reasoning if you are conducting your research in a non-standard way.
How will your sampling process go? What will your sampling procedure be and why? For example, if you will collect data by carrying out semi-structured or unstructured interviews, how will you choose your interviewees and how will you conduct the interviews themselves?
Any practical limitations? You should discuss any limitations you foresee being an issue when you’re carrying out your research.

In any dissertation, thesis, or academic journal, you will always find a chapter dedicated to explaining the research methodology of the person who carried out the study, also referred to as the methodology section of the work.

A good research methodology will explain what you are going to do and why, while a poor methodology will lead to a messy or disorganized approach.

You should also be able to justify in this section your reasoning for why you intend to carry out your research in a particular way, especially if it might be a particularly unique method.

Having a sound methodology in place can also help you with the following:

When another researcher at a later date wishes to try and replicate your research, they will need your explanations and guidelines.
In the event that you receive any criticism or questioning on the research you carried out at a later point, you will be able to refer back to it and succinctly explain the how and why of your approach.
It provides you with a plan to follow throughout your research. When you are drafting your methodology approach, you need to be sure that the method you are using is the right one for your goal. This will help you with both explaining and understanding your method.
It affords you the opportunity to document from the outset what you intend to achieve with your research, from start to finish.

A research instrument is a tool you will use to help you collect, measure and analyze the data you use as part of your research.

The choice of research instrument will usually be yours to make as the researcher and will be whichever best suits your methodology.

There are many different research instruments you can use in collecting data for your research.

Generally, they can be grouped as follows:

Interviews (either as a group or one-on-one). You can carry out interviews in many different ways. For example, your interview can be structured, semi-structured, or unstructured. The difference between them is how formal the set of questions is that is asked of the interviewee. In a group interview, you may choose to ask the interviewees to give you their opinions or perceptions on certain topics.
Surveys (online or in-person). In survey research, you are posing questions in which you ask for a response from the person taking the survey. You may wish to have either free-answer questions such as essay-style questions, or you may wish to use closed questions such as multiple choice. You may even wish to make the survey a mixture of both.
Focus Groups. Similar to the group interview above, you may wish to ask a focus group to discuss a particular topic or opinion while you make a note of the answers given.
Observations. This is a good research instrument to use if you are looking into human behaviors. Different ways of researching this include studying the spontaneous behavior of participants in their everyday life, or something more structured. A structured observation is research conducted at a set time and place where researchers observe behavior as planned and agreed upon with participants.

These are the most common ways of carrying out research, but it is really dependent on your needs as a researcher and what approach you think is best to take.

It is also possible to combine a number of research instruments if this is necessary and appropriate in answering your research problem.

There are three different types of methodologies, and they are distinguished by whether they focus on words, numbers, or both.

➡️ Want to learn more about the differences between qualitative and quantitative research, and how to use both methods? Check out our guide for that!

If you've done your due diligence, you'll have an idea of which methodology approach is best suited to your research.

It’s likely that you will have carried out considerable reading and homework before you reach this point and you may have taken inspiration from other similar studies that have yielded good results.

Still, it is important to consider different options before setting your research in stone. Exploring different options available will help you to explain why the choice you ultimately make is preferable to other methods.

If proving your research problem requires you to gather large volumes of numerical data to test hypotheses, a quantitative research method is likely to provide you with the most usable results.

If instead you’re looking to try and learn more about people, and their perception of events, your methodology is more exploratory in nature and would therefore probably be better served using a qualitative research methodology.

It helps to always bring things back to the question: what do I want to achieve with my research?

Once you have conducted your research, you need to analyze it. Here are some helpful guides for qualitative data analysis:

➡️ How to do a content analysis

➡️ How to do a thematic analysis

➡️ How to do a rhetorical analysis

Research methodology refers to the techniques used to find and analyze information for a study, ensuring that the results are valid, reliable and that they address the research objective.

Data can typically be organized into four different categories or methods: observational, experimental, simulation, and derived.

Writing a methodology section is a process of introducing your methods and instruments, discussing your analysis, providing more background information, addressing your research limitations, and more.

Your research methodology section will need a clear research question and proposed research approach. You'll need to add a background, introduce your research question, write your methodology and add the works you cited during your data collecting phase.

The research methodology section of your study will indicate how valid your findings are and how well-informed your paper is. It also assists future researchers planning to use the same methodology, who want to cite your study or replicate it.

University Libraries
Research Guides
Topic Guides
Research Methods Guide
Research Design & Method

Research Methods Guide: Research Design & Method

Introduction
Survey Research
Interview Research
Data Analysis
Resources & Consultation

Tutorial Videos: Research Design & Method

Research Methods (sociology-focused)

Qualitative vs. Quantitative Methods (intro)

Qualitative vs. Quantitative Methods (advanced)

FAQ: Research Design & Method

What is the difference between Research Design and Research Method?

Research design is a plan to answer your research question. A research method is a strategy used to implement that plan. Research design and methods are different but closely related, because good research design ensures that the data you obtain will help you answer your research question more effectively.

Which research method should I choose ?

It depends on your research goal. It depends on what subjects (and who) you want to study. Let's say you are interested in studying what makes people happy, or why some students are more conscious about recycling on campus. To answer these questions, you need to make a decision about how to collect your data. Most frequently used methods include:

Observation / Participant Observation
Focus Groups
Experiments
Secondary Data Analysis / Archival Study
Mixed Methods (combination of some of the above)

One particular method could be better suited to your research goal than others, because the data you collect from different methods will be different in quality and quantity. For instance, surveys are usually designed to produce relatively short answers, rather than the extensive responses expected in qualitative interviews.

What other factors should I consider when choosing one method over another?

Time for data collection and analysis is something you want to consider. An observation or interview method, so-called qualitative approach, helps you collect richer information, but it takes time. Using a survey helps you collect more data quickly, yet it may lack details. So, you will need to consider the time you have for research and the balance between strengths and weaknesses associated with each method (e.g., qualitative vs. quantitative).

<< Previous: Introduction
Next: Survey Research >>
Last Updated: Aug 21, 2023 10:42 AM

LEARNING SKILLS

Research Methods

Search SkillsYouNeed:

Learning Skills:

A - Z List of Learning Skills
What is Learning?
Learning Approaches
Learning Styles
8 Types of Learning Styles
Understanding Your Preferences to Aid Learning
Lifelong Learning
Decisions to Make Before Applying to University
Top Tips for Surviving Student Life
Living Online: Education and Learning
8 Ways to Embrace Technology-Based Learning Approaches
Critical Thinking Skills
Critical Thinking and Fake News
Understanding and Addressing Conspiracy Theories
Critical Analysis
Study Skills
Exam Skills
Writing a Dissertation or Thesis
Introduction to Research Methods
Designing Research
Quantitative and Qualitative Research Methods

Qualitative Research Designs

Interviews for Research
Focus Groups
Qualitative Data from Interactions

Quantitative Research Designs

Sampling and Sample Design
Surveys and Survey Design
Observational Research and Secondary Data

Analysing Research Data

Analysing Qualitative Data
Simple Statistical Analysis
Statistical Analysis: Types of Data
Understanding Correlations
Understanding Statistical Distributions
Significance and Confidence Intervals
Developing and Testing Hypotheses
Multivariate Analysis

Get the SkillsYouNeed Research Methods eBook

Part of the Skills You Need Guide for Students .

Teaching, Coaching, Mentoring and Counselling
Employability Skills for Graduates

Subscribe to our FREE newsletter and start improving your life in just 5 minutes a day.

You'll get our 5 free 'One Minute Life Skills' and our weekly newsletter.

We'll never share your email address and you can unsubscribe at any time.

Most people first encounter research as part of a school or college course.

A piece of research is usually included in any advanced degree course, and may also be integral to undergraduate degrees. Basic research, such as issuing questionnaires, may be undertaken in social science classes at school.

But there are many more applications for quality research.

These include market research to discover customer preferences, or to establish whether a new product will sell, and focus groups to discuss politics.

Our Research Methods pages are designed to help you choose and then use the right research method for your purposes.

They cover the whole process of research, from understanding the philosophical theory underpinning your choice of method, through choosing the methods that you will use to answer your research question, to collecting data and then analysing it.

Introducing Research Methods

Your research method depends on the question that you wish to answer, and the philosophy that underpins your view of research.

The best place to start is our page An Introduction to Research Methods . This sets out the basic principles of research design, and the role of the researcher.

Our page on Designing Research explains how to approach research, and what to think about in designing your research. It sets out some possible research approaches, including experimental and quasi-experimental designs, survey research, and ethnography.

Finally, you need to make a decision about whether your research will be Qualitative or Quantitative , or even mixed.

Qualitative research is concerned with human behaviour, and why people act the way that they do.

Common methods used for qualitative research include Interviews and Focus Groups and Group Interviews . Both these methods allow researchers to explore a topic in depth with one or two people at a time, or within a small group. You can also collect Qualitative Data from Interactions , in research that recognises that the researcher is a key part of the situation, rather than an outside observer.

Quantitative research always collects numerical data.

If you are not collecting numbers, then your research is qualitative, not quantitative. Quantitative research is usually used to get views from large numbers of people.

The first step in quantitative research is to determine your Sampling and Sample Design . You then need to gather data. Suitable methods include surveys (and our page on Surveys and Survey Design explains more about this surprisingly complex subject).

Other sources of data include Observational and Secondary Data .

Your choice of analysis method will depend heavily on your choice of research method.

For example, for qualitative research, you may need an approach like content analysis, because you will have generated large amounts of data, often narrative in form. Our page on Analysing Qualitative Data explains more.

Quantitative data is often analysed using statistical methods, which may be both simple and more complex, depending on the question you are trying to answer. Our page on Simple Statistical Analysis suggests some suitable starting points, with more information available on Understanding Correlations , Hypothesis Testing and Multivariate Analysis .

How to use and assess qualitative research methods

Loraine busetto.

1 Department of Neurology, Heidelberg University Hospital, Im Neuenheimer Feld 400, 69120 Heidelberg, Germany

Wolfgang Wick

2 Clinical Cooperation Unit Neuro-Oncology, German Cancer Research Center, Heidelberg, Germany

Christoph Gumbinger

Associated data.

Not applicable.

This paper aims to provide an overview of the use and assessment of qualitative research methods in the health sciences. Qualitative research can be defined as the study of the nature of phenomena and is especially appropriate for answering questions of why something is (not) observed, assessing complex multi-component interventions, and focussing on intervention improvement. The most common methods of data collection are document study, (non-) participant observations, semi-structured interviews and focus groups. For data analysis, field-notes and audio-recordings are transcribed into protocols and transcripts, and coded using qualitative data management software. Criteria such as checklists, reflexivity, sampling strategies, piloting, co-coding, member-checking and stakeholder involvement can be used to enhance and assess the quality of the research conducted. Using qualitative in addition to quantitative designs will equip us with better tools to address a greater range of research problems, and to fill in blind spots in current neurological research and practice.

The aim of this paper is to provide an overview of qualitative research methods, including hands-on information on how they can be used, reported and assessed. This article is intended for beginning qualitative researchers in the health sciences as well as experienced quantitative researchers who wish to broaden their understanding of qualitative research.

What is qualitative research?

Qualitative research is defined as “the study of the nature of phenomena”, including “their quality, different manifestations, the context in which they appear or the perspectives from which they can be perceived” , but excluding “their range, frequency and place in an objectively determined chain of cause and effect” [ 1 ]. This formal definition can be complemented with a more pragmatic rule of thumb: qualitative research generally includes data in form of words rather than numbers [ 2 ].

Why conduct qualitative research?

Because some research questions cannot be answered using (only) quantitative methods. For example, one Australian study addressed the issue of why patients from Aboriginal communities often present late or not at all to specialist services offered by tertiary care hospitals. Using qualitative interviews with patients and staff, it found one of the most significant access barriers to be transportation problems, including some towns and communities simply not having a bus service to the hospital [ 3 ]. A quantitative study could have measured the number of patients over time or even looked at possible explanatory factors – but only those previously known or suspected to be of relevance. To discover reasons for observed patterns, especially the invisible or surprising ones, qualitative designs are needed.

While qualitative research is common in other fields, it is still relatively underrepresented in health services research. The latter field is more traditionally rooted in the evidence-based-medicine paradigm, as seen in " research that involves testing the effectiveness of various strategies to achieve changes in clinical practice, preferably applying randomised controlled trial study designs (...) " [ 4 ]. This focus on quantitative research and specifically randomised controlled trials (RCT) is visible in the idea of a hierarchy of research evidence which assumes that some research designs are objectively better than others, and that choosing a "lesser" design is only acceptable when the better ones are not practically or ethically feasible [ 5 , 6 ]. Others, however, argue that an objective hierarchy does not exist, and that, instead, the research design and methods should be chosen to fit the specific research question at hand – "questions before methods" [ 2 , 7 – 9 ]. This means that even when an RCT is possible, some research problems require a different design that is better suited to addressing them. Arguing in JAMA, Berwick uses the example of rapid response teams in hospitals, which he describes as " a complex, multicomponent intervention – essentially a process of social change" susceptible to a range of different context factors including leadership or organisation history. According to him, "[in] such complex terrain, the RCT is an impoverished way to learn. Critics who use it as a truth standard in this context are incorrect" [ 8 ] . Instead of limiting oneself to RCTs, Berwick recommends embracing a wider range of methods , including qualitative ones, which for "these specific applications, (...) are not compromises in learning how to improve; they are superior" [ 8 ].

Research problems that can be approached particularly well using qualitative methods include assessing complex multi-component interventions or systems (of change), addressing questions beyond “what works”, towards “what works for whom when, how and why”, and focussing on intervention improvement rather than accreditation [ 7 , 9 – 12 ]. Using qualitative methods can also help shed light on the “softer” side of medical treatment. For example, while quantitative trials can measure the costs and benefits of neuro-oncological treatment in terms of survival rates or adverse effects, qualitative research can help provide a better understanding of patient or caregiver stress, visibility of illness or out-of-pocket expenses.

How to conduct qualitative research?

Given that qualitative research is characterised by flexibility, openness and responsivity to context, the steps of data collection and analysis are not as separate and consecutive as they tend to be in quantitative research [ 13 , 14 ]. As Fossey puts it : “sampling, data collection, analysis and interpretation are related to each other in a cyclical (iterative) manner, rather than following one after another in a stepwise approach” [ 15 ]. The researcher can make educated decisions with regard to the choice of method, how they are implemented, and to which and how many units they are applied [ 13 ]. As shown in Fig. 1 , this can involve several back-and-forth steps between data collection and analysis where new insights and experiences can lead to adaption and expansion of the original plan. Some insights may also necessitate a revision of the research question and/or the research design as a whole. The process ends when saturation is achieved, i.e. when no relevant new information can be found (see also below: sampling and saturation). For reasons of transparency, it is essential for all decisions as well as the underlying reasoning to be well-documented.

An external file that holds a picture, illustration, etc.
Object name is 42466_2020_59_Fig1_HTML.jpg

Iterative research process

While it is not always explicitly addressed, qualitative methods reflect a different underlying research paradigm than quantitative research (e.g. constructivism or interpretivism as opposed to positivism). The choice of methods can be based on the respective underlying substantive theory or theoretical framework used by the researcher [ 2 ].

Data collection

The methods of qualitative data collection most commonly used in health research are document study, observations, semi-structured interviews and focus groups [ 1 , 14 , 16 , 17 ].

Document study

Document study (also called document analysis) refers to the review by the researcher of written materials [ 14 ]. These can include personal and non-personal documents such as archives, annual reports, guidelines, policy documents, diaries or letters.

Observations

Observations are particularly useful to gain insights into a certain setting and actual behaviour – as opposed to reported behaviour or opinions [ 13 ]. Qualitative observations can be either participant or non-participant in nature. In participant observations, the observer is part of the observed setting, for example a nurse working in an intensive care unit [ 18 ]. In non-participant observations, the observer is “on the outside looking in”, i.e. present in but not part of the situation, trying not to influence the setting by their presence. Observations can be planned (e.g. for 3 h during the day or night shift) or ad hoc (e.g. as soon as a stroke patient arrives at the emergency room). During the observation, the observer takes notes on everything or certain pre-determined parts of what is happening around them, for example focusing on physician-patient interactions or communication between different professional groups. Written notes can be taken during or after the observations, depending on feasibility (which is usually lower during participant observations) and acceptability (e.g. when the observer is perceived to be judging the observed). Afterwards, these field notes are transcribed into observation protocols. If more than one observer was involved, field notes are taken independently, but notes can be consolidated into one protocol after discussions. Advantages of conducting observations include minimising the distance between the researcher and the researched, the potential discovery of topics that the researcher did not realise were relevant and gaining deeper insights into the real-world dimensions of the research problem at hand [ 18 ].

Semi-structured interviews

Hijmans & Kuyper describe qualitative interviews as “an exchange with an informal character, a conversation with a goal” [ 19 ]. Interviews are used to gain insights into a person’s subjective experiences, opinions and motivations – as opposed to facts or behaviours [ 13 ]. Interviews can be distinguished by the degree to which they are structured (i.e. a questionnaire), open (e.g. free conversation or autobiographical interviews) or semi-structured [ 2 , 13 ]. Semi-structured interviews are characterized by open-ended questions and the use of an interview guide (or topic guide/list) in which the broad areas of interest, sometimes including sub-questions, are defined [ 19 ]. The pre-defined topics in the interview guide can be derived from the literature, previous research or a preliminary method of data collection, e.g. document study or observations. The topic list is usually adapted and improved at the start of the data collection process as the interviewer learns more about the field [ 20 ]. Across interviews the focus on the different (blocks of) questions may differ and some questions may be skipped altogether (e.g. if the interviewee is not able or willing to answer the questions or for concerns about the total length of the interview) [ 20 ]. Qualitative interviews are usually not conducted in written format as it impedes on the interactive component of the method [ 20 ]. In comparison to written surveys, qualitative interviews have the advantage of being interactive and allowing for unexpected topics to emerge and to be taken up by the researcher. This can also help overcome a provider or researcher-centred bias often found in written surveys, which by nature, can only measure what is already known or expected to be of relevance to the researcher. Interviews can be audio- or video-taped; but sometimes it is only feasible or acceptable for the interviewer to take written notes [ 14 , 16 , 20 ].

Focus groups

Focus groups are group interviews to explore participants’ expertise and experiences, including explorations of how and why people behave in certain ways [ 1 ]. Focus groups usually consist of 6–8 people and are led by an experienced moderator following a topic guide or “script” [ 21 ]. They can involve an observer who takes note of the non-verbal aspects of the situation, possibly using an observation guide [ 21 ]. Depending on researchers’ and participants’ preferences, the discussions can be audio- or video-taped and transcribed afterwards [ 21 ]. Focus groups are useful for bringing together homogeneous (to a lesser extent heterogeneous) groups of participants with relevant expertise and experience on a given topic on which they can share detailed information [ 21 ]. Focus groups are a relatively easy, fast and inexpensive method to gain access to information on interactions in a given group, i.e. “the sharing and comparing” among participants [ 21 ]. Disadvantages include less control over the process and a lesser extent to which each individual may participate. Moreover, focus group moderators need experience, as do those tasked with the analysis of the resulting data. Focus groups can be less appropriate for discussing sensitive topics that participants might be reluctant to disclose in a group setting [ 13 ]. Moreover, attention must be paid to the emergence of “groupthink” as well as possible power dynamics within the group, e.g. when patients are awed or intimidated by health professionals.

Choosing the “right” method

As explained above, the school of thought underlying qualitative research assumes no objective hierarchy of evidence and methods. This means that each choice of single or combined methods has to be based on the research question that needs to be answered and a critical assessment with regard to whether or to what extent the chosen method can accomplish this – i.e. the “fit” between question and method [ 14 ]. It is necessary for these decisions to be documented when they are being made, and to be critically discussed when reporting methods and results.

Let us assume that our research aim is to examine the (clinical) processes around acute endovascular treatment (EVT), from the patient’s arrival at the emergency room to recanalization, with the aim to identify possible causes for delay and/or other causes for sub-optimal treatment outcome. As a first step, we could conduct a document study of the relevant standard operating procedures (SOPs) for this phase of care – are they up-to-date and in line with current guidelines? Do they contain any mistakes, irregularities or uncertainties that could cause delays or other problems? Regardless of the answers to these questions, the results have to be interpreted based on what they are: a written outline of what care processes in this hospital should look like. If we want to know what they actually look like in practice, we can conduct observations of the processes described in the SOPs. These results can (and should) be analysed in themselves, but also in comparison to the results of the document analysis, especially as regards relevant discrepancies. Do the SOPs outline specific tests for which no equipment can be observed or tasks to be performed by specialized nurses who are not present during the observation? It might also be possible that the written SOP is outdated, but the actual care provided is in line with current best practice. In order to find out why these discrepancies exist, it can be useful to conduct interviews. Are the physicians simply not aware of the SOPs (because their existence is limited to the hospital’s intranet) or do they actively disagree with them or does the infrastructure make it impossible to provide the care as described? Another rationale for adding interviews is that some situations (or all of their possible variations for different patient groups or the day, night or weekend shift) cannot practically or ethically be observed. In this case, it is possible to ask those involved to report on their actions – being aware that this is not the same as the actual observation. A senior physician’s or hospital manager’s description of certain situations might differ from a nurse’s or junior physician’s one, maybe because they intentionally misrepresent facts or maybe because different aspects of the process are visible or important to them. In some cases, it can also be relevant to consider to whom the interviewee is disclosing this information – someone they trust, someone they are otherwise not connected to, or someone they suspect or are aware of being in a potentially “dangerous” power relationship to them. Lastly, a focus group could be conducted with representatives of the relevant professional groups to explore how and why exactly they provide care around EVT. The discussion might reveal discrepancies (between SOPs and actual care or between different physicians) and motivations to the researchers as well as to the focus group members that they might not have been aware of themselves. For the focus group to deliver relevant information, attention has to be paid to its composition and conduct, for example, to make sure that all participants feel safe to disclose sensitive or potentially problematic information or that the discussion is not dominated by (senior) physicians only. The resulting combination of data collection methods is shown in Fig. 2 .

An external file that holds a picture, illustration, etc.
Object name is 42466_2020_59_Fig2_HTML.jpg

Possible combination of data collection methods

Attributions for icons: “Book” by Serhii Smirnov, “Interview” by Adrien Coquet, FR, “Magnifying Glass” by anggun, ID, “Business communication” by Vectors Market; all from the Noun Project

The combination of multiple data source as described for this example can be referred to as “triangulation”, in which multiple measurements are carried out from different angles to achieve a more comprehensive understanding of the phenomenon under study [ 22 , 23 ].

Data analysis

To analyse the data collected through observations, interviews and focus groups these need to be transcribed into protocols and transcripts (see Fig. 3 ). Interviews and focus groups can be transcribed verbatim , with or without annotations for behaviour (e.g. laughing, crying, pausing) and with or without phonetic transcription of dialects and filler words, depending on what is expected or known to be relevant for the analysis. In the next step, the protocols and transcripts are coded , that is, marked (or tagged, labelled) with one or more short descriptors of the content of a sentence or paragraph [ 2 , 15 , 23 ]. Jansen describes coding as “connecting the raw data with “theoretical” terms” [ 20 ]. In a more practical sense, coding makes raw data sortable. This makes it possible to extract and examine all segments describing, say, a tele-neurology consultation from multiple data sources (e.g. SOPs, emergency room observations, staff and patient interview). In a process of synthesis and abstraction, the codes are then grouped, summarised and/or categorised [ 15 , 20 ]. The end product of the coding or analysis process is a descriptive theory of the behavioural pattern under investigation [ 20 ]. The coding process is performed using qualitative data management software, the most common ones being InVivo, MaxQDA and Atlas.ti. It should be noted that these are data management tools which support the analysis performed by the researcher(s) [ 14 ].

An external file that holds a picture, illustration, etc.
Object name is 42466_2020_59_Fig3_HTML.jpg

From data collection to data analysis

Attributions for icons: see Fig. Fig.2, 2 , also “Speech to text” by Trevor Dsouza, “Field Notes” by Mike O’Brien, US, “Voice Record” by ProSymbols, US, “Inspection” by Made, AU, and “Cloud” by Graphic Tigers; all from the Noun Project

How to report qualitative research?

Protocols of qualitative research can be published separately and in advance of the study results. However, the aim is not the same as in RCT protocols, i.e. to pre-define and set in stone the research questions and primary or secondary endpoints. Rather, it is a way to describe the research methods in detail, which might not be possible in the results paper given journals’ word limits. Qualitative research papers are usually longer than their quantitative counterparts to allow for deep understanding and so-called “thick description”. In the methods section, the focus is on transparency of the methods used, including why, how and by whom they were implemented in the specific study setting, so as to enable a discussion of whether and how this may have influenced data collection, analysis and interpretation. The results section usually starts with a paragraph outlining the main findings, followed by more detailed descriptions of, for example, the commonalities, discrepancies or exceptions per category [ 20 ]. Here it is important to support main findings by relevant quotations, which may add information, context, emphasis or real-life examples [ 20 , 23 ]. It is subject to debate in the field whether it is relevant to state the exact number or percentage of respondents supporting a certain statement (e.g. “Five interviewees expressed negative feelings towards XYZ”) [ 21 ].

How to combine qualitative with quantitative research?

Qualitative methods can be combined with other methods in multi- or mixed methods designs, which “[employ] two or more different methods [ …] within the same study or research program rather than confining the research to one single method” [ 24 ]. Reasons for combining methods can be diverse, including triangulation for corroboration of findings, complementarity for illustration and clarification of results, expansion to extend the breadth and range of the study, explanation of (unexpected) results generated with one method with the help of another, or offsetting the weakness of one method with the strength of another [ 1 , 17 , 24 – 26 ]. The resulting designs can be classified according to when, why and how the different quantitative and/or qualitative data strands are combined. The three most common types of mixed method designs are the convergent parallel design , the explanatory sequential design and the exploratory sequential design. The designs with examples are shown in Fig. 4 .

An external file that holds a picture, illustration, etc.
Object name is 42466_2020_59_Fig4_HTML.jpg

Three common mixed methods designs

In the convergent parallel design, a qualitative study is conducted in parallel to and independently of a quantitative study, and the results of both studies are compared and combined at the stage of interpretation of results. Using the above example of EVT provision, this could entail setting up a quantitative EVT registry to measure process times and patient outcomes in parallel to conducting the qualitative research outlined above, and then comparing results. Amongst other things, this would make it possible to assess whether interview respondents’ subjective impressions of patients receiving good care match modified Rankin Scores at follow-up, or whether observed delays in care provision are exceptions or the rule when compared to door-to-needle times as documented in the registry. In the explanatory sequential design, a quantitative study is carried out first, followed by a qualitative study to help explain the results from the quantitative study. This would be an appropriate design if the registry alone had revealed relevant delays in door-to-needle times and the qualitative study would be used to understand where and why these occurred, and how they could be improved. In the exploratory design, the qualitative study is carried out first and its results help informing and building the quantitative study in the next step [ 26 ]. If the qualitative study around EVT provision had shown a high level of dissatisfaction among the staff members involved, a quantitative questionnaire investigating staff satisfaction could be set up in the next step, informed by the qualitative study on which topics dissatisfaction had been expressed. Amongst other things, the questionnaire design would make it possible to widen the reach of the research to more respondents from different (types of) hospitals, regions, countries or settings, and to conduct sub-group analyses for different professional groups.

How to assess qualitative research?

A variety of assessment criteria and lists have been developed for qualitative research, ranging in their focus and comprehensiveness [ 14 , 17 , 27 ]. However, none of these has been elevated to the “gold standard” in the field. In the following, we therefore focus on a set of commonly used assessment criteria that, from a practical standpoint, a researcher can look for when assessing a qualitative research report or paper.

Assessors should check the authors’ use of and adherence to the relevant reporting checklists (e.g. Standards for Reporting Qualitative Research (SRQR)) to make sure all items that are relevant for this type of research are addressed [ 23 , 28 ]. Discussions of quantitative measures in addition to or instead of these qualitative measures can be a sign of lower quality of the research (paper). Providing and adhering to a checklist for qualitative research contributes to an important quality criterion for qualitative research, namely transparency [ 15 , 17 , 23 ].

Reflexivity

While methodological transparency and complete reporting is relevant for all types of research, some additional criteria must be taken into account for qualitative research. This includes what is called reflexivity, i.e. sensitivity to the relationship between the researcher and the researched, including how contact was established and maintained, or the background and experience of the researcher(s) involved in data collection and analysis. Depending on the research question and population to be researched this can be limited to professional experience, but it may also include gender, age or ethnicity [ 17 , 27 ]. These details are relevant because in qualitative research, as opposed to quantitative research, the researcher as a person cannot be isolated from the research process [ 23 ]. It may influence the conversation when an interviewed patient speaks to an interviewer who is a physician, or when an interviewee is asked to discuss a gynaecological procedure with a male interviewer, and therefore the reader must be made aware of these details [ 19 ].

Sampling and saturation

The aim of qualitative sampling is for all variants of the objects of observation that are deemed relevant for the study to be present in the sample “ to see the issue and its meanings from as many angles as possible” [ 1 , 16 , 19 , 20 , 27 ] , and to ensure “information-richness [ 15 ]. An iterative sampling approach is advised, in which data collection (e.g. five interviews) is followed by data analysis, followed by more data collection to find variants that are lacking in the current sample. This process continues until no new (relevant) information can be found and further sampling becomes redundant – which is called saturation [ 1 , 15 ] . In other words: qualitative data collection finds its end point not a priori , but when the research team determines that saturation has been reached [ 29 , 30 ].

This is also the reason why most qualitative studies use deliberate instead of random sampling strategies. This is generally referred to as “ purposive sampling” , in which researchers pre-define which types of participants or cases they need to include so as to cover all variations that are expected to be of relevance, based on the literature, previous experience or theory (i.e. theoretical sampling) [ 14 , 20 ]. Other types of purposive sampling include (but are not limited to) maximum variation sampling, critical case sampling or extreme or deviant case sampling [ 2 ]. In the above EVT example, a purposive sample could include all relevant professional groups and/or all relevant stakeholders (patients, relatives) and/or all relevant times of observation (day, night and weekend shift).

Assessors of qualitative research should check whether the considerations underlying the sampling strategy were sound and whether or how researchers tried to adapt and improve their strategies in stepwise or cyclical approaches between data collection and analysis to achieve saturation [ 14 ].

Good qualitative research is iterative in nature, i.e. it goes back and forth between data collection and analysis, revising and improving the approach where necessary. One example of this are pilot interviews, where different aspects of the interview (especially the interview guide, but also, for example, the site of the interview or whether the interview can be audio-recorded) are tested with a small number of respondents, evaluated and revised [ 19 ]. In doing so, the interviewer learns which wording or types of questions work best, or which is the best length of an interview with patients who have trouble concentrating for an extended time. Of course, the same reasoning applies to observations or focus groups which can also be piloted.

Ideally, coding should be performed by at least two researchers, especially at the beginning of the coding process when a common approach must be defined, including the establishment of a useful coding list (or tree), and when a common meaning of individual codes must be established [ 23 ]. An initial sub-set or all transcripts can be coded independently by the coders and then compared and consolidated after regular discussions in the research team. This is to make sure that codes are applied consistently to the research data.

Member checking

Member checking, also called respondent validation , refers to the practice of checking back with study respondents to see if the research is in line with their views [ 14 , 27 ]. This can happen after data collection or analysis or when first results are available [ 23 ]. For example, interviewees can be provided with (summaries of) their transcripts and asked whether they believe this to be a complete representation of their views or whether they would like to clarify or elaborate on their responses [ 17 ]. Respondents’ feedback on these issues then becomes part of the data collection and analysis [ 27 ].

Stakeholder involvement

In those niches where qualitative approaches have been able to evolve and grow, a new trend has seen the inclusion of patients and their representatives not only as study participants (i.e. “members”, see above) but as consultants to and active participants in the broader research process [ 31 – 33 ]. The underlying assumption is that patients and other stakeholders hold unique perspectives and experiences that add value beyond their own single story, making the research more relevant and beneficial to researchers, study participants and (future) patients alike [ 34 , 35 ]. Using the example of patients on or nearing dialysis, a recent scoping review found that 80% of clinical research did not address the top 10 research priorities identified by patients and caregivers [ 32 , 36 ]. In this sense, the involvement of the relevant stakeholders, especially patients and relatives, is increasingly being seen as a quality indicator in and of itself.

How not to assess qualitative research

The above overview does not include certain items that are routine in assessments of quantitative research. What follows is a non-exhaustive, non-representative, experience-based list of the quantitative criteria often applied to the assessment of qualitative research, as well as an explanation of the limited usefulness of these endeavours.

Protocol adherence

Given the openness and flexibility of qualitative research, it should not be assessed by how well it adheres to pre-determined and fixed strategies – in other words: its rigidity. Instead, the assessor should look for signs of adaptation and refinement based on lessons learned from earlier steps in the research process.

Sample size

For the reasons explained above, qualitative research does not require specific sample sizes, nor does it require that the sample size be determined a priori [ 1 , 14 , 27 , 37 – 39 ]. Sample size can only be a useful quality indicator when related to the research purpose, the chosen methodology and the composition of the sample, i.e. who was included and why.

Randomisation

While some authors argue that randomisation can be used in qualitative research, this is not commonly the case, as neither its feasibility nor its necessity or usefulness has been convincingly established for qualitative research [ 13 , 27 ]. Relevant disadvantages include the negative impact of a too large sample size as well as the possibility (or probability) of selecting “ quiet, uncooperative or inarticulate individuals ” [ 17 ]. Qualitative studies do not use control groups, either.

Interrater reliability, variability and other “objectivity checks”

The concept of “interrater reliability” is sometimes used in qualitative research to assess to which extent the coding approach overlaps between the two co-coders. However, it is not clear what this measure tells us about the quality of the analysis [ 23 ]. This means that these scores can be included in qualitative research reports, preferably with some additional information on what the score means for the analysis, but it is not a requirement. Relatedly, it is not relevant for the quality or “objectivity” of qualitative research to separate those who recruited the study participants and collected and analysed the data. Experiences even show that it might be better to have the same person or team perform all of these tasks [ 20 ]. First, when researchers introduce themselves during recruitment this can enhance trust when the interview takes place days or weeks later with the same researcher. Second, when the audio-recording is transcribed for analysis, the researcher conducting the interviews will usually remember the interviewee and the specific interview situation during data analysis. This might be helpful in providing additional context information for interpretation of data, e.g. on whether something might have been meant as a joke [ 18 ].

Not being quantitative research

Being qualitative research instead of quantitative research should not be used as an assessment criterion if it is used irrespectively of the research problem at hand. Similarly, qualitative research should not be required to be combined with quantitative research per se – unless mixed methods research is judged as inherently better than single-method research. In this case, the same criterion should be applied for quantitative studies without a qualitative component.

The main take-away points of this paper are summarised in Table Table1. 1 . We aimed to show that, if conducted well, qualitative research can answer specific research questions that cannot to be adequately answered using (only) quantitative designs. Seeing qualitative and quantitative methods as equal will help us become more aware and critical of the “fit” between the research problem and our chosen methods: I can conduct an RCT to determine the reasons for transportation delays of acute stroke patients – but should I? It also provides us with a greater range of tools to tackle a greater range of research problems more appropriately and successfully, filling in the blind spots on one half of the methodological spectrum to better address the whole complexity of neurological research and practice.

Take-away-points

Acknowledgements

Abbreviations, authors’ contributions.

LB drafted the manuscript; WW and CG revised the manuscript; all authors approved the final versions.

no external funding.

Availability of data and materials

Ethics approval and consent to participate, consent for publication, competing interests.

The authors declare no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Research Methods In Psychology

Saul Mcleod, PhD

Editor-in-Chief for Simply Psychology

BSc (Hons) Psychology, MRes, PhD, University of Manchester

Saul Mcleod, PhD., is a qualified psychology teacher with over 18 years of experience in further and higher education. He has been published in peer-reviewed journals, including the Journal of Clinical Psychology.

Learn about our Editorial Process

Olivia Guy-Evans, MSc

Associate Editor for Simply Psychology

BSc (Hons) Psychology, MSc Psychology of Education

Olivia Guy-Evans is a writer and associate editor for Simply Psychology. She has previously worked in healthcare and educational sectors.

Research methods in psychology are systematic procedures used to observe, describe, predict, and explain behavior and mental processes. They include experiments, surveys, case studies, and naturalistic observations, ensuring data collection is objective and reliable to understand and explain psychological phenomena.

Hypotheses are statements about the prediction of the results, that can be verified or disproved by some investigation.

There are four types of hypotheses :

Null Hypotheses (H0 ) – these predict that no difference will be found in the results between the conditions. Typically these are written ‘There will be no difference…’
Alternative Hypotheses (Ha or H1) – these predict that there will be a significant difference in the results between the two conditions. This is also known as the experimental hypothesis.
One-tailed (directional) hypotheses – these state the specific direction the researcher expects the results to move in, e.g. higher, lower, more, less. In a correlation study, the predicted direction of the correlation can be either positive or negative.
Two-tailed (non-directional) hypotheses – these state that a difference will be found between the conditions of the independent variable but does not state the direction of a difference or relationship. Typically these are always written ‘There will be a difference ….’

All research has an alternative hypothesis (either a one-tailed or two-tailed) and a corresponding null hypothesis.

Once the research is conducted and results are found, psychologists must accept one hypothesis and reject the other.

So, if a difference is found, the Psychologist would accept the alternative hypothesis and reject the null. The opposite applies if no difference is found.

Sampling techniques

Sampling is the process of selecting a representative group from the population under study.

A sample is the participants you select from a target population (the group you are interested in) to make generalizations about.

Representative means the extent to which a sample mirrors a researcher’s target population and reflects its characteristics.

Generalisability means the extent to which their findings can be applied to the larger population of which their sample was a part.

Volunteer sample : where participants pick themselves through newspaper adverts, noticeboards or online.
Opportunity sampling : also known as convenience sampling , uses people who are available at the time the study is carried out and willing to take part. It is based on convenience.
Random sampling : when every person in the target population has an equal chance of being selected. An example of random sampling would be picking names out of a hat.
Systematic sampling : when a system is used to select participants. Picking every Nth person from all possible participants. N = the number of people in the research population / the number of people needed for the sample.
Stratified sampling : when you identify the subgroups and select participants in proportion to their occurrences.
Snowball sampling : when researchers find a few participants, and then ask them to find participants themselves and so on.
Quota sampling : when researchers will be told to ensure the sample fits certain quotas, for example they might be told to find 90 participants, with 30 of them being unemployed.

Experiments always have an independent and dependent variable .

The independent variable is the one the experimenter manipulates (the thing that changes between the conditions the participants are placed into). It is assumed to have a direct effect on the dependent variable.
The dependent variable is the thing being measured, or the results of the experiment.

Operationalization of variables means making them measurable/quantifiable. We must use operationalization to ensure that variables are in a form that can be easily tested.

For instance, we can’t really measure ‘happiness’, but we can measure how many times a person smiles within a two-hour period.

By operationalizing variables, we make it easy for someone else to replicate our research. Remember, this is important because we can check if our findings are reliable.

Extraneous variables are all variables which are not independent variable but could affect the results of the experiment.

It can be a natural characteristic of the participant, such as intelligence levels, gender, or age for example, or it could be a situational feature of the environment such as lighting or noise.

Demand characteristics are a type of extraneous variable that occurs if the participants work out the aims of the research study, they may begin to behave in a certain way.

For example, in Milgram’s research , critics argued that participants worked out that the shocks were not real and they administered them as they thought this was what was required of them.

Extraneous variables must be controlled so that they do not affect (confound) the results.

Randomly allocating participants to their conditions or using a matched pairs experimental design can help to reduce participant variables.

Situational variables are controlled by using standardized procedures, ensuring every participant in a given condition is treated in the same way

Experimental Design

Experimental design refers to how participants are allocated to each condition of the independent variable, such as a control or experimental group.

Independent design ( between-groups design ): each participant is selected for only one group. With the independent design, the most common way of deciding which participants go into which group is by means of randomization.
Matched participants design : each participant is selected for only one group, but the participants in the two groups are matched for some relevant factor or factors (e.g. ability; sex; age).
Repeated measures design ( within groups) : each participant appears in both groups, so that there are exactly the same participants in each group.
The main problem with the repeated measures design is that there may well be order effects. Their experiences during the experiment may change the participants in various ways.
They may perform better when they appear in the second group because they have gained useful information about the experiment or about the task. On the other hand, they may perform less well on the second occasion because of tiredness or boredom.
Counterbalancing is the best way of preventing order effects from disrupting the findings of an experiment, and involves ensuring that each condition is equally likely to be used first and second by the participants.

If we wish to compare two groups with respect to a given independent variable, it is essential to make sure that the two groups do not differ in any other important way.

Experimental Methods

All experimental methods involve an iv (independent variable) and dv (dependent variable)..

Field experiments are conducted in the everyday (natural) environment of the participants. The experimenter still manipulates the IV, but in a real-life setting. It may be possible to control extraneous variables, though such control is more difficult than in a lab experiment.
Natural experiments are when a naturally occurring IV is investigated that isn’t deliberately manipulated, it exists anyway. Participants are not randomly allocated, and the natural event may only occur rarely.

Case studies are in-depth investigations of a person, group, event, or community. It uses information from a range of sources, such as from the person concerned and also from their family and friends.

Many techniques may be used such as interviews, psychological tests, observations and experiments. Case studies are generally longitudinal: in other words, they follow the individual or group over an extended period of time.

Case studies are widely used in psychology and among the best-known ones carried out were by Sigmund Freud . He conducted very detailed investigations into the private lives of his patients in an attempt to both understand and help them overcome their illnesses.

Case studies provide rich qualitative data and have high levels of ecological validity. However, it is difficult to generalize from individual cases as each one has unique characteristics.

Correlational Studies

Correlation means association; it is a measure of the extent to which two variables are related. One of the variables can be regarded as the predictor variable with the other one as the outcome variable.

Correlational studies typically involve obtaining two different measures from a group of participants, and then assessing the degree of association between the measures.

The predictor variable can be seen as occurring before the outcome variable in some sense. It is called the predictor variable, because it forms the basis for predicting the value of the outcome variable.

Relationships between variables can be displayed on a graph or as a numerical score called a correlation coefficient.

types of correlation. Scatter plot. Positive negative and no correlation

If an increase in one variable tends to be associated with an increase in the other, then this is known as a positive correlation .
If an increase in one variable tends to be associated with a decrease in the other, then this is known as a negative correlation .
A zero correlation occurs when there is no relationship between variables.

After looking at the scattergraph, if we want to be sure that a significant relationship does exist between the two variables, a statistical test of correlation can be conducted, such as Spearman’s rho.

The test will give us a score, called a correlation coefficient . This is a value between 0 and 1, and the closer to 1 the score is, the stronger the relationship between the variables. This value can be both positive e.g. 0.63, or negative -0.63.

Types of correlation. Strong, weak, and perfect positive correlation, strong, weak, and perfect negative correlation, no correlation. Graphs or charts ...

A correlation between variables, however, does not automatically mean that the change in one variable is the cause of the change in the values of the other variable. A correlation only shows if there is a relationship between variables.

Correlation does not always prove causation, as a third variable may be involved.

Interview Methods

Interviews are commonly divided into two types: structured and unstructured.

A fixed, predetermined set of questions is put to every participant in the same order and in the same way.

Responses are recorded on a questionnaire, and the researcher presets the order and wording of questions, and sometimes the range of alternative answers.

The interviewer stays within their role and maintains social distance from the interviewee.

There are no set questions, and the participant can raise whatever topics he/she feels are relevant and ask them in their own way. Questions are posed about participants’ answers to the subject

Unstructured interviews are most useful in qualitative research to analyze attitudes and values.

Though they rarely provide a valid basis for generalization, their main advantage is that they enable the researcher to probe social actors’ subjective point of view.

Questionnaire Method

Questionnaires can be thought of as a kind of written interview. They can be carried out face to face, by telephone, or post.

The choice of questions is important because of the need to avoid bias or ambiguity in the questions, ‘leading’ the respondent or causing offense.

Open questions are designed to encourage a full, meaningful answer using the subject’s own knowledge and feelings. They provide insights into feelings, opinions, and understanding. Example: “How do you feel about that situation?”
Closed questions can be answered with a simple “yes” or “no” or specific information, limiting the depth of response. They are useful for gathering specific facts or confirming details. Example: “Do you feel anxious in crowds?”

Its other practical advantages are that it is cheaper than face-to-face interviews and can be used to contact many respondents scattered over a wide area relatively quickly.

Observations

There are different types of observation methods :

Covert observation is where the researcher doesn’t tell the participants they are being observed until after the study is complete. There could be ethical problems or deception and consent with this particular observation method.
Overt observation is where a researcher tells the participants they are being observed and what they are being observed for.
Controlled : behavior is observed under controlled laboratory conditions (e.g., Bandura’s Bobo doll study).
Natural : Here, spontaneous behavior is recorded in a natural setting.
Participant : Here, the observer has direct contact with the group of people they are observing. The researcher becomes a member of the group they are researching.
Non-participant (aka “fly on the wall): The researcher does not have direct contact with the people being observed. The observation of participants’ behavior is from a distance

Pilot Study

A pilot study is a small scale preliminary study conducted in order to evaluate the feasibility of the key s teps in a future, full-scale project.

A pilot study is an initial run-through of the procedures to be used in an investigation; it involves selecting a few people and trying out the study on them. It is possible to save time, and in some cases, money, by identifying any flaws in the procedures designed by the researcher.

A pilot study can help the researcher spot any ambiguities (i.e. unusual things) or confusion in the information given to participants or problems with the task devised.

Sometimes the task is too hard, and the researcher may get a floor effect, because none of the participants can score at all or can complete the task – all performances are low.

The opposite effect is a ceiling effect, when the task is so easy that all achieve virtually full marks or top performances and are “hitting the ceiling”.

Research Design

In cross-sectional research , a researcher compares multiple segments of the population at the same time

Sometimes, we want to see how people change over time, as in studies of human development and lifespan. Longitudinal research is a research design in which data-gathering is administered repeatedly over an extended period of time.

In cohort studies , the participants must share a common factor or characteristic such as age, demographic, or occupation. A cohort study is a type of longitudinal study in which researchers monitor and observe a chosen population over an extended period.

Triangulation means using more than one research method to improve the study’s validity.

Reliability

Reliability is a measure of consistency, if a particular measurement is repeated and the same result is obtained then it is described as being reliable.

Test-retest reliability : assessing the same person on two different occasions which shows the extent to which the test produces the same answers.
Inter-observer reliability : the extent to which there is an agreement between two or more observers.

Meta-Analysis

A meta-analysis is a systematic review that involves identifying an aim and then searching for research studies that have addressed similar aims/hypotheses.

This is done by looking through various databases, and then decisions are made about what studies are to be included/excluded.

Strengths: Increases the conclusions’ validity as they’re based on a wider range.

Weaknesses: Research designs in studies can vary, so they are not truly comparable.

Peer Review

A researcher submits an article to a journal. The choice of the journal may be determined by the journal’s audience or prestige.

The journal selects two or more appropriate experts (psychologists working in a similar field) to peer review the article without payment. The peer reviewers assess: the methods and designs used, originality of the findings, the validity of the original research findings and its content, structure and language.

Feedback from the reviewer determines whether the article is accepted. The article may be: Accepted as it is, accepted with revisions, sent back to the author to revise and re-submit or rejected without the possibility of submission.

The editor makes the final decision whether to accept or reject the research report based on the reviewers comments/ recommendations.

Peer review is important because it prevent faulty data from entering the public domain, it provides a way of checking the validity of findings and the quality of the methodology and is used to assess the research rating of university departments.

Peer reviews may be an ideal, whereas in practice there are lots of problems. For example, it slows publication down and may prevent unusual, new work being published. Some reviewers might use it as an opportunity to prevent competing researchers from publishing work.

Some people doubt whether peer review can really prevent the publication of fraudulent research.

The advent of the internet means that a lot of research and academic comment is being published without official peer reviews than before, though systems are evolving on the internet where everyone really has a chance to offer their opinions and police the quality of research.

Types of Data

Quantitative data is numerical data e.g. reaction time or number of mistakes. It represents how much or how long, how many there are of something. A tally of behavioral categories and closed questions in a questionnaire collect quantitative data.
Qualitative data is virtually any type of information that can be observed and recorded that is not numerical in nature and can be in the form of written or verbal communication. Open questions in questionnaires and accounts from observational studies collect qualitative data.
Primary data is first-hand data collected for the purpose of the investigation.
Secondary data is information that has been collected by someone other than the person who is conducting the research e.g. taken from journals, books or articles.

Validity means how well a piece of research actually measures what it sets out to, or how well it reflects the reality it claims to represent.

Validity is whether the observed effect is genuine and represents what is actually out there in the world.

Concurrent validity is the extent to which a psychological measure relates to an existing similar measure and obtains close results. For example, a new intelligence test compared to an established test.
Face validity : does the test measure what it’s supposed to measure ‘on the face of it’. This is done by ‘eyeballing’ the measuring or by passing it to an expert to check.
Ecological validit y is the extent to which findings from a research study can be generalized to other settings / real life.
Temporal validity is the extent to which findings from a research study can be generalized to other historical times.

Features of Science

Paradigm – A set of shared assumptions and agreed methods within a scientific discipline.
Paradigm shift – The result of the scientific revolution: a significant change in the dominant unifying theory within a scientific discipline.
Objectivity – When all sources of personal bias are minimised so not to distort or influence the research process.
Empirical method – Scientific approaches that are based on the gathering of evidence through direct observation and experience.
Replicability – The extent to which scientific procedures and findings can be repeated by other researchers.
Falsifiability – The principle that a theory cannot be considered scientific unless it admits the possibility of being proved untrue.

Statistical Testing

A significant result is one where there is a low probability that chance factors were responsible for any observed difference, correlation, or association in the variables tested.

If our test is significant, we can reject our null hypothesis and accept our alternative hypothesis.

If our test is not significant, we can accept our null hypothesis and reject our alternative hypothesis. A null hypothesis is a statement of no effect.

In Psychology, we use p < 0.05 (as it strikes a balance between making a type I and II error) but p < 0.01 is used in tests that could cause harm like introducing a new drug.

A type I error is when the null hypothesis is rejected when it should have been accepted (happens when a lenient significance level is used, an error of optimism).

A type II error is when the null hypothesis is accepted when it should have been rejected (happens when a stringent significance level is used, an error of pessimism).

Ethical Issues

Informed consent is when participants are able to make an informed judgment about whether to take part. It causes them to guess the aims of the study and change their behavior.
To deal with it, we can gain presumptive consent or ask them to formally indicate their agreement to participate but it may invalidate the purpose of the study and it is not guaranteed that the participants would understand.
Deception should only be used when it is approved by an ethics committee, as it involves deliberately misleading or withholding information. Participants should be fully debriefed after the study but debriefing can’t turn the clock back.
All participants should be informed at the beginning that they have the right to withdraw if they ever feel distressed or uncomfortable.
It causes bias as the ones that stayed are obedient and some may not withdraw as they may have been given incentives or feel like they’re spoiling the study. Researchers can offer the right to withdraw data after participation.
Participants should all have protection from harm . The researcher should avoid risks greater than those experienced in everyday life and they should stop the study if any harm is suspected. However, the harm may not be apparent at the time of the study.
Confidentiality concerns the communication of personal information. The researchers should not record any names but use numbers or false names though it may not be possible as it is sometimes possible to work out who the researchers were.

Research Methodology

Qualitative Data Coding

What Is a Focus Group?

Cross-Cultural Research Methodology In Psychology

A-Level Psychology

A-level Psychology AQA Revision Notes

What Is Internal Validity In Research?

Research Methodology , Statistics

What Is Face Validity In Research? Importance & How To Measure

Research Methods Resources

Methods at a glance.

This section provides information and examples of methodological issues to be aware of when working with different study designs. Virtually all studies face methodological issues regarding the selection of the primary outcome(s), sample size estimation, missing outcomes, and multiple comparisons. Randomized studies face additional challenges related to the method for randomization. Other studies face specific challenges associated with their study design such as those that arise in effectiveness-implementation research; multiphase optimization strategy (MOST) studies; sequential, multiple assignment, randomized trials (SMART); crossover designs; non-inferiority trials; regression discontinuity designs; and paired availability designs. Some face issues involving exact tests, adherence to behavioral interventions, noncompliance in encouragement designs, evaluation of risk prediction models, or evaluation of surrogate endpoints.

Learn more about broadly applicable methods

Experiments, including clinical trials, differ considerably in the methods used to assign participants to study conditions (or study arms) and to deliver interventions to those participants.

This section provides information related to the design and analysis of experiments in which (1) participants are assigned in groups (or clusters) and individual observations are analyzed to evaluate the effect of the intervention, (2) participants are assigned individually but receive at least some of their intervention with other participants or through an intervention agent shared with other participants, and (3) participants are assigned in groups (or clusters) but groups cross-over to the intervention condition at pre-determined time points in sequential, staggered fashion until all groups receive the intervention.

This material is relevant for both human and animal studies as well as basic and applied research. And while it is important for investigators to become familiar with the issues presented on this website, it is even more important that they collaborate with a methodologist who is familiar with these issues.

In a parallel group-randomized trial, also called a parallel cluster-randomized trial, groups or clusters are randomized to study conditions, and observations are taken on the members of those groups with no crossover of groups or clusters to a different condition or study arm during the trial.

Learn more about GRTs

In an individually randomized group-treatment trial, also called a partially clustered design, individuals are randomized to study conditions but receive at least some of their intervention with other participants or through an intervention agent shared with other participants.

Learn more about IRGTs

In a stepped wedge group-randomized trial, also called a stepped wedge cluster-randomized trial, groups or clusters are randomized to sequences which cross-over to the intervention condition at predetermined time points in a sequential, staggered fashion until all groups receive the intervention.

Learn more about SWGRTs

NIH Clinical Trial Requirements

The NIH launched a series of initiatives to enhance the accountability and transparency of clinical research. These initiatives target key points along the entire clinical trial lifecycle, from concept to reporting the results.

Check out the Frequently Asked Questions section or send us a message .

Disclaimer: Substantial effort has been made to provide accurate and complete information on this website. However, we cannot guarantee that there will be no errors. Neither the U.S. Government nor the National Institutes of Health (NIH) assumes any legal liability for the accuracy, completeness, or usefulness of any information, products, or processes disclosed herein, or represents that use of such information, products, or processes would not infringe on privately owned rights. The NIH does not endorse or recommend any commercial products, processes, or services. The views and opinions of authors expressed on NIH websites do not necessarily state or reflect those of the U.S. Government, and they may not be used for advertising or product endorsement purposes.

LibGuides
A-Z List
Help

Research Methods Help Guide

Welcome to the research methods help guide, other useful libguides.

Quick Glossary
Types of Data
Types of Research
Types of Studies
Helpful Resources
Get Help @ FIU

Subject Pages

Athletic Training

Commmunication Sciences & Disorders

Complementary & Alternative Medicine

Dietetics & Nutrition

Occupational & Physical Therapy

Public Health

Social Work

Reuse information.

This LibGuide is provided with an Attribution-NonCommercial-ShareAlike Creative Commons license , unless otherwise noted. If you would like to reuse any part of this LibGuide for noncommercial educational or instructional purposes, please contact and credit the guide's creator, Barbara M. Sorondo , Health Sciences Librarian at the FIU Libraries, or the original content creator as noted, and include a link to the source.

In order to understand, interpret, and analyze the articles you find in library databases, you need at least a basic knowledge of research methods. This LibGuide provides simple definitions and explanations of common research methods concepts, including:

SAGE Research Methods This link opens in a new window *Find reference materials on conducting research. *Find information on how to design and conduct a research project. *Learn how to conduct a literature review. *Read case studies from researchers. *Find e-books in qualitative methods. *Find downloadable datasets to practice quantitative statistical and analytical methods. *View streaming video collection dedicated to methods. Tools include a project planner, methods map, which stats test to help determine which statistical method to apply, 2,000+ qualitative, quantitative, and mixed methods case studies, 500+ datasets-indexed by method and data type, streaming video collections, and more. more... less... Includes diversified types of research materials such as reference works, journal articles, datasets, e-books, and videos by leading academics. It has the largest e-book collection in qualitative methods. The resources cover every aspect of research skills training to help researchers at all levels through the steps of the research process, from developing a research question, doing a literature review, planning a project, collecting and analyzing data, and writing up a report, dissertation or thesis.
Types of Data Quantitative, Qualitative, Mixed Methods
Types of Research Definitions of 5 common types of research.
Types of Studies Definitions of different types of studies.

This LibGuide is meant to provide a simple introduction to help you get started. See the "Helpful Resources" page for more in-depth information.

Note: although this LibGuide is designed for health sciences students, the definitions included and resources recommended are useful for anyone interested in learning about research methods.

Questions? Contact the Health Sciences Librarian .

Tips and Tricks for Health Sciences Databases by Joana Fernandez Last Updated Jan 9, 2024 187 views this year
How to Find and Conduct Systematic Reviews by Joana Fernandez Last Updated Feb 14, 2024 1991 views this year
Next: Quick Glossary >>
Last Updated: Apr 17, 2024 11:36 AM
URL: https://library.fiu.edu/researchmethods

Information

Fiu libraries floorplans, green library, modesto a. maidique campus, hubert library, biscayne bay campus.

Directions: Green Library, MMC

Directions: Hubert Library, BBC

Bipolar Disorder
Therapy Center
When To See a Therapist
Types of Therapy
Best Online Therapy
Best Couples Therapy
Best Family Therapy
Managing Stress
Sleep and Dreaming
Understanding Emotions
Self-Improvement
Healthy Relationships
Student Resources
Personality Types
Guided Meditations
Verywell Mind Insights
2024 Verywell Mind 25
Mental Health in the Classroom
Editorial Process
Meet Our Review Board
Crisis Support

Understanding Methods for Research in Psychology

A Psychology Research Methods Study Guide

Kendra Cherry, MS, is a psychosocial rehabilitation specialist, psychology educator, and author of the "Everything Psychology Book."

Emily is a board-certified science editor who has worked with top digital publishing brands like Voices for Biodiversity, Study.com, GoodTherapy, Vox, and Verywell.

Types of Research in Psychology

Cross-Sectional vs. Longitudinal Research
Reliability and Validity

Glossary of Terms

Research in psychology focuses on a variety of topics , ranging from the development of infants to the behavior of social groups. Psychologists use the scientific method to investigate questions both systematically and empirically.

Research in psychology is important because it provides us with valuable information that helps to improve human lives. By learning more about the brain, cognition, behavior, and mental health conditions, researchers are able to solve real-world problems that affect our day-to-day lives.

At a Glance

Knowing more about how research in psychology is conducted can give you a better understanding of what those findings might mean to you. Psychology experiments can range from simple to complex, but there are some basic terms and concepts that all psychology students should understand.

Start your studies by learning more about the different types of research, the basics of experimental design, and the relationships between variables.

Research in Psychology: The Basics

The first step in your review should include a basic introduction to psychology research methods . Psychology research can have a variety of goals. What researchers learn can be used to describe, explain, predict, or change human behavior.

Psychologists use the scientific method to conduct studies and research in psychology. The basic process of conducting psychology research involves asking a question, designing a study, collecting data, analyzing results, reaching conclusions, and sharing the findings.

The Scientific Method in Psychology Research

The steps of the scientific method in psychology research are:

Make an observation
Ask a research question and make predictions about what you expect to find
Test your hypothesis and gather data
Examine the results and form conclusions
Report your findings

Research in psychology can take several different forms. It can describe a phenomenon, explore the causes of a phenomenon, or look at relationships between one or more variables. Three of the main types of psychological research focus on:

Descriptive Studies

This type of research can tell us more about what is happening in a specific population. It relies on techniques such as observation, surveys, and case studies.

Correlational Studies

Correlational research is frequently used in psychology to look for relationships between variables. While research look at how variables are related, they do not manipulate any of the variables.

While correlational studies can suggest a relationship between two variables, finding a correlation does not prove that one variable causes a change in another. In other words, correlation does not equal causation.

Experimental Research Methods

Experiments are a research method that can look at whether changes in one variable cause changes in another. The simple experiment is one of the most basic methods of determining if there is a cause-and-effect relationship between two variables.

A simple experiment utilizes a control group of participants who receive no treatment and an experimental group of participants who receive the treatment.

Experimenters then compare the results of the two groups to determine if the treatment had an effect.

Cross-Sectional vs. Longitudinal Research in Psychology

Research in psychology can also involve collecting data at a single point in time, or gathering information at several points over a period of time.

Cross-Sectional Research

In a cross-sectional study , researchers collect data from participants at a single point in time. These are descriptive type of research and cannot be used to determine cause and effect because researchers do not manipulate the independent variables.

However, cross-sectional research does allow researchers to look at the characteristics of the population and explore relationships between different variables at a single point in time.

Longitudinal Research

A longitudinal study is a type of research in psychology that involves looking at the same group of participants over a period of time. Researchers start by collecting initial data that serves as a baseline, and then collect follow-up data at certain intervals. These studies can last days, months, or years.

The longest longitudinal study in psychology was started in 1921 and the study is planned to continue until the last participant dies or withdraws. As of 2003, more than 200 of the partipants were still alive.

The Reliability and Validity of Research in Psychology

Reliability and validity are two concepts that are also critical in psychology research. In order to trust the results, we need to know if the findings are consistent (reliability) and that we are actually measuring what we think we are measuring (validity).

Reliability

Reliability is a vital component of a valid psychological test. What is reliability? How do we measure it? Simply put, reliability refers to the consistency of a measure. A test is considered reliable if we get the same result repeatedly.

When determining the merits of a psychological test, validity is one of the most important factors to consider. What exactly is validity? One of the greatest concerns when creating a psychological test is whether or not it actually measures what we think it is measuring.

For example, a test might be designed to measure a stable personality trait but instead measures transitory emotions generated by situational or environmental conditions. A valid test ensures that the results accurately reflect the dimension undergoing assessment.

Review some of the key terms that you should know and understand about psychology research methods. Spend some time studying these terms and definitions before your exam. Some key terms that you should know include:

Correlation
Demand characteristic
Dependent variable
Hawthorne effect
Independent variable
Naturalistic observation
Placebo effect
Random assignment
Replication
Selective attrition

Erol A. How to conduct scientific research ? Noro Psikiyatr Ars . 2017;54(2):97-98. doi:10.5152/npa.2017.0120102

Aggarwal R, Ranganathan P. Study designs: Part 2 - Descriptive studies . Perspect Clin Res . 2019;10(1):34-36. doi:10.4103/picr.PICR_154_18

Curtis EA, Comiskey C, Dempsey O. Importance and use of correlational research . Nurse Res . 2016;23(6):20-25. doi:10.7748/nr.2016.e1382

Wang X, Cheng Z. Cross-sectional studies: Strengths, weaknesses, and recommendations . Chest . 2020;158(1S):S65-S71. doi:10.1016/j.chest.2020.03.012

Caruana EJ, Roman M, Hernández-Sánchez J, Solli P. Longitudinal studies . J Thorac Dis . 2015;7(11):E537-E540. doi:10.3978/j.issn.2072-1439.2015.10.63

Stanford Magazine. The vexing legacy of Lewis Terman .

By Kendra Cherry, MSEd Kendra Cherry, MS, is a psychosocial rehabilitation specialist, psychology educator, and author of the "Everything Psychology Book."

Home » Research Process – Steps, Examples and Tips

Research Process – Steps, Examples and Tips

Table of Contents

Research Process

Definition:

Research Process is a systematic and structured approach that involves the collection, analysis, and interpretation of data or information to answer a specific research question or solve a particular problem.

Research Process Steps

Research Process Steps are as follows:

Identify the Research Question or Problem

This is the first step in the research process. It involves identifying a problem or question that needs to be addressed. The research question should be specific, relevant, and focused on a particular area of interest.

Conduct a Literature Review

Once the research question has been identified, the next step is to conduct a literature review. This involves reviewing existing research and literature on the topic to identify any gaps in knowledge or areas where further research is needed. A literature review helps to provide a theoretical framework for the research and also ensures that the research is not duplicating previous work.

Formulate a Hypothesis or Research Objectives

Based on the research question and literature review, the researcher can formulate a hypothesis or research objectives. A hypothesis is a statement that can be tested to determine its validity, while research objectives are specific goals that the researcher aims to achieve through the research.

Design a Research Plan and Methodology

This step involves designing a research plan and methodology that will enable the researcher to collect and analyze data to test the hypothesis or achieve the research objectives. The research plan should include details on the sample size, data collection methods, and data analysis techniques that will be used.

Collect and Analyze Data

This step involves collecting and analyzing data according to the research plan and methodology. Data can be collected through various methods, including surveys, interviews, observations, or experiments. The data analysis process involves cleaning and organizing the data, applying statistical and analytical techniques to the data, and interpreting the results.

Interpret the Findings and Draw Conclusions

After analyzing the data, the researcher must interpret the findings and draw conclusions. This involves assessing the validity and reliability of the results and determining whether the hypothesis was supported or not. The researcher must also consider any limitations of the research and discuss the implications of the findings.

Communicate the Results

Finally, the researcher must communicate the results of the research through a research report, presentation, or publication. The research report should provide a detailed account of the research process, including the research question, literature review, research methodology, data analysis, findings, and conclusions. The report should also include recommendations for further research in the area.

Review and Revise

The research process is an iterative one, and it is important to review and revise the research plan and methodology as necessary. Researchers should assess the quality of their data and methods, reflect on their findings, and consider areas for improvement.

Ethical Considerations

Throughout the research process, ethical considerations must be taken into account. This includes ensuring that the research design protects the welfare of research participants, obtaining informed consent, maintaining confidentiality and privacy, and avoiding any potential harm to participants or their communities.

Dissemination and Application

The final step in the research process is to disseminate the findings and apply the research to real-world settings. Researchers can share their findings through academic publications, presentations at conferences, or media coverage. The research can be used to inform policy decisions, develop interventions, or improve practice in the relevant field.

Research Process Example

Following is a Research Process Example:

Research Question : What are the effects of a plant-based diet on athletic performance in high school athletes?

Step 1: Background Research Conduct a literature review to gain a better understanding of the existing research on the topic. Read academic articles and research studies related to plant-based diets, athletic performance, and high school athletes.

Step 2: Develop a Hypothesis Based on the literature review, develop a hypothesis that a plant-based diet positively affects athletic performance in high school athletes.

Step 3: Design the Study Design a study to test the hypothesis. Decide on the study population, sample size, and research methods. For this study, you could use a survey to collect data on dietary habits and athletic performance from a sample of high school athletes who follow a plant-based diet and a sample of high school athletes who do not follow a plant-based diet.

Step 4: Collect Data Distribute the survey to the selected sample and collect data on dietary habits and athletic performance.

Step 5: Analyze Data Use statistical analysis to compare the data from the two samples and determine if there is a significant difference in athletic performance between those who follow a plant-based diet and those who do not.

Step 6 : Interpret Results Interpret the results of the analysis in the context of the research question and hypothesis. Discuss any limitations or potential biases in the study design.

Step 7: Draw Conclusions Based on the results, draw conclusions about whether a plant-based diet has a significant effect on athletic performance in high school athletes. If the hypothesis is supported by the data, discuss potential implications and future research directions.

Step 8: Communicate Findings Communicate the findings of the study in a clear and concise manner. Use appropriate language, visuals, and formats to ensure that the findings are understood and valued.

Applications of Research Process

The research process has numerous applications across a wide range of fields and industries. Some examples of applications of the research process include:

Scientific research: The research process is widely used in scientific research to investigate phenomena in the natural world and develop new theories or technologies. This includes fields such as biology, chemistry, physics, and environmental science.
Social sciences : The research process is commonly used in social sciences to study human behavior, social structures, and institutions. This includes fields such as sociology, psychology, anthropology, and economics.
Education: The research process is used in education to study learning processes, curriculum design, and teaching methodologies. This includes research on student achievement, teacher effectiveness, and educational policy.
Healthcare: The research process is used in healthcare to investigate medical conditions, develop new treatments, and evaluate healthcare interventions. This includes fields such as medicine, nursing, and public health.
Business and industry : The research process is used in business and industry to study consumer behavior, market trends, and develop new products or services. This includes market research, product development, and customer satisfaction research.
Government and policy : The research process is used in government and policy to evaluate the effectiveness of policies and programs, and to inform policy decisions. This includes research on social welfare, crime prevention, and environmental policy.

Purpose of Research Process

The purpose of the research process is to systematically and scientifically investigate a problem or question in order to generate new knowledge or solve a problem. The research process enables researchers to:

Identify gaps in existing knowledge: By conducting a thorough literature review, researchers can identify gaps in existing knowledge and develop research questions that address these gaps.
Collect and analyze data : The research process provides a structured approach to collecting and analyzing data. Researchers can use a variety of research methods, including surveys, experiments, and interviews, to collect data that is valid and reliable.
Test hypotheses : The research process allows researchers to test hypotheses and make evidence-based conclusions. Through the systematic analysis of data, researchers can draw conclusions about the relationships between variables and develop new theories or models.
Solve problems: The research process can be used to solve practical problems and improve real-world outcomes. For example, researchers can develop interventions to address health or social problems, evaluate the effectiveness of policies or programs, and improve organizational processes.
Generate new knowledge : The research process is a key way to generate new knowledge and advance understanding in a given field. By conducting rigorous and well-designed research, researchers can make significant contributions to their field and help to shape future research.

Tips for Research Process

Here are some tips for the research process:

Start with a clear research question : A well-defined research question is the foundation of a successful research project. It should be specific, relevant, and achievable within the given time frame and resources.
Conduct a thorough literature review: A comprehensive literature review will help you to identify gaps in existing knowledge, build on previous research, and avoid duplication. It will also provide a theoretical framework for your research.
Choose appropriate research methods: Select research methods that are appropriate for your research question, objectives, and sample size. Ensure that your methods are valid, reliable, and ethical.
Be organized and systematic: Keep detailed notes throughout the research process, including your research plan, methodology, data collection, and analysis. This will help you to stay organized and ensure that you don’t miss any important details.
Analyze data rigorously: Use appropriate statistical and analytical techniques to analyze your data. Ensure that your analysis is valid, reliable, and transparent.
I nterpret results carefully : Interpret your results in the context of your research question and objectives. Consider any limitations or potential biases in your research design, and be cautious in drawing conclusions.
Communicate effectively: Communicate your research findings clearly and effectively to your target audience. Use appropriate language, visuals, and formats to ensure that your findings are understood and valued.
Collaborate and seek feedback : Collaborate with other researchers, experts, or stakeholders in your field. Seek feedback on your research design, methods, and findings to ensure that they are relevant, meaningful, and impactful.

About the author

Muhammad Hassan

Researcher, Academic Writer, Web developer

Data Collection – Methods Types and Examples

Delimitations in Research – Types, Examples and...

Research Design – Types, Methods and Examples

Institutional Review Board – Application Sample...

Evaluating Research – Process, Examples and...

Research Questions – Types, Examples and Writing...

1 Chapter 1: The Importance of Research Methods and Becoming an Informed Consumer of Research

Case study : student apprehension regarding research methods.

Research Study

Understanding and Measuring Student Apprehension in Criminal Justice Research Methods Courses 1

Research Question

How do we measure disinterest, relevance argumentation, and math anxiety experienced by students enrolled in research methods courses?

Methodology

It is said that “misery loves company,” so you are not alone in your apprehension and anxiety regarding your research methods course. The problem of student apprehension and anxiety related to taking a research methods course is not new and has been studied for over 25 years. Previously, such apprehension and anxiety appeared to be caused by math anxiety, especially as it applies to statistics. The authors of this article believe that student apprehension goes beyond math anxiety; that math anxiety is too simplistic of an explanation of student fear of research methods courses. Besides math anxiety, the researchers think that apprehension is caused by student indifference to the subject matter and irrelevance of the course because it does not apply to the “real world.” They state that student apprehension in research methods and statistics courses is due to three main factors:

Disinterest (D.);

Relevance Argumentation (RA.), and;

Math Anxiety (MA.).

Taken together, the reconceptualization is known as D.RA.MA., and the combination of these three factors constitutes the D.RA.MA. scale for research methods and statistics courses.

The researchers developed the D.RA.MA. scale by constructing survey questions to measure each factor in the scale (i.e., disinterest, relevance argumentation, and math anxiety). After they developed the survey, they tested it by distributing the survey to three criminal justice classes, totaling 80 students, from a midsized regional comprehensive university in the southern region of the United States. Higher scale scores demonstrate more disinterest, more relevance argumentation, or more math anxiety.

The D.RA.MA. scale consists of 20 survey questions. Ten questions were borrowed from an existing Math Anxiety scale developed by Betz 2 . The researchers then created five items to assess Disinterest and five items intended to measure Relevance Argumentation. The items for the D.RA.MA. scale are illustrated below.

Math Anxiety 3

I usually have been at ease in math classes.

Math does not scare me at all.

I am no good at math.

I don’t think that I could do advanced math.

Generally, I have been secure about attempting math.

For some reason, even though I study, math seems unusually hard for me.

Math has been my worst subject.

My mind goes blank and I am unable to think clearly when working in mathematics.

I think I could handle more difficult math.

I am not the type to do well in mathematics.

Relevance Argumentation 4

I will need research methods for my future work.

I view research methods as a subject that I will rarely use.

Research methods is not really useful for students who intend to work in Criminal Justice.

Knowing research methods will help me earn a living.

Research methods does not reflect the “real world.”

Research Disinterest 5

I am excited about taking research methods.

It would not bother me at all to take more research methods courses.

I expect a research methods class to be boring.

I don’t expect to learn much in research methods.

I really don’t care if I learn anything in research methods, as long as I get the requirement completed.

The Math Anxiety Scale responses for the 80 students ranged from 0 to 30 with a mean of 14, demonstrating a moderate level of math anxiety among the study participants. The responses for Relevance Argumentation ranged from 0 to 12 with a mean of 5.4 while those for Disinterest ranged from 1 to 15 with a mean of 7.0, demonstrating a moderate level of disinterest and relevance argumentation among students regarding research methods. Based on these findings, the study demonstrated that student apprehension regarding research methods courses goes beyond math anxiety and includes two additional factors; disinterest in the subject matter and irrelevance of research methods to the “real world.”

Limitations with the Study Procedure

This research study was designed to develop a broader measure of student apprehension in criminal justice research methods courses. Moving beyond just math anxiety, the researchers accomplished their objective by developing the D.RA.MA. scale; adding disinterest and relevance argumentation to the understanding of student apprehension regarding research methods. As is true for all research, this study is not without limitations. The biggest limitation of this study is the limited sample size. Only 80 students completed the survey. Although this is certainly a good start, similar research (i.e., replication) needs to be completed with larger student samples in different locations throughout the country before the actual quality of the D.RA.MA. scale can be determined.

Impact on Criminal Justice

The D.RA.MA. scale developed in this study identifies disinterest and relevance argumentation, in addition to math anxiety, as part of student apprehension and resistance to research methods. A variety of instructional strategies can be inferred from the D.RA.MA. survey. However, it is important for professors to recognize that no single approach will reduce research methods resistance and apprehension for all students. For example, discussing research methods in a popular culture framework may resonate with students and lead to engaged students who are more interested in the subject matter and identify with the relevance of research methods to criminal justice in general and the future careers of students, in particular. This approach may provide an effective means for combating student disinterest and relevance argumentation in criminal justice research methods courses. At a minimum, it is critical for professors to explain the relevance of research methods to the policies and practices of police, courts, and corrections. Students need to realize that research methods are essential tools for assessing agency policies and practices. Professors will always have D.RA.MA.-plagued students, but recognizing the problem and then developing effective strategies to connect with these students is the challenge all professors face. Experimenting with a multitude of teaching strategies to alleviate the math anxiety, relevance argumentation, and disinterest of criminal justice research methods students will result in more effective teaching and learning.

In This Chapter You Will Learn

What research is and why it is important to be an informed consumer of research

The sources of knowledge development and problems with each

How research methods can dispel myths about crime and the criminal justice system

The steps in the research process

How research has impacted criminal justice operations

Introduction

As noted in the chapter opening case study, it is expected that you have some anxiety and apprehension about taking this criminal justice research methods course. But, you have taken a significant step toward success in this course by opening up your research methods book, so congratulations are in order. You might have opened this book for a number of reasons. Perhaps it is the first day of class and you are ready to get started on the course material. Perhaps you have a quiz or exam soon. Perhaps the book has been gathering dust on your shelf since the first day of class and you are not doing well in your research methods class and are looking for the book to help with course improvement. Perhaps you are taking a research methods class in the future and are seeing if all the chatter among students is true.

No matter how you got here, two things are probably true. First, you are taking this research methods course because it is a requirement for your major. The bottom line is that most of the students who read this text are required to take a research methods course. While you may think studying research methods is irrelevant to your career goals, unnecessary, overly academic, or perhaps even intimidating, you probably must finish this course in order to graduate. Second, you have heard negative comments about this course. The negative comments mention the difficulty of the course and the relevance of the course (e.g., “I am going to be a police officer, so why do I need to take a research methods course?”). If you are like most students we have experienced in our research methods courses in the past, you are not initially interested in this course and are concerned about whether you will do well in it.

If you are concerned about the course, realize that you are not alone because most students are anxious about taking a research methods course. Also realize that your professor is well aware of student anxiety and apprehension regarding research methods. So, relax and do not think about the entire course and the entire book. Take the course content one chapter, one week at a time. One of the advantages of taking a research methods course is that you learn about the process of research methods. Each chapter builds upon the previous chapters, illustrating and discussing more about the research process. This is certainly an advantage, but it is also critical that you understand the initial chapters in this book so you are not confused with the content discussed in later chapters. In addition to anxiety and apprehension over the course material, research methods can be boring if you only read and learn about it with no particular purpose in mind. Although examples are prevalent throughout the book, as you read this material, it is recommended that you think about the relevancy and application of the topics covered in this book to your specific criminal justice interests. As you continue to read the book, think about how you might use the information you are reading in your current position or your intended profession.

The goal of this research methods book is to develop you into an informed consumer of research. Most, if not all, of your fellow classmates will never conduct their own research studies. However, every one of you will be exposed to research findings in your professional and personal lives for the remainder of your lives. You are exposed to research findings in the media (e.g., television, newspapers, and online), in personal interaction with others (e.g., friends and family, doctors, and professors), as well as in class. You should challenge yourself for this semester to keep a journal and document exposure to research in your daily life outside of college whether through the nightly news, newspapers, magazine articles, Internet, personal conversations, or other means. At the end of the semester, you will be amazed at the amount of research you are exposed to in a short period of time. This book is focused on research exposure and assisting you to become an educated consumer of research by providing you the skills necessary to differentiate between good and not so good research. Why should you believe research findings if the study is faulty? Without being an educated consumer of research, you will not be able to differentiate between useful and not useful research. This book is designed to remedy this problem.

This book was written to make your first encounter with research methods relevant and successful while providing you the tools necessary to become an educated consumer of research. Therefore, this book is written with the assumption that students have not had a prior class on research methods. In addition, this book assumes that practical and evaluative knowledge of research methods is more useful than theoretical knowledge of the development of research methods and the relationship between theory and research. Since the focus of this book is on consumerism, not researcher training, practical and evaluative knowledge is more useful than theoretical knowledge.

It is also important to understand that the professors who design academic programs in criminal justice at the associate and bachelor level believe that an understanding of research methods is important for students. That is why, more than likely, this research methods course is a required course in your degree program. These professors understand that a solid understanding of research methods will enrich the qualifications of students for employment and performance in their criminal justice careers.

As previously stated, the basic goal of this book is to make students, as future and possibly even current practitioners in the criminal justice system, better informed and more capable consumers of the results of criminal justice research. This goal is based on the belief that an understanding of research methods allows criminal justice practitioners to be better able to make use of the results of research as it applies to their work-related duties. In fact, thousands of research questions are asked and answered each year in research involving criminal justice and criminological topics. In addition, thousands of articles are published, papers presented at conferences, and reports prepared that provide answers to these questions. The ability to understand research gives practitioners knowledge of the most current information in their respective fields and the ability to use this knowledge to improve the effectiveness of criminal justice agencies.

How Do We Know What We Know? Sources of Knowledge

The reality is the understanding of crime and criminal justice system operations by the public is frequently the product of misguided assumptions, distorted interpretations, outright myths, and hardened ideological positions. 6 This is a bold statement that basically contends that most people’s knowledge of crime and criminal justice is inaccurate. But, how do these inaccuracies occur? Most people have learned what they know about crime and criminal justice system operations through some other means besides scientific research results and findings. Some of that knowledge is based on personal experience and common sense. Much of it is based on the information and images supported by politicians, governmental agencies, and especially the media. This section will discuss the mechanisms used to understand crime and criminal justice operations by the public. It is important to note that although this section will focus on the failings of these knowledge sources, they each can be, and certainly are, accurate at times, and thus are valuable sources of knowledge.

Knowledge from Authority

We gain knowledge from parents, teachers, experts, and others who are in positions of authority in our lives. When we accept something as being correct and true just because someone in a position of authority says it is true, we are using what is referred to as authority knowledge as a means of knowing. Authorities often expend significant time and effort to learn something, and we can benefit from their experience and work.

However, relying on authority as a means of knowing has limitations. It is easy to overestimate the expertise of other people. A person’s expertise is typically limited to a few core areas of significant knowledge; a person is not an expert in all areas. More specifically, criminal justice professors are not experts on all topics related to criminal justice. One professor may be an expert on corrections but know little about policing. If this professor discusses topics in policing in which he is not an expert, we may still assume he is right when he may be wrong. Authority figures may speak on fields they know little about. They can be completely wrong but we may believe them because of their status as an expert. Furthermore, an expert in one area may try to use his authority in an unrelated area. Other times, we have no idea of how the experts arrived at their knowledge. We just know they are experts in the topic area.

As I am writing this, I recall an example of authority knowledge that was wrong during my police academy training in the late 1980s. My academy training was about four years after the U.S. Supreme Court decision in Tennessee v. Garner. 7 In this case, the Court limited the use of deadly force by police to defense of life situations and incidents where the suspect committed a violent offense. Prior to the decision, the police in several states could use deadly force on any fleeing suspect accused of a felony offense. One day, the academy class was practicing mock traffic stops. During one of my mock traffic stops, I received information that the vehicle I stopped was stolen. The driver and passenger exited the vehicle and fled on foot. I did not use deadly force (this was a training exercise so was not real) against the suspects and was chastised by my instructor who insisted that I should have shot the suspects as they were fleeing. Training instructors, just like professors, convey authority knowledge but, in this case, the instructor was wrong. I was not legally authorized to use deadly force in the traffic stop scenario despite the insistence of my instructor to the contrary.

Politicians are sometimes taken as a source of authority knowledge about the law, crime, and criminal justice issues. Since they enact laws that directly impact the operations of the criminal justice system, we may assume they are an authority on crime and criminal justice. More specifically, we may assume that politicians know best about how to reduce crime and increase the effectiveness of the criminal justice system. However, history is rife with laws that sounded good on paper but had no impact on crime. For example, there is little evidence that sex offender registration protects the public from sexual predators or acts as a deterrent to repeat sex offenders even though every state has a law requiring convicted sex offenders to register with local authorities. Perhaps politicians are not the criminal justice experts some perceive them to be.

History is also full of criminal justice authorities that we now see as being misinformed. For example, Cesare Lombroso is the father of the positivist school of criminology. He is most readily recognized for his idea that some individuals are born criminal. He stated that criminals have certain unique biological characteristics, including large protruding jaws, high foreheads, flattened noses, and asymmetrical faces, to name a few. 8 These characteristics were similar to those found in primitive humans. Therefore, Lombroso argued that some individuals were genetic “throwbacks” to a more primitive time and were less evolved than other people and thus, were more likely to be criminals. Lombroso’s research has been discredited because he failed to compare criminals with noncriminals. By studying only criminals, he found characteristics that were common to criminals. However, if Lombroso had studied a group of noncriminals, he would have discovered that these biological characteristics are just as prevalent among noncriminals. This example involves authority knowledge that is supported by research but the research methods used were flawed. The errors of Lombroso seem obvious now, but what do we know today through authority knowledge that is inaccurate or will be proven wrong in the future?

Knowledge from Tradition

In addition to authority knowledge, people often rely on tradition for knowledge. Tradition knowledge relies on the knowledge of the past. Individuals accept something as true because that is the way things have always been so it must be right. A good example of tradition knowledge is preventive/random patrol. Ever since vehicles were brought into the police patrol function, police administrators assumed that having patrol officers drive around randomly in the communities they serve, while they are not answering calls for service, would prevent crime. If you were a patrol officer in the early 1970s and asked your supervisor, “Why do I drive around randomly throughout my assigned area when I am not answering a call for service?” the answer would have been, “That is the way we have always done patrol and random patrol reduces crime through deterrence.” The Kansas City Preventive Patrol Experiment challenged the tradition knowledge that preventive/random patrol reduces crime. The results of the study made it clear that the traditional practice of preventive/random patrol had little to no impact on reducing crime. This allowed police departments to develop other patrol deployment strategies such as directed patrol and “hot spots” policing since preventive patrol was seen as ineffective. The development of effective patrol deployment strategies continues today.

Knowledge from Common Sense

We frequently rely on common sense knowledge for what we know about crime and the criminal justice system because it “just makes sense.” For example, it “just makes sense” that if we send juvenile delinquents on a field trip to prison where they will see first hand the prison environment as well as be yelled at by actual prisoners, they will refrain from future delinquency. That is exactly what the program Scared Straight, originally developed in the 1970s, is designed to do. Scared Straight programs are still in existence today and are even the premise for the television show Beyond Scared Straight on the A&E television network. As originally created, the program was designed to decrease juvenile delinquency by bringing at-risk and delinquent juveniles into prison where they would be “scared straight” by inmates serving life sentences. Participants in the program were talked to and yelled at by the inmates in an effort to scare them. It was believed that the fear felt by the participants would lead to a discontinuation of their delinquent behavior so that they would not end up in prison themselves. This sounds like a good idea. It makes sense, and the program was initially touted as a success due to anecdotal evidence based on a few delinquents who turned their lives around after participation in the program.

However, evaluations of the program and others like it showed that the program was in fact unsuccessful. In the initial evaluation of the Scared Straight program, Finckenauer used a classic experimental design (discussed in Chapter 5), to evaluate the original “Lifer’s Program” at Rahway State Prison in New Jersey where the program was initially developed. 13 Juveniles were randomly assigned to an experimental group that attended the Scared Straight program and a control group that did not participate in the program. Results of the evaluation were not positive. Post-test measures revealed that juveniles who were assigned to the experimental group and participated in the program were actually more seriously delinquent afterwards than those who did not participate in the program. Also using an experimental design with random assignment, Yarborough evaluated the “Juvenile Offenders Learn Truth” (JOLT) program at the State Prison of Southern Michigan at Jackson. 14 This program was similar to that of the “Lifer’s Program,” only with fewer obscenities used by inmates. Post-test measurements were taken at two intervals, three and six months after program completion. Again, results were not positive. Findings revealed no significant differences in delinquency between those juveniles who attended the program and those who did not. Other experiments conducted on Scared Straight- type programs further revealed their inability to deter juveniles from further delinquency. 15 Despite the common sense popularity of these programs, the evaluations showed that Scared Straight programs do not reduce delinquency and, in some instances, may actually increase delinquency. The programs may actually do more harm than good. I guess that begs the question, “Why do we still do these types of programs?”

Scared Straight programs and other widely held common sense beliefs about crime and the criminal justice system are questionable, based on the available research evidence. Common sense is important in our daily lives and is frequently correct, but, at times, it also contains inaccuracies, misinformation, and even prejudice.

CLASSICS IN CJ RESEARCH

Is It Safe to Put Felons on Probation?

Research Study 9

In the mid-1970s, the number of offenders on probation began to significantly increase. By the mid-1980s, probation was the most frequently used sentence in most states and its use was becoming more common for felons, whereas previously, probation was typically limited to misdemeanor crimes and offenses committed by juveniles. Increasing numbers of felony offenders were being placed on probation because judges had no other alternative forms of punishment. Prisons were already operating above capacity due to rising crime rates. Despite the increase in the use of probation in the 1980s, few empirical studies of probation (particularly its use with felony offenders) had been published. In the early 1980s, the Rand Corporation conducted an extensive study of probation to learn more about the offenders sentenced to probation and the effectiveness of probation as a criminal sanction. At the time the study began, over one-third of California’s probation population were convicted felons. 10 This was the first large-scale study of felony probation.

Is it safe to put felons on probation?

Data for the study were obtained from the California Board of Prison Terms (CBPT). The Board had been collecting comprehensive data on all offenders sentenced to prison since 1978 and on a sample of adult males from 17 counties who received probation. From these two data sources, researchers selected a sample of male offenders who had been convicted of the following crimes: robbery, assault, burglary, theft, forgery, and drug offenses. These crimes were selected because an offender could receive either prison or probation if convicted. Approximately 16,500 male felony offenders were included in the study. For each offender, researchers had access to their personal characteristics, information on their crimes, court proceedings, and disposition.

Two main research questions were answered in this study. First, what were the recidivism rates for felony offenders who received probation? When assessing recidivism rates, the study found that the majority of offenders sentenced to probation recidivated during the follow-up period, which averaged 31 months. Overall, 65% of the sample of probationers were re-arrested and 51 % were charged with and convicted of another offense. A total of 18% were convicted of a violent crime.

The second research question asked, what were the characteristics of the probationers who recidivated? Property offenders were more likely to recidivate compared to violent or drug offenders. Researchers also discovered that probationers tended to recidivate by committing the same crime that placed them on probation. Rand researchers included time to recidivism in their analysis and found that property and violent offenders recidivated sooner than drug offenders. The median time to the first filed charge was five months for property offenders and eight months for violent offenders.

The issue of whether or not the findings would generalize to other counties in California and to other states was raised. Data for the study came from probation and prison records from two counties in California. These two counties were not randomly selected, but were chosen because of their large probation populations and the willingness of departments to provide information. Further, the probation departments in these counties had experienced significant budget cuts. Supervision may have become compromised as a result and this could have explained why these counties had high rates of recidivism. Studies of probation recidivism in other states have found recidivism rates to be much lower, suggesting the Rand results may not have applied elsewhere. 11 Several studies examining the effectiveness of probation and the factors correlated with probation outcomes were published after 1985. Much of this research failed to produce results consistent with the Rand study.

The Rand study of felony probation received a considerable amount of attention within the field of corrections. According to one scholar, the study was acclaimed as “the most important criminological research to be reported since World War II.” 12 The National Institute of Justice disseminated the report to criminal justice agencies across the country and even highlighted the study in their monthly newsletter. Today, the study remains one of the most highly cited pieces of corrections research.

According to Rand researchers, these findings raised serious doubts about the effectiveness of probation for felony offenders. Most of the felons sentenced to probation recidivated and researchers were unable to develop an accurate prediction model to improve the courts’ decision-making. The continued use of probation as a sanction for felony offenders appeared to be putting the public at risk. However, without adequate prison space, the courts had no other alternatives besides probation when sentencing offenders.

The researchers made several recommendations to address the limitations of using probation for felony offenders. First, it was recommended that states formally acknowledge that the purpose of probation had changed. Probation was originally used as a means of furthering the goal of rehabilitation in the correctional system. As the United States moved away from that goal in the late 1960s, the expectations of probation changed. Probation was now used as a way to exercise “restrictive supervision” over more serious offenders. Second, probation departments needed to redefine the responsibilities of their probation officers. Probation officers were now expected to be surveillance officers instead of treatment personnel, which required specialized training. In addition, states needed to explore the possibility of broadening the legal authority of its probation officers by allowing them to act as law enforcement officers if necessary. Third, states were advised to adopt a formal client management system that included risk/need assessments of every client. Such a system would help establish uniform, consistent treatment of those on probation and would also help departments allocate their resources efficiently and effectively. Fourth, researchers encouraged states to develop alternative forms of community punishment that offered more public protection than regular probation, which led to the development and use of intensive supervision probation, house arrest, electronic monitoring, day reporting centers, and other intermediate punishments.

Knowledge from Personal Experience

If you personally see something or if it actually happens to you, then you are likely to accept it as true and gain knowledge from the experience. Gaining knowledge through actual experiences is known as personal experience knowledge, and it has a powerful and lasting impact on everyone. Personal experiences are essential building blocks of knowledge and of what we believe to be true. The problem with knowledge gained from personal experiences is that personal experiences can be unique and unreliable, which can distort reality and lead us to believe things that are actually false.

How can events that someone personally experienced be wrong? The events are not wrong. Instead, the knowledge gained from the experience is wrong. For example, the research consistently shows that a person’s demeanor significantly impacts the decision-making of police officers. During a traffic stop, if a person is rude, disrespectful, and uncooperative to the officer, then the driver is more likely to receive a traffic citation than a warning. That is what the research on police discretion shows. However, if a person was rude and uncooperative to a police officer during a traffic stop and was let go without a citation, the person will gain knowledge from this personal experience. The knowledge gained may include that being disrespectful during future traffic stops will get this person out of future tickets. Not likely. The event is not wrong. Instead, the knowledge gained from the experience is wrong because being disrespectful to the police usually leads to more enforcement action taken by the police, not less.

As a student in criminal justice, you have probably experienced something similar in interaction with friends, relatives, and neighbors. Your knowledge of criminal justice that you have developed in your criminal justice classes is trumped by one experience your friend, relative, or neighbor had with the criminal justice system. They believe they are right because they experienced it. However, there are four errors that occur in the knowledge gained from personal experiences: overgeneralization, selective observation, illogical reasoning, and resistance to change.

Overgeneralization happens when people conclude that what they have observed in one or a few cases is true for all cases. For example, you may see that a wealthy businesswomen in your community is acquitted of bribery and may conclude that “wealthy people, especially women, are never convicted in our criminal justice system,” which is an overgeneralization. It is common to draw conclusions about people and society from our personal interactions, but, in reality, our experiences are limited because we interact with just a small percentage of people in society.

The same is true for practitioners in the criminal justice system. Practitioners have a tendency to believe that because something was done a particular way in their agency, it is done that way in all agencies. That may not be true. Although there are certainly operational similarities across criminal justice agencies, there are also nuances that exist across the over 50,000 criminal justice agencies in the United States. Believing that just because it was that way in your agency, it must be that way in all agencies leads to overgeneralization.

Selective observation is choosing, either consciously or unconsciously, to pay attention to and remember events that support our personal preferences and beliefs. In fact, with selective observation, we will seek out evidence that confirms what we believe to be true and ignore the events that provide contradictory evidence. We are more likely to notice pieces of evidence that reinforce and support our ideology. As applied to the criminal justice system, when we are inclined to be critical of the criminal justice system, it is pretty easy to notice its every failing and ignore its successes. For example, if someone believes the police commonly use excessive force, the person is more likely to pay attention to and remember a police brutality allegation on the nightly news than a police pursuit that led to the apprehension of the suspect without incident on the same nightly news. As another example, if you believe treatment efforts on sex offenders are futile, you will pay attention to and remember each sex offender you hear about that recidivates but will pay little attention to any successes. It is easy to find instances that confirm our beliefs, but with selective observation, the complete picture is not being viewed. Therefore, if we only acknowledge the events that confirm our beliefs and ignore those that challenge them, we are falling victim to selective observation.

Besides selective observation, some of our observations may simply be wrong. Consider eyewitness identification. It is a common practice in the criminal justice system, but research has consistently demonstrated inaccuracies in eyewitness identification. The witness feels certain that the person viewed is the person who committed the offense, but sometimes the witness is wrong. Even when our senses of sight, hearing, taste, touch, and smell are fully operational, our minds have to interpret what we have sensed, which may lead to an inaccurate observation.

RESEARCH IN THE NEWS

When Your Criminal Past Isn’t Yours 16

The business of background checks on prospective employees is increasing significantly. According to the Society for Human Resource Management, since the events of September 11, 2001, the percentage of companies that conduct criminal history checks during the hiring process has risen past 90%. Employers spend at least $2 billion a year to look into the pasts of their prospective employees. Problems with the business of background checks were identified through research that included a review of thousands of pages of court filings and interviews with dozens of court officials, data providers, lawyers, victims, and regulators.

The business of background checks is a system weakened by the conversion to digital files and compromised by the significant number of private companies that profit by amassing public records and selling them to employers. The private companies create a system in which a computer program scrapes the public files of court systems around the country to retrieve personal data. Basically, these are automated data-mining programs. Today, half the courts in the United States put criminal records on their public websites. So, the data are there for the taking, but the records that are retrieved typically are not checked for errors—errors that would be obvious to human eyes.

The errors can start with a mistake entered into the logs of a law enforcement agency or a court file. The biggest culprits, though, are companies that compile databases using public information. In some instances, their automated formulas misinterpret the information provided them. Other times, records wind up assigned to the wrong people with a common name. Furthermore, when a government agency erases a criminal conviction after a designated period of good behavior, many of the commercial databases don’t perform the updates required to purge offenses that have been removed from public record. It is clear that these errors can have substantial ramifications, including damaged reputations and loss of job opportunities.

Illogical reasoning occurs when someone jumps to premature conclusions or presents an argument that is based on invalid assumptions. Premature conclusions occur when we feel we have the answer based on a few pieces of evidence and do not need to seek additional information that may invalidate our conclusion. Think of a detective who, after examining only a few pieces of evidence, quickly narrows in on a murder suspect. It is common for a detective to assess the initial evidence and make an initial determination of who committed the murder. However, it is hoped that the detective will continue to sort through all the evidence for confirmation or rejection of his original conclusion regarding the murder suspect. Illogical reasoning by jumping to premature conclusions is common in everyday life. We look for evidence to confirm or reject our beliefs and stop when a small amount of evidence is present; we jump to conclusions. If a person states, “I know four people who have dropped out of high school, and each one of them ended up addicted to drugs, so all dropouts abuse drugs,” the person is jumping to conclusions.

Illogical reasoning also occurs when an argument, based on invalid assumptions, is presented. Let’s revisit the Scared Straight example previously discussed. Program developers assumed that brief exposure to the harsh realities of prison would deter juveniles from future delinquency. The Scared Straight program is an example of illogical reasoning. Four hours of exposure to prison life is not going to counteract years of delinquency and turn a delinquent into a nondelinquent. The program is based on a false assumption and fails to recognize the substantial risk factors present in the lives of most delinquents that must be mediated before the juvenile can live a crime-free lifestyle. A fear of prison, developed through brief exposure, is not enough to counteract the risk factors present in the lives of most delinquents. Although the Scared Straight program sounds good, it is illogical to assume that a brief experience with prison life will have a stronger impact on the decisions made by delinquents than peer support for delinquency, drug abuse, lack of education, poor parental supervision, and other factors that influence delinquency.

Resistance to change is the reluctance to change our beliefs in light of new, accurate, and valid information to the contrary. Resistance to change is common and it occurs for several reasons. First, even though our personal experience may be counter to our belief system, it is hard to admit we were wrong after we have taken a position on an issue. Even when the research evidence shows otherwise, people who work within programs may still believe they are effective. As previously stated, even though the research evidence shows otherwise, Scared Straight programs still exist and there is even a television show devoted to the program. Second, too much devotion to tradition and the argument that this is the way it has always been done inhibits change and hinders our ability to accept new directions and develop new knowledge. Third, uncritical agreement with authority inhibits change. Although authority knowledge is certainly an important means of gaining knowledge, we must critically evaluate the ideas, beliefs, and statements of those in positions of authority and be willing to challenge those statements where necessary. However, people often accept the beliefs of those in positions of authority without question, which hinders change.

Knowledge from Media Portrayals

Television shows, movies, websites, newspapers, and magazine articles are important sources of information. This is especially true for information about crime and the criminal justice system since most people have not had much contact with criminals or the criminal justice system. Instead of gaining knowledge about the criminal justice system through personal experience, most people learn about crime and the operations of the criminal justice system through media outlets. Since the primary goal of many of these media outlets is to entertain, they may not accurately reflect the reality of crime and criminal justice. Despite their inaccuracies, the media has a substantial impact on what people know about crime and the criminal justice system. Most people know what they know about crime and criminal justice through the media, and this knowledge even has an impact on criminal justice system operations.

An example of the potential impact of the media on the actual operations of the criminal justice system involves the CSI: Crime Scene Investigation television shows. The shows have been criticized for their unrealistic portrayal of the role of forensic science in solving criminal cases. Critics claim that CSI viewers accept what they see on the show as an accurate representation of how forensic science works. When summoned for jury duty, they bring with them unrealistic expectations of the forensic evidence they will see in trial. When the expected sophisticated forensic evidence is not presented in the real trial, the juror is more likely to vote to acquit the defendant. This phenomenon is known as the CSI Effect. Has the research shown that the CSI Effect exists and is impacting the criminal justice system? Most of the research shows that the CSI Effect does not exist and thus does not impact juror decision-making, but other research has shown that viewers of CSI have higher expectations related to evidence presented at trial. 17

There are several instances in which media attention on a particular topic created the idea that a major problem existed when it did not. An example is Halloween sadism. Halloween sadism is the practice of giving contaminated treats to children during trick or treating. 18 In 1985, Joel Best wrote an article entitled, “The Myth of the Halloween Sadist.” 19 His article reviewed press coverage of Halloween sadism in the leading papers in the three largest metropolitan areas ( New York Times, Los Angeles Times, and Chicago Tribune ) from 1958–1984. Although the belief in Halloween sadism is widespread, Best found few reported incidents and few reports of children being injured by Halloween sadism. Follow-ups on these reported incidents led to the conclusion that most of these reports were hoaxes. Best concluded, “I have been unable to find a substantiated report of a child being killed or seriously injured by a contaminated treat picked up in the course of trick or treating.” 20 Since 1985, Best has kept his research up to date and has come to the same conclusion. Halloween sadism is an urban legend; it is a story that is told as true, even though there is little or no evidence that the events in the story ever occurred.

Dispelling Myths: The Power of Research Methods

In the prior section, sources of knowledge were discussed along with the limitations of each. A researcher (e.g., criminologist), ideally, takes no knowledge claim for granted, but instead relies on research methods to discover the truth. In the attempt to generate new knowledge, a researcher is skeptical of knowledge that is generated by the sources discussed in the prior section, and this skepticism leads to the questioning of conventional thinking. Through this process, existing knowledge claims are discredited, modified, or substantiated. Research methods provide the researcher with the tools necessary to test current knowledge and discover new knowledge.

Although knowledge developed through research methods is by no means perfect and infallible, it is definitely a more systematic, structured, precise, and evidence-based process than the knowledge sources previously discussed. However, researchers should not dismiss all knowledge from the prior sources discussed, because, as mentioned, these sources of knowledge are sometimes accurate and certainly have their place in the development of knowledge. Researchers should guard against an elitist mind-set in which all knowledge, unless it is research-based knowledge, is dismissed.

To further discuss the importance of research methods in the development of knowledge, this section will discuss myths about crime and criminal justice. Myths are beliefs that are based on emotion rather than rigorous analysis. Take the myth of the Halloween sadist previously discussed. Many believe that there are real examples of children being harmed by razor blades, poison, or other nefarious objects placed in Halloween candy. This belief has changed the practices of many parents on Halloween; not allowing their children to trick-or-treat in their neighborhood and forbidding them from going to the doors of strangers. After careful analysis by Best, there is not a single, known example of children being seriously injured or killed by contaminated candy given by strangers. The Halloween sadist is a myth but it is still perpetuated today, and as the definition states, it is a belief based upon emotion rather than rigorous analysis. People accept myths as accurate knowledge of reality when, in fact, the knowledge is false.

The power of research is the ability to dispel myths. If someone were to assess the research literature on a myth or do their own research, she would find that the knowledge based on the myth is wrong. Perceived reality is contradicted by the facts developed through research. But that does not mean that the myth still doesn’t exist. It is important to keep in mind that the perpetuation and acceptance of myths by the public, politicians, and criminal justice personnel has contributed to the failure of criminal justice practices and policies designed to reduce crime and improve the operations of the criminal justice system. In this section, a detailed example of a myth about crime, police, courts, and corrections will be presented to demonstrate how the myth has been dispelled through research. In addition, several additional myths about crime, police, courts, and corrections will be briefly presented.

The Health Benefits of Alcohol Consumption 21

The press release from Oregon State University is titled “Beer Compound Shows Potent Promise in Prostate Cancer Battle.” The press release leads to several newspaper articles throughout the country written on the preventative nature of drinking beer on prostate cancer development with titles such as “Beer Protects Your Prostate” and “Beer May Help Men Ward Off Prostate Cancer.” By the titles alone, this sounds great; one of the main ingredients in beer appears to thwart prostate cancer.

The study that generated these headlines was conducted by a group of researchers at Oregon State University using cultured cells with purified compounds in a laboratory setting. The research showed that xanthohumol, a compound found in hops, slowed the growth of prostate cancer cells and also the growth of cells that cause enlarged prostates. But you would have to drink more than 17 pints of beer to consume a medically effective dose of xanthohumol, which is almost a case of beer. In addition, although the research is promising, further study is necessary to determine xanthohumol’s true impact on prostate cancer.

These are the types of headlines that people pay attention to and want to believe as true, even if disproven by later research. People want to believe that there are health benefits to alcohol consumption. You have probably heard about the health benefits of drinking red wine, but here is something you should consider. Recently, the University of Connecticut released a statement describing an extensive research misconduct investigation involving a member of its faculty. The investigation was sparked by an anonymous allegation of research irregularities. The comprehensive report of the investigation, which totals approximately 60,000 pages, concludes that the professor is guilty of 145 counts of fabrication and falsification of data. The professor had gained international notoriety for his research into the beneficial properties of resveratrol, which is found in red wine, especially its impact on aging. Obviously, this throws his research conclusions, that red wine has a beneficial impact on the aging process, into question.

Myths about Crime—Drug Users Are Violent

The myth of drug users as violent offenders continues to be perpetuated by media accounts of violent drug users. The public sees drug users as violent offenders who commit violent crimes to get money for drugs or who commit violent crimes while under the intoxicating properties of drugs. The public also recognizes the violent nature of the drug business with gangs and cartels using violence to protect their turf. In May 2012, extensive media attention was given to the case of the Miami man who ate the face of a homeless man for an agonizing 18 minutes until police shot and killed the suspect. The police believed that the suspect was high on the street drug known as “bath salts.” This horrific case definitely leaves the image in the public’s mind about the relationship between violence and drug use.

In recent years, media reports have focused on the relationship between methamphetamine use and violence; before then it was crack cocaine use and violence. 32 However, media portrayals regarding the violent tendencies of drug users date back to the 1930s and the release of Reefer Madness. In 1985, Goldstein suggested that drugs and violence could be related in three different ways:

1. violence could be the direct result of drug ingestion;

2. violence could be a product of the instability of drug market activity; and

3. violence could be the consequence of people having a compulsive need for drugs or money for drugs. 33

So, what does the research show? Studies have found that homicides related to crack cocaine were usually the product of the instability of drug market activity (i.e., buying and selling drugs can be a violent activity) and rarely the result of drug ingestion. 34 After an extensive review of research studies on alcohol, drugs, and violence, Parker and Auerhahn concluded, “Despite a number of published statements to the contrary, we find no significant evidence suggesting that drug use is associated with violence. There is substantial evidence to suggest that alcohol use is significantly associated with violence of all kinds.” 35 The reality is not everyone who uses drugs becomes violent and users who do become violent do not do so every time they use drugs; therefore, the relationship between violence and drug use is a myth.

MYTHS ABOUT CRIME

Some additional myths about crime that research does not support include:

•Crime statistics accurately show what crimes are being committed and what crimes are most harmful. 22

•Most criminals—especially the dangerous ones—are mentally ill. 23

•White-collar crime is only about financial loss and does not hurt anyone. 24

•Serial murderers are middle-aged, white males. 25

•Criminals are significantly different from noncriminals. 26

•People are more likely to be a victim of violent crime committed by a stranger than by someone they know. 27

•Older adults are more likely to be victimized than people in any other age group. 28

•Sex offender registration protects the public from sexual predators. 29

•Juvenile crime rates are significantly increasing. 30

•Only the most violent juveniles are tried as adults. 31

Myths about Police—Female Police Officers Do Not Perform as Well as Males

Female police officers still face the myth that they cannot perform as well as male police officers. Throughout history, females have faced significant difficulties even becoming police officers. In the past, it was common for police agencies to require all police applicants to meet a minimum height requirement to be considered for employment. The minimum height requirement was 5′8″ for most agencies, which limited the ability of females to successfully meet the minimum standards to become a police officer. Even if women could meet the minimum height requirements, they were typically faced with a physical-abilities test that emphasized upper body strength (e.g., push-ups and bench presses). Women failed these tests more often than men, and thus were not eligible to be police officers. Minimum height requirements are no longer used in law enforcement, but the perception that female police officers are not as good as males still exists. Today, the myth that women cannot be effective police officers is based largely on the belief that the need to demonstrate superior physical strength is a daily, common occurrence in law enforcement along with the belief that police work is routinely dangerous, violent, and crime-related.

So, what does the research show? On occasion, it is useful for police officers to be able to overpower suspects by demonstrating superior physical strength, but those types of activities are rare in law enforcement. In addition, it is fairly rare for a police officer to have to deal with a dangerous and violent encounter or even an incident involving a crime. The Police Services Study conducted in the 1970s analyzed 26,418 calls for service in three metropolitan areas and found that only 19% of calls for service involve crime and only 2% of the total calls for service involve violent crime. 43 This research study was among the first to assess the types of calls for service received by police agencies.

Despite the belief that women do not make good police officers, consistent research findings show that women are extremely capable as police officers, and in some respects, outperform their male counterparts. 44 Research has demonstrated several advantages to the hiring, retention, and promotion of women in law enforcement. First, female officers are as competent as their male counterparts. Research does not show any consistent differences in how male and female patrol officers perform their duties. Second, female officers are less likely to use excessive force. Research has shown that female patrol officers are less likely to be involved in high-speed pursuits, incidents of deadly force, and the use of excessive force. Female officers are more capable at calming potentially violent situations through communication and also demonstrate heightened levels of caution. Third, female officers can help implement community-oriented policing. Studies have shown that female officers are more supportive of the community-policing philosophy than are their male counterparts. Fourth, female officers can improve law enforcement’s response to violence against women. Studies have shown that female officers are more patient and understanding in handling domestic violence calls, and female victims of domestic violence are more likely to provide positive evaluations of female officers than their male counterparts. 52

MYTHS ABOUT POLICE

Some additional myths about the police that research does not support include:

•Police target minorities for traffic stops and arrests. 36

•Most crimes are solved through forensic science. 37

•COMPSTAT reduces crime. 38

•Intensive law enforcement efforts at the street level will lead to the control of illicit drug use and abuse. 39

•Police work primarily entails responding to crimes in progress or crimes that have just occurred. 40

•Police presence reduces crime. 41

•Detectives are most responsible for solving crimes and arresting offenders. 42

Myths about Courts—The Death Penalty Is Administered Fairly

According to a recent Gallup poll, 52% of Americans say the death penalty is applied fairly in the United States, the lowest mark in almost 40 years. 53 The issue of fairness and the death penalty typically concerns whether the punishment is equally imposed on offenders who are equally deserving based on legal factors (i.e., similar offense, similar prior criminal history, similar aggravating circumstances, and similar mitigating circumstances). 54 Unfairness can be shown if similarly situated offenders are more or less likely to receive death sentences based on age, gender, and race.

So, what does the research show? First, has research shown that a defendant’s age influences his or her chances of being sentenced to death? A study of about 5,000 homicides, controlling for legally relevant variables, found that defendants over the age of 25 were more than twice as likely to receive the death penalty in comparison to those 25 years of age or younger. 55

Second, has research shown that a defendant’s gender influences his or her chance of being sentenced to death? Capital punishment is almost exclusively reserved for male defendants. On December 31, 2010, there were 3,158 prisoners under a sentence of death in the United States: 58 were women, or 1.8%. 56 However, women account for 10–12% of all murders in the United States. 57 One research study found that male defendants were 2.6 times more likely than females to receive a death sentence after controlling for legally relevant factors. 58

Third, has research shown that a defendant’s race influences his or her chance of being sentenced to death? Most of the research on the biased nature of the death penalty has focused on racial inequities in the sentence. Although some research has shown that a defendant’s race has an impact on the likelihood of receiving a death sentence, a significant amount of research has shown that the race of the victim has the most substantial impact on death sentences. The research evidence clearly shows that offenders who murder white victims are more likely to receive a death sentence than offenders who murder black victims. 59 When assessing the race of both the victim and offender, the composition most likely to receive the death penalty is when a black offender murders a white victim. 60

MYTHS ABOUT COURTS

Some additional myths about courts that research does not support include:

•Many criminals escape justice because of the exclusionary rule. 45

•Subjecting juvenile offenders to harsh punishments can reduce crime committed by juveniles. 46

•Public opinion is overwhelmingly in favor of imprisonment and harsh punishment for offenders. 47

•The death penalty brings closure and a sense of justice to the family and friends of murder victims. 48

•Insanity is a common verdict in criminal courts in the United States. 49

•Eyewitness identification is reliable evidence. 50

•Most people who commit crimes based on hatred, bias, or discrimination face hate crime charges and longer sentencing. 51

Myths about Corrections—Imprisonment Is the Most Severe Form of Punishment

It seems clear that besides the death penalty, the most severe punishment available in our criminal justice system is to lock up offenders in prison. On a continuum, it is perceived that sentence severity increases as one moves from fines, to probation, to intermediate sanctions such as boot camps, and finally, to incarceration in prison. The public and politicians support this perception as well.

So, what does the research show? What do criminals think is the most severe form of punishment? A growing body of research has assessed how convicted offenders perceive and experience the severity of sentences in our criminal justice system. 61 Research suggests that alternatives to incarceration in prison (i.e., probation and intermediate sanctions) are perceived by many offenders as more severe due to a greater risk of program failure (e.g., probation revocation). In comparison, serving prison time is easier. 62

For example, one study found that about one-third of nonviolent offenders given the option of participating in an Intensive Supervision Probation (ISP) program, chose prison instead because the prospects of working every day and submitting to random drug tests was more punitive than serving time in prison. 73 Prisoners also stated that they would likely be caught violating probation conditions (i.e., high risk of program failure) and be sent to prison anyway. 74 In another research study involving survey responses from 415 inmates serving a brief prison sentence for a nonviolent crime, prison was considered the eighth most severe sanction, with only community service and probation seen as less punitive. Electronic monitoring (seventh), intensive supervision probation (sixth), halfway house (fifth), intermittent incarceration (fourth), day reporting (third), county jail (second), and boot camp (first) were all rated by inmates as more severe sanctions than prison. 75

MYTHS ABOUT CORRECTIONS

Some additional myths about corrections that research does not support include:

•Punishing criminals reduces crime. 63

•Prisons are too lenient in their day-to-day operations (prisons as country clubs). 64

•Prisons can be self-supporting if only prisoners were forced to work. 65

•Private prisons are more cost effective than state-run prisons. 66

•Focus of community corrections is rehabilitation rather than punishment. 67

•Correctional rehabilitation does not work. 68

•Drug offenders are treated leniently by the criminal justice system. 69

•Most death row inmates will be executed eventually. 70

•If correctional sanctions are severe enough, people will think twice about committing crimes. 71

•Sexual violence against and exploitation of inmates of the same gender are primarily the result of lack of heterosexual opportunities. 72

What is Research and Why is It Important to be an Informed Consumer of Research?

We probably should have started the chapter with the question “What is research?” but we wanted to initially lay a foundation for the question with a discussion of the problems with how knowledge is developed and the power of research in discovering the truth. Research methods are tools that allow criminology and criminal justice researchers to systematically study crime and the criminal justice system. The study of research methods is the study of the basic rules, appropriate techniques, and relevant procedures for conducting research. Research methods provide the tools necessary to approach issues in criminal justice from a rigorous standpoint and challenge opinions based solely on nonscientific observations and experiences. Similarly, research is the scientific investigation of an issue, problem, or subject utilizing research methods. Research is a means of knowledge development that is designed to assist in discovering answers to research questions and leads to the creation of new questions.

How Is Knowledge Development through Research Different?

Previously, sources of knowledge development were discussed, including authority, tradition, common sense, personal experience, and media portrayals. The problems generated by each knowledge source were also discussed. Research is another source of knowledge development, but it is different than those previously discussed in several ways. First, research relies on logical and systematic methods and observations to answer questions. Researchers use systematic, well-established research practices to seek answers to their questions. The methods and observations are completed in such a way that others can inspect and assess the methods and observations and offer feedback and criticism. Researchers develop, refine, and report their understanding of crime and the criminal justice system more systematically than the public does through casual observation. Those who conduct scientific research employ much more rigorous methods to gather the information/knowledge they are seeking.

Second, in order to prove that a research finding is correct, a researcher must be able to replicate the finding using the same methods. Only through replication can we have confidence in our original finding. For researchers, it may be important to replicate findings many times over so that we are assured our original finding was not a coincidence or chance occurrence. The Minneapolis Domestic Violence Experiment is an example of this and will be discussed in detail in Chapter 5. In the experiment, the researchers found that arrests for domestic violence lead to fewer repeat incidences in comparison to separation of the people involved and mediation. Five replication studies were conducted and none were able to replicate the findings in the Minneapolis study. In fact, three of the replications found that those arrested for domestic violence had higher levels of continued domestic violence, so arrest did not have the deterrent effect found in the Minneapolis study.

Third, research is objective. Objectivity indicates a neutral and nonbiased perspective when conducting research. Although there are examples to the contrary, the researcher should not have a vested interest in what findings are discovered from the research. The researcher is expected to remain objective and report the findings of the study regardless of whether the findings support their personal opinion or agenda. In addition, research ensures objectivity by allowing others to examine and be critical of the methodology, findings, and results of research studies.

It should be clear that using research methods to answer questions about crime and the criminal justice system will greatly reduce the errors in the development of knowledge previously discussed. For example, research methods reduces the likelihood of overgeneralization by using systematic procedures for selecting individuals or groups to study that are representative of the individuals or groups that we wish to generalize. This is the topic of Chapter 3, which covers sampling procedures. In addition, research methods reduces the risk of selective observation by requiring that we measure and observe our research subjects systematically.

Being an Informed Consumer of Research

Criminal justice and criminological research is important for several reasons. First, it can provide better and more objective information. Second, it can promote better decision-making. Today, more than ever, we live in a world driven by data and in which there is an increasing dependence on the assessment of data when making decisions. As well as possible, research ensures that our decisions are based on data and not on an arbitrary or personal basis. Third, it allows for the objective assessment of programs. Fourth, it has often been the source of innovation within criminal justice agencies. Fifth, it can be directly relevant to criminal justice practice and have a significant impact on criminal justice operations.

Before we apply research results to practices in the criminal justice system, and before we even accept those research results as reasonable, we need to be able to know whether or not they are worthwhile. In other words, should we believe the results of the study? Research has its own limitations, so we need to evaluate research results and the methods used to produce them, and we do so through critical evaluation. Critical evaluation involves identifying both positive and negative aspects of the research study—both the good and the bad. Critical evaluation involves comparing the methodology used in the research with the standards established in research methods.

Through critical evaluation, consumers of research break studies down into their essential elements. What are the research questions and hypotheses? What were the independent and dependent variables? What research design was used? Was probability sampling used? What data-gathering procedures were employed? What type of data analysis was conducted and what conclusions were made? These are some of the questions that are asked by informed consumers of research. The evaluation of research ranges from the manner in which one obtains an idea to the ways in which one writes about the research results, and understanding each step in the research process is useful in our attempts to consume research conducted by others. Located between these two activities are issues concerning ethics, sampling, research design, data analyses, and interpretations.

The research design and procedures are typically the most critically evaluated aspects of research and will likewise receive the greatest amount of attention in this text. Informed consumers of research don’t just take the results of a research study at face value because the study is in an academic journal or written by someone with a Ph.D. Instead, informed consumers critically evaluate research. Taking what is learned throughout this text, critical evaluation of research is covered in Chapter 8, and upon completing this text, it is hoped that you will be an informed consumer of research and will put your research knowledge to use throughout your career.

Although many students will never undertake their own research, all will be governed by policies based upon research and exposed to research findings in their chosen professional positions. Most government agencies, including the criminal justice system, as well as private industry, routinely rely on data analysis. Criminal justice students employed with these agencies will be challenged if not prepared for quantitative tasks. Unfortunately, it is not unusual to find students as well as professionals in criminal justice who are unable to fully understand research reports and journal articles in their own field.

Beyond our criminal justice careers, we are all exposed to and use research to help us understand issues and to make personal decisions. For example, we know that cigarette smoking causes lung cancer and has other significant health impacts, so we don’t smoke. Your doctor tells you that your cholesterol is too high and you need to limit your red meat intake because research shows that consumption of red meat raises cholesterol; so, you quit eating red meat. That is why not all the examples in this text are criminal justice research examples. Some come from the medical field while others come from psychology and other disciplines. This is to remind you that you are probably exposed to much more research than you thought on day one of this class.

Overall, knowledge of research methods will allow you to more appropriately consider and consume information that is important to your career in criminal justice. It will help you better understand the process of asking and answering a question systematically and be a better consumer of the kind of information that you really need to be the best criminal justice professional you can. Once familiar with research methods, your anxiety about reviewing technical reports and research findings can be minimized. As discussed in the next section, research methods involve a process and once you understand the process, you can apply your knowledge to any research study, even those in other disciplines.

The Research Process

One of the nice things about studying research methods is it is about learning a process. Research methods can be seen as a sequential process with the first step being followed by the second step, and so on. There are certainly times when the order of the steps may be modified, but researchers typically follow the same process for each research study they complete regardless of the research topic (as depicted in Figure 2.1 in Chapter 2). Very simply, a research problem or question is identified, and a methodology is selected, developed, and implemented to answer the research question. This sequential process is one of the advantages of understanding research methods, because once you understand the process, you can apply that process to any research question that interests you. In addition, research methods are the same across disciplines. So, sampling is the same in business as it is in health education and as it is in criminal justice. Certainly the use of a particular method will be more common in one discipline in comparison to another, but the protocol for implementing the method to complete the research study is the same. For example, field research (discussed in Chapter 6) is used much more frequently in anthropology than in criminal justice. However, the research protocol to implement field research is the same whether you are studying an indigenous Indian tribe in South America in anthropology or a group of heroin users in St. Louis in criminal justice.

Some authors have presented the research process as a wheel or circle, with no specific beginning or end. Typically, the research process begins with the selection of a research problem and the development of research questions or hypotheses (discussed further in Chapter 2). It is common for the results of previous research to generate new research questions and hypotheses for the researcher. This suggests that research is cyclical, a vibrant and continuous process. When a research study answers one question, the result is often the generation of additional questions, which plunges the researcher right back into the research process to complete additional research to answer these new questions.

In this section, a brief overview of the research process will be presented. The chapters that follow address various aspects of the research process, but it is critical that you keep in mind the overall research process as you read this book, which is why is it presented here. Although you will probably not be expected to conduct a research study on your own, it is important for an educated consumer of research to understand the steps in the research process. The steps are presented in chronological order and appear neatly ordered. In practice, the researcher can go back and forth between the steps in the research process.

Step 1: Select a Topic and Conduct a Literature Review

The first step in the research process is typically the identification of a problem or topic that the researcher is interested in studying. Research topics can arise from a wide variety of sources, including the findings of a current study, a question that a criminal justice agency needs to have answered, or the result of intellectual curiosity. Once the researcher has identified a particular problem or topic, the researcher assesses the current state of the literature related to the problem or topic. The researcher will often spend a considerable amount of time in determining what the existing literature has to say about the topic. Has the topic already been studied to the point that the questions in which the researcher is interested have been sufficiently answered? If so, can the researcher approach the subject from a previously unexamined perspective? Many times, research topics have been previously explored but not brought to completion. If this is the case, it is certainly reasonable to examine the topic again. It is even appropriate to replicate a previous study to determine whether the findings reported in the prior research continue to be true in different settings with different participants. This step in the research process is also discussed in Chapter 2.

Step 2: Develop a Research Question

After a topic has been identified and a comprehensive literature review has been completed on the topic, the next step is the development of a research question or questions. The research question marks the beginning of your research study and is critical to the remaining steps in the research process. The research question determines the research plan and methodology that will be employed in the study, the data that will be collected, and the data analysis that will be performed. Basically, the remaining steps in the process are completed in order to answer the research question or questions established in this step. The development of research questions is discussed in more detail in Chapter 2.

Step 3: Develop a Hypothesis

After the research questions have been established, the next step is the formulation of hypotheses, which are statements about the expected relationship between two variables. For example, a hypothesis may state that there is no relationship between heavy metal music preference and violent delinquency. The two variables stated in the hypothesis are music preference and violent delinquency. Hypothesis development is discussed in more detail in Chapter 2.

Step 4: Operationalize Concepts

Operationalization involves the process of giving the concepts in your study a working definition and determining how each concept in your study will be measured. For example, in Step 3, the variables were music preference and violent delinquency. The process of operationalization involves determining how music preference and violent delinquency will be measured. Operationalization is further discussed in Chapter 2.

Step 5: Develop the Research Plan and Methodology

The next step is to develop the methodology that will be employed to answer the research questions and test the hypotheses. The research methodology is the blueprint for the study, which outlines how the research is to be conducted. The research questions will determine the appropriate methodology for the study. The research design selected should be driven by the research questions asked. In other words, the research questions dictate the methods used to answer them. The methodology is basically a research plan on how the research questions will be answered and will detail:

1. What group, subjects, or population will be studied and selected? Sampling will be discussed in Chapter 3.

2 . What research design will be used to collect data to answer the research questions? Various research designs will be covered in Chapters 4–7.

You need to have familiarity with all research designs so that you can become an educated consumer of research. A survey cannot answer all research questions, so knowing a lot about surveys but not other research designs will not serve you well as you assess research studies. There are several common designs used in criminal justice and criminology research. Brief descriptions of several common research designs are presented below, but each is discussed in detail in later chapters.

Survey research is one of the most common research designs employed in criminal justice research. It obtains data directly from research participants by asking them questions and is often conducted through self-administered questionnaires and personal interviews. For example, a professor might have her students complete a survey during class to understand the relationship between drug use and self-esteem. Survey research is discussed in Chapter 4.

Experimental designs are used when researchers are interested in determining whether a program, policy, practice, or intervention is effective. For example, a researcher may use an experimental design to determine if boot camps are effective at reducing juvenile delinquency. Experimental design is discussed in Chapter 5.

Field research involves researchers studying individuals or groups of individuals in their natural environment. The researcher is observing closely or acting as part of the group under study and is able to describe in depth not only the subject’s behaviors, but also consider the motivations that drive those behaviors. For example, if a researcher wanted to learn more about gangs and their activities, he may “hang out” with a gang in order to observe their behavior. Field research is discussed in Chapter 6.

A case study is an in-depth analysis of one or a few illustrative cases. This design allows the story behind an individual, a particular offender, to be told and then information from cases studies can be extrapolated to a larger group. Often these studies require the review and analysis of documents such as police reports and court records and interviews with the offender and others. For example, a researcher may explore the life history of a serial killer to try and understand why the offender killed. Case studies are discussed in Chapter 6.

Secondary data analysis occurs when researchers obtain and reanalyze data that was originally collected for a different purpose. This can include reanalyzing data collected from a prior research study, using criminal justice agency records to answer a research question, or historical research. For example, a researcher using secondary data analysis may analyze inmate files from a nearby prison to understand the relationship between custody level assignment and disciplinary violations inside prison. Secondary data analysis is discussed in Chapter 7.

Content analysis requires the assessment of content contained in mass communication outlets such as newspapers, television, magazines, and the like. In this research design, documents, publications, or presentations are reviewed and analyzed. For example, a researcher utilizing content analysis might review true crime books involving murder to see how the characteristics of the offender and victim in the true crime books match reality as depicted in the FBI’s Supplemental Homicide Reports. Content analysis is discussed in Chapter 7.

Despite the options these designs offer, other research designs are available and will be discussed later in the text. Ultimately, the design used will depend on the nature of the study and the research questions asked.

Step 6: Execute the Research Plan and Collect Data

The next step in the research process is the collection of the data based on the research design developed. For example, if a survey is developed to study the relationship between gang membership and violent delinquency, the distribution and collection of surveys from a group of high school students would occur in this step. Data collection is discussed in several chapters throughout this text.

Step 7: Analyze Data

After the data have been collected, the next phase in the research process involves analyzing the data through various and appropriate statistical techniques. The most common means for data analysis today is through the use of a computer and statistically oriented software. Data analysis and statistics are discussed in Chapter 9.

Step 8: Report Findings, Results, and Limitations

Reporting and interpreting the results of the study make up the final step in the research process. The findings and results of the study can be communicated through reports, journals, books, or computer presentations. At this step, the results are reported and the research questions are answered. In addition, an assessment is made regarding the support or lack of support for the hypotheses tested. It is also at this stage that the researcher can pose additional research questions that may now need to be answered as a result of the research study. In addition, the limitations of the study, as well as the impact those limitations may have on the results of the study, will be described by the researcher. All research has limitations, so it is incumbent on the researcher to identify those limitations for the reader. The process of assessing the quality of research will be discussed in Chapter 8.

Research in Action: Impacting Criminal Justice Operations

Research in the criminal justice system has had significant impacts on its operations. The following sections provide an example of research that has significantly impacted each of the three main components of the criminal justice system: police, courts, and corrections. The purpose of this section is to demonstrate that research has aided the positive development and progression of the criminal justice system.

Police Research Example 76

The efforts of criminal justice researchers in policing have been important and have created the initial and critical foundation necessary for the further development of effective and productive law enforcement. One seminal study asked: How important is it for the police to respond quickly when a citizen calls? The importance of rapid response was conveyed in a 1973 National Commission on Productivity Report despite the fact that there was very little empirical evidence upon which to base this assumption. In fact, the Commission stated “there is no definitive relationship between response time and deterrence, but professional judgment and logic do suggest that the two are related in a strong enough manner to make more rapid response important.” 77 Basically the Commission members were stating that we don’t have any research evidence that response times are important, but we “know” that they are. Police departments allocated substantial resources to the patrol function and deployed officers in an effort to improve response time through the use of the 9-1-1 telephone number, computer-assisted dispatch, and beat assignment systems. Officers were typically assigned to a patrol beat. When the officers were not answering calls for service, they remained in their assigned beats so they could immediately respond to an emergency.

The data for the project were collected as part of a larger experiment on preventive patrol carried out in Kansas City, Missouri, between October 1972 and September 1973. 78 To determine the impact of response time, researchers speculated that the following variables would be influenced by response time: 1) the outcome of the response, 2) citizen satisfaction with response time, and 3) citizen satisfaction with the responding officer. Several data sources were used in the study. First, surveys were completed after all citizen-initiated calls (excluding automobile accidents) that involved contact with a police officer. The survey instrument consisted of questions to assess the length of time to respond to a call and the outcome of the call (i.e., arrest). Over 1,100 surveys were completed. Second, a follow-up survey was mailed to citizens whom the police had contacted during their response. These surveys asked questions to assess citizen satisfaction with response time and outcome. Over 425 of these surveys were returned.

The data collected during the study showed that response time did not determine whether or not the police made an arrest or recovered stolen property. This was the most surprising finding from the study because it challenged one of the basic underlying principles of police patrol. Researchers attributed the lack of significance to the fact that most citizens waited before calling the police. Rapid response simply did not matter in situations where citizens delayed in reporting the crime.

Rapid response time was not only believed to be important in determining the outcome of a response (i.e., more likely to lead to an arrest), it was also considered an important predictor of citizen satisfaction. Data from the study showed that when the police arrived sooner than expected, citizens were more satisfied with response time. However, subsequent research has shown that citizens are also satisfied with a delayed response as long as the dispatcher sets a reasonable expectation for when the patrol officer will arrive. Response time was also the best predictor of how satisfied a citizen was with the responding officer. It was further revealed that citizens became dissatisfied with the police when they were not informed of the outcome (i.e., someone was arrested). Again, these findings indicate the need for dispatchers and patrol officers to communicate with complainants regarding when they should expect an officer to arrive and the outcome of the call.

Based on the results of the response time study, the researchers concluded that rapid response was not as important as police administrators had thought. Response time was not related to an officer’s ability to make an arrest or recover stolen property. Results from the response time study challenged traditional beliefs about the allocation of patrol in our communities. Based on tradition knowledge, as previously discussed, rapidly responding to calls for service is what the police had always done since they started using patrol vehicles. In addition, common sense, as previously discussed, played a role in the practice of rapid response to calls for service; it just made sense that if a patrol officer arrives sooner, she will be more likely to make an arrest.

Prior to the research, police departments operated under the assumption that rapid response was a crucial factor in the ability of an officer to solve a crime and an important predictor of citizen satisfaction. In response to the research on rapid response, many police departments changed the way they responded to calls for service. Many departments adopted a differential police response approach. Differential police response protocols allow police departments to prioritize calls and rapidly dispatch an officer only when an immediate response is needed (i.e., crimes in progress). For crimes in progress, rapid response is critical and may reduce the injuries sustained by the victim as well, but these emergency calls usually account for less than 2% of all 9-1-1 calls for police service. For nonemergency calls, an officer is either dispatched at a later time when the officer is available or a report is taken over the phone or through some other means. Differential police response has been shown to save departments money and give patrol officers more time to engage in community-oriented and proactive policing activities. The benefits for a department are not at the expense of the public. In fact, a study by Robert Worden found a high degree of citizen satisfaction with differential police response. 79

Courts Research Example 80

Research on the courts component of the criminal justice system, while far from complete, has produced direct effects on the operations of the criminal justice system. The study reviewed in this section asked the following research question: Are jurors able to understand different legal rules for establishing a defendant’s criminal responsibility? The study described below explored the issue of criminal responsibility as it applies to the insanity defense in the United States. For several years, the M ’ Naghten rule was the legal rule applied in all courts of the United States. Under M ’ Naghten, criminal responsibility was absent when the offender did not understand the nature of his actions due to failure to distinguish “right” from “wrong.” This is known as the “right/wrong test” for criminal responsibility. The case of Durham v. United States was heard in the U.S. Court of Appeals for the District of Columbia and offered an alternative test for criminal responsibility and insanity. The legal rule emerging from Durham was that criminal responsibility was absent if the offense was a product of mental disease or defect. This ruling provided psychiatrists with a more important role at trial because of the requirement that the behavior be linked to a mental disorder that only a psychiatrist could officially determine.

At the time of Simon’s 1967 study, most courts across the country still followed the M ’ Naghten rule. Questions arose, however, regarding whether juries differed in their understanding of M ’ Naghten versus Durham and, in turn, whether this resulted in differences in their ability to make informed decisions regarding criminal responsibility in cases involving the insanity defense. The study was designed to determine the effect of different legal rules on jurors’ decision-making in cases where the defense was insanity. There was a question of whether there was a difference between the rules to the extent that jurors understood each rule and could capably apply it.

Simon conducted an experimental study on jury deliberations in cases where the only defense was insanity. 81 Utilizing a mock jury approach, Simon took the transcripts of two actual trials with one reflecting the use of the M ’ Naghten rule and the other the Durham rule. Both cases were renamed and the transcripts were edited to constitute a trial of 60–90 minutes in length. These edited transcripts were then recorded, with University of Chicago Law School faculty as the attorneys, judges, and witnesses involved in each case. Groups of 12 jurors listened to each trial with instruction provided at the end regarding the particular rule of law ( M ’ Naghten or Durham) for determining criminal responsibility. Each juror submitted a written statement with his or her initial decision on the case before jury deliberations, and the juries’ final decisions after deliberation were also reported.

Simon found significant differences in the verdicts across the two groups ( M ’ Naghten rule applied and Durham rule applied) even when the case was the same. For the M ’ Naghten version of the case, the psychiatrists stated that the defendant was mentally ill yet knew right from wrong during the crime. These statements/instructions should have led to a guilty verdict on the part of the mock jury. As expected, the M ’ Naghten juries delivered guilty verdicts in 19 of the 20 trials, with one hung jury. For the Durham version of the case, the psychiatrists stated that the crime resulted from the defendant’s mental illness, which should have lead to acquittal. However, the defendant was acquitted in only five of the 26 Durham trials. Twenty-six groups of 12 jurors were exposed to the Durham version of the trial and the case was the same each time. Simon interpreted these results as suggesting that jurors were unambiguous in their interpretations and applications of M ’ Naghten (due to the consistency in guilty verdicts), but they were less clear on the elements of Durham and how to apply it (reflected by the mix of guilty, not guilty, and hung verdicts). 82

After Simon’s study, most states rejected the Durham test. Recall her finding that the Durham rule produced inconsistent verdicts. She interpreted this finding as Durham being no better than providing no guidance to jurors on how to decide the issue of insanity. The observation helped to fuel arguments against the use of Durham, which, in turn, contributed to its demise as a legal rule. Today, only New Hampshire uses a version of the Durham rule in insanity cases.

WHAT RESEARCH SHOWS: IMPACTING CRIMINAL JUSTICE OPERATIONS

The Punishment Cost of Being Young, Black, and Male

Steffensmeier, Ulmer, and Kramer 83 hypothesized that African Americans overall were not likely to be treated more harshly than white defendants by the courts because it was only particular subgroups of minority defendants that fit with court actors’ stereotypes of “more dangerous” offenders. In particular, they argued that younger African American males not only fulfilled this stereotype more than any other age, race, and gender combination, they were also more likely to be perceived by judges as being able to handle incarceration better than other subgroups.

In order to test their hypotheses, the researchers examined sentencing data from Pennsylvania spanning four years (1989–1992). Almost 139,000 cases were examined. The sentences they examined included whether a convicted defendant was incarcerated in prison or jail, and the length of incarceration in prison or jail. The researchers found that offense severity and prior record were the most important predictors of whether a convicted defendant was incarcerated and the length of incarceration. The authors found that the highest likelihood of incarceration and the longest sentences for males were distributed to African Americans aged 18–29 years. Their analysis of females revealed that white females were much less likely than African American females to be incarcerated, regardless of the age group examined. Taken altogether, the analysis revealed that African American males aged 18–29 years maintained the highest odds of incarceration and the longest sentences relative to any other race, sex, and age group.

Overall, this research showed that judges focused primarily on legal factors (offense severity and prior record) when determining the sentences of convicted offenders. These are the factors we expect judges to consider when making sentencing decisions. However, the research also found that judges base their decisions in part on extralegal factors, particularly the interaction of a defendant’s age, race, and gender. This research expanded our knowledge beyond the impact of singular factors on sentencing to expose the interaction effects of several variables (race, gender, and age). Court personnel are aware of these interaction effects based on this study, and others that followed, as well as their personal experiences in the criminal justice system. Identification and recognition of inequities in our justice system (in this case that young, African American males are punished more severely in our justice system) is the first step in mitigating this inequity.

Corrections Research Example 84

Although the research in corrections is far from complete, it has contributed greatly to the development of innovative programs and the professional development of correctional personnel. The contributions of academic and policy-oriented research can be seen across the whole range of correctional functions from pretrial services through probation, institutional corrections, and parole.

Rehabilitation remained the goal of our correctional system until the early 1970s, when the efficacy of rehabilitation was questioned. Violent crime was on the rise, and many politicians placed the blame on the criminal justice system. Some believed the system was too lenient on offenders. Interest in researching the effectiveness of correctional treatment remained low until 1974 when an article written by Robert Martinson and published in Public Interest titled “What Works? Questions and Answers about Prison Reform” generated enormous political and public attention to the effectiveness of correctional treatment. 85

Over a six-month period, Martinson and his colleagues reviewed all of the existing literature on correctional treatment published in English from 1945 to 1967. Each of the articles was evaluated according to traditional standards of social science research. Only studies that utilized an experimental design, included a sufficient sample size, and could be replicated were selected for review. A total of 231 studies examining a variety of different types of treatment were chosen, including educational and vocational training, individual and group counseling, therapeutic milieus, medical treatment, differences in length and type of incarceration, and community corrections. All of the treatment studies included at least one measure of offender recidivism, such as whether or not offenders were rearrested or violated their parole. The recidivism measures were used to examine the success or failure of a program in terms of reducing crime.

After reviewing all 231 studies, Martinson reported that there was no consistent evidence that correctional treatment reduced recidivism. Specifically, he wrote, “with few and isolated exceptions, the rehabilitative efforts that have been reported so far have had no appreciable effect on recidivism.” 86 Martinson further indicated that the lack of empirical support for correctional treatment could be a consequence of poorly implemented programs. If the quality of the programs were improved, the results may have proved more favorable, but this conclusion was for the most part ignored by the media and policy-makers.

Martinson’s report became commonly referred to as “nothing works” and was subsequently used as the definitive study detailing the failures of rehabilitation. The article had implications beyond questioning whether or not specific types of correctional treatment reduced recidivism. The entire philosophy of rehabilitation was now in doubt because of Martinson’s conclusion that “our present strategies … cannot overcome, or even appreciably reduce, the powerful tendencies of offenders to continue in criminal behavior.” 87

Martinson’s article provided policy makers the evidence to justify spending cuts on rehabilitative programs. Furthermore, it allowed politicians to respond to growing concerns about crime with punitive, get-tough strategies. States began implementing strict mandatory sentences that resulted in more criminals being sent to prison and for longer periods of time. Over the next several years, Martinson’s article was used over and over to support abandoning efforts to treat offenders until rehabilitation became virtually nonexistent in our correctional system.

Chapter Summary

This chapter began with a discussion of sources of knowledge development and the problems with each. To depict the importance of research methods in knowledge development, myths about crime and the criminal justice system were reviewed along with research studies that have dispelled myths. As the introductory chapter in this text, this chapter also provided an overview of the steps in the research process from selecting a topic and conducting a literature review at the beginning of a research study to reporting findings, results, and limitations at the end of the study. Examples of actual research studies in the areas of police, courts, and corrections were also provided in this chapter to demonstrate the research process in action and to illustrate how research has significantly impacted practices within the criminal justice system. In addition, this chapter demonstrated the critical importance of becoming an informed consumer of research in both your personal and professional lives.

Critical Thinking Questions

1. What are the primary sources of knowledge development, and what are the problems with each?

2. How is knowledge developed through research methods different from other sources of knowledge?

3. What myths about crime and criminal justice have been dispelled through research? Give an example of a research study that dispelled a myth.

4. Why is it important to be an informed consumer of research?

5. What are the steps in the research process, and what activities occur at each step?

authority knowledge: Knowledge developed when we accept something as being correct and true just because someone in a position of authority says it is true

case study: An in-depth analysis of one or a few illustrative cases

common sense knowledge: Knowledge developed when the information “just makes sense”

content analysis: A method requiring the analyzing of content contained in mass communication outlets such as newspapers, television, magazines, and the like

CSI Effect: Due to the unrealistic portrayal of the role of forensic science in solving criminal cases in television shows, jurors are more likely to vote to acquit a defendant when the expected sophisticated forensic evidence is not presented

differential police response: Methods that allow police departments to prioritize calls and rapidly dispatch an officer only when an immediate response is needed (i.e., crimes in progress)

experimental designs: Used when researchers are interested in determining whether a program, policy, practice, or intervention is effective

field research: Research that involves researchers studying individuals or groups of individuals in their natural environment

Halloween sadism: The practice of giving contaminated treats to children during trick or treating

hypotheses: Statements about the expected relationship between two concepts

illogical reasoning: Occurs when someone jumps to premature conclusions or presents an argument that is based on invalid assumptions

myths: Beliefs that are based on emotion rather than rigorous analysis

operationalization: The process of giving a concept a working definition; determining how each concept in your study will be measured

overgeneralization: Occurs when people conclude that what they have observed in one or a few cases is true for all cases

personal experience knowledge: Knowledge developed through actual experiences

research: The scientific investigation of an issue, problem, or subject utilizing research methods

research methods: The tools that allow criminology and criminal justice researchers to systematically study crime and the criminal justice system and include the basic rules, appropriate techniques, and relevant procedures for conducting research

resistance to change: The reluctance to change our beliefs in light of new, accurate, and valid information to the contrary

secondary data analysis: Occurs when researchers obtain and reanalyze data that were originally collected for a different purpose

selective observation: Choosing, either consciously or unconsciously, to pay attention to and remember events that support our personal preferences and beliefs

survey research: Obtaining data directly from research participants by asking them questions, often conducted through self-administered questionnaires and personal interviews

tradition knowledge: Knowledge developed when we accept something as true because that is the way things have always been, so it must be right

variables: Concepts that have been given a working definition and can take on different values

1 Briggs, Lisa T., Stephen E. Brown, Robert B. Gardner, and Robert L. Davidson. (2009). “D.RA.MA: An extended conceptualization of student anxiety in criminal justice research methods courses.” Journal of Criminal Justice Education 20 (3), 217–226.

2 Betz, N. E. (1978). “Prevalence, distribution, and correlates of math anxiety in college students. Journal of Counseling Psychology 25 (5), 441–448.

3 Briggs, et al., 2009, p. 221.

4 Ibid, p. 221.

5 Ibid, p. 221.

6 Kappeler, Victor E., and Gary W. Potter. (2005). The mythology of crime and criminal justice. Prospect Heights, IL: Waveland.

7 Tennessee v. Gamer, 471 U.S. 1 (1985).

8 Lombroso-Ferrero, Gina. (1911). Criminal man, according to the classification of Cesare Lombroso. New York: Putnam.

9 This study was included in Amy B. Thistlethwaite and John D. Wooldredge. (2010). Forty studies that changed criminal justice: Explorations into the history of criminal justice research. Upper Saddle River, NJ: Prentice Hall.

10 Petersilia, J., S. Turner, J. Kahan, and J. Peterson. (1985). Granting felons probation: Public risks and alternatives. Santa Monica, CA: Rand.

11 Vito, G. (1986). “Felony probation and recidivism: Replication and response.” Federal Probation 50, 17–25.

12 Conrad, J. (1985). “Research and development in corrections.” Federal Probation 49, 69–71.

13 Finckenauer, James O. (1982). Scared straight! and the panacea phenomenon. Englewood Cliffs, NJ: Prentice Hall.

14 Yarborough, J.C. (1979). Evaluation of JOLT (Juvenile Offenders Learn Truth) as a deterrence program. Lansing, MI: Michigan Department of Corrections.

15 Petrosino, Anthony, Carolyn Turpin-Petrosino, and James O. Finckenauer. (2000). “Well-meaning programs can have harmful effects! Lessons from experiments of programs such as Scared Straight,” Crime & Delinquency 46, 354–379.

16 Robertson, Jordan. “I’m being punished for living right”: Background check system is haunted by errors. December 20, 2011. http://finance.yahoo.com/news /ap-impact-criminal-past-isnt-182335059.html. Retrieved on December 29, 2011.

17 Shelton, D. E. (2008). “The ‘CSI Effect’: Does it really exist?” NIJ Journal 259 [NCJ 221501].

18 Best, Joel. (2011). “Halloween sadism: The evidence.” http://dspace.udel.edu:8080/dspace/bitstream/handle/ 19716/726/Halloween%20sadism.revised%20thru%20201l.pdf?sequence=6. Retrieved on May 7, 2012.

19 Best, Joel. (1985, November). “The myth of the Halloween sadist. Psychology Today 19 (11), p. 14.

21 “Beer compound shows potent promise in prostate cancer battle.” Press release from Oregon State University May 30, 2006. http://oregonstate.edu/ua/ncs/archives/2006/ may/beer-compound-shows-potent-promise-prostate-cancer-battle. Retrieved on January 6, 2012; Colgate, Emily C., Cristobal L. Miranda, Jan F. Stevens, Tammy M. Bray, and Emily Ho. (2007). “Xanthohumol, a prenylflavonoid derived from hops induces apoptosis and inhibits NF-kappaB activation in prostate epithelial cells,” Cancer Letters 246, 201–209; “Health benefits of red wine exaggerated” http://health.yahoo.net/articles /nutrition/health-benefits-red-wine-exaggerated. Retrieved on January 14, 2012; “Scientific journals notified following research misconduct investigation.” January 11, 2012. http://today.uconn.edu/blog/2012/01/scientific-journals -notified-following-research-misconduct-investigation/. Retrieved on January 14, 2012.

22 Pepinsky, Hal. “The myth that crime and criminality can be measured.” 3–11 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

23 Bullock, Jennifer L., and Bruce A. Arrigo. “The myth that mental illness causes crime.” 12–19 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

24 Friedrichs, David O. “The myth that white-collar crime is only about financial loss.” 20–28 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

25 Kuhns III, Joseph B., and Charisse T. M. Coston. “The myth that serial murderers are disproportionately white males.” 37–44 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

26 Longmire, Dennis R., Jacqueline Buffington-Vollum, and Scott Vollum. “The myth of positive differentiation in the classification of dangerous offenders.” 123–131 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

27 Masters, Ruth E., Lori Beth Way, Phyllis B. Gerstenfeld, Bernadette T. Muscat, Michael Hooper, John P. J. Dussich, Lester Pincu, and Candice A. Skrapec. (2013). CJ realities and challenges, 2nd ed. New York: McGraw-Hill.

32 Brownstein, Henry H. “The myth of drug users as violent offenders.” 45–53 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

33 Goldstein, P. (1985). “The drugs/violence nexus: A tripartite conceptual framework.” Journal of Drug Issues 15, 493–506.

34 Goldstein, P, H. Brownstein, and P. Ryan. (1992). “Drug-related homicide in New York City: 1984 and 1988.” Crime & Delinquency 38, 459–476.

35 Parker, R., and K. Auerhahn. (1998). “Alcohol, drugs, and violence.” Annual Review of Sociology 24, 291–311, p. 291.

36 Buerger, Michael. “The myth of racial profiling.” 97–103 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

37 Cordner, Gary, and Kathryn E. Scarborough. “The myth that science solves crimes.” 104–110 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

38 Willis, James J., Stephen D. Mastrofski, and David Weisburd. “The myth that COMPSTAT reduces crime and transforms police organizations.” 111–119 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

39 Masters, et al., 2013.

43 Scott, Eric J. (1981). Calls for service: Citizen demand and initial police response. Washington, DC: Government Printing Office.

44 Lersch, Kim. “The myth of policewomen on patrol.” 89–96 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

45 Janikowski, Richard. “The myth that the exclusionary rule allows many criminals to escape justice.” 132–139 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

46 Bishop, Donna M. “The myth that harsh punishments reduce juvenile crime.” 140–148 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

47 Immarigeon, Russ. “The myth that public attitudes are punitive.” 149–157 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

48 Acker, James R. “The myth of closure and capital punishment.” 167–175 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

49 Masters, et al., 2013.

52 Lersch, 2006.

53 Newport, Frank. “In U.S., support for death penalty falls to 39-year low.” October 13, 2011. http://www.gallup .com/poll/150089/support-death-penalty-falls-year-low.aspx. Retrieved on April 16, 2012.

54 Applegate, Brandon. “The myth that the death penalty is administered fairly.” 158–166 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

55 Williams, M. R., and J. E. Holcomb. (2001). “Racial disparity and death sentences in Ohio.” Journal of Criminal Justice 29, 207–218.

56 Snell, Tracy L. (2011, December). Capital punishment, 2010—statistical tables. Washington, DC: Bureau of Justice Statistics.

57 Applegate, 2006.

58 Williams and Holcomb, 2001.

59 Applegate, 2006.

61 Wood, Peter B. “The myth that imprisonment is the most severe form of punishment.” 192–200 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

63 Michalowski, Raymond. “The myth that punishment reduces crime.” 179–191 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

64 McShane, Marilyn, Frank P. Williams III, and Beth Pelz. “The myth of prisons as country clubs.” 201–208 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

65 Parker, Mary. “The myth that prisons can be self-supporting.” 209–213 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

66 Blakely, Curtis, and John Ortiz Smykla. “Correctional privatization and the myth of inherent efficiency.” 214–220 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

67 Jones, G. Mark. “The myth that the focus of community corrections is rehabilitation.” 221–226 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

68 Cullen, Francis T., and Paula Smith. “The myth that correctional rehabilitation does not work.” 227–238 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

69 Masters, et al., 2013.

73 Petersilia, Joan. (1990). “When probation becomes more dreaded than prison. Federal Probation 54, 23–27.

75 Wood, P. B., and H. G. Grasmick. (1999). “Toward the development of punishment equivalencies: Male and female inmates rate the severity of alternative sanctions compared to prison.” Justice Quarterly 16, 19–50.

76 Example is excerpted from Amy B. Thistlethwaite and John D. Wooldredge. (2010). Forty studies that changed criminal justice: Explorations into the history of criminal justice research. Upper Saddle River, NJ: Prentice Hall. This is an excellent book that demonstrates the impact research has had on criminal justice operations.

77 National Commission on Productivity. (1973). Opportunities for improving productivity in police services. Washington, DC: United States Government Printing Office, p. 19.

78 Pate, T., A. Ferrara, R. Bowers, and J. Lorence. (1976). Police response time: Its determinants and effects. Washington, DC: Police Foundation.

79 Worden, R. (1993). “Toward equity and efficiency in law enforcement: Differential police response. American Journal of Police 12, 1–32.

80 Example is excerpted from Amy B. Thistlethwaite and John D. Wooldredge. (2010). Forty studies that changed criminal justice: Explorations into the history of criminal justice research. Upper Saddle River, NJ: Prentice Hall.

81 Simon, R. (1967). The jury and the defense of insanity. Boston: Little, Brown.

83 Steffensmeier, D., J. Ulmer, & J. Kramer. (1998). “The interaction of race, gender, and age in criminal sentencing: The punishment cost of being young, black, and male. Criminology 36, 763–797.

84 Example is excerpted from Amy B. Thistlethwaite and John D. Wooldredge. (2010). Forty studies that changed criminal justice: Explorations into the history of criminal justice research. Upper Saddle River, NJ: Prentice Hall.

85 Martinson, R. (1974). “What works? Questions and answers about prison reform.” The Public Interest 10, 22–54.

86 Ibid, p. 25.

87 Ibid, p. 49.

Applied Research Methods in Criminal Justice and Criminology by University of North Texas is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License , except where otherwise noted.

Share This Book

Frozen human brain tissue can now be revived without damage

Using a new approach, scientists have successfully frozen and thawed brain organoids and cubes of brain tissue from someone with epilepsy, which could enable better research into neurological conditions

By Christa Lesté-Lasserre

15 May 2024

Thawed brain organoids shown via the imaging technique immunofluorescence staining

Thawed brain organoids shown via an imaging technique called immunofluorescence staining

Weiwei Xue et al.

A new technique has allowed scientists to freeze human brain tissue so that it regains normal function after thawing, potentially opening the door to improved ways of studying neurological conditions.

Brain tissue doesn’t usually survive freezing and thawing, a problem that has significantly hindered medical research. In an effort to overcome this, Zhicheng Shao at Fudan University in Shanghai, China, and his colleagues used human embryonic stem cells to grow self-organising brain samples, known as organoids, for three weeks — long enough for the development of neurons and neural stem cells that can become different kinds of functional brain cells.

The researchers then placed these organoids — which measured 4 millimetres across on average — in different chemical compounds, such as sugars and antifreeze, that they suspected might help keep the brain cells alive while frozen and able to grow after being thawed.

Restoring the brain’s mitochondria could slow ageing and end dementia

After storing these organoids in liquid nitrogen for at least 24 hours, the team thawed them and looked for cell death or the growth of neurites — the “branches” of nerve cells — over the following two weeks.

Based on the rates of cell death and growth associated with each compound, the researchers chose their top compound candidates, trying different combinations during freezing and thawing tests on a new set of organoids.

Sign up to our Health Check newsletter

Get the most essential health and fitness news in your inbox every Saturday.

The combination that led to the least cell death and most growth was a blend of chemical compounds called methylcellulose, ethylene glycol, DMSO and Y27632 — which the scientists named “MEDY”. They suspect MEDY interferes with a pathway that otherwise programs cellular death.

Shao and his colleagues tested MEDY through a series of experiments involving brain organoids ranging from 28 days old to more than 100 days old. The team placed the organoids in MEDY, before freezing — usually for 48 hours — and thawing them. The researchers then observed their growth in the laboratory for up to 150 days post-thawing.

They found that the thawed organoids’ appearance, growth and function were highly similar to those of organoids of the same age that had never been frozen, even among those that had been frozen in MEDY for 18 months. The team also observed similar results for organoids representing different regions of the brain.

Finally, the researchers took 3-millimetre cubes of brain tissue from a 9-month-old girl with epilepsy and placed them in MEDY, before freezing and thawing them. The tissue maintained its pre-freezing structure and continued to remain active in a laboratory culture for at least two weeks after thawing.

We are finally starting to understand brain fog and how to treat it

Being able to freeze human brain tissues could lead to better investigations of brain development in the lab for health research, says Roman Bauer at the University of Surrey in the UK.

João Pedro Magalhães at the University of Birmingham in the UK says he is impressed that the team’s method successfully prevented cell death and preserved function. “We know brain cells are very fragile and sensitive to stress,” he says.

With significantly more research and the use of larger tissues, the work could one day lead to freezing entire brains, says Magalhães. “Thinking decades or centuries ahead, we can imagine patients being cryopreserved when they have a terminal condition or astronauts being cryopreserved in order to travel to other star systems,” he says. MEDY may represent “one small step” towards that goal, says Magalhães.

Journal reference:

Cell Reports Methods DOI: 10.1016/j.crmeth.2024.100777

Sign up to our weekly newsletter

Receive a weekly dose of discovery in your inbox! We'll also keep you up to date with New Scientist events and special offers.

More from New Scientist

Explore the latest news, articles and features

What is thought and how does thinking manifest in the brain?

Subscriber-only

Most brain monitors sold to consumers don't keep your data private

Brain activity seems to be more complex in baby girls than boys, a new understanding of tinnitus and deafness could help reverse both, popular articles.

Social Media Research: A Comprehensive Guide

Guv Callahan

May 20, 2024

8 min. read

Social media research helps you unlock the potential of social content for business. We’re living in a world where tweets hold power and likes shape perceptions. When you know what to publish and who you’re posting it for, you can construct a stronger strategy that helps you meet key goals.

Data isn’t just about numbers; it’s about uncovering narratives and following the breadcrumbs of likes, shares, and comments to gain deeper understandings. There’s a method to the madness of selfies and status updates. The right approach to social media research helps you learn more about the collective consciousness of society — and use it to your advantage.

Let’s explore the language of social media likes and shares and dig beneath the surface of our digital interactions.

What is Social Media Research?

Tools and techniques for social media research, understanding the difference: social media research vs. traditional research, harnessing the power of social media research for your business, ethics and privacy in social media research, success stories: real world examples of social media research.

experts conducting social media research

Social media research is the process of using social media data to learn about trending topics, audiences, and content performance. Reviewing social data gives you quantitative insights (e.g., engagement rates , best posting times ), but it can also lead to qualitative learnings like human behaviors, preferences, and opinions.

When conducting social media research, companies can look for patterns and sentiments to drive their social media marketing strategy. They can decide what content to create, which channels to post on, how to reach their audience, when to post content, and a myriad of other decisions that will lead to faster results.

putting a magnifying glass on data collected during research

There’s no single best way to do social media research. You can manually review engagement on your posts or look at your competitors’ content. Or you can use third-party social listening tools to aggregate social data for you.

Social media research can be formal (like a traditional research project) or informal. You might have a certain goal in mind, or you might not know what you’re looking for and just want to see what pops up.

Let’s review some options.

Social media analytics

No matter what channels you choose, you can gain a wealth of insights from built-in social analytics. Platforms like Facebook, Instagram, and Twitter give you instant intel about your content performance and audiences.

Even better, you don’t always need to know what you’re looking for. You can start combing through your analytics, then jot down questions or ideas you want to explore further.

Tip: Learn more in our blog The Complete Guide to Social Media Analytics .

Google Alerts

Google Alerts is a free and underrated tool that gives you unique angles and insights on a given topic. You can set up a Google Alert related to a keyword or topic of your choice, then receive a daily digest of articles published on that topic.

From there, you can learn more about what other brands and businesses are publishing. Repurpose your findings into your social media content to get ahead of trends and topics. You can lead conversations instead of joining them after they blow up on social.

Social listening tools

Social listening tools like Meltwater let you be the fly on the wall in the social world. You can “listen” to what your audience is saying and truly be everywhere all at once.

These tools monitor billions of publicly available data points across multiple social channels, like Twitter, Facebook, and Instagram. They help brands track mentions of their products or brand names in real time so you can become part of important conversations.

You can also track topics related to your niche or learn more about what your audience is talking about beyond your brand. This gives you direct insight into their lifestyles so you can meet them where they are authentically.

Want to learn more about how Meltwater could help your social media research? Fill out the form below and an expert will be in touch!

Media intelligence tools

Taking social listening a step further, you can add media intelligence tools to the mix to learn what’s being talked about beyond social media. Meltwater’s media intelligence suite lets you monitor TV and radio channels, blogs, print media, and other new sources around the world.

This gives you more comprehensive insights into hot topics and trends that you can repurpose for social media. News-worthy events make their way to social media, giving you an easy “in” to your audience’s attention.

Aside from the social-specific aspect, social media research holds a few advantages over traditional research.

For starters, social research gives you real-time data that’s constantly changing. You can also get the most specific insights according to your audience and social channels, not just general info. This means you can shorten the research curve and get faster insights about topics that matter to you.

By comparison, traditional research is often a more structured approach with specific goals in mind. It typically requires lots of sources and manual effort. It takes time to find and vet sources, cross-reference data, and ensure a high level of accuracy.

Combining both types of research can give you the most comprehensive view of your audience.

Now that you know what social media research is, let’s explore some ways you can apply it to your business.

Identify your target audience

Analyzing social media data can help you pinpoint who your target audience is (because it’s not always who you think). You might have your audience defined on the surface with basics like age, gender, and geographic location, but social research can dig several layers deeper to uncover new audience segments you haven’t considered.

Audiences evolve all the time. Their preferences, needs, and interests change. This means that who you want to reach today might not be the same person you want to connect with in the future. Constantly finding new things about your audience will help you continue generating content that captures their interests.

Improve brand reputation

Monitoring online conversations and feedback gives companies a direct path to reputation management . You can more easily spot when trouble might be brewing so you can act fast and defend against hits to your brand image.

Proactively engaging with customers on social platforms shows that the company values their opinions and is committed to providing excellent customer service. This not only builds trust and loyalty but also strengthens the brand's reputation as a customer-centric organization.

Optimize social media marketing campaigns

When you know more about your audience and past content performance, you’re in a better position to create better posts that resonate. Learn what type of content your audience prefers based on engagement metrics. Tailor your content and messaging to reflect their interests and needs.

You’ll also have insights about what’s hot in the social media world. You can use these trends as the foundation for your own content, taking the guesswork out of what you should talk about.

Tip: Learn more about tailoring your content and messaging in our Personalization at Scale Guide !

image of a social media specialist checking her smartphone at her desk

Collecting social media research from outside data sources brings ethics and privacy into question. Marketers should be proactive in asking where their data is coming from and how it was obtained.

Ideally, you’ll choose tools that are in compliance with regulations like GDPR and CCPA. Know how they obtain data and whether they safeguard individual users’ information. Getting ahead of your competitors shouldn't be at the expense of your customers’ privacy or potential legal challenges.

Companies around the world use social media research to drive engagement, create better content, and grow their brand presence.

Take Shiseido , for instance. This Meltwater customer uses our Explore solution to learn what makes their brand special across 120 markets. The company uses social listening to monitor competitors, unify social mentions in a single dashboard, and understand the brand’s presence on a global stage.

Another Meltwater customer, Fifty Acres , uses the platform to learn about relevant narratives happening on social media. Learning what others are talking about allows them to shape their own stories, pitch new ideas for business growth, and connect with people in the right places at the right times.

W Hotels in Singapore is another great example of social media research at work. The company uses Meltwater to learn more about what customers like when traveling, allowing them to create custom experiences in their hotels.

Last but not least, Mailchimp uses Meltwater to inform its content strategy. The company looks for trends and themes on social media that resonate with creators, allowing them to easily scale their content by making their audience go bananas over every post.

Learn more when you request a demo by filling out the form below.

An overhead image of people crossing the street in a crosswalk, used for Meltwater's Personalization at Scale Guide.

Personalization at Scale: Removing Guesswork from Consumer Research

An illustration of a magnifying glass over a collection of internet browser windows representing secondary research companies.

Top Secondary Market Research Companies | Desk Research Companies

Customer Segmentation Models: Types, Benefits & Uses

3D illustration of blue headphones for social listening.

The Ultimate Social Listening Guide - Never Miss a Social Mention

Insight-Driven Marketing, Your New Strategic Advantage

Reflections On Qualtrics X4: AI-Powered Research Is Promising If We Stick To The Research Basics

Senem Guler Biyikli , Analyst

Qualtrics introduced its AI-powered Strategy & Research suite at its summit, X4 , and launched its “Strategic UX” product — officially entering the experience research space . The new product supports various UX research methods like video feedback, unmoderated usability testing, card sorting, and tree testing, and it leverage s AI to generate insights and recommended actions. Adding UX research to its experience management solutions, Qualtrics aims to support organizations’ research efforts at scale with a single platform.

Qualtrics AI was the highlight of the event as it aims to help users get deeper insights through interactive dashboards, data analysis, and recommendations on next steps. These are strong promises, and other leading firms in the experience research space are also similarly improving their AI capabilities and expanding their research toolset. UserTesting, one of the leaders in experience research, recently added AI-powered surveys to its toolset to collect feedback at scale and introduced the Feedback Engine .

What do these AI integrations and the research platforms’ expansion of their toolset tell us about the future of experience research? The conversations I’ve had with our clients and attendees at X4 drive me to conclude that experience research will unlock AI’s true potentia l — a s long as the research expertise plays the key role in shaping research strategy. That means:

AI is not a replacement for research . AI is changing how we ideate, analyze, and synthesize research findings by creating efficiencies (e.g., lowering mundane tasks, summarizing interviews, etc.), but interpreting those findings in the broader context of the user is on us. Determining the right approach to the right problem is still what drives impact. Therefore, while AI accelerates the research workflow, companies still need a collaborative, rigorous research process to produce high-impact research that supports decision-making.
AI facilitates democratization of research — but it needs guardrails. As AI has potential to accelerate the research workflow, it also brings new possibilities to democratize research. For instance, AI-generated tools (e.g., AI-generated interview templates) help novice researchers conduct research and improve their skills. However, when executed poorly, democratization can do more harm than good and can lead to the wrong approach or poor interpretations of data, which is even more important with AI because it can sometimes produce biased outputs. To democratize research responsibly, institute a process with guardrails. For instance, one of the speakers at X4, who is working to democratize research in their product teams, mentioned that only people with a proven track of high-quality research get permission to contribute to the research repository, so they can keep its quality high and use it to inform their AI.
Companies’ research needs vary. Consolidation of research tools benefits companies looking for all-in-one solutions, but companies with specialized research needs and limited budgets must explore alternatives. For instance, firms primarily conducting research with their own community of users do not need research platforms with robust recruitment capabilities. Assess your current research needs and consider your future research plans (e.g., how your practice will grow) to pick a research platform that best suits your needs.

If you are a Forrester client and would like to discuss this topic further or have questions about experience research landscape, set up a conversation with me.

Age of the Customer
AI Insights
customer experience

Thanks for signing up.

Stay tuned for updates from the Forrester blogs.

Explore The What, Why, & How Of GenAI For CX Pros

Download your copy of our best-practice report to get analyst answers to cx leaders’ top genai questions. unlock the secrets to using genai to improve cx, journey management, and more., frenemies forever — the tension between crm and ccaas vendors, ai, platforms, and big promises: what we saw at red hat summit, get the insights at work newsletter, help us improve.

Along with Stanford news and stories, show me:

Student information
Faculty/Staff information

We want to provide announcements, events, leadership messages and resources that are relevant to you. Your selection is stored in a browser cookie which you can remove at any time using “Clear all personalization” below.

Asking for help is hard, but others want to help more than we often give them credit for, says Stanford social psychologist Xuan Zhao .

Xuan Zhao (Image credit: Anne Ryan)

We shy away from asking for help because we don’t want to bother other people, assuming that our request will feel like an inconvenience to them. But oftentimes, the opposite is true: People want to make a difference in people’s lives and they feel good – happy even – when they are able to help others, said Zhao.

Here, Zhao discusses the research about how asking for help can lead to meaningful experiences and strengthen relationships with others – friends as well as strangers.

Zhao is a research scientist at Stanford SPARQ , a research center in the Psychology Department that brings researchers and practitioners together to fight bias, reduce disparities, and drive culture change. Zhao’s research focuses on helping people create better social interactions in person and online where they feel seen, heard, connected, and appreciated. Her research, recently published in Psychological Science , suggests that people regularly underestimate others’ willingness to help.

This fall, Zhao will be co-teaching a two-session workshop Science-Based Practices for a Flourishing Life through Stanford’s well-being program for employees, BeWell.

Why is asking for help hard? For someone who finds it difficult to ask for help, what would you like them to know?

There are several common reasons why people struggle to ask for help. Some people may fear that asking for help would make them appear incompetent, weak, or inferior – recent research from Stanford doctoral student Kayla Good finds that children as young as seven can hold this belief. Some people are concerned about being rejected, which can be embarrassing and painful. Others may be concerned about burdening and inconveniencing others – a topic I recently explored. These concerns may feel more relevant in some contexts than others, but they are all very relatable and very human.

The good news is those concerns are oftentimes exaggerated and mistaken.

What do people misunderstand about asking for help?

When people are in need of help, they are often caught up in their own concerns and worries and do not fully recognize the prosocial motivations of those around them who are ready to help. This can introduce a persistent difference between how help-seekers and potential helpers consider the same helping event. To test this idea, we conducted several experiments where people either directly interacted with each other to seek and offer help, or imagined or recalled such experiences in everyday life. We consistently observed that help-seekers underestimated how willing strangers – and even friends – would be to help them and how positive helpers would feel afterward, and overestimated how inconvenienced helpers would feel.

These patterns are consistent with work by Stanford psychologist Dale Miller showing that when thinking about what motivates other people, we tend to apply a more pessimistic, self-interested view about human nature. After all, Western societies tend to value independence, so asking others to go out of their way to do something for us may seem wrong or selfish and may impose a somewhat negative experience on the helper.

The truth is, most of us are deeply prosocial and want to make a positive difference in others’ lives. Work by Stanford psychologist Jamil Zaki has shown that empathizing with and helping others in need seems to be an intuitive response, and dozens of studies , including my own, have found that people often feel happier after conducting acts of kindness. These findings extend earlier research by Stanford Professor Frank Flynn and colleagues suggesting that people tend to overestimate how likely their direct request for help would be rejected by others. Finally, other research has even shown that seeking advice can even boost how competent the help-seeker is seen by the advice-giver.

Why is asking for help particularly important?

We love stories about spontaneous help, and that may explain why random acts of kindness go viral on social media. But in reality , the majority of help occurs only after a request has been made. It’s often not because people don’t want to help and must be pressed to do so. Quite the opposite, people want to help, but they can’t help if they don’t know someone is suffering or struggling, or what the other person needs and how to help effectively, or whether it is their place to help – perhaps they want to respect others’ privacy or agency. A direct request can remove those uncertainties, such that asking for help enables kindness and unlocks opportunities for positive social connections. It can also create emotional closeness when you realize someone trusts you enough to share their vulnerabilities, and by working together toward a shared goal.

It feels like some requests for help may be harder to ask than others. What does research say about different types of help, and how can we use those insights to help us figure out how we should ask for help?

Many factors can influence how difficult it may feel to ask for help. Our recent research has primarily focused on everyday scenarios where the other person is clearly able to help, and all you need is to show up and ask. In some other cases, the kind of help you need may require more specific skills or resources. As long as you make your request Specific, Meaningful, Action-oriented, Realistic, and Time-bound (also known as the SMART criteria ), people will likely be happy to help and feel good after helping.

Of course, not all requests have to be specific. When we face mental health challenges, we may have difficulty articulating what kind of help we need. It is okay to reach out to mental health resources and take the time to figure things out together. They are there to help, and they are happy to help.

You mentioned how cultural norms can get in the way of people asking for help. What is one thing we can all do to rethink the role society plays in our lives?

Work on independent and interdependent cultures by Hazel Markus , faculty director of Stanford SPARQ , can shed much light on this issue. Following her insights, I think we can all benefit from having a little bit more interdependency in our micro- and macro-environments. For instance, instead of promoting “self-care” and implying that it is people’s own responsibility to sort through their own struggles, perhaps our culture could emphasize the value of caring for each other and create more safe spaces to allow open discussions about our challenges and imperfections.

What inspired your research?

I have always been fascinated by social interaction – how we understand and misunderstand each other’s minds, and how social psychology can help people create more positive and meaningful connections. That’s why I have studied topics such as giving compliments , discussing disagreement , sharing personal failures, creating inclusive conversations on social media , and translating social and positive psychology research as daily practices for the public . This project is also motivated by that general passion.

But a more immediate trigger of this project is reading scholarly work suggesting that the reason why people underestimate their likelihood of getting help is because they don’t recognize how uncomfortable and awkward it would be for someone to say “no” to their request. I agree that people underestimate their chance of getting help upon a direct ask, but based on my personal experience, I saw a different reason – when people ask me for help, I often feel genuinely motivated to help them, more than feeling social pressure and a wish to avoid saying no. This project is to voice my different interpretation on why people agree to help. And given that I’ve seen people who have struggled for too long until it was too late to ask for help, I hope my findings can offer them a bit more comfort when the next time they can really use a helping hand and are debating whether they should ask.

Cookies on GOV.UK

We use some essential cookies to make this website work.

We’d like to set additional cookies to understand how you use GOV.UK, remember your settings and improve government services.

We also use cookies set by other sites to help us deliver content from their services.

You have accepted additional cookies. You can change your cookie settings at any time.

You have rejected additional cookies. You can change your cookie settings at any time.

International migration research, progress update: May 2024

An update on international migration methods and research.

https://www.ons.gov.uk/releases/internationalmigrationresearchprogressupdatemay2024

Official statistics are produced impartially and free from political influence.

Is this page useful?

Yes this page is useful
No this page is not useful

Help us improve GOV.UK

Don’t include personal or financial information like your National Insurance number or credit card details.

To help us improve GOV.UK, we’d like to know more about your visit today. Please fill in this survey (opens in a new tab) .

IMAGES

Types of Research Methodology: Uses, Types & Benefits
Your Step-by-Step Guide to Writing a Good Research Methodology
15 Types of Research Methods (2024)
Infographic: Steps in the Research Process
Research Paper Methodology
How to write a methods section of a research paper

VIDEO

The scientific approach and alternative approaches to investigation
PSY 2120: Why study research methods in psychology?
Research methods and data collection
Dissertation Tutorial: Primary Research
Introduction to Research Methods
Introduction to Research Methods: What is Research?

COMMENTS

Research Methods--Quantitative, Qualitative, and More: Overview
About Research Methods. This guide provides an overview of research methods, how to choose and use them, and supports and resources at UC Berkeley. As Patten and Newhart note in the book Understanding Research Methods, "Research methods are the building blocks of the scientific enterprise. They are the "how" for building systematic knowledge.
Research Methods
Research methods are specific procedures for collecting and analyzing data. Developing your research methods is an integral part of your research design. When planning your methods, there are two key decisions you will make. First, decide how you will collect data. Your methods depend on what type of data you need to answer your research question:
Research Methods
Draw conclusions: Research methods facilitate the drawing of conclusions based on empirical evidence and help researchers make generalizations about a population based on their sample data. Enhance understanding: Research methods contribute to the development of knowledge and enhance our understanding of various phenomena and relationships ...
What Is a Research Methodology?
Step 1: Explain your methodological approach. Step 2: Describe your data collection methods. Step 3: Describe your analysis method. Step 4: Evaluate and justify the methodological choices you made. Tips for writing a strong methodology chapter. Other interesting articles.
Understanding Research Methods
This MOOC is about demystifying research and research methods. It will outline the fundamentals of doing research, aimed primarily, but not exclusively, at the postgraduate level. It places the student experience at the centre of our endeavours by engaging learners in a range of robust and challenging discussions and exercises befitting SOAS ...
Research Methods
Get expert writing help. AI Proofreader. Get unlimited proofreading for 30 days. Try for free. Plagiarism Checker. ... Research methods are specific procedures for collecting and analysing data. Developing your research methods is an integral part of your research design. When planning your methods, there are two key decisions you will make.
Research Methods: What are research methods?
Research methods are the strategies, processes or techniques utilized in the collection of data or evidence for analysis in order to uncover new information or create better understanding of a topic. ... Research methods tool to help researchers gather full-text resources, design research projects, understand a particular method and write up ...
What is research methodology? [Update 2024]
A research methodology encompasses the way in which you intend to carry out your research. This includes how you plan to tackle things like collection methods, statistical analysis, participant observations, and more. You can think of your research methodology as being a formula. One part will be how you plan on putting your research into ...
What Is a Research Design
A research design is a strategy for answering your research question using empirical data. Creating a research design means making decisions about: Your overall research objectives and approach. Whether you'll rely on primary research or secondary research. Your sampling methods or criteria for selecting subjects. Your data collection methods.
Research Methodology
Qualitative Research Methodology. This is a research methodology that involves the collection and analysis of non-numerical data such as words, images, and observations. This type of research is often used to explore complex phenomena, to gain an in-depth understanding of a particular topic, and to generate hypotheses.
(PDF) Understanding research methods: An overview of the essentials
Abstract. A perennial bestseller since 1997, this updated tenth edition of Understanding Research Methods provides a detailed overview of all the important concepts traditionally covered in a ...
Research Methods Guide: Research Design & Method
Research design is a plan to answer your research question. A research method is a strategy used to implement that plan. Research design and methods are different but closely related, because good research design ensures that the data you obtain will help you answer your research question more effectively. Which research method should I choose?
Research Methods
Our Research Methods pages are designed to help you choose and then use the right research method for your purposes. They cover the whole process of research, from understanding the philosophical theory underpinning your choice of method, through choosing the methods that you will use to answer your research question, to collecting data and ...
How to use and assess qualitative research methods
Using qualitative methods can also help shed light on the "softer" side of medical treatment. For example, while quantitative trials can measure the costs and benefits of neuro-oncological treatment in terms of survival rates or adverse effects, qualitative research can help provide a better understanding of patient or caregiver stress ...
Research Methods In Psychology
Olivia Guy-Evans, MSc. Research methods in psychology are systematic procedures used to observe, describe, predict, and explain behavior and mental processes. They include experiments, surveys, case studies, and naturalistic observations, ensuring data collection is objective and reliable to understand and explain psychological phenomena.
Home
The Research Methods Resources website provides investigators with important research methods resources to help them design their studies using the best available methods. The material is relevant to both randomized and non-randomized trials, human and animal studies, and basic and applied research. The information provided here represents ...
Welcome
Welcome to the Research Methods Help Guide. In order to understand, interpret, and analyze the articles you find in library databases, you need at least a basic knowledge of research methods. This LibGuide provides simple definitions and explanations of common research methods concepts, including: *Find reference materials on conducting research.
Research in Psychology: Methods You Should Know
The Scientific Method in Psychology Research. The steps of the scientific method in psychology research are: Make an observation. Ask a research question and make predictions about what you expect to find. Test your hypothesis and gather data. Examine the results and form conclusions. Report your findings.
What Is Qualitative Research?
Qualitative research involves collecting and analyzing non-numerical data (e.g., text, video, or audio) to understand concepts, opinions, or experiences. It can be used to gather in-depth insights into a problem or generate new ideas for research. Qualitative research is the opposite of quantitative research, which involves collecting and ...
Research Process
By conducting rigorous and well-designed research, researchers can make significant contributions to their field and help to shape future research. Tips for Research Process. Here are some tips for the research process: Start with a clear research question: A well-defined research question is the foundation of a successful research project. It ...
1 Chapter 1: The Importance of Research Methods and Becoming an
I view research methods as a subject that I will rarely use. Research methods is not really useful for students who intend to work in Criminal Justice. Knowing research methods will help me earn a living. Research methods does not reflect the "real world." Research Disinterest 5. I am excited about taking research methods.
Literature review as a research methodology: An ...
This is why the literature review as a research method is more relevant than ever. Traditional literature reviews often lack thoroughness and rigor and are conducted ad hoc, rather than following a specific methodology. Therefore, questions can be raised about the quality and trustworthiness of these types of reviews.
Frozen human brain tissue can now be revived without damage
Weiwei Xue et al. A new technique has allowed scientists to freeze human brain tissue so that it regains normal function after thawing, potentially opening the door to improved ways of studying ...
Social Media Research: A Comprehensive Guide
There's a method to the madness of selfies and status updates. The right approach to social media research helps you learn more about the collective consciousness of society — and use it to your advantage. Let's explore the language of social media likes and shares and dig beneath the surface of our digital interactions.
Reflections On Qualtrics X4: AI-Powered Research Is Promising If We
Qualtrics introduced its AI-powered Strategy & Research suite at its summit, X4, and launched its "Strategic UX" product - officially entering the experience research space. The new product supports various UX research methods like video feedback, unmoderated usability testing, card sorting, and tree testing, and leverages AI to generate insights and recommended actions.
Why asking for help is hard, but people want to help more than we
Here, Zhao discusses the research about how asking for help can lead to meaningful experiences and strengthen relationships with others - friends as well as strangers.
A Beginner's Guide to Starting the Research Process
This article takes you through the first steps of the research process, helping you narrow down your ideas and build up a strong foundation for your research project. Table of contents. Step 1: Choose your topic. Step 2: Identify a problem. Step 3: Formulate research questions. Step 4: Create a research design. Step 5: Write a research proposal.
"I Didn't Realize How Common it Was:" A Mixed-Methods Study Examining
This mixed-methods study examined awareness and perceived legitimacy of the #MeToo movement and how #MeToo changed perceptions of sexual assault and consent, as well as sexual interactions, in the United States. Adults residing in the U.S. were recruited through CloudResearch to complete an online survey in 2021.
International migration research, progress update: May 2024
International migration research, progress update: May 2024. An update on international migration methods and research. From: Office for National Statistics. Published. 23 May 2024.
Research and Application of the Mine 3D DC Resistivity Method for
Generally, ground grouting is used to treat confined water areas before mining at the working face, but there is a lack of testing methods for determining the effectiveness of such a grouting treatment on the floor of ultrawide working faces. Therefore, we propose a 3D DC resistivity method for mines and apply it to the detection of the effect of grouting on the mine floor. This study took the ...

Secondary menu

Search form

About Research Methods

START HERE: SAGE Research Methods

Library Data Services at UC Berkeley

Other Data Services at Berkeley

General Research Methods Resources

Consultants

Related Resourcex

Have a language expert improve your writing

Research Methods | Definition, Types, Examples

Table of contents

Qualitative vs quantitative data

Primary vs secondary data

Descriptive vs experimental data

Prevent plagiarism, run a free check.

Qualitative analysis methods

Quantitative analysis methods

Is this article helpful?

Research Methods: What are research methods?

What are research methods

Types of research

Data collection tools

What is research methodology?

The basics of research methodology

Research Methods Guide: Research Design & Method

Tutorial Videos: Research Design & Method

FAQ: Research Design & Method

Research Methods

Qualitative Research Designs

Quantitative Research Designs

Analysing Research Data

Introducing Research Methods

Further Reading on Research

How to use and assess qualitative research methods

Wolfgang Wick

Christoph Gumbinger

What is qualitative research?

Why conduct qualitative research?

How to conduct qualitative research?

Data collection

Document study

Observations

Semi-structured interviews

Focus groups

Choosing the “right” method

Data analysis

How to report qualitative research?

How to combine qualitative with quantitative research?

How to assess qualitative research?

Reflexivity

Sampling and saturation

Member checking

Stakeholder involvement

How not to assess qualitative research

Protocol adherence

Sample size

Randomisation

Interrater reliability, variability and other “objectivity checks”

Not being quantitative research

Acknowledgements

Availability of data and materials

Research Methods In Psychology

Experimental Design

Experimental Methods

Correlational Studies

A correlation between variables, however, does not automatically mean that the change in one variable is the cause of the change in the values of the other variable. A correlation only shows if there is a relationship between variables.

Interview Methods

Observations

Pilot Study

Research Design

Reliability

Meta-Analysis

Peer Review

Types of Data

Features of Science

Statistical Testing

Ethical Issues

Research Methods Resources

NIH Clinical Trial Requirements