importance of quantitative research in criminology

• Skip to main content
• Skip to primary sidebar

Criminal Justice

IResearchNet

Academic Writing Services

Quantitative criminology.

The foundation of a sound quantitative criminology is a solid base of descriptive information. Descriptive inference in criminology turns out to be quite challenging. Criminal offending is covert activity, and exclusive reliance on official records leads to highly deficient inferences. Despite important challenges in descriptive analysis, researchers and policymakers still strive to reach a better understanding of the effects of interventions, policies, and life experiences on criminal behavior. (adsbygoogle = window.adsbygoogle || []).push({});

1. Introduction

2. quantitative data sources, 3. logical and inferential issues, 3.1. time horizon, 3.2. unit of analysis, 3.3. sampling, 3.4. target population, 3.5. concepts and variables, 3.6. descriptive and causal inference, 3.7. validity, 3.8. reliability, 3.9. relationship between reliability and validity, 3.10. estimates and estimators, 3.11. estimator properties: bias, efficiency, and consistency, 4. assessing evidence, 5. methods for descriptive inference, 5.1. measures of central tendency, 5.2. measures of dispersion, 5.3. criminal careers, 5.4. recidivism rates, 5.5. trajectories and developmental pathways, 6. analytic methods for causal inference, 6.1. independent variables and outcomes, 6.2. contingency tables, 6.3. measures of association, 6.4. chi-square, t tests, and analysis of variance, 6.5. linear regression, 6.6. regression for qualitative and counted outcomes, 6.7. structural equation models, 6.8. interrupted time series analysis, 6.9. models for hierarchical and panel data, 6.10. counterfactual reasoning and treatment effects, 6.11. randomized experiments, 6.12. natural experiments and instrumental variable estimators, 6.13. matching, 7. conclusion.

Since its inception as a field of scientific inquiry, criminology and criminal justice (CCJ) researchers have used quantitative data to describe and explain criminal behavior and social responses to criminal behavior. Although other types of data have been used to make important contributions to criminological thought, the analysis of quantitative data has always played an important role in the development of knowledge about crime. This research paper discusses the various types of quantitative data typically encountered by CCJ researchers. Then, some of the logical and inferential issues that arise when researchers work with quantitative data are described. Next, the research paper considers different analytic frameworks for evaluating evidence, testing hypotheses, and answering research questions. Finally, a discussion of the range of methodological approaches used by contemporary CCJ researchers is provided.

CCJ researchers commonly work with data collected for official recordkeeping by government or quasi-government agencies. Such data often include records of criminal events, offender and victim characteristics, and information about how cases are handled or disposed. Detailed information about crimes known to the police and crimes cleared by arrest are available in the UniformCrime Reports (UCR) and the National Incident Based Reporting System (NIBRS). In addition, for purposes of specific research projects, criminal justice agencies often make their administrative records available to criminologists—provided that appropriate steps are taken to protect individual identities. For example, the Bureau of Justice Statistics has conducted two major studies of recidivism rates for prisoners returning to the community in multiple states. Such projects require coordinated use of state correctional databases and access to criminal records, including arrests, convictions, and reincarceration.

More recently, researchers have also relied on information collected through direct interviews and surveys with various populations. In these surveys, respondents are asked about their involvement in offending activities, victimization experiences, background characteristics, perceptions, and life circumstances. Analyses from data collected through the National Crime Victimization Survey; the Arrestee Drug Abuse Monitoring program; the RAND inmate survey; the National Youth Survey; the National Longitudinal Survey of Youth; the Adolescent Health Study; Monitoring the Future (MTF); Research on Pathways to Desistance, and the Office of Juvenile Justice and Delinquency Prevention’s longitudinal youth studies in Rochester, New York, Pittsburgh, Pennsylvania, and Denver, Colorado, have all made important contributions to criminological thought and public policy.

Researchers have also attempted, in some studies, to collect detailed quantitative databases composed of information from both administrative and direct surveys on the same individuals. Among other findings, this research has consistently shown that most crime victimizations are not reported to the police and that most offending activities do not result in an arrest.

The analysis of quantitative crime-related data, like any other type of analysis, depends primarily on the question one is asking and the capabilities of the data available. This section briefly discusses some of the most prominent issues that crime researchers consider when analyzing quantitative data.

Regardless of the data source, research projects using quantitative data can generally be characterized as crosssectional or longitudinal. Cross-sectional studies examine individuals or populations at a single point in time, whereas longitudinal studies follow the same individuals or populations over a period of time. Among longitudinal studies, an important consideration is whether the data will be collected prospectively or retrospectively. In prospective studies, individuals are enrolled in the study and then followed to see what happens to them. In retrospective studies, individuals are enrolled in the study, and researchers then examine historical information about them. Some studies include both prospective and retrospective elements. For example, the Research on Pathways to Desistance study enrolled adolescent offenders in Phoenix, Arizona, and Philadelphia to see how these offenders adapt to the transition from adolescence to adulthood. In that sense, the study is prospective; however, historical information about the individuals included in the study is available and has been collected retrospectively as well.

In most studies, it is clear whether the project is crosssectional or longitudinal, but there are exceptions. For example, the MTF study repeatedly surveys nationally representative samples of high school seniors. This study can be viewed as cross-sectional because it does not survey the same individuals repeatedly, but it can also be viewed as longitudinal because the same methodology for drawing the sample and analyzing the data is repeated over time. Similar issues arise with UCR and NIBRS data. Often, specific studies using a repeated cross-sectional data source, such as MTF, UCR, or NIBRS, will tend to emphasize either crosssectional or longitudinal features of the data.

It is also useful to think about research projects in terms of the basic source of variation to be studied. For example, some studies focus on variation in crime between communities, whereas other studies examine variation in criminality between individual persons. Still other studies attempt to describe and explain variation in behavior over time for the same community or individual. In some studies, the unit of analysis is unambiguous, whereas in other instances, there may be multiple logical analysis units (e.g., multiple observations on the same person and multiple persons per community). These studies are generally referred to as hierarchical or multilevel analyses. An important issue arising in these analyses is lack of independence among observations belonging to a logical higher-order group. For example, individuals who live in the same community or who attend the same school are not likely to be truly independent of each other.

The list of all cases that are eligible to be included in a study is called the sampling frame. The sample included in the study will either be identical to the sampling frame or it will be a subset of the sampling frame. In some instances, the sampling frame is explicitly defined; at other times, the sampling frame is vague. Researchers generally describe the manner in which the sample was selected from the sampling frame in terms of probability or nonprobability sampling. In probability sampling, each case in the sampling frame has a known, non-zero probability of being selected for the sample. Samples selected in any other way are called nonprobability samples. The most basic form of probability sampling is simple random sampling, when each member of the sampling frame has an equal probability of being selected for the sample. More complicated forms of probability sampling, such as stratified random sampling, cluster sampling, and stratified multistage cluster sampling, are all commonly used in CCJ research.

The use of probability sampling allows researchers to make clear statements about the generalizability of their results. Although this is a desirable feature of probability samples, much CCJ research is based on nonprobability samples. The 1945 and 1958 Philadelphia birth cohort studies conducted by Marvin Wolfgang and his colleagues (Wolfgang, Figlio, & Sellin, 1972) focused on an entire population of individuals rather than a sample. Still, one can view the choice of the years 1945 and 1958 as a means of sampling. In fact, when populations are studied, there is almost always a way to conceive of them as nonprobability samples. In other studies, a researcher may survey all children in attendance at a school on a particular day. The resulting sample would be called a convenience or availability sample. Still other research projects rely on the purposive selection of certain numbers of people meeting particular criteria to ensure representation of people from different groups (i.e., males, females, blacks, whites, etc.). These samples are usually called quota samples.A key feature of nonprobability samples is that one is not able to make explicit probabilistic statements about quantities in the population based on what one observes in the sample. Nevertheless, nonprobability samples are quite useful and necessary for addressing many interesting research and policy questions that arise in CCJ research.

A key aspect of any scientific work is the identification of empirical regularities that transcend specific individuals, places, or times. Thus, the population to which the results of a study generalize is of considerable importance. In general, researchers tend to prefer studies that identify the target population and discuss how well the results are likely to generalize to that population. But the target population is sometimes ambiguous. If one studies all individuals in attendance at a particular school on a given day, one could argue that the sample is synonymous with the target population. The research community, however, is not likely to be interested in what is occurring at that individual school unless it somehow relates to what is occurring at other schools in other locations and at other times. This ambiguity means that one cannot make precise statements about the generalizability of the results to other settings. Thus, clear statements about the composition and boundaries of the target population are often the exception rather than the rule.

Scientific theories describe relationships between concepts. In this sense, concepts represent the key elements of a well-developed theory. Concepts are verbal cues or symbols that sometimes refer to simple or complicated sources of variation. Sex (male vs. female), for example, refers to a simple, objective source of variation, whereas the meaning of concepts such as delinquency or socioeconomic status is potentially quite complicated. Still, reference to concepts for purposes of theory and hypothesis development can be sufficient. For purposes of conducting empirical tests of theories and hypotheses, however, more rigor and specificity are required.

Variables are the language of actual empirical work. A researcher’s description of a variable explicitly defines how the concept in question is to be measured for purposes of an actual research project. An operational description or definition of a variable attends to how the variable was measured and what values the variable can take on. Variables such as sex and race are categorical, whereas variables such as age and income are quantitative. Categorical variables can be nominal (unordered categories) or ordinal (ordered categories, but the distance between categories is not well-defined). Quantitative variables can be interval (equal distance between categories) or ratio (existence of a true zero). Still another type of variable, of particular interest to criminologists, is a count of events. Event-count variables represent the number of times an event occurs within some period of time. One way to think of an event-count variable is to consider a two-category variable: Either an event occurs or does not occur within some small time interval. If one adds up the number of times an event occurs over many of these small time intervals, one gets a total count of events.

Some concepts are too broad to be measured effectively with a single variable. Socioeconomic status, for example, is often linked to a combination of at least three subordinate concepts: (1) educational attainment, (2) income, and (3) occupational prestige. Often, variables associated with closely related subordinate concepts can be combined into a scale or index that measures the conceptual variation of interest. There are different ways to form scales and indexes. Some are driven by mathematical decision rules based on correlations between the items comprising the scale or index, and others are based on conceptual considerations.

Still another important feature of any quantitative study is whether it emphasizes description or the identification of cause–effect relationships. Descriptive inference is a characterization or summary of important features of a population. For example, the main objective of the 1993 Bureau of Justice Statistics recidivism study was to estimate the percentage of offenders released from prison in 1993 who experienced subsequent involvement with the criminal justice system within 3 years of their release. No effort was made to explain variation in the recidivism rate; instead, the goal was pure description.

Causal inference is the process of distinguishing between a correlation or statistical association between two or more variables and a cause–effect relationship between those variables. In order for a variable x to be considered a cause of variable y, three criteria must be satisfied: (1) x precedes y in time, (2) x and y are statistically associated, and (3) the statistical association between x and y is not spurious (i.e., there is no other variable that can account for or explain the statistical association between x and y). It turns out that establishing the first two criteria is reasonably straightforward. Convincingly demonstrating nonspuriousness, however, is much more difficult. This issue is discussed in more detail in the “Analytic Methods for Causal Inference” section.

The word validity is often used in two broad contexts in CCJ research. It may be used to indicate whether (or to what extent) a specific measure is an accurate characterization of the concept being studied. For example, one might ask whether an IQ test is a valid measure of intelligence. The word validity is also used as a way of characterizing a study or particular methodological approach. In this case, the concern is whether the study or method is likely to faithfully present the world as it really operates or whether it will distort the phenomena under study in some important way. As an example of this usage, one might consider whether a study with a pretest outcome measurement followed by an intervention and then a posttest outcome measurement but no control group (a group that does not experience the intervention) is a valid study.

A number of different types of validity appear in the CCJ literature. A few common types are discussed here. Assessments of face validity are subjective judgments about whether a measurement or methodology is likely to yield accurate results. If a measure successfully predicts variation in a logically linked outcome, one can say that it rates high on criterion or predictive validity. For example, if one has a parole risk assessment instrument that is designed to predict likelihood of recidivism and the instrument, in fact, does do a good job of recidivism prediction, then one can say that it exhibits criterion validity. Measures with good construct validity are correlated with wellestablished indicators of the phenomenon in question. Such measures should also be independent of indicators that are not relevant to the phenomenon in question.

Studies with high internal validity take convincing steps to ensure that the logic of the study as applied to the individuals actually being studied is sound. External validity, on the other hand, refers to the generalizability of the study’s results to individuals other than those actually included in the study. Internal validity tends to be maximized when the researcher is able to exert a great deal of control over the study and the environment in which the study is conducted (i.e., a laboratory setting). Unfortunately, when the researcher exerts great control, the conditions of the study sometimes become more artificial and less realistic. This raises questions about how well the study results will generalize to other cases. To the extent that the researcher attempts to allow for more realistic study environments (and greater external validity), this will often lead to less control over the study, which produces threats to internal validity. Researchers desire studies that maximize both internal and external validity, but this is often difficult to achieve.

Reliability refers to the consistency, stability, or repeatability of results when a particular measurement procedure or instrument is used. Researchers aspire to the use of instruments and procedures that will produce consistent results (provided that the phenomena under study have not changed). There are different ways of assessing and quantifying reliability. One approach is to take a measurement at a particular point in time and then repeat that same measurement at a later point in time. The correlation between the two measurements is called test–retest reliability. Another approach is to conduct multiple measurements with some variation in the precise measurement method; for example, multiple questionnaires with variations in the wording of various items can be administered to the same individuals. The correlation between the various instruments is called parallel forms reliability.

In some instances, researchers need to code various pieces of information into quantitative research data. A concern often arises about whether the coding rules are written in such a way that multiple properly trained coders will reach the same coding decisions. Interrater reliability is considered to be high when there is a high correlation between the decisions of multiple coders who have reviewed the same information.

Reliability can also be assessed by examining correlations between multiple indicators of the same underlying concept. Assume, for example, that a researcher believes that a key influence on criminal behavior is an individual’s level of self-control. Because there is no single definitive measure of self-control, the researcher might measure many indicators and characteristics of individuals that he believes to be manifestations of one’s level of self-control (i.e., time spent on homework each day, grades in school, time spent watching television, etc.). One way of assessing the reliability of a scale or index that combines this information is to calculate the correlations between all of the indicators, which can then be used to calculate internal-consistency reliability. High levels of internal-consistency reliability imply that the various characteristics and indicators being studied are closely related to each other.

Measures or procedures for capturing measurements can be highly reliable but also invalid. It is possible, for example, to obtain consistent but wrong or misleading measurements. Measures or procedures can also be both unreliable and invalid. In general, however, if a measure is valid it must also, by definition, be reliable.

An estimate is a person’s guess about the value of some interesting quantity or parameter for a target population. Researchers obtain an estimate by applying a formula or estimator to observed data that can be used to develop inferences about the target population. The most straightforward case is when one studies observed data from a simple random sample drawn from a well-defined target population. The goal is to infer the value of a parameter or quantity in the population on the basis of what one observes in the sample. A researcher plugs the observed data into an estimator and then uses the estimator, or formula, to calculate an estimate of the quantity of interest in the population.

In the case of a probability sample drawn from a welldefined population, there is a true population parameter or quantity that researchers seek to estimate on the basis of what they see in the sample.An important issue is whether the estimator applied to the sample will—over the course of drawing many, many probability samples—on average lead to the correct inference about the population parameter. If the average of the parameter estimates is different from the true population parameter, one says that the estimator is biased.

Sometimes there are different unbiased estimators or formulas that could be used to estimate a population quantity. An important question is how to choose one estimator over another. Generally speaking, in this situation researchers would prefer the unbiased estimator that exhibits the least amount of variation in the estimates generated over many samples drawn from the same population. The estimator that exhibits the minimum amount of sample-to-sample variation in the estimates is the most efficient estimator. For example, the sample mean, the sample median, and the sample mode (see “Measures of Central Tendency” section) are both valid estimators for the population mean of a normally distributed variable. The sample mean, however, is a more efficient estimator than the sample median, which is itself more efficient than the sample mode.

In some circumstances, an unbiased estimator is not available. When this happens, researchers typically try to use a consistent estimator. A consistent estimator is biased in small samples, but the bias decreases as the size of the sample increases. Many commonly used estimators in the social sciences, such as logistic regression (discussed later in this research paper), are consistent rather than unbiased.

A statistical model is a description of a process that explains (or fails to explain) the distribution of the observed data. A problem that arises in quantitative CCJ research is how to consider the extent to which a particular statistical model is consistent with the observed data. This section describes several common frameworks for thinking about this correspondence.

4.1. Relative Frequency

In quantitative crime research, decisions about whether to reject or fail to reject a particular hypothesis are often of central importance. For example, a hypothesis may assert that there is no statistical association between two variables in the target population. A test of this hypothesis amounts to asking the following question: What is the probability of observing a statistical association at least as large (either in absolute value or in a single direction) as the one observed in this sample if the true statistical association in the target population is equal to zero? Put another way, assume that there is a target population in which the statistical association is truly equal to zero. If a researcher drew many simple random samples from that population and calculated the statistical association in each of those samples, he or she she would have a sampling distribution of the statistical association parameter estimates. This theoretical sampling distribution could be used to indicate what percentage of the time the statistical association would be at least as large as the association the researcher observed in the original random sample.

Generally speaking, if the percentage is sufficiently low (often, less than 5%), one would reject the hypothesis of no statistical association in the target population. A concern that arises in these kinds of tests is that the hypothesis to be tested is usually very specific (i.e., the statistical association in the target population is equal to zero). With a very large sample size it becomes quite likely that the so-called test statistic will lead a person to reject the hypothesis even if it is only slightly wrong. With a very small sample size, the test statistic is less likely to lead one to reject the hypothesis even if it is very wrong. With this in mind, it is important for researchers to remember that hypothesis tests based on the relative frequency approach are not tests of whether the statistical association in question is large or substantively meaningful. It is also important to keep in mind that the interpretation of statistical tests outside of the framework of well-defined target populations and probability samples is much more ambiguous and controversial.

4.2. Bayesian Methods

Researchers often find the relative frequency framework to be technically easy to use but conceptually difficult to interpret. In fact, researchers and policymakers are not necessarily so concerned with the truth or falsehood of a specific hypothesis (e.g., that a population parameter is equal to zero) as they are with the probability distribution of that parameter. For example, it might be of more interest to estimate the probability that a parameter is greater than zero rather than the probability that a sample test statistic could be as least as large as it is if the population parameter is equal to zero. Analysis conducted in the Bayesian tradition (named after the Rev. Thomas Bayes, who developed the well-known conditional probability theorem) places most of its emphasis on the estimation of the full probability distribution of the parameter(s) of interest. In general, Bayesian methods tend not to be as widely used as relative frequency (or frequentist) methods in CCJ research. This is probably due to the training received by most criminologists, which tends to underemphasize Bayesian analysis. Because Bayesian analyses can often be presented in terms that are easier for policy and lay audiences to understand, it is likely that Bayesian methods will become more prominent in the years ahead.

4.3. Parameter Estimation and Model Selection

CCJ researchers typically rely on quantitative criteria to estimate parameters and select statistical models. Common criteria for parameter estimation include least squares (LS) and maximum likelihood (ML). LS estimators minimize the sum of the squared deviations between the predicted and actual values of the outcome variable. ML estimators produce estimates that maximize the probability of the data looking the way they do. Provided the necessary assumptions are met, LS estimators are unbiased and exhibit minimum sampling variation (efficiency). ML estimators, on the other hand, are typically consistent, and they become efficient as the sample size grows (asymptotic efficiency).

Model selection involves the choice of one model from a comparison of two or more models (i.e., a model space). The most prominent model selection tools include F tests (selection based on explained variation) and likelihoodratio tests (selection based on likelihood comparisons). An important issue with these tests is that they typically require that one model be a special case of the other models in the model space. For these approaches, tests are therefore limited to comparisons of models that are closely related to each other. Increasingly, model selection problems require researchers to make comparisons between models that are not special cases of each other. In recent years, two more general model selection criteria have become more widely used: (1) the Akaike information criterion (AIC) and (2) the Bayesian information criterion (BIC). These criteria can be used to compare both nested and non-nested models provided the outcome data being used for the comparison are the same. Like F tests and likelihood-ratio tests, AIC and BIC penalize for the number of parameters being estimated. The logic for penalizing is that, all other things equal, we expect a model with more parameters to be more consistent with the observed data. In addition to penalizing for parameters, the BIC also penalizes for increasing sample size. This provides a counterweight to tests of statistical significance, such as the F test and the likelihood-ratio test, which are more likely to select more complicated models when the sample size is large. As modeling choices continue to proliferate, it seems likely that use of AIC and BIC will continue to increase.

This section briefly considers some descriptive parameters often studied in CCJ research. The first two subsections deal with parameters that are usually of interest to all social scientists. The final three subsections emphasize issues of particular importance for CCJ research.

Central tendency measures provide researchers with information about what is typical for the cases involved in a study for a particular variable. The mean or arithmetic average (i.e., the sum of the variable scores divided by the number of scores) is a common measure of central tendency for quantitative variables. The mean has an advantage in that each case’s numerical value has a direct effect on the estimate; thus, the mean uses all of the information in the scores to describe the “typical” case. A problem with the mean is that cases with extreme scores can cause the mean to be much higher or much lower than what is typical for the cases in the study. In situations where the mean is affected by extreme scores, researchers often prefer to use the median as a measure of central tendency. The median is the middle score of the distribution; half of the cases have scores above the median, and the other half have scores below the median. The median can also be viewed as the 50th percentile of the distribution. Unlike the mean, the median does not use all of the information in the data, but it is also not susceptible to the influence of extreme scores. For categorical variables, the mode (i.e., the most frequently occurring category) is often used as a measure of central tendency. For dichotomous or two-category variables, the most commonly used measure of central tendency is the proportion of cases in one of the categories.

In addition to summarizing what is typical for the cases in a study, researchers usually consider the amount of variation as well. Several common summaries of variation, or dispersion, are commonly reported in the literature. The most common measure of dispersion for quantitative variables is the variance and/or its square root, the standard deviation. Many interesting social science variables are either normally or approximately normally distributed (i.e., the distribution looks like a bell-shaped curve). In these types of distributions, approximately two thirds of the cases fall within 1 standard deviation of the mean, and about 95% of the cases fall within 2 standard deviations of the mean. Thus, for variables with a bell-shaped distribution, the standard deviation has a very clear interpretation. This is particularly important because sampling distributions are often assumed to have normal distributions. Thus, the standard error calculation that appears in much quantitative CCJ research is actually an estimate of the standard deviation of the sampling distribution. It can be used to form confidence intervals and other measures of uncertainty for parameter estimates in the relative frequency framework.

For qualitative or categorical variables, a common measure of dispersion is the diversity index, which measures the probability that cases come from different categories. Some CCJ researchers have used the diversity index to study offending specialization and ethnic–racial heterogeneity in communities and neighborhoods. A generalized version of the diversity index that adjusts for the number of categories is the index of qualitative variation, which indicates the extent to which individuals are clustered within the same category or distributed across multiple categories.

Over the past three to four decades, criminologists have developed the concept of the criminal career. According to researchers who study criminal career issues, within any given time period the population can be divided into two groups: (1) active offenders and (2) everyone else. The percentage of the population in the active offender category is the crime participation rate. Within that same time period, active offenders vary in several respects: (a) the number of offenses committed, (b) the seriousness of the offenses committed, and (c) the length of time the offender is actively involved in criminal activity. A key idea within the criminal career framework is that the causes of participation may not be the same as the causes of offense frequency, seriousness, or the length of time the offender is active.

There is an extensive body of research devoted to estimating these parameters for general and higher-risk populations, and more recent research has treated these criminal career dimensions as outcomes in their own right. For example, a large amount of research has been devoted to the study of offense frequency distributions. This literature shows that in both general and high-risk populations offense frequency distributions tend to be highly skewed, with most individuals exhibiting low frequencies and a relatively small number of individuals exhibiting high frequencies. Among the most prominent findings in the field came from Wolfgang et al.’s (1972) study of the 1945 Philadelphia male birth cohort, which showed that about 6% of the boys in the cohort were responsible for over 50% of the police contacts for the entire cohort.

A particularly important parameter for criminal justice policy is the rate at which individuals who have offended in the past commit new crimes in the future (the recidivism or reoffending rate). Recidivism rates are based on three key pieces of information: (1) the size of the population of prior offenders at risk to recidivate in the future, (2) the number of individuals who actually do reoffend by whatever measure is used (i.e., self-report of new criminal activity, rearrest, reconviction, return to prison), and (3) a known follow-up period or length of time that individuals will be followed. Recidivism is also sometimes studied in terms of the length of time that lapses between one’s entry into the population of offenders at risk to recidivate and the timing of one’s first recidivism incident.

With the advent of a large number of longitudinal studies of criminal and precriminal antisocial and aggressive behaviors, researchers have become increasingly interested in the developmental course of criminality as people age. To aid in the discovery of developmental trends and patterns, criminologists have turned to several types of statistical models that provide helpful lenses through which to view behavior change. The most prominent of these models are growth curve models, semiparametric trajectory models, and growth curve mixture models. These all assume that there is important variation in longitudinal patterns of offending. Some individuals begin offending early and continue at a sustained high rate of offending throughout their lives, whereas others who begin offending early seem to stop offending during adolescence and early adulthood. Some individuals avoid offending at all, whereas others offend in fairly unsystematic ways over time. Growth and trajectory models provide ways of summarizing and describing variation in the development of criminal behavior as individuals move through the life span.

The foundation of a sound quantitative criminology is a solid base of descriptive information. Descriptive inference in criminology turns out to be quite challenging. Criminal offending is covert activity, and exclusive reliance on official records leads to highly deficient inferences. Despite important challenges in descriptive analysis, researchers and policymakers still strive to reach a better understanding of the effects of interventions, policies, and life experiences on criminal behavior. Much of the CCJ literature is therefore focused on efforts to develop valid causal inferences. This section discusses some of the most prominent analytic methods used for studying cause and effect in CCJ research.

CCJ researchers typically distinguish between independent variables and dependent or outcome variables. In general, researchers conceive of dependent or outcome variables as variation that depends on the independent or predictor variables. Thus, independent variables explain variation in dependent or outcome variables. Sometimes researchers use stronger language, suggesting that independent variables cause variation in dependent variables. The burden of proof for use of the word cause is very high, however, and many researchers are careful to qualify their results if they do not think this burden of proof has been met.

Contingency tables are a useful way of presenting frequency distributions for two or three categorical variables at the same time. For example, if a person wanted to create a measure of offending participation (either someone offends in a particular time period or he or she does not) and then compare the distribution of that variable for individuals who are employed and those who are not employed, a contingency table could be constructed to display this information. Several measures of the strength of the statistical association (analogous to a correlation coefficient) have been designed for contingency tables. Although contingency tables are not often used for studying cause–effect relationships (except in randomized experiments), they are quite useful for exploratory data analysis and foundational work for more elaborate statistical models.

Researchers often want to summarize the strength of the statistical association between two variables. Correlation coefficients and other measures of association are used for this purpose. In general, measures of association are arrayed on a scale of – 1 to 1 or 0 to 1, where 0 usually represents no association at all and – 1 or 1 represents a perfect negative or positive association. Measures of association have been developed for categorical and quantitative variables. Some measures of association, such as the relative risk ratio and the odds ratio, are calibrated so that 1 implies no statistical association, whereas numbers close to zero and large positive numbers indicate strong association. Researchers often conduct tests of statistical significance to test the hypothesis of “no association” in the population.

CCJ researchers are able to draw on a wide variety of tools for conducting tests of statistical significance. In a contingency table setting, researchers often are interested in testing the hypothesis that two categorical variables are statistically independent. The chi-square test of independence is frequently used for this purpose. Sometimes, a researcher will want to test the hypothesis that the mean of a continuous variable is the same for two populations. The independent samples t test is most often used to conduct this test. In addition, researchers may need to test the hypothesis that the mean of a continuous variable remains the same at two time points. In this setting, the paired samples t test will most likely be used. Finally, if a researcher wants to test the hypothesis that a continuous variable has the same mean in three or more populations, then analysis of variance will be used. There are many statistical tests for many types of problems. Although these are among the most common applications, many others are available for more complicated situations.

Linear regression models are a class of statistical models summarizing the relationship between a quantitative or continuous outcome variable and one or more independent variables. Careful use of these models requires attention to a number of assumptions about the distribution of the outcome variable, the correctness of the model’s specification, and the independence of the observations in the analysis. If the assumptions underlying the model are valid, then the parameter estimates can provide useful information about the relationship between the independent variable or variables and the outcome variable.

Many outcome variables in CCJ are not continuous or do not meet some of the distributional assumptions required for linear regression. Statistical models for these variables, therefore, do not fit well into the linear regression framework. Examples of this problem include dichotomous and event-count outcomes. For dichotomous outcomes, researchers often estimate logistic or probit regression models; for counted outcomes, specialized models for event counts are usually estimated (i.e., binomial, Poisson, negative binomial).

CCJ researchers sometimes have well-developed ideas about the relationships between a complex system of independent and dependent variables. These ideas are usually based on theories or findings from previous empirical research. Structural equation models can be used to investigate whether the relationships between the variables in the system are in accord with the researcher’s predictions.

A time series analysis is based on the study of a particular cross-sectional unit (e.g., a community or city) over a sustained period of time. Over that period of time, the study takes repeated measurements of the phenomenon of interest (e.g., the number of gun homicides each month). Sometimes, an intervention occurs (e.g., the introduction of a new law restricting access to handguns) and the researcher has access to both the preintervention time series and the postintervention time series. These time series can be combined into a single interrupted time series analysis to study the effect of the intervention on the series. Researchers conducting interrupted time series analysis usually include both a series in which the intervention occurs and a series in which there is no intervention (a control series). If there is an apparent effect of the intervention in the interrupted time series analysis and the effect reflects a genuine causal effect, then there should be no corresponding change in the control series.

As discussed earlier (see the “Unit ofAnalysis” section), some data sets have more than one logical unit of analysis. For example, the National Longitudinal Survey of Youth follows the same individuals repeatedly over a sustained period of time (panel data). Other studies, such as the MTF study, sample schools and then sample multiple individuals within each school. A variety of modeling tools (i.e., fixed effect, random effect, hierarchical, and multilevel models) exist for working these kinds of data. An important feature of all of these tools is that they attend specifically to dependence within higher order units of analysis.

Increasingly, CCJ researchers are thinking about cause and effect in terms of counterfactual reasoning. Ultimately, this is an exercise in observing what actually occurs under a specific set of circumstances and then asking how things might have occurred differently if the circumstances had been different. The hypothetical aspect of the problem is a counterfactual, because it involves speculation about what might have occurred but actually did not occur. Counterfactual reasoning is particularly applicable to the problem of estimating treatment effects. For example, a researcher considers a group of people who received a particular treatment and observes their outcomes. What he would like to know (but cannot know for sure) is what outcomes these same people would have experienced if they had not received the treatment. The difference between the actual, observed outcome and the hypothetical outcome is the treatment effect. CCJ researchers usually look to the experience of a control group to estimate the hypothetical outcome.An important problemin CCJ research is the identification of appropriate control groups.

A randomized experiment is a study in which individuals are randomly assigned to treatment or control groups prior to treatment. They provide a useful framework for estimating valid counterfactuals because random assignment to treatment and control conditions ensures that the groups are statistically comparable to each other prior to treatment. Thus, the experience of the control group provides a very convincing answer to the question of what would happen to the treatment group if the treatment group did not receive treatment.

For a variety of reasons, randomized experiments are not possible in many instances, but sometimes conditions that closely approximate an experiment occur because of a key event or policy change. When researchers recognize these conditions, a natural experiment is possible—even when more conventional studies fail. Consider the problem of estimating the effect of police strength on crime rates. Estimating correlations and conventional regression models cannot help much with this problem. The critical ambiguity is that street crime almost certainly has an effect on police strength and that police strength almost certainly has some effect on street crime. Natural experiments can provide more convincing evidence.A recent study conducted in Washington, D.C., is illustrative (Klick & Tabarrok, 2005). It was based on the insight that changes in terror alert levels lead to meaningful changes in the presence of police on the street. The researchers examined what happened to crime rates when street-level police presence increased and decreased as terror alert levels changed. Researchers sometimes refer to natural experimentally based treatments as instrumental variable estimators, and they can provide a powerful method for estimating treatment effects when randomized experiments cannot be conducted.

Another approach to developing valid counterfactuals is to identify a group of cases that receive treatment and then identify another group of cases—the control group—that are similar to the treatment cases but do not receive treatment. To ensure that the treatment and control groups are similar, researchers match the groups on characteristics that are thought to be important. The direct matching approach guarantees that the treatment and control groups look alike on the matched characteristics.A problem is that the groups may look different from each other on characteristics that were not matched. Thus, in general, counterfactuals produced by the matching approach will not be as convincing as those produced by a randomized or natural experiment. However, in instances where experiments are not possible, direct matching designs can still provide convincing evidence about treatment effects. A generalization of the matching design involves matching on indexes based on combinations of variables. Propensity scores, which increasingly appear in the CCJ literature, are one such index. It can be shown that matching on a properly created index can lead to treatment and control groups that look like each other on many characteristics. It is likely that CCJ researchers will rely more and more heavily on matching designs and propensity scores to study treatment effects, in particular when randomized experiments are not possible.

Some aspects of quantitative CCJ research have remained relatively constant throughout the field’s history. Some CCJ research problems are very much like problems studied in other fields, and some are quite different, yet there has always been a major emphasis on description and learning about how much crime is occurring and what populations are at highest risk of criminal involvement and victimization. Other aspects, such as repeatedly and systematically following the same individuals over time and rigorously measuring the effects of changing policies, are more recent developments. CCJ is an interdisciplinary field that relies on insights from sociology, psychology, economics, political science, and statistics as well as its own rapidly emerging traditions. One thing is certain: Analytic methods in the field will continue to evolve. It is critical that quantitativeCCJ researchers monitor developments in their own field and stay well connected with developments in other allied fields to strengthen their efforts at descriptive and causal inference.

References:

• Bachman, R., & Paternoster, R. (1997). Statistical methods for criminology and criminal justice. New York: McGraw-Hill.
• Berk, R. A. (1991). Drug use, prostitution and the prevalence of AIDS: An analysis using census tracts. Journal of Sex Research, 27, 607–621.
• Blumstein, A., & Cohen, J. (1987, August 28). Characterizing criminal careers. Science, 237, 985–991.
• Blumstein, A., Cohen, J., Roth, J., & Visher, C. A. (Eds.). (1986). Criminal careers and “career criminals.”Washington, DC: National Academy Press.
• Bushway, S. D., Thornberry, T. P., & Krohn, M. D. (2003). Desistance as a developmental process: A comparison of static and dynamic approaches. Journal of Quantitative Criminology, 19, 129–153.
• Campbell, A., Berk, R. A., & Fyfe, J. J. (1998). Deployment of violence: The Los Angeles Police Department’s use of dogs. Evaluation Review, 22, 535–565.
• Eliott, D. S., Huizinga, D., & Menard, S. (1989). Multiple problem youth: Delinquency, substance use, and mental health problems. New York: Springer-Verlag.
• Ezell, M. E., & Cohen, L. E. (2005). Desisting from crime: Continuity and change in long-term patterns of serious chronic offenders. Oxford, UK: Oxford University Press.
• Fox, J. A. (Ed.). (1981). Models in quantitative criminology. New York: Academic Press.
• Greenberg, D. F. (1979). Mathematical criminology. New Brunswick, NJ: Rutgers University Press.
• Haviland, A. M., & Nagin, D. S. (2005). Causal inferences with group based trajectory models. Psychometrika, 70, 1–22.
• Johnston, L. D., O’Malley, P. M., Bachman, J. G., & Schulenberg, J. E. (2007). Monitoring the Future national survey results on drug use, 1975–2006. Bethesda, MD: National Institute on Drug Abuse.
• Klick, J., & Tabarrok, A. (2005). Using terror alert levels to estimate the effect of police on crime. Journal of Law and Economics, 48, 267–279.
• Land, K. C. (1992). Models of criminal careers: Some suggestions for moving beyond the current debate. Criminology, 30, 149–155.
• Langan, P. A., & Levin, D. J. (2002). Recidivism of prisoners released in 1994. Washington, DC: Bureau of Justice Statistics.
• Laub, J. H., & Sampson, R. J. (2003). Shared beginnings, divergent lives: Delinquent boys to age 70. Cambridge, MA: Harvard University Press.
• Loftin, C., McDowall, D., Wiersema, B., & Cottey, T. J. (1991). Effects of restrictive licensing of handguns on homicide and suicide in the District of Columbia. New England Journal of Medicine, 325, 1615–1620.
• Maltz, M. D. (1984). Recidivism. New York: Academic Press.
• Mulvey, E. P., Steinberg, L. D., Fagan, J., Cauffman, E., Piquero, A. R., Chassin, L., et al. (2004). Theory and research on desistance from antisocial activity among serious adolescent offenders. Youth Violence and Juvenile Justice, 2, 213–236.
• Nagin, D. S. (2005). Group-based modeling of development. Cambridge, MA: Harvard University Press.
• Osgood, D. W. (2000). Poisson-based regression analysis of aggregate crime rates. Journal of Quantitative Criminology, 16, 21–43.
• Osgood, D.W., & Rowe, D. C. (1994). Bridging criminal careers, theory, and policy through latent variable models of individual offending. Criminology, 32, 517–554.
• Piquero, A. R., Farrington, D. P., & Blumstein, A. (2007). Key issues in criminal career research. New York: Cambridge University Press.
• Rubin, D. B. (2006). Matched sampling for causal effects. New York: Cambridge University Press.
• Sampson, R. J., & Laub, J. H. (1993). Crime in the making: Pathways and turning points through life. Cambridge, MA: Harvard University Press.
• Schmidt, P., & Witte, A. D. (1984). An economic analysis of crime and justice. Orlando, FL: Academic Press.
• Thornberry, T. P., & Krohn, M. D. (Eds.). (2003). Taking stock of delinquency: An overview of findings from contemporary longitudinal studies. New York: Plenum Press.
• Tracy, P., & Kempf-Leonard, K. (1996). Continuity and discontinuity in criminal careers. New York: Plenum Press.
• Widom, C. S. (1989, April 14). The cycle of violence. Science, 244, 160–166.
• Wolfgang, M. E., Figlio, R. M., & Sellin, T. (1972). Delinquency in a birth cohort. Chicago: University of Chicago Press.

Advertisement

Mixed Methods Research in Criminology and Criminal Justice: a Systematic Review

• Published: 07 January 2021
• Volume 47 , pages 526–546, ( 2022 )

Cite this article

• Nicole Wilkes 1 ,
• Valerie R. Anderson 1 ,
• Cheryl Laura Johnson 2 &
• Lillian Mae Bedell 1  

3373 Accesses

8 Citations

7 Altmetric

Explore all metrics

The field of criminology and criminal justice encompass broad and complex multidisciplinary topics. Most of the research that falls under these areas uses either quantitative or qualitative methodologies, with historically limited use of mixed methods designs. Research utilizing mixed methods has increased within the social sciences in recent years, including a steadily growing body of mixed method research in criminal justice and criminology. The goal of this study was to examine how mixed method designs are being employed within research related to criminal justice and criminology. Our systematic review located 327 mixed method articles published between 2001 and 2017. Findings indicated most criminology and criminal justice research is being conducted within the specialty area of victimology. This study provides an overview of mixed methods research in criminology and criminal justice and also illustrates that most publications are not including methodological concepts specific to mixed methods research (e.g., integration). Along with our systematic review, we offer a series of recommendations to move mixed methods research forward in criminology and criminal justice.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price includes VAT (Russian Federation)

Instant access to the full article PDF.

Rent this article via DeepDyve

Institutional subscriptions

Similar content being viewed by others

The Trustworthiness of Content Analysis

The Social Learning Theory of Crime and Deviance

Labeling theory.

Aarons, G. A., Fettes, D. L., Sommerfeld, D. H., & Palinkas, L. A. (2012). Mixed methods for implementation research: Application to evidence-based practice implementation and staff turnover in community-based organizations providing child welfare services. Child Maltreatment, 17 (1), 67–79.

Article   Google Scholar  

Anderson, E. (1999). Code of the street: Decency, violence, and the moral life of the inner city . New York: W. W. Norton & Company.

Google Scholar  

Anderson, V. R. (2015). Introduction to mixed methods approaches. In L. A. Jason & D. S. Glenwick (Eds.), Handbook of methodological approaches to community-based research: Qualitative, quantitative, and mixed methods (pp. 233–241). New York: Oxford University Press.

Chapter   Google Scholar  

Bazeley, P. (2018). Integrating analyses in mixed methods research . Thousand Oaks, CA: Sage.

Book   Google Scholar  

Brent, J. J., & Kraska, P. B. (2010). Moving beyond our methodological default: A case for mixed methods. Journal of Criminal Justice Education, 21 (4), 412–430.

Bryman, A. (1988). Quantity and quality in social research . London: Routledge.

Buckler, K. (2008). The quantitative/qualitative divide revisited: A study of published research, doctoral program curricula, and journal editor perceptions. Journal of Criminal Justice Education, 19 (3), 383–403.

Burrell, N. A., & Gross, C. (2018). Quantitative research, purpose of. In M. Allen (Ed.), The SAGE Encyclopedia of Communication Research Methods (pp. 1378–1380). Los Angeles: SAGE.

Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56 (2), 81–105. https://doi.org/10.1037/h0046016 .

Campbell, R., Fehler-Cabral, G., Bybee, D., & Shaw, J. (2017). Forgotten evidence: A mixed methods study of why sexual assault kits (SAKs) are not submitted for DNA forensic testing. Law and Human Behavior, 41 (5), 454–467.

Campbell, R., Goodman-Williams, R., Feeney, H., & Fehler-Cabral, G. (2020). Assessing triangulation across methodologies, methods, and stakeholder groups: The joys, woes, and politics of interpreting convergent and divergent data. American Journal of Evaluation, 41 (1), 125–144.

Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 1 , 37–46.

Copes, H., Beaton, B., Ayeni, D., Dabney, D., & Tewksbury, R. (2020). A content analysis of qualitative research published in top criminology and criminal justice journals from 2010 to 2019. American Journal of Criminal Justice, 45 , 1060–1079. https://doi.org/10.1007/s12103-020-09540-6 .

Copes, H., Brown, A., & Tewksbury, R. (2011). A content analysis of ethnographic research published in top criminology and criminal justice journals from 2000 to 2009. Journal of Criminal Justice Education, 22 (3), 341–359.

Creswell, J. W. (2009). Research design: Qualitative, quantitative, and mixed methods approaches (3rd ed.). Los Angeles: Sage.

Creswell, J. W. (2013). Qualitative inquiry & research design: Choosing among five approaches (3rd ed.). Sage.

Creswell, J. W., Klassen, A. C., & Plano Clark, V. L. (2011). Best practices for mixed methods research in the health sciences . Washington, DC: National Institute for Health https://www.obssr.od.nih.gov/wp-content/uploads/2018/01/Best-Practices-for-Mixed-Methods-Research-in-the-Health-Sciences-2018-01-25.pdf .

Creswell, J. W., & Plano Clark, V. L. (2018). Designing and conducting mixed methods research (3rd ed.). Thousand Oaks, CA: Sage.

Crow, M. S., & Smykla, J. O. (2013). A mixed methods analysis of methodological orientation in national and regional criminology and criminal justice journals. Journal of Criminal Justice Education, 24 (4), 536–555.

Culbert, G. J., Bazazi, A. R., Waluyo, A., Murni, A., Muchransyah, A. P., Iriyanti, M., Finnahari, Polonsky, M., Levy, J., & Altice, F. L. (2016). The influence of medication attitudes on utilization of antiretroviral therapy (ART) in Indonesian prisons. AIDS and Behavior, 20 (5), 1026–1038.

Curry, L., & Nunez-Smith, M. (2015). Mixed methods in health sciences research: A practical primer . Thousand Oaks, CA: Sage.

Denzin, N. (1978). Sociological methods . New York, NY: McGraw-Hill.

Eadie, D., MacAskill, S., McKell, J., & Baybutt, M. (2012). Barriers and facilitators to a criminal justice tobacco control coordinator: An innovative approach to supporting smoking cessation among offenders. Addiction, 107 (2), 26–38.

European Commission JRC. (2007). Quantitative versus qualitative methods. Retrieved from http://forlearn.jrc.ec.europa.eu/guide/4_methodology/meth_quanti-quali.htm .

Fàbregues, S., & Molina-Azorín, J. F. (2017). Addressing quality in mixed methods research: A review and recommendations for a future agenda. Quality and Quantity, 51 , 2847–2863.

Greene, J. C., & Caracelli, V. J. (Eds.). (1997). Advances in mixed-method evaluation: The challenges and benefits of integrating diverse paradigms: New directions for evaluation, 74 . San Francisco: Jossey-Bass.

Greene, J. C., Caracelli, V. J., & Graham, W. F. (1989). Toward a conceptual framework for mixed-method evaluation designs. Educational Evaluation and Policy Analysis, 11 (3), 255–274.

Hart, L. C., Smith, S. Z., Swars, S. L., & Smith, M. E. (2009). An examination of research methods in mathematics education (1995–2005). Journal of Mixed Methods Research, 3 (1), 26–41.

Heap, V., & Waters, J. (2019). Mixed methods in criminology . Routledge.

Hesse-Biber, S., & Johnson, R. B. (2013). Coming at things differently: Future directions of possible engagement with mixed methods research [Editorial]. Journal of Mixed Methods Research, 7 (2), 103–109.

Hovey, A., Rye, B. J., & Stalker, C. A. (2013). Factors influencing perceptions of abuse victims: Do therapists’ beliefs about sexual offending affect counseling practices with women? Journal of Child Sexual Abuse, 22 , 572–592.

Hovey, A., Stalker, C. A., & Rye, B. J. (2014). Perpetrators of sexual abuse and considerations for treatment. Asking women survivors about thoughts or actions involving sex with children: An issue requiring therapist sensitivity. Journal of Child Sexual Abuse, 23 , 442–461.

Howe, K. R. (2016). Against the quantitative-qualitative incompatibility thesis or dogmas die hard. Educational Researcher, 17 (8), 10–16.

Howell Smith, M. C., & Shanahan Bazis, P. (2020). Conducting mixed methods research systematic methodological reviews: A review of practice and recommendations. Journal of Mixed Methods Research . https://doi.org/10.1177/1558689820967626 .

Islam, F., & Oremus, M. (2014). Mixed methods immigrant mental health research in Canada: A systematic review. Journal of Immigrant Minority Health, 16 , 1284–1289.

Johnson, R. B., & Onwuegbuzie, A. J. (2004). Mixed methods research: A research paradigm whose time has come. Educational Researcher, 33 (7), 14–26.

Johnson, R. B., Onwuegbuzie, A. J., & Turner, L. A. (2007). Toward a definition of mixed methods research. Journal of Mixed Methods Research, 1 (2), 112–133.

Kleck, G., Tark, J., & Bellows, J. J. (2006). What methods are most frequently used in research in criminology and criminal justice? Journal of Criminal Justice, 34 , 147–152.

Maruna, S. (2009). Mixed method research in criminology: Why not go both ways? In A. R. Piquero & D. Weisburd (Eds.), Handbook of Quantitative Criminology (pp. 123–140). New York: Springer.

Miller, H. V., Miller, J. M., & Barnes, J. C. (2016). Reentry programming for opioid and opiate involved female offenders: Findings from a mixed methods evaluation. Journal of Criminal Justice, 46 , 129–136.

Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Medicine, 6 (7), 1–6.

Molina-Azorin, J. F., & Fetters, M. D. (2016). Mixed methods research prevalence studies: Field-specific studies on the state of the art of mixed methods research. Journal of Mixed Methods Research, 10 (2), 123–128. https://doi.org/10.1177/155868981663670 .

Plano Clark, V. L., & Ivankova, N. V. (2016). Mixed methods research: A guide to the field . Thousand Oaks, CA: Sage.

Shaw, C. R. (1966). The jack-roller: A delinquent boy’s own story . University of Chicago Press.

Sullivan, C. J., & Maxfield, M. G. (2003). Examining paradigmatic development in criminology and criminal justice: A content analysis of research methods syllabi in doctoral programs. Journal of Criminal Justice Education, 14 (2), 269–285.

Tashakkori, A., & Creswell, J. W. (2007). The new era of mixed methods [editorial]. Journal of Mixed Methods Research, 1 (3), 207–211.

Tashakkori, A., & Teddlie, C. (1998). Mixed methodology: Combining qualitative and quantitative approaches . Thousand Oaks, CA: Sage.

Testa, M., Livingston, J. A., & Vanzile-Tamsen, C. (2011). Advancing the study of violence against women using mixed methods: Integrating qualitative methods into a quantitative research program. Violence Against Women, 17 (2), 236–250.

Tewksbury, R., DeMichele, M. T., & Miller, J. M. (2005). Methodological orientations of articles appearing in criminal justice’s top journals: Who publishes what and where. Journal of Criminal Justice Education, 16 (2), 265–279.

Tewksbury, R., Dabney, D. A., & Copes, H. (2010). The prominence of qualitative research in criminology and criminal justice scholarship. Journal of Criminal Justice Education, 21 , 391–411.

Wright, R. T., & Decker, S. H. (1997). Armed robbers in action: Stickups and street culture . Boston: Northeastern University Press.

Download references

Acknowledgements

We greatly appreciate Christina Poole’s assistance with coding.

Author information

Authors and affiliations.

Teachers-Dyer Complex, School of Criminal Justice, University of Cincinnati, 2610 McMicken Circle, Cincinnati, OH, 45221, USA

Nicole Wilkes, Valerie R. Anderson & Lillian Mae Bedell

Department of Sociology, Hartwick College, P.O. Box 4022, Oneonta, NY, 13820, USA

Cheryl Laura Johnson

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to Nicole Wilkes .

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

(DOCX 38 kb)

Rights and permissions

Reprints and permissions

About this article

Wilkes, N., Anderson, V.R., Johnson, C.L. et al. Mixed Methods Research in Criminology and Criminal Justice: a Systematic Review. Am J Crim Just 47 , 526–546 (2022). https://doi.org/10.1007/s12103-020-09593-7

Download citation

Received : 17 August 2020

Accepted : 13 November 2020

Published : 07 January 2021

Issue Date : June 2022

DOI : https://doi.org/10.1007/s12103-020-09593-7

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Mixed methods
• Methodology
• Criminal justice
• Criminology
• Find a journal
• Publish with us
• Track your research

• My library record
• ANU Library
• new production templates

Criminology

Research methodologies.

• Dictionaries
• Encyclopedias
• Books and e-books
• Journals and e-journals
• Audio-visual resources
• Sample ANU Theses
• Associations and Societies
• Domain names
• Open Educational Resources
• Requesting resources

A research methodology describes the specific process used to collect and evaluate information and data. This may involve a variety of qualitative and quantative techniques such as surveys, interviews, experiments, measurement and statistics, and publication research. The texts below are a selection of titles that may help you to design your own research methodology.

• << Previous: Audio-visual resources
• Next: Statistics >>
• Last Updated: May 13, 2024 4:17 PM
• URL: https://libguides.anu.edu.au/criminology

Responsible Officer: University Librarian / Page Contact: Library Systems & Web Coordinator

• Contact ANU
• Freedom of Information

+61 2 6125 5111 The Australian National University, Canberra CRICOS Provider : 00120C ABN : 52 234 063 906

The Importance of Research Methods in Criminal Justice

By Dr. Jarrod Sadulski   |  01/31/2024

Research methods in criminal justice enable researchers to address some of the most pressing issues that affect our society. The criminal justice system is always evolving. It shifts to meet the ever-changing trends in crime and technology.

Criminal justice research provides policymakers and criminal justice leaders with up-to-date and relevant insight to answer many of the challenges that they face. For example, criminal justice research can lead to new policies and even case laws that guide law enforcement officers daily. Policy analysis is used to solve problems in crime and criminology.

I once attended a large conference by the International Association of Chiefs of Police where police leaders from around the world examined criminal justice and criminology. Research formed the backbone of many of the presentations I attended.

These presentations addressed the most pressing problems in modern-day policing and enabled leaders to make informed decisions. Research can influence policy through practical application in criminology and criminal justice.

The Research Process

To obtain information that can shape policies and laws, effective criminal justice research methods are essential. The research process typically involves quantitative, qualitative, or mixed methods research that go through a peer review process to validate the researcher’s findings.

Once that validation occurs, the research is viewed as credible and is ready to be presented to policymakers. Research methods are commonly guided through a theoretical framework in criminal justice. For example, a criminal justice researcher studying police stress may wish to apply Agnew's General Strain Theory to guide the research.

A researcher who may wish to study if someone's upbringing and environment contribute to whether they engage in criminality as an adult may apply a Social Learning theoretical framework. If someone is studying crime mapping, they may wish to apply a Routine Activity theoretical framework.

Research Designs

Effective research begins with a quality research design to address a research problem. The design typically involves:

• A sample that represents a population
• Research questions in qualitative research or hypotheses in quantitative research
• A problem statement
• A purpose statement

A research design of high quality is also important in criminal justice research, and the research design should be detailed. For instance, it should explain how a researcher will collect data from the sample, how the data will be analyzed, and how the researcher’s conclusions should answer the research questions or hypotheses.

Access to participants is vital. That access typically begins with obtaining permission to recruit from an organization, then sending recruitment material to willing participants such as students who are interested in criminal justice and criminology.

Qualitative Methods

In qualitative research interviews, field research, questionnaires, participant observation, case studies, focus groups, and non-experimental methods are common. In data analysis, thematic analysis is commonly used, which involves developing themes obtained through participant data.

Saturation is an important part of this type of work that involves developing themes that occur through each participant's responses. Data between participants and existing literature are triangulated to ensure that there are the same findings among the data collected.

In multiple case studies research, triangulation is used among each case study to draw conclusions. Interviews are common in multiple case studies research.

In qualitative data surveys, open-ended questions are commonly used to collect data. One limitation of this type of research is that rigor in research may be more difficult to demonstrate due to the lack of experimental analysis.

Quantitative Research

Quantitative research tends to be more experimental and involve a scientific method. Data collection through quantitative research may be descriptive and may be collected through self-report surveys. Survey research is a common way to collect data in quantitative research.

Quantitative data analysis often involves experimental tests that recognize relationships between variables. For example, survey research may involve sending surveys to participants who can answer with either yes/no answers or with numerical values that can be analyzed. This analysis may occur through t-tests , an analysis of variance (ANOVA) , and other statistical analyses.

Secondary Data Analysis

Secondary data analysis involves using existing research in past research. For example, data may be collected from a published national crime victimization survey or other past survey research.

Secondary research can be helpful in answering a new problem. Social science research involves conducting research to develop information from a study into various social or societal issues.

Various methods can be used in criminological research. Properly designed research methods are an important part of criminal justice research and are explained in the study.

To ensure reliability and validity, another researcher should be able to follow the same data collection to address a research question and should come to the same conclusions. Critical thinking is an important part of content analysis.

Evaluation research can be used by decision-makers in criminal justice because it evaluates the merit and effectiveness of a program or policy. Evaluation research can help decision-makers to understand the effectiveness of policies.

The Role of Students

Students have an important role in serving as researchers. They can aid in policy analysis by addressing a current problem and developing findings that can be published. While completing coursework, students can learn the skills of a researcher and the process of the Institutional Review Board .

Students are also critical consumers of research. They will view a research topic with great interest and can provide useful feedback to academics when needed.

Dr. Sadulski is an Associate Professor within our School of Security and Global Studies. He has over two decades in the field of criminal justice. His expertise includes training on countering human trafficking, maritime security, effective stress management in policing and narcotics trafficking trends in Latin America. Jarrod frequently conducts in-country research and consultant work in Central and South America on human trafficking and current trends in narcotics trafficking. He also has a background in business development. Jarrod can be reached through his website at www.Sadulski.com for more information.

• Call: 877-755-2787
• Email: [email protected]
• Chat: Live Chat

An official website of the United States government, Department of Justice.

Here's how you know

Official websites use .gov A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS A lock ( Lock A locked padlock ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

NCJRS Virtual Library

Quantitative studies in criminology, additional details.

2455 Teller Road , Thousand Oaks , CA 91320 , United States

No download available

Availability, related topics.

• Subject List
• Take a Tour
• For Authors
• Subscriber Services
• Publications
• African American Studies
• African Studies
• American Literature
• Anthropology
• Architecture Planning and Preservation
• Art History
• Atlantic History
• Biblical Studies
• British and Irish Literature
• Childhood Studies
• Chinese Studies
• Cinema and Media Studies
• Communication

Criminology

• Environmental Science
• Evolutionary Biology
• International Law
• International Relations
• Islamic Studies
• Jewish Studies
• Latin American Studies
• Latino Studies
• Linguistics
• Literary and Critical Theory
• Medieval Studies
• Military History
• Political Science
• Public Health
• Renaissance and Reformation
• Social Work
• Urban Studies
• Victorian Literature
• Browse All Subjects

How to Subscribe

• Free Trials

In This Article Expand or collapse the "in this article" section Qualitative Methods in Criminology

Introduction.

• Chicago School
• Mid-20th Century
• Current Status
• Qualitative Research and Life-Course Theory
• The Lived Experience of Crime
• The Lived Experience of Criminalization and Punishment
• The Law in Action
• Ethnography
• Interview-Based Studies
• Content Analysis
• Case Studies
• Focus Groups
• Qualitative Data Collection and Analysis
• Positivist versus Post-Positivist Approaches
• Inductive versus Deductive Approaches
• Cases and Generalizability
• Internal Validity
• Anthologies of Qualitative Research in Criminology
• Continued Challenges for Qualitative Research in Criminology

Related Articles Expand or collapse the "related articles" section about

About related articles close popup.

Lorem Ipsum Sit Dolor Amet

Vestibulum ante ipsum primis in faucibus orci luctus et ultrices posuere cubilia Curae; Aliquam ligula odio, euismod ut aliquam et, vestibulum nec risus. Nulla viverra, arcu et iaculis consequat, justo diam ornare tellus, semper ultrices tellus nunc eu tellus.

• Active Offender Research
• Critical Criminology
• Measuring Crime
• Narrative Criminology
• Self-Report Crime Surveys
• Snitching and Use of Criminal Informants
• Street Code

Other Subject Areas

Forthcoming articles expand or collapse the "forthcoming articles" section.

• Education Programs in Prison
• Mixed Methods Research in Criminal Justice and Criminology
• Victim Impact Statements
• Find more forthcoming articles...
• Export Citations
• Share This Facebook LinkedIn Twitter

Qualitative Methods in Criminology by Jamie Fader LAST REVIEWED: 26 July 2017 LAST MODIFIED: 26 July 2017 DOI: 10.1093/obo/9780195396607-0225

Qualitative research formed the basis of much of the early American criminological canon. In the mid-20th century, however, criminology took a decidedly quantitative turn with advanced analytical technology and increased federal funding for survey research. As criminology has fully embraced positivism, qualitative research has been generally marginalized and practicing scholars have struggled to publish or secure funding. Quantitative standards of evaluation are often incorrectly applied to qualitative work. In the last two decades, we have seen a re-emergence in qualitative research in criminology, accompanied by a new appreciation for its unique value for generating and refining theory, as well as documenting the lived experience of offending and criminal justice system involvement. The ascendance of the life-course paradigm is both a cause and consequence of the renewed status of qualitative research. Although qualitative researchers are enjoying a renaissance within the field of criminology, they also face serious obstacles erected by demands for increased speed and volume of publications, heavy reliance on seemingly objective metrics of publication quality, and human subjects concerns.

American criminology can trace its roots to University of Chicago Sociology Department, which produced several decades of urban research starting in the early 20th century known as the Chicago School tradition. Robert Ezra Park, one of the department’s founders and a former journalist, urged his students to leave the comforts of the university behind and engage directly in the surrounding communities, documenting social disorganization, community institutions, social inequality, gangs, and other forms of crime and vice.

back to top

Users without a subscription are not able to see the full content on this page. Please subscribe or login .

Oxford Bibliographies Online is available by subscription and perpetual access to institutions. For more information or to contact an Oxford Sales Representative click here .

• About Criminology »
• Meet the Editorial Board »
• Adler, Freda
• Adversarial System of Justice
• Adverse Childhood Experiences
• Aging Prison Population, The
• Airport and Airline Security
• Alcohol and Drug Prohibition
• Alcohol Use, Policy and Crime
• Alt-Right Gangs and White Power Youth Groups
• Animals, Crimes Against
• Back-End Sentencing and Parole Revocation
• Bail and Pretrial Detention
• Batterer Intervention Programs
• Bentham, Jeremy
• Big Data and Communities and Crime
• Biosocial Criminology
• Black's Theory of Law and Social Control
• Blumstein, Alfred
• Boot Camps and Shock Incarceration Programs
• Burglary, Residential
• Bystander Intervention
• Capital Punishment
• Chambliss, William
• Chicago School of Criminology, The
• Child Maltreatment
• Chinese Triad Society
• Civil Protection Orders
• Collateral Consequences of Felony Conviction and Imprisonm...
• Collective Efficacy
• Commercial and Bank Robbery
• Commercial Sexual Exploitation of Children
• Communicating Scientific Findings in the Courtroom
• Community Change and Crime
• Community Corrections
• Community Disadvantage and Crime
• Community-Based Justice Systems
• Community-Based Substance Use Prevention
• Comparative Criminal Justice Systems
• CompStat Models of Police Performance Management
• Confessions, False and Coerced
• Conservation Criminology
• Consumer Fraud
• Contextual Analysis of Crime
• Control Balance Theory
• Convict Criminology
• Co-Offending and the Role of Accomplices
• Corporate Crime
• Costs of Crime and Justice
• Courts, Drug
• Courts, Juvenile
• Courts, Mental Health
• Courts, Problem-Solving
• Crime and Justice in Latin America
• Crime, Campus
• Crime Control Policy
• Crime Control, Politics of
• Crime, (In)Security, and Islam
• Crime Prevention, Delinquency and
• Crime Prevention, Situational
• Crime Prevention, Voluntary Organizations and
• Crime Trends
• Crime Victims' Rights Movement
• Criminal Career Research
• Criminal Decision Making, Emotions in
• Criminal Justice Data Sources
• Criminal Justice Ethics
• Criminal Justice Fines and Fees
• Criminal Justice Reform, Politics of
• Criminal Justice System, Discretion in the
• Criminal Records
• Criminal Retaliation
• Criminal Talk
• Criminology and Political Science
• Criminology of Genocide, The
• Cross-National Crime
• Cross-Sectional Research Designs in Criminology and Crimin...
• Cultural Criminology
• Cultural Theories
• Cybercrime Investigations and Prosecutions
• Cycle of Violence
• Deadly Force
• Defense Counsel
• Defining "Success" in Corrections and Reentry
• Developmental and Life-Course Criminology
• Digital Piracy
• Driving and Traffic Offenses
• Drug Control
• Drug Trafficking, International
• Drugs and Crime
• Elder Abuse
• Electronically Monitored Home Confinement
• Employee Theft
• Environmental Crime and Justice
• Experimental Criminology
• Family Violence
• Fear of Crime and Perceived Risk
• Felon Disenfranchisement
• Feminist Theories
• Feminist Victimization Theories
• Fencing and Stolen Goods Markets
• Firearms and Violence
• Forensic Science
• For-Profit Private Prisons and the Criminal Justice–Indust...
• Gangs, Peers, and Co-offending
• Gender and Crime
• Gendered Crime Pathways
• General Opportunity Victimization Theories
• Genetics, Environment, and Crime
• Green Criminology
• Halfway Houses
• Harm Reduction and Risky Behaviors
• Hate Crime Legislation
• Healthcare Fraud
• Hirschi, Travis
• History of Crime in the United Kingdom
• History of Criminology
• Homelessness and Crime
• Homicide Victimization
• Honor Cultures and Violence
• Hot Spots Policing
• Human Rights
• Human Trafficking
• Identity Theft
• Immigration, Crime, and Justice
• Incarceration, Mass
• Incarceration, Public Health Effects of
• Income Tax Evasion
• Indigenous Criminology
• Institutional Anomie Theory
• Integrated Theory
• Intermediate Sanctions
• Interpersonal Violence, Historical Patterns of
• Interrogation
• Intimate Partner Violence, Criminological Perspectives on
• Intimate Partner Violence, Police Responses to
• Investigation, Criminal
• Juvenile Delinquency
• Juvenile Justice System, The
• Kornhauser, Ruth Rosner
• Labeling Theory
• Labor Markets and Crime
• Land Use and Crime
• Lead and Crime
• LGBTQ Intimate Partner Violence
• LGBTQ People in Prison
• Life Without Parole Sentencing
• Local Institutions and Neighborhood Crime
• Lombroso, Cesare
• Longitudinal Research in Criminology
• Mandatory Minimum Sentencing
• Mapping and Spatial Analysis of Crime, The
• Mass Media, Crime, and Justice
• Mediation and Dispute Resolution Programs
• Mental Health and Crime
• Merton, Robert K.
• Meta-analysis in Criminology
• Middle-Class Crime and Criminality
• Migrant Detention and Incarceration
• Mixed Methods Research in Criminology
• Money Laundering
• Motor Vehicle Theft
• Multi-Level Marketing Scams
• Murder, Serial
• National Deviancy Symposia, The
• Nature Versus Nurture
• Neighborhood Disorder
• Neutralization Theory
• New Penology, The
• Offender Decision-Making and Motivation
• Offense Specialization/Expertise
• Organized Crime
• Outlaw Motorcycle Clubs
• Panel Methods in Criminology
• Peacemaking Criminology
• Peer Networks and Delinquency
• Performance Measurement and Accountability Systems
• Personality and Trait Theories of Crime
• Persons with a Mental Illness, Police Encounters with
• Phenomenological Theories of Crime
• Plea Bargaining
• Police Administration
• Police Cooperation, International
• Police Discretion
• Police Effectiveness
• Police History
• Police Militarization
• Police Misconduct
• Police, Race and the
• Police Use of Force
• Police, Violence against the
• Policing and Law Enforcement
• Policing, Body-Worn Cameras and
• Policing, Broken Windows
• Policing, Community and Problem-Oriented
• Policing Cybercrime
• Policing, Evidence-Based
• Policing, Intelligence-Led
• Policing, Privatization of
• Policing, Proactive
• Policing, School
• Policing, Stop-and-Frisk
• Policing, Third Party
• Polyvictimization
• Positivist Criminology
• Pretrial Detention, Alternatives to
• Pretrial Diversion
• Prison Administration
• Prison Classification
• Prison, Disciplinary Segregation in
• Prison Education Exchange Programs
• Prison Gangs and Subculture
• Prison History
• Prison Labor
• Prison Visitation
• Prisoner Reentry
• Prisons and Jails
• Prisons, HIV in
• Private Security
• Probation Revocation
• Procedural Justice
• Property Crime
• Prosecution and Courts
• Prostitution
• Psychiatry, Psychology, and Crime: Historical and Current ...
• Psychology and Crime
• Public Criminology
• Public Opinion, Crime and Justice
• Public Order Crimes
• Public Social Control and Neighborhood Crime
• Punishment Justification and Goals
• Qualitative Methods in Criminology
• Queer Criminology
• Race and Sentencing Research Advancements
• Race, Ethnicity, Crime, and Justice
• Racial Threat Hypothesis
• Racial Profiling
• Rape and Sexual Assault
• Rape, Fear of
• Rational Choice Theories
• Rehabilitation
• Religion and Crime
• Restorative Justice
• Risk Assessment
• Routine Activity Theories
• School Bullying
• School Crime and Violence
• School Safety, Security, and Discipline
• Search Warrants
• Seasonality and Crime
• Self-Control, The General Theory:
• Sentencing Enhancements
• Sentencing, Evidence-Based
• Sentencing Guidelines
• Sentencing Policy
• Sex Offender Policies and Legislation
• Sex Trafficking
• Sexual Revictimization
• Situational Action Theory
• Social and Intellectual Context of Criminology, The
• Social Construction of Crime, The
• Social Control of Tobacco Use
• Social Control Theory
• Social Disorganization
• Social Ecology of Crime
• Social Learning Theory
• Social Networks
• Social Threat and Social Control
• Solitary Confinement
• South Africa, Crime and Justice in
• Sport Mega-Events Security
• Stalking and Harassment
• State Crime
• State Dependence and Population Heterogeneity in Theories ...
• Strain Theories
• Street Robbery
• Substance Use and Abuse
• Surveillance, Public and Private
• Sutherland, Edwin H.
• Technology and the Criminal Justice System
• Technology, Criminal Use of
• Terrorism and Hate Crime
• Terrorism, Criminological Explanations for
• Testimony, Eyewitness
• Therapeutic Jurisprudence
• Trajectory Methods in Criminology
• Transnational Crime
• Truth-In-Sentencing
• Urban Politics and Crime
• US War on Terrorism, Legal Perspectives on the
• Victimization, Adolescent
• Victimization, Biosocial Theories of
• Victimization Patterns and Trends
• Victimization, Repeat
• Victimization, Vicarious and Related Forms of Secondary Tr...
• Victimless Crime
• Victim-Offender Overlap, The
• Violence Against Women
• Violence, Youth
• Violent Crime
• White-Collar Crime
• White-Collar Crime, The Global Financial Crisis and
• White-Collar Crime, Women and
• Wilson, James Q.
• Wolfgang, Marvin
• Women, Girls, and Reentry
• Wrongful Conviction
• Privacy Policy
• Cookie Policy
• Legal Notice
• Accessibility

Powered by:

• [66.249.64.20|81.177.182.159]
• 81.177.182.159