• Brain Development
  • Childhood & Adolescence
  • Diet & Lifestyle
  • Emotions, Stress & Anxiety
  • Learning & Memory
  • Thinking & Awareness
  • Alzheimer's & Dementia
  • Childhood Disorders
  • Immune System Disorders
  • Mental Health
  • Neurodegenerative Disorders
  • Infectious Disease
  • Neurological Disorders A-Z
  • Body Systems
  • Cells & Circuits
  • Genes & Molecules
  • The Arts & the Brain
  • Law, Economics & Ethics
  • Neuroscience in the News
  • Supporting Research
  • Tech & the Brain
  • Animals in Research
  • BRAIN Initiative
  • Meet the Researcher
  • Neuro-technologies
  • Tools & Techniques
  • Core Concepts
  • For Educators
  • Ask an Expert
  • The Brain Facts Book

BrainFacts.org

Test Your Problem-Solving Skills

Personalize your emails.

Personalize your monthly updates from BrainFacts.org by choosing the topics that you care about most!

Find a Neuroscientist

Engage local scientists to educate your community about the brain.

Image of the Week

Check out the Image of the Week Archive.

Facebook

SUPPORTING PARTNERS

Dana Foundation logo

  • Privacy Policy
  • Accessibility Policy
  • Terms and Conditions
  • Manage Cookies

Some pages on this website provide links that require Adobe Reader to view.

7.3 Problem-Solving

Learning objectives.

By the end of this section, you will be able to:

  • Describe problem solving strategies
  • Define algorithm and heuristic
  • Explain some common roadblocks to effective problem solving

   People face problems every day—usually, multiple problems throughout the day. Sometimes these problems are straightforward: To double a recipe for pizza dough, for example, all that is required is that each ingredient in the recipe be doubled. Sometimes, however, the problems we encounter are more complex. For example, say you have a work deadline, and you must mail a printed copy of a report to your supervisor by the end of the business day. The report is time-sensitive and must be sent overnight. You finished the report last night, but your printer will not work today. What should you do? First, you need to identify the problem and then apply a strategy for solving the problem.

The study of human and animal problem solving processes has provided much insight toward the understanding of our conscious experience and led to advancements in computer science and artificial intelligence. Essentially much of cognitive science today represents studies of how we consciously and unconsciously make decisions and solve problems. For instance, when encountered with a large amount of information, how do we go about making decisions about the most efficient way of sorting and analyzing all the information in order to find what you are looking for as in visual search paradigms in cognitive psychology. Or in a situation where a piece of machinery is not working properly, how do we go about organizing how to address the issue and understand what the cause of the problem might be. How do we sort the procedures that will be needed and focus attention on what is important in order to solve problems efficiently. Within this section we will discuss some of these issues and examine processes related to human, animal and computer problem solving.

PROBLEM-SOLVING STRATEGIES

   When people are presented with a problem—whether it is a complex mathematical problem or a broken printer, how do you solve it? Before finding a solution to the problem, the problem must first be clearly identified. After that, one of many problem solving strategies can be applied, hopefully resulting in a solution.

Problems themselves can be classified into two different categories known as ill-defined and well-defined problems (Schacter, 2009). Ill-defined problems represent issues that do not have clear goals, solution paths, or expected solutions whereas well-defined problems have specific goals, clearly defined solutions, and clear expected solutions. Problem solving often incorporates pragmatics (logical reasoning) and semantics (interpretation of meanings behind the problem), and also in many cases require abstract thinking and creativity in order to find novel solutions. Within psychology, problem solving refers to a motivational drive for reading a definite “goal” from a present situation or condition that is either not moving toward that goal, is distant from it, or requires more complex logical analysis for finding a missing description of conditions or steps toward that goal. Processes relating to problem solving include problem finding also known as problem analysis, problem shaping where the organization of the problem occurs, generating alternative strategies, implementation of attempted solutions, and verification of the selected solution. Various methods of studying problem solving exist within the field of psychology including introspection, behavior analysis and behaviorism, simulation, computer modeling, and experimentation.

A problem-solving strategy is a plan of action used to find a solution. Different strategies have different action plans associated with them (table below). For example, a well-known strategy is trial and error. The old adage, “If at first you don’t succeed, try, try again” describes trial and error. In terms of your broken printer, you could try checking the ink levels, and if that doesn’t work, you could check to make sure the paper tray isn’t jammed. Or maybe the printer isn’t actually connected to your laptop. When using trial and error, you would continue to try different solutions until you solved your problem. Although trial and error is not typically one of the most time-efficient strategies, it is a commonly used one.

   Another type of strategy is an algorithm. An algorithm is a problem-solving formula that provides you with step-by-step instructions used to achieve a desired outcome (Kahneman, 2011). You can think of an algorithm as a recipe with highly detailed instructions that produce the same result every time they are performed. Algorithms are used frequently in our everyday lives, especially in computer science. When you run a search on the Internet, search engines like Google use algorithms to decide which entries will appear first in your list of results. Facebook also uses algorithms to decide which posts to display on your newsfeed. Can you identify other situations in which algorithms are used?

A heuristic is another type of problem solving strategy. While an algorithm must be followed exactly to produce a correct result, a heuristic is a general problem-solving framework (Tversky & Kahneman, 1974). You can think of these as mental shortcuts that are used to solve problems. A “rule of thumb” is an example of a heuristic. Such a rule saves the person time and energy when making a decision, but despite its time-saving characteristics, it is not always the best method for making a rational decision. Different types of heuristics are used in different types of situations, but the impulse to use a heuristic occurs when one of five conditions is met (Pratkanis, 1989):

  • When one is faced with too much information
  • When the time to make a decision is limited
  • When the decision to be made is unimportant
  • When there is access to very little information to use in making the decision
  • When an appropriate heuristic happens to come to mind in the same moment

Working backwards is a useful heuristic in which you begin solving the problem by focusing on the end result. Consider this example: You live in Washington, D.C. and have been invited to a wedding at 4 PM on Saturday in Philadelphia. Knowing that Interstate 95 tends to back up any day of the week, you need to plan your route and time your departure accordingly. If you want to be at the wedding service by 3:30 PM, and it takes 2.5 hours to get to Philadelphia without traffic, what time should you leave your house? You use the working backwards heuristic to plan the events of your day on a regular basis, probably without even thinking about it.

Another useful heuristic is the practice of accomplishing a large goal or task by breaking it into a series of smaller steps. Students often use this common method to complete a large research project or long essay for school. For example, students typically brainstorm, develop a thesis or main topic, research the chosen topic, organize their information into an outline, write a rough draft, revise and edit the rough draft, develop a final draft, organize the references list, and proofread their work before turning in the project. The large task becomes less overwhelming when it is broken down into a series of small steps.

Further problem solving strategies have been identified (listed below) that incorporate flexible and creative thinking in order to reach solutions efficiently.

Additional Problem Solving Strategies :

  • Abstraction – refers to solving the problem within a model of the situation before applying it to reality.
  • Analogy – is using a solution that solves a similar problem.
  • Brainstorming – refers to collecting an analyzing a large amount of solutions, especially within a group of people, to combine the solutions and developing them until an optimal solution is reached.
  • Divide and conquer – breaking down large complex problems into smaller more manageable problems.
  • Hypothesis testing – method used in experimentation where an assumption about what would happen in response to manipulating an independent variable is made, and analysis of the affects of the manipulation are made and compared to the original hypothesis.
  • Lateral thinking – approaching problems indirectly and creatively by viewing the problem in a new and unusual light.
  • Means-ends analysis – choosing and analyzing an action at a series of smaller steps to move closer to the goal.
  • Method of focal objects – putting seemingly non-matching characteristics of different procedures together to make something new that will get you closer to the goal.
  • Morphological analysis – analyzing the outputs of and interactions of many pieces that together make up a whole system.
  • Proof – trying to prove that a problem cannot be solved. Where the proof fails becomes the starting point or solving the problem.
  • Reduction – adapting the problem to be as similar problems where a solution exists.
  • Research – using existing knowledge or solutions to similar problems to solve the problem.
  • Root cause analysis – trying to identify the cause of the problem.

The strategies listed above outline a short summary of methods we use in working toward solutions and also demonstrate how the mind works when being faced with barriers preventing goals to be reached.

One example of means-end analysis can be found by using the Tower of Hanoi paradigm . This paradigm can be modeled as a word problems as demonstrated by the Missionary-Cannibal Problem :

Missionary-Cannibal Problem

Three missionaries and three cannibals are on one side of a river and need to cross to the other side. The only means of crossing is a boat, and the boat can only hold two people at a time. Your goal is to devise a set of moves that will transport all six of the people across the river, being in mind the following constraint: The number of cannibals can never exceed the number of missionaries in any location. Remember that someone will have to also row that boat back across each time.

Hint : At one point in your solution, you will have to send more people back to the original side than you just sent to the destination.

The actual Tower of Hanoi problem consists of three rods sitting vertically on a base with a number of disks of different sizes that can slide onto any rod. The puzzle starts with the disks in a neat stack in ascending order of size on one rod, the smallest at the top making a conical shape. The objective of the puzzle is to move the entire stack to another rod obeying the following rules:

  • 1. Only one disk can be moved at a time.
  • 2. Each move consists of taking the upper disk from one of the stacks and placing it on top of another stack or on an empty rod.
  • 3. No disc may be placed on top of a smaller disk.

problem solving test in psychology

  Figure 7.02. Steps for solving the Tower of Hanoi in the minimum number of moves when there are 3 disks.

problem solving test in psychology

Figure 7.03. Graphical representation of nodes (circles) and moves (lines) of Tower of Hanoi.

The Tower of Hanoi is a frequently used psychological technique to study problem solving and procedure analysis. A variation of the Tower of Hanoi known as the Tower of London has been developed which has been an important tool in the neuropsychological diagnosis of executive function disorders and their treatment.

GESTALT PSYCHOLOGY AND PROBLEM SOLVING

As you may recall from the sensation and perception chapter, Gestalt psychology describes whole patterns, forms and configurations of perception and cognition such as closure, good continuation, and figure-ground. In addition to patterns of perception, Wolfgang Kohler, a German Gestalt psychologist traveled to the Spanish island of Tenerife in order to study animals behavior and problem solving in the anthropoid ape.

As an interesting side note to Kohler’s studies of chimp problem solving, Dr. Ronald Ley, professor of psychology at State University of New York provides evidence in his book A Whisper of Espionage  (1990) suggesting that while collecting data for what would later be his book  The Mentality of Apes (1925) on Tenerife in the Canary Islands between 1914 and 1920, Kohler was additionally an active spy for the German government alerting Germany to ships that were sailing around the Canary Islands. Ley suggests his investigations in England, Germany and elsewhere in Europe confirm that Kohler had served in the German military by building, maintaining and operating a concealed radio that contributed to Germany’s war effort acting as a strategic outpost in the Canary Islands that could monitor naval military activity approaching the north African coast.

While trapped on the island over the course of World War 1, Kohler applied Gestalt principles to animal perception in order to understand how they solve problems. He recognized that the apes on the islands also perceive relations between stimuli and the environment in Gestalt patterns and understand these patterns as wholes as opposed to pieces that make up a whole. Kohler based his theories of animal intelligence on the ability to understand relations between stimuli, and spent much of his time while trapped on the island investigation what he described as  insight , the sudden perception of useful or proper relations. In order to study insight in animals, Kohler would present problems to chimpanzee’s by hanging some banana’s or some kind of food so it was suspended higher than the apes could reach. Within the room, Kohler would arrange a variety of boxes, sticks or other tools the chimpanzees could use by combining in patterns or organizing in a way that would allow them to obtain the food (Kohler & Winter, 1925).

While viewing the chimpanzee’s, Kohler noticed one chimp that was more efficient at solving problems than some of the others. The chimp, named Sultan, was able to use long poles to reach through bars and organize objects in specific patterns to obtain food or other desirables that were originally out of reach. In order to study insight within these chimps, Kohler would remove objects from the room to systematically make the food more difficult to obtain. As the story goes, after removing many of the objects Sultan was used to using to obtain the food, he sat down ad sulked for a while, and then suddenly got up going over to two poles lying on the ground. Without hesitation Sultan put one pole inside the end of the other creating a longer pole that he could use to obtain the food demonstrating an ideal example of what Kohler described as insight. In another situation, Sultan discovered how to stand on a box to reach a banana that was suspended from the rafters illustrating Sultan’s perception of relations and the importance of insight in problem solving.

Grande (another chimp in the group studied by Kohler) builds a three-box structure to reach the bananas, while Sultan watches from the ground.  Insight , sometimes referred to as an “Ah-ha” experience, was the term Kohler used for the sudden perception of useful relations among objects during problem solving (Kohler, 1927; Radvansky & Ashcraft, 2013).

Solving puzzles.

   Problem-solving abilities can improve with practice. Many people challenge themselves every day with puzzles and other mental exercises to sharpen their problem-solving skills. Sudoku puzzles appear daily in most newspapers. Typically, a sudoku puzzle is a 9×9 grid. The simple sudoku below (see figure) is a 4×4 grid. To solve the puzzle, fill in the empty boxes with a single digit: 1, 2, 3, or 4. Here are the rules: The numbers must total 10 in each bolded box, each row, and each column; however, each digit can only appear once in a bolded box, row, and column. Time yourself as you solve this puzzle and compare your time with a classmate.

How long did it take you to solve this sudoku puzzle? (You can see the answer at the end of this section.)

   Here is another popular type of puzzle (figure below) that challenges your spatial reasoning skills. Connect all nine dots with four connecting straight lines without lifting your pencil from the paper:

Did you figure it out? (The answer is at the end of this section.) Once you understand how to crack this puzzle, you won’t forget.

   Take a look at the “Puzzling Scales” logic puzzle below (figure below). Sam Loyd, a well-known puzzle master, created and refined countless puzzles throughout his lifetime (Cyclopedia of Puzzles, n.d.).

A puzzle involving a scale is shown. At the top of the figure it reads: “Sam Loyds Puzzling Scales.” The first row of the puzzle shows a balanced scale with 3 blocks and a top on the left and 12 marbles on the right. Below this row it reads: “Since the scales now balance.” The next row of the puzzle shows a balanced scale with just the top on the left, and 1 block and 8 marbles on the right. Below this row it reads: “And balance when arranged this way.” The third row shows an unbalanced scale with the top on the left side, which is much lower than the right side. The right side is empty. Below this row it reads: “Then how many marbles will it require to balance with that top?”

What steps did you take to solve this puzzle? You can read the solution at the end of this section.

Pitfalls to problem solving.

   Not all problems are successfully solved, however. What challenges stop us from successfully solving a problem? Albert Einstein once said, “Insanity is doing the same thing over and over again and expecting a different result.” Imagine a person in a room that has four doorways. One doorway that has always been open in the past is now locked. The person, accustomed to exiting the room by that particular doorway, keeps trying to get out through the same doorway even though the other three doorways are open. The person is stuck—but she just needs to go to another doorway, instead of trying to get out through the locked doorway. A mental set is where you persist in approaching a problem in a way that has worked in the past but is clearly not working now.

Functional fixedness is a type of mental set where you cannot perceive an object being used for something other than what it was designed for. During the Apollo 13 mission to the moon, NASA engineers at Mission Control had to overcome functional fixedness to save the lives of the astronauts aboard the spacecraft. An explosion in a module of the spacecraft damaged multiple systems. The astronauts were in danger of being poisoned by rising levels of carbon dioxide because of problems with the carbon dioxide filters. The engineers found a way for the astronauts to use spare plastic bags, tape, and air hoses to create a makeshift air filter, which saved the lives of the astronauts.

   Researchers have investigated whether functional fixedness is affected by culture. In one experiment, individuals from the Shuar group in Ecuador were asked to use an object for a purpose other than that for which the object was originally intended. For example, the participants were told a story about a bear and a rabbit that were separated by a river and asked to select among various objects, including a spoon, a cup, erasers, and so on, to help the animals. The spoon was the only object long enough to span the imaginary river, but if the spoon was presented in a way that reflected its normal usage, it took participants longer to choose the spoon to solve the problem. (German & Barrett, 2005). The researchers wanted to know if exposure to highly specialized tools, as occurs with individuals in industrialized nations, affects their ability to transcend functional fixedness. It was determined that functional fixedness is experienced in both industrialized and nonindustrialized cultures (German & Barrett, 2005).

In order to make good decisions, we use our knowledge and our reasoning. Often, this knowledge and reasoning is sound and solid. Sometimes, however, we are swayed by biases or by others manipulating a situation. For example, let’s say you and three friends wanted to rent a house and had a combined target budget of $1,600. The realtor shows you only very run-down houses for $1,600 and then shows you a very nice house for $2,000. Might you ask each person to pay more in rent to get the $2,000 home? Why would the realtor show you the run-down houses and the nice house? The realtor may be challenging your anchoring bias. An anchoring bias occurs when you focus on one piece of information when making a decision or solving a problem. In this case, you’re so focused on the amount of money you are willing to spend that you may not recognize what kinds of houses are available at that price point.

The confirmation bias is the tendency to focus on information that confirms your existing beliefs. For example, if you think that your professor is not very nice, you notice all of the instances of rude behavior exhibited by the professor while ignoring the countless pleasant interactions he is involved in on a daily basis. Hindsight bias leads you to believe that the event you just experienced was predictable, even though it really wasn’t. In other words, you knew all along that things would turn out the way they did. Representative bias describes a faulty way of thinking, in which you unintentionally stereotype someone or something; for example, you may assume that your professors spend their free time reading books and engaging in intellectual conversation, because the idea of them spending their time playing volleyball or visiting an amusement park does not fit in with your stereotypes of professors.

Finally, the availability heuristic is a heuristic in which you make a decision based on an example, information, or recent experience that is that readily available to you, even though it may not be the best example to inform your decision . Biases tend to “preserve that which is already established—to maintain our preexisting knowledge, beliefs, attitudes, and hypotheses” (Aronson, 1995; Kahneman, 2011). These biases are summarized in the table below.

Were you able to determine how many marbles are needed to balance the scales in the figure below? You need nine. Were you able to solve the problems in the figures above? Here are the answers.

The first puzzle is a Sudoku grid of 16 squares (4 rows of 4 squares) is shown. Half of the numbers were supplied to start the puzzle and are colored blue, and half have been filled in as the puzzle’s solution and are colored red. The numbers in each row of the grid, left to right, are as follows. Row 1: blue 3, red 1, red 4, blue 2. Row 2: red 2, blue 4, blue 1, red 3. Row 3: red 1, blue 3, blue 2, red 4. Row 4: blue 4, red 2, red 3, blue 1.The second puzzle consists of 9 dots arranged in 3 rows of 3 inside of a square. The solution, four straight lines made without lifting the pencil, is shown in a red line with arrows indicating the direction of movement. In order to solve the puzzle, the lines must extend beyond the borders of the box. The four connecting lines are drawn as follows. Line 1 begins at the top left dot, proceeds through the middle and right dots of the top row, and extends to the right beyond the border of the square. Line 2 extends from the end of line 1, through the right dot of the horizontally centered row, through the middle dot of the bottom row, and beyond the square’s border ending in the space beneath the left dot of the bottom row. Line 3 extends from the end of line 2 upwards through the left dots of the bottom, middle, and top rows. Line 4 extends from the end of line 3 through the middle dot in the middle row and ends at the right dot of the bottom row.

   Many different strategies exist for solving problems. Typical strategies include trial and error, applying algorithms, and using heuristics. To solve a large, complicated problem, it often helps to break the problem into smaller steps that can be accomplished individually, leading to an overall solution. Roadblocks to problem solving include a mental set, functional fixedness, and various biases that can cloud decision making skills.

References:

Openstax Psychology text by Kathryn Dumper, William Jenkins, Arlene Lacombe, Marilyn Lovett and Marion Perlmutter licensed under CC BY v4.0. https://openstax.org/details/books/psychology

Review Questions:

1. A specific formula for solving a problem is called ________.

a. an algorithm

b. a heuristic

c. a mental set

d. trial and error

2. Solving the Tower of Hanoi problem tends to utilize a  ________ strategy of problem solving.

a. divide and conquer

b. means-end analysis

d. experiment

3. A mental shortcut in the form of a general problem-solving framework is called ________.

4. Which type of bias involves becoming fixated on a single trait of a problem?

a. anchoring bias

b. confirmation bias

c. representative bias

d. availability bias

5. Which type of bias involves relying on a false stereotype to make a decision?

6. Wolfgang Kohler analyzed behavior of chimpanzees by applying Gestalt principles to describe ________.

a. social adjustment

b. student load payment options

c. emotional learning

d. insight learning

7. ________ is a type of mental set where you cannot perceive an object being used for something other than what it was designed for.

a. functional fixedness

c. working memory

Critical Thinking Questions:

1. What is functional fixedness and how can overcoming it help you solve problems?

2. How does an algorithm save you time and energy when solving a problem?

Personal Application Question:

1. Which type of bias do you recognize in your own decision making processes? How has this bias affected how you’ve made decisions in the past and how can you use your awareness of it to improve your decisions making skills in the future?

anchoring bias

availability heuristic

confirmation bias

functional fixedness

hindsight bias

problem-solving strategy

representative bias

trial and error

working backwards

Answers to Exercises

algorithm:  problem-solving strategy characterized by a specific set of instructions

anchoring bias:  faulty heuristic in which you fixate on a single aspect of a problem to find a solution

availability heuristic:  faulty heuristic in which you make a decision based on information readily available to you

confirmation bias:  faulty heuristic in which you focus on information that confirms your beliefs

functional fixedness:  inability to see an object as useful for any other use other than the one for which it was intended

heuristic:  mental shortcut that saves time when solving a problem

hindsight bias:  belief that the event just experienced was predictable, even though it really wasn’t

mental set:  continually using an old solution to a problem without results

problem-solving strategy:  method for solving problems

representative bias:  faulty heuristic in which you stereotype someone or something without a valid basis for your judgment

trial and error:  problem-solving strategy in which multiple solutions are attempted until the correct one is found

working backwards:  heuristic in which you begin to solve a problem by focusing on the end result

Creative Commons License

Share This Book

  • Increase Font Size

APS

The Process of Problem Solving

  • Editor's Choice
  • Experimental Psychology
  • Problem Solving

problem solving test in psychology

In a 2013 article published in the Journal of Cognitive Psychology , Ngar Yin Louis Lee (Chinese University of Hong Kong) and APS William James Fellow Philip N. Johnson-Laird (Princeton University) examined the ways people develop strategies to solve related problems. In a series of three experiments, the researchers asked participants to solve series of matchstick problems.

In matchstick problems, participants are presented with an array of joined squares. Each square in the array is comprised of separate pieces. Participants are asked to remove a certain number of pieces from the array while still maintaining a specific number of intact squares. Matchstick problems are considered to be fairly sophisticated, as there is generally more than one solution, several different tactics can be used to complete the task, and the types of tactics that are appropriate can change depending on the configuration of the array.

Louis Lee and Johnson-Laird began by examining what influences the tactics people use when they are first confronted with the matchstick problem. They found that initial problem-solving tactics were constrained by perceptual features of the array, with participants solving symmetrical problems and problems with salient solutions faster. Participants frequently used tactics that involved symmetry and salience even when other solutions that did not involve these features existed.

To examine how problem solving develops over time, the researchers had participants solve a series of matchstick problems while verbalizing their problem-solving thought process. The findings from this second experiment showed that people tend to go through two different stages when solving a series of problems.

People begin their problem-solving process in a generative manner during which they explore various tactics — some successful and some not. Then they use their experience to narrow down their choices of tactics, focusing on those that are the most successful. The point at which people begin to rely on this newfound tactical knowledge to create their strategic moves indicates a shift into a more evaluative stage of problem solving.

In the third and last experiment, participants completed a set of matchstick problems that could be solved using similar tactics and then solved several problems that required the use of novel tactics.  The researchers found that participants often had trouble leaving their set of successful tactics behind and shifting to new strategies.

From the three studies, the researchers concluded that when people tackle a problem, their initial moves may be constrained by perceptual components of the problem. As they try out different tactics, they hone in and settle on the ones that are most efficient; however, this deduced knowledge can in turn come to constrain players’ generation of moves — something that can make it difficult to switch to new tactics when required.

These findings help expand our understanding of the role of reasoning and deduction in problem solving and of the processes involved in the shift from less to more effective problem-solving strategies.

Reference Louis Lee, N. Y., Johnson-Laird, P. N. (2013). Strategic changes in problem solving. Journal of Cognitive Psychology, 25 , 165–173. doi: 10.1080/20445911.2012.719021

' src=

good work for other researcher

APS regularly opens certain online articles for discussion on our website. Effective February 2021, you must be a logged-in APS member to post comments. By posting a comment, you agree to our Community Guidelines and the display of your profile information, including your name and affiliation. Any opinions, findings, conclusions, or recommendations present in article comments are those of the writers and do not necessarily reflect the views of APS or the article’s author. For more information, please see our Community Guidelines .

Please login with your APS account to comment.

problem solving test in psychology

Careers Up Close: Joel Anderson on Gender and Sexual Prejudices, the Freedoms of Academic Research, and the Importance of Collaboration

Joel Anderson, a senior research fellow at both Australian Catholic University and La Trobe University, researches group processes, with a specific interest on prejudice, stigma, and stereotypes.

problem solving test in psychology

Experimental Methods Are Not Neutral Tools

Ana Sofia Morais and Ralph Hertwig explain how experimental psychologists have painted too negative a picture of human rationality, and how their pessimism is rooted in a seemingly mundane detail: methodological choices. 

APS Fellows Elected to SEP

In addition, an APS Rising Star receives the society’s Early Investigator Award.

Privacy Overview

CONCEPTUAL ANALYSIS article

Complex problem solving: what it is and what it is not.

\r\nDietrich Drner

  • 1 Department of Psychology, University of Bamberg, Bamberg, Germany
  • 2 Department of Psychology, Heidelberg University, Heidelberg, Germany

Computer-simulated scenarios have been part of psychological research on problem solving for more than 40 years. The shift in emphasis from simple toy problems to complex, more real-life oriented problems has been accompanied by discussions about the best ways to assess the process of solving complex problems. Psychometric issues such as reliable assessments and addressing correlations with other instruments have been in the foreground of these discussions and have left the content validity of complex problem solving in the background. In this paper, we return the focus to content issues and address the important features that define complex problems.

Succeeding in the 21st century requires many competencies, including creativity, life-long learning, and collaboration skills (e.g., National Research Council, 2011 ; Griffin and Care, 2015 ), to name only a few. One competence that seems to be of central importance is the ability to solve complex problems ( Mainzer, 2009 ). Mainzer quotes the Nobel prize winner Simon (1957) who wrote as early as 1957:

The capacity of the human mind for formulating and solving complex problems is very small compared with the size of the problem whose solution is required for objectively rational behavior in the real world or even for a reasonable approximation to such objective rationality. (p. 198)

The shift from well-defined to ill-defined problems came about as a result of a disillusion with the “general problem solver” ( Newell et al., 1959 ): The general problem solver was a computer software intended to solve all kind of problems that can be expressed through well-formed formulas. However, it soon became clear that this procedure was in fact a “special problem solver” that could only solve well-defined problems in a closed space. But real-world problems feature open boundaries and have no well-determined solution. In fact, the world is full of wicked problems and clumsy solutions ( Verweij and Thompson, 2006 ). As a result, solving well-defined problems and solving ill-defined problems requires different cognitive processes ( Schraw et al., 1995 ; but see Funke, 2010 ).

Well-defined problems have a clear set of means for reaching a precisely described goal state. For example: in a match-stick arithmetic problem, a person receives a false arithmetic expression constructed out of matchsticks (e.g., IV = III + III). According to the instructions, moving one of the matchsticks will make the equations true. Here, both the problem (find the appropriate stick to move) and the goal state (true arithmetic expression; solution is: VI = III + III) are defined clearly.

Ill-defined problems have no clear problem definition, their goal state is not defined clearly, and the means of moving towards the (diffusely described) goal state are not clear. For example: The goal state for solving the political conflict in the near-east conflict between Israel and Palestine is not clearly defined (living in peaceful harmony with each other?) and even if the conflict parties would agree on a two-state solution, this goal again leaves many issues unresolved. This type of problem is called a “complex problem” and is of central importance to this paper. All psychological processes that occur within individual persons and deal with the handling of such ill-defined complex problems will be subsumed under the umbrella term “complex problem solving” (CPS).

Systematic research on CPS started in the 1970s with observations of the behavior of participants who were confronted with computer simulated microworlds. For example, in one of those microworlds participants assumed the role of executives who were tasked to manage a company over a certain period of time (see Brehmer and Dörner, 1993 , for a discussion of this methodology). Today, CPS is an established concept and has even influenced large-scale assessments such as PISA (“Programme for International Student Assessment”), organized by the Organization for Economic Cooperation and Development ( OECD, 2014 ). According to the World Economic Forum, CPS is one of the most important competencies required in the future ( World Economic Forum, 2015 ). Numerous articles on the subject have been published in recent years, documenting the increasing research activity relating to this field. In the following collection of papers we list only those published in 2010 and later: theoretical papers ( Blech and Funke, 2010 ; Funke, 2010 ; Knauff and Wolf, 2010 ; Leutner et al., 2012 ; Selten et al., 2012 ; Wüstenberg et al., 2012 ; Greiff et al., 2013b ; Fischer and Neubert, 2015 ; Schoppek and Fischer, 2015 ), papers about measurement issues ( Danner et al., 2011a ; Greiff et al., 2012 , 2015a ; Alison et al., 2013 ; Gobert et al., 2015 ; Greiff and Fischer, 2013 ; Herde et al., 2016 ; Stadler et al., 2016 ), papers about applications ( Fischer and Neubert, 2015 ; Ederer et al., 2016 ; Tremblay et al., 2017 ), papers about differential effects ( Barth and Funke, 2010 ; Danner et al., 2011b ; Beckmann and Goode, 2014 ; Greiff and Neubert, 2014 ; Scherer et al., 2015 ; Meißner et al., 2016 ; Wüstenberg et al., 2016 ), one paper about developmental effects ( Frischkorn et al., 2014 ), one paper with a neuroscience background ( Osman, 2012 ) 1 , papers about cultural differences ( Güss and Dörner, 2011 ; Sonnleitner et al., 2014 ; Güss et al., 2015 ), papers about validity issues ( Goode and Beckmann, 2010 ; Greiff et al., 2013c ; Schweizer et al., 2013 ; Mainert et al., 2015 ; Funke et al., 2017 ; Greiff et al., 2017 , 2015b ; Kretzschmar et al., 2016 ; Kretzschmar, 2017 ), review papers and meta-analyses ( Osman, 2010 ; Stadler et al., 2015 ), and finally books ( Qudrat-Ullah, 2015 ; Csapó and Funke, 2017b ) and book chapters ( Funke, 2012 ; Hotaling et al., 2015 ; Funke and Greiff, 2017 ; Greiff and Funke, 2017 ; Csapó and Funke, 2017a ; Fischer et al., 2017 ; Molnàr et al., 2017 ; Tobinski and Fritz, 2017 ; Viehrig et al., 2017 ). In addition, a new “Journal of Dynamic Decision Making” (JDDM) has been launched ( Fischer et al., 2015 , 2016 ) to give the field an open-access outlet for research and discussion.

This paper aims to clarify aspects of validity: what should be meant by the term CPS and what not? This clarification seems necessary because misunderstandings in recent publications provide – from our point of view – a potentially misleading picture of the construct. We start this article with a historical review before attempting to systematize different positions. We conclude with a working definition.

Historical Review

The concept behind CPS goes back to the German phrase “komplexes Problemlösen” (CPS; the term “komplexes Problemlösen” was used as a book title by Funke, 1986 ). The concept was introduced in Germany by Dörner and colleagues in the mid-1970s (see Dörner et al., 1975 ; Dörner, 1975 ) for the first time. The German phrase was later translated to CPS in the titles of two edited volumes by Sternberg and Frensch (1991) and Frensch and Funke (1995a) that collected papers from different research traditions. Even though it looks as though the term was coined in the 1970s, Edwards (1962) used the term “dynamic decision making” to describe decisions that come in a sequence. He compared static with dynamic decision making, writing:

In dynamic situations, a new complication not found in the static situations arises. The environment in which the decision is set may be changing, either as a function of the sequence of decisions, or independently of them, or both. It is this possibility of an environment which changes while you collect information about it which makes the task of dynamic decision theory so difficult and so much fun. (p. 60)

The ability to solve complex problems is typically measured via dynamic systems that contain several interrelated variables that participants need to alter. Early work (see, e.g., Dörner, 1980 ) used a simulation scenario called “Lohhausen” that contained more than 2000 variables that represented the activities of a small town: Participants had to take over the role of a mayor for a simulated period of 10 years. The simulation condensed these ten years to ten hours in real time. Later, researchers used smaller dynamic systems as scenarios either based on linear equations (see, e.g., Funke, 1993 ) or on finite state automata (see, e.g., Buchner and Funke, 1993 ). In these contexts, CPS consisted of the identification and control of dynamic task environments that were previously unknown to the participants. Different task environments came along with different degrees of fidelity ( Gray, 2002 ).

According to Funke (2012) , the typical attributes of complex systems are (a) complexity of the problem situation which is usually represented by the sheer number of involved variables; (b) connectivity and mutual dependencies between involved variables; (c) dynamics of the situation, which reflects the role of time and developments within a system; (d) intransparency (in part or full) about the involved variables and their current values; and (e) polytely (greek term for “many goals”), representing goal conflicts on different levels of analysis. This mixture of features is similar to what is called VUCA (volatility, uncertainty, complexity, ambiguity) in modern approaches to management (e.g., Mack et al., 2016 ).

In his evaluation of the CPS movement, Sternberg (1995) compared (young) European approaches to CPS with (older) American research on expertise. His analysis of the differences between the European and American traditions shows advantages but also potential drawbacks for each side. He states (p. 301): “I believe that although there are problems with the European approach, it deals with some fundamental questions that American research scarcely addresses.” So, even though the echo of the European approach did not enjoy strong resonance in the US at that time, it was valued by scholars like Sternberg and others. Before attending to validity issues, we will first present a short review of different streams.

Different Approaches to CPS

In the short history of CPS research, different approaches can be identified ( Buchner, 1995 ; Fischer et al., 2017 ). To systematize, we differentiate between the following five lines of research:

(a) The search for individual differences comprises studies identifying interindividual differences that affect the ability to solve complex problems. This line of research is reflected, for example, in the early work by Dörner et al. (1983) and their “Lohhausen” study. Here, naïve student participants took over the role of the mayor of a small simulated town named Lohhausen for a simulation period of ten years. According to the results of the authors, it is not intelligence (as measured by conventional IQ tests) that predicts performance, but it is the ability to stay calm in the face of a challenging situation and the ability to switch easily between an analytic mode of processing and a more holistic one.

(b) The search for cognitive processes deals with the processes behind understanding complex dynamic systems. Representative of this line of research is, for example, Berry and Broadbent’s (1984) work on implicit and explicit learning processes when people interact with a dynamic system called “Sugar Production”. They found that those who perform best in controlling a dynamic system can do so implicitly, without explicit knowledge of details regarding the systems’ relations.

(c) The search for system factors seeks to identify the aspects of dynamic systems that determine the difficulty of complex problems and make some problems harder than others. Representative of this line of research is, for example, work by Funke (1985) , who systematically varied the number of causal effects within a dynamic system or the presence/absence of eigendynamics. He found, for example, that solution quality decreases as the number of systems relations increases.

(d) The psychometric approach develops measurement instruments that can be used as an alternative to classical IQ tests, as something that goes “beyond IQ”. The MicroDYN approach ( Wüstenberg et al., 2012 ) is representative for this line of research that presents an alternative to reasoning tests (like Raven matrices). These authors demonstrated that a small improvement in predicting school grade point average beyond reasoning is possible with MicroDYN tests.

(e) The experimental approach explores CPS under different experimental conditions. This approach uses CPS assessment instruments to test hypotheses derived from psychological theories and is sometimes used in research about cognitive processes (see above). Exemplary for this line of research is the work by Rohe et al. (2016) , who test the usefulness of “motto goals” in the context of complex problems compared to more traditional learning and performance goals. Motto goals differ from pure performance goals by activating positive affect and should lead to better goal attainment especially in complex situations (the mentioned study found no effect).

To be clear: these five approaches are not mutually exclusive and do overlap. But the differentiation helps to identify different research communities and different traditions. These communities had different opinions about scaling complexity.

The Race for Complexity: Use of More and More Complex Systems

In the early years of CPS research, microworlds started with systems containing about 20 variables (“Tailorshop”), soon reached 60 variables (“Moro”), and culminated in systems with about 2000 variables (“Lohhausen”). This race for complexity ended with the introduction of the concept of “minimal complex systems” (MCS; Greiff and Funke, 2009 ; Funke and Greiff, 2017 ), which ushered in a search for the lower bound of complexity instead of the higher bound, which could not be defined as easily. The idea behind this concept was that whereas the upper limits of complexity are unbound, the lower limits might be identifiable. Imagine starting with a simple system containing two variables with a simple linear connection between them; then, step by step, increase the number of variables and/or the type of connections. One soon reaches a point where the system can no longer be considered simple and has become a “complex system”. This point represents a minimal complex system. Despite some research having been conducted in this direction, the point of transition from simple to complex has not been identified clearly as of yet.

Some years later, the original “minimal complex systems” approach ( Greiff and Funke, 2009 ) shifted to the “multiple complex systems” approach ( Greiff et al., 2013a ). This shift is more than a slight change in wording: it is important because it taps into the issue of validity directly. Minimal complex systems have been introduced in the context of challenges from large-scale assessments like PISA 2012 that measure new aspects of problem solving, namely interactive problems besides static problem solving ( Greiff and Funke, 2017 ). PISA 2012 required test developers to remain within testing time constraints (given by the school class schedule). Also, test developers needed a large item pool for the construction of a broad class of problem solving items. It was clear from the beginning that MCS deal with simple dynamic situations that require controlled interaction: the exploration and control of simple ticket machines, simple mobile phones, or simple MP3 players (all of these example domains were developed within PISA 2012) – rather than really complex situations like managerial or political decision making.

As a consequence of this subtle but important shift in interpreting the letters MCS, the definition of CPS became a subject of debate recently ( Funke, 2014a ; Greiff and Martin, 2014 ; Funke et al., 2017 ). In the words of Funke (2014b , p. 495):

It is funny that problems that nowadays come under the term ‘CPS’, are less complex (in terms of the previously described attributes of complex situations) than at the beginning of this new research tradition. The emphasis on psychometric qualities has led to a loss of variety. Systems thinking requires more than analyzing models with two or three linear equations – nonlinearity, cyclicity, rebound effects, etc. are inherent features of complex problems and should show up at least in some of the problems used for research and assessment purposes. Minimal complex systems run the danger of becoming minimal valid systems.

Searching for minimal complex systems is not the same as gaining insight into the way how humans deal with complexity and uncertainty. For psychometric purposes, it is appropriate to reduce complexity to a minimum; for understanding problem solving under conditions of overload, intransparency, and dynamics, it is necessary to realize those attributes with reasonable strength. This aspect is illustrated in the next section.

Importance of the Validity Issue

The most important reason for discussing the question of what complex problem solving is and what it is not stems from its phenomenology: if we lose sight of our phenomena, we are no longer doing good psychology. The relevant phenomena in the context of complex problems encompass many important aspects. In this section, we discuss four phenomena that are specific to complex problems. We consider these phenomena as critical for theory development and for the construction of assessment instruments (i.e., microworlds). These phenomena require theories for explaining them and they require assessment instruments eliciting them in a reliable way.

The first phenomenon is the emergency reaction of the intellectual system ( Dörner, 1980 ): When dealing with complex systems, actors tend to (a) reduce their intellectual level by decreasing self-reflections, by decreasing their intentions, by stereotyping, and by reducing their realization of intentions, (b) they show a tendency for fast action with increased readiness for risk, with increased violations of rules, and with increased tendency to escape the situation, and (c) they degenerate their hypotheses formation by construction of more global hypotheses and reduced tests of hypotheses, by increasing entrenchment, and by decontextualizing their goals. This phenomenon illustrates the strong connection between cognition, emotion, and motivation that has been emphasized by Dörner (see, e.g., Dörner and Güss, 2013 ) from the beginning of his research tradition; the emergency reaction reveals a shift in the mode of information processing under the pressure of complexity.

The second phenomenon comprises cross-cultural differences with respect to strategy use ( Strohschneider and Güss, 1999 ; Güss and Wiley, 2007 ; Güss et al., 2015 ). Results from complex task environments illustrate the strong influence of context and background knowledge to an extent that cannot be found for knowledge-poor problems. For example, in a comparison between Brazilian and German participants, it turned out that Brazilians accept the given problem descriptions and are more optimistic about the results of their efforts, whereas Germans tend to inquire more about the background of the problems and take a more active approach but are less optimistic (according to Strohschneider and Güss, 1998 , p. 695).

The third phenomenon relates to failures that occur during the planning and acting stages ( Jansson, 1994 ; Ramnarayan et al., 1997 ), illustrating that rational procedures seem to be unlikely to be used in complex situations. The potential for failures ( Dörner, 1996 ) rises with the complexity of the problem. Jansson (1994) presents seven major areas for failures with complex situations: acting directly on current feedback; insufficient systematization; insufficient control of hypotheses and strategies; lack of self-reflection; selective information gathering; selective decision making; and thematic vagabonding.

The fourth phenomenon describes (a lack of) training and transfer effects ( Kretzschmar and Süß, 2015 ), which again illustrates the context dependency of strategies and knowledge (i.e., there is no strategy that is so universal that it can be used in many different problem situations). In their own experiment, the authors could show training effects only for knowledge acquisition, not for knowledge application. Only with specific feedback, performance in complex environments can be increased ( Engelhart et al., 2017 ).

These four phenomena illustrate why the type of complexity (or degree of simplicity) used in research really matters. Furthermore, they demonstrate effects that are specific for complex problems, but not for toy problems. These phenomena direct the attention to the important question: does the stimulus material used (i.e., the computer-simulated microworld) tap and elicit the manifold of phenomena described above?

Dealing with partly unknown complex systems requires courage, wisdom, knowledge, grit, and creativity. In creativity research, “little c” and “BIG C” are used to differentiate between everyday creativity and eminent creativity ( Beghetto and Kaufman, 2007 ; Kaufman and Beghetto, 2009 ). Everyday creativity is important for solving everyday problems (e.g., finding a clever fix for a broken spoke on my bicycle), eminent creativity changes the world (e.g., inventing solar cells for energy production). Maybe problem solving research should use a similar differentiation between “little p” and “BIG P” to mark toy problems on the one side and big societal challenges on the other. The question then remains: what can we learn about BIG P by studying little p? What phenomena are present in both types, and what phenomena are unique to each of the two extremes?

Discussing research on CPS requires reflecting on the field’s research methods. Even if the experimental approach has been successful for testing hypotheses (for an overview of older work, see Funke, 1995 ), other methods might provide additional and novel insights. Complex phenomena require complex approaches to understand them. The complex nature of complex systems imposes limitations on psychological experiments: The more complex the environments, the more difficult is it to keep conditions under experimental control. And if experiments have to be run in labs one should bring enough complexity into the lab to establish the phenomena mentioned, at least in part.

There are interesting options to be explored (again): think-aloud protocols , which have been discredited for many years ( Nisbett and Wilson, 1977 ) and yet are a valuable source for theory testing ( Ericsson and Simon, 1983 ); introspection ( Jäkel and Schreiber, 2013 ), which seems to be banned from psychological methods but nevertheless offers insights into thought processes; the use of life-streaming ( Wendt, 2017 ), a medium in which streamers generate a video stream of think-aloud data in computer-gaming; political decision-making ( Dhami et al., 2015 ) that demonstrates error-proneness in groups; historical case studies ( Dörner and Güss, 2011 ) that give insights into the thinking styles of political leaders; the use of the critical incident technique ( Reuschenbach, 2008 ) to construct complex scenarios; and simulations with different degrees of fidelity ( Gray, 2002 ).

The methods tool box is full of instruments that have to be explored more carefully before any individual instrument receives a ban or research narrows its focus to only one paradigm for data collection. Brehmer and Dörner (1993) discussed the tensions between “research in the laboratory and research in the field”, optimistically concluding “that the new methodology of computer-simulated microworlds will provide us with the means to bridge the gap between the laboratory and the field” (p. 183). The idea behind this optimism was that computer-simulated scenarios would bring more complexity from the outside world into the controlled lab environment. But this is not true for all simulated scenarios. In his paper on simulated environments, Gray (2002) differentiated computer-simulated environments with respect to three dimensions: (1) tractability (“the more training subjects require before they can use a simulated task environment, the less tractable it is”, p. 211), correspondence (“High correspondence simulated task environments simulate many aspects of one task environment. Low correspondence simulated task environments simulate one aspect of many task environments”, p. 214), and engagement (“A simulated task environment is engaging to the degree to which it involves and occupies the participants; that is, the degree to which they agree to take it seriously”, p. 217). But the mere fact that a task is called a “computer-simulated task environment” does not mean anything specific in terms of these three dimensions. This is one of several reasons why we should differentiate between those studies that do not address the core features of CPS and those that do.

What is not CPS?

Even though a growing number of references claiming to deal with complex problems exist (e.g., Greiff and Wüstenberg, 2015 ; Greiff et al., 2016 ), it would be better to label the requirements within these tasks “dynamic problem solving,” as it has been done adequately in earlier work ( Greiff et al., 2012 ). The dynamics behind on-off-switches ( Thimbleby, 2007 ) are remarkable but not really complex. Small nonlinear systems that exhibit stunningly complex and unstable behavior do exist – but they are not used in psychometric assessments of so-called CPS. There are other small systems (like MicroDYN scenarios: Greiff and Wüstenberg, 2014 ) that exhibit simple forms of system behavior that are completely predictable and stable. This type of simple systems is used frequently. It is even offered commercially as a complex problem-solving test called COMPRO ( Greiff and Wüstenberg, 2015 ) for business applications. But a closer look reveals that the label is not used correctly; within COMPRO, the used linear equations are far from being complex and the system can be handled properly by using only one strategy (see for more details Funke et al., 2017 ).

Why do simple linear systems not fall within CPS? At the surface, nonlinear and linear systems might appear similar because both only include 3–5 variables. But the difference is in terms of systems behavior as well as strategies and learning. If the behavior is simple (as in linear systems where more input is related to more output and vice versa), the system can be easily understood (participants in the MicroDYN world have 3 minutes to explore a complex system). If the behavior is complex (as in systems that contain strange attractors or negative feedback loops), things become more complicated and much more observation is needed to identify the hidden structure of the unknown system ( Berry and Broadbent, 1984 ; Hundertmark et al., 2015 ).

Another issue is learning. If tasks can be solved using a single (and not so complicated) strategy, steep learning curves are to be expected. The shift from problem solving to learned routine behavior occurs rapidly, as was demonstrated by Luchins (1942) . In his water jar experiments, participants quickly acquired a specific strategy (a mental set) for solving certain measurement problems that they later continued applying to problems that would have allowed for easier approaches. In the case of complex systems, learning can occur only on very general, abstract levels because it is difficult for human observers to make specific predictions. Routines dealing with complex systems are quite different from routines relating to linear systems.

What should not be studied under the label of CPS are pure learning effects, multiple-cue probability learning, or tasks that can be solved using a single strategy. This last issue is a problem for MicroDYN tasks that rely strongly on the VOTAT strategy (“vary one thing at a time”; see Tschirgi, 1980 ). In real-life, it is hard to imagine a business manager trying to solve her or his problems by means of VOTAT.

What is CPS?

In the early days of CPS research, planet Earth’s dynamics and complexities gained attention through such books as “The limits to growth” ( Meadows et al., 1972 ) and “Beyond the limits” ( Meadows et al., 1992 ). In the current decade, for example, the World Economic Forum (2016) attempts to identify the complexities and risks of our modern world. In order to understand the meaning of complexity and uncertainty, taking a look at the worlds’ most pressing issues is helpful. Searching for strategies to cope with these problems is a difficult task: surely there is no place for the simple principle of “vary-one-thing-at-a-time” (VOTAT) when it comes to global problems. The VOTAT strategy is helpful in the context of simple problems ( Wüstenberg et al., 2014 ); therefore, whether or not VOTAT is helpful in a given problem situation helps us distinguish simple from complex problems.

Because there exist no clear-cut strategies for complex problems, typical failures occur when dealing with uncertainty ( Dörner, 1996 ; Güss et al., 2015 ). Ramnarayan et al. (1997) put together a list of generic errors (e.g., not developing adequate action plans; lack of background control; learning from experience blocked by stereotype knowledge; reactive instead of proactive action) that are typical of knowledge-rich complex systems but cannot be found in simple problems.

Complex problem solving is not a one-dimensional, low-level construct. On the contrary, CPS is a multi-dimensional bundle of competencies existing at a high level of abstraction, similar to intelligence (but going beyond IQ). As Funke et al. (2018) state: “Assessment of transversal (in educational contexts: cross-curricular) competencies cannot be done with one or two types of assessment. The plurality of skills and competencies requires a plurality of assessment instruments.”

There are at least three different aspects of complex systems that are part of our understanding of a complex system: (1) a complex system can be described at different levels of abstraction; (2) a complex system develops over time, has a history, a current state, and a (potentially unpredictable) future; (3) a complex system is knowledge-rich and activates a large semantic network, together with a broad list of potential strategies (domain-specific as well as domain-general).

Complex problem solving is not only a cognitive process but is also an emotional one ( Spering et al., 2005 ; Barth and Funke, 2010 ) and strongly dependent on motivation (low-stakes versus high-stakes testing; see Hermes and Stelling, 2016 ).

Furthermore, CPS is a dynamic process unfolding over time, with different phases and with more differentiation than simply knowledge acquisition and knowledge application. Ideally, the process should entail identifying problems (see Dillon, 1982 ; Lee and Cho, 2007 ), even if in experimental settings, problems are provided to participants a priori . The more complex and open a given situation, the more options can be generated (T. S. Schweizer et al., 2016 ). In closed problems, these processes do not occur in the same way.

In analogy to the difference between formative (process-oriented) and summative (result-oriented) assessment ( Wiliam and Black, 1996 ; Bennett, 2011 ), CPS should not be reduced to the mere outcome of a solution process. The process leading up to the solution, including detours and errors made along the way, might provide a more differentiated impression of a person’s problem-solving abilities and competencies than the final result of such a process. This is one of the reasons why CPS environments are not, in fact, complex intelligence tests: research on CPS is not only about the outcome of the decision process, but it is also about the problem-solving process itself.

Complex problem solving is part of our daily life: finding the right person to share one’s life with, choosing a career that not only makes money, but that also makes us happy. Of course, CPS is not restricted to personal problems – life on Earth gives us many hard nuts to crack: climate change, population growth, the threat of war, the use and distribution of natural resources. In sum, many societal challenges can be seen as complex problems. To reduce that complexity to a one-hour lab activity on a random Friday afternoon puts it out of context and does not address CPS issues.

Theories about CPS should specify which populations they apply to. Across populations, one thing to consider is prior knowledge. CPS research with experts (e.g., Dew et al., 2009 ) is quite different from problem solving research using tasks that intentionally do not require any specific prior knowledge (see, e.g., Beckmann and Goode, 2014 ).

More than 20 years ago, Frensch and Funke (1995b) defined CPS as follows:

CPS occurs to overcome barriers between a given state and a desired goal state by means of behavioral and/or cognitive, multi-step activities. The given state, goal state, and barriers between given state and goal state are complex, change dynamically during problem solving, and are intransparent. The exact properties of the given state, goal state, and barriers are unknown to the solver at the outset. CPS implies the efficient interaction between a solver and the situational requirements of the task, and involves a solver’s cognitive, emotional, personal, and social abilities and knowledge. (p. 18)

The above definition is rather formal and does not account for content or relations between the simulation and the real world. In a sense, we need a new definition of CPS that addresses these issues. Based on our previous arguments, we propose the following working definition:

Complex problem solving is a collection of self-regulated psychological processes and activities necessary in dynamic environments to achieve ill-defined goals that cannot be reached by routine actions. Creative combinations of knowledge and a broad set of strategies are needed. Solutions are often more bricolage than perfect or optimal. The problem-solving process combines cognitive, emotional, and motivational aspects, particularly in high-stakes situations. Complex problems usually involve knowledge-rich requirements and collaboration among different persons.

The main differences to the older definition lie in the emphasis on (a) the self-regulation of processes, (b) creativity (as opposed to routine behavior), (c) the bricolage type of solution, and (d) the role of high-stakes challenges. Our new definition incorporates some aspects that have been discussed in this review but were not reflected in the 1995 definition, which focused on attributes of complex problems like dynamics or intransparency.

This leads us to the final reflection about the role of CPS for dealing with uncertainty and complexity in real life. We will distinguish thinking from reasoning and introduce the sense of possibility as an important aspect of validity.

CPS as Combining Reasoning and Thinking in an Uncertain Reality

Leading up to the Battle of Borodino in Leo Tolstoy’s novel “War and Peace”, Prince Andrei Bolkonsky explains the concept of war to his friend Pierre. Pierre expects war to resemble a game of chess: You position the troops and attempt to defeat your opponent by moving them in different directions.

“Far from it!”, Andrei responds. “In chess, you know the knight and his moves, you know the pawn and his combat strength. While in war, a battalion is sometimes stronger than a division and sometimes weaker than a company; it all depends on circumstances that can never be known. In war, you do not know the position of your enemy; some things you might be able to observe, some things you have to divine (but that depends on your ability to do so!) and many things cannot even be guessed at. In chess, you can see all of your opponent’s possible moves. In war, that is impossible. If you decide to attack, you cannot know whether the necessary conditions are met for you to succeed. Many a time, you cannot even know whether your troops will follow your orders…”

In essence, war is characterized by a high degree of uncertainty. A good commander (or politician) can add to that what he or she sees, tentatively fill in the blanks – and not just by means of logical deduction but also by intelligently bridging missing links. A bad commander extrapolates from what he sees and thus arrives at improper conclusions.

Many languages differentiate between two modes of mentalizing; for instance, the English language distinguishes between ‘thinking’ and ‘reasoning’. Reasoning denotes acute and exact mentalizing involving logical deductions. Such deductions are usually based on evidence and counterevidence. Thinking, however, is what is required to write novels. It is the construction of an initially unknown reality. But it is not a pipe dream, an unfounded process of fabrication. Rather, thinking asks us to imagine reality (“Wirklichkeitsfantasie”). In other words, a novelist has to possess a “sense of possibility” (“Möglichkeitssinn”, Robert Musil; in German, sense of possibility is often used synonymously with imagination even though imagination is not the same as sense of possibility, for imagination also encapsulates the impossible). This sense of possibility entails knowing the whole (or several wholes) or being able to construe an unknown whole that could accommodate a known part. The whole has to align with sociological and geographical givens, with the mentality of certain peoples or groups, and with the laws of physics and chemistry. Otherwise, the entire venture is ill-founded. A sense of possibility does not aim for the moon but imagines something that might be possible but has not been considered possible or even potentially possible so far.

Thinking is a means to eliminate uncertainty. This process requires both of the modes of thinking we have discussed thus far. Economic, political, or ecological decisions require us to first consider the situation at hand. Though certain situational aspects can be known, but many cannot. In fact, von Clausewitz (1832) posits that only about 25% of the necessary information is available when a military decision needs to be made. Even then, there is no way to guarantee that whatever information is available is also correct: Even if a piece of information was completely accurate yesterday, it might no longer apply today.

Once our sense of possibility has helped grasping a situation, problem solvers need to call on their reasoning skills. Not every situation requires the same action, and we may want to act this way or another to reach this or that goal. This appears logical, but it is a logic based on constantly shifting grounds: We cannot know whether necessary conditions are met, sometimes the assumptions we have made later turn out to be incorrect, and sometimes we have to revise our assumptions or make completely new ones. It is necessary to constantly switch between our sense of possibility and our sense of reality, that is, to switch between thinking and reasoning. It is an arduous process, and some people handle it well, while others do not.

If we are to believe Tuchman’s (1984) book, “The March of Folly”, most politicians and commanders are fools. According to Tuchman, not much has changed in the 3300 years that have elapsed since the misguided Trojans decided to welcome the left-behind wooden horse into their city that would end up dismantling Troy’s defensive walls. The Trojans, too, had been warned, but decided not to heed the warning. Although Laocoön had revealed the horse’s true nature to them by attacking it with a spear, making the weapons inside the horse ring, the Trojans refused to see the forest for the trees. They did not want to listen, they wanted the war to be over, and this desire ended up shaping their perception.

The objective of psychology is to predict and explain human actions and behavior as accurately as possible. However, thinking cannot be investigated by limiting its study to neatly confined fractions of reality such as the realms of propositional logic, chess, Go tasks, the Tower of Hanoi, and so forth. Within these systems, there is little need for a sense of possibility. But a sense of possibility – the ability to divine and construe an unknown reality – is at least as important as logical reasoning skills. Not researching the sense of possibility limits the validity of psychological research. All economic and political decision making draws upon this sense of possibility. By not exploring it, psychological research dedicated to the study of thinking cannot further the understanding of politicians’ competence and the reasons that underlie political mistakes. Christopher Clark identifies European diplomats’, politicians’, and commanders’ inability to form an accurate representation of reality as a reason for the outbreak of World War I. According to Clark’s (2012) book, “The Sleepwalkers”, the politicians of the time lived in their own make-believe world, wrongfully assuming that it was the same world everyone else inhabited. If CPS research wants to make significant contributions to the world, it has to acknowledge complexity and uncertainty as important aspects of it.

For more than 40 years, CPS has been a new subject of psychological research. During this time period, the initial emphasis on analyzing how humans deal with complex, dynamic, and uncertain situations has been lost. What is subsumed under the heading of CPS in modern research has lost the original complexities of real-life problems. From our point of view, the challenges of the 21st century require a return to the origins of this research tradition. We would encourage researchers in the field of problem solving to come back to the original ideas. There is enough complexity and uncertainty in the world to be studied. Improving our understanding of how humans deal with these global and pressing problems would be a worthwhile enterprise.

Author Contributions

JF drafted a first version of the manuscript, DD added further text and commented on the draft. JF finalized the manuscript.

Authors Note

After more than 40 years of controversial discussions between both authors, this is the first joint paper. We are happy to have done this now! We have found common ground!

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

The authors thank the Deutsche Forschungsgemeinschaft (DFG) for the continuous support of their research over many years. Thanks to Daniel Holt for his comments on validity issues, thanks to Julia Nolte who helped us by translating German text excerpts into readable English and helped us, together with Keri Hartman, to improve our style and grammar – thanks for that! We also thank the two reviewers for their helpful critical comments on earlier versions of this manuscript. Finally, we acknowledge financial support by Deutsche Forschungsgemeinschaft and Ruprecht-Karls-Universität Heidelberg within their funding programme Open Access Publishing .

  • ^ The fMRI-paper from Anderson (2012) uses the term “complex problem solving” for tasks that do not fall in our understanding of CPS and is therefore excluded from this list.

Alison, L., van den Heuvel, C., Waring, S., Power, N., Long, A., O’Hara, T., et al. (2013). Immersive simulated learning environments for researching critical incidents: a knowledge synthesis of the literature and experiences of studying high-risk strategic decision making. J. Cogn. Eng. Deci. Mak. 7, 255–272. doi: 10.1177/1555343412468113

CrossRef Full Text | Google Scholar

Anderson, J. R. (2012). Tracking problem solving by multivariate pattern analysis and hidden markov model algorithms. Neuropsychologia 50, 487–498. doi: 10.1016/j.neuropsychologia.2011.07.025

PubMed Abstract | CrossRef Full Text | Google Scholar

Barth, C. M., and Funke, J. (2010). Negative affective environments improve complex solving performance. Cogn. Emot. 24, 1259–1268. doi: 10.1080/02699930903223766

Beckmann, J. F., and Goode, N. (2014). The benefit of being naïve and knowing it: the unfavourable impact of perceived context familiarity on learning in complex problem solving tasks. Instruct. Sci. 42, 271–290. doi: 10.1007/s11251-013-9280-7

Beghetto, R. A., and Kaufman, J. C. (2007). Toward a broader conception of creativity: a case for “mini-c” creativity. Psychol. Aesthetics Creat. Arts 1, 73–79. doi: 10.1037/1931-3896.1.2.73

Bennett, R. E. (2011). Formative assessment: a critical review. Assess. Educ. Princ. Policy Pract. 18, 5–25. doi: 10.1080/0969594X.2010.513678

Berry, D. C., and Broadbent, D. E. (1984). On the relationship between task performance and associated verbalizable knowledge. Q. J. Exp. Psychol. 36, 209–231. doi: 10.1080/14640748408402156

Blech, C., and Funke, J. (2010). You cannot have your cake and eat it, too: how induced goal conflicts affect complex problem solving. Open Psychol. J. 3, 42–53. doi: 10.2174/1874350101003010042

Brehmer, B., and Dörner, D. (1993). Experiments with computer-simulated microworlds: escaping both the narrow straits of the laboratory and the deep blue sea of the field study. Comput. Hum. Behav. 9, 171–184. doi: 10.1016/0747-5632(93)90005-D

Buchner, A. (1995). “Basic topics and approaches to the study of complex problem solving,” in Complex Problem Solving: The European Perspective , eds P. A. Frensch and J. Funke (Hillsdale, NJ: Erlbaum), 27–63.

Google Scholar

Buchner, A., and Funke, J. (1993). Finite state automata: dynamic task environments in problem solving research. Q. J. Exp. Psychol. 46A, 83–118. doi: 10.1080/14640749308401068

Clark, C. (2012). The Sleepwalkers: How Europe Went to War in 1914 . London: Allen Lane.

Csapó, B., and Funke, J. (2017a). “The development and assessment of problem solving in 21st-century schools,” in The Nature of Problem Solving: Using Research to Inspire 21st Century Learning , eds B. Csapó and J. Funke (Paris: OECD Publishing), 19–31.

Csapó, B., and Funke, J. (eds) (2017b). The Nature of Problem Solving. Using Research to Inspire 21st Century Learning. Paris: OECD Publishing.

Danner, D., Hagemann, D., Holt, D. V., Hager, M., Schankin, A., Wüstenberg, S., et al. (2011a). Measuring performance in dynamic decision making. Reliability and validity of the Tailorshop simulation. J. Ind. Differ. 32, 225–233. doi: 10.1027/1614-0001/a000055

CrossRef Full Text

Danner, D., Hagemann, D., Schankin, A., Hager, M., and Funke, J. (2011b). Beyond IQ: a latent state-trait analysis of general intelligence, dynamic decision making, and implicit learning. Intelligence 39, 323–334. doi: 10.1016/j.intell.2011.06.004

Dew, N., Read, S., Sarasvathy, S. D., and Wiltbank, R. (2009). Effectual versus predictive logics in entrepreneurial decision-making: differences between experts and novices. J. Bus. Ventur. 24, 287–309. doi: 10.1016/j.jbusvent.2008.02.002

Dhami, M. K., Mandel, D. R., Mellers, B. A., and Tetlock, P. E. (2015). Improving intelligence analysis with decision science. Perspect. Psychol. Sci. 10, 753–757. doi: 10.1177/1745691615598511

Dillon, J. T. (1982). Problem finding and solving. J. Creat. Behav. 16, 97–111. doi: 10.1002/j.2162-6057.1982.tb00326.x

Dörner, D. (1975). Wie Menschen eine Welt verbessern wollten [How people wanted to improve a world]. Bild Der Wissenschaft 12, 48–53.

Dörner, D. (1980). On the difficulties people have in dealing with complexity. Simulat. Gam. 11, 87–106. doi: 10.1177/104687818001100108

Dörner, D. (1996). The Logic of Failure: Recognizing and Avoiding Error in Complex Situations. New York, NY: Basic Books.

Dörner, D., Drewes, U., and Reither, F. (1975). “Über das Problemlösen in sehr komplexen Realitätsbereichen,” in Bericht über den 29. Kongreß der DGfPs in Salzburg 1974, Band 1 , ed. W. H. Tack (Göttingen: Hogrefe), 339–340.

Dörner, D., and Güss, C. D. (2011). A psychological analysis of Adolf Hitler’s decision making as commander in chief: summa confidentia et nimius metus. Rev. Gen. Psychol. 15, 37–49. doi: 10.1037/a0022375

Dörner, D., and Güss, C. D. (2013). PSI: a computational architecture of cognition, motivation, and emotion. Rev. Gen. Psychol. 17, 297–317. doi: 10.1037/a0032947

Dörner, D., Kreuzig, H. W., Reither, F., and Stäudel, T. (1983). Lohhausen. Vom Umgang mit Unbestimmtheit und Komplexität. Bern: Huber.

Ederer, P., Patt, A., and Greiff, S. (2016). Complex problem-solving skills and innovativeness – evidence from occupational testing and regional data. Eur. J. Educ. 51, 244–256. doi: 10.1111/ejed.12176

Edwards, W. (1962). Dynamic decision theory and probabiIistic information processing. Hum. Factors 4, 59–73. doi: 10.1177/001872086200400201

Engelhart, M., Funke, J., and Sager, S. (2017). A web-based feedback study on optimization-based training and analysis of human decision making. J. Dynamic Dec. Mak. 3, 1–23.

Ericsson, K. A., and Simon, H. A. (1983). Protocol Analysis: Verbal Reports As Data. Cambridge, MA: Bradford.

Fischer, A., Greiff, S., and Funke, J. (2017). “The history of complex problem solving,” in The Nature of Problem Solving: Using Research to Inspire 21st Century Learning , eds B. Csapó and J. Funke (Paris: OECD Publishing), 107–121.

Fischer, A., Holt, D. V., and Funke, J. (2015). Promoting the growing field of dynamic decision making. J. Dynamic Decis. Mak. 1, 1–3. doi: 10.11588/jddm.2015.1.23807

Fischer, A., Holt, D. V., and Funke, J. (2016). The first year of the “journal of dynamic decision making.” J. Dynamic Decis. Mak. 2, 1–2. doi: 10.11588/jddm.2016.1.28995

Fischer, A., and Neubert, J. C. (2015). The multiple faces of complex problems: a model of problem solving competency and its implications for training and assessment. J. Dynamic Decis. Mak. 1, 1–14. doi: 10.11588/jddm.2015.1.23945

Frensch, P. A., and Funke, J. (eds) (1995a). Complex Problem Solving: The European Perspective. Hillsdale, NJ: Erlbaum.

Frensch, P. A., and Funke, J. (1995b). “Definitions, traditions, and a general framework for understanding complex problem solving,” in Complex Problem Solving: The European Perspective , eds P. A. Frensch and J. Funke (Hillsdale, NJ: Lawrence Erlbaum), 3–25.

Frischkorn, G. T., Greiff, S., and Wüstenberg, S. (2014). The development of complex problem solving in adolescence: a latent growth curve analysis. J. Educ. Psychol. 106, 1004–1020. doi: 10.1037/a0037114

Funke, J. (1985). Steuerung dynamischer Systeme durch Aufbau und Anwendung subjektiver Kausalmodelle. Z. Psychol. 193, 435–457.

Funke, J. (1986). Komplexes Problemlösen - Bestandsaufnahme und Perspektiven [Complex Problem Solving: Survey and Perspectives]. Heidelberg: Springer.

Funke, J. (1993). “Microworlds based on linear equation systems: a new approach to complex problem solving and experimental results,” in The Cognitive Psychology of Knowledge , eds G. Strube and K.-F. Wender (Amsterdam: Elsevier Science Publishers), 313–330.

Funke, J. (1995). “Experimental research on complex problem solving,” in Complex Problem Solving: The European Perspective , eds P. A. Frensch and J. Funke (Hillsdale, NJ: Erlbaum), 243–268.

Funke, J. (2010). Complex problem solving: a case for complex cognition? Cogn. Process. 11, 133–142. doi: 10.1007/s10339-009-0345-0

Funke, J. (2012). “Complex problem solving,” in Encyclopedia of the Sciences of Learning , Vol. 38, ed. N. M. Seel (Heidelberg: Springer), 682–685.

Funke, J. (2014a). Analysis of minimal complex systems and complex problem solving require different forms of causal cognition. Front. Psychol. 5:739. doi: 10.3389/fpsyg.2014.00739

Funke, J. (2014b). “Problem solving: what are the important questions?,” in Proceedings of the 36th Annual Conference of the Cognitive Science Society , eds P. Bello, M. Guarini, M. McShane, and B. Scassellati (Austin, TX: Cognitive Science Society), 493–498.

Funke, J., Fischer, A., and Holt, D. V. (2017). When less is less: solving multiple simple problems is not complex problem solving—A comment on Greiff et al. (2015). J. Intell. 5:5. doi: 10.3390/jintelligence5010005

Funke, J., Fischer, A., and Holt, D. V. (2018). “Competencies for complexity: problem solving in the 21st century,” in Assessment and Teaching of 21st Century Skills , eds E. Care, P. Griffin, and M. Wilson (Dordrecht: Springer), 3.

Funke, J., and Greiff, S. (2017). “Dynamic problem solving: multiple-item testing based on minimally complex systems,” in Competence Assessment in Education. Research, Models and Instruments , eds D. Leutner, J. Fleischer, J. Grünkorn, and E. Klieme (Heidelberg: Springer), 427–443.

Gobert, J. D., Kim, Y. J., Pedro, M. A. S., Kennedy, M., and Betts, C. G. (2015). Using educational data mining to assess students’ skills at designing and conducting experiments within a complex systems microworld. Think. Skills Creat. 18, 81–90. doi: 10.1016/j.tsc.2015.04.008

Goode, N., and Beckmann, J. F. (2010). You need to know: there is a causal relationship between structural knowledge and control performance in complex problem solving tasks. Intelligence 38, 345–352. doi: 10.1016/j.intell.2010.01.001

Gray, W. D. (2002). Simulated task environments: the role of high-fidelity simulations, scaled worlds, synthetic environments, and laboratory tasks in basic and applied cognitive research. Cogn. Sci. Q. 2, 205–227.

Greiff, S., and Fischer, A. (2013). Measuring complex problem solving: an educational application of psychological theories. J. Educ. Res. 5, 38–58.

Greiff, S., Fischer, A., Stadler, M., and Wüstenberg, S. (2015a). Assessing complex problem-solving skills with multiple complex systems. Think. Reason. 21, 356–382. doi: 10.1080/13546783.2014.989263

Greiff, S., Stadler, M., Sonnleitner, P., Wolff, C., and Martin, R. (2015b). Sometimes less is more: comparing the validity of complex problem solving measures. Intelligence 50, 100–113. doi: 10.1016/j.intell.2015.02.007

Greiff, S., Fischer, A., Wüstenberg, S., Sonnleitner, P., Brunner, M., and Martin, R. (2013a). A multitrait–multimethod study of assessment instruments for complex problem solving. Intelligence 41, 579–596. doi: 10.1016/j.intell.2013.07.012

Greiff, S., Holt, D. V., and Funke, J. (2013b). Perspectives on problem solving in educational assessment: analytical, interactive, and collaborative problem solving. J. Problem Solv. 5, 71–91. doi: 10.7771/1932-6246.1153

Greiff, S., Wüstenberg, S., Molnár, G., Fischer, A., Funke, J., and Csapó, B. (2013c). Complex problem solving in educational contexts—something beyond g: concept, assessment, measurement invariance, and construct validity. J. Educ. Psychol. 105, 364–379. doi: 10.1037/a0031856

Greiff, S., and Funke, J. (2009). “Measuring complex problem solving: the MicroDYN approach,” in The Transition to Computer-Based Assessment. New Approaches to Skills Assessment and Implications for Large-Scale Testing , eds F. Scheuermann and J. Björnsson (Luxembourg: Office for Official Publications of the European Communities), 157–163.

Greiff, S., and Funke, J. (2017). “Interactive problem solving: exploring the potential of minimal complex systems,” in The Nature of Problem Solving: Using Research to Inspire 21st Century Learning , eds B. Csapó and J. Funke (Paris: OECD Publishing), 93–105.

Greiff, S., and Martin, R. (2014). What you see is what you (don’t) get: a comment on Funke’s (2014) opinion paper. Front. Psychol. 5:1120. doi: 10.3389/fpsyg.2014.01120

Greiff, S., and Neubert, J. C. (2014). On the relation of complex problem solving, personality, fluid intelligence, and academic achievement. Learn. Ind. Diff. 36, 37–48. doi: 10.1016/j.lindif.2014.08.003

Greiff, S., Niepel, C., Scherer, R., and Martin, R. (2016). Understanding students’ performance in a computer-based assessment of complex problem solving: an analysis of behavioral data from computer-generated log files. Comput. Hum. Behav. 61, 36–46. doi: 10.1016/j.chb.2016.02.095

Greiff, S., Stadler, M., Sonnleitner, P., Wolff, C., and Martin, R. (2017). Sometimes more is too much: a rejoinder to the commentaries on Greiff et al. (2015). J. Intell. 5:6. doi: 10.3390/jintelligence5010006

Greiff, S., and Wüstenberg, S. (2014). Assessment with microworlds using MicroDYN: measurement invariance and latent mean comparisons. Eur. J. Psychol. Assess. 1, 1–11. doi: 10.1027/1015-5759/a000194

Greiff, S., and Wüstenberg, S. (2015). Komplexer Problemlösetest COMPRO [Complex Problem-Solving Test COMPRO]. Mödling: Schuhfried.

Greiff, S., Wüstenberg, S., and Funke, J. (2012). Dynamic problem solving: a new assessment perspective. Appl. Psychol. Measure. 36, 189–213. doi: 10.1177/0146621612439620

Griffin, P., and Care, E. (2015). “The ATC21S method,” in Assessment and Taching of 21st Century Skills , eds P. Griffin and E. Care (Dordrecht, NL: Springer), 3–33.

Güss, C. D., and Dörner, D. (2011). Cultural differences in dynamic decision-making strategies in a non-linear, time-delayed task. Cogn. Syst. Res. 12, 365–376. doi: 10.1016/j.cogsys.2010.12.003

Güss, C. D., Tuason, M. T., and Orduña, L. V. (2015). Strategies, tactics, and errors in dynamic decision making in an Asian sample. J. Dynamic Deci. Mak. 1, 1–14. doi: 10.11588/jddm.2015.1.13131

Güss, C. D., and Wiley, B. (2007). Metacognition of problem-solving strategies in Brazil, India, and the United States. J. Cogn. Cult. 7, 1–25. doi: 10.1163/156853707X171793

Herde, C. N., Wüstenberg, S., and Greiff, S. (2016). Assessment of complex problem solving: what we know and what we don’t know. Appl. Meas. Educ. 29, 265–277. doi: 10.1080/08957347.2016.1209208

Hermes, M., and Stelling, D. (2016). Context matters, but how much? Latent state – trait analysis of cognitive ability assessments. Int. J. Sel. Assess. 24, 285–295. doi: 10.1111/ijsa.12147

Hotaling, J. M., Fakhari, P., and Busemeyer, J. R. (2015). “Dynamic decision making,” in International Encyclopedia of the Social & Behavioral Sciences , 2nd Edn, eds N. J. Smelser and P. B. Batles (New York, NY: Elsevier), 709–714.

Hundertmark, J., Holt, D. V., Fischer, A., Said, N., and Fischer, H. (2015). System structure and cognitive ability as predictors of performance in dynamic system control tasks. J. Dynamic Deci. Mak. 1, 1–10. doi: 10.11588/jddm.2015.1.26416

Jäkel, F., and Schreiber, C. (2013). Introspection in problem solving. J. Problem Solv. 6, 20–33. doi: 10.7771/1932-6246.1131

Jansson, A. (1994). Pathologies in dynamic decision making: consequences or precursors of failure? Sprache Kogn. 13, 160–173.

Kaufman, J. C., and Beghetto, R. A. (2009). Beyond big and little: the four c model of creativity. Rev. Gen. Psychol. 13, 1–12. doi: 10.1037/a0013688

Knauff, M., and Wolf, A. G. (2010). Complex cognition: the science of human reasoning, problem-solving, and decision-making. Cogn. Process. 11, 99–102. doi: 10.1007/s10339-010-0362-z

Kretzschmar, A. (2017). Sometimes less is not enough: a commentary on Greiff et al. (2015). J. Intell. 5:4. doi: 10.3390/jintelligence5010004

Kretzschmar, A., Neubert, J. C., Wüstenberg, S., and Greiff, S. (2016). Construct validity of complex problem solving: a comprehensive view on different facets of intelligence and school grades. Intelligence 54, 55–69. doi: 10.1016/j.intell.2015.11.004

Kretzschmar, A., and Süß, H.-M. (2015). A study on the training of complex problem solving competence. J. Dynamic Deci. Mak. 1, 1–14. doi: 10.11588/jddm.2015.1.15455

Lee, H., and Cho, Y. (2007). Factors affecting problem finding depending on degree of structure of problem situation. J. Educ. Res. 101, 113–123. doi: 10.3200/JOER.101.2.113-125

Leutner, D., Fleischer, J., Wirth, J., Greiff, S., and Funke, J. (2012). Analytische und dynamische Problemlösekompetenz im Lichte internationaler Schulleistungsvergleichsstudien: Untersuchungen zur Dimensionalität. Psychol. Rundschau 63, 34–42. doi: 10.1026/0033-3042/a000108

Luchins, A. S. (1942). Mechanization in problem solving: the effect of einstellung. Psychol. Monogr. 54, 1–95. doi: 10.1037/h0093502

Mack, O., Khare, A., Krämer, A., and Burgartz, T. (eds) (2016). Managing in a VUCA world. Heidelberg: Springer.

Mainert, J., Kretzschmar, A., Neubert, J. C., and Greiff, S. (2015). Linking complex problem solving and general mental ability to career advancement: does a transversal skill reveal incremental predictive validity? Int. J. Lifelong Educ. 34, 393–411. doi: 10.1080/02601370.2015.1060024

Mainzer, K. (2009). Challenges of complexity in the 21st century. An interdisciplinary introduction. Eur. Rev. 17, 219–236. doi: 10.1017/S1062798709000714

Meadows, D. H., Meadows, D. L., and Randers, J. (1992). Beyond the Limits. Vermont, VA: Chelsea Green Publishing.

Meadows, D. H., Meadows, D. L., Randers, J., and Behrens, W. W. (1972). The Limits to Growth. New York, NY: Universe Books.

Meißner, A., Greiff, S., Frischkorn, G. T., and Steinmayr, R. (2016). Predicting complex problem solving and school grades with working memory and ability self-concept. Learn. Ind. Differ. 49, 323–331. doi: 10.1016/j.lindif.2016.04.006

Molnàr, G., Greiff, S., Wüstenberg, S., and Fischer, A. (2017). “Empirical study of computer-based assessment of domain-general complex problem-solving skills,” in The Nature of Problem Solving: Using research to Inspire 21st Century Learning , eds B. Csapó and J. Funke (Paris: OECD Publishing), 125–141.

National Research Council (2011). Assessing 21st Century Skills: Summary of a Workshop. Washington, DC: The National Academies Press.

Newell, A., Shaw, J. C., and Simon, H. A. (1959). A general problem-solving program for a computer. Comput. Automat. 8, 10–16.

Nisbett, R. E., and Wilson, T. D. (1977). Telling more than we can know: verbal reports on mental processes. Psychol. Rev. 84, 231–259. doi: 10.1037/0033-295X.84.3.231

OECD (2014). “PISA 2012 results,” in Creative Problem Solving: Students’ Skills in Tackling Real-Life problems , Vol. 5 (Paris: OECD Publishing).

Osman, M. (2010). Controlling uncertainty: a review of human behavior in complex dynamic environments. Psychol. Bull. 136, 65–86. doi: 10.1037/a0017815

Osman, M. (2012). The role of reward in dynamic decision making. Front. Neurosci. 6:35. doi: 10.3389/fnins.2012.00035

Qudrat-Ullah, H. (2015). Better Decision Making in Complex, Dynamic Tasks. Training with Human-Facilitated Interactive Learning Environments. Heidelberg: Springer.

Ramnarayan, S., Strohschneider, S., and Schaub, H. (1997). Trappings of expertise and the pursuit of failure. Simulat. Gam. 28, 28–43. doi: 10.1177/1046878197281004

Reuschenbach, B. (2008). Planen und Problemlösen im Komplexen Handlungsfeld Pflege. Berlin: Logos.

Rohe, M., Funke, J., Storch, M., and Weber, J. (2016). Can motto goals outperform learning and performance goals? Influence of goal setting on performance, intrinsic motivation, processing style, and affect in a complex problem solving task. J. Dynamic Deci. Mak. 2, 1–15. doi: 10.11588/jddm.2016.1.28510

Scherer, R., Greiff, S., and Hautamäki, J. (2015). Exploring the relation between time on task and ability in complex problem solving. Intelligence 48, 37–50. doi: 10.1016/j.intell.2014.10.003

Schoppek, W., and Fischer, A. (2015). Complex problem solving – single ability or complex phenomenon? Front. Psychol. 6:1669. doi: 10.3389/fpsyg.2015.01669

Schraw, G., Dunkle, M., and Bendixen, L. D. (1995). Cognitive processes in well-defined and ill-defined problem solving. Appl. Cogn. Psychol. 9, 523–538. doi: 10.1002/acp.2350090605

Schweizer, F., Wüstenberg, S., and Greiff, S. (2013). Validity of the MicroDYN approach: complex problem solving predicts school grades beyond working memory capacity. Learn. Ind. Differ. 24, 42–52. doi: 10.1016/j.lindif.2012.12.011

Schweizer, T. S., Schmalenberger, K. M., Eisenlohr-Moul, T. A., Mojzisch, A., Kaiser, S., and Funke, J. (2016). Cognitive and affective aspects of creative option generation in everyday life situations. Front. Psychol. 7:1132. doi: 10.3389/fpsyg.2016.01132

Selten, R., Pittnauer, S., and Hohnisch, M. (2012). Dealing with dynamic decision problems when knowledge of the environment is limited: an approach based on goal systems. J. Behav. Deci. Mak. 25, 443–457. doi: 10.1002/bdm.738

Simon, H. A. (1957). Administrative Behavior: A Study of Decision-Making Processes in Administrative Organizations , 2nd Edn. New York, NY: Macmillan.

Sonnleitner, P., Brunner, M., Keller, U., and Martin, R. (2014). Differential relations between facets of complex problem solving and students’ immigration background. J. Educ. Psychol. 106, 681–695. doi: 10.1037/a0035506

Spering, M., Wagener, D., and Funke, J. (2005). The role of emotions in complex problem solving. Cogn. Emot. 19, 1252–1261. doi: 10.1080/02699930500304886

Stadler, M., Becker, N., Gödker, M., Leutner, D., and Greiff, S. (2015). Complex problem solving and intelligence: a meta-analysis. Intelligence 53, 92–101. doi: 10.1016/j.intell.2015.09.005

Stadler, M., Niepel, C., and Greiff, S. (2016). Easily too difficult: estimating item difficulty in computer simulated microworlds. Comput. Hum. Behav. 65, 100–106. doi: 10.1016/j.chb.2016.08.025

Sternberg, R. J. (1995). “Expertise in complex problem solving: a comparison of alternative conceptions,” in Complex Problem Solving: The European Perspective , eds P. A. Frensch and J. Funke (Hillsdale, NJ: Erlbaum), 295–321.

Sternberg, R. J., and Frensch, P. A. (1991). Complex Problem Solving: Principles and Mechanisms. (eds) R. J. Sternberg and P. A. Frensch. Hillsdale, NJ: Erlbaum.

Strohschneider, S., and Güss, C. D. (1998). Planning and problem solving: differences between brazilian and german students. J. Cross-Cult. Psychol. 29, 695–716. doi: 10.1177/0022022198296002

Strohschneider, S., and Güss, C. D. (1999). The fate of the Moros: a cross-cultural exploration of strategies in complex and dynamic decision making. Int. J. Psychol. 34, 235–252. doi: 10.1080/002075999399873

Thimbleby, H. (2007). Press On. Principles of Interaction. Cambridge, MA: MIT Press.

Tobinski, D. A., and Fritz, A. (2017). “EcoSphere: a new paradigm for problem solving in complex systems,” in The Nature of Problem Solving: Using Research to Inspire 21st Century Learning , eds B. Csapó and J. Funke (Paris: OECD Publishing), 211–222.

Tremblay, S., Gagnon, J.-F., Lafond, D., Hodgetts, H. M., Doiron, M., and Jeuniaux, P. P. J. M. H. (2017). A cognitive prosthesis for complex decision-making. Appl. Ergon. 58, 349–360. doi: 10.1016/j.apergo.2016.07.009

Tschirgi, J. E. (1980). Sensible reasoning: a hypothesis about hypotheses. Child Dev. 51, 1–10. doi: 10.2307/1129583

Tuchman, B. W. (1984). The March of Folly. From Troy to Vietnam. New York, NY: Ballantine Books.

Verweij, M., and Thompson, M. (eds) (2006). Clumsy Solutions for A Complex World. Governance, Politics and Plural Perceptions. New York, NY: Palgrave Macmillan. doi: 10.1057/9780230624887

Viehrig, K., Siegmund, A., Funke, J., Wüstenberg, S., and Greiff, S. (2017). “The heidelberg inventory of geographic system competency model,” in Competence Assessment in Education. Research, Models and Instruments , eds D. Leutner, J. Fleischer, J. Grünkorn, and E. Klieme (Heidelberg: Springer), 31–53.

von Clausewitz, C. (1832). Vom Kriege [On war]. Berlin: Dämmler.

Wendt, A. N. (2017). The empirical potential of live streaming beyond cognitive psychology. J. Dynamic Deci. Mak. 3, 1–9. doi: 10.11588/jddm.2017.1.33724

Wiliam, D., and Black, P. (1996). Meanings and consequences: a basis for distinguishing formative and summative functions of assessment? Br. Educ. Res. J. 22, 537–548. doi: 10.1080/0141192960220502

World Economic Forum (2015). New Vsion for Education Unlocking the Potential of Technology. Geneva: World Economic Forum.

World Economic Forum (2016). Global Risks 2016: Insight Report , 11th Edn. Geneva: World Economic Forum.

Wüstenberg, S., Greiff, S., and Funke, J. (2012). Complex problem solving — more than reasoning? Intelligence 40, 1–14. doi: 10.1016/j.intell.2011.11.003

Wüstenberg, S., Greiff, S., Vainikainen, M.-P., and Murphy, K. (2016). Individual differences in students’ complex problem solving skills: how they evolve and what they imply. J. Educ. Psychol. 108, 1028–1044. doi: 10.1037/edu0000101

Wüstenberg, S., Stadler, M., Hautamäki, J., and Greiff, S. (2014). The role of strategy knowledge for the application of strategies in complex problem solving tasks. Technol. Knowl. Learn. 19, 127–146. doi: 10.1007/s10758-014-9222-8

Keywords : complex problem solving, validity, assessment, definition, MicroDYN

Citation: Dörner D and Funke J (2017) Complex Problem Solving: What It Is and What It Is Not. Front. Psychol. 8:1153. doi: 10.3389/fpsyg.2017.01153

Received: 14 March 2017; Accepted: 23 June 2017; Published: 11 July 2017.

Reviewed by:

Copyright © 2017 Dörner and Funke. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY) . The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Joachim Funke, [email protected]

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

  • Search Menu
  • Browse content in Arts and Humanities
  • Browse content in Archaeology
  • Anglo-Saxon and Medieval Archaeology
  • Archaeological Methodology and Techniques
  • Archaeology by Region
  • Archaeology of Religion
  • Archaeology of Trade and Exchange
  • Biblical Archaeology
  • Contemporary and Public Archaeology
  • Environmental Archaeology
  • Historical Archaeology
  • History and Theory of Archaeology
  • Industrial Archaeology
  • Landscape Archaeology
  • Mortuary Archaeology
  • Prehistoric Archaeology
  • Underwater Archaeology
  • Urban Archaeology
  • Zooarchaeology
  • Browse content in Architecture
  • Architectural Structure and Design
  • History of Architecture
  • Residential and Domestic Buildings
  • Theory of Architecture
  • Browse content in Art
  • Art Subjects and Themes
  • History of Art
  • Industrial and Commercial Art
  • Theory of Art
  • Biographical Studies
  • Byzantine Studies
  • Browse content in Classical Studies
  • Classical History
  • Classical Philosophy
  • Classical Mythology
  • Classical Literature
  • Classical Reception
  • Classical Art and Architecture
  • Classical Oratory and Rhetoric
  • Greek and Roman Epigraphy
  • Greek and Roman Law
  • Greek and Roman Papyrology
  • Greek and Roman Archaeology
  • Late Antiquity
  • Religion in the Ancient World
  • Digital Humanities
  • Browse content in History
  • Colonialism and Imperialism
  • Diplomatic History
  • Environmental History
  • Genealogy, Heraldry, Names, and Honours
  • Genocide and Ethnic Cleansing
  • Historical Geography
  • History by Period
  • History of Emotions
  • History of Agriculture
  • History of Education
  • History of Gender and Sexuality
  • Industrial History
  • Intellectual History
  • International History
  • Labour History
  • Legal and Constitutional History
  • Local and Family History
  • Maritime History
  • Military History
  • National Liberation and Post-Colonialism
  • Oral History
  • Political History
  • Public History
  • Regional and National History
  • Revolutions and Rebellions
  • Slavery and Abolition of Slavery
  • Social and Cultural History
  • Theory, Methods, and Historiography
  • Urban History
  • World History
  • Browse content in Language Teaching and Learning
  • Language Learning (Specific Skills)
  • Language Teaching Theory and Methods
  • Browse content in Linguistics
  • Applied Linguistics
  • Cognitive Linguistics
  • Computational Linguistics
  • Forensic Linguistics
  • Grammar, Syntax and Morphology
  • Historical and Diachronic Linguistics
  • History of English
  • Language Acquisition
  • Language Evolution
  • Language Reference
  • Language Variation
  • Language Families
  • Lexicography
  • Linguistic Anthropology
  • Linguistic Theories
  • Linguistic Typology
  • Phonetics and Phonology
  • Psycholinguistics
  • Sociolinguistics
  • Translation and Interpretation
  • Writing Systems
  • Browse content in Literature
  • Bibliography
  • Children's Literature Studies
  • Literary Studies (Asian)
  • Literary Studies (European)
  • Literary Studies (Eco-criticism)
  • Literary Studies (Romanticism)
  • Literary Studies (American)
  • Literary Studies (Modernism)
  • Literary Studies - World
  • Literary Studies (1500 to 1800)
  • Literary Studies (19th Century)
  • Literary Studies (20th Century onwards)
  • Literary Studies (African American Literature)
  • Literary Studies (British and Irish)
  • Literary Studies (Early and Medieval)
  • Literary Studies (Fiction, Novelists, and Prose Writers)
  • Literary Studies (Gender Studies)
  • Literary Studies (Graphic Novels)
  • Literary Studies (History of the Book)
  • Literary Studies (Plays and Playwrights)
  • Literary Studies (Poetry and Poets)
  • Literary Studies (Postcolonial Literature)
  • Literary Studies (Queer Studies)
  • Literary Studies (Science Fiction)
  • Literary Studies (Travel Literature)
  • Literary Studies (War Literature)
  • Literary Studies (Women's Writing)
  • Literary Theory and Cultural Studies
  • Mythology and Folklore
  • Shakespeare Studies and Criticism
  • Browse content in Media Studies
  • Browse content in Music
  • Applied Music
  • Dance and Music
  • Ethics in Music
  • Ethnomusicology
  • Gender and Sexuality in Music
  • Medicine and Music
  • Music Cultures
  • Music and Religion
  • Music and Media
  • Music and Culture
  • Music Education and Pedagogy
  • Music Theory and Analysis
  • Musical Scores, Lyrics, and Libretti
  • Musical Structures, Styles, and Techniques
  • Musicology and Music History
  • Performance Practice and Studies
  • Race and Ethnicity in Music
  • Sound Studies
  • Browse content in Performing Arts
  • Browse content in Philosophy
  • Aesthetics and Philosophy of Art
  • Epistemology
  • Feminist Philosophy
  • History of Western Philosophy
  • Metaphysics
  • Moral Philosophy
  • Non-Western Philosophy
  • Philosophy of Science
  • Philosophy of Language
  • Philosophy of Mind
  • Philosophy of Perception
  • Philosophy of Action
  • Philosophy of Law
  • Philosophy of Religion
  • Philosophy of Mathematics and Logic
  • Practical Ethics
  • Social and Political Philosophy
  • Browse content in Religion
  • Biblical Studies
  • Christianity
  • East Asian Religions
  • History of Religion
  • Judaism and Jewish Studies
  • Qumran Studies
  • Religion and Education
  • Religion and Health
  • Religion and Politics
  • Religion and Science
  • Religion and Law
  • Religion and Art, Literature, and Music
  • Religious Studies
  • Browse content in Society and Culture
  • Cookery, Food, and Drink
  • Cultural Studies
  • Customs and Traditions
  • Ethical Issues and Debates
  • Hobbies, Games, Arts and Crafts
  • Lifestyle, Home, and Garden
  • Natural world, Country Life, and Pets
  • Popular Beliefs and Controversial Knowledge
  • Sports and Outdoor Recreation
  • Technology and Society
  • Travel and Holiday
  • Visual Culture
  • Browse content in Law
  • Arbitration
  • Browse content in Company and Commercial Law
  • Commercial Law
  • Company Law
  • Browse content in Comparative Law
  • Systems of Law
  • Competition Law
  • Browse content in Constitutional and Administrative Law
  • Government Powers
  • Judicial Review
  • Local Government Law
  • Military and Defence Law
  • Parliamentary and Legislative Practice
  • Construction Law
  • Contract Law
  • Browse content in Criminal Law
  • Criminal Procedure
  • Criminal Evidence Law
  • Sentencing and Punishment
  • Employment and Labour Law
  • Environment and Energy Law
  • Browse content in Financial Law
  • Banking Law
  • Insolvency Law
  • History of Law
  • Human Rights and Immigration
  • Intellectual Property Law
  • Browse content in International Law
  • Private International Law and Conflict of Laws
  • Public International Law
  • IT and Communications Law
  • Jurisprudence and Philosophy of Law
  • Law and Politics
  • Law and Society
  • Browse content in Legal System and Practice
  • Courts and Procedure
  • Legal Skills and Practice
  • Primary Sources of Law
  • Regulation of Legal Profession
  • Medical and Healthcare Law
  • Browse content in Policing
  • Criminal Investigation and Detection
  • Police and Security Services
  • Police Procedure and Law
  • Police Regional Planning
  • Browse content in Property Law
  • Personal Property Law
  • Study and Revision
  • Terrorism and National Security Law
  • Browse content in Trusts Law
  • Wills and Probate or Succession
  • Browse content in Medicine and Health
  • Browse content in Allied Health Professions
  • Arts Therapies
  • Clinical Science
  • Dietetics and Nutrition
  • Occupational Therapy
  • Operating Department Practice
  • Physiotherapy
  • Radiography
  • Speech and Language Therapy
  • Browse content in Anaesthetics
  • General Anaesthesia
  • Neuroanaesthesia
  • Browse content in Clinical Medicine
  • Acute Medicine
  • Cardiovascular Medicine
  • Clinical Genetics
  • Clinical Pharmacology and Therapeutics
  • Dermatology
  • Endocrinology and Diabetes
  • Gastroenterology
  • Genito-urinary Medicine
  • Geriatric Medicine
  • Infectious Diseases
  • Medical Toxicology
  • Medical Oncology
  • Pain Medicine
  • Palliative Medicine
  • Rehabilitation Medicine
  • Respiratory Medicine and Pulmonology
  • Rheumatology
  • Sleep Medicine
  • Sports and Exercise Medicine
  • Clinical Neuroscience
  • Community Medical Services
  • Critical Care
  • Emergency Medicine
  • Forensic Medicine
  • Haematology
  • History of Medicine
  • Browse content in Medical Dentistry
  • Oral and Maxillofacial Surgery
  • Paediatric Dentistry
  • Restorative Dentistry and Orthodontics
  • Surgical Dentistry
  • Browse content in Medical Skills
  • Clinical Skills
  • Communication Skills
  • Nursing Skills
  • Surgical Skills
  • Medical Ethics
  • Medical Statistics and Methodology
  • Browse content in Neurology
  • Clinical Neurophysiology
  • Neuropathology
  • Nursing Studies
  • Browse content in Obstetrics and Gynaecology
  • Gynaecology
  • Occupational Medicine
  • Ophthalmology
  • Otolaryngology (ENT)
  • Browse content in Paediatrics
  • Neonatology
  • Browse content in Pathology
  • Chemical Pathology
  • Clinical Cytogenetics and Molecular Genetics
  • Histopathology
  • Medical Microbiology and Virology
  • Patient Education and Information
  • Browse content in Pharmacology
  • Psychopharmacology
  • Browse content in Popular Health
  • Caring for Others
  • Complementary and Alternative Medicine
  • Self-help and Personal Development
  • Browse content in Preclinical Medicine
  • Cell Biology
  • Molecular Biology and Genetics
  • Reproduction, Growth and Development
  • Primary Care
  • Professional Development in Medicine
  • Browse content in Psychiatry
  • Addiction Medicine
  • Child and Adolescent Psychiatry
  • Forensic Psychiatry
  • Learning Disabilities
  • Old Age Psychiatry
  • Psychotherapy
  • Browse content in Public Health and Epidemiology
  • Epidemiology
  • Public Health
  • Browse content in Radiology
  • Clinical Radiology
  • Interventional Radiology
  • Nuclear Medicine
  • Radiation Oncology
  • Reproductive Medicine
  • Browse content in Surgery
  • Cardiothoracic Surgery
  • Gastro-intestinal and Colorectal Surgery
  • General Surgery
  • Neurosurgery
  • Paediatric Surgery
  • Peri-operative Care
  • Plastic and Reconstructive Surgery
  • Surgical Oncology
  • Transplant Surgery
  • Trauma and Orthopaedic Surgery
  • Vascular Surgery
  • Browse content in Science and Mathematics
  • Browse content in Biological Sciences
  • Aquatic Biology
  • Biochemistry
  • Bioinformatics and Computational Biology
  • Developmental Biology
  • Ecology and Conservation
  • Evolutionary Biology
  • Genetics and Genomics
  • Microbiology
  • Molecular and Cell Biology
  • Natural History
  • Plant Sciences and Forestry
  • Research Methods in Life Sciences
  • Structural Biology
  • Systems Biology
  • Zoology and Animal Sciences
  • Browse content in Chemistry
  • Analytical Chemistry
  • Computational Chemistry
  • Crystallography
  • Environmental Chemistry
  • Industrial Chemistry
  • Inorganic Chemistry
  • Materials Chemistry
  • Medicinal Chemistry
  • Mineralogy and Gems
  • Organic Chemistry
  • Physical Chemistry
  • Polymer Chemistry
  • Study and Communication Skills in Chemistry
  • Theoretical Chemistry
  • Browse content in Computer Science
  • Artificial Intelligence
  • Computer Architecture and Logic Design
  • Game Studies
  • Human-Computer Interaction
  • Mathematical Theory of Computation
  • Programming Languages
  • Software Engineering
  • Systems Analysis and Design
  • Virtual Reality
  • Browse content in Computing
  • Business Applications
  • Computer Security
  • Computer Games
  • Computer Networking and Communications
  • Digital Lifestyle
  • Graphical and Digital Media Applications
  • Operating Systems
  • Browse content in Earth Sciences and Geography
  • Atmospheric Sciences
  • Environmental Geography
  • Geology and the Lithosphere
  • Maps and Map-making
  • Meteorology and Climatology
  • Oceanography and Hydrology
  • Palaeontology
  • Physical Geography and Topography
  • Regional Geography
  • Soil Science
  • Urban Geography
  • Browse content in Engineering and Technology
  • Agriculture and Farming
  • Biological Engineering
  • Civil Engineering, Surveying, and Building
  • Electronics and Communications Engineering
  • Energy Technology
  • Engineering (General)
  • Environmental Science, Engineering, and Technology
  • History of Engineering and Technology
  • Mechanical Engineering and Materials
  • Technology of Industrial Chemistry
  • Transport Technology and Trades
  • Browse content in Environmental Science
  • Applied Ecology (Environmental Science)
  • Conservation of the Environment (Environmental Science)
  • Environmental Sustainability
  • Environmentalist Thought and Ideology (Environmental Science)
  • Management of Land and Natural Resources (Environmental Science)
  • Natural Disasters (Environmental Science)
  • Nuclear Issues (Environmental Science)
  • Pollution and Threats to the Environment (Environmental Science)
  • Social Impact of Environmental Issues (Environmental Science)
  • History of Science and Technology
  • Browse content in Materials Science
  • Ceramics and Glasses
  • Composite Materials
  • Metals, Alloying, and Corrosion
  • Nanotechnology
  • Browse content in Mathematics
  • Applied Mathematics
  • Biomathematics and Statistics
  • History of Mathematics
  • Mathematical Education
  • Mathematical Finance
  • Mathematical Analysis
  • Numerical and Computational Mathematics
  • Probability and Statistics
  • Pure Mathematics
  • Browse content in Neuroscience
  • Cognition and Behavioural Neuroscience
  • Development of the Nervous System
  • Disorders of the Nervous System
  • History of Neuroscience
  • Invertebrate Neurobiology
  • Molecular and Cellular Systems
  • Neuroendocrinology and Autonomic Nervous System
  • Neuroscientific Techniques
  • Sensory and Motor Systems
  • Browse content in Physics
  • Astronomy and Astrophysics
  • Atomic, Molecular, and Optical Physics
  • Biological and Medical Physics
  • Classical Mechanics
  • Computational Physics
  • Condensed Matter Physics
  • Electromagnetism, Optics, and Acoustics
  • History of Physics
  • Mathematical and Statistical Physics
  • Measurement Science
  • Nuclear Physics
  • Particles and Fields
  • Plasma Physics
  • Quantum Physics
  • Relativity and Gravitation
  • Semiconductor and Mesoscopic Physics
  • Browse content in Psychology
  • Affective Sciences
  • Clinical Psychology
  • Cognitive Psychology
  • Cognitive Neuroscience
  • Criminal and Forensic Psychology
  • Developmental Psychology
  • Educational Psychology
  • Evolutionary Psychology
  • Health Psychology
  • History and Systems in Psychology
  • Music Psychology
  • Neuropsychology
  • Organizational Psychology
  • Psychological Assessment and Testing
  • Psychology of Human-Technology Interaction
  • Psychology Professional Development and Training
  • Research Methods in Psychology
  • Social Psychology
  • Browse content in Social Sciences
  • Browse content in Anthropology
  • Anthropology of Religion
  • Human Evolution
  • Medical Anthropology
  • Physical Anthropology
  • Regional Anthropology
  • Social and Cultural Anthropology
  • Theory and Practice of Anthropology
  • Browse content in Business and Management
  • Business Strategy
  • Business Ethics
  • Business History
  • Business and Government
  • Business and Technology
  • Business and the Environment
  • Comparative Management
  • Corporate Governance
  • Corporate Social Responsibility
  • Entrepreneurship
  • Health Management
  • Human Resource Management
  • Industrial and Employment Relations
  • Industry Studies
  • Information and Communication Technologies
  • International Business
  • Knowledge Management
  • Management and Management Techniques
  • Operations Management
  • Organizational Theory and Behaviour
  • Pensions and Pension Management
  • Public and Nonprofit Management
  • Strategic Management
  • Supply Chain Management
  • Browse content in Criminology and Criminal Justice
  • Criminal Justice
  • Criminology
  • Forms of Crime
  • International and Comparative Criminology
  • Youth Violence and Juvenile Justice
  • Development Studies
  • Browse content in Economics
  • Agricultural, Environmental, and Natural Resource Economics
  • Asian Economics
  • Behavioural Finance
  • Behavioural Economics and Neuroeconomics
  • Econometrics and Mathematical Economics
  • Economic Systems
  • Economic History
  • Economic Methodology
  • Economic Development and Growth
  • Financial Markets
  • Financial Institutions and Services
  • General Economics and Teaching
  • Health, Education, and Welfare
  • History of Economic Thought
  • International Economics
  • Labour and Demographic Economics
  • Law and Economics
  • Macroeconomics and Monetary Economics
  • Microeconomics
  • Public Economics
  • Urban, Rural, and Regional Economics
  • Welfare Economics
  • Browse content in Education
  • Adult Education and Continuous Learning
  • Care and Counselling of Students
  • Early Childhood and Elementary Education
  • Educational Equipment and Technology
  • Educational Strategies and Policy
  • Higher and Further Education
  • Organization and Management of Education
  • Philosophy and Theory of Education
  • Schools Studies
  • Secondary Education
  • Teaching of a Specific Subject
  • Teaching of Specific Groups and Special Educational Needs
  • Teaching Skills and Techniques
  • Browse content in Environment
  • Applied Ecology (Social Science)
  • Climate Change
  • Conservation of the Environment (Social Science)
  • Environmentalist Thought and Ideology (Social Science)
  • Natural Disasters (Environment)
  • Social Impact of Environmental Issues (Social Science)
  • Browse content in Human Geography
  • Cultural Geography
  • Economic Geography
  • Political Geography
  • Browse content in Interdisciplinary Studies
  • Communication Studies
  • Museums, Libraries, and Information Sciences
  • Browse content in Politics
  • African Politics
  • Asian Politics
  • Chinese Politics
  • Comparative Politics
  • Conflict Politics
  • Elections and Electoral Studies
  • Environmental Politics
  • European Union
  • Foreign Policy
  • Gender and Politics
  • Human Rights and Politics
  • Indian Politics
  • International Relations
  • International Organization (Politics)
  • International Political Economy
  • Irish Politics
  • Latin American Politics
  • Middle Eastern Politics
  • Political Methodology
  • Political Communication
  • Political Philosophy
  • Political Sociology
  • Political Behaviour
  • Political Economy
  • Political Institutions
  • Political Theory
  • Politics and Law
  • Public Administration
  • Public Policy
  • Quantitative Political Methodology
  • Regional Political Studies
  • Russian Politics
  • Security Studies
  • State and Local Government
  • UK Politics
  • US Politics
  • Browse content in Regional and Area Studies
  • African Studies
  • Asian Studies
  • East Asian Studies
  • Japanese Studies
  • Latin American Studies
  • Middle Eastern Studies
  • Native American Studies
  • Scottish Studies
  • Browse content in Research and Information
  • Research Methods
  • Browse content in Social Work
  • Addictions and Substance Misuse
  • Adoption and Fostering
  • Care of the Elderly
  • Child and Adolescent Social Work
  • Couple and Family Social Work
  • Developmental and Physical Disabilities Social Work
  • Direct Practice and Clinical Social Work
  • Emergency Services
  • Human Behaviour and the Social Environment
  • International and Global Issues in Social Work
  • Mental and Behavioural Health
  • Social Justice and Human Rights
  • Social Policy and Advocacy
  • Social Work and Crime and Justice
  • Social Work Macro Practice
  • Social Work Practice Settings
  • Social Work Research and Evidence-based Practice
  • Welfare and Benefit Systems
  • Browse content in Sociology
  • Childhood Studies
  • Community Development
  • Comparative and Historical Sociology
  • Economic Sociology
  • Gender and Sexuality
  • Gerontology and Ageing
  • Health, Illness, and Medicine
  • Marriage and the Family
  • Migration Studies
  • Occupations, Professions, and Work
  • Organizations
  • Population and Demography
  • Race and Ethnicity
  • Social Theory
  • Social Movements and Social Change
  • Social Research and Statistics
  • Social Stratification, Inequality, and Mobility
  • Sociology of Religion
  • Sociology of Education
  • Sport and Leisure
  • Urban and Rural Studies
  • Browse content in Warfare and Defence
  • Defence Strategy, Planning, and Research
  • Land Forces and Warfare
  • Military Administration
  • Military Life and Institutions
  • Naval Forces and Warfare
  • Other Warfare and Defence Issues
  • Peace Studies and Conflict Resolution
  • Weapons and Equipment

The Oxford Handbook of Cognitive Psychology

  • < Previous chapter
  • Next chapter >

48 Problem Solving

Department of Psychological and Brain Sciences, University of California, Santa Barbara

  • Published: 03 June 2013
  • Cite Icon Cite
  • Permissions Icon Permissions

Problem solving refers to cognitive processing directed at achieving a goal when the problem solver does not initially know a solution method. A problem exists when someone has a goal but does not know how to achieve it. Problems can be classified as routine or nonroutine, and as well defined or ill defined. The major cognitive processes in problem solving are representing, planning, executing, and monitoring. The major kinds of knowledge required for problem solving are facts, concepts, procedures, strategies, and beliefs. Classic theoretical approaches to the study of problem solving are associationism, Gestalt, and information processing. Current issues and suggested future issues include decision making, intelligence and creativity, teaching of thinking skills, expert problem solving, analogical reasoning, mathematical and scientific thinking, everyday thinking, and the cognitive neuroscience of problem solving. Common themes concern the domain specificity of problem solving and a focus on problem solving in authentic contexts.

The study of problem solving begins with defining problem solving, problem, and problem types. This introduction to problem solving is rounded out with an examination of cognitive processes in problem solving, the role of knowledge in problem solving, and historical approaches to the study of problem solving.

Definition of Problem Solving

Problem solving refers to cognitive processing directed at achieving a goal for which the problem solver does not initially know a solution method. This definition consists of four major elements (Mayer, 1992 ; Mayer & Wittrock, 2006 ):

Cognitive —Problem solving occurs within the problem solver’s cognitive system and can only be inferred indirectly from the problem solver’s behavior (including biological changes, introspections, and actions during problem solving). Process —Problem solving involves mental computations in which some operation is applied to a mental representation, sometimes resulting in the creation of a new mental representation. Directed —Problem solving is aimed at achieving a goal. Personal —Problem solving depends on the existing knowledge of the problem solver so that what is a problem for one problem solver may not be a problem for someone who already knows a solution method.

The definition is broad enough to include a wide array of cognitive activities such as deciding which apartment to rent, figuring out how to use a cell phone interface, playing a game of chess, making a medical diagnosis, finding the answer to an arithmetic word problem, or writing a chapter for a handbook. Problem solving is pervasive in human life and is crucial for human survival. Although this chapter focuses on problem solving in humans, problem solving also occurs in nonhuman animals and in intelligent machines.

How is problem solving related to other forms of high-level cognition processing, such as thinking and reasoning? Thinking refers to cognitive processing in individuals but includes both directed thinking (which corresponds to the definition of problem solving) and undirected thinking such as daydreaming (which does not correspond to the definition of problem solving). Thus, problem solving is a type of thinking (i.e., directed thinking).

Reasoning refers to problem solving within specific classes of problems, such as deductive reasoning or inductive reasoning. In deductive reasoning, the reasoner is given premises and must derive a conclusion by applying the rules of logic. For example, given that “A is greater than B” and “B is greater than C,” a reasoner can conclude that “A is greater than C.” In inductive reasoning, the reasoner is given (or has experienced) a collection of examples or instances and must infer a rule. For example, given that X, C, and V are in the “yes” group and x, c, and v are in the “no” group, the reasoning may conclude that B is in “yes” group because it is in uppercase format. Thus, reasoning is a type of problem solving.

Definition of Problem

A problem occurs when someone has a goal but does not know to achieve it. This definition is consistent with how the Gestalt psychologist Karl Duncker ( 1945 , p. 1) defined a problem in his classic monograph, On Problem Solving : “A problem arises when a living creature has a goal but does not know how this goal is to be reached.” However, today researchers recognize that the definition should be extended to include problem solving by intelligent machines. This definition can be clarified using an information processing approach by noting that a problem occurs when a situation is in the given state, the problem solver wants the situation to be in the goal state, and there is no obvious way to move from the given state to the goal state (Newell & Simon, 1972 ). Accordingly, the three main elements in describing a problem are the given state (i.e., the current state of the situation), the goal state (i.e., the desired state of the situation), and the set of allowable operators (i.e., the actions the problem solver is allowed to take). The definition of “problem” is broad enough to include the situation confronting a physician who wishes to make a diagnosis on the basis of preliminary tests and a patient examination, as well as a beginning physics student trying to solve a complex physics problem.

Types of Problems

It is customary in the problem-solving literature to make a distinction between routine and nonroutine problems. Routine problems are problems that are so familiar to the problem solver that the problem solver knows a solution method. For example, for most adults, “What is 365 divided by 12?” is a routine problem because they already know the procedure for long division. Nonroutine problems are so unfamiliar to the problem solver that the problem solver does not know a solution method. For example, figuring out the best way to set up a funding campaign for a nonprofit charity is a nonroutine problem for most volunteers. Technically, routine problems do not meet the definition of problem because the problem solver has a goal but knows how to achieve it. Much research on problem solving has focused on routine problems, although most interesting problems in life are nonroutine.

Another customary distinction is between well-defined and ill-defined problems. Well-defined problems have a clearly specified given state, goal state, and legal operators. Examples include arithmetic computation problems or games such as checkers or tic-tac-toe. Ill-defined problems have a poorly specified given state, goal state, or legal operators, or a combination of poorly defined features. Examples include solving the problem of global warming or finding a life partner. Although, ill-defined problems are more challenging, much research in problem solving has focused on well-defined problems.

Cognitive Processes in Problem Solving

The process of problem solving can be broken down into two main phases: problem representation , in which the problem solver builds a mental representation of the problem situation, and problem solution , in which the problem solver works to produce a solution. The major subprocess in problem representation is representing , which involves building a situation model —that is, a mental representation of the situation described in the problem. The major subprocesses in problem solution are planning , which involves devising a plan for how to solve the problem; executing , which involves carrying out the plan; and monitoring , which involves evaluating and adjusting one’s problem solving.

For example, given an arithmetic word problem such as “Alice has three marbles. Sarah has two more marbles than Alice. How many marbles does Sarah have?” the process of representing involves building a situation model in which Alice has a set of marbles, there is set of marbles for the difference between the two girls, and Sarah has a set of marbles that consists of Alice’s marbles and the difference set. In the planning process, the problem solver sets a goal of adding 3 and 2. In the executing process, the problem solver carries out the computation, yielding an answer of 5. In the monitoring process, the problem solver looks over what was done and concludes that 5 is a reasonable answer. In most complex problem-solving episodes, the four cognitive processes may not occur in linear order, but rather may interact with one another. Although some research focuses mainly on the execution process, problem solvers may tend to have more difficulty with the processes of representing, planning, and monitoring.

Knowledge for Problem Solving

An important theme in problem-solving research is that problem-solving proficiency on any task depends on the learner’s knowledge (Anderson et al., 2001 ; Mayer, 1992 ). Five kinds of knowledge are as follows:

Facts —factual knowledge about the characteristics of elements in the world, such as “Sacramento is the capital of California” Concepts —conceptual knowledge, including categories, schemas, or models, such as knowing the difference between plants and animals or knowing how a battery works Procedures —procedural knowledge of step-by-step processes, such as how to carry out long-division computations Strategies —strategic knowledge of general methods such as breaking a problem into parts or thinking of a related problem Beliefs —attitudinal knowledge about how one’s cognitive processing works such as thinking, “I’m good at this”

Although some research focuses mainly on the role of facts and procedures in problem solving, complex problem solving also depends on the problem solver’s concepts, strategies, and beliefs (Mayer, 1992 ).

Historical Approaches to Problem Solving

Psychological research on problem solving began in the early 1900s, as an outgrowth of mental philosophy (Humphrey, 1963 ; Mandler & Mandler, 1964 ). Throughout the 20th century four theoretical approaches developed: early conceptions, associationism, Gestalt psychology, and information processing.

Early Conceptions

The start of psychology as a science can be set at 1879—the year Wilhelm Wundt opened the first world’s psychology laboratory in Leipzig, Germany, and sought to train the world’s first cohort of experimental psychologists. Instead of relying solely on philosophical speculations about how the human mind works, Wundt sought to apply the methods of experimental science to issues addressed in mental philosophy. His theoretical approach became structuralism —the analysis of consciousness into its basic elements.

Wundt’s main contribution to the study of problem solving, however, was to call for its banishment. According to Wundt, complex cognitive processing was too complicated to be studied by experimental methods, so “nothing can be discovered in such experiments” (Wundt, 1911/1973 ). Despite his admonishments, however, a group of his former students began studying thinking mainly in Wurzburg, Germany. Using the method of introspection, subjects were asked to describe their thought process as they solved word association problems, such as finding the superordinate of “newspaper” (e.g., an answer is “publication”). Although the Wurzburg group—as they came to be called—did not produce a new theoretical approach, they found empirical evidence that challenged some of the key assumptions of mental philosophy. For example, Aristotle had proclaimed that all thinking involves mental imagery, but the Wurzburg group was able to find empirical evidence for imageless thought .

Associationism

The first major theoretical approach to take hold in the scientific study of problem solving was associationism —the idea that the cognitive representations in the mind consist of ideas and links between them and that cognitive processing in the mind involves following a chain of associations from one idea to the next (Mandler & Mandler, 1964 ; Mayer, 1992 ). For example, in a classic study, E. L. Thorndike ( 1911 ) placed a hungry cat in what he called a puzzle box—a wooden crate in which pulling a loop of string that hung from overhead would open a trap door to allow the cat to escape to a bowl of food outside the crate. Thorndike placed the cat in the puzzle box once a day for several weeks. On the first day, the cat engaged in many extraneous behaviors such as pouncing against the wall, pushing its paws through the slats, and meowing, but on successive days the number of extraneous behaviors tended to decrease. Overall, the time required to get out of the puzzle box decreased over the course of the experiment, indicating the cat was learning how to escape.

Thorndike’s explanation for how the cat learned to solve the puzzle box problem is based on an associationist view: The cat begins with a habit family hierarchy —a set of potential responses (e.g., pouncing, thrusting, meowing, etc.) all associated with the same stimulus (i.e., being hungry and confined) and ordered in terms of strength of association. When placed in the puzzle box, the cat executes its strongest response (e.g., perhaps pouncing against the wall), but when it fails, the strength of the association is weakened, and so on for each unsuccessful action. Eventually, the cat gets down to what was initially a weak response—waving its paw in the air—but when that response leads to accidentally pulling the string and getting out, it is strengthened. Over the course of many trials, the ineffective responses become weak and the successful response becomes strong. Thorndike refers to this process as the law of effect : Responses that lead to dissatisfaction become less associated with the situation and responses that lead to satisfaction become more associated with the situation. According to Thorndike’s associationist view, solving a problem is simply a matter of trial and error and accidental success. A major challenge to assocationist theory concerns the nature of transfer—that is, where does a problem solver find a creative solution that has never been performed before? Associationist conceptions of cognition can be seen in current research, including neural networks, connectionist models, and parallel distributed processing models (Rogers & McClelland, 2004 ).

Gestalt Psychology

The Gestalt approach to problem solving developed in the 1930s and 1940s as a counterbalance to the associationist approach. According to the Gestalt approach, cognitive representations consist of coherent structures (rather than individual associations) and the cognitive process of problem solving involves building a coherent structure (rather than strengthening and weakening of associations). For example, in a classic study, Kohler ( 1925 ) placed a hungry ape in a play yard that contained several empty shipping crates and a banana attached overhead but out of reach. Based on observing the ape in this situation, Kohler noted that the ape did not randomly try responses until one worked—as suggested by Thorndike’s associationist view. Instead, the ape stood under the banana, looked up at it, looked at the crates, and then in a flash of insight stacked the crates under the bananas as a ladder, and walked up the steps in order to reach the banana.

According to Kohler, the ape experienced a sudden visual reorganization in which the elements in the situation fit together in a way to solve the problem; that is, the crates could become a ladder that reduces the distance to the banana. Kohler referred to the underlying mechanism as insight —literally seeing into the structure of the situation. A major challenge of Gestalt theory is its lack of precision; for example, naming a process (i.e., insight) is not the same as explaining how it works. Gestalt conceptions can be seen in modern research on mental models and schemas (Gentner & Stevens, 1983 ).

Information Processing

The information processing approach to problem solving developed in the 1960s and 1970s and was based on the influence of the computer metaphor—the idea that humans are processors of information (Mayer, 2009 ). According to the information processing approach, problem solving involves a series of mental computations—each of which consists of applying a process to a mental representation (such as comparing two elements to determine whether they differ).

In their classic book, Human Problem Solving , Newell and Simon ( 1972 ) proposed that problem solving involved a problem space and search heuristics . A problem space is a mental representation of the initial state of the problem, the goal state of the problem, and all possible intervening states (based on applying allowable operators). Search heuristics are strategies for moving through the problem space from the given to the goal state. Newell and Simon focused on means-ends analysis , in which the problem solver continually sets goals and finds moves to accomplish goals.

Newell and Simon used computer simulation as a research method to test their conception of human problem solving. First, they asked human problem solvers to think aloud as they solved various problems such as logic problems, chess, and cryptarithmetic problems. Then, based on an information processing analysis, Newell and Simon created computer programs that solved these problems. In comparing the solution behavior of humans and computers, they found high similarity, suggesting that the computer programs were solving problems using the same thought processes as humans.

An important advantage of the information processing approach is that problem solving can be described with great clarity—as a computer program. An important limitation of the information processing approach is that it is most useful for describing problem solving for well-defined problems rather than ill-defined problems. The information processing conception of cognition lives on as a keystone of today’s cognitive science (Mayer, 2009 ).

Classic Issues in Problem Solving

Three classic issues in research on problem solving concern the nature of transfer (suggested by the associationist approach), the nature of insight (suggested by the Gestalt approach), and the role of problem-solving heuristics (suggested by the information processing approach).

Transfer refers to the effects of prior learning on new learning (or new problem solving). Positive transfer occurs when learning A helps someone learn B. Negative transfer occurs when learning A hinders someone from learning B. Neutral transfer occurs when learning A has no effect on learning B. Positive transfer is a central goal of education, but research shows that people often do not transfer what they learned to solving problems in new contexts (Mayer, 1992 ; Singley & Anderson, 1989 ).

Three conceptions of the mechanisms underlying transfer are specific transfer , general transfer , and specific transfer of general principles . Specific transfer refers to the idea that learning A will help someone learn B only if A and B have specific elements in common. For example, learning Spanish may help someone learn Latin because some of the vocabulary words are similar and the verb conjugation rules are similar. General transfer refers to the idea that learning A can help someone learn B even they have nothing specifically in common but A helps improve the learner’s mind in general. For example, learning Latin may help people learn “proper habits of mind” so they are better able to learn completely unrelated subjects as well. Specific transfer of general principles is the idea that learning A will help someone learn B if the same general principle or solution method is required for both even if the specific elements are different.

In a classic study, Thorndike and Woodworth ( 1901 ) found that students who learned Latin did not subsequently learn bookkeeping any better than students who had not learned Latin. They interpreted this finding as evidence for specific transfer—learning A did not transfer to learning B because A and B did not have specific elements in common. Modern research on problem-solving transfer continues to show that people often do not demonstrate general transfer (Mayer, 1992 ). However, it is possible to teach people a general strategy for solving a problem, so that when they see a new problem in a different context they are able to apply the strategy to the new problem (Judd, 1908 ; Mayer, 2008 )—so there is also research support for the idea of specific transfer of general principles.

Insight refers to a change in a problem solver’s mind from not knowing how to solve a problem to knowing how to solve it (Mayer, 1995 ; Metcalfe & Wiebe, 1987 ). In short, where does the idea for a creative solution come from? A central goal of problem-solving research is to determine the mechanisms underlying insight.

The search for insight has led to five major (but not mutually exclusive) explanatory mechanisms—insight as completing a schema, insight as suddenly reorganizing visual information, insight as reformulation of a problem, insight as removing mental blocks, and insight as finding a problem analog (Mayer, 1995 ). Completing a schema is exemplified in a study by Selz (Fridja & de Groot, 1982 ), in which people were asked to think aloud as they solved word association problems such as “What is the superordinate for newspaper?” To solve the problem, people sometimes thought of a coordinate, such as “magazine,” and then searched for a superordinate category that subsumed both terms, such as “publication.” According to Selz, finding a solution involved building a schema that consisted of a superordinate and two subordinate categories.

Reorganizing visual information is reflected in Kohler’s ( 1925 ) study described in a previous section in which a hungry ape figured out how to stack boxes as a ladder to reach a banana hanging above. According to Kohler, the ape looked around the yard and found the solution in a flash of insight by mentally seeing how the parts could be rearranged to accomplish the goal.

Reformulating a problem is reflected in a classic study by Duncker ( 1945 ) in which people are asked to think aloud as they solve the tumor problem—how can you destroy a tumor in a patient without destroying surrounding healthy tissue by using rays that at sufficient intensity will destroy any tissue in their path? In analyzing the thinking-aloud protocols—that is, transcripts of what the problem solvers said—Duncker concluded that people reformulated the goal in various ways (e.g., avoid contact with healthy tissue, immunize healthy tissue, have ray be weak in healthy tissue) until they hit upon a productive formulation that led to the solution (i.e., concentrating many weak rays on the tumor).

Removing mental blocks is reflected in classic studies by Duncker ( 1945 ) in which solving a problem involved thinking of a novel use for an object, and by Luchins ( 1942 ) in which solving a problem involved not using a procedure that had worked well on previous problems. Finding a problem analog is reflected in classic research by Wertheimer ( 1959 ) in which learning to find the area of a parallelogram is supported by the insight that one could cut off the triangle on one side and place it on the other side to form a rectangle—so a parallelogram is really a rectangle in disguise. The search for insight along each of these five lines continues in current problem-solving research.

Heuristics are problem-solving strategies, that is, general approaches to how to solve problems. Newell and Simon ( 1972 ) suggested three general problem-solving heuristics for moving from a given state to a goal state: random trial and error , hill climbing , and means-ends analysis . Random trial and error involves randomly selecting a legal move and applying it to create a new problem state, and repeating that process until the goal state is reached. Random trial and error may work for simple problems but is not efficient for complex ones. Hill climbing involves selecting the legal move that moves the problem solver closer to the goal state. Hill climbing will not work for problems in which the problem solver must take a move that temporarily moves away from the goal as is required in many problems.

Means-ends analysis involves creating goals and seeking moves that can accomplish the goal. If a goal cannot be directly accomplished, a subgoal is created to remove one or more obstacles. Newell and Simon ( 1972 ) successfully used means-ends analysis as the search heuristic in a computer program aimed at general problem solving, that is, solving a diverse collection of problems. However, people may also use specific heuristics that are designed to work for specific problem-solving situations (Gigerenzer, Todd, & ABC Research Group, 1999 ; Kahneman & Tversky, 1984 ).

Current and Future Issues in Problem Solving

Eight current issues in problem solving involve decision making, intelligence and creativity, teaching of thinking skills, expert problem solving, analogical reasoning, mathematical and scientific problem solving, everyday thinking, and the cognitive neuroscience of problem solving.

Decision Making

Decision making refers to the cognitive processing involved in choosing between two or more alternatives (Baron, 2000 ; Markman & Medin, 2002 ). For example, a decision-making task may involve choosing between getting $240 for sure or having a 25% change of getting $1000. According to economic theories such as expected value theory, people should chose the second option, which is worth $250 (i.e., .25 x $1000) rather than the first option, which is worth $240 (1.00 x $240), but psychological research shows that most people prefer the first option (Kahneman & Tversky, 1984 ).

Research on decision making has generated three classes of theories (Markman & Medin, 2002 ): descriptive theories, such as prospect theory (Kahneman & Tversky), which are based on the ideas that people prefer to overweight the cost of a loss and tend to overestimate small probabilities; heuristic theories, which are based on the idea that people use a collection of short-cut strategies such as the availability heuristic (Gigerenzer et al., 1999 ; Kahneman & Tversky, 2000 ); and constructive theories, such as mental accounting (Kahneman & Tversky, 2000 ), in which people build a narrative to justify their choices to themselves. Future research is needed to examine decision making in more realistic settings.

Intelligence and Creativity

Although researchers do not have complete consensus on the definition of intelligence (Sternberg, 1990 ), it is reasonable to view intelligence as the ability to learn or adapt to new situations. Fluid intelligence refers to the potential to solve problems without any relevant knowledge, whereas crystallized intelligence refers to the potential to solve problems based on relevant prior knowledge (Sternberg & Gregorenko, 2003 ). As people gain more experience in a field, their problem-solving performance depends more on crystallized intelligence (i.e., domain knowledge) than on fluid intelligence (i.e., general ability) (Sternberg & Gregorenko, 2003 ). The ability to monitor and manage one’s cognitive processing during problem solving—which can be called metacognition —is an important aspect of intelligence (Sternberg, 1990 ). Research is needed to pinpoint the knowledge that is needed to support intelligent performance on problem-solving tasks.

Creativity refers to the ability to generate ideas that are original (i.e., other people do not think of the same idea) and functional (i.e., the idea works; Sternberg, 1999 ). Creativity is often measured using tests of divergent thinking —that is, generating as many solutions as possible for a problem (Guilford, 1967 ). For example, the uses test asks people to list as many uses as they can think of for a brick. Creativity is different from intelligence, and it is at the heart of creative problem solving—generating a novel solution to a problem that the problem solver has never seen before. An important research question concerns whether creative problem solving depends on specific knowledge or creativity ability in general.

Teaching of Thinking Skills

How can people learn to be better problem solvers? Mayer ( 2008 ) proposes four questions concerning teaching of thinking skills:

What to teach —Successful programs attempt to teach small component skills (such as how to generate and evaluate hypotheses) rather than improve the mind as a single monolithic skill (Covington, Crutchfield, Davies, & Olton, 1974 ). How to teach —Successful programs focus on modeling the process of problem solving rather than solely reinforcing the product of problem solving (Bloom & Broder, 1950 ). Where to teach —Successful programs teach problem-solving skills within the specific context they will be used rather than within a general course on how to solve problems (Nickerson, 1999 ). When to teach —Successful programs teaching higher order skills early rather than waiting until lower order skills are completely mastered (Tharp & Gallimore, 1988 ).

Overall, research on teaching of thinking skills points to the domain specificity of problem solving; that is, successful problem solving depends on the problem solver having domain knowledge that is relevant to the problem-solving task.

Expert Problem Solving

Research on expertise is concerned with differences between how experts and novices solve problems (Ericsson, Feltovich, & Hoffman, 2006 ). Expertise can be defined in terms of time (e.g., 10 years of concentrated experience in a field), performance (e.g., earning a perfect score on an assessment), or recognition (e.g., receiving a Nobel Prize or becoming Grand Master in chess). For example, in classic research conducted in the 1940s, de Groot ( 1965 ) found that chess experts did not have better general memory than chess novices, but they did have better domain-specific memory for the arrangement of chess pieces on the board. Chase and Simon ( 1973 ) replicated this result in a better controlled experiment. An explanation is that experts have developed schemas that allow them to chunk collections of pieces into a single configuration.

In another landmark study, Larkin et al. ( 1980 ) compared how experts (e.g., physics professors) and novices (e.g., first-year physics students) solved textbook physics problems about motion. Experts tended to work forward from the given information to the goal, whereas novices tended to work backward from the goal to the givens using a means-ends analysis strategy. Experts tended to store their knowledge in an integrated way, whereas novices tended to store their knowledge in isolated fragments. In another study, Chi, Feltovich, and Glaser ( 1981 ) found that experts tended to focus on the underlying physics concepts (such as conservation of energy), whereas novices tended to focus on the surface features of the problem (such as inclined planes or springs). Overall, research on expertise is useful in pinpointing what experts know that is different from what novices know. An important theme is that experts rely on domain-specific knowledge rather than solely general cognitive ability.

Analogical Reasoning

Analogical reasoning occurs when people solve one problem by using their knowledge about another problem (Holyoak, 2005 ). For example, suppose a problem solver learns how to solve a problem in one context using one solution method and then is given a problem in another context that requires the same solution method. In this case, the problem solver must recognize that the new problem has structural similarity to the old problem (i.e., it may be solved by the same method), even though they do not have surface similarity (i.e., the cover stories are different). Three steps in analogical reasoning are recognizing —seeing that a new problem is similar to a previously solved problem; abstracting —finding the general method used to solve the old problem; and mapping —using that general method to solve the new problem.

Research on analogical reasoning shows that people often do not recognize that a new problem can be solved by the same method as a previously solved problem (Holyoak, 2005 ). However, research also shows that successful analogical transfer to a new problem is more likely when the problem solver has experience with two old problems that have the same underlying structural features (i.e., they are solved by the same principle) but different surface features (i.e., they have different cover stories) (Holyoak, 2005 ). This finding is consistent with the idea of specific transfer of general principles as described in the section on “Transfer.”

Mathematical and Scientific Problem Solving

Research on mathematical problem solving suggests that five kinds of knowledge are needed to solve arithmetic word problems (Mayer, 2008 ):

Factual knowledge —knowledge about the characteristics of problem elements, such as knowing that there are 100 cents in a dollar Schematic knowledge —knowledge of problem types, such as being able to recognize time-rate-distance problems Strategic knowledge —knowledge of general methods, such as how to break a problem into parts Procedural knowledge —knowledge of processes, such as how to carry our arithmetic operations Attitudinal knowledge —beliefs about one’s mathematical problem-solving ability, such as thinking, “I am good at this”

People generally possess adequate procedural knowledge but may have difficulty in solving mathematics problems because they lack factual, schematic, strategic, or attitudinal knowledge (Mayer, 2008 ). Research is needed to pinpoint the role of domain knowledge in mathematical problem solving.

Research on scientific problem solving shows that people harbor misconceptions, such as believing that a force is needed to keep an object in motion (McCloskey, 1983 ). Learning to solve science problems involves conceptual change, in which the problem solver comes to recognize that previous conceptions are wrong (Mayer, 2008 ). Students can be taught to engage in scientific reasoning such as hypothesis testing through direct instruction in how to control for variables (Chen & Klahr, 1999 ). A central theme of research on scientific problem solving concerns the role of domain knowledge.

Everyday Thinking

Everyday thinking refers to problem solving in the context of one’s life outside of school. For example, children who are street vendors tend to use different procedures for solving arithmetic problems when they are working on the streets than when they are in school (Nunes, Schlieman, & Carraher, 1993 ). This line of research highlights the role of situated cognition —the idea that thinking always is shaped by the physical and social context in which it occurs (Robbins & Aydede, 2009 ). Research is needed to determine how people solve problems in authentic contexts.

Cognitive Neuroscience of Problem Solving

The cognitive neuroscience of problem solving is concerned with the brain activity that occurs during problem solving. For example, using fMRI brain imaging methodology, Goel ( 2005 ) found that people used the language areas of the brain to solve logical reasoning problems presented in sentences (e.g., “All dogs are pets…”) and used the spatial areas of the brain to solve logical reasoning problems presented in abstract letters (e.g., “All D are P…”). Cognitive neuroscience holds the potential to make unique contributions to the study of problem solving.

Problem solving has always been a topic at the fringe of cognitive psychology—too complicated to study intensively but too important to completely ignore. Problem solving—especially in realistic environments—is messy in comparison to studying elementary processes in cognition. The field remains fragmented in the sense that topics such as decision making, reasoning, intelligence, expertise, mathematical problem solving, everyday thinking, and the like are considered to be separate topics, each with its own separate literature. Yet some recurring themes are the role of domain-specific knowledge in problem solving and the advantages of studying problem solving in authentic contexts.

Future Directions

Some important issues for future research include the three classic issues examined in this chapter—the nature of problem-solving transfer (i.e., How are people able to use what they know about previous problem solving to help them in new problem solving?), the nature of insight (e.g., What is the mechanism by which a creative solution is constructed?), and heuristics (e.g., What are some teachable strategies for problem solving?). In addition, future research in problem solving should continue to pinpoint the role of domain-specific knowledge in problem solving, the nature of cognitive ability in problem solving, how to help people develop proficiency in solving problems, and how to provide aids for problem solving.

Anderson L. W. , Krathwohl D. R. , Airasian P. W. , Cruikshank K. A. , Mayer R. E. , Pintrich P. R. , Raths, J., & Wittrock M. C. ( 2001 ). A taxonomy for learning, teaching, and assessing: A revision of Bloom’s taxonomy of educational objectives. New York : Longman.

Baron J. ( 2000 ). Thinking and deciding (3rd ed.). New York : Cambridge University Press.

Google Scholar

Google Preview

Bloom B. S. , & Broder B. J. ( 1950 ). Problem-solving processes of college students: An exploratory investigation. Chicago : University of Chicago Press.

Chase W. G. , & Simon H. A. ( 1973 ). Perception in chess.   Cognitive Psychology, 4, 55–81.

Chen Z. , & Klahr D. ( 1999 ). All other things being equal: Acquisition and transfer of the control of variable strategy . Child Development, 70, 1098–1120.

Chi M. T. H. , Feltovich P. J. , & Glaser R. ( 1981 ). Categorization and representation of physics problems by experts and novices. Cognitive Science, 5, 121–152.

Covington M. V. , Crutchfield R. S. , Davies L. B. , & Olton R. M. ( 1974 ). The productive thinking program. Columbus, OH : Merrill.

de Groot A. D. ( 1965 ). Thought and choice in chess. The Hague, The Netherlands : Mouton.

Duncker K. ( 1945 ). On problem solving.   Psychological Monographs, 58 (3) (Whole No. 270).

Ericsson K. A. , Feltovich P. J. , & Hoffman R. R. (Eds.). ( 2006 ). The Cambridge handbook of expertise and expert performance. New York : Cambridge University Press.

Fridja N. H. , & de Groot A. D. ( 1982 ). Otto Selz: His contribution to psychology. The Hague, The Netherlands : Mouton.

Gentner D. , & Stevens A. L. (Eds.). ( 1983 ). Mental models. Hillsdale, NJ : Erlbaum.

Gigerenzer G. , Todd P. M. , & ABC Research Group (Eds.). ( 1999 ). Simple heuristics that make us smart. Oxford, England : Oxford University Press.

Goel V. ( 2005 ). Cognitive neuroscience of deductive reasoning. In K. J. Holyoak & R. G. Morrison (Eds.), The Cambridge handbook of thinking and reasoning (pp. 475–492). New York : Cambridge University Press.

Guilford J. P. ( 1967 ). The nature of human intelligence. New York : McGraw-Hill.

Holyoak K. J. ( 2005 ). Analogy. In K. J. Holyoak & R. G. Morrison (Eds.), The Cambridge handbook of thinking and reasoning (pp. 117–142). New York : Cambridge University Press.

Humphrey G. ( 1963 ). Thinking: An introduction to experimental psychology. New York : Wiley.

Judd C. H. ( 1908 ). The relation of special training and general intelligence. Educational Review, 36, 28–42.

Kahneman D. , & Tversky A. ( 1984 ). Choices, values, and frames. American Psychologist, 39, 341–350.

Kahneman D. , & Tversky A. (Eds.). ( 2000 ). Choices, values, and frames. New York : Cambridge University Press.

Kohler W. ( 1925 ). The mentality of apes. New York : Liveright.

Larkin J. H. , McDermott J. , Simon D. P. , & Simon H. A. ( 1980 ). Expert and novice performance in solving physics problems. Science, 208, 1335–1342.

Luchins A. ( 1942 ). Mechanization in problem solving.   Psychological Monographs, 54 (6) (Whole No. 248).

Mandler J. M. , & Mandler G. ( 1964 ). Thinking from associationism to Gestalt. New York : Wiley.

Markman A. B. , & Medin D. L. ( 2002 ). Decision making. In D. Medin (Ed.), Stevens’ handbook of experimental psychology, Vol. 2. Memory and cognitive processes (2nd ed., pp. 413–466). New York : Wiley.

Mayer R. E. ( 1992 ). Thinking, problem solving, cognition (2nd ed). New York : Freeman.

Mayer R. E. ( 1995 ). The search for insight: Grappling with Gestalt psychology’s unanswered questions. In R. J. Sternberg & J. E. Davidson (Eds.), The nature of insight (pp. 3–32). Cambridge, MA : MIT Press.

Mayer R. E. ( 2008 ). Learning and instruction. Upper Saddle River, NJ : Merrill Prentice Hall.

Mayer R. E. ( 2009 ). Information processing. In T. L. Good (Ed.), 21st century education: A reference handbook (pp. 168–174). Thousand Oaks, CA : Sage.

Mayer R. E. , & Wittrock M. C. ( 2006 ). Problem solving. In P. A. Alexander & P. H. Winne (Eds.), Handbook of educational psychology (2nd ed., pp. 287–304). Mahwah, NJ : Erlbaum.

McCloskey M. ( 1983 ). Intuitive physics.   Scientific American, 248 (4), 122–130.

Metcalfe J. , & Wiebe D. ( 1987 ). Intuition in insight and non-insight problem solving. Memory and Cognition, 15, 238–246.

Newell A. , & Simon H. A. ( 1972 ). Human problem solving. Englewood Cliffs, NJ : Prentice-Hall.

Nickerson R. S. ( 1999 ). Enhancing creativity. In R. J. Sternberg (Ed.), Handbook of creativity (pp. 392–430). New York : Cambridge University Press.

Nunes T. , Schliemann A. D. , & Carraher D. W , ( 1993 ). Street mathematics and school mathematics. Cambridge, England : Cambridge University Press.

Robbins P. , & Aydede M. (Eds.). ( 2009 ). The Cambridge handbook of situated cognition. New York : Cambridge University Press.

Rogers T. T. , & McClelland J. L. ( 2004 ). Semantic cognition: A parallel distributed processing approach. Cambridge, MA : MIT Press.

Singley M. K. , & Anderson J. R. ( 1989 ). The transfer of cognitive skill. Cambridge, MA : Harvard University Press.

Sternberg R. J. ( 1990 ). Metaphors of mind: Conceptions of the nature of intelligence. New York : Cambridge University Press.

Sternberg R. J. ( 1999 ). Handbook of creativity. New York : Cambridge University Press.

Sternberg R. J. , & Gregorenko E. L. (Eds.). ( 2003 ). The psychology of abilities, competencies, and expertise. New York : Cambridge University Press.

Tharp R. G. , & Gallimore R. ( 1988 ). Rousing minds to life: Teaching, learning, and schooling in social context. New York : Cambridge University Press.

Thorndike E. L. ( 1911 ). Animal intelligence. New York: Hafner.

Thorndike E. L. , & Woodworth R. S. ( 1901 ). The influence of improvement in one mental function upon the efficiency of other functions. Psychological Review, 8, 247–261.

Wertheimer M. ( 1959 ). Productive thinking. New York : Harper and Collins.

Wundt W. ( 1973 ). An introduction to experimental psychology. New York : Arno Press. (Original work published in 1911).

Further Reading

Baron, J. ( 2008 ). Thinking and deciding (4th ed). New York: Cambridge University Press.

Duncker, K. ( 1945 ). On problem solving. Psychological Monographs , 58(3) (Whole No. 270).

Holyoak, K. J. , & Morrison, R. G. ( 2005 ). The Cambridge handbook of thinking and reasoning . New York: Cambridge University Press.

Mayer, R. E. , & Wittrock, M. C. ( 2006 ). Problem solving. In P. A. Alexander & P. H. Winne (Eds.), Handbook of educational psychology (2nd ed., pp. 287–304). Mahwah, NJ: Erlbaum.

Sternberg, R. J. , & Ben-Zeev, T. ( 2001 ). Complex cognition: The psychology of human thought . New York: Oxford University Press.

Weisberg, R. W. ( 2006 ). Creativity . New York: Wiley.

  • About Oxford Academic
  • Publish journals with us
  • University press partners
  • What we publish
  • New features  
  • Open access
  • Institutional account management
  • Rights and permissions
  • Get help with access
  • Accessibility
  • Advertising
  • Media enquiries
  • Oxford University Press
  • Oxford Languages
  • University of Oxford

Oxford University Press is a department of the University of Oxford. It furthers the University's objective of excellence in research, scholarship, and education by publishing worldwide

  • Copyright © 2024 Oxford University Press
  • Cookie settings
  • Cookie policy
  • Privacy policy
  • Legal notice

This Feature Is Available To Subscribers Only

Sign In or Create an Account

This PDF is available to Subscribers Only

For full access to this pdf, sign in to an existing account, or purchase an annual subscription.

  • Bipolar Disorder
  • Therapy Center
  • When To See a Therapist
  • Types of Therapy
  • Best Online Therapy
  • Best Couples Therapy
  • Best Family Therapy
  • Managing Stress
  • Sleep and Dreaming
  • Understanding Emotions
  • Self-Improvement
  • Healthy Relationships
  • Student Resources
  • Personality Types
  • Guided Meditations
  • Verywell Mind Insights
  • 2023 Verywell Mind 25
  • Mental Health in the Classroom
  • Editorial Process
  • Meet Our Review Board
  • Crisis Support

Problem-Solving Strategies and Obstacles

Kendra Cherry, MS, is a psychosocial rehabilitation specialist, psychology educator, and author of the "Everything Psychology Book."

problem solving test in psychology

Sean is a fact-checker and researcher with experience in sociology, field research, and data analytics.

problem solving test in psychology

JGI / Jamie Grill / Getty Images

  • Application
  • Improvement

From deciding what to eat for dinner to considering whether it's the right time to buy a house, problem-solving is a large part of our daily lives. Learn some of the problem-solving strategies that exist and how to use them in real life, along with ways to overcome obstacles that are making it harder to resolve the issues you face.

What Is Problem-Solving?

In cognitive psychology , the term 'problem-solving' refers to the mental process that people go through to discover, analyze, and solve problems.

A problem exists when there is a goal that we want to achieve but the process by which we will achieve it is not obvious to us. Put another way, there is something that we want to occur in our life, yet we are not immediately certain how to make it happen.

Maybe you want a better relationship with your spouse or another family member but you're not sure how to improve it. Or you want to start a business but are unsure what steps to take. Problem-solving helps you figure out how to achieve these desires.

The problem-solving process involves:

  • Discovery of the problem
  • Deciding to tackle the issue
  • Seeking to understand the problem more fully
  • Researching available options or solutions
  • Taking action to resolve the issue

Before problem-solving can occur, it is important to first understand the exact nature of the problem itself. If your understanding of the issue is faulty, your attempts to resolve it will also be incorrect or flawed.

Problem-Solving Mental Processes

Several mental processes are at work during problem-solving. Among them are:

  • Perceptually recognizing the problem
  • Representing the problem in memory
  • Considering relevant information that applies to the problem
  • Identifying different aspects of the problem
  • Labeling and describing the problem

Problem-Solving Strategies

There are many ways to go about solving a problem. Some of these strategies might be used on their own, or you may decide to employ multiple approaches when working to figure out and fix a problem.

An algorithm is a step-by-step procedure that, by following certain "rules" produces a solution. Algorithms are commonly used in mathematics to solve division or multiplication problems. But they can be used in other fields as well.

In psychology, algorithms can be used to help identify individuals with a greater risk of mental health issues. For instance, research suggests that certain algorithms might help us recognize children with an elevated risk of suicide or self-harm.

One benefit of algorithms is that they guarantee an accurate answer. However, they aren't always the best approach to problem-solving, in part because detecting patterns can be incredibly time-consuming.

There are also concerns when machine learning is involved—also known as artificial intelligence (AI)—such as whether they can accurately predict human behaviors.

Heuristics are shortcut strategies that people can use to solve a problem at hand. These "rule of thumb" approaches allow you to simplify complex problems, reducing the total number of possible solutions to a more manageable set.

If you find yourself sitting in a traffic jam, for example, you may quickly consider other routes, taking one to get moving once again. When shopping for a new car, you might think back to a prior experience when negotiating got you a lower price, then employ the same tactics.

While heuristics may be helpful when facing smaller issues, major decisions shouldn't necessarily be made using a shortcut approach. Heuristics also don't guarantee an effective solution, such as when trying to drive around a traffic jam only to find yourself on an equally crowded route.

Trial and Error

A trial-and-error approach to problem-solving involves trying a number of potential solutions to a particular issue, then ruling out those that do not work. If you're not sure whether to buy a shirt in blue or green, for instance, you may try on each before deciding which one to purchase.

This can be a good strategy to use if you have a limited number of solutions available. But if there are many different choices available, narrowing down the possible options using another problem-solving technique can be helpful before attempting trial and error.

In some cases, the solution to a problem can appear as a sudden insight. You are facing an issue in a relationship or your career when, out of nowhere, the solution appears in your mind and you know exactly what to do.

Insight can occur when the problem in front of you is similar to an issue that you've dealt with in the past. Although, you may not recognize what is occurring since the underlying mental processes that lead to insight often happen outside of conscious awareness .

Research indicates that insight is most likely to occur during times when you are alone—such as when going on a walk by yourself, when you're in the shower, or when lying in bed after waking up.

How to Apply Problem-Solving Strategies in Real Life

If you're facing a problem, you can implement one or more of these strategies to find a potential solution. Here's how to use them in real life:

  • Create a flow chart . If you have time, you can take advantage of the algorithm approach to problem-solving by sitting down and making a flow chart of each potential solution, its consequences, and what happens next.
  • Recall your past experiences . When a problem needs to be solved fairly quickly, heuristics may be a better approach. Think back to when you faced a similar issue, then use your knowledge and experience to choose the best option possible.
  • Start trying potential solutions . If your options are limited, start trying them one by one to see which solution is best for achieving your desired goal. If a particular solution doesn't work, move on to the next.
  • Take some time alone . Since insight is often achieved when you're alone, carve out time to be by yourself for a while. The answer to your problem may come to you, seemingly out of the blue, if you spend some time away from others.

Obstacles to Problem-Solving

Problem-solving is not a flawless process as there are a number of obstacles that can interfere with our ability to solve a problem quickly and efficiently. These obstacles include:

  • Assumptions: When dealing with a problem, people can make assumptions about the constraints and obstacles that prevent certain solutions. Thus, they may not even try some potential options.
  • Functional fixedness : This term refers to the tendency to view problems only in their customary manner. Functional fixedness prevents people from fully seeing all of the different options that might be available to find a solution.
  • Irrelevant or misleading information: When trying to solve a problem, it's important to distinguish between information that is relevant to the issue and irrelevant data that can lead to faulty solutions. The more complex the problem, the easier it is to focus on misleading or irrelevant information.
  • Mental set: A mental set is a tendency to only use solutions that have worked in the past rather than looking for alternative ideas. A mental set can work as a heuristic, making it a useful problem-solving tool. However, mental sets can also lead to inflexibility, making it more difficult to find effective solutions.

How to Improve Your Problem-Solving Skills

In the end, if your goal is to become a better problem-solver, it's helpful to remember that this is a process. Thus, if you want to improve your problem-solving skills, following these steps can help lead you to your solution:

  • Recognize that a problem exists . If you are facing a problem, there are generally signs. For instance, if you have a mental illness , you may experience excessive fear or sadness, mood changes, and changes in sleeping or eating habits. Recognizing these signs can help you realize that an issue exists.
  • Decide to solve the problem . Make a conscious decision to solve the issue at hand. Commit to yourself that you will go through the steps necessary to find a solution.
  • Seek to fully understand the issue . Analyze the problem you face, looking at it from all sides. If your problem is relationship-related, for instance, ask yourself how the other person may be interpreting the issue. You might also consider how your actions might be contributing to the situation.
  • Research potential options . Using the problem-solving strategies mentioned, research potential solutions. Make a list of options, then consider each one individually. What are some pros and cons of taking the available routes? What would you need to do to make them happen?
  • Take action . Select the best solution possible and take action. Action is one of the steps required for change . So, go through the motions needed to resolve the issue.
  • Try another option, if needed . If the solution you chose didn't work, don't give up. Either go through the problem-solving process again or simply try another option.

You can find a way to solve your problems as long as you keep working toward this goal—even if the best solution is simply to let go because no other good solution exists.

Sarathy V. Real world problem-solving .  Front Hum Neurosci . 2018;12:261. doi:10.3389/fnhum.2018.00261

Dunbar K. Problem solving . A Companion to Cognitive Science . 2017. doi:10.1002/9781405164535.ch20

Stewart SL, Celebre A, Hirdes JP, Poss JW. Risk of suicide and self-harm in kids: The development of an algorithm to identify high-risk individuals within the children's mental health system . Child Psychiat Human Develop . 2020;51:913-924. doi:10.1007/s10578-020-00968-9

Rosenbusch H, Soldner F, Evans AM, Zeelenberg M. Supervised machine learning methods in psychology: A practical introduction with annotated R code . Soc Personal Psychol Compass . 2021;15(2):e12579. doi:10.1111/spc3.12579

Mishra S. Decision-making under risk: Integrating perspectives from biology, economics, and psychology . Personal Soc Psychol Rev . 2014;18(3):280-307. doi:10.1177/1088868314530517

Csikszentmihalyi M, Sawyer K. Creative insight: The social dimension of a solitary moment . In: The Systems Model of Creativity . 2015:73-98. doi:10.1007/978-94-017-9085-7_7

Chrysikou EG, Motyka K, Nigro C, Yang SI, Thompson-Schill SL. Functional fixedness in creative thinking tasks depends on stimulus modality .  Psychol Aesthet Creat Arts . 2016;10(4):425‐435. doi:10.1037/aca0000050

Huang F, Tang S, Hu Z. Unconditional perseveration of the short-term mental set in chunk decomposition .  Front Psychol . 2018;9:2568. doi:10.3389/fpsyg.2018.02568

National Alliance on Mental Illness. Warning signs and symptoms .

Mayer RE. Thinking, problem solving, cognition, 2nd ed .

Schooler JW, Ohlsson S, Brooks K. Thoughts beyond words: When language overshadows insight. J Experiment Psychol: General . 1993;122:166-183. doi:10.1037/0096-3445.2.166

By Kendra Cherry, MSEd Kendra Cherry, MS, is a psychosocial rehabilitation specialist, psychology educator, and author of the "Everything Psychology Book."

loading

How it works

For Business

Join Mind Tools

Self-Assessment • 20 min read

How Good Is Your Problem Solving?

Use a systematic approach..

By the Mind Tools Content Team

problem solving test in psychology

Good problem solving skills are fundamentally important if you're going to be successful in your career.

But problems are something that we don't particularly like.

They're time-consuming.

They muscle their way into already packed schedules.

They force us to think about an uncertain future.

And they never seem to go away!

That's why, when faced with problems, most of us try to eliminate them as quickly as possible. But have you ever chosen the easiest or most obvious solution – and then realized that you have entirely missed a much better solution? Or have you found yourself fixing just the symptoms of a problem, only for the situation to get much worse?

To be an effective problem-solver, you need to be systematic and logical in your approach. This quiz helps you assess your current approach to problem solving. By improving this, you'll make better overall decisions. And as you increase your confidence with solving problems, you'll be less likely to rush to the first solution – which may not necessarily be the best one.

Once you've completed the quiz, we'll direct you to tools and resources that can help you make the most of your problem-solving skills.

How Good Are You at Solving Problems?

Instructions.

For each statement, click the button in the column that best describes you. Please answer questions as you actually are (rather than how you think you should be), and don't worry if some questions seem to score in the 'wrong direction'. When you are finished, please click the 'Calculate My Total' button at the bottom of the test.

Answering these questions should have helped you recognize the key steps associated with effective problem solving.

This quiz is based on Dr Min Basadur's Simplexity Thinking problem-solving model. This eight-step process follows the circular pattern shown below, within which current problems are solved and new problems are identified on an ongoing basis. This assessment has not been validated and is intended for illustrative purposes only.

Below, we outline the tools and strategies you can use for each stage of the problem-solving process. Enjoy exploring these stages!

Step 1: Find the Problem (Questions 7, 12)

Some problems are very obvious, however others are not so easily identified. As part of an effective problem-solving process, you need to look actively for problems – even when things seem to be running fine. Proactive problem solving helps you avoid emergencies and allows you to be calm and in control when issues arise.

These techniques can help you do this:

PEST Analysis helps you pick up changes to your environment that you should be paying attention to. Make sure too that you're watching changes in customer needs and market dynamics, and that you're monitoring trends that are relevant to your industry.

Risk Analysis helps you identify significant business risks.

Failure Modes and Effects Analysis helps you identify possible points of failure in your business process, so that you can fix these before problems arise.

After Action Reviews help you scan recent performance to identify things that can be done better in the future.

Where you have several problems to solve, our articles on Prioritization and Pareto Analysis help you think about which ones you should focus on first.

Step 2: Find the Facts (Questions 10, 14)

After identifying a potential problem, you need information. What factors contribute to the problem? Who is involved with it? What solutions have been tried before? What do others think about the problem?

If you move forward to find a solution too quickly, you risk relying on imperfect information that's based on assumptions and limited perspectives, so make sure that you research the problem thoroughly.

Step 3: Define the Problem (Questions 3, 9)

Now that you understand the problem, define it clearly and completely. Writing a clear problem definition forces you to establish specific boundaries for the problem. This keeps the scope from growing too large, and it helps you stay focused on the main issues.

A great tool to use at this stage is CATWOE . With this process, you analyze potential problems by looking at them from six perspectives, those of its Customers; Actors (people within the organization); the Transformation, or business process; the World-view, or top-down view of what's going on; the Owner; and the wider organizational Environment. By looking at a situation from these perspectives, you can open your mind and come to a much sharper and more comprehensive definition of the problem.

Cause and Effect Analysis is another good tool to use here, as it helps you think about the many different factors that can contribute to a problem. This helps you separate the symptoms of a problem from its fundamental causes.

Step 4: Find Ideas (Questions 4, 13)

With a clear problem definition, start generating ideas for a solution. The key here is to be flexible in the way you approach a problem. You want to be able to see it from as many perspectives as possible. Looking for patterns or common elements in different parts of the problem can sometimes help. You can also use metaphors and analogies to help analyze the problem, discover similarities to other issues, and think of solutions based on those similarities.

Traditional brainstorming and reverse brainstorming are very useful here. By taking the time to generate a range of creative solutions to the problem, you'll significantly increase the likelihood that you'll find the best possible solution, not just a semi-adequate one. Where appropriate, involve people with different viewpoints to expand the volume of ideas generated.

Tip: Don't evaluate your ideas until step 5. If you do, this will limit your creativity at too early a stage.

Step 5: Select and Evaluate (Questions 6, 15)

After finding ideas, you'll have many options that must be evaluated. It's tempting at this stage to charge in and start discarding ideas immediately. However, if you do this without first determining the criteria for a good solution, you risk rejecting an alternative that has real potential.

Decide what elements are needed for a realistic and practical solution, and think about the criteria you'll use to choose between potential solutions.

Paired Comparison Analysis , Decision Matrix Analysis and Risk Analysis are useful techniques here, as are many of the specialist resources available within our Decision-Making section . Enjoy exploring these!

Step 6: Plan (Questions 1, 16)

You might think that choosing a solution is the end of a problem-solving process. In fact, it's simply the start of the next phase in problem solving: implementation. This involves lots of planning and preparation. If you haven't already developed a full Risk Analysis in the evaluation phase, do so now. It's important to know what to be prepared for as you begin to roll out your proposed solution.

The type of planning that you need to do depends on the size of the implementation project that you need to set up. For small projects, all you'll often need are Action Plans that outline who will do what, when, and how. Larger projects need more sophisticated approaches – you'll find out more about these in the article What is Project Management? And for projects that affect many other people, you'll need to think about Change Management as well.

Here, it can be useful to conduct an Impact Analysis to help you identify potential resistance as well as alert you to problems you may not have anticipated. Force Field Analysis will also help you uncover the various pressures for and against your proposed solution. Once you've done the detailed planning, it can also be useful at this stage to make a final Go/No-Go Decision , making sure that it's actually worth going ahead with the selected option.

Step 7: Sell the Idea (Questions 5, 8)

As part of the planning process, you must convince other stakeholders that your solution is the best one. You'll likely meet with resistance, so before you try to “sell” your idea, make sure you've considered all the consequences.

As you begin communicating your plan, listen to what people say, and make changes as necessary. The better the overall solution meets everyone's needs, the greater its positive impact will be! For more tips on selling your idea, read our article on Creating a Value Proposition and use our Sell Your Idea Skillbook.

Step 8: Act (Questions 2, 11)

Finally, once you've convinced your key stakeholders that your proposed solution is worth running with, you can move on to the implementation stage. This is the exciting and rewarding part of problem solving, which makes the whole process seem worthwhile.

This action stage is an end, but it's also a beginning: once you've completed your implementation, it's time to move into the next cycle of problem solving by returning to the scanning stage. By doing this, you'll continue improving your organization as you move into the future.

Problem solving is an exceptionally important workplace skill.

Being a competent and confident problem solver will create many opportunities for you. By using a well-developed model like Simplexity Thinking for solving problems, you can approach the process systematically, and be comfortable that the decisions you make are solid.

Given the unpredictable nature of problems, it's very reassuring to know that, by following a structured plan, you've done everything you can to resolve the problem to the best of your ability.

This assessment has not been validated and is intended for illustrative purposes only. It is just one of many Mind Tool quizzes that can help you to evaluate your abilities in a wide range of important career skills.

If you want to reproduce this quiz, you can purchase downloadable copies in our Store .

You've accessed 1 of your 2 free resources.

Get unlimited access

Discover more content

4 logical fallacies.

Avoid Common Types of Faulty Reasoning

Problem Solving

Add comment

Comments (2)

Afkar Hashmi

😇 This tool is very useful for me.

over 1 year

Very impactful

problem solving test in psychology

Team Management

Learn the key aspects of managing a team, from building and developing your team, to working with different types of teams, and troubleshooting common problems.

Sign-up to our newsletter

Subscribing to the Mind Tools newsletter will keep you up-to-date with our latest updates and newest resources.

Subscribe now

Business Skills

Personal Development

Leadership and Management

Member Extras

Most Popular

Newest Releases

Article amtbj63

SWOT Analysis

Article a4wo118

SMART Goals

Mind Tools Store

About Mind Tools Content

Discover something new today

How to stop procrastinating.

Overcoming the Habit of Delaying Important Tasks

What Is Time Management?

Working Smarter to Enhance Productivity

How Emotionally Intelligent Are You?

Boosting Your People Skills

Self-Assessment

What's Your Leadership Style?

Learn About the Strengths and Weaknesses of the Way You Like to Lead

Recommended for you

Networked for learning.

How Different Organizations Use Technology to Collaborate, Innovate and Learn

Case Studies

Business Operations and Process Management

Strategy Tools

Customer Service

Business Ethics and Values

Handling Information and Data

Project Management

Knowledge Management

Self-Development and Goal Setting

Time Management

Presentation Skills

Learning Skills

Career Skills

Communication Skills

Negotiation, Persuasion and Influence

Working With Others

Difficult Conversations

Creativity Tools

Self-Management

Work-Life Balance

Stress Management and Wellbeing

Coaching and Mentoring

Change Management

Managing Conflict

Delegation and Empowerment

Performance Management

Leadership Skills

Developing Your Team

Talent Management

Decision Making

Member Podcast

10 Best Problem-Solving Therapy Worksheets & Activities

Problem solving therapy

Cognitive science tells us that we regularly face not only well-defined problems but, importantly, many that are ill defined (Eysenck & Keane, 2015).

Sometimes, we find ourselves unable to overcome our daily problems or the inevitable (though hopefully infrequent) life traumas we face.

Problem-Solving Therapy aims to reduce the incidence and impact of mental health disorders and improve wellbeing by helping clients face life’s difficulties (Dobson, 2011).

This article introduces Problem-Solving Therapy and offers techniques, activities, and worksheets that mental health professionals can use with clients.

Before you continue, we thought you might like to download our three Positive Psychology Exercises for free . These science-based exercises explore fundamental aspects of positive psychology, including strengths, values, and self-compassion, and will give you the tools to enhance the wellbeing of your clients, students, or employees.

This Article Contains:

What is problem-solving therapy, 14 steps for problem-solving therapy, 3 best interventions and techniques, 7 activities and worksheets for your session, fascinating books on the topic, resources from positivepsychology.com, a take-home message.

Problem-Solving Therapy assumes that mental disorders arise in response to ineffective or maladaptive coping. By adopting a more realistic and optimistic view of coping, individuals can understand the role of emotions and develop actions to reduce distress and maintain mental wellbeing (Nezu & Nezu, 2009).

“Problem-solving therapy (PST) is a psychosocial intervention, generally considered to be under a cognitive-behavioral umbrella” (Nezu, Nezu, & D’Zurilla, 2013, p. ix). It aims to encourage the client to cope better with day-to-day problems and traumatic events and reduce their impact on mental and physical wellbeing.

Clinical research, counseling, and health psychology have shown PST to be highly effective in clients of all ages, ranging from children to the elderly, across multiple clinical settings, including schizophrenia, stress, and anxiety disorders (Dobson, 2011).

Can it help with depression?

PST appears particularly helpful in treating clients with depression. A recent analysis of 30 studies found that PST was an effective treatment with a similar degree of success as other successful therapies targeting depression (Cuijpers, Wit, Kleiboer, Karyotaki, & Ebert, 2020).

Other studies confirm the value of PST and its effectiveness at treating depression in multiple age groups and its capacity to combine with other therapies, including drug treatments (Dobson, 2011).

The major concepts

Effective coping varies depending on the situation, and treatment typically focuses on improving the environment and reducing emotional distress (Dobson, 2011).

PST is based on two overlapping models:

Social problem-solving model

This model focuses on solving the problem “as it occurs in the natural social environment,” combined with a general coping strategy and a method of self-control (Dobson, 2011, p. 198).

The model includes three central concepts:

  • Social problem-solving
  • The problem
  • The solution

The model is a “self-directed cognitive-behavioral process by which an individual, couple, or group attempts to identify or discover effective solutions for specific problems encountered in everyday living” (Dobson, 2011, p. 199).

Relational problem-solving model

The theory of PST is underpinned by a relational problem-solving model, whereby stress is viewed in terms of the relationships between three factors:

  • Stressful life events
  • Emotional distress and wellbeing
  • Problem-solving coping

Therefore, when a significant adverse life event occurs, it may require “sweeping readjustments in a person’s life” (Dobson, 2011, p. 202).

problem solving test in psychology

  • Enhance positive problem orientation
  • Decrease negative orientation
  • Foster ability to apply rational problem-solving skills
  • Reduce the tendency to avoid problem-solving
  • Minimize the tendency to be careless and impulsive

D’Zurilla’s and Nezu’s model includes (modified from Dobson, 2011):

  • Initial structuring Establish a positive therapeutic relationship that encourages optimism and explains the PST approach.
  • Assessment Formally and informally assess areas of stress in the client’s life and their problem-solving strengths and weaknesses.
  • Obstacles to effective problem-solving Explore typically human challenges to problem-solving, such as multitasking and the negative impact of stress. Introduce tools that can help, such as making lists, visualization, and breaking complex problems down.
  • Problem orientation – fostering self-efficacy Introduce the importance of a positive problem orientation, adopting tools, such as visualization, to promote self-efficacy.
  • Problem orientation – recognizing problems Help clients recognize issues as they occur and use problem checklists to ‘normalize’ the experience.
  • Problem orientation – seeing problems as challenges Encourage clients to break free of harmful and restricted ways of thinking while learning how to argue from another point of view.
  • Problem orientation – use and control emotions Help clients understand the role of emotions in problem-solving, including using feelings to inform the process and managing disruptive emotions (such as cognitive reframing and relaxation exercises).
  • Problem orientation – stop and think Teach clients how to reduce impulsive and avoidance tendencies (visualizing a stop sign or traffic light).
  • Problem definition and formulation Encourage an understanding of the nature of problems and set realistic goals and objectives.
  • Generation of alternatives Work with clients to help them recognize the wide range of potential solutions to each problem (for example, brainstorming).
  • Decision-making Encourage better decision-making through an improved understanding of the consequences of decisions and the value and likelihood of different outcomes.
  • Solution implementation and verification Foster the client’s ability to carry out a solution plan, monitor its outcome, evaluate its effectiveness, and use self-reinforcement to increase the chance of success.
  • Guided practice Encourage the application of problem-solving skills across multiple domains and future stressful problems.
  • Rapid problem-solving Teach clients how to apply problem-solving questions and guidelines quickly in any given situation.

Success in PST depends on the effectiveness of its implementation; using the right approach is crucial (Dobson, 2011).

Problem-solving therapy – Baycrest

The following interventions and techniques are helpful when implementing more effective problem-solving approaches in client’s lives.

First, it is essential to consider if PST is the best approach for the client, based on the problems they present.

Is PPT appropriate?

It is vital to consider whether PST is appropriate for the client’s situation. Therapists new to the approach may require additional guidance (Nezu et al., 2013).

Therapists should consider the following questions before beginning PST with a client (modified from Nezu et al., 2013):

  • Has PST proven effective in the past for the problem? For example, research has shown success with depression, generalized anxiety, back pain, Alzheimer’s disease, cancer, and supporting caregivers (Nezu et al., 2013).
  • Is PST acceptable to the client?
  • Is the individual experiencing a significant mental or physical health problem?

All affirmative answers suggest that PST would be a helpful technique to apply in this instance.

Five problem-solving steps

The following five steps are valuable when working with clients to help them cope with and manage their environment (modified from Dobson, 2011).

Ask the client to consider the following points (forming the acronym ADAPT) when confronted by a problem:

  • Attitude Aim to adopt a positive, optimistic attitude to the problem and problem-solving process.
  • Define Obtain all required facts and details of potential obstacles to define the problem.
  • Alternatives Identify various alternative solutions and actions to overcome the obstacle and achieve the problem-solving goal.
  • Predict Predict each alternative’s positive and negative outcomes and choose the one most likely to achieve the goal and maximize the benefits.
  • Try out Once selected, try out the solution and monitor its effectiveness while engaging in self-reinforcement.

If the client is not satisfied with their solution, they can return to step ‘A’ and find a more appropriate solution.

3 positive psychology exercises

Download 3 Free Positive Psychology Exercises (PDF)

Enhance wellbeing with these free, science-based exercises that draw on the latest insights from positive psychology.

Download 3 Free Positive Psychology Tools Pack (PDF)

By filling out your name and email address below.

Positive self-statements

When dealing with clients facing negative self-beliefs, it can be helpful for them to use positive self-statements.

Use the following (or add new) self-statements to replace harmful, negative thinking (modified from Dobson, 2011):

  • I can solve this problem; I’ve tackled similar ones before.
  • I can cope with this.
  • I just need to take a breath and relax.
  • Once I start, it will be easier.
  • It’s okay to look out for myself.
  • I can get help if needed.
  • Other people feel the same way I do.
  • I’ll take one piece of the problem at a time.
  • I can keep my fears in check.
  • I don’t need to please everyone.

Worksheets for problem solving therapy

5 Worksheets and workbooks

Problem-solving self-monitoring form.

Answering the questions in the Problem-Solving Self-Monitoring Form provides the therapist with necessary information regarding the client’s overall and specific problem-solving approaches and reactions (Dobson, 2011).

Ask the client to complete the following:

  • Describe the problem you are facing.
  • What is your goal?
  • What have you tried so far to solve the problem?
  • What was the outcome?

Reactions to Stress

It can be helpful for the client to recognize their own experiences of stress. Do they react angrily, withdraw, or give up (Dobson, 2011)?

The Reactions to Stress worksheet can be given to the client as homework to capture stressful events and their reactions. By recording how they felt, behaved, and thought, they can recognize repeating patterns.

What Are Your Unique Triggers?

Helping clients capture triggers for their stressful reactions can encourage emotional regulation.

When clients can identify triggers that may lead to a negative response, they can stop the experience or slow down their emotional reaction (Dobson, 2011).

The What Are Your Unique Triggers ? worksheet helps the client identify their triggers (e.g., conflict, relationships, physical environment, etc.).

Problem-Solving worksheet

Imagining an existing or potential problem and working through how to resolve it can be a powerful exercise for the client.

Use the Problem-Solving worksheet to state a problem and goal and consider the obstacles in the way. Then explore options for achieving the goal, along with their pros and cons, to assess the best action plan.

Getting the Facts

Clients can become better equipped to tackle problems and choose the right course of action by recognizing facts versus assumptions and gathering all the necessary information (Dobson, 2011).

Use the Getting the Facts worksheet to answer the following questions clearly and unambiguously:

  • Who is involved?
  • What did or did not happen, and how did it bother you?
  • Where did it happen?
  • When did it happen?
  • Why did it happen?
  • How did you respond?

2 Helpful Group Activities

While therapists can use the worksheets above in group situations, the following two interventions work particularly well with more than one person.

Generating Alternative Solutions and Better Decision-Making

A group setting can provide an ideal opportunity to share a problem and identify potential solutions arising from multiple perspectives.

Use the Generating Alternative Solutions and Better Decision-Making worksheet and ask the client to explain the situation or problem to the group and the obstacles in the way.

Once the approaches are captured and reviewed, the individual can share their decision-making process with the group if they want further feedback.

Visualization

Visualization can be performed with individuals or in a group setting to help clients solve problems in multiple ways, including (Dobson, 2011):

  • Clarifying the problem by looking at it from multiple perspectives
  • Rehearsing a solution in the mind to improve and get more practice
  • Visualizing a ‘safe place’ for relaxation, slowing down, and stress management

Guided imagery is particularly valuable for encouraging the group to take a ‘mental vacation’ and let go of stress.

Ask the group to begin with slow, deep breathing that fills the entire diaphragm. Then ask them to visualize a favorite scene (real or imagined) that makes them feel relaxed, perhaps beside a gently flowing river, a summer meadow, or at the beach.

The more the senses are engaged, the more real the experience. Ask the group to think about what they can hear, see, touch, smell, and even taste.

Encourage them to experience the situation as fully as possible, immersing themselves and enjoying their place of safety.

Such feelings of relaxation may be able to help clients fall asleep, relieve stress, and become more ready to solve problems.

We have included three of our favorite books on the subject of Problem-Solving Therapy below.

1. Problem-Solving Therapy: A Treatment Manual – Arthur Nezu, Christine Maguth Nezu, and Thomas D’Zurilla

Problem-Solving Therapy

This is an incredibly valuable book for anyone wishing to understand the principles and practice behind PST.

Written by the co-developers of PST, the manual provides powerful toolkits to overcome cognitive overload, emotional dysregulation, and the barriers to practical problem-solving.

Find the book on Amazon .

2. Emotion-Centered Problem-Solving Therapy: Treatment Guidelines – Arthur Nezu and Christine Maguth Nezu

Emotion-Centered Problem-Solving Therapy

Another, more recent, book from the creators of PST, this text includes important advances in neuroscience underpinning the role of emotion in behavioral treatment.

Along with clinical examples, the book also includes crucial toolkits that form part of a stepped model for the application of PST.

3. Handbook of Cognitive-Behavioral Therapies – Keith Dobson and David Dozois

Handbook of Cognitive-Behavioral Therapies

This is the fourth edition of a hugely popular guide to Cognitive-Behavioral Therapies and includes a valuable and insightful section on Problem-Solving Therapy.

This is an important book for students and more experienced therapists wishing to form a high-level and in-depth understanding of the tools and techniques available to Cognitive-Behavioral Therapists.

For even more tools to help strengthen your clients’ problem-solving skills, check out the following free worksheets from our blog.

  • Case Formulation Worksheet This worksheet presents a four-step framework to help therapists and their clients come to a shared understanding of the client’s presenting problem.
  • Understanding Your Default Problem-Solving Approach This worksheet poses a series of questions helping clients reflect on their typical cognitive, emotional, and behavioral responses to problems.
  • Social Problem Solving: Step by Step This worksheet presents a streamlined template to help clients define a problem, generate possible courses of action, and evaluate the effectiveness of an implemented solution.

If you’re looking for more science-based ways to help others enhance their wellbeing, check out this signature collection of 17 validated positive psychology tools for practitioners. Use them to help others flourish and thrive.

problem solving test in psychology

17 Top-Rated Positive Psychology Exercises for Practitioners

Expand your arsenal and impact with these 17 Positive Psychology Exercises [PDF] , scientifically designed to promote human flourishing, meaning, and wellbeing.

Created by Experts. 100% Science-based.

While we are born problem-solvers, facing an incredibly diverse set of challenges daily, we sometimes need support.

Problem-Solving Therapy aims to reduce stress and associated mental health disorders and improve wellbeing by improving our ability to cope. PST is valuable in diverse clinical settings, ranging from depression to schizophrenia, with research suggesting it as a highly effective treatment for teaching coping strategies and reducing emotional distress.

Many PST techniques are available to help improve clients’ positive outlook on obstacles while reducing avoidance of problem situations and the tendency to be careless and impulsive.

The PST model typically assesses the client’s strengths, weaknesses, and coping strategies when facing problems before encouraging a healthy experience of and relationship with problem-solving.

Why not use this article to explore the theory behind PST and try out some of our powerful tools and interventions with your clients to help them with their decision-making, coping, and problem-solving?

We hope you enjoyed reading this article. Don’t forget to download our three Positive Psychology Exercises for free .

  • Cuijpers, P., Wit, L., Kleiboer, A., Karyotaki, E., & Ebert, D. (2020). Problem-solving therapy for adult depression: An updated meta-analysis. European P sychiatry ,  48 (1), 27–37.
  • Dobson, K. S. (2011). Handbook of cognitive-behavioral therapies (3rd ed.). Guilford Press.
  • Dobson, K. S., & Dozois, D. J. A. (2021). Handbook of cognitive-behavioral therapies  (4th ed.). Guilford Press.
  • Eysenck, M. W., & Keane, M. T. (2015). Cognitive psychology: A student’s handbook . Psychology Press.
  • Nezu, A. M., & Nezu, C. M. (2009). Problem-solving therapy DVD . Retrieved September 13, 2021, from https://www.apa.org/pubs/videos/4310852
  • Nezu, A. M., & Nezu, C. M. (2018). Emotion-centered problem-solving therapy: Treatment guidelines. Springer.
  • Nezu, A. M., Nezu, C. M., & D’Zurilla, T. J. (2013). Problem-solving therapy: A treatment manual . Springer.

' src=

Share this article:

Article feedback

What our readers think.

Saranya

Thanks for your information given, it was helpful for me something new I learned

Let us know your thoughts Cancel reply

Your email address will not be published.

Save my name, email, and website in this browser for the next time I comment.

Related articles

Variations of the empty chair

The Empty Chair Technique: How It Can Help Your Clients

Resolving ‘unfinished business’ is often an essential part of counseling. If left unresolved, it can contribute to depression, anxiety, and mental ill-health while damaging existing [...]

problem solving test in psychology

29 Best Group Therapy Activities for Supporting Adults

As humans, we are social creatures with personal histories based on the various groups that make up our lives. Childhood begins with a family of [...]

Free Therapy Resources

47 Free Therapy Resources to Help Kick-Start Your New Practice

Setting up a private practice in psychotherapy brings several challenges, including a considerable investment of time and money. You can reduce risks early on by [...]

Read other articles by their category

  • Body & Brain (48)
  • Coaching & Application (57)
  • Compassion (26)
  • Counseling (51)
  • Emotional Intelligence (24)
  • Gratitude (18)
  • Grief & Bereavement (21)
  • Happiness & SWB (40)
  • Meaning & Values (26)
  • Meditation (20)
  • Mindfulness (45)
  • Motivation & Goals (45)
  • Optimism & Mindset (34)
  • Positive CBT (28)
  • Positive Communication (20)
  • Positive Education (47)
  • Positive Emotions (32)
  • Positive Leadership (17)
  • Positive Parenting (3)
  • Positive Psychology (33)
  • Positive Workplace (37)
  • Productivity (16)
  • Relationships (46)
  • Resilience & Coping (35)
  • Self Awareness (21)
  • Self Esteem (37)
  • Strengths & Virtues (31)
  • Stress & Burnout Prevention (34)
  • Theory & Books (46)
  • Therapy Exercises (37)
  • Types of Therapy (64)

Chapter 7: Thinking and Intelligence

Solving problems.

People face problems every day—usually, multiple problems throughout the day. Sometimes these problems are straightforward: To double a recipe for pizza dough, for example, all that is required is that each ingredient in the recipe be doubled. Sometimes, however, the problems we encounter are more complex. For example, say you have a work deadline, and you must mail a printed copy of a report to your supervisor by the end of the business day. The report is time-sensitive and must be sent overnight. You finished the report last night, but your printer will not work today. What should you do? First, you need to identify the problem and then apply a strategy for solving the problem.

Problem-Solving Strategies

When you are presented with a problem—whether it is a complex mathematical problem or a broken printer, how do you solve it? Before finding a solution to the problem, the problem must first be clearly identified. After that, one of many problem-solving strategies can be applied, hopefully resulting in a solution.

Video 1. Problem Solving explains strategies used for solving problems.

A problem-solving strategy is a plan of action used to find a solution. Different strategies have different action plans associated with them. For example, a well-known strategy is trial and error . The old adage, “If at first you don’t succeed, try, try again” describes trial and error. In terms of your broken printer, you could try checking the ink levels, and if that doesn’t work, you could check to make sure the paper tray isn’t jammed. Or maybe the printer isn’t actually connected to your laptop. When using trial and error, you would continue to try different solutions until you solved your problem. Although trial and error is not typically one of the most time-efficient strategies, it is a commonly used one.

Another type of strategy is an algorithm. An algorithm is a problem-solving formula that provides you with step-by-step instructions used to achieve the desired outcome (Kahneman, 2011). You can think of an algorithm as a recipe with highly detailed instructions that produce the same result every time they are performed. Algorithms are used frequently in our everyday lives, especially in computer science. When you run a search on the Internet, search engines like Google use algorithms to decide which entries will appear first in your list of results. Facebook also uses algorithms to decide which posts to display on your newsfeed. Can you identify other situations in which algorithms are used?

A heuristic is another type of problem solving strategy. While an algorithm must be followed exactly to produce a correct result, a heuristic is a general problem-solving framework (Tversky & Kahneman, 1974). You can think of these as mental shortcuts that are used to solve problems. A “rule of thumb” is an example of a heuristic. Such a rule saves the person time and energy when making a decision, but despite its time-saving characteristics, it is not always the best method for making a rational decision. Different types of heuristics are used in different types of situations, but the impulse to use a heuristic occurs when one of five conditions is met (Pratkanis, 1989):

  • When one is faced with too much information
  • When the time to make a decision is limited
  • When the decision to be made is unimportant
  • When there is access to very little information to use in making the decision
  • When an appropriate heuristic happens to come to mind in the same moment

Working backward is a useful heuristic in which you begin solving the problem by focusing on the end result. Consider this example: You live in Washington, D.C., and have been invited to a wedding at 4 PM on Saturday in Philadelphia. Knowing that Interstate 95 tends to back up any day of the week, you need to plan your route and time your departure accordingly. If you want to be at the wedding service by 3:30 PM, and it takes 2.5 hours to get to Philadelphia without traffic, what time should you leave your house? You use the working backward heuristic to plan the events of your day on a regular basis, probably without even thinking about it.

Video 2.  What problem-solving method could you use to solve Einstein’s famous riddle?

Another useful heuristic is the practice of accomplishing a large goal or task by breaking it into a series of smaller steps. Students often use this common method to complete a large research project or long essay for school. For example, students typically brainstorm, develop a thesis or main topic, research the chosen topic, organize their information into an outline, write a rough draft, revise and edit the rough draft, develop a final draft, organize the references list, and proofread their work before turning in the project. The large task becomes less overwhelming when it is broken down into a series of small steps.

Everyday Connections: Solving Puzzles

Problem-solving abilities can improve with practice. Many people challenge themselves every day with puzzles and other mental exercises to sharpen their problem-solving skills. Sudoku puzzles appear daily in most newspapers. Typically, a sudoku puzzle is a 9×9 grid. The simple sudoku below (Figure 1) is a 4×4 grid. To solve the puzzle, fill in the empty boxes with a single digit: 1, 2, 3, or 4. Here are the rules: The numbers must total 10 in each bolded box, each row, and each column; however, each digit can only appear once in a bolded box, row, and column. Time yourself as you solve this puzzle and compare your time with a classmate.

A four column by four row Sudoku puzzle is shown. The top left cell contains the number 3. The top right cell contains the number 2. The bottom right cell contains the number 1. The bottom left cell contains the number 4. The cell at the intersection of the second row and the second column contains the number 4. The cell to the right of that contains the number 1. The cell below the cell containing the number 1 contains the number 2. The cell to the left of the cell containing the number 2 contains the number 3.

Figure 1 . How long did it take you to solve this sudoku puzzle? (You can see the answer at the end of this section.)

Here is another popular type of puzzle that challenges your spatial reasoning skills. Connect all nine dots with four connecting straight lines without lifting your pencil from the paper:

A square shaped outline contains three rows and three columns of dots with equal space between them.

Figure 2. Did you figure it out? (The answer is at the end of this section.) Once you understand how to crack this puzzle, you won’t forget.

Take a look at the “Puzzling Scales” logic puzzle below (Figure 3). Sam Loyd, a well-known puzzle master, created and refined countless puzzles throughout his lifetime (Cyclopedia of Puzzles, n.d.).

A puzzle involving a scale is shown. At the top of the figure it reads: “Sam Loyds Puzzling Scales.” The first row of the puzzle shows a balanced scale with 3 blocks and a top on the left and 12 marbles on the right. Below this row it reads: “Since the scales now balance.” The next row of the puzzle shows a balanced scale with just the top on the left, and 1 block and 8 marbles on the right. Below this row it reads: “And balance when arranged this way.” The third row shows an unbalanced scale with the top on the left side, which is much lower than the right side. The right side is empty. Below this row it reads: “Then how many marbles will it require to balance with that top?”

Figure 3 . The puzzle reads, “Since the scales now balance…and balance when arranged this way, then how many marbles will it require to balance with that top?

Were you able to determine how many marbles are needed to balance the scales in the Puzzling Scales? You need nine. Were you able to solve the other problems above? Here are the answers:

The first puzzle is a Sudoku grid of 16 squares (4 rows of 4 squares) is shown. Half of the numbers were supplied to start the puzzle and are colored blue, and half have been filled in as the puzzle’s solution and are colored red. The numbers in each row of the grid, left to right, are as follows. Row 1: blue 3, red 1, red 4, blue 2. Row 2: red 2, blue 4, blue 1, red 3. Row 3: red 1, blue 3, blue 2, red 4. Row 4: blue 4, red 2, red 3, blue 1.The second puzzle consists of 9 dots arranged in 3 rows of 3 inside of a square. The solution, four straight lines made without lifting the pencil, is shown in a red line with arrows indicating the direction of movement. In order to solve the puzzle, the lines must extend beyond the borders of the box. The four connecting lines are drawn as follows. Line 1 begins at the top left dot, proceeds through the middle and right dots of the top row, and extends to the right beyond the border of the square. Line 2 extends from the end of line 1, through the right dot of the horizontally centered row, through the middle dot of the bottom row, and beyond the square’s border ending in the space beneath the left dot of the bottom row. Line 3 extends from the end of line 2 upwards through the left dots of the bottom, middle, and top rows. Line 4 extends from the end of line 3 through the middle dot in the middle row and ends at the right dot of the bottom row.

Pitfalls to Problem-Solving

Not all problems are successfully solved, however. What challenges stop us from successfully solving a problem?

Video 3.   Cognitive Biases: What They Are , Why They’re Important provides an introduction to the many cognitive biases that prevent us from always thinking clearly and rationally.

Albert Einstein once said, “Insanity is doing the same thing over and over again and expecting a different result.” Imagine a person in a room that has four doorways. One doorway that has always been open in the past is now locked. The person, accustomed to exiting the room by that particular doorway, keeps trying to get out through the same doorway even though the other three doorways are open. The person is stuck—but she just needs to go to another doorway, instead of trying to get out through the locked doorway. A mental set is where you persist in approaching a problem in a way that has worked in the past but is clearly not working now.  Functional fixedness is a type of mental set where you cannot perceive an object being used for something other than what it was designed for. During the Apollo 13 mission to the moon, NASA engineers at Mission Control had to overcome functional fixedness to save the lives of the astronauts aboard the spacecraft. An explosion in a module of the spacecraft damaged multiple systems. The astronauts were in danger of being poisoned by rising levels of carbon dioxide because of problems with the carbon dioxide filters. The engineers found a way for the astronauts to use spare plastic bags, tape, and air hoses to create a makeshift air filter, which saved the lives of the astronauts.

Link to Learning

Check out this Apollo 13 scene where a group of NASA engineers is given the task of overcoming functional fixedness.

Researchers have investigated whether functional fixedness is affected by culture. In one experiment, individuals from the Shuar group in Ecuador were asked to use an object for a purpose other than that for which the object was originally intended. For example, the participants were told a story about a bear and a rabbit that were separated by a river and asked to select among various objects, including a spoon, a cup, erasers, and so on, to help the animals. The spoon was the only object long enough to span the imaginary river, but if the spoon was presented in a way that reflected its normal usage, it took participants longer to choose the spoon to solve the problem. (German & Barrett, 2005). The researchers wanted to know if exposure to highly specialized tools, as occurs with individuals in industrialized nations, affects their ability to transcend functional fixedness. It was determined that functional fixedness is experienced in both industrialized and nonindustrialized cultures (German & Barrett, 2005).

In order to make good decisions, we use our knowledge and our reasoning. Often, this knowledge and reasoning is sound and solid. Sometimes, however, we are swayed by biases or by others manipulating a situation. For example, let’s say you and three friends wanted to rent a house and had a combined target budget of $1,600. The realtor shows you only very run-down houses for $1,600 and then shows you a very nice house for $2,000. Might you ask each person to pay more in rent to get the $2,000 home? Why would the realtor show you the run-down houses and the nice house? The realtor may be challenging your anchoring bias. An anchoring bias occurs when you focus on one piece of information when making a decision or solving a problem. In this case, you’re so focused on the amount of money you are willing to spend that you may not recognize what kinds of houses are available at that price point.

Confirmation bias   is the tendency to focus on information that confirms your existing beliefs. For example, if you think that your professor is not very nice, you notice all of the instances of rude behavior exhibited by the professor while ignoring the countless pleasant interactions he is involved in on a daily basis. This bias proves that first impressions do matter and that we tend to look for information to confirm our initial judgments of others.

Video 4.  Watch this video from the Big Think to learn more about confirmation bias.

Hindsight bias leads you to believe that the event you just experienced was predictable, even though it really wasn’t. In other words, you knew all along that things would turn out the way they did. Representative bias describes a faulty way of thinking, in which you unintentionally stereotype someone or something; for example, you may assume that your professors spend their free time reading books and engaging in intellectual conversation, because the idea of them spending their time playing volleyball or visiting an amusement park does not fit in with your stereotypes of professors.

Finally, the availability heuristic is a heuristic in which you make a decision based on an example, information, or recent experience that is that readily available to you, even though it may not be the best example to inform your decision . To use a common example, would you guess there are more murders or more suicides in America each year? When asked, most people would guess there are more murders. In truth, there are twice as many suicides as there are murders each year. However, murders seem more common because we hear a lot more about murders on an average day. Unless someone we know or someone famous takes their own life, it does not make the news. Murders, on the other hand, we see in the news every day. This leads to the erroneous assumption that the easier it is to think of instances of something, the more often that thing occurs.

Video 5.  Watch the following video for an example of the availability heuristic.

Biases tend to “preserve that which is already established—to maintain our preexisting knowledge, beliefs, attitudes, and hypotheses” (Aronson, 1995; Kahneman, 2011). These biases are summarized in Table 2 below.

Learn more about heuristics and common biases through the article, “ 8 Common Thinking Mistakes Our Brains Make Every Day and How to Prevent Them ” by  Belle Beth Cooper.

You can also watch this clever music video explaining these and other cognitive biases.

  • Modification and adaptation. Provided by : Lumen Learning. License : CC BY: Attribution
  • Psychology in Real Life: Choice Blindness. Authored by : Patrick Carroll for Lumen Learning. License : CC BY: Attribution
  • Problem-Solving. Authored by : OpenStax College. Located at : http://cnx.org/contents/[email protected]:Lk3YnvuC@6/Problem-Solving . License : CC BY: Attribution . License Terms : Download for free at http://cnx.org/content/col11629/latest/.
  • Actors Headshots . Authored by : Vanity Studios. Located at : https://www.flickr.com/photos/149481436@N03/34277183806/in/photostream/ . License : CC BY: Attribution
  • Image of man. Provided by : Pixabay. Located at : https://pixabay.com/en/boy-portrait-outdoors-facial-men-s-3566903/ . License : CC0: No Rights Reserved
  • https://pixabay.com/en/boy-portrait-outdoors-facial-men-s-3566903/. Authored by : Simon Robben. Provided by : Pexels. Located at : https://www.pexels.com/photo/face-facial-hair-fine-looking-guy-614810/ . License : Public Domain: No Known Copyright
  • image of businessman. Authored by : RoyalAnwar. Provided by : Pixabay. Located at : https://pixabay.com/en/model-businessman-corporate-2911332/ . License : CC0: No Rights Reserved
  • man in black shirt. Authored by : songjayjay. Provided by : Pixabay. Located at : https://pixabay.com/en/face-men-s-asia-shirts-blacj-young-1391628/ . License : CC0: No Rights Reserved
  • woman headshot. Authored by : Richard Ha. Provided by : Flickr. Located at : https://www.flickr.com/photos/richardha101/31951459743/in/photolist-QFrzNX-V9Amf2-UM2ZU5-HMQxnd-WmpZx1-5ztiGT-ovm92d-28C1Eyi-qhwZzM-8szjMV-YRsM5B-LCTNFR-LtgVC9-LCUgd8-8gRLbQ-REArrY-WQNThG-ph52sx-2bC2DwH-qE61yp-28NspiC-21h8cj4-RVoBBc-29GiNJ3-21QEU6M-M1YTcp-PePwTJ-LALKtr-RVoBtg-Ry1bpy-FVr9BB-282GDDG-V7zSQJ-NwmdK9-29bSs5N-29mSb5G-272dN8p-26brtas-28tTQWf-RS1osg-WHoUSc-25uETMH-D7crwK-28m9fEh-25taZPB-JCwqE7-241e8Xp-265Ce4A-22V7VVo-25N7i4q . License : CC BY: Attribution
  • businesswoman headshot. Authored by : Richard Rives. Provided by : Flickr. Located at : https://www.flickr.com/photos/richpat2/38251159285/in/photostream/ . License : CC BY: Attribution
  • Can you solve Einsteinu2019s Riddle? . Authored by : Dan Van der Vieren. Provided by : Ted-Ed. Located at : https://www.youtube.com/watch?v=1rDVz_Fb6HQ&index=3&list=PLUmyCeox8XCwB8FrEfDQtQZmCc2qYMS5a . License : Other . License Terms : Standard YouTube License
  • BBC Choice Blindness. Authored by : BBC. Provided by : ChoiceBlindnessLab. Located at : https://www.youtube.com/watch?v=wRqyw-EwgTk . License : Other . License Terms : Standard YouTube License
  • Using Choice Blindness to Shift Political Attitudes and Voter Intentions. Provided by : ChoiceBlindnessLab. Located at : https://www.youtube.com/watch?v=_htNx0eWmgs . License : Other . License Terms : Standard YouTube License

Footer Logo Lumen Candela

Privacy Policy

  • Join Mind Tools

The Mind Tools Content Team

How Good Is Your Problem Solving?

How Good Is Your Problem Solving?

© iStockphoto Entienou

Use a systematic approach.

Good problem solving skills are fundamentally important if you're going to be successful in your career.

But problems are something that we don't particularly like.

They're time-consuming.

They muscle their way into already packed schedules.

They force us to think about an uncertain future.

And they never seem to go away!

That's why, when faced with problems, most of us try to eliminate them as quickly as possible. But have you ever chosen the easiest or most obvious solution – and then realized that you have entirely missed a much better solution? Or have you found yourself fixing just the symptoms of a problem, only for the situation to get much worse?

To be an effective problem-solver, you need to be systematic and logical in your approach. This quiz helps you assess your current approach to problem solving. By improving this, you'll make better overall decisions. And as you increase your confidence with solving problems, you'll be less likely to rush to the first solution – which may not necessarily be the best one.

Once you've completed the quiz, we'll direct you to tools and resources that can help you make the most of your problem-solving skills.

How Good Are You at Solving Problems?

Instructions.

For each statement, click the button in the column that best describes you. Please answer questions as you actually are (rather than how you think you should be), and don't worry if some questions seem to score in the 'wrong direction'. When you are finished, please click the 'Calculate My Total' button at the bottom of the test.

Your last quiz results are shown.

You last completed this quiz on , at .

Score Interpretation

Answering these questions should have helped you recognize the key steps associated with effective problem solving.

This quiz is based on Dr Min Basadur's Simplexity Thinking    problem-solving model. This eight-step process follows the circular pattern shown below, within which current problems are solved and new problems are identified on an ongoing basis. This assessment has not been validated and is intended for illustrative purposes only. 

Figure 1 – The Simplexity Thinking Process

Reproduced with permission from Dr Min Basadur from "The Power of Innovation: How to Make Innovation a Part of Life & How to Put Creative Solutions to Work" Copyright ©1995

Simplex Process Diagram

Below, we outline the tools and strategies you can use for each stage of the problem-solving process. Enjoy exploring these stages!

Step 1: Find the Problem

(Questions 7, 12)

Some problems are very obvious, however others are not so easily identified. As part of an effective problem-solving process, you need to look actively for problems – even when things seem to be running fine. Proactive problem solving helps you avoid emergencies and allows you to be calm and in control when issues arise.

These techniques can help you do this:

  • PEST Analysis   helps you pick up changes to your environment that you should be paying attention to. Make sure too that you're watching changes in customer needs and market dynamics, and that you're monitoring trends that are relevant to your industry.
  • Risk Analysis   helps you identify significant business risks.
  • Failure Modes and Effects Analysis   helps you identify possible points of failure in your business process, so that you can fix these before problems arise.
  • After Action Reviews   help you scan recent performance to identify things that can be done better in the future.
  • Where you have several problems to solve, our articles on Prioritization   and Pareto Analysis   help you think about which ones you should focus on first.

Step 2: Find the Facts

(Questions 10, 14)

After identifying a potential problem, you need information. What factors contribute to the problem? Who is involved with it? What solutions have been tried before? What do others think about the problem?

If you move forward to find a solution too quickly, you risk relying on imperfect information that's based on assumptions and limited perspectives, so make sure that you research the problem thoroughly.

Step 3: Define the Problem

(Questions 3, 9)

Now that you understand the problem, define it clearly and completely. Writing a clear problem definition forces you to establish specific boundaries for the problem. This keeps the scope from growing too large, and it helps you stay focused on the main issues.

A great tool to use at this stage is CATWOE   . With this process, you analyze potential problems by looking at them from six perspectives, those of its Customers; Actors (people within the organization); the Transformation, or business process; the World-view, or top-down view of what's going on; the Owner; and the wider organizational Environment. By looking at a situation from these perspectives, you can open your mind and come to a much sharper and more comprehensive definition of the problem.

Cause and Effect Analysis   is another good tool to use here, as it helps you think about the many different factors that can contribute to a problem. This helps you separate the symptoms of a problem from its fundamental causes.

Step 4: Find Ideas

(Questions 4, 13)

With a clear problem definition, start generating ideas for a solution. The key here is to be flexible in the way you approach a problem. You want to be able to see it from as many perspectives as possible. Looking for patterns or common elements in different parts of the problem can sometimes help. You can also use metaphors   and analogies to help analyze the problem, discover similarities to other issues, and think of solutions based on those similarities.

Traditional brainstorming   and reverse brainstorming   are very useful here. By taking the time to generate a range of creative solutions to the problem, you'll significantly increase the likelihood that you'll find the best possible solution, not just a semi-adequate one. Where appropriate, involve people with different viewpoints to expand the volume of ideas generated.

Don't evaluate your ideas until step 5. If you do, this will limit your creativity at too early a stage.

Step 5: Select and Evaluate

(Questions 6, 15)

After finding ideas, you'll have many options that must be evaluated. It's tempting at this stage to charge in and start discarding ideas immediately. However, if you do this without first determining the criteria for a good solution, you risk rejecting an alternative that has real potential.

Decide what elements are needed for a realistic and practical solution, and think about the criteria you'll use to choose between potential solutions.

Paired Comparison Analysis   , Decision Matrix Analysis   and Risk Analysis   are useful techniques here, as are many of the specialist resources available within our Decision-Making section . Enjoy exploring these!

Step 6: Plan

(Questions 1, 16)

You might think that choosing a solution is the end of a problem-solving process. In fact, it's simply the start of the next phase in problem solving: implementation. This involves lots of planning and preparation. If you haven't already developed a full Risk Analysis   in the evaluation phase, do so now. It's important to know what to be prepared for as you begin to roll out your proposed solution.

The type of planning that you need to do depends on the size of the implementation project that you need to set up. For small projects, all you'll often need are Action Plans   that outline who will do what, when, and how. Larger projects need more sophisticated approaches – you'll find out more about these in the Mind Tools Project Management section. And for projects that affect many other people, you'll need to think about Change Management   as well.

Here, it can be useful to conduct an Impact Analysis   to help you identify potential resistance as well as alert you to problems you may not have anticipated. Force Field Analysis   will also help you uncover the various pressures for and against your proposed solution. Once you've done the detailed planning, it can also be useful at this stage to make a final Go/No-Go Decision   , making sure that it's actually worth going ahead with the selected option.

Step 7: Sell the Idea

(Questions 5, 8)

As part of the planning process, you must convince other stakeholders that your solution is the best one. You'll likely meet with resistance, so before you try to “sell” your idea, make sure you've considered all the consequences.

As you begin communicating your plan, listen to what people say, and make changes as necessary. The better the overall solution meets everyone's needs, the greater its positive impact will be! For more tips on selling your idea, read our article on Creating a Value Proposition   and use our Sell Your Idea   Bite-Sized Training session.

Step 8: Act

(Questions 2, 11)

Finally, once you've convinced your key stakeholders that your proposed solution is worth running with, you can move on to the implementation stage. This is the exciting and rewarding part of problem solving, which makes the whole process seem worthwhile.

This action stage is an end, but it's also a beginning: once you've completed your implementation, it's time to move into the next cycle of problem solving by returning to the scanning stage. By doing this, you'll continue improving your organization as you move into the future.

Problem solving is an exceptionally important workplace skill.

Being a competent and confident problem solver will create many opportunities for you. By using a well-developed model like Simplexity Thinking for solving problems, you can approach the process systematically, and be comfortable that the decisions you make are solid.

Given the unpredictable nature of problems, it's very reassuring to know that, by following a structured plan, you've done everything you can to resolve the problem to the best of your ability.

This site teaches you the skills you need for a happy and successful career; and this is just one of many tools and resources that you'll find here at Mind Tools. Subscribe to our free newsletter , or join the Mind Tools Club and really supercharge your career!

Rate this resource

The Mind Tools Club gives you exclusive tips and tools to boost your career - plus a friendly community and support from our career coaches! 

problem solving test in psychology

Comments (220)

  • Over a month ago Sonia_H wrote Hi PANGGA, This is great news! Thanks for sharing your experience. We hope these 8 steps outlined will help you in multiple ways. ~Sonia Mind Tools Coach
  • Over a month ago PANGGA wrote Thank you for this mind tool. I got to know my skills in solving problem. It will serve as my guide on facing and solving problem that I might encounter.
  • Over a month ago Sarah_H wrote Wow, thanks for your very detailed feedback HardipG. The Mind Tools team will take a look at your feedback and suggestions for improvement. Best wishes, Sarah Mind Tools Coach

Please wait...

Salene M. W. Jones Ph.D.

Cognitive Behavioral Therapy

Solving problems the cognitive-behavioral way, problem solving is another part of behavioral therapy..

Posted February 2, 2022 | Reviewed by Ekua Hagan

  • What Is Cognitive Behavioral Therapy?
  • Find a counsellor who practices CBT
  • Problem-solving is one technique used on the behavioral side of cognitive-behavioral therapy.
  • The problem-solving technique is an iterative, five-step process that requires one to identify the problem and test different solutions.
  • The technique differs from ad-hoc problem-solving in its suspension of judgment and evaluation of each solution.

As I have mentioned in previous posts, cognitive behavioral therapy is more than challenging negative, automatic thoughts. There is a whole behavioral piece of this therapy that focuses on what people do and how to change their actions to support their mental health. In this post, I’ll talk about the problem-solving technique from cognitive behavioral therapy and what makes it unique.

The problem-solving technique

While there are many different variations of this technique, I am going to describe the version I typically use, and which includes the main components of the technique:

The first step is to clearly define the problem. Sometimes, this includes answering a series of questions to make sure the problem is described in detail. Sometimes, the client is able to define the problem pretty clearly on their own. Sometimes, a discussion is needed to clearly outline the problem.

The next step is generating solutions without judgment. The "without judgment" part is crucial: Often when people are solving problems on their own, they will reject each potential solution as soon as they or someone else suggests it. This can lead to feeling helpless and also discarding solutions that would work.

The third step is evaluating the advantages and disadvantages of each solution. This is the step where judgment comes back.

Fourth, the client picks the most feasible solution that is most likely to work and they try it out.

The fifth step is evaluating whether the chosen solution worked, and if not, going back to step two or three to find another option. For step five, enough time has to pass for the solution to have made a difference.

This process is iterative, meaning the client and therapist always go back to the beginning to make sure the problem is resolved and if not, identify what needs to change.

Andrey Burmakin/Shutterstock

Advantages of the problem-solving technique

The problem-solving technique might differ from ad hoc problem-solving in several ways. The most obvious is the suspension of judgment when coming up with solutions. We sometimes need to withhold judgment and see the solution (or problem) from a different perspective. Deliberately deciding not to judge solutions until later can help trigger that mindset change.

Another difference is the explicit evaluation of whether the solution worked. When people usually try to solve problems, they don’t go back and check whether the solution worked. It’s only if something goes very wrong that they try again. The problem-solving technique specifically includes evaluating the solution.

Lastly, the problem-solving technique starts with a specific definition of the problem instead of just jumping to solutions. To figure out where you are going, you have to know where you are.

One benefit of the cognitive behavioral therapy approach is the behavioral side. The behavioral part of therapy is a wide umbrella that includes problem-solving techniques among other techniques. Accessing multiple techniques means one is more likely to address the client’s main concern.

Salene M. W. Jones Ph.D.

Salene M. W. Jones, Ph.D., is a clinical psychologist in Washington State.

  • Find a Therapist
  • Find a Treatment Center
  • Find a Support Group
  • International
  • New Zealand
  • South Africa
  • Switzerland
  • Asperger's
  • Bipolar Disorder
  • Chronic Pain
  • Eating Disorders
  • Passive Aggression
  • Personality
  • Goal Setting
  • Positive Psychology
  • Stopping Smoking
  • Low Sexual Desire
  • Relationships
  • Child Development
  • Therapy Center NEW
  • Diagnosis Dictionary
  • Types of Therapy

March 2024 magazine cover

Understanding what emotional intelligence looks like and the steps needed to improve it could light a path to a more emotionally adept world.

  • Coronavirus Disease 2019
  • Affective Forecasting
  • Neuroscience

U.S. flag

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

  • Publications
  • Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

  • Advanced Search
  • Journal List
  • Front Psychol

Intelligence and Creativity in Problem Solving: The Importance of Test Features in Cognition Research

Associated data.

This paper discusses the importance of three features of psychometric tests for cognition research: construct definition, problem space, and knowledge domain. Definition of constructs, e.g., intelligence or creativity, forms the theoretical basis for test construction. Problem space, being well or ill-defined, is determined by the cognitive abilities considered to belong to the constructs, e.g., convergent thinking to intelligence, divergent thinking to creativity. Knowledge domain and the possibilities it offers cognition are reflected in test results. We argue that (a) comparing results of tests with different problem spaces is more informative when cognition operates in both tests on an identical knowledge domain, and (b) intertwining of abilities related to both constructs can only be expected in tests developed to instigate such a process. Test features should guarantee that abilities can contribute to self-generated and goal-directed processes bringing forth solutions that are both new and applicable. We propose and discuss a test example that was developed to address these issues.

The definition of the construct a test is to measure is most important in test construction and application, because cognitive processes reflect the possibilities a task offers. For instance, a test constructed to assess intelligence will operationalize the definition of this construct, being, in short, finding the correct answer. Also, the definition of a construct becomes important when selecting tests for the confirmation of a specific hypothesis. One can only find confirmation for a hypothesis if the chosen task instigates the necessary cognitive operations. For instance, in trying to confirm the assumed intertwining of certain cognitive abilities (e.g., convergent thinking and divergent thinking), tasks should be applied that have shown to yield the necessary cognitive process.

The second test feature, problem space , determines the degrees of freedom cognition has to its disposal in solving a problem. For instance, cognition will go through a wider search path when problem constraints are less well defined and, consequently, data will differ accordingly.

The third test feature, knowledge domain , is important when comparing results from two different tests. When tests differ in problem space, it is not advisable they should differ in knowledge domain. For instance, when studying the differences in cognitive abilities between tests constructed to asses convergent thinking (mostly defined problem space) and divergent thinking (mostly ill-defined problem space), in general test practice, both tests also differ in knowledge domain. Hence, data will reflect cognition operating not only in different problem spaces, but also operating on different knowledge domains, which makes the interpretation of results ambiguous.

The proposed approach for test development and test application holds the promise of, firstly, studying cognitive abilities in different problem spaces while operating on an identical knowledge domain. Although cognitions’ operations have been studied extensively and superbly in both contexts separately, they have rarely been studied in test situations where one or the other test feature is controlled for. The proposed approach also presents a unique method for studying thinking processes in which cognitive abilities intertwine. On the basis of defined abilities, tasks can be developed that have a higher probability of yielding the hypothesized results.

The construct of intelligence is defined as the ability to produce the single best (or correct) answer to a clearly defined question, such as a proof to a theorem ( Simon, 1973 ). It may also be seen as a domain-general ability ( g -factor; Spearman, 1904 ; Cattell, 1967 ) that has much in common with meta cognitive functions, such as metacognitive knowledge, metacognitive monitoring, and metacognitive control ( Saraç et al., 2014 ).

The construct of creativity, in contrast, is defined as the ability to innovate and move beyond what is already known ( Wertheimer , 1945/1968 ; Ghiselin , 1952/1985 ; Vernon, 1970 ). In other words, it emphasizes the aspect of innovation. This involves the ability to consider things from an uncommon perspective, transcend the old order ( Ghiselin , 1952/1985 ; Chi, 1997 ; Ward, 2007 ), and explore loosely associated ideas ( Guilford, 1950 ; Mednick, 1962 ; Koestler, 1964 ; Gentner, 1983 ; Boden, 1990 ; Christensen, 2007 ). Creativity could also be defined as the ability to generate a solution to problems with ill-defined problem spaces ( Wertheimer , 1945/1968 ; Getzels and Csikszentmihalyi, 1976 ). In this sense it involves the ability to identify problematic aspects of a given situation ( Ghiselin , 1952/1985 ) and, in a wider sense, the ability to define completely new problems ( Getzels, 1975 , 1987 ).

Guilford (1956) introduced the constructs of convergent thinking and divergent thinking abilities. Both thinking abilities are important because they allow us insights in human problem solving. On the basis of their definitions convergent and divergent thinking help us to structurally study human cognitive operations in different situations and over different developmental stages. Convergent thinking is defined as the ability to apply conventional and logical search, recognition, and decision-making strategies to stored information in order to produce an already known answer ( Cropley, 2006 ). Divergent thinking, by contrast, is defined as the ability to produce new approaches and original ideas by forming unexpected combinations from available information and by applying such abilities as semantic flexibility, and fluency of association, ideation, and transformation ( Guilford, 1959 , as cited in Cropley, 2006 , p. 1). Divergent thinking brings forth answers that may never have existed before and are often novel, unusual, or surprising ( Cropley, 2006 ).

Guilford (1967) introduced convergent and divergent thinking as part of a set of five operations that apply in his Structure of Intellect model (SOI model) on six products and four kinds of content, to produce 120 different factors of cognitive abilities. With the SOI model Guilford wanted to give the construct of intelligence a comprehensive model. He wanted the model to include all aspects of intelligence, many of which had been seriously neglected in traditional intelligence testing because of a persistent adherence to the belief in Spearman’s g ( Guilford, 1967 , p. vii). Hence, Guilford envisaged cognition to embrace, among other abilities, both convergent and divergent thinking abilities. After these new constructs were introduced and defined, tests for convergent and divergent thinking emerged. Despite the fact that Guilford reported significant loadings of tests for divergent production on tests constructed to measure convergent production ( Guilford, 1967 , p. 155), over the years, both modes of thinking were considered as separate identities where convergent thinking tests associated with intelligence and divergent thinking tests with creativity ( Cropley, 2006 ; Shye and Yuhas, 2004 ). Even intelligence tests that assess aspects of intelligence that supposedly reflect creative abilities do not actually measure creativity ( Kaufman, 2015 ).

The idea that both convergent and divergent thinking are important for solving problems, and that intelligence helps in the creative process, is not really new. In literature we find models of the creative process that define certain stages to convergent and divergent thinking; the stages of purposeful preparation at the start and those of critical verification at the end of the process, respectively ( Wallas, 1926 ; Webb Young , 1939/2003 ). In this view, divergent thinking enables the generation of new ideas whereas the exploratory activities of convergent thinking enable the conversion of ideas into something new and appropriate ( Cropley and Cropley, 2008 ).

We argue that studying the abilities of divergent and convergent thinking in isolation does not suffice to give us complete insight of all possible aspects of human problem solving, its constituent abilities and the structure of its processes. Processes that in a sequence of thoughts and actions lead to novel and adaptive productions ( Lubart, 2001 ) are more demanding of cognition for understanding the situation at hand and planning a path to a possible solution, than abilities involved in less complex situations ( Jaušovec, 1999 ). Processes that yield self-generated and goal-directed thought are the most complex cognitive processes that can be studied ( Beaty et al., 2016 ). Creative cognition literature is moving toward the view that especially in those processes that yield original and appropriate solutions within a specific context, convergent and divergent abilities intertwine ( Cropley, 2006 ; Ward, 2007 ; Gabora, 2010 ).

The approach of intertwining cognitive abilities is also developed within cognitive neuroscience by focusing on the intertwining of brain networks ( Beaty et al., 2016 ). In this approach divergent thinking relates to the default brain network. This network operates in defocused or associative mode of thought yielding spontaneous and self-generated cognition ( Beaty et al., 2015 ). Convergent thinking relates to the executive control network operating in focused or analytic modes of thought, yielding updating, shifting, and inhibition ( Benedek et al., 2014 ). Defocused attention theory ( Mendelssohn, 1976 ) states that less creative individuals operate with a more focused attention than do creative individuals. This theory argues that e.g., attending to two things at the same time, might result in one analogy, while attending to four things might yield six analogies ( Martindale, 1999 ).

In the process of shifting back and forth along the spectrum between associative and analytic modes of thinking, the fruits of associative thought become ingredients for analytic thought processes, and vice versa ( Gabora, 2010 ). In this process, mental imagery is involved as one sensory aspect of the human ability to gather and process information ( Jung and Haier, 2013 ). Mental imagery is fed by scenes in the environment that provide crucial visual clues for creative problem solving and actuates the need for sketching ( Verstijnen et al., 2001 ).

Creative problem solving processes often involve an interactive relationship between imagining, sketching, and evaluating the result of the sketch ( van Leeuwen et al., 1999 ). This interactive process evolves within a type of imagery called “visual reasoning” where forms and shapes are manipulated in order to specify the configurations and properties of the design entities ( Goldschmidt, 2013 ). The originality of inventions is predicted by the application of visualization, whereas their practicality is predicted by the vividness of imagery ( Palmiero et al., 2015 ). Imaginative thought processes emerge from our conceptual knowledge of the world that is represented in our semantic memory system. In constrained divergent thinking, the neural correlates of this semantic memory system partially overlap with those of the creative cognition system ( Abraham and Bubic, 2015 ).

Studies of convergent and divergent thinking abilities have yielded innumerable valuable insights on the cognitive and neurological aspects involved, e.g., reaction times, strategies, brain areas involved, mental representations, and short and long time memory components. Studies on the relationship between both constructs suggest that it is unlikely that individuals employ similar cognitive strategies when solving more convergent than more divergent thinking tasks ( Jaušovec, 2000 ). However, to arrive at a quality formulation the creative process cannot do without the application of both, convergent and divergent thinking abilities (e.g., Kaufmann, 2003 ; Runco, 2003 ; Sternberg, 2005 ; Dietrich, 2007 ; Cropley and Cropley, 2008 ; Silvia et al., 2013 ; Jung, 2014 ).

When it is our aim to study the networks addressed by the intertwining of convergent and divergent thinking processes that are considered to operate when new, original, and yet appropriate solutions are generated, then traditional thinking tests like intelligence tests and creativity tests are not appropriate; they yield processes related to the definition of one or the other type of construct.

Creative Reasoning Task

According to the new insights gained in cognition research, we need tasks that are developed with the aim to instigate precisely the kind of thinking processes we are looking for. Tasks should also provide a method of scoring independently the contribution of convergent and divergent thinking. As one possible solution for such tasks we present the Creative Reasoning Task (CRT; Jaarsveld, 2007 ; Jaarsveld et al., 2010 , 2012 , 2013 ).

The CRT presents participants with an empty 3 × 3 matrix and asks them to fill it out, as original and complex as possible, by creating components and the relationships that connect them. The created matrix can, in principle, be solved by another person. The creation of components is entirely free, as is the generation of the relationships that connects them into a completed pattern. Created matrices are scored with two sub scores; Relations , which scores the logical complexity of a matrix and is, therefore, considered a measure for convergent thinking, and Components and Specifications , which scores the originality, fluency, and flexibility and, therefore, is considered an indication for divergent thinking (for a more detailed description of the score method, see Appendix 1 in Supplementary Material).

Psychometric studies with the CRT showed, firstly, that convergent and divergent thinking abilities apply within this task and can be assessed independently. The CRT sub score Relations correlated with the Standard Progressive Matrices test (SPM) and the CRT sub score Components and Specifications correlated with a standard creativity test (TCT–DP, Test of Creative Thinking–Drawing Production; Urban and Jellen, 1995 ; Jaarsveld et al., 2010 , 2012 , 2013 ). Studies further showed that, although a correlation was observed for the intelligence and creativity test scores, no correlation was observed between the CRT sub scores relating to intelligent and creative performances ( Jaarsveld et al., 2012 , 2013 ; for further details about the CRT’s objectivity, validity, and reliability, see Appendix 2 in Supplementary Material).

Reasoning in creative thinking can be defined as the involvement of executive/convergent abilities in the inhibition of ideas and the updating of information ( Benedek et al., 2014 ). Jung (2014) describes a dichotomy for cognitive abilities with at one end the dedicated system that relies on explicit and conscious knowledge and at the other end the improvisational system that relies more upon implicit or unconscious knowledge systems. The link between explicit and implicit systems can actually be traced back to Kris’ psychoanalytic approach to creativity dating from the 1950s. The implicit system refers to Kris’ primary process of adaptive regression, where unmodulated thoughts intrude into consciousness; the explicit system refers to the secondary process, where the reworking and transformation of primary process material takes place through reality-oriented and ego-controlled thinking ( Sternberg and Lubart, 1999 ). The interaction between explicit and implicit systems can be seen to form the basis of creative reasoning, i.e., the cognitive ability to solve problems in an effective and adaptive way. This interaction evolved as a cognitive mechanism when human survival depended on finding effective solutions to both common and novel problem situations ( Gabora and Kaufman, 2010 ). Creative reasoning solves that minority of problems that are unforeseen and yet of high adaptability ( Jung, 2014 ).

Hence, common tests are insufficient when it comes to solving problems that are unforeseen and yet of high adaptability, because they present problems that are either unforeseen and measure certain abilities contained in the construct of creativity or they address adaptability and measure certain abilities contained in the construct of intelligence. The CRT presents participants with a problem that they could not have foreseen; the form is blank and offers no stimuli. All tests, even creativity tests, present participants with some kind of stimuli. The CRT addresses adaptability; to invent from scratch a coherent structure that can be solved by another person, like creating a crossword puzzle. Problems, that are unforeseen and of high adaptability, are solved by the application of abilities from both constructs.

Neuroscience of Creative Cognition

Studies in neuroscience showed that cognition operating in ill-defined problem space not only applies divergent thinking but also benefits from additional convergent operations ( Gabora, 2010 ; Jung, 2014 ). Understanding creative cognition may be advanced when we study the flow of information among brain areas ( Jung et al., 2010 ).

In a cognitive neuroscience study with the CRT we focused on the cognitive process evolving within this task. Participants performed the CRT while EEG alpha activity was registered. EEG alpha synchronization in frontal areas is understood as an indication of top-down control ( Cooper et al., 2003 ). When observed in frontal areas, for divergent and convergent thinking tasks, it may not reflect a brain state that is specific for creative cognition but could be attributed to the high processing demands typically involved in creative thinking ( Benedek et al., 2011 ). Top-down control, relates to volitionally focusing attention to task demands ( Buschman and Miller, 2007 ). That this control plays a role in tasks with an ill-defined problem space showed when electroencephalography (EEG) alpha synchronization was stronger for individuals engaged in creative ideation tasks compared to an intelligence related tasks ( Fink et al., 2007 , 2009 ; Fink and Benedek, 2014 ). This activation was also found for the CRT; task related alpha synchronization showed that convergent thinking was integrated in the divergent thinking processes. Analyzes of the stages in the CRT process showed that this alpha synchronization was especially visible at the start of the creative process at prefrontal and frontal sites when information processing was most demanding, i.e., due to multiplicity of ideas, and it was visible at the end of the process, due to narrowing down of alternatives ( Jaarsveld et al., 2015 ).

A functional magnetic resonance imaging (fMRI) study ( Beaty et al., 2015 ) with a creativity task in which cognition had to meet specific constraints, showed the networks involved. The default mode network which drives toward abstraction and metaphorical thinking and the executive control network driving toward certainty ( Jung, 2014 ). Control involves not only maintenance of patterns of activity that represent goals and the means to achieve those ( Miller and Cohen, 2001 ), but also their voluntary suppression when no longer needed, as well as the flexible shift between different goals and mental sets ( Abraham and Windmann, 2007 ). Attention can be focused volitionally by top-down signals derived from task demands and automatically by bottom-up signals from salient stimuli ( Buschman and Miller, 2007 ). Intertwining between top-down and bottom-up attention processes in creative cognition ensures a broadening of attention in free associative thinking ( Abraham and Windmann, 2007 ).

These studies support and enhance the findings of creative cognition research in showing that the generation of original and applicable ideas involves an intertwining between different abilities, networks, and attention processes.

Problem Space

A problem space is an abstract representation, in the mind of the problem solver, of the encountered problem and of the asked for solution ( Simon and Newell, 1971 ; Simon, 1973 ; Hayes and Flowers, 1986 ; Kulkarni and Simon, 1988 ; Runco, 2007 ). The space that comes with a certain problem can, according to the constraints that are formulated for the solution, be labeled well-defined or ill-defined ( Simon and Newell, 1971 ). Consequently, the original problems are labeled closed and open problems, respectively ( Jaušovec, 2000 ).

A problem space contains all possible states that are accessible to the problem solver from the initial state , through iterative application of transformation rules , to the goal state ( Newell and Simon, 1972 ; Anderson, 1983 ). The initial state presents the problem solver with a task description that defines which requirements a solution has to answer. The goal state represents the solution. The proposed solution is a product of the application of transformation rules (algorithms and heuristics) on a series of successive intermediate solutions. The proposed solution is also a product of the iterative evaluations of preceding solutions and decisions based upon these evaluations ( Boden, 1990 ; Gabora, 2002 ; Jaarsveld and van Leeuwen, 2005 ; Goldschmidt, 2014 ). Whether all possible states need to be passed through depends on the problem space being well or ill-defined and this, in turn, depends on the character of the task descriptions.

When task descriptions clearly state which requirements a solution has to answer then the inferences made will show little idiosyncratic aspects and will adhere to the task constraints. As a result, fewer options for alternative paths are open to the problem solver and search for a solution evolves in a well-defined space. Vice versa, when task or problem descriptions are fuzzy and under specified, the problem solver’s inferences are more idiosyncratic; the resulting process will evolve within an ill-defined space and will contain more generative-evaluative cycles in which new goals are set, and the cycle is repeated ( Dennett, 1978 , as cited in Gabora, 2002 , p. 126).

Tasks that evolve in defined problem space are, e.g., traditional intelligence tests (e.g., Wechsler Adult Intelligence Scale, WAIS; and SPM, Raven , 1938/1998 ). The above tests consist of different types of questions, each testing a different component of intelligence. They are used in test practice to assess reasoning abilities in diverse domains, such as, abstract, logical, spatial, verbal, numerical, and mathematical domains. These tests have clearly stated task descriptions and each item has one and only one correct solution that has to be generated from memory or chosen from a set of alternatives, like in multiple choice formats. Tests can be constructed to assess crystallized or fluid intelligence. Crystallized intelligence represents abilities acquired through learning, practice, and exposure to education, while fluid intelligence represents a more basic capacity that is valuable to reasoning and problem solving in contexts not necessarily related to school education ( Carroll, 1982 ).

Tasks that evolve in ill-defined problem space are, e.g., standard creativity tests. These types of test ask for a multitude of ideas to be generated in association with a given item or situation (e.g., “think of as many titles for this story”). Therefore, they are also labeled as divergent thinking test. Although they assess originality, fluency, flexibility of responses, and elaboration, they are not constructed, however, to score appropriateness or applicability. Divergent thinking tests assess one limited aspect of what makes an individual creative. Creativity depends also on variables like affect and intuition; therefore, divergent thinking can only be considered an indication of an individual’s creative potential ( Runco, 2008 ). More precisely, divergent thinking explains just under half of the variance in adult creative potential, which is more than three times that of the contribution of intelligence ( Plucker, 1999 , p. 103). Creative achievement , by contrast, is commonly assessed by means of self-reports such as biographical questionnaires in which participants indicate their achievement across various domains (e.g., literature, music, or theater).

Studies with the CRT showed that problem space differently affects processing of and comprehension of relationships between components. Problem space did not affect the ability to process complex information. This ability showed equal performance in well and ill-defined problem spaces ( Jaarsveld et al., 2012 , 2013 ). However, problem space did affect the comprehension of relationships, which showed in the different frequencies of relationships solved and created ( Jaarsveld et al., 2010 , 2012 ). Problem space also affected the neurological activity as displayed when individuals solve open or closed problems ( Jaušovec, 2000 ).

Problem space further affected trends over grade levels of primary school children for relationships solved in well-defined and applied in ill-defined problem space. Only one of the 12 relationships defined in the CRT, namely Combination, showed an increase with grade for both types of problem spaces ( Jaarsveld et al., 2013 ). In the same study, cognitive development in the CRT showed in the shifts of preference for a certain relationship. These shifts seem to correspond to Piaget’s developmental stages ( Piaget et al., 1977 ; Siegler, 1998 ) which are in evidence in the CRT, but not in the SPM ( Jaarsveld et al., 2013 ).

Design Problems

A sub category of problems with an ill-defined problem space are represented by design problems. In contrast to divergent thinking tasks that ask for the generation of a multitude of ideas, in design tasks interim ideas are nurtured and incrementally developed until they are appropriate for the task. Ideas are rarely discarded and replaced with new ideas ( Goel and Pirolli, 1992 ). The CRT could be considered a design problem because it yields (a) one possible solution and (b) an iterative thinking process that involves the realization of a vague initial idea. In the CRT a created matrix, which is a closed problem, is created within an ill-defined problem space. Design problems can be found, e.g., in engineering, industrial design, advertising, software design, and architecture ( Sakar and Chakrabarti, 2013 ), however, they can also be found in the arts, e.g., poetry, sculpting, and dance geography.

These complex problems are partly determined by unalterable needs, requirements and intentions but the major part of the design problem is undetermined ( Dorst, 2004 ). This author points out that besides containing an original and a functional value, these types of problems contain an aesthetic value. He further states that the interpretation of the design problem and the creation and selection of possible suitable solutions can only be decided during the design process on the basis of proposals made by the designer.

In design problems the generation stage may be considered a divergent thinking process. However, not in the sense that it moves in multiple directions or generates multiple possibilities as in a divergent thinking tests, but in the sense that it unrolls by considering an initially vague idea from different perspectives until it comes into focus and requires further processing to become viable. These processes can be characterized by a set of invariant features ( Goel and Pirolli, 1992 ), e.g., structuring. iteration , and coherence .

Structuring of the initial situation is required in design processes before solving can commence. The problem contains little structured and clear information about its initial state and about the requirements of its solution. Therefore, design problems allow or even require re-interpretation of transformation rules; for instance, rearranging the location of furniture in a room according to a set of desirable outcomes. Here one uncovers implicit requirements that introduce a set of new transformations and/or eliminate existing ones ( Barsalou, 1992 ; Goel and Pirolli, 1992 ) or, when conflicting requirements arise, one creates alternatives and/or introduces new trade-offs between the conflicting constraints ( Yamamoto et al., 2000 ; Dorst, 2011 ).

A second aspect of design processes is their iterative character. After structuring and planning a vague idea emerges, which is the result of the merging of memory items. A vague idea is a cognitive structure that, halfway the creative process is still ill defined and, therefore, can be said to exist in a state of potentiality ( Gabora and Saab, 2011 ). Design processes unroll in an iterative way by the inspection and adjustment of the generated ideas ( Goldschmidt, 2014 ). New meanings are created and realized while the creative mind imposes its own order and meaning on the sensory data and through creative production furthers its own understanding of the world ( Arnheim , 1962/1974 , as cited in Grube and Davis, 1988 , pp. 263–264).

A third aspect of design processes is coherence. Coherence theories characterize coherence in, for instance, philosophical problems and psychological processes, in terms of maximal satisfaction of multiple constraints and compute coherence by using, a.o., connectionist algorithms ( Thagard and Verbeurgt, 1998 ). Another measure of coherence is characterized as continuity in design processes. This measure was developed for a design task ( Jaarsveld and van Leeuwen, 2005 ) and calculated by the occurrence of a given pair of objects in a sketch, expressed as a percentage of all the sketches of a series. In a series of sketches participants designed a logo for a new soft drink. Design series strong in coherence also received a high score for their final design, as assessed by professionals in various domains. Indicating that participants with a high score for the creative quality of their final sketch seemed better in assessing their design activity in relation to the continuity in the process and, thereby, seemed better in navigating the ill-defined space of a design problem ( Jaarsveld and van Leeuwen, 2005 ). In design problems the quality of cognitive production depends, in part, on the abilities to reflect on one’s own creative behavior ( Boden, 1996 ) and to monitor how far along in the process one is in solving it ( Gabora, 2002 ). Hence, design problems are especially suited to study more complex problem solving processes.

Knowledge Domain

Knowledge domain represents disciplines or fields of study organized by general principles, e.g., domains of various arts and sciences. It contains accumulated knowledge that can be divided in diverse content domains, and the relevant algorithms and heuristics. We also speak of knowledge domains when referring to, e.g., visuo-spatial and verbal domains. This latter differentiation may refer to the method by which performance in a certain knowledge domain is assessed, e.g., a visuo-spatial physics task that assesses the content domain of the workings of mass and weights of objects.

In comparing tests results, we should keep in mind that apart from reflecting cognitive processes evolving in different problem spaces, the results also arise from cognition operating on different knowledge domains. We argue that, the still contradictory and inconclusive discussion about the relationship between intelligence and creativity ( Silvia, 2008 ), should involve the issue of knowledge domain.

Intelligence tests contain items that pertain to, e.g., verbal, abstract, mechanical and spatial reasoning abilities, while their content mostly operates on knowledge domains that are related to contents contained in school curricula. Items of creativity tests, by contrast, pertain to more idiosyncratic knowledge domains, their contents relating to associations between stored personal experiences ( Karmiloff-Smith, 1992 ). The influence of knowledge domain on the relationships between different test scores was already mentioned by Guilford (1956 , p. 169). This author expected a higher correlation between scores from a typical intelligence test and a divergent thinking test than between scores from two divergent thinking tests because the former pair operated on identical information and the latter pair on different information.

Studies with the CRT showed that when knowledge domain is controlled for, the development of intelligence operating in ill-defined problem space does not compare to that of traditional intelligence but develops more similarly to the development of creativity ( Welter et al., in press ).

Relationship Intelligence and Creativity

The Threshold theory ( Guilford, 1967 ) predicts a relationship between intelligence and creativity up to approximately an intelligence quotient (IQ) level of 120 but not beyond ( Lubart, 2003 ; Runco, 2007 ). Threshold theory was corroborated when creative potential was found to be related to intelligence up to certain IQ levels; however, the theory was refuted, when focusing on achievement in creative domains; it showed that creative achievement benefited from higher intelligence even at fairly high levels of intellectual ability ( Jauk et al., 2013 ).

Distinguishing between subtypes of general intelligence known as fluent and crystallized intelligence ( Cattell, 1967 ), Sligh et al. (2005) observed an inverse threshold effect with fluid IQ: a correlation with creativity test scores in the high IQ group but not in the average IQ group. Also creative achievement showed to be affected by fluid intelligence ( Beaty et al., 2014 ). Intelligence, defined as fluid IQ, verbal fluency, and strategic abilities, showed a higher correlation with creativity scores ( Silvia, 2008 ) than when defined as crystallized intelligence. Creativity tests, which involved convergent thinking (e.g., Remote Association Test; Mednick, 1962 ) showed higher correlations with intelligence than ones that involved only divergent thinking (e.g., the Alternate Uses Test; Guilford et al., 1978 ).

That the Remote Association test also involves convergent thinking follows from the instructions; one is asked, when presented with a stimulus word (e.g., table) to produce the first word one thinks of (e.g., chair). The word pair table–chair is a common association, more remote is the pair table–plate, and quite remote is table–shark. According to Mednick’s theory (a) all cognitive work is done essentially by combining or associating ideas and (b) individuals with more commonplace associations have an advantage in well-defined problem spaces, because the class of relevant associations is already implicit in the statement of the problem ( Eysenck, 2003 ).

To circumvent the problem of tests differing in knowledge domain, one can develop out of one task a more divergent and a more convergent thinking task by asking, on the one hand, for the generation of original responses, and by asking, on the other hand, for more common responses ( Jauk et al., 2012 ). By changing the instruction of a task, from convergent to divergent, one changes the constraints the solution has to answer and, thereby, one changes for cognition its freedom of operation ( Razumnikova et al., 2009 ; Limb, 2010 ; Jauk et al., 2012 ). However, asking for more common responses is still a divergent thinking task because it instigates a generative and ideational process.

Indeed, studying the relationship between intelligence and creativity with knowledge domain controlled for yielded different results as defined in the Threshold theory. A study in which knowledge domain was controlled for showed, firstly, that intelligence is no predictor for the development of creativity ( Welter et al., 2016 ). Secondly, that the relationship between scores of intelligence and creativity tests as defined under the Threshold theory was only observed in a small subset of primary school children, namely, female children in Grade 4 ( Welter et al., 2016 ). We state that relating results of operations yielded by cognitive abilities performing in defined and in ill-defined problem spaces can only be informative when it is ensured that cognitive processes also operate on an identical knowledge domain.

Intertwining of Cognitive Abilities

Eysenck (2003) observed that there is little justification for considering the constructs of divergent and convergent thinking in categorical terms in which one construct excludes the other. In processes that yield original and appropriate solutions convergent and divergent thinking both operate on the same large knowledge base and the underlying cognitive processes are not entirely dissimilar ( Eysenck, 2003 , p. 110–111).

Divergent thinking is especially effective when it is coupled with convergent thinking ( Runco, 2003 ; Gabora and Ranjan, 2013 ). A design problem study ( Jaarsveld and van Leeuwen, 2005 ) showed that divergent production was active throughout the design, as new meanings are continuously added to the evolving structure ( Akin, 1986 ), and that convergent production was increasingly important toward the end of the process, as earlier productions are wrapped up and integrated in the final design. These findings are in line with the assumptions of Wertheimer (1945/1968) who stated that thinking within ill-defined problem space is characterized by two points of focus; one is to work on the parts, the other to make the central idea clearer.

Parallel to the discussion about the intertwining of convergent and divergent thinking abilities in processes that evolve in ill-defined problem space we find the discussion about how intelligence may facilitate creative thought. This showed when top-down cognitive control advanced divergent processing in the generation of original ideas and a certain measure of cognitive inhibition advanced the fluency of idea generation ( Nusbaum and Silvia, 2011 ). Fluid intelligence and broad retrieval considered as intelligence factors in a structural equation study contributed both to the production of creative ideas in a metaphor generation task ( Beaty and Silvia, 2013 ). The notion that creative thought involves top-down, executive processes showed in a latent variable analysis where inhibition primarily promoted the fluency of ideas, and intelligence promoted their originality ( Benedek et al., 2012 ).

Definitions of the Constructs Intelligence and Creativity

The various definitions of the constructs of intelligence and creativity show a problematic overlap. This overlap stems from the enormous endeavor to unanimously agree on valid descriptions for each construct. Spearman (1927) , after having attended many symposia that aimed at defining intelligence, stated that “in truth, ‘intelligence’ has become a mere vocal sound, a word with so many meanings that finally it has none” (p. 14).

Intelligence is expressed in terms of adaptive, goal-directed behavior; and the subset of such behavior that is labeled “intelligent” seems to be determined in large part by cultural or societal norms ( Sternberg and Salter, 1982 ). The development of the IQ measure is discussed by Carroll (1982) : “Binet (around 1905) realized that intelligent behavior or mental ability can be ranged along a scale. Not much later, Stern (around 1912) noticed that, as chronological age increased, variation in mental age changes proportionally. He developed the IQ ratio, whose standard deviation would be approximately constant over chronological age if mental age was divided by chronological age. With the development of multiple-factor-analyses (Thurstone, around 1935) it could be shown that intelligence is not a simple unitary trait because at least seven somewhat independent factors of mental ability were identified.”

Creativity is defined as a combined manifestation of novelty and usefulness ( Jung et al., 2010 ). Although it is identified with divergent thinking, and performance on divergent thinking tasks predicts, e.g., quantity of creative achievements ( Torrance, 1988 , as cited in Beaty et al., 2014 ) and quality of creative performance ( Beaty et al., 2013 ), it cannot be identified uniquely with divergent thinking.

Divergent thinking often leads to highly original ideas that are honed to appropriate ideas by evaluative processes of critical thinking, and valuative and appreciative considerations ( Runco, 2008 ). Divergent thinking tests should be more considered as estimates of creative problem solving potential rather than of actual creativity ( Runco, 1991 ). Divergent thinking is not specific enough to help us understand what, exactly, are the mental processes—or the cognitive abilities—that yield creative thoughts ( Dietrich, 2007 ).

Although current definitions of intelligence and creativity try to determine for each separate construct a unique set of cognitive abilities, analyses show that definitions vary in the degree to which each includes abilities that are generally considered to belong to the other construct ( Runco, 2003 ; Jaarsveld et al., 2012 ). Abilities considered belonging to the construct of intelligence such as hypothesis testing, inhibition of alternative responses, and creating mental images of new actions or plans are also considered to be involved in creative thinking ( Fuster, 1997 , as cited in Colom et al., 2009 , p. 215). The ability, for instance, to evaluate , which is considered to belong to the construct of intelligence and assesses the match between a proposed solution and task constraints, has long been considered to play a role in creative processes that goes beyond the mere generation of a series of ideas as in creativity tasks ( Wallas, 1926 , as cited in Gabora, 2002 , p. 1; Boden, 1990 ).

The Geneplore model ( Finke et al., 1992 ) explicitly models this idea; after stages in which objects are merely generated, follow phases in which an object’s utility is explored and estimated. The generation phase brings forth pre inventive objects, imaginary objects that are generated without any constraints in mind. In exploration, these objects are evaluated for their possible functionalities. In anticipating the functional characteristics of generated ideas, convergent thinking is needed to apprehend the situation, make evaluations ( Kozbelt, 2008 ), and consider the consequences of a chosen solution ( Goel and Pirolli, 1992 ). Convergent reasoning in creativity tasks invokes criteria of functionality and appropriateness ( Halpern, 2003 ; Kaufmann, 2003 ), goal directedness and adaptive behavior ( Sternberg, 1982 ), as well as the abilities of planning and attention. Convergent thinking stages may even require divergent thinking sub processes to identify restrictions on proposed new ideas and suggest requisite revision strategies ( Mumford et al., 2007 ). Hence, evaluation, which is considered to belong to the construct of intelligence, is also functional in creative processes.

In contrast, the ability of flexibility , which is considered to belong to the construct of creativity and denotes an openness of mind that ensures the generation of ideas from different domains, showed, as a factor component for latent divergent thinking, a relationship with intelligence ( Silvia, 2008 ). Flexibility was also found to play an important role in intelligent behavior where it enables us to do novel things smartly in new situations ( Colunga and Smith, 2008 ). These authors studied children’s generalizations of novel nouns and concluded that if we are to understand human intelligence, we must understand the processes that make inventiveness. They propose to include the construct of flexibility within that of intelligence. Therefore, definitions of the constructs we are to measure affect test construction and the resulting data. However, an overlap between definitions, as discussed, yields a test diversity that makes it impossible to interpret the different findings across studies with any confidence ( Arden et al., 2010 ). Also Kim (2005) concluded that because of differences in tests and administration methods, the observed correlation between intelligence and creativity was negligible. As the various definitions of the constructs of intelligence and creativity show problematic overlap, we propose to circumvent the discussion about which cognitive abilities are assessed by which construct, and to consider both constructs as being involved in one design process. This approach allows us to study the contribution to this process of the various defined abilities, without one construct excluding the other.

Reasoning Abilities

The CRT is a psychometrical tool constructed on the basis of an alternative construct of human cognitive functioning that considers creative reasoning as a thinking process understood as the cooperation between cognitive abilities related to intelligent and creative thinking.

In generating relationships for a matrix, reasoning and more specifically the ability of rule invention is applied. The ability of rule invention could be considered as an extension of the sequence of abilities of rule learning, rule inference, and rule application, implying that creativity is an extension of intelligence ( Shye and Goldzweig, 1999 ). According to this model, we could expect different results between a task assessing abilities of rule learning and rule inference, and a task assessing abilities of rule application. In two studies rule learning and rule inference was assessed with the RPM and rule application was assessed with the CRT. Results showed that from Grades 1 to 4, the frequencies of relationships applied did not correlate with those solved ( Jaarsveld et al., 2010 , 2012 ). Results showed that performance in the CRT allows an insight of cognitive abilities operating on relationships among components that differs from the insight based on performance within the same knowledge domain in a matrix solving task. Hence, reasoning abilities lead to different performances when applied in solving closed as to open problems.

We assume that reasoning abilities are more clearly reflected when one formulates a matrix from scratch; in the process of thinking and drawing one has, so to speak, to solve one’s own matrix. In doing so one explains to oneself the relationship(s) realized so far and what one would like to attain. Drawing is thinking aloud a problem and aids the designer’s thinking processes in providing some “talk-back” ( Cross and Clayburn Cross, 1996 ). Explanatory activity enhances learning through increased depth of processing ( Siegler, 2005 ). Analyzing explanations of examples given with physics problems showed that they clarify and specify the conditions and consequences of actions, and that they explicate tacit knowledge; thereby enhancing and completing an individual’s understanding of principles relevant to the task ( Chi and VanLehn, 1991 ). Constraint of the CRT is that the matrix, in principle, can be solved by another person. Therefore, in a kind of inner explanatory discussion, the designer makes observations of progress, and uses evaluations and decisions to answer this constraint. Because of this, open problems where certain constraints have to be met, constitute a powerful mechanism for promoting understanding and conceptual advancement ( Chi and VanLehn, 1991 ; Mestre, 2002 ; Siegler, 2005 ).

Convergent and divergent thinking processes have been studied with a variety of intelligence and creativity tests, respectively. Relationships between performances on these tests have been demonstrated and a large number of research questions have been addressed. However, the fact that intelligence and creativity tests vary in the definition of their construct, in their problem space, and in their knowledge domain, poses methodological problems regarding the validity of comparisons of test results. When we want to focus on one cognitive process, e.g., intelligent thinking, and on its different performances in well or ill-defined problem situations, we need pairs of tasks that are constructed along identical definitions of the construct to be assessed, that differ, however, in the description of their constraints but are identical regarding their knowledge domain.

One such possible pair, the Progressive Matrices Test and the CRT was suggested here. The CRT was developed on the basis of creative reasoning , a construct that assumes the intertwining of intelligent and creativity related abilities when looking for original and applicable solutions. Matched with the Matrices test, results indicated that, besides similarities, intelligent thinking also yielded considerable differences for both problem spaces. Hence, with knowledge domain controlled, and only differences in problem space remaining, comparison of data yielded new results on intelligence’s operations. Data gathered from intelligence and creativity tests, whether they are performance scores or physiological measurements on the basis of, e.g., EEG, and fMRI methods, are reflections of cognitive processes performing on a certain test that was constructed on the basis of a certain definition of the construct it was meant to measure. Data are also reflections of the processes evolving within a certain problem space and of cognitive abilities operating on a certain knowledge domain.

Data can unhide brain networks that are involved in the performance of certain tasks, e.g., traditional intelligence and creativity tests, but data will always be related to the characteristics of the task. The characteristics of the task, such as problem space and knowledge domain originated at the construction of the task, and the construction, on its turn, is affected by the definition of the construct the task is meant to measure.

Here we present the CRT as one possible solution for the described problems in cognition research. However, for research on relationships among test scores other pairs of tests are imaginable, e.g., pairs of tasks operating on the same domain where one task has a defined problem space and the other one an ill-defined space. It is conceivable that pairs of test could operate, besides on the domain of mathematics, on content of e.g., visuo-spatial, verbal, and musical domains. Pairs of test have been constructed by changing the instruction of a task; instructions instigated a more convergent or a more a divergent mode of response ( Razumnikova et al., 2009 ; Limb, 2010 ; Jauk et al., 2012 ; Beaty et al., 2013 ).

The CRT involves the creation of components and their relationships for a 3 × 3 matrix. Hence, matrices created in the CRT are original in the sense that they all bear individual markers and they are applicable in the sense, that they can, in principle, be solved by another person. We showed that the CRT instigates a real design process; creators’ cognitive abilities are wrapped up in a process that should produce a closed problem within an ill-defined problem space.

For research on the relationship among convergent and divergent thinking, we need pairs of test that differ in the problem spaces related to each test but are identical in the knowledge domain on which cognition operates. The test pair of RPM and CRT provides such a pair. For research on the intertwining of convergent and divergent thinking, we need tasks that measure more than tests assessing each construct alone. We need tasks that are developed on the definition of intertwining cognitive abilities; the CRT is one such test.

Hence, we hope to have sufficiently discussed and demonstrated the importance of the three test features, construct definition, problem space, and knowledge domain, for research questions in creative cognition research.

Author Contributions

All authors listed, have made substantial, direct and intellectual contribution to the work, and approved it for publication.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Supplementary Material

The Supplementary Material for this article can be found online at: http://journal.frontiersin.org/article/10.3389/fpsyg.2017.00134/full#supplementary-material

  • Abraham A., Bubic A. (2015). Semantic memory as the root of imagination. Front. Psychol. 6 : 325 10.3389/fpsyg.2015.00325 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Abraham A., Windmann S. (2007). Creative cognition: the diverse operations and the prospect of applying a cognitive neuroscience perspective. Methods 42 38–48. 10.1016/j.ymeth.2006.12.007 [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Akin O. (1986). Psychology of Architectural Design London: Pion. [ Google Scholar ]
  • Anderson J. R. (1983). The Architecture of Cognition Cambridge, MA: Harvard University Press. [ Google Scholar ]
  • Arden R., Chavez R. S., Grazioplene R., Jung R. E. (2010). Neuroimaging creativity: a psychometric view. Behav. Brain Res. 214 143–156. 10.1016/j.bbr.2010.05.015 [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Arnheim R. (1962/1974). Picasso’s Guernica Berkeley: University of California Press. [ Google Scholar ]
  • Barsalou L. W. (1992). Cognitive Psychology: An Overview for Cognitive Scientists Hillsdale, NJ: LEA. [ Google Scholar ]
  • Beaty R. E., Benedek M., Silvia P. J., Schacter D. L. (2016). Creative cognition and brain network dynamics. Trends Cogn. Sci. 20 87–95. 10.1016/j.tics.2015.10.004 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Beaty R. E., Kaufman S. B., Benedek M., Jung R. E., Kenett Y. N., Jauk E., et al. (2015). Personality and complex brain networks: the role of openness to experience in default network efficiency. Hum. Brain Mapp. 37 773–777. 10.1002/hbm.23065 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Beaty R. E., Nusbaum E. C., Silvia P. J. (2014). Does insight problem solving predict real-world creativity? Psychol. Aesthet. Creat. Arts 8 287–292. 10.1037/a0035727 [ CrossRef ] [ Google Scholar ]
  • Beaty R. E., Silvia R. E. (2013). Metaphorically speaking: cognitive abilities and the production of figurative language. Mem. Cognit. 41 255–267. 10.3758/s13421-012-0258-5 [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Beaty R. E., Smeekens B. A., Silvia P. J., Hodges D. A., Kane M. J. (2013). A first look at the role of domain-general cognitive and creative abilities in jazz improvisation. Psychomusicology 23 262–268. 10.1037/a0034968 [ CrossRef ] [ Google Scholar ]
  • Benedek M., Bergner S., Konen T., Fink A., Neubauer A. C. (2011). EEG alpha synchronization is related to top-down processing in convergent and divergent thinking. Neuropsychologia 49 3505–3511. 10.1016/j.neuropsychologia.2011.09.004 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Benedek M., Franz F., Heene M., Neubauer A. C. (2012). Differential effects of cognitive inhibition and intelligence on creativity. Pers. Individ. Dif. 53 480–485. 10.1016/j.paid.2012.04.014 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Benedek M., Jauk E., Sommer M., Arendasy M., Neubauer A. C. (2014). Intelligence, creativity, and cognitive control: the common and differential involvement of executive functions in intelligence and creativity. Intelligence 46 73–83. 10.1016/j.intell.2014.05.007 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Boden M. A. (1990). The Creative Mind: Myths and Mechanisms London: Abacus. [ Google Scholar ]
  • Boden M. A. (1996). Artificial Intelligence New York, NY: Academic. [ Google Scholar ]
  • Buschman T. J., Miller E. K. (2007). Top-down versus bottom-up control of attention in the prefrontal and posterior parietal cortices. Science 315 1860–1862. 10.1126/science.1138071 [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Carroll J. B. (1982). “The measurement of Intelligence,” in Handbook of Human Intelligence , ed. Sternberg R. J. (New York, NY: Cambridge University Press; ), 29–120. [ Google Scholar ]
  • Cattell R. B. (1967). The theory of fluid and crystallized general intelligence checked at the 5-6 year-old level. Br. J. Educ. Psychol. 37 209–224. 10.1111/j.2044-8279.1967.tb01930.x [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Chi M. T. H. (1997). “ Creativity: Shifting across ontological categories flexibly ,” in Creative Thought: An Investigation of Conceptual Structures and Processes , eds Ward T., Smith S., Vaid J. (Washington, DC: American Psychological Association; ), 209–234. [ Google Scholar ]
  • Chi M. T. H., VanLehn K. A. (1991). The content of physics self-explanations. J. Learn. Sci. 1 69–105. 10.1207/s15327809jls0101_4 [ CrossRef ] [ Google Scholar ]
  • Christensen B. T. (2007). The relationship of analogical distance to analogical function and preinventive structure: the case of engineering design. Mem. Cogn. 35 29–38. 10.3758/BF03195939 [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Colom R., Haier R. J., Head K., Álvarez-Linera J., Quiroga M. A., Shih P. C., et al. (2009). Gray matter correlates of fluid, crystallized, and spatial intelligence: testing the P-FIT model. Intelligence 37 124–135. 10.1016/j.intell.2008.07.007 [ CrossRef ] [ Google Scholar ]
  • Colunga E., Smith L. B. (2008). Flexibility and variability: essential to human cognition and the study of human cognition. New Ideas Psychol. 26 158–192. 10.1016/j.newideapsych.2007.07.012 [ CrossRef ] [ Google Scholar ]
  • Cooper N. R., Croft R. J., Dominey S. J. J., Burgess A. P., Gruzelier J. H. (2003). Paradox lost? Exploring the role of alpha oscillations during externally vs. internally directed attention and the implications for idling and inhibition hypotheses. Int. J. Psychophysiol. 47 65–74. 10.1016/S0167-8760(02)00107-1 [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Cropley A. (2006). In praise of convergent thinking. Creat. Res. J. 18 391–404. 10.1207/s15326934crj1803_13 [ CrossRef ] [ Google Scholar ]
  • Cropley A., Cropley D. (2008). Resolving the paradoxes of creativity: an extended phase model. Camb. J. Educ. 38 355–373. 10.1080/03057640802286871 [ CrossRef ] [ Google Scholar ]
  • Cross N., Clayburn Cross A. (1996). Winning by design: the methods of Gordon Murray, racing car designer. Des. Stud. 17 91–107. 10.1016/0142-694X(95)00027-O [ CrossRef ] [ Google Scholar ]
  • Dennett D. (1978). Brainstorms: Philosophical Essays on Mind and Psychology Montgomery, VT: Bradford Books. [ Google Scholar ]
  • Dietrich A. (2007). Who’s afraid of a cognitive neuroscience of creativity? Methods 42 22–27. 10.1016/j.ymeth.2006.12.009 [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Dorst K. (2004). The problem of design problems: Problem solving and design expertise. J. Design Res. 4 10.1504/JDR.2004.009841 [ CrossRef ] [ Google Scholar ]
  • Dorst K. (2011). The core of ‘design thinking’ and its application. Des. Stud. 32 521–532. 10.1016/j.destud.2011.07.006 [ CrossRef ] [ Google Scholar ]
  • Eysenck H. J. (2003). “Creativity, personality and the convergent-divergent continuum,” in Critical Creative Processes , ed. Runco M. A. (Cresskill, NJ: Hampton Press; ), 95–114. [ Google Scholar ]
  • Fink A., Benedek M. (2014). EEG alpha power and creative ideation. Neurosci. Biobehav. Rev. 44 111–123. 10.1016/j.neubiorev.2012.12.002 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Fink A., Benedek M., Grabner R. H., Staudt B., Neubauer A. C. (2007). Creativity meets neuroscience: experimental tasks for the neuroscientific study of creative thinking. Methods 42 68–76. 10.1016/j.ymeth.2006.12.001 [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Fink A., Grabner R. H., Benedek M., Reishofer G., Hauswirth V., Fally M., et al. (2009). The creative brain: investigation of brain activity during creative problem solving by means of EEG and FMRI. Hum. Brain Mapp. 30 734–748. 10.1002/hbm.20538 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Finke R. A., Ward T. B., Smith S. M. (1992). Creative Cognition: Theory, Research, and Applications Cambridge, MA: MIT Press. [ Google Scholar ]
  • Fuster J. M. (1997). Network memory. Trends Neurosci. 20 451–459. 10.1016/S0166-2236(97)01128-4 [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Gabora L. (2002). “Cognitive mechanisms underlying the creative process,” in Proceedings of the Fourth International Conference on Creativity and Cognition , eds Hewett T., Kavanagh T. (Loughborough: Loughborough University; ), 126–133. [ Google Scholar ]
  • Gabora L. (2010). Revenge of the ‘neurds’: Characterizing creative thought in terms of the structure and dynamics of human memory. Creat. Res. J. 22 1–13. 10.1080/10400410903579494 [ CrossRef ] [ Google Scholar ]
  • Gabora L., Kaufman S. B. (2010). “Evolutionary approaches to creativity,” in The Cambridge Handbook of Creativity , eds Kaufman J. S., Sternberg R. J. (Cambridge: Cambridge University Press; ), 279–300. [ Google Scholar ]
  • Gabora L., Ranjan A. (2013). “How insight emerges in a distributed, content-addressable memory,” in The Neuroscience of Creativity , eds Bristol A., Vartanian O., Kaufman J. (Cambridge: MIT Press; ), 19–43. [ Google Scholar ]
  • Gabora L., Saab A. (2011). “Creative inference and states of potentiality in analogy problem solving,” in Proceedings of the Annual Meeting of the Cognitive Science Society , Boston, MA, 3506–3511. [ Google Scholar ]
  • Gentner D. (1983). Structure mapping: a theoretical framework for analogy. Cogn. Sci. 7 155–170. 10.1207/s15516709cog0702_3 [ CrossRef ] [ Google Scholar ]
  • Getzels J. W. (1975). Problem finding and the inventiveness of solutions. J. Creat. Behav. 9 12–18. 10.1002/j.2162-6057.1975.tb00552.x [ CrossRef ] [ Google Scholar ]
  • Getzels J. W. (1987). “Creativity, intelligence, and problem finding: retrospect and prospect,” in Frontiers of Creativity Research: Beyond the Basics , ed. Isaksen S. G. (Buffalo, NY: Bearly Limited; ), 88–102. [ Google Scholar ]
  • Getzels J. W., Csikszentmihalyi M. (1976). The Creative Vision: A Longitudinal Study of Problem Finding in Art New York, NY: Wiley. [ Google Scholar ]
  • Ghiselin B. (ed.) (1952/1985). The Creative Process Los Angeles: University of California. [ Google Scholar ]
  • Goel V., Pirolli P. (1992). The structure of design problem spaces. Cogn. Sci. 16 395–429. 10.1207/s15516709cog1603_3 [ CrossRef ] [ Google Scholar ]
  • Goldschmidt G. (2013). “A micro view of design reasoning: two-way shifts between embodiment and rationale,” in Creativity and Rationale: Enhancing Human Experience by Design, Human-Computer Interaction Series , ed. Carroll J. M. (London: Springer Verlag; ). 10.1007/978-1-4471-2_3 [ CrossRef ] [ Google Scholar ]
  • Goldschmidt G. (2014). Linkography: Unfolding the Design Process Cambridge, MA: MIT Press. [ Google Scholar ]
  • Grube H. E., Davis S. N. (1988). “Inching our way up mount Olympus: The evolving-systems approach to creative thinking,” in The Nature of Creativity , ed. Sternberg R. J. (New York, NY: Cambridge University Press; ), 243–270. [ Google Scholar ]
  • Guilford J. P. (1950). Creativity. Am. Psychol. 5 444–454. 10.1037/h0063487 [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Guilford J. P. (1956). The structure of intellect model. Psychol. Bull. 53 267–293. 10.1037/h0040755 [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Guilford J. P. (1959). “Traits of creativity,” in Creativity and its Cultivation , ed. Anderson H. H. (New York: Harper; ), 142–161. [ Google Scholar ]
  • Guilford J. P. (1967). The Nature of Human Intelligence New York, NY: McGraw-Hill, Inc. [ Google Scholar ]
  • Guilford J. P., Christensen P. R., Merrifield P. R., Wilson R. C. (1978). Alternate Uses: Manual of Instructions and Interpretation Orange, CA: Sheridan Psychological Services. [ Google Scholar ]
  • Halpern D. F. (2003). “Thinking critically about creative thinking,” in Critical Creative Processes , ed. Runco M. A. (Cresskill, NJ: Hampton Press; ), 189–208. [ Google Scholar ]
  • Hayes J. R., Flowers L. S. (1986). Writing research and the writer. Am. Psychol. 41 1106–1113. 10.1037/0003-066X.41.10.1106 [ CrossRef ] [ Google Scholar ]
  • Jaarsveld S. (2007). Creative Cognition: New Perspectives on Creative Thinking Kaiserslautern: University of Kaiserslautern Press. [ Google Scholar ]
  • Jaarsveld S., Fink A., Rinner M., Schwab D., Benedek M., Lachmann T. (2015). Intelligence in creative processes; an EEG study. Intelligence 49 171–178. 10.1016/j.ijpsycho.2012.02.012 [ CrossRef ] [ Google Scholar ]
  • Jaarsveld S., Lachmann T., Hamel R., van Leeuwen C. (2010). Solving and creating Raven Progressive Matrices: reasoning in well and ill defined problem spaces. Creat. Res. J. 22 304–319. 10.1080/10400419.2010.503541 [ CrossRef ] [ Google Scholar ]
  • Jaarsveld S., Lachmann T., van Leeuwen C. (2012). Creative reasoning across developmental levels: convergence and divergence in problem creation. Intelligence 40 172–188. 10.1016/j.intell.2012.01.002 [ CrossRef ] [ Google Scholar ]
  • Jaarsveld S., Lachmann T., van Leeuwen C. (2013). “The impact of problem space on reasoning: Solving versus creating matrices,” in Proceedings of the 35th Annual Conference of the Cognitive Science Society , eds Knauff M., Pauen M., Sebanz N., Wachsmuth I. (Austin, TX: Cognitive Science Society; ), 2632–2638. [ Google Scholar ]
  • Jaarsveld S., van Leeuwen C. (2005). Sketches from a design process: creative cognition inferred from intermediate products. Cogn. Sci. 29 79–101. 10.1207/s15516709cog2901_4 [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Jauk E., Benedek M., Dunst B., Neubauer A. C. (2013). The relationship between intelligence and creativity: new support for the threshold hypothesis by means of empirical breakpoint detection. Intelligence 41 212–221. 10.1016/j.intell.2013.03.003 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Jauk E., Benedek M., Neubauer A. C. (2012). Tackling creativity at its roots: evidence for different patterns of EEG alpha activity related to convergent and divergent modes of task processing. Int. J. Psychophysiol. 84 219–225. 10.1016/j.ijpsycho.2012.02.012 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Jaušovec N. (1999). “Brain biology and brain functioning,” in Encyclopedia of Creativity , eds Runco M. A., Pritzker S. R. (San Diego, CA: Academic Press; ), 203–212. [ Google Scholar ]
  • Jaušovec N. (2000). Differences in cognitive processes between gifted, intelligent, creative, and average individuals while solving complex problems: an EEG Study. Intelligence 28 213–237. 10.1016/S0160-2896(00)00037-4 [ CrossRef ] [ Google Scholar ]
  • Jung R. E. (2014). Evolution, creativity, intelligence, and madness: “here be dragons”. Front. Psychol 5 : 784 10.3389/fpsyg.2014.00784 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Jung R. E., Haier R. J. (2013). “Creativity and intelligence,” in Neuroscience of Creativity , eds Vartanian O., Bristol A. S., Kaufman J. C. (Cambridge, MA: MIT Press; ), 233–254. [ Google Scholar ]
  • Jung R. E., Segall J. M., Bockholt H. J., Flores R. A., Smith S. M., Chavez R. S., et al. (2010). Neuroanatomy of creativity. Hum. Brain Mapp. 31 398–409. 10.1002/hbm.20874 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Karmiloff-Smith A. (1992). Beyond Modularity: A Developmental Perspective on Cognitive Science Cambridge, MA: MIT Press. [ Google Scholar ]
  • Kaufman J. C. (2015). Why creativity isn’t in IQ tests, why it matters, and why it won’t change anytime soon probably. Intelligence 3 59–72. 10.3390/jintelligence303005 [ CrossRef ] [ Google Scholar ]
  • Kaufmann G. (2003). What to measure? A new look at the concept of creativity. Scand. J. Educ. Res. 47 235–251. 10.1080/00313830308604 [ CrossRef ] [ Google Scholar ]
  • Kim K. H. (2005). Can only intelligent people be creative? J. Second. Gift. Educ. 16 57–66. [ Google Scholar ]
  • Koestler A. (1964). The Act of Creation London: Penguin. [ Google Scholar ]
  • Kozbelt A. (2008). Hierarchical linear modeling of creative artists’ problem solving behaviors. J. Creat. Behav. 42 181–200. 10.1002/j.2162-6057.2008.tb01294.x [ CrossRef ] [ Google Scholar ]
  • Kulkarni D., Simon H. A. (1988). The processes of scientific discovery: the strategy of experimentation. Cogn. Sci. 12 139–175. 10.1016/j.coph.2009.08.004 [ CrossRef ] [ Google Scholar ]
  • Limb C. J. (2010). Your Brain on Improve Available at: http://www.ted.com/talks/charles_limb_your_brain_on_improv [ Google Scholar ]
  • Lubart T. I. (2001). Models of the creative process: past, present and future. Creat. Res. J. 13 295–308. 10.1207/S15326934CRJ1334_07 [ CrossRef ] [ Google Scholar ]
  • Lubart T. I. (2003). Psychologie de la Créativité. Cursus. Psychologie Paris: Armand Colin. [ Google Scholar ]
  • Martindale C. (1999). “Biological basis of creativity,” in Handbook of Creativity , ed. Sternberg R. J. (New York, NY: Cambridge University Press; ), 137–152. [ Google Scholar ]
  • Mednick S. A. (1962). The associative basis of the creative process. Psychol. Rev. 69 220–232. 10.1037/h0048850 [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Mendelssohn G. A. (1976). Associational and attentional processes in creative performance. J. Pers. 44 341–369. 10.1111/j.1467-6494.1976.tb00127.x [ CrossRef ] [ Google Scholar ]
  • Mestre J. P. (2002). Probing adults’ conceptual understanding and transfer of learning via problem posing. Appl. Dev. Psychol. 23 9–50. 10.1016/S0193-3973(01)00101-0 [ CrossRef ] [ Google Scholar ]
  • Miller E. K., Cohen J. D. (2001). An integrative theory of prefrontal cortex function. Annu. Rev. Neurosci. 24 167–202. 10.1146/annurev.neuro.24.1.167 [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Mumford M. D., Hunter S. T., Eubanks D. L., Bedell K. E., Murphy S. T. (2007). Developing leaders for creative efforts: a domain-based approach to leadership development. Hum. Res. Manag. Rev. 17 402–417. 10.1016/j.hrmr.2007.08.002 [ CrossRef ] [ Google Scholar ]
  • Newell A., Simon H. A. (1972). “The theory of human problem solving,” in Human Problem Solving , eds Newell A., Simon H. (Englewood Cliffs, NJ: Prentice Hall; ), 787–868. [ Google Scholar ]
  • Nusbaum E. C., Silvia P. J. (2011). Are intelligence and creativity really so different? Intelligence 39 36–40. 10.1016/j.intell.2010.11.002 [ CrossRef ] [ Google Scholar ]
  • Palmiero M., Nori R., Aloisi V., Ferrara M., Piccardi L. (2015). Domain-specificity of creativity: a study on the relationship between visual creativity and visual mental imagery. Front. Psychol. 6 : 1870 10.3389/fpsyg.2015.01870 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Piaget J., Montangero J., Billeter J. (1977). “La formation des correlats,” in Recherches sur L’abstraction Reflechissante I , ed. Piaget J. (Paris: Presse Universitaires de France; ), 115–129. [ Google Scholar ]
  • Plucker J. (1999). Is the proof in the pudding? Reanalyses of torrance’s (1958 to present) longitudinal study data. Creat. Res. J. 12 103–114. 10.1207/s15326934crj1202_3 [ CrossRef ] [ Google Scholar ]
  • Raven J. C. (1938/1998). Standard Progressive Matrices, Sets A, B, C, D & E Oxford: Oxford Psychologists Press. [ Google Scholar ]
  • Razumnikova O. M., Volf N. V., Tarasova I. V. (2009). Strategy and results: sex differences in electrographic correlates of verbal and figural creativity. Hum. Physiol. 35 285–294. 10.1134/S0362119709030049 [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Runco M. A. (1991). The evaluative, valuative, and divergent thinking of children. J. Creat. Behav. 25 311–319. 10.1177/1073858414568317 [ CrossRef ] [ Google Scholar ]
  • Runco M. A. (2003). “Idea evaluation, divergent thinking, and creativity,” in Critical Creative Processes , ed. Runco M. A. (Cresskill, NJ: Hampton Press; ), 69–94. [ Google Scholar ]
  • Runco M. A. (2007). Creativity, Theories and Themes: Research, Development, and Practice New York, NY: Elsevier. [ Google Scholar ]
  • Runco M. A. (2008). Commentary: divergent thinking is not synonymous with creativity. Psychol. Aesthet. Creat. Arts 2 93–96. 10.1037/1931-3896.2.2.93 [ CrossRef ] [ Google Scholar ]
  • Sakar P., Chakrabarti A. (2013). Support for protocol analyses in design research. Des. Issues 29 70–81. 10.1162/DESI_a_00231 [ CrossRef ] [ Google Scholar ]
  • Saraç S., Önder A., Karakelle S. (2014). The relations among general intelligence, metacognition and text learning performance. Educ. Sci. 39 40–53. [ Google Scholar ]
  • Shye S., Goldzweig G. (1999). Creativity as an extension of intelligence: Faceted definition and structural hypotheses. Megamot 40 31–53. [ Google Scholar ]
  • Shye S., Yuhas I. (2004). Creativity in problem solving. Tech. Rep. 10.13140/2.1.1940.0643 [ CrossRef ] [ Google Scholar ]
  • Siegler R. S. (1998). Children’s Thinking , 3rd Edn Upper Saddle River, NJ: Prentice Hall, 28–50. [ Google Scholar ]
  • Siegler R. S. (2005). Children’s learning. Am. Psychol. 60 769–778. 10.1037/0003-066X.60.8.769 [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Silvia P. J. (2008). Creativity and intelligence revisited: a reanalysis of Wallach and Kogan (1965). Creat. Res. J. 20 34–39. 10.1080/10400410701841807 [ CrossRef ] [ Google Scholar ]
  • Silvia P. J., Beaty R. E., Nussbaum E. C. (2013). Verbal fluency and creativity: general and specific contributions of broad retrieval ability (Gr) factors to divergent thinking. Intelligence 41 328–340. 10.1016/j.intell.2013.05.004 [ CrossRef ] [ Google Scholar ]
  • Simon H. A. (1973). The structure of ill structured problems. Artif. Intell. 4 1012–1021. 10.1016/0004-3702(73)90011-8 [ CrossRef ] [ Google Scholar ]
  • Simon H. A., Newell A. (1971). Human problem solving: state of theory in 1970. Am. Psychol. 26 145–159. 10.1037/h0030806 [ CrossRef ] [ Google Scholar ]
  • Sligh A. C., Conners F. A., Roskos-Ewoldsen B. (2005). Relation of creativity to fluid and crystallized intelligence. J. Creat. Behav. 39 123–136. 10.1002/j.2162-6057.2005.tb01254.x [ CrossRef ] [ Google Scholar ]
  • Spearman C. (1904). ‘General intelligence,’ objectively determined and measured. Am. J. Psychol. 15 201–293. 10.2307/1412107 [ CrossRef ] [ Google Scholar ]
  • Spearman C. (1927). The Abilities of Man London: Macmillan. [ Google Scholar ]
  • Sternberg R. J. (1982). “Conceptions of intelligence,” in Handbook of Human Intelligence , ed. Sternberg R. J. (New York, NY: Cambridge University Press; ), 3–28. [ Google Scholar ]
  • Sternberg R. J. (2005). “The WICS model of giftedness,” in Conceptions of Giftedness , 2nd Edn, eds Sternberg R. J., Davidson J. E. (New York, NY: Cambridge University Press; ), 237–243. [ Google Scholar ]
  • Sternberg R. J., Lubart T. I. (1999). “The concept of creativity: Prospects and paradigms,” in Handbook of Creativity , ed. Sternberg R. J. (New York, NY: Cambridge University Press; ), 3–15. [ Google Scholar ]
  • Sternberg R. J., Salter W. (1982). “The nature of intelligence and its measurements,” in Handbook of Human Intelligence , ed. Sternberg R. J. (New York, NY: Cambridge University Press; ), 3–24. [ Google Scholar ]
  • Thagard P., Verbeurgt K. (1998). Coherence as constraint satisfaction. Cogn. Sci. 22 l–24. 10.1207/s15516709cog2201_1 [ CrossRef ] [ Google Scholar ]
  • Torrance E. P. (1988). “The nature of creativity as manifest in its testing,” in The Nature of Creativity: Contemporary Psychological Perspectives , ed. Sternberg R. J. (New York, NY: Cambridge University Press; ), 43–75. [ Google Scholar ]
  • Urban K. K., Jellen H. G. (1995). Test of Creative Thinking – Drawing Production Frankfurt: Swets Test Services. [ Google Scholar ]
  • van Leeuwen C., Verstijnen I. M., Hekkert P. (1999). “Common unconscious dynamics underlie uncommon conscious effect: a case study in the iterative nature of perception and creation,” in Modeling Consciousness Across the Disciplines , ed. Jordan J. S. (Lanham, MD: University Press of America; ), 179–218. [ Google Scholar ]
  • Vernon P. E. (ed.) (1970). Creativity London: Penguin. [ Google Scholar ]
  • Verstijnen I. M., Heylighen A., Wagemans J., Neuckermans H. (2001). “Sketching, analogies, and creativity,” in Visual and Spatial Reasoning in Design, II. Key Centre of Design Computing and Cognition , eds Gero J. S., Tversky B., Purcell T. (Sydney, NSW: University of Sydney; ). [ Google Scholar ]
  • Wallas G. (1926). The Art of Thought New York, NY: Harcourt, Brace & World. [ Google Scholar ]
  • Ward T. B. (2007). Creative cognition as a window on creativity. Methods 42 28–37. 10.1016/j.ymeth.2006.12.002 [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Webb Young J. (1939/2003). A Technique for Producing Ideas New York, NY: McGraw-Hill. [ Google Scholar ]
  • Welter M. M., Jaarsveld S., Lachmann T. Problem space matters: development of creativity and intelligence in primary school children. Creat. Res. J. (in press) [ Google Scholar ]
  • Welter M. M., Jaarsveld S., van Leeuwen C., Lachmann T. (2016). Intelligence and creativity; over the threshold together? Creat. Res. J. 28 212–218. 10.1080/10400419.2016.1162564 [ CrossRef ] [ Google Scholar ]
  • Wertheimer M. (1945/1968). Productive Thinking (Enlarged Edition) London: Tavistock. [ Google Scholar ]
  • Yamamoto Y., Nakakoji K., Takada S. (2000). Hand on representations in two dimensional spaces for early stages of design. Knowl. Based Syst. 13 357–384. 10.1016/S0950-7051(00)00078-2 [ CrossRef ] [ Google Scholar ]

7.3 Problem Solving

Learning objectives.

  • Describe problem solving strategies
  • Define algorithm and heuristic
  • Explain some common roadblocks to effective problem solving

People face problems every day—usually, multiple problems throughout the day. Sometimes these problems are straightforward: To double a recipe for pizza dough, for example, all that is required is that each ingredient in the recipe be doubled. Sometimes, however, the problems we encounter are more complex. For example, say you have a work deadline, and you must mail a printed copy of a report to your supervisor by the end of the business day. The report is time-sensitive and must be sent overnight. You finished the report last night, but your printer will not work today. What should you do? First, you need to identify the problem and then apply a strategy for solving the problem.

Problem-Solving Strategies

When you are presented with a problem—whether it is a complex mathematical problem or a broken printer, how do you solve it? Before finding a solution to the problem, the problem must first be clearly identified. After that, one of many problem solving strategies can be applied, hopefully resulting in a solution.

A problem-solving strategy is a plan of action used to find a solution. Different strategies have different action plans associated with them ( Table 7.2 ). For example, a well-known strategy is trial and error . The old adage, “If at first you don’t succeed, try, try again” describes trial and error. In terms of your broken printer, you could try checking the ink levels, and if that doesn’t work, you could check to make sure the paper tray isn’t jammed. Or maybe the printer isn’t actually connected to your laptop. When using trial and error, you would continue to try different solutions until you solved your problem. Although trial and error is not typically one of the most time-efficient strategies, it is a commonly used one.

Another type of strategy is an algorithm. An algorithm is a problem-solving formula that provides you with step-by-step instructions used to achieve a desired outcome (Kahneman, 2011). You can think of an algorithm as a recipe with highly detailed instructions that produce the same result every time they are performed. Algorithms are used frequently in our everyday lives, especially in computer science. When you run a search on the Internet, search engines like Google use algorithms to decide which entries will appear first in your list of results. Facebook also uses algorithms to decide which posts to display on your newsfeed. Can you identify other situations in which algorithms are used?

A heuristic is another type of problem solving strategy. While an algorithm must be followed exactly to produce a correct result, a heuristic is a general problem-solving framework (Tversky & Kahneman, 1974). You can think of these as mental shortcuts that are used to solve problems. A “rule of thumb” is an example of a heuristic. Such a rule saves the person time and energy when making a decision, but despite its time-saving characteristics, it is not always the best method for making a rational decision. Different types of heuristics are used in different types of situations, but the impulse to use a heuristic occurs when one of five conditions is met (Pratkanis, 1989):

  • When one is faced with too much information
  • When the time to make a decision is limited
  • When the decision to be made is unimportant
  • When there is access to very little information to use in making the decision
  • When an appropriate heuristic happens to come to mind in the same moment

Working backwards is a useful heuristic in which you begin solving the problem by focusing on the end result. Consider this example: You live in Washington, D.C. and have been invited to a wedding at 4 PM on Saturday in Philadelphia. Knowing that Interstate 95 tends to back up any day of the week, you need to plan your route and time your departure accordingly. If you want to be at the wedding service by 3:30 PM, and it takes 2.5 hours to get to Philadelphia without traffic, what time should you leave your house? You use the working backwards heuristic to plan the events of your day on a regular basis, probably without even thinking about it.

Another useful heuristic is the practice of accomplishing a large goal or task by breaking it into a series of smaller steps. Students often use this common method to complete a large research project or long essay for school. For example, students typically brainstorm, develop a thesis or main topic, research the chosen topic, organize their information into an outline, write a rough draft, revise and edit the rough draft, develop a final draft, organize the references list, and proofread their work before turning in the project. The large task becomes less overwhelming when it is broken down into a series of small steps.

Everyday Connection

Solving puzzles.

Problem-solving abilities can improve with practice. Many people challenge themselves every day with puzzles and other mental exercises to sharpen their problem-solving skills. Sudoku puzzles appear daily in most newspapers. Typically, a sudoku puzzle is a 9×9 grid. The simple sudoku below ( Figure 7.8 ) is a 4×4 grid. To solve the puzzle, fill in the empty boxes with a single digit: 1, 2, 3, or 4. Here are the rules: The numbers must total 10 in each bolded box, each row, and each column; however, each digit can only appear once in a bolded box, row, and column. Time yourself as you solve this puzzle and compare your time with a classmate.

Here is another popular type of puzzle ( Figure 7.9 ) that challenges your spatial reasoning skills. Connect all nine dots with four connecting straight lines without lifting your pencil from the paper:

Take a look at the “Puzzling Scales” logic puzzle below ( Figure 7.10 ). Sam Loyd, a well-known puzzle master, created and refined countless puzzles throughout his lifetime (Cyclopedia of Puzzles, n.d.).

Pitfalls to Problem Solving

Not all problems are successfully solved, however. What challenges stop us from successfully solving a problem? Albert Einstein once said, “Insanity is doing the same thing over and over again and expecting a different result.” Imagine a person in a room that has four doorways. One doorway that has always been open in the past is now locked. The person, accustomed to exiting the room by that particular doorway, keeps trying to get out through the same doorway even though the other three doorways are open. The person is stuck—but she just needs to go to another doorway, instead of trying to get out through the locked doorway. A mental set is where you persist in approaching a problem in a way that has worked in the past but is clearly not working now.

Functional fixedness is a type of mental set where you cannot perceive an object being used for something other than what it was designed for. During the Apollo 13 mission to the moon, NASA engineers at Mission Control had to overcome functional fixedness to save the lives of the astronauts aboard the spacecraft. An explosion in a module of the spacecraft damaged multiple systems. The astronauts were in danger of being poisoned by rising levels of carbon dioxide because of problems with the carbon dioxide filters. The engineers found a way for the astronauts to use spare plastic bags, tape, and air hoses to create a makeshift air filter, which saved the lives of the astronauts.

Link to Learning

Check out this Apollo 13 scene where the group of NASA engineers are given the task of overcoming functional fixedness.

Researchers have investigated whether functional fixedness is affected by culture. In one experiment, individuals from the Shuar group in Ecuador were asked to use an object for a purpose other than that for which the object was originally intended. For example, the participants were told a story about a bear and a rabbit that were separated by a river and asked to select among various objects, including a spoon, a cup, erasers, and so on, to help the animals. The spoon was the only object long enough to span the imaginary river, but if the spoon was presented in a way that reflected its normal usage, it took participants longer to choose the spoon to solve the problem. (German & Barrett, 2005). The researchers wanted to know if exposure to highly specialized tools, as occurs with individuals in industrialized nations, affects their ability to transcend functional fixedness. It was determined that functional fixedness is experienced in both industrialized and nonindustrialized cultures (German & Barrett, 2005).

In order to make good decisions, we use our knowledge and our reasoning. Often, this knowledge and reasoning is sound and solid. Sometimes, however, we are swayed by biases or by others manipulating a situation. For example, let’s say you and three friends wanted to rent a house and had a combined target budget of $1,600. The realtor shows you only very run-down houses for $1,600 and then shows you a very nice house for $2,000. Might you ask each person to pay more in rent to get the $2,000 home? Why would the realtor show you the run-down houses and the nice house? The realtor may be challenging your anchoring bias. An anchoring bias occurs when you focus on one piece of information when making a decision or solving a problem. In this case, you’re so focused on the amount of money you are willing to spend that you may not recognize what kinds of houses are available at that price point.

The confirmation bias is the tendency to focus on information that confirms your existing beliefs. For example, if you think that your professor is not very nice, you notice all of the instances of rude behavior exhibited by the professor while ignoring the countless pleasant interactions he is involved in on a daily basis. Hindsight bias leads you to believe that the event you just experienced was predictable, even though it really wasn’t. In other words, you knew all along that things would turn out the way they did. Representative bias describes a faulty way of thinking, in which you unintentionally stereotype someone or something; for example, you may assume that your professors spend their free time reading books and engaging in intellectual conversation, because the idea of them spending their time playing volleyball or visiting an amusement park does not fit in with your stereotypes of professors.

Finally, the availability heuristic is a heuristic in which you make a decision based on an example, information, or recent experience that is that readily available to you, even though it may not be the best example to inform your decision . Biases tend to “preserve that which is already established—to maintain our preexisting knowledge, beliefs, attitudes, and hypotheses” (Aronson, 1995; Kahneman, 2011). These biases are summarized in Table 7.3 .

Please visit this site to see a clever music video that a high school teacher made to explain these and other cognitive biases to his AP psychology students.

Were you able to determine how many marbles are needed to balance the scales in Figure 7.10 ? You need nine. Were you able to solve the problems in Figure 7.8 and Figure 7.9 ? Here are the answers ( Figure 7.11 ).

As an Amazon Associate we earn from qualifying purchases.

This book may not be used in the training of large language models or otherwise be ingested into large language models or generative AI offerings without OpenStax's permission.

Want to cite, share, or modify this book? This book uses the Creative Commons Attribution License and you must attribute OpenStax.

Access for free at https://openstax.org/books/psychology/pages/1-introduction
  • Authors: Rose M. Spielman, Kathryn Dumper, William Jenkins, Arlene Lacombe, Marilyn Lovett, Marion Perlmutter
  • Publisher/website: OpenStax
  • Book title: Psychology
  • Publication date: Dec 8, 2014
  • Location: Houston, Texas
  • Book URL: https://openstax.org/books/psychology/pages/1-introduction
  • Section URL: https://openstax.org/books/psychology/pages/7-3-problem-solving

© Feb 9, 2022 OpenStax. Textbook content produced by OpenStax is licensed under a Creative Commons Attribution License . The OpenStax name, OpenStax logo, OpenStax book covers, OpenStax CNX name, and OpenStax CNX logo are not subject to the Creative Commons license and may not be reproduced without the prior and express written consent of Rice University.

Get the mobile app for the best Kahoot! experience!

Eilert Hanoa Avatar

Back to blog

Kahoot! stands with Ukraine

Kahoot! is committed to supporting Ukrainian educators and learners affected by the current crisis. To protect the integrity of our platform and our users, we will suspend offering Kahoot!’s services in Russia, with the exception of self-study.

problem solving test in psychology

Ukrainian educators and learners need our support

We are deeply troubled and concerned by the violence and loss of life resulting from the Russian invasion of Ukraine. We stand with the people of Ukraine and we hope for the swiftest and most peaceful possible end to the current crisis. 

Kahoot! has received a number of requests from schools and educators in Ukraine requesting the help of our services to continue teaching despite the disruption of the war. We have supported each of these and we are now offering Kahoot! EDU solutions for free for both K-12 and higher education institutions for one year to Ukrainian schools in need. In addition, we are fast-tracking translation and localization of the Kahoot! platform into Ukrainian. 

Suspending commercial services and sales in Russia

Our commercial footprint in the Russian market is very limited. We do not have offices or representation in the country, nor do we have any physical operations or data services there. The overwhelming majority of our users in Russia are teachers and students using our free service.

Kahoot! is abiding by the international sanctions regime, and does not allow sales to sanctioned individuals or entities in Russia. Shortly after the Russian invasion of Ukraine, Kahoot! initiated a process to suspend offering of all commercial services in Russia. This includes but is not limited to online sales, assisted sales, app store sales and prohibiting sales to Russian corporations and organizations.

Prioritizing safe and secure use of the Kahoot! platform

As part of our mission to make learning awesome, and as education remains a fundamental human right, we offer teachers, students and personal users free access to our platform. We do this in more than 200 countries and regions in a spirit similar to public commons services, such as Wikipedia. 

Similarly, inclusivity is one of Kahoot!’s overarching values. As such, our aim is to, whenever and wherever possible, offer children, schools and others the opportunity to use digital tools for impactful education and learning, irrespective of their background or location. This has been our guiding principle also for offering our service in Russia.

Among our first responses to the crisis was to swiftly expand our global moderation team’s monitoring on all Russia-related content to safeguard the integrity of the platform. 

However, as the situation continues to escalate, it is vital that we are able to ensure that our platform is used according to our own guidelines and standards. Therefore, in addition to suspending sales, we will be taking all possible and necessary steps to suspend access to Kahoot! services in Russia, with the eventual exception of self-study mode which will feature only content verified by Kahoot!.

This will enable students, school children and other individual users to continue their learning journeys both safely and responsibly. We will continue to assess ways in which our services can be offered safely and responsibly to support all learners and educators, also those based in Russia. 

Supporting our employees 

At Kahoot!, we are not just a team in name, we are a team in practice. As such, we are committed to the well-being of our employees, especially those with ties to Ukraine, or those that in other ways are particularly affected by the war. We are providing these colleagues with any support we can. 

Acknowledging the current situation, the Kahoot! Group made an emergency aid donation to Save the Children and the Norwegian Refugee Council. This is a contribution to support life-saving assistance and protection for innocent Ukrainian children, families and refugees. 

As the situation in Ukraine continues to develop our teams across the company are actively monitoring the crisis so that we can respond in the most responsible and supportive way possible. 

Our hearts go out to the people of Ukraine, their loved ones, and anyone affected by this crisis. 

Related articles

Kahoot! ERB

Strengthen students’ reasoning skills with new learning content...

Put your students’ problem-solving, critical thinking, and reasoning skills to the test with these compelling new kahoots!

problem solving test in psychology

Get inspired to explore the future of teaching and learning with prof...

Unlock engaging professional development for educators inspired by the brightest minds in education! Start learning with these exclusive Kahoot! courses featuring thought leaders from...

Inspire students to explore climate change and solutions with Our Cli...

Empower students with knowledge about climate change and how we can take action for a brighter future!

COMMENTS

  1. Creative Problem-Solving Test

    This Creative Problem-solving Test was developed to evaluate whether your attitude towards problem-solving and the manner in which you approach a problem are conducive to creative thinking. This ...

  2. Test Your Problem-Solving Skills

    Test Your Problem-Solving Skills. Personalize Your Emails Personalize your monthly updates from BrainFacts.org by choosing the topics that you care about most! Sign Up Find a Neuroscientist Engage local scientists to educate your community about the brain. ...

  3. 7.3 Problem-Solving

    Additional Problem Solving Strategies:. Abstraction - refers to solving the problem within a model of the situation before applying it to reality.; Analogy - is using a solution that solves a similar problem.; Brainstorming - refers to collecting an analyzing a large amount of solutions, especially within a group of people, to combine the solutions and developing them until an optimal ...

  4. Intelligence and creativity in problem solving: The importance of test

    This paper discusses the importance of three features of psychometric tests for cognition research: construct definition, problem space, and knowledge domain. Definition of constructs, e.g., intelligence or creativity, forms the theoretical basis for test construction. Problem space, being well or ill-defined, is determined by the cognitive abilities considered to belong to the constructs, e.g ...

  5. The Problem-Solving Process

    Problem-solving is a mental process that involves discovering, analyzing, and solving problems. The ultimate goal of problem-solving is to overcome obstacles and find a solution that best resolves the issue. The best strategy for solving a problem depends largely on the unique situation. In some cases, people are better off learning everything ...

  6. Intelligence and Creativity in problem solving: The importance of test

    The second test feature, problem space, determines the degrees of freedom cognition has to its disposal in solving a problem. For instance, cognition will go through a wider search path when problem constraints are less well defined and, consequently, data will differ accordingly.

  7. The Process of Problem Solving

    The findings from this second experiment showed that people tend to go through two different stages when solving a series of problems. People begin their problem-solving process in a generative manner during which they explore various tactics — some successful and some not. Then they use their experience to narrow down their choices of ...

  8. Complex Problem Solving: What It Is and What It Is Not

    1 Department of Psychology, University of Bamberg, Bamberg, Germany; 2 Department of Psychology, Heidelberg University, Heidelberg, Germany; Computer-simulated scenarios have been part of psychological research on problem solving for more than 40 years. The shift in emphasis from simple toy problems to complex, more real-life oriented problems has been accompanied by discussions about the best ...

  9. Problem Solving

    Problem solving refers to cognitive processing directed at achieving a goal when the problem solver does not initially know a solution method. A problem exists when someone has a goal but does not know how to achieve it. Problems can be classified as routine or nonroutine, and as well defined or ill defined.

  10. Assessing complex problem-solving skills in under 20 minutes.

    Rationale: Assessing complex problem-solving skills (CPS) is of great interest to many researchers. However, existing assessments require long testing times making them difficult to include in many studies and experiments. Here, we propose a specific composition of microworlds based on the MicroDYN approach, which allows for valid estimation of CPS in a substantially reduced amount of time (N ...

  11. Problem-Solving Strategies and Obstacles

    Several mental processes are at work during problem-solving. Among them are: Perceptually recognizing the problem. Representing the problem in memory. Considering relevant information that applies to the problem. Identifying different aspects of the problem. Labeling and describing the problem.

  12. How Good Is Your Problem Solving?

    Problem solving is an exceptionally important workplace skill. Being a competent and confident problem solver will create many opportunities for you. By using a well-developed model like Simplexity Thinking for solving problems, you can approach the process systematically, and be comfortable that the decisions you make are solid.

  13. 10 Best Problem-Solving Therapy Worksheets & Activities

    We have included three of our favorite books on the subject of Problem-Solving Therapy below. 1. Problem-Solving Therapy: A Treatment Manual - Arthur Nezu, Christine Maguth Nezu, and Thomas D'Zurilla. This is an incredibly valuable book for anyone wishing to understand the principles and practice behind PST.

  14. Solving Problems

    Many people challenge themselves every day with puzzles and other mental exercises to sharpen their problem-solving skills. Sudoku puzzles appear daily in most newspapers. Typically, a sudoku puzzle is a 9×9 grid. The simple sudoku below (Figure 1) is a 4×4 grid. To solve the puzzle, fill in the empty boxes with a single digit: 1, 2, 3, or 4.

  15. Problem Solving Skills Test

    Step 1: Find the Problem. (Questions 7, 12) Your score is 0 out of 0. Some problems are very obvious, however others are not so easily identified. As part of an effective problem-solving process, you need to look actively for problems - even when things seem to be running fine.

  16. Solving Problems the Cognitive Behavioral Way

    The problem-solving technique is an iterative, five-step process that requires one to identify the problem and test different solutions. The problem-solving technique differs from ad hoc problem ...

  17. Intelligence and Creativity in Problem Solving: The Importance of Test

    The second test feature, problem space, determines the degrees of freedom cognition has to its disposal in solving a problem. For instance, cognition will go through a wider search path when problem constraints are less well defined and, consequently, data will differ accordingly.

  18. 7.3 Problem Solving

    Solving Puzzles. Problem-solving abilities can improve with practice. Many people challenge themselves every day with puzzles and other mental exercises to sharpen their problem-solving skills. Sudoku puzzles appear daily in most newspapers. Typically, a sudoku puzzle is a 9×9 grid. The simple sudoku below is a 4×4 grid. To solve the puzzle ...

  19. Assessing Complex Problem-Solving Skills in Under 20 Minutes

    Being able to solve complex problems is an essential skill to succeed in the 21st century (Autor et al., 2003).Measuring complex problem-solving skills (CPS) has, therefore, been of great interest to psychologists for several decades (Schoppek et al., 2019).A recent culmination of this interest has been the assessment of CPS in the Program for International Student Assessment 2012, the ...

  20. Problem Solving Ability Test

    Course: Psychology (PSY101) 418 Documents. University: Mahatma Gandhi University. Info. Download. AI Quiz. A short introduction and procedure of problem solving ability test problem solving ability test (psat) problem solving ability test (psat), developed dubey and.

  21. Put students' reasoning skills to the test with ERB on Kahoot!

    Sparking engagement in key problem-solving skills. These kahoots will challenge your students' reasoning in a wide variety of ways. By working through questions that call on quantitative as well as verbal reasoning, students will practice using both numbers and language to solve problems.