problem solving approach in education

Center for Teaching

Teaching problem solving.

Print Version

Tips and Techniques

Expert vs. novice problem solvers, communicate.

Have students identify specific problems, difficulties, or confusions . Don’t waste time working through problems that students already understand.
If students are unable to articulate their concerns, determine where they are having trouble by asking them to identify the specific concepts or principles associated with the problem.
In a one-on-one tutoring session, ask the student to work his/her problem out loud . This slows down the thinking process, making it more accurate and allowing you to access understanding.
When working with larger groups you can ask students to provide a written “two-column solution.” Have students write up their solution to a problem by putting all their calculations in one column and all of their reasoning (in complete sentences) in the other column. This helps them to think critically about their own problem solving and helps you to more easily identify where they may be having problems. Two-Column Solution (Math) Two-Column Solution (Physics)

Encourage Independence

Model the problem solving process rather than just giving students the answer. As you work through the problem, consider how a novice might struggle with the concepts and make your thinking clear
Have students work through problems on their own. Ask directing questions or give helpful suggestions, but provide only minimal assistance and only when needed to overcome obstacles.
Don’t fear group work ! Students can frequently help each other, and talking about a problem helps them think more critically about the steps needed to solve the problem. Additionally, group work helps students realize that problems often have multiple solution strategies, some that might be more effective than others

Be sensitive

Frequently, when working problems, students are unsure of themselves. This lack of confidence may hamper their learning. It is important to recognize this when students come to us for help, and to give each student some feeling of mastery. Do this by providing positive reinforcement to let students know when they have mastered a new concept or skill.

Encourage Thoroughness and Patience

Try to communicate that the process is more important than the answer so that the student learns that it is OK to not have an instant solution. This is learned through your acceptance of his/her pace of doing things, through your refusal to let anxiety pressure you into giving the right answer, and through your example of problem solving through a step-by step process.

Experts (teachers) in a particular field are often so fluent in solving problems from that field that they can find it difficult to articulate the problem solving principles and strategies they use to novices (students) in their field because these principles and strategies are second nature to the expert. To teach students problem solving skills, a teacher should be aware of principles and strategies of good problem solving in his or her discipline .

The mathematician George Polya captured the problem solving principles and strategies he used in his discipline in the book How to Solve It: A New Aspect of Mathematical Method (Princeton University Press, 1957). The book includes a summary of Polya’s problem solving heuristic as well as advice on the teaching of problem solving.

Teaching Guides

Online Course Development Resources
Principles & Frameworks
Pedagogies & Strategies
Reflecting & Assessing
Challenges & Opportunities
Populations & Contexts

Quick Links

Services for Departments and Schools
Examples of Online Instructional Modules

Center for Teaching Innovation

Resource library.

Establishing Community Agreements and Classroom Norms
Sample group work rubric
Problem-Based Learning Clearinghouse of Activities, University of Delaware

Problem-Based Learning

Problem-based learning  (PBL) is a student-centered approach in which students learn about a subject by working in groups to solve an open-ended problem. This problem is what drives the motivation and the learning. 

Why Use Problem-Based Learning?

Nilson (2010) lists the following learning outcomes that are associated with PBL. A well-designed PBL project provides students with the opportunity to develop skills related to:

Working in teams.
Managing projects and holding leadership roles.
Oral and written communication.
Self-awareness and evaluation of group processes.
Working independently.
Critical thinking and analysis.
Explaining concepts.
Self-directed learning.
Applying course content to real-world examples.
Researching and information literacy.
Problem solving across disciplines.

Considerations for Using Problem-Based Learning

Rather than teaching relevant material and subsequently having students apply the knowledge to solve problems, the problem is presented first. PBL assignments can be short, or they can be more involved and take a whole semester. PBL is often group-oriented, so it is beneficial to set aside classroom time to prepare students to  work in groups  and to allow them to engage in their PBL project.

Students generally must:

Examine and define the problem.
Explore what they already know about underlying issues related to it.
Determine what they need to learn and where they can acquire the information and tools necessary to solve the problem.
Evaluate possible ways to solve the problem.
Solve the problem.
Report on their findings.

Getting Started with Problem-Based Learning

Articulate the learning outcomes of the project. What do you want students to know or be able to do as a result of participating in the assignment?
Create the problem. Ideally, this will be a real-world situation that resembles something students may encounter in their future careers or lives. Cases are often the basis of PBL activities. Previously developed PBL activities can be found online through the University of Delaware’s PBL Clearinghouse of Activities .
Establish ground rules at the beginning to prepare students to work effectively in groups.
Introduce students to group processes and do some warm up exercises to allow them to practice assessing both their own work and that of their peers.
Consider having students take on different roles or divide up the work up amongst themselves. Alternatively, the project might require students to assume various perspectives, such as those of government officials, local business owners, etc.
Establish how you will evaluate and assess the assignment. Consider making the self and peer assessments a part of the assignment grade.

Nilson, L. B. (2010). Teaching at its best: A research-based resource for college instructors (2nd ed.).  San Francisco, CA: Jossey-Bass. 

Why Every Educator Needs to Teach Problem-Solving Skills

Strong problem-solving skills will help students be more resilient and will increase their academic and career success .

Want to learn more about how to measure and teach students’ higher-order skills, including problem solving, critical thinking, and written communication?

Problem-solving skills are essential in school, careers, and life.

Problem-solving skills are important for every student to master. They help individuals navigate everyday life and find solutions to complex issues and challenges. These skills are especially valuable in the workplace, where employees are often required to solve problems and make decisions quickly and effectively.

Problem-solving skills are also needed for students’ personal growth and development because they help individuals overcome obstacles and achieve their goals. By developing strong problem-solving skills, students can improve their overall quality of life and become more successful in their personal and professional endeavors.

Problem-Solving Skills Help Students…

develop resilience.

Problem-solving skills are an integral part of resilience and the ability to persevere through challenges and adversity. To effectively work through and solve a problem, students must be able to think critically and creatively. Critical and creative thinking help students approach a problem objectively, analyze its components, and determine different ways to go about finding a solution.

This process in turn helps students build self-efficacy . When students are able to analyze and solve a problem, this increases their confidence, and they begin to realize the power they have to advocate for themselves and make meaningful change.

When students gain confidence in their ability to work through problems and attain their goals, they also begin to build a growth mindset . According to leading resilience researcher, Carol Dweck, “in a growth mindset, people believe that their most basic abilities can be developed through dedication and hard work—brains and talent are just the starting point. This view creates a love of learning and a resilience that is essential for great accomplishment.”

Set and Achieve Goals

Students who possess strong problem-solving skills are better equipped to set and achieve their goals. By learning how to identify problems, think critically, and develop solutions, students can become more self-sufficient and confident in their ability to achieve their goals. Additionally, problem-solving skills are used in virtually all fields, disciplines, and career paths, which makes them important for everyone. Building strong problem-solving skills will help students enhance their academic and career performance and become more competitive as they begin to seek full-time employment after graduation or pursue additional education and training.

Resolve Conflicts

In addition to increased social and emotional skills like self-efficacy and goal-setting, problem-solving skills teach students how to cooperate with others and work through disagreements and conflicts. Problem-solving promotes “thinking outside the box” and approaching a conflict by searching for different solutions. This is a very different (and more effective!) method than a more stagnant approach that focuses on placing blame or getting stuck on elements of a situation that can’t be changed.

While it’s natural to get frustrated or feel stuck when working through a conflict, students with strong problem-solving skills will be able to work through these obstacles, think more rationally, and address the situation with a more solution-oriented approach. These skills will be valuable for students in school, their careers, and throughout their lives.

Achieve Success

We are all faced with problems every day. Problems arise in our personal lives, in school and in our jobs, and in our interactions with others. Employers especially are looking for candidates with strong problem-solving skills. In today’s job market, most jobs require the ability to analyze and effectively resolve complex issues. Students with strong problem-solving skills will stand out from other applicants and will have a more desirable skill set.

In a recent opinion piece published by The Hechinger Report , Virgel Hammonds, Chief Learning Officer at KnowledgeWorks, stated “Our world presents increasingly complex challenges. Education must adapt so that it nurtures problem solvers and critical thinkers.” Yet, the “traditional K–12 education system leaves little room for students to engage in real-world problem-solving scenarios.” This is the reason that a growing number of K–12 school districts and higher education institutions are transforming their instructional approach to personalized and competency-based learning, which encourage students to make decisions, problem solve and think critically as they take ownership of and direct their educational journey.

Problem-Solving Skills Can Be Measured and Taught

Research shows that problem-solving skills can be measured and taught. One effective method is through performance-based assessments which require students to demonstrate or apply their knowledge and higher-order skills to create a response or product or do a task.

What Are Performance-Based Assessments?

With the No Child Left Behind Act (2002), the use of standardized testing became the primary way to measure student learning in the U.S. The legislative requirements of this act shifted the emphasis to standardized testing, and this led to a decline in nontraditional testing methods .

But many educators, policy makers, and parents have concerns with standardized tests. Some of the top issues include that they don’t provide feedback on how students can perform better, they don’t value creativity, they are not representative of diverse populations, and they can be disadvantageous to lower-income students.

While standardized tests are still the norm, U.S. Secretary of Education Miguel Cardona is encouraging states and districts to move away from traditional multiple choice and short response tests and instead use performance-based assessment, competency-based assessments, and other more authentic methods of measuring students abilities and skills rather than rote learning.

Performance-based assessments measure whether students can apply the skills and knowledge learned from a unit of study. Typically, a performance task challenges students to use their higher-order skills to complete a project or process. Tasks can range from an essay to a complex proposal or design.

Preview a Performance-Based Assessment

Want a closer look at how performance-based assessments work? Preview CAE’s K–12 and Higher Education assessments and see how CAE’s tools help students develop critical thinking, problem-solving, and written communication skills.

Performance-Based Assessments Help Students Build and Practice Problem-Solving Skills

In addition to effectively measuring students’ higher-order skills, including their problem-solving skills, performance-based assessments can help students practice and build these skills. Through the assessment process, students are given opportunities to practically apply their knowledge in real-world situations. By demonstrating their understanding of a topic, students are required to put what they’ve learned into practice through activities such as presentations, experiments, and simulations.

This type of problem-solving assessment tool requires students to analyze information and choose how to approach the presented problems. This process enhances their critical thinking skills and creativity, as well as their problem-solving skills. Unlike traditional assessments based on memorization or reciting facts, performance-based assessments focus on the students’ decisions and solutions, and through these tasks students learn to bridge the gap between theory and practice.

Performance-based assessments like CAE’s College and Career Readiness Assessment (CRA+) and Collegiate Learning Assessment (CLA+) provide students with in-depth reports that show them which higher-order skills they are strongest in and which they should continue to develop. This feedback helps students and their teachers plan instruction and supports to deepen their learning and improve their mastery of critical skills.

Explore CAE’s Problem-Solving Assessments

CAE offers performance-based assessments that measure student proficiency in higher-order skills including problem solving, critical thinking, and written communication.

College and Career Readiness Assessment (CCRA+) for secondary education and
Collegiate Learning Assessment (CLA+) for higher education.

Our solution also includes instructional materials, practice models, and professional development.

We can help you create a program to build students’ problem-solving skills that includes:

Measuring students’ problem-solving skills through a performance-based assessment
Using the problem-solving assessment data to inform instruction and tailor interventions
Teaching students problem-solving skills and providing practice opportunities in real-life scenarios
Supporting educators with quality professional development

Get started with our problem-solving assessment tools to measure and build students’ problem-solving skills today! These skills will be invaluable to students now and in the future.

Ready to Get Started?

Learn more about cae’s suite of products and let’s get started measuring and teaching students important higher-order skills like problem solving..

Teaching Problem-Solving Skills

Many instructors design opportunities for students to solve “problems”. But are their students solving true problems or merely participating in practice exercises? The former stresses critical thinking and decision making skills whereas the latter requires only the application of previously learned procedures.

Problem solving is often broadly defined as "the ability to understand the environment, identify complex problems, review related information to develop, evaluate strategies and implement solutions to build the desired outcome" (Fissore, C. et al, 2021). True problem solving is the process of applying a method – not known in advance – to a problem that is subject to a specific set of conditions and that the problem solver has not seen before, in order to obtain a satisfactory solution.

Below you will find some basic principles for teaching problem solving and one model to implement in your classroom teaching.

Principles for teaching problem solving

Model a useful problem-solving method . Problem solving can be difficult and sometimes tedious. Show students how to be patient and persistent, and how to follow a structured method, such as Woods’ model described below. Articulate your method as you use it so students see the connections.
Teach within a specific context . Teach problem-solving skills in the context in which they will be used by students (e.g., mole fraction calculations in a chemistry course). Use real-life problems in explanations, examples, and exams. Do not teach problem solving as an independent, abstract skill.
Help students understand the problem . In order to solve problems, students need to define the end goal. This step is crucial to successful learning of problem-solving skills. If you succeed at helping students answer the questions “what?” and “why?”, finding the answer to “how?” will be easier.
Take enough time . When planning a lecture/tutorial, budget enough time for: understanding the problem and defining the goal (both individually and as a class); dealing with questions from you and your students; making, finding, and fixing mistakes; and solving entire problems in a single session.
Ask questions and make suggestions . Ask students to predict “what would happen if …” or explain why something happened. This will help them to develop analytical and deductive thinking skills. Also, ask questions and make suggestions about strategies to encourage students to reflect on the problem-solving strategies that they use.
Link errors to misconceptions . Use errors as evidence of misconceptions, not carelessness or random guessing. Make an effort to isolate the misconception and correct it, then teach students to do this by themselves. We can all learn from mistakes.

Woods’ problem-solving model

Define the problem.

The system . Have students identify the system under study (e.g., a metal bridge subject to certain forces) by interpreting the information provided in the problem statement. Drawing a diagram is a great way to do this.
Known(s) and concepts . List what is known about the problem, and identify the knowledge needed to understand (and eventually) solve it.
Unknown(s) . Once you have a list of knowns, identifying the unknown(s) becomes simpler. One unknown is generally the answer to the problem, but there may be other unknowns. Be sure that students understand what they are expected to find.
Units and symbols . One key aspect in problem solving is teaching students how to select, interpret, and use units and symbols. Emphasize the use of units whenever applicable. Develop a habit of using appropriate units and symbols yourself at all times.
Constraints . All problems have some stated or implied constraints. Teach students to look for the words "only", "must", "neglect", or "assume" to help identify the constraints.
Criteria for success . Help students consider, from the beginning, what a logical type of answer would be. What characteristics will it possess? For example, a quantitative problem will require an answer in some form of numerical units (e.g., $/kg product, square cm, etc.) while an optimization problem requires an answer in the form of either a numerical maximum or minimum.

Think about it

“Let it simmer”. Use this stage to ponder the problem. Ideally, students will develop a mental image of the problem at hand during this stage.
Identify specific pieces of knowledge . Students need to determine by themselves the required background knowledge from illustrations, examples and problems covered in the course.
Collect information . Encourage students to collect pertinent information such as conversion factors, constants, and tables needed to solve the problem.

Plan a solution

Consider possible strategies . Often, the type of solution will be determined by the type of problem. Some common problem-solving strategies are: compute; simplify; use an equation; make a model, diagram, table, or chart; or work backwards.
Choose the best strategy . Help students to choose the best strategy by reminding them again what they are required to find or calculate.

Carry out the plan

Be patient . Most problems are not solved quickly or on the first attempt. In other cases, executing the solution may be the easiest step.
Be persistent . If a plan does not work immediately, do not let students get discouraged. Encourage them to try a different strategy and keep trying.

Encourage students to reflect. Once a solution has been reached, students should ask themselves the following questions:

Does the answer make sense?
Does it fit with the criteria established in step 1?
Did I answer the question(s)?
What did I learn by doing this?
Could I have done the problem another way?

If you would like support applying these tips to your own teaching, CTE staff members are here to help. View the CTE Support page to find the most relevant staff member to contact.

Fissore, C., Marchisio, M., Roman, F., & Sacchet, M. (2021). Development of problem solving skills with Maple in higher education. In: Corless, R.M., Gerhard, J., Kotsireas, I.S. (eds) Maple in Mathematics Education and Research. MC 2020. Communications in Computer and Information Science, vol 1414. Springer, Cham. https://doi.org/10.1007/978-3-030-81698-8_15
Foshay, R., & Kirkley, J. (1998). Principles for Teaching Problem Solving. TRO Learning Inc., Edina MN. (PDF) Principles for Teaching Problem Solving (researchgate.net)
Hayes, J.R. (1989). The Complete Problem Solver. 2nd Edition. Hillsdale, NJ: Lawrence Erlbaum Associates.
Woods, D.R., Wright, J.D., Hoffman, T.W., Swartman, R.K., Doig, I.D. (1975). Teaching Problem solving Skills.
Engineering Education. Vol 1, No. 1. p. 238. Washington, DC: The American Society for Engineering Education.

Catalog search

Teaching tip categories.

Assessment and feedback
Blended Learning and Educational Technologies
Career Development
Course Design
Course Implementation
Inclusive Teaching and Learning
Learning activities
Support for Student Learning
Support for TAs
Learning activities ,

Teaching problem solving: Let students get ‘stuck’ and ‘unstuck’

Subscribe to the center for universal education bulletin, kate mills and km kate mills literacy interventionist - red bank primary school helyn kim helyn kim former brookings expert @helyn_kim.

October 31, 2017

This is the second in a six-part blog series on teaching 21st century skills , including problem solving , metacognition , critical thinking , and collaboration , in classrooms.

In the real world, students encounter problems that are complex, not well defined, and lack a clear solution and approach. They need to be able to identify and apply different strategies to solve these problems. However, problem solving skills do not necessarily develop naturally; they need to be explicitly taught in a way that can be transferred across multiple settings and contexts.

Here’s what Kate Mills, who taught 4 th grade for 10 years at Knollwood School in New Jersey and is now a Literacy Interventionist at Red Bank Primary School, has to say about creating a classroom culture of problem solvers:

Helping my students grow to be people who will be successful outside of the classroom is equally as important as teaching the curriculum. From the first day of school, I intentionally choose language and activities that help to create a classroom culture of problem solvers. I want to produce students who are able to think about achieving a particular goal and manage their mental processes . This is known as metacognition , and research shows that metacognitive skills help students become better problem solvers.

I begin by “normalizing trouble” in the classroom. Peter H. Johnston teaches the importance of normalizing struggle , of naming it, acknowledging it, and calling it what it is: a sign that we’re growing. The goal is for the students to accept challenge and failure as a chance to grow and do better.

I look for every chance to share problems and highlight how the students— not the teachers— worked through those problems. There is, of course, coaching along the way. For example, a science class that is arguing over whose turn it is to build a vehicle will most likely need a teacher to help them find a way to the balance the work in an equitable way. Afterwards, I make it a point to turn it back to the class and say, “Do you see how you …” By naming what it is they did to solve the problem , students can be more independent and productive as they apply and adapt their thinking when engaging in future complex tasks.

After a few weeks, most of the class understands that the teachers aren’t there to solve problems for the students, but to support them in solving the problems themselves. With that important part of our classroom culture established, we can move to focusing on the strategies that students might need.

Here’s one way I do this in the classroom:

I show the broken escalator video to the class. Since my students are fourth graders, they think it’s hilarious and immediately start exclaiming, “Just get off! Walk!”

When the video is over, I say, “Many of us, probably all of us, are like the man in the video yelling for help when we get stuck. When we get stuck, we stop and immediately say ‘Help!’ instead of embracing the challenge and trying new ways to work through it.” I often introduce this lesson during math class, but it can apply to any area of our lives, and I can refer to the experience and conversation we had during any part of our day.

Research shows that just because students know the strategies does not mean they will engage in the appropriate strategies. Therefore, I try to provide opportunities where students can explicitly practice learning how, when, and why to use which strategies effectively so that they can become self-directed learners.

For example, I give students a math problem that will make many of them feel “stuck”. I will say, “Your job is to get yourselves stuck—or to allow yourselves to get stuck on this problem—and then work through it, being mindful of how you’re getting yourselves unstuck.” As students work, I check-in to help them name their process: “How did you get yourself unstuck?” or “What was your first step? What are you doing now? What might you try next?” As students talk about their process, I’ll add to a list of strategies that students are using and, if they are struggling, help students name a specific process. For instance, if a student says he wrote the information from the math problem down and points to a chart, I will say: “Oh that’s interesting. You pulled the important information from the problem out and organized it into a chart.” In this way, I am giving him the language to match what he did, so that he now has a strategy he could use in other times of struggle.

The charts grow with us over time and are something that we refer to when students are stuck or struggling. They become a resource for students and a way for them to talk about their process when they are reflecting on and monitoring what did or did not work.

For me, as a teacher, it is important that I create a classroom environment in which students are problem solvers. This helps tie struggles to strategies so that the students will not only see value in working harder but in working smarter by trying new and different strategies and revising their process. In doing so, they will more successful the next time around.

Teaching problem solving

Strategies for teaching problem solving apply across disciplines and instructional contexts. First, introduce the problem and explain how people in your discipline generally make sense of the given information. Then, explain how to apply these approaches to solve the problem.

Introducing the problem

Explaining how people in your discipline understand and interpret these types of problems can help students develop the skills they need to understand the problem (and find a solution). After introducing how you would go about solving a problem, you could then ask students to:

frame the problem in their own words
define key terms and concepts
determine statements that accurately represent the givens of a problem
identify analogous problems
determine what information is needed to solve the problem

Working on solutions

In the solution phase, one develops and then implements a coherent plan for solving the problem. As you help students with this phase, you might ask them to:

identify the general model or procedure they have in mind for solving the problem
set sub-goals for solving the problem
identify necessary operations and steps
draw conclusions
carry out necessary operations

You can help students tackle a problem effectively by asking them to:

systematically explain each step and its rationale
explain how they would approach solving the problem
help you solve the problem by posing questions at key points in the process
work together in small groups (3 to 5 students) to solve the problem and then have the solution presented to the rest of the class (either by you or by a student in the group)

In all cases, the more you get the students to articulate their own understandings of the problem and potential solutions, the more you can help them develop their expertise in approaching problems in your discipline.

Problem-Based Learning (PBL)

What is Problem-Based Learning (PBL)? PBL is a student-centered approach to learning that involves groups of students working to solve a real-world problem, quite different from the direct teaching method of a teacher presenting facts and concepts about a specific subject to a classroom of students. Through PBL, students not only strengthen their teamwork, communication, and research skills, but they also sharpen their critical thinking and problem-solving abilities essential for life-long learning.

By working with PBL, students will:

Become engaged with open-ended situations that assimilate the world of work
Participate in groups to pinpoint what is known/ not known and the methods of finding information to help solve the given problem.
Investigate a problem; through critical thinking and problem solving, brainstorm a list of unique solutions.
Analyze the situation to see if the real problem is framed or if there are other problems that need to be solved.

How to Begin PBL

Establish the learning outcomes (i.e., what is it that you want your students to really learn and to be able to do after completing the learning project).
Find a real-world problem that is relevant to the students; often the problems are ones that students may encounter in their own life or future career.
Discuss pertinent rules for working in groups to maximize learning success.
Practice group processes: listening, involving others, assessing their work/peers.
Explore different roles for students to accomplish the work that needs to be done and/or to see the problem from various perspectives depending on the problem (e.g., for a problem about pollution, different roles may be a mayor, business owner, parent, child, neighboring city government officials, etc.).
Determine how the project will be evaluated and assessed. Most likely, both self-assessment and peer-assessment will factor into the assignment grade.

Designing Classroom Instruction

How to Orchestrate a PBL Activity

Explain Problem-Based Learning to students: its rationale, daily instruction, class expectations, grading.
Serve as a model and resource to the PBL process; work in-tandem through the first problem
Help students secure various resources when needed.
Supply ample class time for collaborative group work.
Give feedback to each group after they share via the established format; critique the solution in quality and thoroughness. Reinforce to the students that the prior thinking and reasoning process in addition to the solution are important as well.

Teacher’s Role in PBL

The Role of the Students

Definitions of The Addie Model

What is the ADDIE Model? This article attempts to explain the ADDIE model by providing different definitions. Basically, ADDIE is a conceptual framework. ADDIE is the most commonly used instructional design framework and…

Gamification, What It Is, How It Works, Examples

For many students, the traditional classroom setting can feel like an uninspiring environment. Long lectures, repetitive tasks, and a focus on exams often leave young minds disengaged, craving a more dynamic way to…

Educational Technology: An Overview

Educational technology is a field of study that investigates the process of analyzing, designing, developing, implementing, and evaluating the instructional environment and learning materials in order to improve teaching and learning. It is…

Erikson’s Stages of Psychosocial Development

In 1950, Erik Erikson released his book, Childhood and Society, which outlined his now prominent Theory of Psychosocial Development. His theory comprises of 8 stages that a healthy individual passes through in his…

Planning for Educational Technology Integration

Why seek out educational technology? We know that technology can enhance the teaching and learning process by providing unique opportunities. However, we also know that adoption of educational technology is a highly complex…

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

View all journals
My Account Login
Explore content
About the journal
Publish with us
Sign up for alerts
Review Article
Open access
Published: 11 January 2023

The effectiveness of collaborative problem solving in promoting students’ critical thinking: A meta-analysis based on empirical literature

Enwei Xu ORCID: orcid.org/0000-0001-6424-8169 1 ,
Wei Wang 1 &
Qingxia Wang 1

Humanities and Social Sciences Communications volume 10 , Article number: 16 ( 2023 ) Cite this article

15k Accesses

15 Citations

3 Altmetric

Metrics details

Science, technology and society

Collaborative problem-solving has been widely embraced in the classroom instruction of critical thinking, which is regarded as the core of curriculum reform based on key competencies in the field of education as well as a key competence for learners in the 21st century. However, the effectiveness of collaborative problem-solving in promoting students’ critical thinking remains uncertain. This current research presents the major findings of a meta-analysis of 36 pieces of the literature revealed in worldwide educational periodicals during the 21st century to identify the effectiveness of collaborative problem-solving in promoting students’ critical thinking and to determine, based on evidence, whether and to what extent collaborative problem solving can result in a rise or decrease in critical thinking. The findings show that (1) collaborative problem solving is an effective teaching approach to foster students’ critical thinking, with a significant overall effect size (ES = 0.82, z = 12.78, P < 0.01, 95% CI [0.69, 0.95]); (2) in respect to the dimensions of critical thinking, collaborative problem solving can significantly and successfully enhance students’ attitudinal tendencies (ES = 1.17, z = 7.62, P < 0.01, 95% CI[0.87, 1.47]); nevertheless, it falls short in terms of improving students’ cognitive skills, having only an upper-middle impact (ES = 0.70, z = 11.55, P < 0.01, 95% CI[0.58, 0.82]); and (3) the teaching type (chi 2 = 7.20, P < 0.05), intervention duration (chi 2 = 12.18, P < 0.01), subject area (chi 2 = 13.36, P < 0.05), group size (chi 2 = 8.77, P < 0.05), and learning scaffold (chi 2 = 9.03, P < 0.01) all have an impact on critical thinking, and they can be viewed as important moderating factors that affect how critical thinking develops. On the basis of these results, recommendations are made for further study and instruction to better support students’ critical thinking in the context of collaborative problem-solving.

Testing theory of mind in large language models and humans

Impact of artificial intelligence on human loss in decision making, laziness and safety in education

Interviews in the social sciences

Introduction.

Although critical thinking has a long history in research, the concept of critical thinking, which is regarded as an essential competence for learners in the 21st century, has recently attracted more attention from researchers and teaching practitioners (National Research Council, 2012 ). Critical thinking should be the core of curriculum reform based on key competencies in the field of education (Peng and Deng, 2017 ) because students with critical thinking can not only understand the meaning of knowledge but also effectively solve practical problems in real life even after knowledge is forgotten (Kek and Huijser, 2011 ). The definition of critical thinking is not universal (Ennis, 1989 ; Castle, 2009 ; Niu et al., 2013 ). In general, the definition of critical thinking is a self-aware and self-regulated thought process (Facione, 1990 ; Niu et al., 2013 ). It refers to the cognitive skills needed to interpret, analyze, synthesize, reason, and evaluate information as well as the attitudinal tendency to apply these abilities (Halpern, 2001 ). The view that critical thinking can be taught and learned through curriculum teaching has been widely supported by many researchers (e.g., Kuncel, 2011 ; Leng and Lu, 2020 ), leading to educators’ efforts to foster it among students. In the field of teaching practice, there are three types of courses for teaching critical thinking (Ennis, 1989 ). The first is an independent curriculum in which critical thinking is taught and cultivated without involving the knowledge of specific disciplines; the second is an integrated curriculum in which critical thinking is integrated into the teaching of other disciplines as a clear teaching goal; and the third is a mixed curriculum in which critical thinking is taught in parallel to the teaching of other disciplines for mixed teaching training. Furthermore, numerous measuring tools have been developed by researchers and educators to measure critical thinking in the context of teaching practice. These include standardized measurement tools, such as WGCTA, CCTST, CCTT, and CCTDI, which have been verified by repeated experiments and are considered effective and reliable by international scholars (Facione and Facione, 1992 ). In short, descriptions of critical thinking, including its two dimensions of attitudinal tendency and cognitive skills, different types of teaching courses, and standardized measurement tools provide a complex normative framework for understanding, teaching, and evaluating critical thinking.

Cultivating critical thinking in curriculum teaching can start with a problem, and one of the most popular critical thinking instructional approaches is problem-based learning (Liu et al., 2020 ). Duch et al. ( 2001 ) noted that problem-based learning in group collaboration is progressive active learning, which can improve students’ critical thinking and problem-solving skills. Collaborative problem-solving is the organic integration of collaborative learning and problem-based learning, which takes learners as the center of the learning process and uses problems with poor structure in real-world situations as the starting point for the learning process (Liang et al., 2017 ). Students learn the knowledge needed to solve problems in a collaborative group, reach a consensus on problems in the field, and form solutions through social cooperation methods, such as dialogue, interpretation, questioning, debate, negotiation, and reflection, thus promoting the development of learners’ domain knowledge and critical thinking (Cindy, 2004 ; Liang et al., 2017 ).

Collaborative problem-solving has been widely used in the teaching practice of critical thinking, and several studies have attempted to conduct a systematic review and meta-analysis of the empirical literature on critical thinking from various perspectives. However, little attention has been paid to the impact of collaborative problem-solving on critical thinking. Therefore, the best approach for developing and enhancing critical thinking throughout collaborative problem-solving is to examine how to implement critical thinking instruction; however, this issue is still unexplored, which means that many teachers are incapable of better instructing critical thinking (Leng and Lu, 2020 ; Niu et al., 2013 ). For example, Huber ( 2016 ) provided the meta-analysis findings of 71 publications on gaining critical thinking over various time frames in college with the aim of determining whether critical thinking was truly teachable. These authors found that learners significantly improve their critical thinking while in college and that critical thinking differs with factors such as teaching strategies, intervention duration, subject area, and teaching type. The usefulness of collaborative problem-solving in fostering students’ critical thinking, however, was not determined by this study, nor did it reveal whether there existed significant variations among the different elements. A meta-analysis of 31 pieces of educational literature was conducted by Liu et al. ( 2020 ) to assess the impact of problem-solving on college students’ critical thinking. These authors found that problem-solving could promote the development of critical thinking among college students and proposed establishing a reasonable group structure for problem-solving in a follow-up study to improve students’ critical thinking. Additionally, previous empirical studies have reached inconclusive and even contradictory conclusions about whether and to what extent collaborative problem-solving increases or decreases critical thinking levels. As an illustration, Yang et al. ( 2008 ) carried out an experiment on the integrated curriculum teaching of college students based on a web bulletin board with the goal of fostering participants’ critical thinking in the context of collaborative problem-solving. These authors’ research revealed that through sharing, debating, examining, and reflecting on various experiences and ideas, collaborative problem-solving can considerably enhance students’ critical thinking in real-life problem situations. In contrast, collaborative problem-solving had a positive impact on learners’ interaction and could improve learning interest and motivation but could not significantly improve students’ critical thinking when compared to traditional classroom teaching, according to research by Naber and Wyatt ( 2014 ) and Sendag and Odabasi ( 2009 ) on undergraduate and high school students, respectively.

The above studies show that there is inconsistency regarding the effectiveness of collaborative problem-solving in promoting students’ critical thinking. Therefore, it is essential to conduct a thorough and trustworthy review to detect and decide whether and to what degree collaborative problem-solving can result in a rise or decrease in critical thinking. Meta-analysis is a quantitative analysis approach that is utilized to examine quantitative data from various separate studies that are all focused on the same research topic. This approach characterizes the effectiveness of its impact by averaging the effect sizes of numerous qualitative studies in an effort to reduce the uncertainty brought on by independent research and produce more conclusive findings (Lipsey and Wilson, 2001 ).

This paper used a meta-analytic approach and carried out a meta-analysis to examine the effectiveness of collaborative problem-solving in promoting students’ critical thinking in order to make a contribution to both research and practice. The following research questions were addressed by this meta-analysis:

What is the overall effect size of collaborative problem-solving in promoting students’ critical thinking and its impact on the two dimensions of critical thinking (i.e., attitudinal tendency and cognitive skills)?

How are the disparities between the study conclusions impacted by various moderating variables if the impacts of various experimental designs in the included studies are heterogeneous?

This research followed the strict procedures (e.g., database searching, identification, screening, eligibility, merging, duplicate removal, and analysis of included studies) of Cooper’s ( 2010 ) proposed meta-analysis approach for examining quantitative data from various separate studies that are all focused on the same research topic. The relevant empirical research that appeared in worldwide educational periodicals within the 21st century was subjected to this meta-analysis using Rev-Man 5.4. The consistency of the data extracted separately by two researchers was tested using Cohen’s kappa coefficient, and a publication bias test and a heterogeneity test were run on the sample data to ascertain the quality of this meta-analysis.

Data sources and search strategies

There were three stages to the data collection process for this meta-analysis, as shown in Fig. 1 , which shows the number of articles included and eliminated during the selection process based on the statement and study eligibility criteria.

This flowchart shows the number of records identified, included and excluded in the article.

First, the databases used to systematically search for relevant articles were the journal papers of the Web of Science Core Collection and the Chinese Core source journal, as well as the Chinese Social Science Citation Index (CSSCI) source journal papers included in CNKI. These databases were selected because they are credible platforms that are sources of scholarly and peer-reviewed information with advanced search tools and contain literature relevant to the subject of our topic from reliable researchers and experts. The search string with the Boolean operator used in the Web of Science was “TS = (((“critical thinking” or “ct” and “pretest” or “posttest”) or (“critical thinking” or “ct” and “control group” or “quasi experiment” or “experiment”)) and (“collaboration” or “collaborative learning” or “CSCL”) and (“problem solving” or “problem-based learning” or “PBL”))”. The research area was “Education Educational Research”, and the search period was “January 1, 2000, to December 30, 2021”. A total of 412 papers were obtained. The search string with the Boolean operator used in the CNKI was “SU = (‘critical thinking’*‘collaboration’ + ‘critical thinking’*‘collaborative learning’ + ‘critical thinking’*‘CSCL’ + ‘critical thinking’*‘problem solving’ + ‘critical thinking’*‘problem-based learning’ + ‘critical thinking’*‘PBL’ + ‘critical thinking’*‘problem oriented’) AND FT = (‘experiment’ + ‘quasi experiment’ + ‘pretest’ + ‘posttest’ + ‘empirical study’)” (translated into Chinese when searching). A total of 56 studies were found throughout the search period of “January 2000 to December 2021”. From the databases, all duplicates and retractions were eliminated before exporting the references into Endnote, a program for managing bibliographic references. In all, 466 studies were found.

Second, the studies that matched the inclusion and exclusion criteria for the meta-analysis were chosen by two researchers after they had reviewed the abstracts and titles of the gathered articles, yielding a total of 126 studies.

Third, two researchers thoroughly reviewed each included article’s whole text in accordance with the inclusion and exclusion criteria. Meanwhile, a snowball search was performed using the references and citations of the included articles to ensure complete coverage of the articles. Ultimately, 36 articles were kept.

Two researchers worked together to carry out this entire process, and a consensus rate of almost 94.7% was reached after discussion and negotiation to clarify any emerging differences.

Eligibility criteria

Since not all the retrieved studies matched the criteria for this meta-analysis, eligibility criteria for both inclusion and exclusion were developed as follows:

The publication language of the included studies was limited to English and Chinese, and the full text could be obtained. Articles that did not meet the publication language and articles not published between 2000 and 2021 were excluded.

The research design of the included studies must be empirical and quantitative studies that can assess the effect of collaborative problem-solving on the development of critical thinking. Articles that could not identify the causal mechanisms by which collaborative problem-solving affects critical thinking, such as review articles and theoretical articles, were excluded.

The research method of the included studies must feature a randomized control experiment or a quasi-experiment, or a natural experiment, which have a higher degree of internal validity with strong experimental designs and can all plausibly provide evidence that critical thinking and collaborative problem-solving are causally related. Articles with non-experimental research methods, such as purely correlational or observational studies, were excluded.

The participants of the included studies were only students in school, including K-12 students and college students. Articles in which the participants were non-school students, such as social workers or adult learners, were excluded.

The research results of the included studies must mention definite signs that may be utilized to gauge critical thinking’s impact (e.g., sample size, mean value, or standard deviation). Articles that lacked specific measurement indicators for critical thinking and could not calculate the effect size were excluded.

Data coding design

In order to perform a meta-analysis, it is necessary to collect the most important information from the articles, codify that information’s properties, and convert descriptive data into quantitative data. Therefore, this study designed a data coding template (see Table 1 ). Ultimately, 16 coding fields were retained.

The designed data-coding template consisted of three pieces of information. Basic information about the papers was included in the descriptive information: the publishing year, author, serial number, and title of the paper.

The variable information for the experimental design had three variables: the independent variable (instruction method), the dependent variable (critical thinking), and the moderating variable (learning stage, teaching type, intervention duration, learning scaffold, group size, measuring tool, and subject area). Depending on the topic of this study, the intervention strategy, as the independent variable, was coded into collaborative and non-collaborative problem-solving. The dependent variable, critical thinking, was coded as a cognitive skill and an attitudinal tendency. And seven moderating variables were created by grouping and combining the experimental design variables discovered within the 36 studies (see Table 1 ), where learning stages were encoded as higher education, high school, middle school, and primary school or lower; teaching types were encoded as mixed courses, integrated courses, and independent courses; intervention durations were encoded as 0–1 weeks, 1–4 weeks, 4–12 weeks, and more than 12 weeks; group sizes were encoded as 2–3 persons, 4–6 persons, 7–10 persons, and more than 10 persons; learning scaffolds were encoded as teacher-supported learning scaffold, technique-supported learning scaffold, and resource-supported learning scaffold; measuring tools were encoded as standardized measurement tools (e.g., WGCTA, CCTT, CCTST, and CCTDI) and self-adapting measurement tools (e.g., modified or made by researchers); and subject areas were encoded according to the specific subjects used in the 36 included studies.

The data information contained three metrics for measuring critical thinking: sample size, average value, and standard deviation. It is vital to remember that studies with various experimental designs frequently adopt various formulas to determine the effect size. And this paper used Morris’ proposed standardized mean difference (SMD) calculation formula ( 2008 , p. 369; see Supplementary Table S3 ).

Procedure for extracting and coding data

According to the data coding template (see Table 1 ), the 36 papers’ information was retrieved by two researchers, who then entered them into Excel (see Supplementary Table S1 ). The results of each study were extracted separately in the data extraction procedure if an article contained numerous studies on critical thinking, or if a study assessed different critical thinking dimensions. For instance, Tiwari et al. ( 2010 ) used four time points, which were viewed as numerous different studies, to examine the outcomes of critical thinking, and Chen ( 2013 ) included the two outcome variables of attitudinal tendency and cognitive skills, which were regarded as two studies. After discussion and negotiation during data extraction, the two researchers’ consistency test coefficients were roughly 93.27%. Supplementary Table S2 details the key characteristics of the 36 included articles with 79 effect quantities, including descriptive information (e.g., the publishing year, author, serial number, and title of the paper), variable information (e.g., independent variables, dependent variables, and moderating variables), and data information (e.g., mean values, standard deviations, and sample size). Following that, testing for publication bias and heterogeneity was done on the sample data using the Rev-Man 5.4 software, and then the test results were used to conduct a meta-analysis.

Publication bias test

When the sample of studies included in a meta-analysis does not accurately reflect the general status of research on the relevant subject, publication bias is said to be exhibited in this research. The reliability and accuracy of the meta-analysis may be impacted by publication bias. Due to this, the meta-analysis needs to check the sample data for publication bias (Stewart et al., 2006 ). A popular method to check for publication bias is the funnel plot; and it is unlikely that there will be publishing bias when the data are equally dispersed on either side of the average effect size and targeted within the higher region. The data are equally dispersed within the higher portion of the efficient zone, consistent with the funnel plot connected with this analysis (see Fig. 2 ), indicating that publication bias is unlikely in this situation.

This funnel plot shows the result of publication bias of 79 effect quantities across 36 studies.

Heterogeneity test

To select the appropriate effect models for the meta-analysis, one might use the results of a heterogeneity test on the data effect sizes. In a meta-analysis, it is common practice to gauge the degree of data heterogeneity using the I 2 value, and I 2 ≥ 50% is typically understood to denote medium-high heterogeneity, which calls for the adoption of a random effect model; if not, a fixed effect model ought to be applied (Lipsey and Wilson, 2001 ). The findings of the heterogeneity test in this paper (see Table 2 ) revealed that I 2 was 86% and displayed significant heterogeneity ( P < 0.01). To ensure accuracy and reliability, the overall effect size ought to be calculated utilizing the random effect model.

The analysis of the overall effect size

This meta-analysis utilized a random effect model to examine 79 effect quantities from 36 studies after eliminating heterogeneity. In accordance with Cohen’s criterion (Cohen, 1992 ), it is abundantly clear from the analysis results, which are shown in the forest plot of the overall effect (see Fig. 3 ), that the cumulative impact size of cooperative problem-solving is 0.82, which is statistically significant ( z = 12.78, P < 0.01, 95% CI [0.69, 0.95]), and can encourage learners to practice critical thinking.

This forest plot shows the analysis result of the overall effect size across 36 studies.

In addition, this study examined two distinct dimensions of critical thinking to better understand the precise contributions that collaborative problem-solving makes to the growth of critical thinking. The findings (see Table 3 ) indicate that collaborative problem-solving improves cognitive skills (ES = 0.70) and attitudinal tendency (ES = 1.17), with significant intergroup differences (chi 2 = 7.95, P < 0.01). Although collaborative problem-solving improves both dimensions of critical thinking, it is essential to point out that the improvements in students’ attitudinal tendency are much more pronounced and have a significant comprehensive effect (ES = 1.17, z = 7.62, P < 0.01, 95% CI [0.87, 1.47]), whereas gains in learners’ cognitive skill are slightly improved and are just above average. (ES = 0.70, z = 11.55, P < 0.01, 95% CI [0.58, 0.82]).

The analysis of moderator effect size

The whole forest plot’s 79 effect quantities underwent a two-tailed test, which revealed significant heterogeneity ( I 2 = 86%, z = 12.78, P < 0.01), indicating differences between various effect sizes that may have been influenced by moderating factors other than sampling error. Therefore, exploring possible moderating factors that might produce considerable heterogeneity was done using subgroup analysis, such as the learning stage, learning scaffold, teaching type, group size, duration of the intervention, measuring tool, and the subject area included in the 36 experimental designs, in order to further explore the key factors that influence critical thinking. The findings (see Table 4 ) indicate that various moderating factors have advantageous effects on critical thinking. In this situation, the subject area (chi 2 = 13.36, P < 0.05), group size (chi 2 = 8.77, P < 0.05), intervention duration (chi 2 = 12.18, P < 0.01), learning scaffold (chi 2 = 9.03, P < 0.01), and teaching type (chi 2 = 7.20, P < 0.05) are all significant moderators that can be applied to support the cultivation of critical thinking. However, since the learning stage and the measuring tools did not significantly differ among intergroup (chi 2 = 3.15, P = 0.21 > 0.05, and chi 2 = 0.08, P = 0.78 > 0.05), we are unable to explain why these two factors are crucial in supporting the cultivation of critical thinking in the context of collaborative problem-solving. These are the precise outcomes, as follows:

Various learning stages influenced critical thinking positively, without significant intergroup differences (chi 2 = 3.15, P = 0.21 > 0.05). High school was first on the list of effect sizes (ES = 1.36, P < 0.01), then higher education (ES = 0.78, P < 0.01), and middle school (ES = 0.73, P < 0.01). These results show that, despite the learning stage’s beneficial influence on cultivating learners’ critical thinking, we are unable to explain why it is essential for cultivating critical thinking in the context of collaborative problem-solving.

Different teaching types had varying degrees of positive impact on critical thinking, with significant intergroup differences (chi 2 = 7.20, P < 0.05). The effect size was ranked as follows: mixed courses (ES = 1.34, P < 0.01), integrated courses (ES = 0.81, P < 0.01), and independent courses (ES = 0.27, P < 0.01). These results indicate that the most effective approach to cultivate critical thinking utilizing collaborative problem solving is through the teaching type of mixed courses.

Various intervention durations significantly improved critical thinking, and there were significant intergroup differences (chi 2 = 12.18, P < 0.01). The effect sizes related to this variable showed a tendency to increase with longer intervention durations. The improvement in critical thinking reached a significant level (ES = 0.85, P < 0.01) after more than 12 weeks of training. These findings indicate that the intervention duration and critical thinking’s impact are positively correlated, with a longer intervention duration having a greater effect.

Different learning scaffolds influenced critical thinking positively, with significant intergroup differences (chi 2 = 9.03, P < 0.01). The resource-supported learning scaffold (ES = 0.69, P < 0.01) acquired a medium-to-higher level of impact, the technique-supported learning scaffold (ES = 0.63, P < 0.01) also attained a medium-to-higher level of impact, and the teacher-supported learning scaffold (ES = 0.92, P < 0.01) displayed a high level of significant impact. These results show that the learning scaffold with teacher support has the greatest impact on cultivating critical thinking.

Various group sizes influenced critical thinking positively, and the intergroup differences were statistically significant (chi 2 = 8.77, P < 0.05). Critical thinking showed a general declining trend with increasing group size. The overall effect size of 2–3 people in this situation was the biggest (ES = 0.99, P < 0.01), and when the group size was greater than 7 people, the improvement in critical thinking was at the lower-middle level (ES < 0.5, P < 0.01). These results show that the impact on critical thinking is positively connected with group size, and as group size grows, so does the overall impact.

Various measuring tools influenced critical thinking positively, with significant intergroup differences (chi 2 = 0.08, P = 0.78 > 0.05). In this situation, the self-adapting measurement tools obtained an upper-medium level of effect (ES = 0.78), whereas the complete effect size of the standardized measurement tools was the largest, achieving a significant level of effect (ES = 0.84, P < 0.01). These results show that, despite the beneficial influence of the measuring tool on cultivating critical thinking, we are unable to explain why it is crucial in fostering the growth of critical thinking by utilizing the approach of collaborative problem-solving.

Different subject areas had a greater impact on critical thinking, and the intergroup differences were statistically significant (chi 2 = 13.36, P < 0.05). Mathematics had the greatest overall impact, achieving a significant level of effect (ES = 1.68, P < 0.01), followed by science (ES = 1.25, P < 0.01) and medical science (ES = 0.87, P < 0.01), both of which also achieved a significant level of effect. Programming technology was the least effective (ES = 0.39, P < 0.01), only having a medium-low degree of effect compared to education (ES = 0.72, P < 0.01) and other fields (such as language, art, and social sciences) (ES = 0.58, P < 0.01). These results suggest that scientific fields (e.g., mathematics, science) may be the most effective subject areas for cultivating critical thinking utilizing the approach of collaborative problem-solving.

The effectiveness of collaborative problem solving with regard to teaching critical thinking

According to this meta-analysis, using collaborative problem-solving as an intervention strategy in critical thinking teaching has a considerable amount of impact on cultivating learners’ critical thinking as a whole and has a favorable promotional effect on the two dimensions of critical thinking. According to certain studies, collaborative problem solving, the most frequently used critical thinking teaching strategy in curriculum instruction can considerably enhance students’ critical thinking (e.g., Liang et al., 2017 ; Liu et al., 2020 ; Cindy, 2004 ). This meta-analysis provides convergent data support for the above research views. Thus, the findings of this meta-analysis not only effectively address the first research query regarding the overall effect of cultivating critical thinking and its impact on the two dimensions of critical thinking (i.e., attitudinal tendency and cognitive skills) utilizing the approach of collaborative problem-solving, but also enhance our confidence in cultivating critical thinking by using collaborative problem-solving intervention approach in the context of classroom teaching.

Furthermore, the associated improvements in attitudinal tendency are much stronger, but the corresponding improvements in cognitive skill are only marginally better. According to certain studies, cognitive skill differs from the attitudinal tendency in classroom instruction; the cultivation and development of the former as a key ability is a process of gradual accumulation, while the latter as an attitude is affected by the context of the teaching situation (e.g., a novel and exciting teaching approach, challenging and rewarding tasks) (Halpern, 2001 ; Wei and Hong, 2022 ). Collaborative problem-solving as a teaching approach is exciting and interesting, as well as rewarding and challenging; because it takes the learners as the focus and examines problems with poor structure in real situations, and it can inspire students to fully realize their potential for problem-solving, which will significantly improve their attitudinal tendency toward solving problems (Liu et al., 2020 ). Similar to how collaborative problem-solving influences attitudinal tendency, attitudinal tendency impacts cognitive skill when attempting to solve a problem (Liu et al., 2020 ; Zhang et al., 2022 ), and stronger attitudinal tendencies are associated with improved learning achievement and cognitive ability in students (Sison, 2008 ; Zhang et al., 2022 ). It can be seen that the two specific dimensions of critical thinking as well as critical thinking as a whole are affected by collaborative problem-solving, and this study illuminates the nuanced links between cognitive skills and attitudinal tendencies with regard to these two dimensions of critical thinking. To fully develop students’ capacity for critical thinking, future empirical research should pay closer attention to cognitive skills.

The moderating effects of collaborative problem solving with regard to teaching critical thinking

In order to further explore the key factors that influence critical thinking, exploring possible moderating effects that might produce considerable heterogeneity was done using subgroup analysis. The findings show that the moderating factors, such as the teaching type, learning stage, group size, learning scaffold, duration of the intervention, measuring tool, and the subject area included in the 36 experimental designs, could all support the cultivation of collaborative problem-solving in critical thinking. Among them, the effect size differences between the learning stage and measuring tool are not significant, which does not explain why these two factors are crucial in supporting the cultivation of critical thinking utilizing the approach of collaborative problem-solving.

In terms of the learning stage, various learning stages influenced critical thinking positively without significant intergroup differences, indicating that we are unable to explain why it is crucial in fostering the growth of critical thinking.

Although high education accounts for 70.89% of all empirical studies performed by researchers, high school may be the appropriate learning stage to foster students’ critical thinking by utilizing the approach of collaborative problem-solving since it has the largest overall effect size. This phenomenon may be related to student’s cognitive development, which needs to be further studied in follow-up research.

With regard to teaching type, mixed course teaching may be the best teaching method to cultivate students’ critical thinking. Relevant studies have shown that in the actual teaching process if students are trained in thinking methods alone, the methods they learn are isolated and divorced from subject knowledge, which is not conducive to their transfer of thinking methods; therefore, if students’ thinking is trained only in subject teaching without systematic method training, it is challenging to apply to real-world circumstances (Ruggiero, 2012 ; Hu and Liu, 2015 ). Teaching critical thinking as mixed course teaching in parallel to other subject teachings can achieve the best effect on learners’ critical thinking, and explicit critical thinking instruction is more effective than less explicit critical thinking instruction (Bensley and Spero, 2014 ).

In terms of the intervention duration, with longer intervention times, the overall effect size shows an upward tendency. Thus, the intervention duration and critical thinking’s impact are positively correlated. Critical thinking, as a key competency for students in the 21st century, is difficult to get a meaningful improvement in a brief intervention duration. Instead, it could be developed over a lengthy period of time through consistent teaching and the progressive accumulation of knowledge (Halpern, 2001 ; Hu and Liu, 2015 ). Therefore, future empirical studies ought to take these restrictions into account throughout a longer period of critical thinking instruction.

With regard to group size, a group size of 2–3 persons has the highest effect size, and the comprehensive effect size decreases with increasing group size in general. This outcome is in line with some research findings; as an example, a group composed of two to four members is most appropriate for collaborative learning (Schellens and Valcke, 2006 ). However, the meta-analysis results also indicate that once the group size exceeds 7 people, small groups cannot produce better interaction and performance than large groups. This may be because the learning scaffolds of technique support, resource support, and teacher support improve the frequency and effectiveness of interaction among group members, and a collaborative group with more members may increase the diversity of views, which is helpful to cultivate critical thinking utilizing the approach of collaborative problem-solving.

With regard to the learning scaffold, the three different kinds of learning scaffolds can all enhance critical thinking. Among them, the teacher-supported learning scaffold has the largest overall effect size, demonstrating the interdependence of effective learning scaffolds and collaborative problem-solving. This outcome is in line with some research findings; as an example, a successful strategy is to encourage learners to collaborate, come up with solutions, and develop critical thinking skills by using learning scaffolds (Reiser, 2004 ; Xu et al., 2022 ); learning scaffolds can lower task complexity and unpleasant feelings while also enticing students to engage in learning activities (Wood et al., 2006 ); learning scaffolds are designed to assist students in using learning approaches more successfully to adapt the collaborative problem-solving process, and the teacher-supported learning scaffolds have the greatest influence on critical thinking in this process because they are more targeted, informative, and timely (Xu et al., 2022 ).

With respect to the measuring tool, despite the fact that standardized measurement tools (such as the WGCTA, CCTT, and CCTST) have been acknowledged as trustworthy and effective by worldwide experts, only 54.43% of the research included in this meta-analysis adopted them for assessment, and the results indicated no intergroup differences. These results suggest that not all teaching circumstances are appropriate for measuring critical thinking using standardized measurement tools. “The measuring tools for measuring thinking ability have limits in assessing learners in educational situations and should be adapted appropriately to accurately assess the changes in learners’ critical thinking.”, according to Simpson and Courtney ( 2002 , p. 91). As a result, in order to more fully and precisely gauge how learners’ critical thinking has evolved, we must properly modify standardized measuring tools based on collaborative problem-solving learning contexts.

With regard to the subject area, the comprehensive effect size of science departments (e.g., mathematics, science, medical science) is larger than that of language arts and social sciences. Some recent international education reforms have noted that critical thinking is a basic part of scientific literacy. Students with scientific literacy can prove the rationality of their judgment according to accurate evidence and reasonable standards when they face challenges or poorly structured problems (Kyndt et al., 2013 ), which makes critical thinking crucial for developing scientific understanding and applying this understanding to practical problem solving for problems related to science, technology, and society (Yore et al., 2007 ).

Suggestions for critical thinking teaching

Other than those stated in the discussion above, the following suggestions are offered for critical thinking instruction utilizing the approach of collaborative problem-solving.

First, teachers should put a special emphasis on the two core elements, which are collaboration and problem-solving, to design real problems based on collaborative situations. This meta-analysis provides evidence to support the view that collaborative problem-solving has a strong synergistic effect on promoting students’ critical thinking. Asking questions about real situations and allowing learners to take part in critical discussions on real problems during class instruction are key ways to teach critical thinking rather than simply reading speculative articles without practice (Mulnix, 2012 ). Furthermore, the improvement of students’ critical thinking is realized through cognitive conflict with other learners in the problem situation (Yang et al., 2008 ). Consequently, it is essential for teachers to put a special emphasis on the two core elements, which are collaboration and problem-solving, and design real problems and encourage students to discuss, negotiate, and argue based on collaborative problem-solving situations.

Second, teachers should design and implement mixed courses to cultivate learners’ critical thinking, utilizing the approach of collaborative problem-solving. Critical thinking can be taught through curriculum instruction (Kuncel, 2011 ; Leng and Lu, 2020 ), with the goal of cultivating learners’ critical thinking for flexible transfer and application in real problem-solving situations. This meta-analysis shows that mixed course teaching has a highly substantial impact on the cultivation and promotion of learners’ critical thinking. Therefore, teachers should design and implement mixed course teaching with real collaborative problem-solving situations in combination with the knowledge content of specific disciplines in conventional teaching, teach methods and strategies of critical thinking based on poorly structured problems to help students master critical thinking, and provide practical activities in which students can interact with each other to develop knowledge construction and critical thinking utilizing the approach of collaborative problem-solving.

Third, teachers should be more trained in critical thinking, particularly preservice teachers, and they also should be conscious of the ways in which teachers’ support for learning scaffolds can promote critical thinking. The learning scaffold supported by teachers had the greatest impact on learners’ critical thinking, in addition to being more directive, targeted, and timely (Wood et al., 2006 ). Critical thinking can only be effectively taught when teachers recognize the significance of critical thinking for students’ growth and use the proper approaches while designing instructional activities (Forawi, 2016 ). Therefore, with the intention of enabling teachers to create learning scaffolds to cultivate learners’ critical thinking utilizing the approach of collaborative problem solving, it is essential to concentrate on the teacher-supported learning scaffolds and enhance the instruction for teaching critical thinking to teachers, especially preservice teachers.

Implications and limitations

There are certain limitations in this meta-analysis, but future research can correct them. First, the search languages were restricted to English and Chinese, so it is possible that pertinent studies that were written in other languages were overlooked, resulting in an inadequate number of articles for review. Second, these data provided by the included studies are partially missing, such as whether teachers were trained in the theory and practice of critical thinking, the average age and gender of learners, and the differences in critical thinking among learners of various ages and genders. Third, as is typical for review articles, more studies were released while this meta-analysis was being done; therefore, it had a time limit. With the development of relevant research, future studies focusing on these issues are highly relevant and needed.

Conclusions

The subject of the magnitude of collaborative problem-solving’s impact on fostering students’ critical thinking, which received scant attention from other studies, was successfully addressed by this study. The question of the effectiveness of collaborative problem-solving in promoting students’ critical thinking was addressed in this study, which addressed a topic that had gotten little attention in earlier research. The following conclusions can be made:

Regarding the results obtained, collaborative problem solving is an effective teaching approach to foster learners’ critical thinking, with a significant overall effect size (ES = 0.82, z = 12.78, P < 0.01, 95% CI [0.69, 0.95]). With respect to the dimensions of critical thinking, collaborative problem-solving can significantly and effectively improve students’ attitudinal tendency, and the comprehensive effect is significant (ES = 1.17, z = 7.62, P < 0.01, 95% CI [0.87, 1.47]); nevertheless, it falls short in terms of improving students’ cognitive skills, having only an upper-middle impact (ES = 0.70, z = 11.55, P < 0.01, 95% CI [0.58, 0.82]).

As demonstrated by both the results and the discussion, there are varying degrees of beneficial effects on students’ critical thinking from all seven moderating factors, which were found across 36 studies. In this context, the teaching type (chi 2 = 7.20, P < 0.05), intervention duration (chi 2 = 12.18, P < 0.01), subject area (chi 2 = 13.36, P < 0.05), group size (chi 2 = 8.77, P < 0.05), and learning scaffold (chi 2 = 9.03, P < 0.01) all have a positive impact on critical thinking, and they can be viewed as important moderating factors that affect how critical thinking develops. Since the learning stage (chi 2 = 3.15, P = 0.21 > 0.05) and measuring tools (chi 2 = 0.08, P = 0.78 > 0.05) did not demonstrate any significant intergroup differences, we are unable to explain why these two factors are crucial in supporting the cultivation of critical thinking in the context of collaborative problem-solving.

Data availability

All data generated or analyzed during this study are included within the article and its supplementary information files, and the supplementary information files are available in the Dataverse repository: https://doi.org/10.7910/DVN/IPFJO6 .

Bensley DA, Spero RA (2014) Improving critical thinking skills and meta-cognitive monitoring through direct infusion. Think Skills Creat 12:55–68. https://doi.org/10.1016/j.tsc.2014.02.001

Article Google Scholar

Castle A (2009) Defining and assessing critical thinking skills for student radiographers. Radiography 15(1):70–76. https://doi.org/10.1016/j.radi.2007.10.007

Chen XD (2013) An empirical study on the influence of PBL teaching model on critical thinking ability of non-English majors. J PLA Foreign Lang College 36 (04):68–72

Google Scholar

Cohen A (1992) Antecedents of organizational commitment across occupational groups: a meta-analysis. J Organ Behav. https://doi.org/10.1002/job.4030130602

Cooper H (2010) Research synthesis and meta-analysis: a step-by-step approach, 4th edn. Sage, London, England

Cindy HS (2004) Problem-based learning: what and how do students learn? Educ Psychol Rev 51(1):31–39

Duch BJ, Gron SD, Allen DE (2001) The power of problem-based learning: a practical “how to” for teaching undergraduate courses in any discipline. Stylus Educ Sci 2:190–198

Ennis RH (1989) Critical thinking and subject specificity: clarification and needed research. Educ Res 18(3):4–10. https://doi.org/10.3102/0013189x018003004

Facione PA (1990) Critical thinking: a statement of expert consensus for purposes of educational assessment and instruction. Research findings and recommendations. Eric document reproduction service. https://eric.ed.gov/?id=ed315423

Facione PA, Facione NC (1992) The California Critical Thinking Dispositions Inventory (CCTDI) and the CCTDI test manual. California Academic Press, Millbrae, CA

Forawi SA (2016) Standard-based science education and critical thinking. Think Skills Creat 20:52–62. https://doi.org/10.1016/j.tsc.2016.02.005

Halpern DF (2001) Assessing the effectiveness of critical thinking instruction. J Gen Educ 50(4):270–286. https://doi.org/10.2307/27797889

Hu WP, Liu J (2015) Cultivation of pupils’ thinking ability: a five-year follow-up study. Psychol Behav Res 13(05):648–654. https://doi.org/10.3969/j.issn.1672-0628.2015.05.010

Huber K (2016) Does college teach critical thinking? A meta-analysis. Rev Educ Res 86(2):431–468. https://doi.org/10.3102/0034654315605917

Kek MYCA, Huijser H (2011) The power of problem-based learning in developing critical thinking skills: preparing students for tomorrow’s digital futures in today’s classrooms. High Educ Res Dev 30(3):329–341. https://doi.org/10.1080/07294360.2010.501074

Kuncel NR (2011) Measurement and meaning of critical thinking (Research report for the NRC 21st Century Skills Workshop). National Research Council, Washington, DC

Kyndt E, Raes E, Lismont B, Timmers F, Cascallar E, Dochy F (2013) A meta-analysis of the effects of face-to-face cooperative learning. Do recent studies falsify or verify earlier findings? Educ Res Rev 10(2):133–149. https://doi.org/10.1016/j.edurev.2013.02.002

Leng J, Lu XX (2020) Is critical thinking really teachable?—A meta-analysis based on 79 experimental or quasi experimental studies. Open Educ Res 26(06):110–118. https://doi.org/10.13966/j.cnki.kfjyyj.2020.06.011

Liang YZ, Zhu K, Zhao CL (2017) An empirical study on the depth of interaction promoted by collaborative problem solving learning activities. J E-educ Res 38(10):87–92. https://doi.org/10.13811/j.cnki.eer.2017.10.014

Lipsey M, Wilson D (2001) Practical meta-analysis. International Educational and Professional, London, pp. 92–160

Liu Z, Wu W, Jiang Q (2020) A study on the influence of problem based learning on college students’ critical thinking-based on a meta-analysis of 31 studies. Explor High Educ 03:43–49

Morris SB (2008) Estimating effect sizes from pretest-posttest-control group designs. Organ Res Methods 11(2):364–386. https://doi.org/10.1177/1094428106291059

Article ADS Google Scholar

Mulnix JW (2012) Thinking critically about critical thinking. Educ Philos Theory 44(5):464–479. https://doi.org/10.1111/j.1469-5812.2010.00673.x

Naber J, Wyatt TH (2014) The effect of reflective writing interventions on the critical thinking skills and dispositions of baccalaureate nursing students. Nurse Educ Today 34(1):67–72. https://doi.org/10.1016/j.nedt.2013.04.002

National Research Council (2012) Education for life and work: developing transferable knowledge and skills in the 21st century. The National Academies Press, Washington, DC

Niu L, Behar HLS, Garvan CW (2013) Do instructional interventions influence college students’ critical thinking skills? A meta-analysis. Educ Res Rev 9(12):114–128. https://doi.org/10.1016/j.edurev.2012.12.002

Peng ZM, Deng L (2017) Towards the core of education reform: cultivating critical thinking skills as the core of skills in the 21st century. Res Educ Dev 24:57–63. https://doi.org/10.14121/j.cnki.1008-3855.2017.24.011

Reiser BJ (2004) Scaffolding complex learning: the mechanisms of structuring and problematizing student work. J Learn Sci 13(3):273–304. https://doi.org/10.1207/s15327809jls1303_2

Ruggiero VR (2012) The art of thinking: a guide to critical and creative thought, 4th edn. Harper Collins College Publishers, New York

Schellens T, Valcke M (2006) Fostering knowledge construction in university students through asynchronous discussion groups. Comput Educ 46(4):349–370. https://doi.org/10.1016/j.compedu.2004.07.010

Sendag S, Odabasi HF (2009) Effects of an online problem based learning course on content knowledge acquisition and critical thinking skills. Comput Educ 53(1):132–141. https://doi.org/10.1016/j.compedu.2009.01.008

Sison R (2008) Investigating Pair Programming in a Software Engineering Course in an Asian Setting. 2008 15th Asia-Pacific Software Engineering Conference, pp. 325–331. https://doi.org/10.1109/APSEC.2008.61

Simpson E, Courtney M (2002) Critical thinking in nursing education: literature review. Mary Courtney 8(2):89–98

Stewart L, Tierney J, Burdett S (2006) Do systematic reviews based on individual patient data offer a means of circumventing biases associated with trial publications? Publication bias in meta-analysis. John Wiley and Sons Inc, New York, pp. 261–286

Tiwari A, Lai P, So M, Yuen K (2010) A comparison of the effects of problem-based learning and lecturing on the development of students’ critical thinking. Med Educ 40(6):547–554. https://doi.org/10.1111/j.1365-2929.2006.02481.x

Wood D, Bruner JS, Ross G (2006) The role of tutoring in problem solving. J Child Psychol Psychiatry 17(2):89–100. https://doi.org/10.1111/j.1469-7610.1976.tb00381.x

Wei T, Hong S (2022) The meaning and realization of teachable critical thinking. Educ Theory Practice 10:51–57

Xu EW, Wang W, Wang QX (2022) A meta-analysis of the effectiveness of programming teaching in promoting K-12 students’ computational thinking. Educ Inf Technol. https://doi.org/10.1007/s10639-022-11445-2

Yang YC, Newby T, Bill R (2008) Facilitating interactions through structured web-based bulletin boards: a quasi-experimental study on promoting learners’ critical thinking skills. Comput Educ 50(4):1572–1585. https://doi.org/10.1016/j.compedu.2007.04.006

Yore LD, Pimm D, Tuan HL (2007) The literacy component of mathematical and scientific literacy. Int J Sci Math Educ 5(4):559–589. https://doi.org/10.1007/s10763-007-9089-4

Zhang T, Zhang S, Gao QQ, Wang JH (2022) Research on the development of learners’ critical thinking in online peer review. Audio Visual Educ Res 6:53–60. https://doi.org/10.13811/j.cnki.eer.2022.06.08

Download references

Acknowledgements

This research was supported by the graduate scientific research and innovation project of Xinjiang Uygur Autonomous Region named “Research on in-depth learning of high school information technology courses for the cultivation of computing thinking” (No. XJ2022G190) and the independent innovation fund project for doctoral students of the College of Educational Science of Xinjiang Normal University named “Research on project-based teaching of high school information technology courses from the perspective of discipline core literacy” (No. XJNUJKYA2003).

Author information

Authors and affiliations.

College of Educational Science, Xinjiang Normal University, 830017, Urumqi, Xinjiang, China

Enwei Xu, Wei Wang & Qingxia Wang

You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Enwei Xu or Wei Wang .

Ethics declarations

Competing interests.

The authors declare no competing interests.

Ethical approval

This article does not contain any studies with human participants performed by any of the authors.

Informed consent

Additional information.

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Supplementary tables, rights and permissions.

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ .

Reprints and permissions

About this article

Cite this article.

Xu, E., Wang, W. & Wang, Q. The effectiveness of collaborative problem solving in promoting students’ critical thinking: A meta-analysis based on empirical literature. Humanit Soc Sci Commun 10 , 16 (2023). https://doi.org/10.1057/s41599-023-01508-1

Download citation

Received : 07 August 2022

Accepted : 04 January 2023

Published : 11 January 2023

DOI : https://doi.org/10.1057/s41599-023-01508-1

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

This article is cited by

Impacts of online collaborative learning on students’ intercultural communication apprehension and intercultural communicative competence.

Hoa Thi Hoang Chau
Hung Phu Bui
Quynh Thi Huong Dinh

Education and Information Technologies (2024)

Exploring the effects of digital technology on deep learning: a meta-analysis

Sustainable electricity generation and farm-grid utilization from photovoltaic aquaculture: a bibliometric analysis.

A. A. Amusa
M. Alhassan

International Journal of Environmental Science and Technology (2024)

Quick links

Explore articles by subject
Guide to authors
Editorial policies

Utility Menu

GA4 Tracking Code

fa51e2b1dc8cca8f7467da564e77b5ea

Make a Gift
Join Our Email List
Problem Solving in STEM

Solving problems is a key component of many science, math, and engineering classes. If a goal of a class is for students to emerge with the ability to solve new kinds of problems or to use new problem-solving techniques, then students need numerous opportunities to develop the skills necessary to approach and answer different types of problems. Problem solving during section or class allows students to develop their confidence in these skills under your guidance, better preparing them to succeed on their homework and exams. This page offers advice about strategies for facilitating problem solving during class.

How do I decide which problems to cover in section or class?

In-class problem solving should reinforce the major concepts from the class and provide the opportunity for theoretical concepts to become more concrete. If students have a problem set for homework, then in-class problem solving should prepare students for the types of problems that they will see on their homework. You may wish to include some simpler problems both in the interest of time and to help students gain confidence, but it is ideal if the complexity of at least some of the in-class problems mirrors the level of difficulty of the homework. You may also want to ask your students ahead of time which skills or concepts they find confusing, and include some problems that are directly targeted to their concerns.

You have given your students a problem to solve in class. What are some strategies to work through it?

Try to give your students a chance to grapple with the problems as much as possible. Offering them the chance to do the problem themselves allows them to learn from their mistakes in the presence of your expertise as their teacher. (If time is limited, they may not be able to get all the way through multi-step problems, in which case it can help to prioritize giving them a chance to tackle the most challenging steps.)
When you do want to teach by solving the problem yourself at the board, talk through the logic of how you choose to apply certain approaches to solve certain problems. This way you can externalize the type of thinking you hope your students internalize when they solve similar problems themselves.
Start by setting up the problem on the board (e.g you might write down key variables and equations; draw a figure illustrating the question). Ask students to start solving the problem, either independently or in small groups. As they are working on the problem, walk around to hear what they are saying and see what they are writing down. If several students seem stuck, it might be a good to collect the whole class again to clarify any confusion. After students have made progress, bring the everyone back together and have students guide you as to what to write on the board.
It can help to first ask students to work on the problem by themselves for a minute, and then get into small groups to work on the problem collaboratively.
If you have ample board space, have students work in small groups at the board while solving the problem. That way you can monitor their progress by standing back and watching what they put up on the board.
If you have several problems you would like to have the students practice, but not enough time for everyone to do all of them, you can assign different groups of students to work on different – but related - problems.

When do you want students to work in groups to solve problems?

Don’t ask students to work in groups for straightforward problems that most students could solve independently in a short amount of time.
Do have students work in groups for thought-provoking problems, where students will benefit from meaningful collaboration.
Even in cases where you plan to have students work in groups, it can be useful to give students some time to work on their own before collaborating with others. This ensures that every student engages with the problem and is ready to contribute to a discussion.

What are some benefits of having students work in groups?

Students bring different strengths, different knowledge, and different ideas for how to solve a problem; collaboration can help students work through problems that are more challenging than they might be able to tackle on their own.
In working in a group, students might consider multiple ways to approach a problem, thus enriching their repertoire of strategies.
Students who think they understand the material will gain a deeper understanding by explaining concepts to their peers.

What are some strategies for helping students to form groups?

Instruct students to work with the person (or people) sitting next to them.
Count off. (e.g. 1, 2, 3, 4; all the 1’s find each other and form a group, etc)
Hand out playing cards; students need to find the person with the same number card. (There are many variants to this. For example, you can print pictures of images that go together [rain and umbrella]; each person gets a card and needs to find their partner[s].)
Based on what you know about the students, assign groups in advance. List the groups on the board.
Note: Always have students take the time to introduce themselves to each other in a new group.

What should you do while your students are working on problems?

Walk around and talk to students. Observing their work gives you a sense of what people understand and what they are struggling with. Answer students’ questions, and ask them questions that lead in a productive direction if they are stuck.
If you discover that many people have the same question—or that someone has a misunderstanding that others might have—you might stop everyone and discuss a key idea with the entire class.

After students work on a problem during class, what are strategies to have them share their answers and their thinking?

Ask for volunteers to share answers. Depending on the nature of the problem, student might provide answers verbally or by writing on the board. As a variant, for questions where a variety of answers are relevant, ask for at least three volunteers before anyone shares their ideas.
Use online polling software for students to respond to a multiple-choice question anonymously.
If students are working in groups, assign reporters ahead of time. For example, the person with the next birthday could be responsible for sharing their group’s work with the class.
Cold call. To reduce student anxiety about cold calling, it can help to identify students who seem to have the correct answer as you were walking around the class and checking in on their progress solving the assigned problem. You may even want to warn the student ahead of time: "This is a great answer! Do you mind if I call on you when we come back together as a class?"
Have students write an answer on a notecard that they turn in to you. If your goal is to understand whether students in general solved a problem correctly, the notecards could be submitted anonymously; if you wish to assess individual students’ work, you would want to ask students to put their names on their notecard.
Use a jigsaw strategy, where you rearrange groups such that each new group is comprised of people who came from different initial groups and had solved different problems. Students now are responsible for teaching the other students in their new group how to solve their problem.
Have a representative from each group explain their problem to the class.
Have a representative from each group draw or write the answer on the board.

What happens if a student gives a wrong answer?

Ask for their reasoning so that you can understand where they went wrong.
Ask if anyone else has other ideas. You can also ask this sometimes when an answer is right.
Cultivate an environment where it’s okay to be wrong. Emphasize that you are all learning together, and that you learn through making mistakes.
Do make sure that you clarify what the correct answer is before moving on.
Once the correct answer is given, go through some answer-checking techniques that can distinguish between correct and incorrect answers. This can help prepare students to verify their future work.

How can you make your classroom inclusive?

The goal is that everyone is thinking, talking, and sharing their ideas, and that everyone feels valued and respected. Use a variety of teaching strategies (independent work and group work; allow students to talk to each other before they talk to the class). Create an environment where it is normal to struggle and make mistakes.
See Kimberly Tanner’s article on strategies to promoste student engagement and cultivate classroom equity.

A few final notes…

Make sure that you have worked all of the problems and also thought about alternative approaches to solving them.
Board work matters. You should have a plan beforehand of what you will write on the board, where, when, what needs to be added, and what can be erased when. If students are going to write their answers on the board, you need to also have a plan for making sure that everyone gets to the correct answer. Students will copy what is on the board and use it as their notes for later study, so correct and logical information must be written there.

For more information...

Tipsheet: Problem Solving in STEM Sections

Tanner, K. D. (2013). Structure matters: twenty-one teaching strategies to promote student engagement and cultivate classroom equity . CBE-Life Sciences Education, 12(3), 322-331.

Designing Your Course
A Teaching Timeline: From Pre-Term Planning to the Final Exam
The First Day of Class
Group Agreements
Classroom Debate
Flipped Classrooms
Leading Discussions
Polling & Clickers
Teaching with Cases
Engaged Scholarship
Devices in the Classroom
Beyond the Classroom
On Professionalism
Getting Feedback
Equitable & Inclusive Teaching
Advising and Mentoring
Teaching and Your Career
Teaching Remotely
Tools and Platforms
The Science of Learning
Bok Publications
Other Resources Around Campus

Problem-Solving Method in Teaching

The problem-solving method is a highly effective teaching strategy that is designed to help students develop critical thinking skills and problem-solving abilities . It involves providing students with real-world problems and challenges that require them to apply their knowledge, skills, and creativity to find solutions. This method encourages active learning, promotes collaboration, and allows students to take ownership of their learning.

Definition of problem-solving method.

Problem-solving is a process of identifying, analyzing, and resolving problems. The problem-solving method in teaching involves providing students with real-world problems that they must solve through collaboration and critical thinking. This method encourages students to apply their knowledge and creativity to develop solutions that are effective and practical.

Meaning of Problem-Solving Method

The meaning and Definition of problem-solving are given by different Scholars. These are-

Woodworth and Marquis(1948) : Problem-solving behavior occurs in novel or difficult situations in which a solution is not obtainable by the habitual methods of applying concepts and principles derived from past experience in very similar situations.

Skinner (1968): Problem-solving is a process of overcoming difficulties that appear to interfere with the attainment of a goal. It is the procedure of making adjustments in spite of interference

Benefits of Problem-Solving Method

The problem-solving method has several benefits for both students and teachers. These benefits include:

Encourages active learning: The problem-solving method encourages students to actively participate in their own learning by engaging them in real-world problems that require critical thinking and collaboration
Promotes collaboration: Problem-solving requires students to work together to find solutions. This promotes teamwork, communication, and cooperation.
Builds critical thinking skills: The problem-solving method helps students develop critical thinking skills by providing them with opportunities to analyze and evaluate problems
Increases motivation: When students are engaged in solving real-world problems, they are more motivated to learn and apply their knowledge.
Enhances creativity: The problem-solving method encourages students to be creative in finding solutions to problems.

Steps in Problem-Solving Method

The problem-solving method involves several steps that teachers can use to guide their students. These steps include

Identifying the problem: The first step in problem-solving is identifying the problem that needs to be solved. Teachers can present students with a real-world problem or challenge that requires critical thinking and collaboration.
Analyzing the problem: Once the problem is identified, students should analyze it to determine its scope and underlying causes.
Generating solutions: After analyzing the problem, students should generate possible solutions. This step requires creativity and critical thinking.
Evaluating solutions: The next step is to evaluate each solution based on its effectiveness and practicality
Selecting the best solution: The final step is to select the best solution and implement it.

Verification of the concluded solution or Hypothesis

The solution arrived at or the conclusion drawn must be further verified by utilizing it in solving various other likewise problems. In case, the derived solution helps in solving these problems, then and only then if one is free to agree with his finding regarding the solution. The verified solution may then become a useful product of his problem-solving behavior that can be utilized in solving further problems. The above steps can be utilized in solving various problems thereby fostering creative thinking ability in an individual.

The problem-solving method is an effective teaching strategy that promotes critical thinking, creativity, and collaboration. It provides students with real-world problems that require them to apply their knowledge and skills to find solutions. By using the problem-solving method, teachers can help their students develop the skills they need to succeed in school and in life.

Jonassen, D. (2011). Learning to solve problems: A handbook for designing problem-solving learning environments. Routledge.
Hmelo-Silver, C. E. (2004). Problem-based learning: What and how do students learn? Educational Psychology Review, 16(3), 235-266.
Mergendoller, J. R., Maxwell, N. L., & Bellisimo, Y. (2006). The effectiveness of problem-based instruction: A comparative study of instructional methods and student characteristics. Interdisciplinary Journal of Problem-based Learning, 1(2), 49-69.
Richey, R. C., Klein, J. D., & Tracey, M. W. (2011). The instructional design knowledge base: Theory, research, and practice. Routledge.
Savery, J. R., & Duffy, T. M. (2001). Problem-based learning: An instructional model and its constructivist framework. CRLT Technical Report No. 16-01, University of Michigan. Wojcikowski, J. (2013). Solving real-world problems through problem-based learning. College Teaching, 61(4), 153-156

The Problem Solving Approach in Science Education

Table of Contents

Have you ever wondered how science , with its vast array of facts and figures, becomes so deeply integrated into our understanding of the world? It isn’t just about memorizing data; it’s about engaging with problems and seeking solutions through a systematic approach. This is where the problem\-solving approach in science education takes the spotlight. It transforms passive listeners into active participants, nurturing the next generation of critical thinkers and innovators.

What is the Problem-Solving Approach?

At its core, the problem-solving approach is a student\-centered method that encourages learners to tackle scientific problems with curiosity and rigor. It isn’t just a teaching strategy; it’s a journey that begins with recognizing a problem and ends with reaching a conclusion through investigation and reasoning.

Step 1: Identifying the Problem

Every scientific journey begins with a question. In the classroom, this means fostering an environment where students are prompted to observe phenomena and articulate their curiosities in the form of clear, concise problems. This might look like a teacher demonstrating an unexpected result in an experiment and asking students to ponder why it occurred.

Step 2: Gathering Information

Once the problem is set, the next step is to gather relevant information. Here, students exercise their research skills, looking through textbooks, scientific journals, and credible internet sources to understand the context of their problem. They learn to differentiate between reliable and unreliable information—a skill with far-reaching implications.

Step 3: Formulating Hypotheses

Armed with information, students then formulate hypotheses. A hypothesis is an educated guess that can be tested through experiments. Encouraging learners to come up with their hypotheses promotes creativity and ownership of the learning process.

Step 4: Conducting Experiments

What sets science apart is its reliance on empirical evidence . In this step, students design and conduct experiments to test their hypotheses. They learn about controls, variables, and the importance of replicability. This hands-on experience is invaluable and often the most engaging part of the approach.

Step 5: Analyzing Data

After the experiment, comes the analysis. Students examine their results, often using statistical methods , to see if the data supports or refutes their hypotheses. This is where critical thinking is paramount, as they must interpret the data without bias.

Step 6: Drawing Conclusions

The final step in the process is drawing conclusions. Here, students evaluate the entirety of their work and determine the implications of their findings. Whether their hypotheses were supported or not, they gain insights into the scientific process and develop the ability to argue their conclusions based on evidence.

The Benefits of Problem Solving in Science Education

This methodology goes beyond knowledge acquisition; it’s about instilling a scientific mindset. Let’s explore how this approach benefits learners:

Develops Higher-Order Thinking Skills

By grappling with complex problems, students develop higher\-order thinking skills such as analysis, synthesis, and evaluation. These are not only vital in science but in everyday decision-making as well.

Encourages Active Learning

Active engagement in learning through problem-solving keeps students invested in their education. They’re not passive receivers of information but active participants in their learning journey.

Promotes Autonomy and Confidence

As students navigate through problems on their own, they build autonomy and confidence in their ability to tackle challenges. This self-assurance can translate to various aspects of their lives.

Fosters a Deeper Understanding of Scientific Principles

By connecting theoretical knowledge to practical problems, students develop a more nuanced understanding of scientific principles. It’s one thing to read about a concept; it’s another to see it in action.

Improves Collaboration Skills

Problem-solving often involves teamwork, allowing students to improve their collaborative skills . They learn to communicate ideas, share tasks, and respect different viewpoints.

Enhances Persistence and Resilience

Not every experiment will go as planned, and not every hypothesis will be correct. Navigating these challenges teaches learners persistence and resilience —qualities that are essential in science and in life.

Bringing Problem Solving Into the Classroom

Integrating the problem-solving approach into science education requires careful planning and a shift in mindset. Teachers become facilitators rather than lecturers, guiding students through the process and providing support when needed. Classrooms become active learning environments where mistakes are seen as learning opportunities.

The problem-solving approach in science education is more than a teaching strategy; it’s a blueprint for developing curious, independent, and analytical thinkers. By engaging learners in this manner, we’re not just teaching them science; we’re equipping them with the tools to solve the complex problems of tomorrow.

What do you think? How can we further encourage problem-solving skills in students from an early age? Do you believe that the problem-solving approach should be applied to other subjects beyond science? Share your thoughts and experiences with this dynamic educational strategy.

How useful was this post?

Click on a star to rate it!

Average rating 0 / 5. Vote count: 0

No votes so far! Be the first to rate this post.

We are sorry that this post was not useful for you!

Let us improve this post!

Tell us how we can improve this post?

Submit a Comment Cancel reply

Your email address will not be published. Required fields are marked *

Save my name, email, and website in this browser for the next time I comment.

Submit Comment

Pedagogy of Science

1 Science – Perspectives and Nature

Understanding Science
Myths about Nature of Science
Understanding Nature of Science
Domains of Science

2 Aims and Objectives of Science Teaching-Learning

Aims of Science Education
Objectives of Science Teaching-Learning
Developing Learning Objectives
Shift in Pedagogic Approach

3 Process Skills in Science

Process Skills in Science
Basic Process Skills in Science
Developing Scientific Attitude and Scientific Temper
Nurturing Aesthetic Sense and Curiosity
Interdependence of Different Aspects of Nature of Science

4 Science in School Curriculum

Historical Development of Science Education in India
Teaching of Science as Recommended in National Curriculum Framework-2005
Correlation of Science with Other Subjects/Disciplines

5 Organizing Teaching – Learning Experiences

Linking Process Skills with Content
Formulating Learning Objectives
Unit Planning in Science
Lesson Planning in Science
Using Laboratory for Teaching-Learning

6 Approaches in Science Teaching – Learning

Science as a Process of Construction of Knowledge
Inquiry Approach
Problem Solving Approach
Cooperative Learning Approach
Experiential Learning Approach
Concept Mapping as an Approach for Planning and Transaction
Adopting Critical Pedagogy in Science Teaching-Learning

7 Methods in Science Teaching – Learning

Teacher Centric Methods
Learner Centric Methods
Cooperative Learning Methods
Inclusion in Science Classroom
Adopting Critical Pedagogy

8 Learning Resources in Science

Identifying Appropriate Learning Resource
Various Learning Resources
Classroom Learning Resources
ICT as Learning Resource
Developing Learning Resource Centres
Importance of Various Activities in Science Teaching-Learning
Innovations in Science Laboratories
Role of Innovation and Research in Science
Professional Development of Science Teachers

9 Assessment in Science

Nature of Assessment in Science
Assessment Indicators in Science
Tools and Techniques for Assessment
Diagnostics Assessment in Science
Schemes for Promoting Scientific Attitude
Components of Food
How to Get Higher Yields
Animal Husbandry

11 Material

Classification of Substances
States of Material
Mole Valency and Equivalence
Types of Chemical Reactions
Basic Metallurgical Processes

12 The Living World

Diversity in Plants and Animals
Nomenclature Scientific Names and Hierarchy
Cell and Cell Organelles
Life Processes

13 How Things Work

Electric Current and Electric Circuit
Electric Potential and Potential Difference
Combination of Resistors — Series and Parallel
Electric Power
Heating Effects of Electric Current
Magnetic Effects of Electric Current
Electric Motor
Electromagnetic Induction
Electric Generator
Domestic Electric Circuits

14 Moving Things, People and Ideas

Newton’s Law of Motion
Conservation of Momentum
Kinetic and Potential Energy

15 Natural Phenomenon

Light as a Natural Phenomenon
Water Cycle
Conservation of Water Bodies
Natural Disasters
Waste Management

16 Natural Resources

Physical Resources and their Utilization
Pollution and Role of Human Being
Bio-Geo-Chemical Cycles in Nature
Natural Resource Management

Share on Mastodon

Want to create or adapt books like this? Learn more about how Pressbooks supports open publishing practices.

5 Teaching Mathematics Through Problem Solving

Janet Stramel

In his book “How to Solve It,” George Pólya (1945) said, “One of the most important tasks of the teacher is to help his students. This task is not quite easy; it demands time, practice, devotion, and sound principles. The student should acquire as much experience of independent work as possible. But if he is left alone with his problem without any help, he may make no progress at all. If the teacher helps too much, nothing is left to the student. The teacher should help, but not too much and not too little, so that the student shall have a reasonable share of the work.” (page 1)

What is a problem in mathematics? A problem is “any task or activity for which the students have no prescribed or memorized rules or methods, nor is there a perception by students that there is a specific ‘correct’ solution method” (Hiebert, et. al., 1997). Problem solving in mathematics is one of the most important topics to teach; learning to problem solve helps students develop a sense of solving real-life problems and apply mathematics to real world situations. It is also used for a deeper understanding of mathematical concepts. Learning “math facts” is not enough; students must also learn how to use these facts to develop their thinking skills.

According to NCTM (2010), the term “problem solving” refers to mathematical tasks that have the potential to provide intellectual challenges for enhancing students’ mathematical understanding and development. When you first hear “problem solving,” what do you think about? Story problems or word problems? Story problems may be limited to and not “problematic” enough. For example, you may ask students to find the area of a rectangle, given the length and width. This type of problem is an exercise in computation and can be completed mindlessly without understanding the concept of area. Worthwhile problems includes problems that are truly problematic and have the potential to provide contexts for students’ mathematical development.

There are three ways to solve problems: teaching for problem solving, teaching about problem solving, and teaching through problem solving.

Teaching for problem solving begins with learning a skill. For example, students are learning how to multiply a two-digit number by a one-digit number, and the story problems you select are multiplication problems. Be sure when you are teaching for problem solving, you select or develop tasks that can promote the development of mathematical understanding.

Teaching about problem solving begins with suggested strategies to solve a problem. For example, “draw a picture,” “make a table,” etc. You may see posters in teachers’ classrooms of the “Problem Solving Method” such as: 1) Read the problem, 2) Devise a plan, 3) Solve the problem, and 4) Check your work. There is little or no evidence that students’ problem-solving abilities are improved when teaching about problem solving. Students will see a word problem as a separate endeavor and focus on the steps to follow rather than the mathematics. In addition, students will tend to use trial and error instead of focusing on sense making.

Teaching through problem solving focuses students’ attention on ideas and sense making and develops mathematical practices. Teaching through problem solving also develops a student’s confidence and builds on their strengths. It allows for collaboration among students and engages students in their own learning.

Consider the following worthwhile-problem criteria developed by Lappan and Phillips (1998):

The problem has important, useful mathematics embedded in it.
The problem requires high-level thinking and problem solving.
The problem contributes to the conceptual development of students.
The problem creates an opportunity for the teacher to assess what his or her students are learning and where they are experiencing difficulty.
The problem can be approached by students in multiple ways using different solution strategies.
The problem has various solutions or allows different decisions or positions to be taken and defended.
The problem encourages student engagement and discourse.
The problem connects to other important mathematical ideas.
The problem promotes the skillful use of mathematics.
The problem provides an opportunity to practice important skills.

Of course, not every problem will include all of the above. Sometimes, you will choose a problem because your students need an opportunity to practice a certain skill.

Key features of a good mathematics problem includes:

It must begin where the students are mathematically.
The feature of the problem must be the mathematics that students are to learn.
It must require justifications and explanations for both answers and methods of solving.

Problem solving is not a neat and orderly process. Think about needlework. On the front side, it is neat and perfect and pretty.

But look at the b ack.

It is messy and full of knots and loops. Problem solving in mathematics is also like this and we need to help our students be “messy” with problem solving; they need to go through those knots and loops and learn how to solve problems with the teacher’s guidance.

When you teach through problem solving , your students are focused on ideas and sense-making and they develop confidence in mathematics!

Mathematics Tasks and Activities that Promote Teaching through Problem Solving

Choosing the Right Task

Selecting activities and/or tasks is the most significant decision teachers make that will affect students’ learning. Consider the following questions:

Teachers must do the activity first. What is problematic about the activity? What will you need to do BEFORE the activity and AFTER the activity? Additionally, think how your students would do the activity.
What mathematical ideas will the activity develop? Are there connections to other related mathematics topics, or other content areas?
Can the activity accomplish your learning objective/goals?

Low Floor High Ceiling Tasks

By definition, a “ low floor/high ceiling task ” is a mathematical activity where everyone in the group can begin and then work on at their own level of engagement. Low Floor High Ceiling Tasks are activities that everyone can begin and work on based on their own level, and have many possibilities for students to do more challenging mathematics. One gauge of knowing whether an activity is a Low Floor High Ceiling Task is when the work on the problems becomes more important than the answer itself, and leads to rich mathematical discourse [Hover: ways of representing, thinking, talking, agreeing, and disagreeing; the way ideas are exchanged and what the ideas entail; and as being shaped by the tasks in which students engage as well as by the nature of the learning environment].

The strengths of using Low Floor High Ceiling Tasks:

Allows students to show what they can do, not what they can’t.
Provides differentiation to all students.
Promotes a positive classroom environment.
Advances a growth mindset in students
Aligns with the Standards for Mathematical Practice

Examples of some Low Floor High Ceiling Tasks can be found at the following sites:

YouCubed – under grades choose Low Floor High Ceiling
NRICH Creating a Low Threshold High Ceiling Classroom
Inside Mathematics Problems of the Month

Math in 3-Acts

Math in 3-Acts was developed by Dan Meyer to spark an interest in and engage students in thought-provoking mathematical inquiry. Math in 3-Acts is a whole-group mathematics task consisting of three distinct parts:

Act One is about noticing and wondering. The teacher shares with students an image, video, or other situation that is engaging and perplexing. Students then generate questions about the situation.

In Act Two , the teacher offers some information for the students to use as they find the solutions to the problem.

Act Three is the “reveal.” Students share their thinking as well as their solutions.

“Math in 3 Acts” is a fun way to engage your students, there is a low entry point that gives students confidence, there are multiple paths to a solution, and it encourages students to work in groups to solve the problem. Some examples of Math in 3-Acts can be found at the following websites:

Dan Meyer’s Three-Act Math Tasks
Graham Fletcher3-Act Tasks ]
Math in 3-Acts: Real World Math Problems to Make Math Contextual, Visual and Concrete

Number Talks

Number talks are brief, 5-15 minute discussions that focus on student solutions for a mental math computation problem. Students share their different mental math processes aloud while the teacher records their thinking visually on a chart or board. In addition, students learn from each other’s strategies as they question, critique, or build on the strategies that are shared.. To use a “number talk,” you would include the following steps:

The teacher presents a problem for students to solve mentally.
Provide adequate “ wait time .”
The teacher calls on a students and asks, “What were you thinking?” and “Explain your thinking.”
For each student who volunteers to share their strategy, write their thinking on the board. Make sure to accurately record their thinking; do not correct their responses.
Invite students to question each other about their strategies, compare and contrast the strategies, and ask for clarification about strategies that are confusing.

“Number Talks” can be used as an introduction, a warm up to a lesson, or an extension. Some examples of Number Talks can be found at the following websites:

Inside Mathematics Number Talks
Number Talks Build Numerical Reasoning

Saying “This is Easy”

“This is easy.” Three little words that can have a big impact on students. What may be “easy” for one person, may be more “difficult” for someone else. And saying “this is easy” defeats the purpose of a growth mindset classroom, where students are comfortable making mistakes.

When the teacher says, “this is easy,” students may think,

“Everyone else understands and I don’t. I can’t do this!”
Students may just give up and surrender the mathematics to their classmates.
Students may shut down.

Instead, you and your students could say the following:

“I think I can do this.”
“I have an idea I want to try.”
“I’ve seen this kind of problem before.”

Tracy Zager wrote a short article, “This is easy”: The Little Phrase That Causes Big Problems” that can give you more information. Read Tracy Zager’s article here.

Using “Worksheets”

Do you want your students to memorize concepts, or do you want them to understand and apply the mathematics for different situations?

What is a “worksheet” in mathematics? It is a paper and pencil assignment when no other materials are used. A worksheet does not allow your students to use hands-on materials/manipulatives [Hover: physical objects that are used as teaching tools to engage students in the hands-on learning of mathematics]; and worksheets are many times “naked number” with no context. And a worksheet should not be used to enhance a hands-on activity.

Students need time to explore and manipulate materials in order to learn the mathematics concept. Worksheets are just a test of rote memory. Students need to develop those higher-order thinking skills, and worksheets will not allow them to do that.

One productive belief from the NCTM publication, Principles to Action (2014), states, “Students at all grade levels can benefit from the use of physical and virtual manipulative materials to provide visual models of a range of mathematical ideas.”

You may need an “activity sheet,” a “graphic organizer,” etc. as you plan your mathematics activities/lessons, but be sure to include hands-on manipulatives. Using manipulatives can

Provide your students a bridge between the concrete and abstract
Serve as models that support students’ thinking
Provide another representation
Support student engagement
Give students ownership of their own learning.

Adapted from “ The Top 5 Reasons for Using Manipulatives in the Classroom ”.

any task or activity for which the students have no prescribed or memorized rules or methods, nor is there a perception by students that there is a specific ‘correct’ solution method

should be intriguing and contain a level of challenge that invites speculation and hard work, and directs students to investigate important mathematical ideas and ways of thinking toward the learning

involves teaching a skill so that a student can later solve a story problem

when we teach students how to problem solve

teaching mathematics content through real contexts, problems, situations, and models

a mathematical activity where everyone in the group can begin and then work on at their own level of engagement

20 seconds to 2 minutes for students to make sense of questions

Share This Book

Our Mission

6 Tips for Teaching Math Problem-Solving Skills

Solving word problems is tougher than computing with numbers, but elementary teachers can guide students to do the deep thinking involved.

Photo of elementary school teacher with students

A growing concern with students is the ability to problem-solve, especially with complex, multistep problems. Data shows that students struggle more when solving word problems than they do with computation , and so problem-solving should be considered separately from computation. Why?

Consider this. When we’re on the way to a new destination and we plug in our location to a map on our phone, it tells us what lane to be in and takes us around any detours or collisions, sometimes even buzzing our watch to remind us to turn. When I experience this as a driver, I don’t have to do the thinking. I can think about what I’m going to cook for dinner, not paying much attention to my surroundings other than to follow those directions. If I were to be asked to go there again, I wouldn’t be able to remember, and I would again seek help.

If we can switch to giving students strategies that require them to think instead of giving them too much support throughout the journey to the answer, we may be able to give them the ability to learn the skills to read a map and have several ways to get there.

Here are six ways we can start letting students do this thinking so that they can go through rigorous problem-solving again and again, paving their own way to the solution.

1. Link problem-solving to reading

When we can remind students that they already have many comprehension skills and strategies they can easily use in math problem-solving, it can ease the anxiety surrounding the math problem. For example, providing them with strategies to practice, such as visualizing, acting out the problem with math tools like counters or base 10 blocks, drawing a quick sketch of the problem, retelling the story in their own words, etc., can really help them to utilize the skills they already have to make the task less daunting.

We can break these skills into specific short lessons so students have a bank of strategies to try on their own. Here's an example of an anchor chart that they can use for visualizing . Breaking up comprehension into specific skills can increase student independence and help teachers to be much more targeted in their problem-solving instruction. This allows students to build confidence and break down the barriers between reading and math to see they already have so many strengths that are transferable to all problems.

2. Avoid boxing students into choosing a specific operation

It can be so tempting to tell students to look for certain words that might mean a certain operation. This might even be thoroughly successful in kindergarten and first grade, but just like when our map tells us where to go, that limits students from becoming deep thinkers. It also expires once they get into the upper grades, where those words could be in a problem multiple times, creating more confusion when students are trying to follow a rule that may not exist in every problem.

We can encourage a variety of ways to solve problems instead of choosing the operation first. In first grade, a problem might say, “Joceline has 13 stuffed animals and Jordan has 17. How many more does Jordan have?” Some students might choose to subtract, but a lot of students might just count to find the amount in between. If we tell them that “how many more” means to subtract, we’re taking the thinking out of the problem altogether, allowing them to go on autopilot without truly solving the problem or using their comprehension skills to visualize it.

3. Revisit ‘representation’

The word “representation” can be misleading. It seems like something to do after the process of solving. When students think they have to go straight to solving, they may not realize that they need a step in between to be able to support their understanding of what’s actually happening in the problem first.

Using an anchor chart like one of these ( lower grade , upper grade ) can help students to choose a representation that most closely matches what they’re visualizing in their mind. Once they sketch it out, it can give them a clearer picture of different ways they could solve the problem.

Think about this problem: “Varush went on a trip with his family to his grandmother’s house. It was 710 miles away. On the way there, three people took turns driving. His mom drove 214 miles. His dad drove 358 miles. His older sister drove the rest. How many miles did his sister drive?”

If we were to show this student the anchor chart, they would probably choose a number line or a strip diagram to help them understand what’s happening.

If we tell students they must always draw base 10 blocks in a place value chart, that doesn’t necessarily match the concept of this problem. When we ask students to match our way of thinking, we rob them of critical thinking practice and sometimes confuse them in the process.

4. Give time to process

Sometimes as educators, we can feel rushed to get to everyone and everything that’s required. When solving a complex problem, students need time to just sit with a problem and wrestle with it, maybe even leaving it and coming back to it after a period of time.

This might mean we need to give them fewer problems but go deeper with those problems we give them. We can also speed up processing time when we allow for collaboration and talk time with peers on problem-solving tasks.

5. Ask questions that let Students do the thinking

Questions or prompts during problem-solving should be very open-ended to promote thinking. Telling a student to reread the problem or to think about what tools or resources would help them solve it is a way to get them to try something new but not take over their thinking.

These skills are also transferable across content, and students will be reminded, “Good readers and mathematicians reread.”

6. Spiral concepts so students frequently use problem-solving skills

When students don’t have to switch gears in between concepts, they’re not truly using deep problem-solving skills. They already kind of know what operation it might be or that it’s something they have at the forefront of their mind from recent learning. Being intentional within their learning stations and assessments about having a variety of rigorous problem-solving skills will refine their critical thinking abilities while building more and more resilience throughout the school year as they retain content learning in the process.

Problem-solving skills are so abstract, and it can be tough to pinpoint exactly what students need. Sometimes we have to go slow to go fast. Slowing down and helping students have tools when they get stuck and enabling them to be critical thinkers will prepare them for life and allow them multiple ways to get to their own destination.

Educational leaders’ problem-solving for educational improvement: Belief validity testing in conversations

Open access
Published: 01 October 2021
Volume 24 , pages 133–181, ( 2023 )

Cite this article

You have full access to this open access article

Claire Sinnema ORCID: orcid.org/0000-0002-6707-6726 1 ,
Frauke Meyer 1 ,
Deidre Le Fevre 1 ,
Hamish Chalmers 1 &
Viviane Robinson 1

13k Accesses

8 Citations

21 Altmetric

Explore all metrics

Educational leaders’ effectiveness in solving problems is vital to school and system-level efforts to address macrosystem problems of educational inequity and social injustice. Leaders’ problem-solving conversation attempts are typically influenced by three types of beliefs—beliefs about the nature of the problem, about what causes it, and about how to solve it. Effective problem solving demands testing the validity of these beliefs—the focus of our investigation. We analyzed 43 conversations between leaders and staff about equity related problems including teaching effectiveness. We first determined the types of beliefs held and the validity testing behaviors employed drawing on fine-grained coding frameworks. The quantification of these allowed us to use cross tabs and chi-square tests of independence to explore the relationship between leaders’ use of validity testing behaviors (those identified as more routine or more robust, and those relating to both advocacy and inquiry) and belief type. Leaders tended to avoid discussion of problem causes, advocate more than inquire, bypass disagreements, and rarely explore logic between solutions and problem causes. There was a significant relationship between belief type and the likelihood that leaders will test the validity of those beliefs—beliefs about problem causes were the least likely to be tested. The patterns found here are likely to impact whether micro and mesosystem problems, and ultimately exo and macrosystem problems, are solved. Capability building in belief validity testing is vital for leadership professional learning to ensure curriculum, social justice and equity policy aspirations are realized in practice.

Teachers’ Beliefs Shift Across Year-Long Professional Development: ENA Graphs Transformation of Privately Held Beliefs Over Time

Addressing inequity and underachievement: Intervening to improve middle leaders’problem-solving conversations

Teaching Testable Explanations and Putting Them into Practice

Avoid common mistakes on your manuscript.

This study examines the extent to which leaders, in their conversations with others, test rather than assume the validity of their own and others’ beliefs about the nature, causes of, and solutions to problems of teaching and learning that arise in their sphere of responsibility. We define a problem as a gap between the current and desired state, plus the demand that the gap be reduced (Robinson, 1993 ). We position this focus within the broader context of educational change, and educational improvement in particular, since effective discussion of such problems is central to improvement and vital for addressing issues of educational equity and social justice.

Educational improvement and leaders’ role in problem solving

Educational leaders work in a discretionary problem-solving space. Ball ( 2018 ) describes discretionary spaces as the micro level practices of the teacher. It is imperative to attend to what happens in these spaces because the specific talk and actions that occur in particular moments (for example, what the teacher says or does when one student responds in a particular way to his or her question) impact all participants in the classroom and shape macro level educational issues including legacies of racism, oppression, and marginalization of particular groups of students. A parallel exists, we argue, for leaders’ problem solving—how capable leaders are at dealing with micro-level problems in the conversational moment impacts whether a school or network achieves its improvement goals. For example, how a leader deals with problems with a particular teacher or with a particular student or group of students is subtly but strongly related to the solving of equity problems at the exo and macro levels. Problem solving effectiveness is also related to challenges in the realization of curriculum reform aspirations, including curriculum reform depth, spread, reach, and pace (Sinnema & Stoll, 2020b ).

The conversations leaders have with others in their schools in their efforts to solve educational problems are situated in a broader environment which they both influence and are influenced by. We draw here on Bronfonbrenner’s ( 1992 ) ecological systems theory to construct a nested model of educational problem solving (see Fig. 1 ). Bronfenbrenner focused on the environment around children, and set out five interrelated systems that he professed influence a child’s development. We propose that these systems can also be used to understand another type of learner—educators, including leaders and teachers—in the context of educational problem solving.

Nested model of educational problem solving

Bronfenbrenner’s ( 1977 ) microsystem sets out the immediate environment, parents, siblings, teachers, and peers as influencers of and influenced by children. We propose the micro system for educators to include those they have direct contact with including their students, other teachers in their classroom and school, the school board, and the parent community. Bronfenbrenner’s meso system referred to the interactions between a child’s microsystems. In the same way, when foregrounding the ecological system around educators, we suggest attention to the problems that occur in the interactions between students, teachers, school leaders, their boards, and communities. In the exo system, Bronfenbrenner directs attention to other social structures (formal and informal), which do not themselves contain the child, but indirectly influence them as they affect one of the microsystems. In the same way, we suggest educational ministries, departments and agencies function to influence educators. The macro system as theorized by Bronfenbrenner focuses on how child development is influenced by cultural elements established in society, including prevalent beliefs, attitudes, and perceptions. In our model, we recognise how such cultural elements of Bronfenbrenner’s macro system also relate to educators in that dominant and pervasive beliefs, attitudes and perceptions create and perpetuate educational problems, including those relating to educational inequity, bias, racism, social injustice, and underachievement. The chronosystem, as Bronfenbrenner describes, shows the role of environmental changes across a lifetime, which influences development. In a similar way, educators′ professional transitions and professional milestones influence and are influenced by other system levels, and in the context of our work, their problem solving approaches.

Leaders’ effectiveness in discussions about problems related to the micro and mesosystem contributes greatly to the success of exosystem reform efforts, and those efforts, in turn, influence the beliefs, attitudes, and ideologies of the macrosystem. As Fig. 1 shows, improvement goals (indicated by the arrows moving from the current to a desired state) in the exo or macrosystem are unlikely to be achieved without associated improvement in the micro and mesosystem involving students, teachers, and groups of teachers, schools and their boards and parent communities. Similarly, the level of improvement in the macro and exosystems is limited by the extent to which more improvement goals at the micro and mesosystem are achieved through solving problems relating to students’ experience and school and classroom practices including curriculum, teaching, and assessment. As well as drawing on Bronfenbrenner’s ecological systems theory, our nested model of problem solving draws on problem solving theory to draw attention to how gaps between current and desired states at each of the system levels also influence each other (Newell & Simon, 1972 ). Efforts to solve problems in any one system (to move from current state toward a more desired state) are supported by similar moves at other interrelated systems. For example, the success of a teacher seeking to solve a curriculum problem (demand from parents to focus on core knowledge in traditional learning domains, for example)—a problem related to the microsystem and mesosystem—will be influenced by how similar problems are recognised, attended to, and solved by those in the ministries, departments and agencies in the exosystem.

In considering the role of educational leaders in this nested model of problem solving, we take a capability perspective (Mumford et al., 2000 ) rather than a leadership style perspective (Bedell-Avers et al., 2008 ). School leaders (including those with formal and informal leadership positions) require particular capabilities if they are to enact ambitious policies and solve complex problems related to enhancing equity for marginalized and disadvantaged groups of students (Mavrogordato & White, 2020 ). Too often, micro and mesosystem problems remain unsolved which is problematic not only for those directly involved, but also for the resolution of the related exo and macrosystem problems. The ill-structured nature of the problems school leaders face, and the social nature of the problem-solving process, contribute to the ineffectiveness of leaders’ problem-solving efforts and the persistence of important microsystem and mesosystem problems in schools.

Ill-structured problems

The problems that leaders need to solve are typically ill-structured rather than clearly defined, complex rather that than straight-forward, and adaptive rather than routine challenges (Bedell-Avers et al., 2008 ; Heifetz et al., 2009 ; Leithwood & Stager, 1989 ; Leithwood & Steinbach, 1992 , 1995 ; Mumford & Connelly, 1991 ; Mumford et al., 2000 ; Zaccaro et al., 2000 ). As Mumford and Connelly explain, “even if their problems are not totally unprecedented, leaders are, […] likely to be grappling with unique problems for which there is no clear-cut predefined solution” (Mumford & Connelly, 1991 , p. 294). Most such problems are difficult to solve because they can be construed in various ways and lack clear criteria for what counts as a good solution. Mumford et al. ( 2000 ) highlight the particular difficulties in solving ill-structured problems with regard to accessing, evaluating and using relevant information:

Not only is it difficult in many organizational settings for leaders to say exactly what the problem is, it may not be clear exactly what information should be brought to bear on the problem. There is a plethora of available information in complex organizational systems, only some of which is relevant to the problem. Further, it may be difficult to obtain accurate, timely information and identify key diagnostic information. As a result, leaders must actively seek and carefully evaluate information bearing on potential problems and goal attainment. (p. 14)

Problems in schools are complex. Each single problem can comprise multiple educational dimensions (learners, learning, curriculum, teaching, assessment) as well as relational, organizational, psychological, social, cultural, and political dimensions. In response to a teaching problem, for example, a single right or wrong answer is almost never at play; there are typically countless possible ‘responses’ to the problem of how to teach effectively in any given situation.

Problem solving as socially situated

Educational leaders’ problem solving is typically social because multiple people are usually involved in defining, explaining, and solving any given problem (Mumford et al., 2000 ). When there are multiple parties invested in addressing a problem, they typically hold diverse perspectives on how to describe (frame, perceive, and communicate about problems), explain (identify causes which lead to the problem), and solve the problem. Argyris and Schön ( 1974 ) argue that effective leaders must manage the complexity of integrating multiple and diverse perspectives, not only because all parties need to be internally committed to solutions, but also because quality solutions rely on a wide range of perspectives and evidence. Somewhat paradoxically, while the multiple perspectives involved in social problem solving add to their inherent complexity, these perspectives are a resource for educational change, and for the development of more effective solutions (Argyris & Schön, 1974 ). The social nature of problem solving requires high trust so participants can provide relevant, accurate, and timely information (rather than distort or withhold it), recognize their interdependence, and avoid controlling others. In high trust relationships, as Zand’s early work in this field established, “there is less socially generated uncertainty and problems are solved more effectively” (Zand, 1972 , p. 238).

Leaders’ capabilities in problem solving

Leadership research has established the centrality of capability in problem solving to leadership effectiveness generally (Marcy & Mumford, 2010 ; Mumford et al., 2000 , 2007 ) and to educational leadership in particular. Leithwood and Stager ( 1989 ), for example, consider “administrator’s problem-solving processes as crucial to an understanding of why principals act as they do and why some principals are more effective than others” (p. 127). Similarly, Robinson ( 1995 , 2001 , 2010 ) positions the ability to solve complex problems as central to all other dimensions of effective educational leadership. Unsurprisingly, problem solving is often prominent in standards for school leaders/leadership and is included in tools for the assessment of school leadership (Goldring et al., 2009 ). Furthermore, its importance is heightened given the increasing demand and complexity in standards for teaching (Sinnema, Meyer & Aitken, 2016) and the trend toward leadership across networks of schools (Sinnema, Daly, Liou, & Rodway, 2020a ) and the added complexity of such problem solving where a system perspective is necessary.

Empirical research on leaders’ practice has revealed that there is a need for capability building in problem solving (Le Fevre et al., 2015 ; Robinson et al., 2020 ; Sinnema et al., 2013 ; Sinnema et al., 2016 ; Smith, 1997 ; Spillane et al., 2009 ; Timperley & Robinson, 1998 ; Zaccaro et al., 2000 ). Some studies have compared the capability of leaders with varying experience. For example, Leithwood and Stager ( 1989 ) noted differences in problem solving approaches between novice and expert principals when responding to problem scenarios, particularly when the scenarios described ill-structured problems. Principals classified as ‘experts’ were more likely to collect information rather than make assumptions, and perceived unstructured problems to be manageable, whereas typical principals found these problems stressful. Expert principals also consulted extensively to get relevant information and find ways to deal with constraints. In contrast, novice principals consulted less frequently and tended to see constraints as obstacles (Leithwood & Stager, 1989 ). Allison and Allison ( 1993 ) reported that while experienced principals were better than novices at developing abstract problem-solving goals, they were less interested in the detail of how they would pursue these goals. Similar differences were found in Spillane et al.’s ( 2009 ) work that found expert principals to be better at interpreting problems and reflecting on their own actions compared with aspiring principals. More recent work (Sinnema et al., 2021 ) highlights that educators perceptions of discussion quality is positively associated with both new learning for the educator (learning that influences their practice) and improved practice (practices that reach students)—the more robust and helpful educators report their professional discussion to be, the more likely they are to report improvement in their practice. This supports the demand for quality conversation in educational teams.

Solving problems related to teaching and learning that occur in the micro or mesosystem usually requires conversations that demand high levels of interpersonal skill. Skill development is important because leaders tend to have difficulty inquiring deeply into the viewpoints of others (Le Fevre & Robinson, 2015 ; Le Fevre et al., 2015 ; Robinson & Le Fevre, 2011 ). In a close analysis of 43 conversation transcripts, Le Fevre et al. ( 2015 ) showed that when leaders anticipated or encountered diverse views, they tended to ask leading or loaded rather than genuine questions. This pattern was explained by their judgmental thinking, and their desire to avoid negative emotion and stay in control of the conversation. In a related study of leaders’ conversations, a considerable difference was found between the way educational leaders described their problem before and during the conversation with those involved (Sinnema et al., 2013 ). Prior to the conversation, privately, they tended to describe their problem as more serious and more urgent than they did in the conversation they held later with the person concerned.

One of the reasons for the mismatch between their private descriptions and public disclosures was the judgmental framing of their beliefs about the other party’s intentions, attitudes, and/or motivations (Peeters & Robinson, 2015 ). If leaders are not willing or able to reframe such privately-held beliefs in a more respectful manner, they will avoid addressing problems through fear of provoking negative emotion, and neither party will be able to critique the reasoning that leads to the belief in question (Robinson et al., 2020 ). When that happens, beliefs based on faulty reasoning may prevail, problem solutions may be based only on that which is discussable, and the problem may persist.

A model of effective problem-solving conversations

We present below a normative model of effective problem-solving conversations (Fig. 2 ) in which testing the validity of relevant beliefs plays a central role. Leaders test their beliefs about a problem when they draw on a set of validity testing behaviors and enact those behaviors, through their inquiry and advocacy, in ways that are consistent with the three interpersonal values included in the model. The model proposes that these processes increase the effectiveness of social problem solving, with effectiveness understood as progressing the task of solving the problem while maintaining or improving the leader’s relationship with those involved. In formulating this model, we drew on the previously discussed research on problem solving and theories of interpersonal and organisational effectiveness.

Model of effective problem-solving conversations

The role of beliefs in problem solving

Beliefs are important in the context of problem solving because they shape decisions about what constitutes a problem and how it can be explained and resolved. Beliefs link the object of the belief (e.g., a teacher’s planning) to some attribute (e.g., copied from the internet). In the context of school problems these attributes are usually tightly linked to a negative evaluation of the object of the belief (Fishbein & Ajzen, 1975 ). Problem solving, therefore, requires explicit attention by leaders to the validity of the information on which their own and others’ beliefs are based. The model draws on the work of Mumford et al. ( 2000 ) by highlighting three types of beliefs that are central to how people solve problems—beliefs about whether and why a situation is problematic (we refer to these as problem description beliefs); beliefs about the precursors of the problem situation (we refer to these as problem explanation beliefs); and beliefs about strategies which could, would, or should improve the situation (we refer to these as problem solution beliefs). With regard to problem explanation beliefs, it is important that attention is not limited to surface level factors, but also encompasses consideration of deeper related issues in the broader social context and how they contribute to any given problem.

The role of values in problem-solving conversations

Figure 2 proposes that problem solving effectiveness is increased when leaders’ validity testing behaviors are consistent with three values—respecting the views of others, seeking to maximize validity of their own and others’ beliefs, and building internal commitment to decisions reached. The inclusion of these three values in the model means that our validity testing behaviors must be conceptualized and measured in ways that capture their interpersonal (respect and internal commitment) and epistemic (valid information) underpinnings. Without this conceptual underpinning, it is likely to be difficult to identify the validity testing behaviors that are associated with effectiveness. For example, the act of seeking agreement can be done in a coercive or a respectful manner, so it is important to define and measure this behavior in ways that distinguish between the two. How this and similar distinctions were accomplished is described in the subsequent section on the five validity testing behaviors.

The three values in Fig. 2 are based on the theories and practice of interpersonal and organizational effectiveness developed by Argyris and Schön ( 1974 , 1978 , 1996 ) and applied more recently in a range of educational leadership research contexts (Hannah et al., 2018 ; Patuawa et al., 2021 ; Sinnema et al., 2021a ). We have drawn on the work of Argyris and Schön because their theories explain the dilemma many leaders experience between the two components of problem solving effectiveness and indicate how that dilemma can be avoided or resolved.

Seeking to maximize the validity of information is important because leaders’ beliefs have powerful consequences for the lives and learning of teachers and students and can limit or support educational change efforts. Leaders who behave consistently with the validity of information value are truth seekers rather than truth claimers in that they are open-minded and thus more attentive to the information that disconfirms rather than confirms their beliefs. Rather than assuming the validity of their beliefs and trying to impose them on others, their stance is one of seeking to detect and correct errors in their own and others′ thinking (Robinson, 2017 ).

The value of respect is closely linked to the value of maximizing the validity of information. Leaders increase validity by listening carefully to the views of others, especially if those views differ from their own. Listening carefully requires the accordance of worth and respect, rather than private or public dismissal of views that diverge from or challenge one’s own. If leaders’ conversations are guided by the two values of valid information and respect, then the third value of fostering internal commitment is also likely to be present. Teachers become internally committed to courses of action when their concerns have been listened to and directly addressed as part of the problem-solving process.

The role of validity testing behaviors in problem solving

Figure 2 includes five behaviors designed to test the validity of the three types of belief involved in problem solving. They are: 1) disclosing beliefs; 2) providing grounds; 3) exploring difference; 4) examining logic; and 5) seeking agreement. These behaviors enable leaders to check the validity of their beliefs by engaging in open minded disclosure and discussion of their thinking. While these behaviors are most closely linked to the value of maximizing valid information, the values of respect and internal commitment are also involved in these behaviors. For example, it is respectful to honestly and clearly disclose one’s beliefs about a problem to the other person concerned (advocacy), and to do so in ways that make the grounds for the belief testable and open to revision. It is also respectful to combine advocacy of one’s own beliefs with inquiry into others’ reactions to those beliefs and with inquiry into their own beliefs. When leaders encounter doubts and disagreements, they build internal rather than external commitment by being open minded and genuinely interested in understanding the grounds for them (Spiegel, 2012 ). By listening to and responding directly to others’ concerns, they build internal commitment to the process and outcomes of the problem solving.

Advocacy and inquiry dimensions

Each of the five validity testing behaviors can take the form of a statement (advocacy) or a question (inquiry). A leader’s advocacy contributes to problem solving effectiveness when it communicates his or her beliefs and the grounds for them, in a manner that is consistent with the three values. Such disclosure enables others to understand and critically evaluate the leader’s thinking (Tompkins, 2013 ). Respectful inquiry is equally important, as it invites the other person into the conversation, builds the trust they need for frank disclosure of their views, and signals that diverse views are welcomed. Explicit inquiry for others’ views is particularly important when there is a power imbalance between the parties, and when silence suggests that some are reluctant to disclose their views. Across their careers, leaders tend to rely more heavily on advocating their own views than on genuinely inquiring into the views of others (Robinson & Le Fevre, 2011 ). It is the combination of advocacy and inquiry behaviors, that enables all parties to collaborate in formulating a more valid understanding of the nature of the problem and of how it may be solved.

The five validity testing behaviors

Disclosing beliefs is the first and most essential validity testing behavior because beliefs cannot be publicly tested, using the subsequent four behaviors, if they are not disclosed. This behavior includes leaders’ advocacy of their own beliefs and their inquiry into others’ beliefs, including reactions to their own beliefs (Peeters & Robinson, 2015 ; Robinson & Le Fevre, 2011 ).

Honest and respectful disclosure ensures that all the information that is believed to be relevant to the problem, including that which might trigger an emotional reaction, is shared and available for validity testing (Robinson & Le Fevre, 2011 ; Robinson et al., 2020 ; Tjosvold et al., 2005 ). Respectful disclosure has been linked with follower trust. The empirical work of Norman et al. ( 2010 ), for example, showed that leaders who disclose more, and are more transparent in their communication, instill higher levels of trust in those they work with.

Providing grounds , the second validity testing behavior, is concerned with leaders expressing their beliefs in a way that makes the reasoning that led to them testable (advocacy) and invites others to do the same (inquiry). When leaders clearly explain the grounds for their beliefs and invite the other party to critique their relevance or accuracy, the validity or otherwise of the belief becomes more apparent. Both advocacy and inquiry about the grounds for beliefs can lead to a strengthening, revision, or abandonment of the beliefs for either or both parties (Myran & Sutherland, 2016 ; Robinson & Le Fevre, 2011 ; Robinson et al., 2020 ).

Exploring difference is the third validity testing behavior. It is essential because two parties simply disclosing beliefs and the grounds for them is insufficient for arriving at a joint solution, particularly when such disclosure reveals that there are differences in beliefs about the accuracy and implications of the evidence or differences about the soundness of arguments. Exploring difference through advocacy is seen in such behaviors as identifying and signaling differing beliefs and evaluating contrary evidence that underpins those differing beliefs. An inquiry approach to exploring difference (Timperley & Parr, 2005 ) occurs when a leader inquires into the other party’s beliefs about difference, or their response to the leaders’ beliefs about difference.

Exploring differences in beliefs is key to increasing validity in problem solving efforts (Mumford et al., 2007 ; Robinson & Le Fevre, 2011 ; Tjosvold et al., 2005 ) because it can lead to more integrative solutions and enhance the commitment from both parties to work with each other in the future (Tjosvold et al., 2005 ). Leaders who are able to engage with diverse beliefs are more likely to detect and challenge any faulty reasoning and consequently improve solution development (Le Fevre & Robinson, 2015 ). In contrast, when leaders do not engage with different beliefs, either by not recognizing or by intentionally ignoring them, validity testing is more limited. Such disengagement may be the result of negative attributions about the other person, such as that they are resistant, stubborn, or lazy. Such attributions reduce opportunities for the rigorous public testing that is afforded by the exchange and critical examination of competing views.

Examining logic , the fourth validity testing behavior, highlights the importance of devising a solution that adequately addresses the nature of the problem at hand and its causes. To develop an effective solution both parties must be able to evaluate the logic that links problems to their assumed causes and solutions. This behavior is present when the leader suggests or critiques the relationship between possible causes of and solutions to the identified problem. In its inquiry form, the leader seeks such information from the other party. As Zaccaro et al. ( 2000 ) explain, good problem solvers have skills and expertise in selecting the information to attend to in their effort to “understand the parameters of problems and therefore the dimensions and characteristics of a likely solution” (p. 44–45). These characteristics may include solution timeframes, resource capacities, an emphasis on organizational versus personal goals, and navigation of the degree of risk allowed by the problem approach. Explicitly exploring beliefs is key to ensuring the logic linking problem causes and any proposed solution. Taking account of a potentially complex set of contributing factors when crafting logical solutions, and testing the validity of beliefs about them, is likely to support effective problem solving. This requires what Copland ( 2010 ) describes as a creative process with similarities to clinical reasoning in medicine, in which “the initial framing of the problem is fundamental to the development of a useful solution” (p. 587).

Seeking agreement , the fifth validity testing behavior, signals the importance of warranted agreement about problem beliefs. We use the term ‘warranted’ to make clear that the goal is not merely getting the other party to agree (either that something is a problem, that a particular cause is involved, or that particular actions should be carried out to solve it)—mere agreement is insufficient. Rather, the goal is for warranted agreement whereby both parties have explored and critiqued the beliefs (and their grounds) of the other party in ways that provide a strong basis for the agreement. Both parties must come to some form of agreement on beliefs because successful solution implementation occurs in a social context, in that it relies on the commitment of all parties to carry it out (Mumford et al., 2000 ; Robinson & Le Fevre, 2011 ; Tjosvold et al., 2005 ). Where full agreement does not occur, the parties must at least be clear about where agreement/disagreement lies and why.

Testing the validity of beliefs using these five behaviors, and underpinned by the values described earlier is, we argue, necessary if conversations are to lead to two types of improvement—progress on the task (i.e., solving the problem) and improving the relationship between those involved in the conversation (i.e., ensuring those relationship between the problem-solvers is intact and enhanced through the process). We draw attention here to those improvement purposes as distinct from those underpinning work in the educational leadership field that takes a neo-managerialist perspective. The rise of neo-managerialism is argued to redefine school management and leadership along managerial lines and hence contribute to schools that are inequitable, reductionist, and inauthentic (Thrupp & Willmott, 2003 ). School leaders, when impacted by neo-managerialism, need to be (and are seen as) “self-interested, opportunistic innovators and risk-takers who exploit information and situations to produce radical change.” In contrast, the model we propose rejects self-interest. Our model emphasizes on deep respect for the views of others and the relentless pursuit of genuine shared commitment to understanding and solving problems that impact on children and young people through collaborative engagement in joint problem solving. Rather than permitting leaders to exploit others, our model requires leaders to be adept at using both inquiry and advocacy together with listening to both progress the task (solving problems) and simultaneously enhance the relationship between those involved. We position this model of social problem solving effectiveness as a tool for addressing social justice concerns—it intentionally dismisses problem solving approaches that privilege organizational efficiency indicators and ignore the wellbeing of learners and issues of inequity, racism, bias, and social injustice within and beyond educational contexts.

Methodology

The following section outlines the purpose of the study, the participants, and the mixed methods approach to data collection and analysis.

Research purpose

Our prior qualitative research (Robinson et al., 2020 ) involving in-depth case studies of three educational leaders revealed problematic patterns in leaders’ approach to problem-solving conversations: little disclosure of causal beliefs, little public testing of beliefs that might trigger negative emotions, and agreement on solutions that were misaligned with causal beliefs. The present investigation sought to understand if a quantitative methodological approach would reveal similar patterns and examine the relationship between belief types and leaders’ use of validity testing behaviors. Thus, our overarching research question was: to what extent do leaders test the validity of their beliefs in conversations with those directly involved in the analysis and resolution of the problem? Our argument is that while new experiences might motivate change in beliefs (Bonner et al., 2020 ), new insights gained through testing the validity of beliefs is also imperative to change. The sub-questions were:

What is the relative frequency in the types of beliefs leaders hold about problems involving others?

To what extent do leaders employ validity testing behaviors in conversations about those problems?

Are there differential patterns in leaders’ validity testing of the different belief types?

Participants

The participants were 43 students in a graduate course on educational leadership in New Zealand who identified an important on the job problem that they intended to discuss with the person directly involved.

The mixed methods approach

The study took a mixed methods approach using a partially mixed sequential equal status design; (QUAL → QUAN) (Leech & Onwuegbuzie, 2009 ). The five stages of sourcing and analyzing data and making interpretations are summarised in Fig. 3 below and outlined in more detail in the following sections (with reference in brackets to the numbered phases in the figure). We describe the study as partially mixed because, as Leech & Onwuegbuzie, 2009 explain, in partially mixed methods “both the quantitative and qualitative elements are conducted either concurrently or sequentially in their entirety before being mixed at the data interpretation stage” (p. 267).

Overview of mixed methods approach

Stage 1: Qualitative data collection

Three data sources were used to reveal participants’ beliefs about the problem they were seeking to address. The first source was their response to nine open ended items in a questionnaire focused on a real problem the participant had attempted to address but that still required attention (1a). The items were about: the nature and history of the problem; its importance; their own and others’ contribution to it; the causes of the problem; and the approach to and effectiveness of prior attempts to resolve it.

The second source (1b) was the transcript of a real conversation (typically between 5 and 10 minutes duration) the leaders held with the other person involved in the problem, and the third was the leaders’ own annotations of their unspoken thoughts and feelings during the course of the conversation (1c). The transcription was placed in the right-hand column (RHC) of a split page with the annotations recorded at the appropriate place in the left-hand column (LHC). The LHC method was originally developed by Argyris and Schön ( 1974 ) as a way of examining discrepancies between people’s espoused and enacted interpersonal values. Referring to data about each leader’s behavior (as recorded in the transcript of the conversation) and their thoughts (as indicated in the LHC) was important since the model specifies validity testing behaviors that are motivated by the values of respect, valid information, and internal commitment. Since motives cannot be revealed by speech alone, we also needed access to the thoughts that drove their behavior, hence our use of the LHC data collection technique. This approach allowed us to respond to Leithwood and Stager’s ( 1989 ) criticism that much research on effective problem solving gives results that “reveal little or nothing about how actions were selected or created and treat the administrator’s mind as a ‘black box’” (p. 127).

Stage 2: Qualitative analysis

The three stages of qualitative analysis focused on identifying discrete beliefs in the three qualitative data sources, distilling those discrete beliefs into key beliefs, and identifying leaders’ use of validity testing behaviors.

Stage 2a: Analyzing types of beliefs about problems

For this stage, we developed and applied coding rules (see Table 1 ) for the identification of the three types of beliefs in the three sources described earlier—leaders’ questionnaire responses, conversation transcript (RHC), and unexpressed thoughts (LHC). We identified 903 discrete beliefs (utterances or thoughts) from the 43 transcripts, annotations, and questionnaires and recorded these on a spreadsheet (2a). While our model proposes that leaders’ inquiry will surface and test the beliefs of others, we quantify in this study only the leaders’ beliefs.

Stage 2b: Distilling discrete beliefs into key beliefs

Next, we distilled the 903 discrete beliefs into key beliefs (KBs) (2b). This was a complex process and involved multiple iterations across the research team to determine, check, and test the coding rules. The final set of rules for distilling key beliefs were:

Beliefs should be made more succinct in the key belief statement, and key words should be retained as much as possible

Judgment quality (i.e., negative or positive) of the belief needs to be retained in the key belief

Key beliefs should use overarching terms where possible

The meaning and the object of the belief need to stay constant in the key belief

When reducing overlap, the key idea of both beliefs need to be captured in the key beliefs

Distinctive beliefs need to be summarized on their own and not combined with other beliefs

The subject of the belief must be retained in the key belief—own belief versus restated belief of other

All belief statements must be accounted for in key beliefs

These rules were applied to the process of distilling multiple related beliefs into statements of key beliefs as illustrated by the example in the table below (Table 2 ).

Further examples of how the rules were applied are outlined in ' Appendix A '. The number of discrete beliefs for each leader ranged from 7 to 35, with an average of 21, and the number of key beliefs for each leader ranged between 4 and 14, with an average of eight key beliefs. Frequency counts were used to identify any patterns in the types of key beliefs which were held privately (not revealed in the conversation but signalled in the left hand column or questionnaire) or conveyed publicly (in conversation with the other party).

Stage 2c: Analyzing leaders’ use of validity testing behaviors

We then developed and applied coding rules for the five validity testing behaviors (VTB) outlined in our model (disclosing beliefs, providing grounds, exploring difference, examining logic, and seeking agreement). Separate rules were established for the inquiry and advocacy aspects of each VTB, generating ten coding rules in all (Table 3 ).

These rules, summarised in the table below, and outlined more fully in ' Appendix A ', encompassed inclusion and exclusion criteria for the advocacy and inquiry dimensions of each validity testing behavior. For example, the inclusion rule for the VTB of ‘Disclosing Beliefs’ required leaders to disclose their beliefs about the nature, and/or causes, and/or possible solutions to the problem, in ways that were consistent with the three values included in the model. The associated exclusion rule signalled that this criterion was not met if, for example, the leader asked a question in order to steer the other person toward their own views without having ever disclosed their own views, or if they distorted the urgency or seriousness of the problem related to what they had expressed privately. The exclusion rules also noted how thoughts expressed in the left hand column would exclude the verbal utterance from being treated as disclosure—for example if there were contradictions between the right hand (spoken) and left hand column (thoughts), or if the thoughts indicated that the disclosure had been distorted in order to minimise negative emotion.

The coding rules reflected the values of respect and internal commitment in addition to the valid information value that was foregrounded in the analysis. The emphasis on inquiry, for example (into others’ beliefs and/or responses to the beliefs already expressed by the leader), recognised that internal commitment would be impossible if the other party held contrary views that had not been disclosed and discussed. Similarly, the focus on leaders advocating their beliefs, grounds for those beliefs and views about the logic linking solutions to problem causes recognise that it is respectful to make those transparent to another party rather than impose a solution in the absence of such disclosure.

The coding rules were applied to all 43 transcripts and the qualitative analysis was carried out using NVivo 10. A random sample of 10% of the utterances coded to a VTB category was checked independently by two members of the research team following the initial analysis by a third member. Any discrepancies in the coding were resolved, and data were recoded if needed. Descriptive analyses then enabled us to compare the frequency of leaders’ use of the five validity testing behaviors.

Stage 3: Data transformation: From qualitative to quantitative data

We carried out transformation of our data set (Burke et al., 2004 ), from qualitative to quantitative, to allow us to carry out statistical analysis to answer our research questions. The databases that resulted from our data transformation, with text from the qualitative coding along with numeric codes, are detailed next. In database 1, key beliefs were all entered as cases with indications in adjacent columns as to the belief type category they related to, and the source/s of the belief (questionnaire, transcript or unspoken thoughts/feelings). A unique identifier was created for each key belief.

In database 2, each utterance identified as meeting the VTB coding rules were entered in column 1. The broader context of the utterance from the original transcript was then examined to establish the type of belief (description, explanation, or solution) the VTB was being applied to, with this recorded numerically alongside the VTB utterance itself. For example, the following utterance had been coded to indicate that it met the ‘providing grounds’ coding rule, and in this phase it was also coded to indicate that it was in relation to a ‘problem description’ belief type:

“I noticed on the feedback form that a number of students, if I’ve got the numbers right here, um, seven out of ten students in your class said that you don’t normally start the lesson with a ‘Do Now’ or a starter activity.” (case 21)

A third database listed all of the unique identifiers for each leader’s key beliefs (KB) in the first column. Subsequent columns were set up for each of the 10 validity testing codes (the five validity testing behaviors for both inquiry and advocacy). The NVivo coding for the VTBs was then examined, one piece of coding at a time, to identify which key belief the utterance was associated with. Each cell that intersected the appropriate key belief and VTB was increased by one as a VTB utterance was associated with a key belief. Our database included variables for both the frequency of each VTB (the number of instances the behavior was used) and a parallel version with just a dichotomous variable indicating the presence or absence or each VTB. The dichotomous variable was used for our subsequent analysis because multiple utterances indicating a certain validity testing behavior were not deemed to necessarily constitute better quality belief validity testing than one utterance.

Stage 4: Quantitative analysis

The first phase of quantitative analysis involved the calculation of frequency counts for the three belief types (4a). Next, frequencies were calculated for the five validity testing behaviors, and for those behaviors in relation to each belief type (4b).

The final and most complex stage of the quantitative analysis, stages 4c through 4f, involved looking for patterns across the two sets of data created through the prior analyses (belief type and validity testing behaviors) to investigate whether leaders might be more inclined to use certain validity testing behaviors in conjunction with a particular belief type.

Stage 4a: Analyzing for relationships between belief type and VTB

We investigated the relationship between belief type and VTB, first, for all key beliefs. Given initial findings about variability in the frequency of the VTBs, we chose not to use all five VTBs separately in our analysis, but rather the three categories of: 1) None (key beliefs that had no VTB applied to them); 2) VTB—Routine (the sum of VTBs 1 and 2; given those were much more prevalent than others in the case of both advocacy and inquiry); and 3) VTB—Robust (the sum of the VTBs 3, 4 and 5 given these were all much less prevalent than VTBs 1 and 2, again including both advocacy and/or inquiry). Cross tabs were prepared and a chi-square test of independence was performed on the data from all 331 key beliefs.

Stage 4b: Analyzing for relationships between belief type and VTB

Next, because more than half (54.7%, 181) of the 331 key beliefs were not tested by leaders using any one of the VTBs, we analyzed a sub-set of the database, selecting only those key beliefs where leaders had disclosed the belief (using advocacy and/or inquiry). The reason for this was to ensure that any relationships established statistically were not unduly influenced by the data collection procedure which limited the time for the conversation to 10 minutes, during which it would not be feasible to fully disclose and address all key beliefs held by the leader. For this subset we prepared cross tabs and carried out chi-square tests of independence for the 145 key beliefs that leaders had disclosed. We again investigated the relationship between key belief type and VTBs, this time using a VTB variable with two categories: 1) More routine only and 2) More routine and robust.

Stage 4c: Analyzing for relationships between belief type and advocacy/inquiry dimensions of validity testing

Next, we investigated the relationship between key belief type and the advocacy and inquiry dimensions of validity testing. This analysis was to provide insight into whether leaders might be more or less inclined to use certain VTBs for certain types of belief. Specifically, we compared the frequency of utterances about beliefs of all three types for the categories of 1) No advocacy or inquiry, 2) Advocacy only, 3) Inquiry only, and 4) Advocacy and inquiry (4e). Cross tabs were prepared, and a chi-square test of independence was performed on the data from all 331 key beliefs. Finally, we again worked with the subset of 145 key beliefs that had been disclosed, comparing the frequency of utterances coded to 1) Advocacy or inquiry only, or 2) Both advocacy and inquiry (4f).

Below, we highlight findings in relation to the research questions guiding our analysis about: the relative frequency in the types of beliefs leaders hold about problems involving others; the extent to which leaders employ validity testing behaviors in conversations about those problems; and differential patterns in leaders’ validity testing of the different belief types. We make our interpretations based on the statistical analysis and draw on insights from the qualitative analysis to illustrate those results.

Belief types

Leaders’ key beliefs about the problem were evenly distributed between the three belief types, suggesting that when they think about a problem, leaders think, though not necessarily in a systematic way, about the nature of, explanation for, and solutions to their problem (see Table 4 ). These numbers include beliefs that were communicated and also those recorded privately in the questionnaire or in writing on the conversation transcripts.

Patterns in validity testing

The majority of the 331 key beliefs (54.7%, 181) were not tested by leaders using any one of the VTBs, not even the behavior of disclosing the belief. Our analysis of the VTBs that leaders did use (see Table 5 ) shows the wide variation in frequency of use with some, arguably the more robust ones, hardly used at all.

The first pattern was more frequent disclosure of key beliefs than provision of the grounds for them. The lower levels of providing grounds is concerning because it has implications for the likelihood of those in the conversation subsequently reaching agreement and being able to develop solutions logically aligned to the problem (VTB4). The logical solution if it is the time that guided reading takes that is preventing a teacher doing ‘shared book reading’ (as Leader 20 believed to be the case) is quite different to the solution that is logical if in fact the reason is something different, for example uncertainty about how to go about ‘shared book reading’, lack of shared book resources, or a misunderstanding that school policy requires greater time on shared reading.

The second pattern was a tendency for leaders to advocate much more than they inquire— there was more than double the proportion of advocacy than inquiry overall and for some behaviors the difference between advocacy and inquiry was up to seven times greater. This suggests that leaders were more comfortable disclosing their own beliefs, providing the grounds for their own beliefs and expressing their own assumptions about agreement, and less comfortable in inquiring in ways that created space and invited the other person in the conversation to reveal their beliefs.

A third pattern revealed in this analysis was the difference in the ratio of inquiry to advocacy between VTB1 (disclosing beliefs)—a ratio of close to 1:2 and VTB2 (providing grounds)—a ratio of close to 1:7. Leaders are more likely to seek others’ reactions when they disclose their beliefs than when they give their grounds for those beliefs. This might suggest that leaders assume the validity of their own beliefs (and therefore do not see the need to inquire into grounds) or that they do not have the skills to share the grounds associated with the beliefs they hold.

Fourthly, there was an absence of attention to three of the VTBs outlined in our model—in only very few of the 329 validity testing utterances the 43 leaders used were they exploring difference (11 instances), examining logic (4 instances) or seeking agreement (22 instances). In Case 22, for example, the leader claimed that learning intentions should be displayed and understood by children and expressed concern that the teacher was not displaying them, and that her students thus did not understand the purpose of the activities they were doing. While the teacher signaled her disagreement with both of those claims—“I do learning intentions, it’s all in my modelling books I can show them to you if you want” and “I think the children know why they are learning what they are learning”—the fact that there were differences in their beliefs was not explicitly signaled, and the differences were not explored. The conversation went on, with each continuing to assume the accuracy of their own beliefs. They were unable to reach agreement on a solution to the problem because they had not established and explored the lack of agreement about the nature of the problem itself. We presume from these findings, and from our prior qualitative work in this field, that those VTBs are much more difficult, and therefore much less likely to be used than the behaviors of disclosing beliefs and providing grounds.

The relationship between belief type and validity testing behaviors

The relationship between belief type and category of validity testing behavior was significant ( Χ 2 (4) = 61.96, p < 0.001). It was notable that problem explanation beliefs were far less likely than problem description or problem solution beliefs to be subject to any validity testing (the validity of more than 80% of PEBs was not tested) and, when they were tested, it was typically with the more routine rather than robust VTBs (see Table 6 ).

Problem explanation beliefs were also most likely to not be tested at all; more than 80% of the problem explanation beliefs were not the focus of any validity testing. Further, problem description beliefs were less likely than problem solution beliefs to be the target of both routine and robust validity testing behaviors—12% of PDBs and 18% of PSBs were tested using both routine and robust VTBs.

Two important assumptions underpin the study reported here. The first is that problems of equity must be solved, not only in the macrosystem and exosystem, but also as they occur in the day to day practices of leaders and teachers in micro and mesosystems. The second is that conversations are the key practice in which problem solving occurs in the micro and mesosystems, and that is why we focused on conversation quality. We focused on validity testing as an indicator of quality by closely analyzing transcripts of conversations between 43 individual leaders and a teacher they were discussing problems with.

Our findings suggest a considerable gap between our normative model of effective problem solving conversations and the practices of our sample of leaders. While beliefs about what problems are, and proposed solutions to them are shared relatively often, rarely is attention given to beliefs about the causes of problems. Further, while leaders do seem to be able to disclose and provide grounds for their beliefs about problems, they do so less often for beliefs about problem cause than other belief types. In addition, the critical validity testing behaviors of exploring difference, examining logic, and seeking agreement are very rare. Learning how to test the validity of beliefs is, therefore, a relevant focus for educational leaders’ goals (Bendikson et al., 2020 ; Meyer et al., 2019 ; Sinnema & Robinson, 2012 ) as well as a means for achieving other goals.

The patterns we found are problematic from the point of view of problem solving in schools generally but are particularly problematic from the point of view of macrosystem problems relating to equity. In New Zealand, for example, the underachievement and attendance issues of Pasifika students is a macrosystem problem that has been the target of many attempts to address through a range of policies and initiatives. Those efforts include a Pasifika Education Plan (Ministry of Education, 2013 ) and a cultural competencies framework for teachers of Pasifika learners—‘Tapasa’ (Ministry of Education, 2018 ) At the level of the mesosystem, many schools have strategic plans and school-wide programmes for interactions seeking to address those issues.

Resolving such equity issues demands that macro and exosystem initiatives are also reflected in the interactions of educators—hence our investigation of leaders’ problem-solving conversations and attention to whether leaders have the skills required to solve problems in conversations that contribute to aspirations in the exo and macrosystem, include of excellence and equity in new and demanding national curricula (Sinnema et al., 2020a ; Sinnema, Stoll, 2020a ). An example of an exosystem framework—the competencies framework for teachers of Pacific students in New Zealand—is useful here. It requires that teachers “establish and maintain collaborative and respectful relationships and professional behaviors that enhance learning and wellbeing for Pasifika learners” (Ministry of Education, 2018 , p. 12). The success of this national framework is influenced by and also influences the success that leaders in school settings have at solving problems in the conversations they have about related micro and mesosystem problems.

To illustrate this point, we draw here on the example of one case from our sample that showed how problem-solving conversation capability is related to the success or otherwise of system level aspirations of this type. In the case of Leader 36, under-developed skill in problem solving talk likely stymied the success of the equity-focused system initiatives. Leader 36 had been alerted by the parents of a Pasifika student that their daughter “feels that she is being unfairly treated, picked on and being made to feel very uncomfortable in the teacher’s class.” In the conversation with Leader 36, the teacher described having established a good relationship with the student, but also having had a range of issues with her including that she was too talkative, that led the teacher to treat her in ways the teacher acknowledged could have made her feel picked on and consequently reluctant to come to school.

The teacher also told the leader that there were issues with uniform irregularities (which the teacher picked on) and general non conformity—“No, she doesn’t [conform]. She often comes with improper footwear, incorrect jacket, comes late to school, she puts make up on, there are quite a few things that aren’t going on correctly….”. The teacher suggested that the student was “drawing the wrong type of attention from me as a teacher, which has had a negative effect on her.” The teacher described to the leader a recent incident:

[The student] had come to class with her hair looking quite shabby so I quietly asked [the student] “Did you wake up late this morning?” and then she but I can’t remember, I made a comment like “it looks like you didn’t take too much interest in yourself.” To me, I thought there was nothing wrong with the comment as it did not happen publicly; it happened in class and I had walked up to her. Following that, [her] Mum sends another email about girls and image and [says] that I am picking on her again. I’m quite baffled as to what is happening here. (case 36)

This troubling example represented a critical discretionary moment. The pattern of belief validity testing identified through our analysis of this case (see Table 7 ), however, mirrors some of the patterns evident in the wider sample.

The leader, like the student’s parents, believed that the teacher had been offensive in her communication with the student and also that the relationship between the teacher and student would be negatively impacted as a result. These two problem description beliefs were disclosed by the leader during her conversation with the teacher. However, while her disclosure of her belief about the problem description involved both advocating the belief, and inquiring into the other’s perception of it, the provision of grounds for the belief involved advocacy only. She reported the basis of the concern (the email from the student’s parents about their daughter feeling unfairly treated, picked on, and uncomfortable in class) but did not explicitly inquire into the grounds. This may be explained in this case through the teacher offering her own account of the situation that matched the parent’s report. Leader 36 also disclosed in her conversation with the teacher, her problem solution key belief that they should hold a restorative meeting between the teacher, the student, and herself.

What Leader 36 did not disclose was her belief about the explanation for the problem—that the teacher did not adequately understand the student personally, or their culture. The problem explanation belief (KB4) that she did inquire into was one the teacher raised—suggesting that the student has “compliance issues” that led the teacher to respond negatively to the student’s communication style—and that the teacher agreed with. The leader did not use any of the more robust but important validity testing behaviors for any of the key beliefs they held, either about problem description, explanation or solutions. And most importantly, this conversation highlights how policies and initiatives developed by those in the macrosystem, aimed at addressing equity issues, can be thwarted through well-intentioned but ultimately unsuccessful efforts of educators as they operate in the micro and mesosystem in what we referred to earlier as a discretionary problem solving space. The teacher’s treatment of the Pasifika student in our example was in stark contrast to the respectful and strong relationships demanded by the exosystem policy, the framework for teachers of Pasifika students. Furthermore, while the leader recognized the problem, issues of culture were avoided—they were not skilled enough in disclosing and testing their beliefs in the course of the conversation to contribute to broader equity concerns. The skill gap resonates with the findings of much prior work in this field (Le Fevre et al., 2015 ; Robinson et al., 2020 ; Sinnema et al., 2013 ; Smith, 1997 ; Spillane et al., 2009 ; Timperley & Robinson, 1998 ; Zaccaro et al., 2000 ), and highlights the importance of leaders, and those working with them in leadership development efforts, to recognize the interactions between the eco-systems outlined in the nested model of problem solving detailed in Fig. 1 .

The reluctance of Leader 36 to disclose and discuss her belief that the teacher misunderstands the student and her culture is important given the wider research evidence about the nature of the beliefs teachers may hold about indigenous and minority learners. The expectations teachers hold for these groups are typically lower and more negative than for white students (Gay, 2005 ; Meissel et al., 2017 ). In evidence from the New Zealand context, Turner et al. ( 2015 ), for example, found expectations to differ according to ethnicity with higher expectations for Asian and European students than for Māori and Pasifika students, even when controlling for achievement, due to troubling teacher beliefs about students’ home backgrounds, motivations, and aspirations. These are just the kind of beliefs that leaders must be able to confront in conversations with their teachers.

We use this example to illustrate both the interrelatedness of problems across the ecosystem, and the urgency of leadership development intervention in this area. Our normative model of effective problem solving conversations (Fig. 2 ), we suggest, provides a useful framework for the design of educational leadership intervention in this area. It shows how validity testing behaviors should embody both advocacy and inquiry and be used to explore not only perceptions of problem descriptions and solutions, but also problem causes. In this way, we hope to offer insights into how the dilemma between trust and accountability (Ehren et al., 2020 ) might be solved through increased interpersonal effectiveness. The combination of inquiry with advocacy also marks this approach out from neo-liberal approaches that emphasize leaders staying in control and predominantly advocating authoritarian perspectives of educational leadership. The interpersonal effectiveness theory that we draw on (Argyris & Schön, 1974 ) positions such unilateral control as ineffective, arguing for a mutual learning alternative. The work of problem solving is, we argue, joint work, requiring shared commitment and control.

Our findings also call for more research explicitly designed to investigate linkages between the systems. Case studies are needed, of macro and exosystem inequity problems backward mapped to initiatives and interactions that occur in schools related to those problems and initiatives. Such research could capture the complex ways in which power plays out “in relation to structural inequalities (of class, disability, ethnicity, gender, nationality, race, sexuality, and so forth)” and in relation to “more shifting and fluid inequalities that play out at the symbolic and cultural levels (for example, in ways that construct who “has” potential)” (Burke & Whitty, 2018 , p. 274).

Leadership development in problem solving should be approached in ways that surface and test the validity of leaders’ beliefs, so that they similarly learn to surface and test others’ beliefs in their leadership work. That is important not only from a workforce development point of view, but also from a social justice point of view since leaders’ capabilities in this area are inextricably linked to the success of educational systems in tackling urgent equity concerns.

Allison, D., & Allison, P. (1993). Both ends of a telescope: Experience and expertise in principal problem solving. Educational Administration Quarterly, 29 (3), 302–322. https://doi.org/10.1177/0013161x93029003005

Article Google Scholar

Argyris, C., Schön, D. (1974). Theory in practice: Increasing professional effectiveness . Jossey-Bass.

Argyris, C., & Schön, D. (1978). Organizational learning: A theory of action perspective Addison-Wesley.

Argyris, C., & Schön, D. (1996). Organizational learning II: Theory, method and practice . Addison-Wesley.

Google Scholar

Ball, D. L. (2018). Just dreams and imperatives: the power of teaching in the struggle for public education . New York, NYC: Annual Meeting of the American Educational Research Association.

Bedell-Avers, E., Hunter, S., & Mumford, M. (2008). Conditions of problem-solving and the performance of charismatic, ideological, and pragmatic leaders: A comparative experimental study. The Leadership Quarterly, 19 , 89–106.

Bendikson, L., Broadwith, M., Zhu, T., & Meyer, F. (2020). Goal pursuit practices in high schools: hitting the target?. Journal of Educational Administration , 56 (6), 713–728. https://doi.org/10.1108/JEA-01-2020-0020

Bonner, S. M., Diehl, K., & Trachtman, R. (2020). Teacher belief and agency development in bringing change to scale. Journal of Educational Change, 21 (2), 363–384. https://doi.org/10.1007/s10833-019-09360-4

Bronfenbrenner, U. (1992). Ecological systems theory. In R. Vasta, Six theories of child development: Revised formulations and current issues. Jessica Kingsley Publishers

Bronfenbrenner, U. (1977). Toward an experimental ecology of human development. American Psychologist, 32 (7), 513–531.

Burke Johnson, R., & Onwuegbuzie, A. (2004). Mixed methods research; a research paradigm whose time has come. Educational Researcher, 33 (7), 14–26.

Burke, P. J., & Whitty, G. (2018). Equity issues in teaching and teacher education. Peabody Journal of Education, 93 (3), 272–284. https://doi.org/10.1080/0161956X.2018.1449800

Copland, F. (2010). Causes of tension in post-observation feedback in pre-service teacher training: An alternative view. Teaching and Teacher Education, 26 (3), 466–472. https://doi.org/10.1016/j.tate.2009.06.001

Ehren, M., Paterson, A., & Baxter, J. (2020). Accountability and Trust: Two sides of the same coin? Journal of Educational Change, 21 (1), 183–213. https://doi.org/10.1007/s10833-019-09352-4

Fishbein, M., & Ajzen, I. (1975). Belief An Introduction to Theory and Research. Attitude, Intention and Behavior . Addison-Wesley.

Gay, G. (2005). Politics of multicultural teacher education. Journal of Teacher Education, 56 (3), 221–228.

Goldring, E., Cravens, X., Murphy, J., Porter, A., Elliott, S., & Carson, B. (2009). The evaluation of principals: What and how do states and urban disrticts assess leadership? The Elementary School Journal, 110 (1), 19–36.

Hannah, D., Sinnema, C., & Robinson. V. (2018). Theory of action accounts of problem-solving: How a Japanese school communicates student incidents to parents. Management in Education, 33 (2), 62–69. https://doi.org/10.1177/0892020618783809 .

Heifetz, R., Grashow, A., & Linsky, M. (2009). The practice of adaptive leadership: Tools and tactics for changing your organization and the world . Harvard Business Press.

Le Fevre, D., & Robinson, V. M. J. (2015). The interpersonal challenges of instructional leadership: Principals’ effectiveness in conversations about performance issues. Educational Administration Quarterly, 51 (1), 58–95.

Le Fevre, D., Robinson, V. M. J., & Sinnema, C. (2015). Genuine inquiry: Widely espoused yet rarely enacted. Educational Management Administration & Leadership, 43 (6), 883–899.

Leech, N. L., & Onwuegbuzie, A. J. (2009). A typology of mixed methods research designs. Quality & Quantity, 43 (2), 265–275. https://doi.org/10.1007/s11135-007-9105-3

Leithwood, K., & Steinbach, R. (1995). Expert problem solving: Evidence from school and district leaders . State University of New York Press.

Leithwood, K., & Stager, M. (1989). Expertise in Principals’ Problem Solving. Educational Administration Quarterly, 25 (2), 126–161. https://doi.org/10.1177/0013161x89025002003

Leithwood, K., & Steinbach, R. (1992). Improving the problem solving expertise of school administrators. Education and Urban Society, 24 (3), 317–345.

Marcy, R., & Mumford, M. (2010). Leader cognition: Improving leader performance through causal analysis. The Leadership Quarterly, 21 (1), 1–19.

Mavrogordato, M., & White, R. (2020). Leveraging policy implementation for social justice: How school leaders shape educational opportunity when implementing policy for English learners. Educational Administration Quarterly, 56 (1), 3–45. https://doi.org/10.1177/0013161X18821364

Meissel, K., Meyer, F., Yao, E. S., & Rubie-Davies, C. (2017). Subjectivity of Teacher Judgments: Exploring student characteristics that influence teacher judgments of student ability. Teaching and Teacher Education, 65 , 48–60. https://doi.org/10.1016/j.tate.2017.02.021

Meyer, F., Sinnema, C., & Patuawa, J. (2019). Novice principals setting goals for school improvement in New Zealand. School Leadership & Management , 39 (2), 198−221. https://doi.org/10.1080/13632434.2018.1473358

Ministry of Education. (2013). Pasifika education plan 2013–2017 Retrieved 9 July from https://www.education.govt.nz/assets/Documents/Ministry/Strategies-and-policies/PEPImplementationPlan20132017V2.pdf

Ministry of Education. (2018). Tapasā cultural competencies framework for teachers of Pacific learners . Ministry of Education.

Mumford, M., & Connelly, M. (1991). Leaders as creators: Leaders performance and problem solving in ill-defined domains. Leadership Quarterly, 2 (4), 289–315.

Mumford, M., Friedrich, T., Caughron, J., & Byrne, C. (2007). Leader cognition in real-world settings: How do leaders think about crises? The Leadership Quarterly, 18 , 515–543. https://doi.org/10.1016/j.leaqua.2007.09.002

Mumford, M., Zaccaro, S., Harding, F., Jacobs, T., & Fleishman, E. (2000). Leadership skills for a changing world: Solving complex social problems. Leadership Quarterly, 11 (1), 11–35.

Myran, S., & Sutherland, I. (2016). Problem posing in leadership education: using case study to foster more effective problem solving. Journal of Cases in Educational Leadership, 19 (4), 57–71. https://doi.org/10.1177/1555458916664763

Newell, A., & Simon. (1972). Human problem solving . Prentice-Hall.

Norman, S., Avolio, B., & Luthans, B. (2010). The impact of positivity and transparency on trust in leaders and their perceived effectiveness. The Leadership Quarterly, 21 , 350–364.

Patuawa, J., Robinson, V., Sinnema, C., & Zhu, T. (2021). Addressing inequity and underachievement: Middle leaders’ effectiveness in problem solving. Leading and Managing , 27 (1), 51–78. https://doi.org/10.3316/informit.925220205986712

Peeters, A., & Robinson, V. M. J. (2015). A teacher educator learns how to learn from mistakes: Single and double-loop learning for facilitators of in-service teacher education. Studying Teacher Education, 11 (3), 213–227.

Robinson, V. M. J., Meyer, F., Le Fevre, D., & Sinnema, C. (2020). The Quality of Leaders’ Problem-Solving Conversations: truth-seeking or truth-claiming? Leadership and Policy in Schools , 1–22.

Robinson, V. M. J. (1993). Problem-based methodology: Research for the improvement of practice . Pergamon Press.

Robinson, V. M. J. (1995). Organisational learning as organisational problem-solving. Leading & Managing, 1 (1), 63–78.

Robinson, V. M. J. (2001). Organizational learning, organizational problem solving and models of mind. In K. Leithwood & P. Hallinger (Eds.), Second international handbook of educational leadership and administration. Kluwer Academic.

Robinson, V. M. J. (2010). From instructional leadership to leadership capabilities: Empirical findings and methodological challenges. Leadership and Policy in Schools, 9 (1), 1–26.

Robinson, V. M. J. (2017). Reduce change to increase improvement . Corwin Press.

Robinson, V. M. J., & Le Fevre, D. (2011). Principals’ capability in challenging conversations: The case of parental complaints. Journal of Educational Administration, 49 (3), 227–255. https://doi.org/10.1108/09578231111129046

Sinnema, C., Robinson, V. (2012). Goal setting in principal evaluation: Goal quality and predictors of achievement. Leadership and Policy in schools . 11 (2), 135–167, https://doi.org/10.1080/15700763.2011.629767

Sinnema, C., Le Fevre, D., Robinson, V. M. J., & Pope, D. (2013). When others’ performance just isn’t good enough: Educational leaders’ framing of concerns in private and public. Leadership and Policy in Schools, 12 (4), 301–336. https://doi.org/10.1080/15700763.2013.857419

Sinnema, C., Ludlow, L. H., & Robinson, V. M. J. (2016a). Educational leadership effectiveness: A rasch analysis. Journal of Educational Administration , 54 (3), 305–339. https://doi.org/10.1108/JEA-12-2014-0140

Sinnema, C., Meyer, F., & Aitken, G. (2016b). Capturing the complex, situated, and sctive nature of teaching through inquiry-oriented standards for teaching. Journal of Teacher Education , 68 (1), 9–27. https://doi.org/10.1177/0022487116668017

Sinnema, C., Daly, A. J., Liou, Y.-h Sinnema, C., Daly, A. J., Liou, Y.-H., & Rodway, J. (2020a). Exploring the communities of learning policy in New Zealand using social network analysis: A case study of leadership, expertise, and networks. International Journal of Educational Research , 99 , 101492. https://doi.org/10.1016/j.ijer.2019.10.002

Sinnema, C., & Stoll, L. (2020b). Learning for and realising curriculum aspirations through schools as learning organisations. European Journal of Education, 55 , 9–23. https://doi.org/10.1111/ejed.12381

Sinnema, C., Nieveen, N., & Priestley, M. (2020c). Successful futures, successful curriculum: What can Wales learn from international curriculum reforms? The Curriculum Journal . https://doi.org/10.1002/curj.17

Sinnema, C., Hannah, D., Finnerty, A., & Daly, A. J. (2021a). A theory of action account of within and across school collaboration: The role of relational trust in collaboration actions and impacts. Journal of Educational Change .

Sinnema, C., Hannah, D., Finnerty, A. et al. (2021b). A theory of action account of an across-school collaboration policy in practice. Journal of Educational Change . https://doi.org/10.1007/s10833-020-09408-w

Sinnema, C., Liou, Y.-H., Daly, A., Cann, R., & Rodway, J. (2021c). When seekers reap rewards and providers pay a price: The role of relationships and discussion in improving practice in a community of learning. Teaching and Teacher Education, 107 , 103474. https://doi.org/10.1016/j.tate.2021.103474

Smith, G. (1997). Managerial problem solving: A problem-centered approach. In C. E. Zsambok & G. Klein (Eds.), Naturalistic Decision Making (pp. 371–380). Lawrence Erlbaum Associates.

Spiegel, J. (2012). Open-mindedness and intellectual humility. School Field, 10 (1), 27–38. https://doi.org/10.1177/1477878512437472

Spillane, J., Weitz White, K., & Stephan, J. (2009). School principal expertise: Putting expert aspiring principal differences in problem solving to the test. Leadership and Policy in Schools, 8 , 128–151.

Teddlie, C., & Tashakkori, A. (2006). A general typology of research designs featuring mixed methods. Research in the Schools, 13 , 12–28.

Thrupp, M., & Willmott, R. (2003). Education management in managerialist times: Beyond the textual apologists . Open University Press.

Timperley, H., & Parr, J. M. (2005). Theory competition and the process of change. Journal of Educational Change, 6 (3), 227–251. https://doi.org/10.1007/s10833-005-5065-3

Timperley, H. S., & Robinson, V. M. J. (1998). Collegiality in schools: Its nature and implications for problem solving. Educational Administration Quarterly, 34 (1), 608–629. https://doi.org/10.1177/0013161X980341003

Tjosvold, D., Sun, H., & Wan, P. (2005). Effects of openness, problem solving, and blaming on learning: An experiment in China. The Journal of Social Psychology, 145 (6), 629–644. https://doi.org/10.3200/SOCP.145.6.629-644

Tompkins, T. (2013). Groupthink and the Ladder of Inference : Increasing Effective Decision Making. The Journal of Human Resource and Adult Learning , 8 (2), 84–90.

Turner, H., Rubie-Davies, C. M., & Webber, M. (2015). Teacher expectations, ethnicity and the achievement gap. New Zealand Journal of Educational Studies, 50 (1), 55–69. https://doi.org/10.1007/s40841-015-0004-1

Zaccaro, S., Mumford, M., Connelly, M., Marks, M., & Gilbert, J. (2000). Assessment of leader problem-solving capabilities. Leadership Quarterly, 11 (1), 37–64.

Zand, D. (1972). Trust and managerial problem solving. Administrative Science Quarterly, 17 , 229–239.

Download references

Author information

Authors and affiliations.

The Faculty of Education and Social Work, The University of Auckland, Auckland, New Zealand

Claire Sinnema, Frauke Meyer, Deidre Le Fevre, Hamish Chalmers & Viviane Robinson

You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Claire Sinnema .

Additional information

Publisher's note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

See Table 8 .

See Table 9 .

See Table 10 .

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ .

Reprints and permissions

About this article

Sinnema, C., Meyer, F., Le Fevre, D. et al. Educational leaders’ problem-solving for educational improvement: Belief validity testing in conversations. J Educ Change 24 , 133–181 (2023). https://doi.org/10.1007/s10833-021-09437-z

Download citation

Accepted : 29 August 2021

Published : 01 October 2021

Issue Date : June 2023

DOI : https://doi.org/10.1007/s10833-021-09437-z

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

Educational Change
Educational improvement
Problem solving
Problem-solving conversations
Educational leadership
Validity testing
Find a journal
Publish with us
Track your research

Share full article

Supported by

The Algebra Problem: How Middle School Math Became a National Flashpoint

Top students can benefit greatly by being offered the subject early. But many districts offer few Black and Latino eighth graders a chance to study it.

The arms of a student are seen leaning on a desk. One hand holds a pencil and works on algebra equations.

By Troy Closson

From suburbs in the Northeast to major cities on the West Coast, a surprising subject is prompting ballot measures, lawsuits and bitter fights among parents: algebra.

Students have been required for decades to learn to solve for the variable x, and to find the slope of a line. Most complete the course in their first year of high school. But top-achievers are sometimes allowed to enroll earlier, typically in eighth grade.

The dual pathways inspire some of the most fiery debates over equity and academic opportunity in American education.

Do bias and inequality keep Black and Latino children off the fast track? Should middle schools eliminate algebra to level the playing field? What if standout pupils lose the chance to challenge themselves?

The questions are so fraught because algebra functions as a crucial crossroads in the education system. Students who fail it are far less likely to graduate. Those who take it early can take calculus by 12th grade, giving them a potential edge when applying to elite universities and lifting them toward society’s most high-status and lucrative professions.

But racial and economic gaps in math achievement are wide in the United States, and grew wider during the pandemic. In some states, nearly four in five poor children do not meet math standards.

To close those gaps, New York City’s previous mayor, Bill de Blasio, adopted a goal embraced by many districts elsewhere. Every middle school would offer algebra, and principals could opt to enroll all of their eighth graders in the class. San Francisco took an opposite approach: If some children could not reach algebra by middle school, no one would be allowed to take it.

The central mission in both cities was to help disadvantaged students. But solving the algebra dilemma can be more complex than solving the quadratic formula.

New York’s dream of “algebra for all” was never fully realized, and Mayor Eric Adams’s administration changed the goal to improving outcomes for ninth graders taking algebra. In San Francisco, dismantling middle-school algebra did little to end racial inequities among students in advanced math classes. After a huge public outcry, the district decided to reverse course.

“You wouldn’t think that there could be a more boring topic in the world,” said Thurston Domina, a professor at the University of North Carolina. “And yet, it’s this place of incredibly high passions.”

“Things run hot,” he said.

In some cities, disputes over algebra have been so intense that parents have sued school districts, protested outside mayors’ offices and campaigned for the ouster of school board members.

Teaching math in middle school is a challenge for educators in part because that is when the material becomes more complex, with students moving from multiplication tables to equations and abstract concepts. Students who have not mastered the basic skills can quickly become lost, and it can be difficult for them to catch up.

Many school districts have traditionally responded to divergent achievement levels by simply separating children into distinct pathways, placing some in general math classes while offering others algebra as an accelerated option. Such sorting, known as tracking, appeals to parents who want their children to reach advanced math as quickly as possible.

But tracking has cast an uncomfortable spotlight on inequality. Around a quarter of all students in the United States take algebra in middle school. But only about 12 percent of Black and Latino eighth graders do, compared with roughly 24 percent of white pupils, a federal report found .

“That’s why middle school math is this flashpoint,” said Joshua Goodman, an associate professor of education and economics at Boston University. “It’s the first moment where you potentially make it very obvious and explicit that there are knowledge gaps opening up.”

In the decades-long war over math, San Francisco has emerged as a prominent battleground.

California once required that all eighth graders take algebra. But lower-performing middle school students often struggle when forced to enroll in the class, research shows. San Francisco later stopped offering the class in eighth grade. But the ban did little to close achievement gaps in more advanced math classes, recent research has found.

As the pendulum swung, the only constant was anger. Leading Bay Area academics disparaged one another’s research . A group of parents even sued the district last spring. “Denying students the opportunity to skip ahead in math when their intellectual ability clearly allows for it greatly harms their potential for future achievement,” their lawsuit said.

The city is now back to where it began: Middle school algebra — for some, not necessarily for all — will return in August. The experience underscored how every approach carries risks.

“Schools really don’t know what to do,” said Jon R. Star, an educational psychologist at Harvard who has studied algebra education. “And it’s just leading to a lot of tension.”

In Cambridge, Mass., the school district phased out middle school algebra before the pandemic. But some argued that the move had backfired: Families who could afford to simply paid for their children to take accelerated math outside of school.

“It’s the worst of all possible worlds for equity,” Jacob Barandes, a Cambridge parent, said at a school board meeting.

Elsewhere, many students lack options to take the class early: One of Philadelphia’s most prestigious high schools requires students to pass algebra before enrolling, preventing many low-income children from applying because they attend middle schools that do not offer the class.

In New York, Mr. de Blasio sought to tackle the disparities when he announced a plan in 2015 to offer algebra — but not require it — in all of the city’s middle schools. More than 15,000 eighth graders did not have the class at their schools at the time.

Since then, the number of middle schools that offer algebra has risen to about 80 percent from 60 percent. But white and Asian American students still pass state algebra tests at higher rates than their peers.

The city’s current schools chancellor, David Banks, also shifted the system’s algebra focus to high schools, requiring the same ninth-grade curriculum at many schools in a move that has won both support and backlash from educators.

And some New York City families are still worried about middle school. A group of parent leaders in Manhattan recently asked the district to create more accelerated math options before high school, saying that many young students must seek out higher-level instruction outside the public school system.

In a vast district like New York — where some schools are filled with children from well-off families and others mainly educate homeless children — the challenge in math education can be that “incredible diversity,” said Pedro A. Noguera, the dean of the University of Southern California’s Rossier School of Education.

“You have some kids who are ready for algebra in fourth grade, and they should not be denied it,” Mr. Noguera said. “Others are still struggling with arithmetic in high school, and they need support.”

Many schools are unequipped to teach children with disparate math skills in a single classroom. Some educators lack the training they need to help students who have fallen behind, while also challenging those working at grade level or beyond.

Some schools have tried to find ways to tackle the issue on their own. KIPP charter schools in New York have added an additional half-hour of math time to many students’ schedules, to give children more time for practice and support so they can be ready for algebra by eighth grade.

At Middle School 50 in Brooklyn, where all eighth graders take algebra, teachers rewrote lesson plans for sixth- and seventh-grade students to lay the groundwork for the class.

The school’s principal, Ben Honoroff, said he expected that some students would have to retake the class in high school. But after starting a small algebra pilot program a few years ago, he came to believe that exposing children early could benefit everyone — as long as students came into it well prepared.

Looking around at the students who were not enrolling in the class, Mr. Honoroff said, “we asked, ‘Are there other kids that would excel in this?’”

“The answer was 100 percent, yes,” he added. “That was not something that I could live with.”

Troy Closson reports on K-12 schools in New York City for The Times. More about Troy Closson

Air Warfare
Cyber (Opens in new window)
C4ISR (Opens in new window)
Training & Sim
Asia Pacific
Mideast Africa
The Americas
Top 100 Companies
Defense News Weekly
Money Minute
Whitepapers & eBooks (Opens in new window)
DSDs & SMRs (Opens in new window)
Webcasts (Opens in new window)
Events (Opens in new window)
Newsletters (Opens in new window)
Events Calendar
Early Bird Brief
Digital Edition (Opens in new window)

Modern Day Marine

Marines say no more ‘death by powerpoint’ as corps overhauls education.

WASHINGTON, D.C. ― Marines and those who teach them will see more direct, problem-solving approaches to how they learn and far less “death by PowerPoint” as the Corps overhauls its education methods .

Decades of lecturers “foot stomping” material for Marines to learn, recall and regurgitate on a test before forgetting most of what they heard is being replaced by “outcomes-based” learning, a method that’s been in use in other fields but only recently brought into military training.

“Instead of teaching them what to think, we’re teaching them how to think,” said Col. Karl Arbogast, director of the policy and standards division at training and education command .

Here’s what’s in the Corps’ new training and education plan

New ranges, tougher swimming. inside the corps' new training blueprint..

Arbogast laid out some of the new methods that the command is using at the center for learning and faculty development while speaking at the Modern Day Marine Expo.

“No more death by PowerPoint,” Arbogast said. “No more ‘sage on the stage’ anymore, it’s the ‘guide on the side.’”

To do that, Lt. Col. Chris Devries, director of the learning and faculty center, is a multiyear process in which the Marines have developed two new military occupational specialties, 0951 and 0952.

The exceptional MOS is in addition to their primary MOS but allows the Marines to quickly identify who among their ranks is qualified to teach using the new methods.

Training for those jobs gives instructors, now called facilitators, an entry-level understanding of how to teach in an outcomes-based learning model.

Devries said the long-term goal is to create two more levels of instructor/facilitator that a Marine could return to in their career, a journeyman level and a master level. Those curricula are still under development.

The new method helps facilitators first learn the technology they’ll need to share material with and guide students. It also teaches them more formal assessment tools so they can gauge how well students are performing.

For the students, they can learn at their own pace. If they grasp the material the group is covering, they’re encouraged to advance in their study, rather than wait for the entire group to master the introductory material.

More responsibility is placed on the students. For example, in a land navigation class, a facilitator might share materials for students to review before class on their own and then immediately jump into working with maps, compasses and protractors on land navigation projects in the next class period, said John deForest, learning and development officer at the center.

That creates more time in the field for those Marines to practice the skills in a realistic setting.

Marines with Marine Medium Tiltrotor Squadron (VMM) 268, Marine Aircraft Group 24, 1st Marine Aircraft Wing, fire M240-B machine guns at the Marine Corps Air Station Kaneohe Bay range, Hawaii, March 5. (Lance Cpl. Tania Guerrero/Marine Corps)

For the infantry Marine course, the school split up the large classroom into squad-sized groups led by a sergeant or staff sergeant, allowing for more individual focus and participation among the students, Arbogast said.

“They have to now prepare activities for the learner to be directly involved in their own learning and then they have to steer and guide the learners correct outcome,” said Timothy Heck, director of the center’s West Coast detachment.

The students are creating products and portfolios of activities in their training instead of simply taking a written test, said Justina Kirkland, a facilitator at the West Coast detachment.

Students are also pushed to discuss problems among themselves and troubleshoot scenarios. The role of the facilitator then is to monitor the conversation and ask probing questions to redirect the group if they get off course, Heck said.

That involves more decision games, decision forcing cases and even wargaming, deForest said.

We “put the student in an active learning experience where they have to grapple with uncertainty, where they have to grapple with the technical skills and the knowledge they need,” deForest said.

That makes the learning more about application than recall, he said.

Todd South has written about crime, courts, government and the military for multiple publications since 2004 and was named a 2014 Pulitzer finalist for a co-written project on witness intimidation. Todd is a Marine veteran of the Iraq War.

More In Your Marine Corps

DIU sees new portfolio deepening ties between labs, commercial firms

The head of the new emerging tech portfolio said the goal is bring "diu flavor" to the s&t community..

National Reconnaissance Office launches proliferated constellation

The launch is the first of six planned for this year and is part of a broader nro effort to extend its satellite architecture across multiple orbits..

Space Force to hold annual Tactically Responsive Space demos

The space force aims to have an operational capability by 2026, but will maintain an annual demonstration cadence, according to lt. gen. phillip garrant..

Space Force to demonstrate satellite maneuvering in 2026 mission

Space systems command and spacewerx awarded washington-based starfish space $37.5 million to build and operate a satellite for the mission..

US departure from Niger ‘already underway’ ahead of September deadline

The future of america's counter-terrorism work in the country had been in doubt for months after a coup last summer., featured video, 'shadows in the jungle' | a new series on the vietnam war from military times beginning may 27.

He was shot in the hand, arm and chest but this Sgt. says that ‘doing the right thing is courage’

A historic battleship sails again, and a special ops demo | Defense News Weekly Full Episode 5.20.24

Webcast: Scaling up Data Collection and Interpretation

Trending now, russian forces may have seized first estonian ground robot in ukraine, lawmakers move to automate selective service registration for all men, replicator drones already being delivered, pentagon says, f-35 customers in asia-pacific monitor lockheed upgrade saga from afar, house advances $884 billion defense bill with enlisted troop pay raise.

IMAGES

Developing Problem-Solving Skills for Kids
Collaborative Problem-Solving Steps
Problem Solving Strategies for Education
A Problem-solving Style Can Be Described Using Dimensions of
Problem-Solving Strategies: Definition and 5 Techniques to Try
7 Steps to Improve Your Problem Solving Skills

VIDEO

problem solving approach in community health nursing 4th year
Problem Solving Approach
Problem Solving
Think:Moment: When and Where to Have Difficult Conversations
Think:Moment: Attention Seeking
Clarifying the '5 Whys' Problem-Solving Method #shorts #problemsolving

COMMENTS

Teaching Problem Solving
Make students articulate their problem solving process . In a one-on-one tutoring session, ask the student to work his/her problem out loud. This slows down the thinking process, making it more accurate and allowing you to access understanding. When working with larger groups you can ask students to provide a written "two-column solution.".
Problem-Based Learning
Problem-based learning (PBL) is a student-centered approach in which students learn about a subject by working in groups to solve an open-ended problem. ... Problem solving across disciplines. Considerations for Using Problem-Based Learning. Rather than teaching relevant material and subsequently having students apply the knowledge to solve ...
Why Every Educator Needs to Teach Problem-Solving Skills
Resolve Conflicts. In addition to increased social and emotional skills like self-efficacy and goal-setting, problem-solving skills teach students how to cooperate with others and work through disagreements and conflicts. Problem-solving promotes "thinking outside the box" and approaching a conflict by searching for different solutions.
Teaching Problem Solving
Problem solving is a necessary skill in all disciplines and one that the Sheridan Center is focusing on as part of the Brown Learning Collaborative, which provides students the opportunity to achieve new levels of excellence in six key skills traditionally honed in a liberal arts education - critical reading, writing, research, data ...
Teaching Problem-Solving Skills
Some common problem-solving strategies are: compute; simplify; use an equation; make a model, diagram, table, or chart; or work backwards. Choose the best strategy. Help students to choose the best strategy by reminding them again what they are required to find or calculate. Be patient.
Teaching problem solving: Let students get 'stuck' and 'unstuck'
October 31, 2017. 5 min read. This is the second in a six-part blog series on teaching 21st century skills, including problem solving , metacognition, critical thinking, and collaboration, in ...
Teaching problem solving
Strategies for teaching problem solving apply across disciplines and instructional contexts. First, introduce the problem and explain how people in your discipline generally make sense of the given information. Then, explain how to apply these approaches to solve the problem. Introducing the problem Explaining how people in your discipline understand and interpret these types of problems can ...
Problem-Based Learning (PBL)
PBL is a student-centered approach to learning that involves groups of students working to solve a real-world problem, quite different from the direct teaching method of a teacher presenting facts and concepts about a specific subject to a classroom of students. Through PBL, students not only strengthen their teamwork, communication, and ...
The effectiveness of collaborative problem solving in promoting
Regarding the results obtained, collaborative problem solving is an effective teaching approach to foster learners' critical thinking, with a significant overall effect size (ES = 0.82, z = 12. ...
Problem Solving in STEM
Problem Solving in STEM. Solving problems is a key component of many science, math, and engineering classes. If a goal of a class is for students to emerge with the ability to solve new kinds of problems or to use new problem-solving techniques, then students need numerous opportunities to develop the skills necessary to approach and answer ...
The process of implementing problem-based learning in a teacher
Using group discussions, the group members discussed issues related to the situation by presenting the problem and leading the whole class in analysing/discussing and summarising the problem and developing/organising the appropriate teaching approach. In this way, the teaching content developed gradually as a group effort.
Full article: Understanding and explaining pedagogical problem solving
1. Introduction. The focus of this paper is on understanding and explaining pedagogical problem solving. This theoretical paper builds on two previous studies (Riordan, Citation 2020; and Riordan, Hardman and Cumbers, Citation 2021) by introducing an 'extended Pedagogy Analysis Framework' and a 'Pedagogical Problem Typology' illustrating both with examples from video-based analysis of ...
Problem-Solving Method In Teaching
The problem-solving method is an effective teaching strategy that promotes critical thinking, creativity, and collaboration. It provides students with real-world problems that require them to apply their knowledge and skills to find solutions. By using the problem-solving method, teachers can help their students develop the skills they need to ...
Problem Solving in Mathematics Education
Singer et al. ( 2013) provides a broad view about problem posing that links problem posing experiences to general mathematics education; to the development of abilities, attitudes and creativity; and also to its interrelation with problem solving, and studies on when and how problem-solving sessions should take place.
PDF Problem Based Learning: A Student-Centered Approach
principles and concept. PBL is both a teaching method and approach to the curriculum. It can develop critical thinking skill, problem solving abilities, communication skills and lifelong learning. The purpose of this study is to give the general idea of PBL in the context of language learning, as PBL has expanded in the areas of law,
The Problem Solving Approach in Science Education
Integrating the problem-solving approach into science education requires careful planning and a shift in mindset. Teachers become facilitators rather than lecturers, guiding students through the process and providing support when needed. Classrooms become active learning environments where mistakes are seen as learning opportunities.
Teaching Mathematics Through Problem Solving
Teaching about problem solving begins with suggested strategies to solve a problem. For example, "draw a picture," "make a table," etc. You may see posters in teachers' classrooms of the "Problem Solving Method" such as: 1) Read the problem, 2) Devise a plan, 3) Solve the problem, and 4) Check your work. There is little or no ...
6 Tips for Teaching Math Problem-Solving Skills
Telling a student to reread the problem or to think about what tools or resources would help them solve it is a way to get them to try something new but not take over their thinking. These skills are also transferable across content, and students will be reminded, "Good readers and mathematicians reread.". 6.
Teaching: the problem-solving approach
Teaching: the problem-solving approach - UNESCO ... article
Educational leaders' problem-solving for educational improvement
Educational leaders' effectiveness in solving problems is vital to school and system-level efforts to address macrosystem problems of educational inequity and social injustice. Leaders' problem-solving conversation attempts are typically influenced by three types of beliefs—beliefs about the nature of the problem, about what causes it, and about how to solve it. Effective problem solving ...
Brian Holmes (1920-1993)
Holmes regarded the best method for comparative education to be the problem-solving method. By confounding individual norms with national norms, Holmes created a difficulty in his method, a difficulty that repeated reference to mental states was needed to overcome. Holmes emphasised the separation of individual norms and societal institutions ...
How to utilize problem-solving models in education
The MTSS problem-solving model is a data-driven decision-making process that helps educators utilize and analyze interventions based on students' needs on a continual basis. Traditionally, the MTSS problem-solving model only involves four steps: Identifying the student's strengths and needs, based on data.
What is Problem Solving? Steps, Process & Techniques
Finding a suitable solution for issues can be accomplished by following the basic four-step problem-solving process and methodology outlined below. Step. Characteristics. 1. Define the problem. Differentiate fact from opinion. Specify underlying causes. Consult each faction involved for information. State the problem specifically.
Exploring Behavioral and Strategic Factors Affecting Secondary Students
Despite the growing emphasis on integrating collaborative problem-solving (CPS) into science, technology, engineering, and mathematics (STEM) education, a comprehensive understanding of the critical factors that affect the effectiveness of this educational approach remains a challenge.
Modeling Using Multiple Connected Representations: An Approach to
Modeling and using multiple representations are regarded as useful methods for problem solving. However, models are usually demonstrated by teachers rather than actively constructed by students, and students find it hard to connect macro- and submicrorepresentations and comprehend the meaning conveyed by symbols. With the intention of coping with these issues, we propose the method of Modeling ...
Teaching Constant Rate-of-Change Problem-Solving to Secondary Students
Teaching Constant Rate-of-Change Problem-Solving to Secondary Students With or at Risk of Learning Disabilities ... Teaching rate of change to students with disabilities: A concrete-representational-abstract + writing approach. Learning Disability Quarterly, 44(1), 35-49 ... The International Journal on Mathematics Education, 51(4), 601-612 ...
Exploring the Predictive Potential of Complex Problem-Solving in ...
Programming is acknowledged widely as a cornerstone skill in Computer Science education. Despite significant efforts to refine teaching methodologies, a segment of students is still at risk of failing programming courses. It is crucial to identify potentially struggling students at risk of underperforming or academic failure. This study explores the predictive potential of students' problem ...
The Algebra Problem: How Middle School Math Became a National
Teaching math in middle school is a challenge for educators in part because that is when the material becomes more complex, with students moving from multiplication tables to equations and ...
Dr. Lankapalli Bullayya College of Engineering has recently entered
Dr. Lankapalli Bullayya College of Engineering has recently entered into a Memorandum of Understanding (MoU) with L&T EduTech, marking the commencement...
Marines say no more 'death by PowerPoint' as Corps overhauls education
WASHINGTON, D.C. ― Marines and those who teach them will see more direct, problem-solving approaches to how they learn and far less "death by PowerPoint" as the Corps overhauls its education ...

Center for Teaching

Tips and Techniques

Encourage Independence

Be sensitive

Encourage Thoroughness and Patience

Teaching Guides

Quick Links

Center for Teaching Innovation

Problem-Based Learning

Why Use Problem-Based Learning?

Considerations for Using Problem-Based Learning

Getting Started with Problem-Based Learning

Why Every Educator Needs to Teach Problem-Solving Skills

Want to learn more about how to measure and teach students’ higher-order skills, including problem solving, critical thinking, and written communication?

Problem-Solving Skills Help Students…

Set and Achieve Goals

Resolve Conflicts

Achieve Success

Problem-Solving Skills Can Be Measured and Taught

What Are Performance-Based Assessments?

Preview a Performance-Based Assessment

Performance-Based Assessments Help Students Build and Practice Problem-Solving Skills

Explore CAE’s Problem-Solving Assessments

Ready to Get Started?

Teaching Problem-Solving Skills

Principles for teaching problem solving

Woods’ problem-solving model

Think about it

Plan a solution

Carry out the plan

Catalog search

Teaching problem solving: Let students get ‘stuck’ and ‘unstuck’

Teaching problem solving

Introducing the problem

Working on solutions

Problem-Based Learning (PBL)

By working with PBL, students will:

How to Begin PBL

Designing Classroom Instruction

How to Orchestrate a PBL Activity

Teacher’s Role in PBL

The Role of the Students

Similar Posts

Definitions of The Addie Model

Gamification, What It Is, How It Works, Examples

Educational Technology: An Overview

Erikson’s Stages of Psychosocial Development

Planning for Educational Technology Integration

The effectiveness of collaborative problem solving in promoting students’ critical thinking: A meta-analysis based on empirical literature

Similar content being viewed by others

Testing theory of mind in large language models and humans

Impact of artificial intelligence on human loss in decision making, laziness and safety in education

Interviews in the social sciences

Data sources and search strategies

Eligibility criteria

Data coding design

Procedure for extracting and coding data

Publication bias test

Heterogeneity test

The analysis of the overall effect size

The analysis of moderator effect size

The effectiveness of collaborative problem solving with regard to teaching critical thinking

The moderating effects of collaborative problem solving with regard to teaching critical thinking

Suggestions for critical thinking teaching

Implications and limitations

Conclusions

Data availability

Acknowledgements

Author information

Corresponding authors

Ethics declarations

Ethical approval

Informed consent

Supplementary information

About this article

Share this article

This article is cited by

Exploring the effects of digital technology on deep learning: a meta-analysis

Quick links

GA4 Tracking Code