problem solving skills in research

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

• Advanced Search
• Journal List
• Elsevier - PMC COVID-19 Collection

Problem solving through values: A challenge for thinking and capability development

• • This paper introduces the 4W framework of consistent problem solving through values.
• • The 4W suggests when, how and why the explication of values helps to solve a problem.
• • The 4W is significant to teach students to cope with problems having crucial consequences.
• • The paper considers challenges using such framework of thinking in different fields of education.

The paper aims to introduce the conceptual framework of problem solving through values. The framework consists of problem analysis, selection of value(s) as a background for the solution, the search for alternative ways of the solution, and the rationale for the solution. This framework reveals when, how, and why is important to think about values when solving problems. A consistent process fosters cohesive and creative value-based thinking during problem solving rather than teaching specific values. Therefore, the framework discloses the possibility for enabling the development of value-grounded problem solving capability.The application of this framework highlights the importance of responsibility for the chosen values that are the basis for the alternatives which determine actions. The 4W framework is meaningful for the people’s lives and their professional work. It is particularly important in the process of future professionals’ education. Critical issues concerning the development of problem solving through values are discussed when considering and examining options for the implementation of the 4W framework in educational institutions.

1. Introduction

The core competencies necessary for future professionals include problem solving based on complexity and collaborative approaches ( OECD, 2018 ). Currently, the emphasis is put on the development of technical, technological skills as well as system thinking and other cognitive abilities (e.g., Barber, 2018 ; Blanco, Schirmbeck, & Costa, 2018 ). Hence, education prepares learners with high qualifications yet lacking in moral values ( Nadda, 2017 ). Educational researchers (e.g., Barnett, 2007 ; Harland & Pickering, 2010 ) stress that such skills and abilities ( the how? ), as well as knowledge ( the what? ), are insufficient to educate a person for society and the world. The philosophy of education underlines both the epistemological and ontological dimensions of learning. Barnett (2007) points out that the ontological dimension has to be above the epistemological one. The ontological dimension encompasses the issues related to values that education should foster ( Harland & Pickering, 2010 ). In addition, values are closely related to the enablement of learners in educational environments ( Jucevičienė et al., 2010 ). For these reasons, ‘ the why ?’ based on values is required in the learning process. The question arises as to what values and how it makes sense to educate them. Value-based education seeks to address these issues and concentrates on values transfer due to their integration into the curriculum. Yazdani and Akbarilakeh (2017) discussed that value-based education could only convey factual knowledge of values and ethics. However, such education does not guarantee the internalization of values. Nevertheless, value-based education indicates problem solving as one of the possibilities to develop values.

Values guide and affect personal behavior encompassing the ethical aspects of solutions ( Roccas, Sagiv, & Navon, 2017 ; Schwartz, 1992 , 2012 ; Verplanken & Holland, 2002 ). Therefore, they represent the essential foundation for solving a problem. Growing evidence indicates the creative potential of values ( Dollinger, Burke, & Gump, 2007 ; Kasof, Chen, Himsel, & Greenberger, 2007 ; Lebedeva et al., 2019) and emphasizes their significance for problem solving. Meanwhile, research in problem solving pays little attention to values. Most of the problem solving models (e.g., Newell & Simon, 1972 ; Jonassen, 1997 ) utilize a rational economic approach. Principally, the research on the mechanisms of problem solving have been conducted under laboratory conditions performing simple tasks ( Csapó & Funke, 2017 ). Moreover, some of the decision-making models share the same steps as problem solving (c.f., Donovan, Guss, & Naslund, 2015 ). This explains why these terms are sometimes used interchangeably ( Huitt, 1992 ). Indeed, decision-making is a part of problem solving, which emerges while choosing between alternatives. Yet, values, moral, and ethical issues are more common in decision-making research (e.g., Keeney, 1994 ; Verplanken & Holland, 2002 ; Hall & Davis, 2007 ; Sheehan & Schmidt, 2015 ). Though, research by Shepherd, Patzelt, and Baron (2013) , Baron, Zhao, and Miao (2015) has affirmed that contemporary business decision makers rather often leave aside ethical issues and moral values. Thus, ‘ethical disengagement fallacy’ ( Sternberg, 2017, p.7 ) occurs as people think that ethics is more relevant to others. In the face of such disengagement, ethical issues lose their prominence.

The analysis of the literature revealed a wide field of problem solving research presenting a range of more theoretical insights rather empirical evidence. Despite this, to date, a comprehensive model that reveals how to solve problems emphasizing thinking about values is lacking. This underlines the relevance of the chosen topic, i.e. a challenge for thinking and for the development of capabilities addressing problems through values. To address this gap, the following issues need to be investigated: When, how, and why a problem solver should take into account values during problem solving? What challenges may occur for using such framework of thinking in different fields of education? Aiming this, the authors of the paper substantiated the conceptual framework of problem solving grounded in consistent thinking about values. The substantiation consists of several parts. First, different approaches to solving problems were examined. Second, searching to reveal the possibilities of values integration into problem solving, value-based approaches significant for problem solving were critically analyzed. Third, drawing on the effect of values when solving a problem and their creative potential, the authors of this paper claim that the identification of values and their choice for a solution need to be specified in the process of problem solving. As a synthesis of conclusions coming from the literature review and conceptual extensions regarding values, the authors of the paper created the coherent framework of problem solving through values (so called 4W).

The novelty of the 4W framework is exposed by several contributions. First, the clear design of overall problem solving process with attention on integrated thinking about values is used. Unlike in most models of problem solving, the first stage encompass the identification of a problem, an analysis of a context and the perspectives that influence the whole process, i.e. ‘What?’. The stage ‘What is the basis for a solution?’ focus on values identification and their choice. The stage ‘Ways how?’ encourages to create alternatives considering values. The stage ‘Why?’ represent justification of a chosen alternative according particular issues. Above-mentioned stages including specific steps are not found in any other model of problem solving. Second, even two key stages nurture thinking about values. The specificity of the 4W framework allows expecting its successful practical application. It may help to solve a problem more informed revealing when and how the explication of values helps to reach the desired value-based solution. The particular significance is that the 4W framework can be used to develop capabilities to solve problems through values. The challenges to use the 4W framework in education are discussed.

2. Methodology

To create the 4W framework, the integrative literature review was chosen. According to Snyder (2019) , this review is ‘useful when the purpose of the review is not to cover all articles ever published on the topic but rather to combine perspectives to create new theoretical models’ (p.334). The scope of this review focused on research disclosing problem solving process that paid attention on values. The following databases were used for relevant information search: EBSCO/Hostdatabases (ERIC, Education Source), Emerald, Google Scholar. The first step of this search was conducted using integrated keywords problem solving model , problem solving process, problem solving steps . These keywords were combined with the Boolean operator AND with the second keywords values approach, value-based . The inclusion criteria were used to identify research that: presents theoretical backgrounds and/or empirical evidences; performed within the last 5 years; within an educational context; availability of full text. The sources appropriate for this review was very limited in scope (N = 2).

We implemented the second search only with the same set of the integrated keywords. The inclusion criteria were the same except the date; this criterion was extended up to 10 years. This search presented 85 different sources. After reading the summaries, introductions and conclusions of the sources found, the sources that do not explicitly provide the process/models/steps of problem solving for teaching/learning purposes and eliminates values were excluded. Aiming to see a more accurate picture of the chosen topic, we selected secondary sources from these initial sources.

Several important issues were determined as well. First, most researchers ground their studies on existing problem solving models, however, not based on values. Second, some of them conducted empirical research in order to identify the process of studies participants’ problem solving. Therefore, we included sources without date restrictions trying to identify the principal sources that reveal the process/models/steps of problem solving. Third, decision-making is a part of problem solving process. Accordingly, we performed a search with the additional keywords decision-making AND values approach, value-based decision-making . We used such inclusion criteria: presents theoretical background and/or empirical evidence; no date restriction; within an educational context; availability of full text. These all searches resulted in a total of 16 (9 theoretical and 7 empirical) sources for inclusion. They were the main sources that contributed most fruitfully for the background. We used other sources for the justification the wholeness of the 4W framework. We present the principal results of the conducted literature review in the part ‘The background of the conceptual framework’.

3. The background of the conceptual framework

3.1. different approaches of how to solve a problem.

Researchers from different fields focus on problem solving. As a result, there still seems to be a lack of a conventional definition of problem solving. Regardless of some differences, there is an agreement that problem solving is a cognitive process and one of the meaningful and significant ways of learning ( Funke, 2014 ; Jonassen, 1997 ; Mayer & Wittrock, 2006 ). Differing in approaches to solving a problem, researchers ( Collins, Sibthorp, & Gookin, 2016 ; Jonassen, 1997 ; Litzinger et al., 2010 ; Mayer & Wittrock, 2006 ; O’Loughlin & McFadzean, 1999 ; ect.) present a variety of models that differ in the number of distinct steps. What is similar in these models is that they stress the procedural process of problem solving with the focus on the development of specific skills and competences.

For the sake of this paper, we have focused on those models of problem solving that clarify the process and draw attention to values, specifically, on Huitt (1992) , Basadur, Ellspermann, and Evans (1994) , and Morton (1997) . Integrating the creative approach to problem solving, Newell and Simon (1972) presents six phases: phase 1 - identifying the problem, phase 2 - understanding the problem, phase 3 - posing solutions, phase 4 - choosing solutions, phase 5 - implementing solutions, and phase 6 - final analysis. The weakness of this model is that these phases do not necessarily follow one another, and several can coincide. However, coping with simultaneously occurring phases could be a challenge, especially if these are, for instance, phases five and six. Certainly, it may be necessary to return to the previous phases for further analysis. According to Basadur et al. (1994) , problem solving consists of problem generation, problem formulation, problem solving, and solution implementation stages. Huitt (1992) distinguishes four stages in problem solving: input, processing, output, and review. Both Huitt (1992) and Basadur et al. (1994) four-stage models emphasize a sequential process of problem solving. Thus, problem solving includes four stages that are used in education. For example, problem-based learning employs such stages as introduction of the problem, problem analysis and learning issues, discovery and reporting, solution presentation and evaluation ( Chua, Tan, & Liu, 2016 ). Even PISA 2012 framework for problem solving composes four stages: exploring and understanding, representing and formulating, planning and executing, monitoring and reflecting ( OECD, 2013 ).

Drawing on various approaches to problem solving, it is possible to notice that although each stage is named differently, it is possible to reveal some general steps. These steps reflect the essential idea of problem solving: a search for the solution from the initial state to the desirable state. The identification of a problem and its contextual elements, the generation of alternatives to a problem solution, the evaluation of these alternatives according to specific criteria, the choice of an alternative for a solution, the implementation, and monitoring of the solution are the main proceeding steps in problem solving.

3.2. Value-based approaches relevant for problem solving

Huitt (1992) suggests that important values are among the criteria for the evaluation of alternatives and the effectiveness of a chosen solution. Basadur et al. (1994) point out to visible values in the problem formulation. Morton (1997) underlines that interests, investigation, prevention, and values of all types, which may influence the process, inspire every phase of problem solving. However, the aforementioned authors do not go deeper and do not seek to disclose the significance of values for problem solving.

Decision-making research shows more possibilities for problem solving and values integration. Sheehan and Schmidt (2015) model of ethical decision-making includes moral sensitivity, moral judgment, moral motivation, and moral action where values are presented in the component of moral motivation. Another useful approach concerned with values comes from decision-making in management. It is the concept of Value-Focused Thinking (VFT) proposed by Keeney (1994) . The author argues that the goals often are merely means of achieving results in traditional models of problem solving. Such models frequently do not help to identify logical links between the problem solving goals, values, and alternatives. Thus, according to Keeney (1994) , the decision-making starts with values as they are stated in the goals and objectives of decision-makers. VFT emphasizes the core values of decision-makers that are in a specific context as well as how to find a way to achieve them by using means-ends analysis. The weakness of VFT is its restriction to this means-ends analysis. According to Shin, Jonassen, and McGee (2003) , in searching for a solution, such analysis is weak as the problem solver focuses simply on removing inadequacies between the current state and the goal state. The strengths of this approach underline that values are included in the decision before alternatives are created. Besides, values help to find creative and meaningful alternatives and to assess them. Further, they include the forthcoming consequences of the decision. As VFT emphasizes the significant function of values and clarifies the possibilities of their integration into problem solving, we adapt this approach in the current paper.

3.3. The effect of values when solving a problem

In a broader sense, values provide a direction to a person’s life. Whereas the importance of values is relatively stable over time and across situations, Roccas et al. (2017) argue that values differ in their importance to a person. Verplanken and Holland (2002) investigated the relationship between values and choices or behavior. The research revealed that the activation of a value and the centrality of a value to the self, are the essential elements for value-guided behavior. The activation of values could happen in such cases: when values are the primary focus of attention; if the situation or the information a person is confronted with implies values; when the self is activated. The centrality of a particular value is ‘the degree to which an individual has incorporated this value as part of the self’ ( Verplanken & Holland, 2002, p.436 ). Thus, the perceived importance of values and attention to them determine value-guided behavior.

According to Argandoña (2003) , values can change due to external (changing values in the people around, in society, changes in situations, etc.) and internal (internalization by learning) factors affecting the person. The research by Hall and Davis (2007) indicates that the decision-makers’ applied value profile temporarily changed as they analyzed the issue from multiple perspectives and revealed the existence of a broader set of values. The study by Kirkman (2017) reveal that participants noticed the relevance of moral values to situations they encountered in various contexts.

Values are tightly related to personal integrity and identity and guide an individual’s perception, judgment, and behavior ( Halstead, 1996 ; Schwartz, 1992 ). Sheehan and Schmidt (2015) found that values influenced ethical decision-making of accounting study programme students when they uncovered their own values and grounded in them their individual codes of conduct for future jobs. Hence, the effect of values discloses by observing the problem solver’s decision-making. The latter observations could explain the abundance of ethics-laden research in decision-making rather than in problem solving.

Contemporary researchers emphasize the creative potential of values. Dollinger et al. (2007) , Kasof et al. (2007) , Lebedeva, Schwartz, Plucker, & Van De Vijver, 2019 present to some extent similar findings as they all used Schwartz Value Survey (respectively: Schwartz, 1992 ; ( Schwartz, 1994 ), Schwartz, 2012 ). These studies disclosed that such values as self-direction, stimulation and universalism foster creativity. Kasof et al. (2007) focused their research on identified motivation. Stressing that identified motivation is the only fully autonomous type of external motivation, authors define it as ‘the desire to commence an activity as a means to some end that one greatly values’ (p.106). While identified motivation toward specific values (italic in original) fosters the search for outcomes that express those specific values, this research demonstrated that it could also inhibit creative behavior. Thus, inhibition is necessary, especially in the case where reckless creativity could have painful consequences, for example, when an architect creates a beautiful staircase without a handrail. Consequently, creativity needs to be balanced.

Ultimately, values affect human beings’ lives as they express the motivational goals ( Schwartz, 1992 ). These motivational goals are the comprehensive criteria for a person’s choices when solving problems. Whereas some problem solving models only mention values as possible evaluation criteria, but they do not give any significant suggestions when and how the problem solver could think about the values coming to the understanding that his/her values direct the decision how to solve the problem. The authors of this paper claim that the identification of personal values and their choice for a solution need to be specified in the process of problem solving. This position is clearly reflected in humanistic philosophy and psychology ( Maslow, 2011 ; Rogers, 1995 ) that emphasize personal responsibility for discovering personal values through critical questioning, honest self-esteem, self-discovery, and open-mindedness in the constant pursuit of the truth in the path of individual life. However, fundamental (of humankind) and societal values should be taken into account. McLaughlin (1997) argues that a clear boundary between societal and personal values is difficult to set as they are intertwined due to their existence in complex cultural, social, and political contexts at a particular time. A person is related to time and context when choosing values. As a result, a person assumes existing values as implicit knowledge without as much as a consideration. This is particularly evident in the current consumer society.

Moreover, McLaughlin (1997) stresses that if a particular action should be tolerated and legitimated by society, it does not mean that this action is ultimately morally acceptable in all respects. Education has possibilities to reveal this. One such possibility is to turn to the capability approach ( Sen, 1990 ), which emphasizes what people are effectively able to do and to be. Capability, according to Sen (1990) , reflects a person’s freedom to choose between various ways of living, i.e., the focus is on the development of a person’s capability to choose the life he/she has a reason to value. According to Webster (2017) , ‘in order for people to value certain aspects of life, they need to appreciate the reasons and purposes – the whys – for certain valuing’ (italic in original; p.75). As values reflect and foster these whys, education should supplement the development of capability with attention to values ( Saito, 2003 ). In order to attain this possibility, a person has to be aware of and be able to understand two facets of values. Argandoña (2003) defines them as rationality and virtuality . Rationality refers to values as the ideal of conduct and involves the development of a person’s understanding of what values and why he/she should choose them when solving a problem. Virtuality approaches values as virtues and includes learning to enable a person to live according to his/her values. However, according to McLaughlin (1997) , some people may have specific values that are deep or self-evidently essential. These values are based on fundamental beliefs about the nature and purpose of the human being. Other values can be more or less superficial as they are based on giving priority to one or the other. Thus, virtuality highlights the depth of life harmonized to fundamentally rather than superficially laden values. These approaches inform the rationale for the framework of problem solving through values.

4. The 4W framework of problem solving through values

Similar to the above-presented stages of the problem solving processes, the introduced framework by the authors of this paper revisits them (see Fig. 1 ). The framework is titled 4W as its four stages respond to such questions: Analyzing the Problem: W hat ? → Choice of the value(s): W hat is the background for the solution? → Search for the alternative w ays of the solution: How ? → The rationale for problem solution: W hy is this alternative significant ? The stages of this framework cover seven steps that reveal the logical sequence of problem solving through values.

The 4 W framework: problem solving through values.

Though systematic problem solving models are criticized for being linear and inflexible (e.g., Treffinger & Isaksen, 2005 ), the authors of this paper assume a structural view of the problem solving process due to several reasons. First, the framework enables problem solvers to understand the thorough process of problem solving through values. Second, this framework reveals the depth of each stage and step. Third, problem solving through values encourages tackling problems that have crucial consequences. Only by understanding and mastering the coherence of how problems those require a value-based approach need to be addressed, a problem solver will be able to cope with them in the future. Finally, this framework aims at helping to recognize, to underline personal values, to solve problems through thinking about values, and to take responsibility for choices, even value-based. The feedback supports a direct interrelation between stages. It shapes a dynamic process of problem solving through values.

The first stage of problem solving through values - ‘ The analysis of the problem: What? ’- consists of three steps (see Fig. 1 ). The first step is ‘ Recognizing the problematic situation and naming the problem ’. This step is performed in the following sequence. First, the problem solver should perceive the problematic situation he/she faces in order to understand it. Dostál (2015) argues that the problematic situation has the potential to become the problem necessary to be addressed. Although each problem is limited by its context, not every problematic situation turns into a problem. This is related to the problem solver’s capability and the perception of reality: a person may not ‘see’ the problem if his/her capability to perceive it is not developed ( Dorst, 2006 ; Dostál, 2015 ). Second, after the problem solver recognizes the existence of the problematic situation, the problem solver has to identify the presence or absence of the problem itself, i.e. to name the problem. This is especially important in the case of the ill-structured problems since they cannot be directly visible to the problem solver ( Jonassen, 1997 ). Consequently, this step allows to determine whether the problem solver developed or has acquired the capability to perceive the problematic situation and the problem (naming the problem).

The second step is ‘ Analysing the context of the problem as a reason for its rise ’. At this step, the problem solver aims to analyse the context of the problem. The latter is one of the external issues, and it determines the solution ( Jonassen, 2011 ). However, if more attention is paid to the solution of the problem, it diverts attention from the context ( Fields, 2006 ). The problem solver has to take into account both the conveyed and implied contextual elements in the problematic situation ( Dostál, 2015 ). In other words, the problem solver has to examine it through his/her ‘contextual lenses’ ( Hester & MacG, 2017 , p.208). Thus, during this step the problem solver needs to identify the elements that shape the problem - reasons and circumstances that cause the problem, the factors that can be changed, and stakeholders that are involved in the problematic situation. Whereas the elements of the context mentioned above are within the problematic situation, the problem solver can control many of them. Such control can provide unique ways for a solution.

Although the problem solver tries to predict the undesirable results, some criteria remain underestimated. For that reason, it is necessary to highlight values underlying the various possible goals during the analysis ( Fields, 2006 ). According to Hester and MacG (2017) , values express one of the main features of the context and direct the attention of the problem solver to a given problematic situation. Hence, the problem solver should explore the value-based positions that emerge in the context of the problem.

The analysis of these contextual elements focus not only on a specific problematic situation but also on the problem that has emerged. This requires setting boundaries of attention for an in-depth understanding ( Fields, 2006 ; Hester & MacG, 2017 ). Such understanding influences several actions: (a) the recognition of inappropriate aspects of the problematic situation; (b) the emergence of paths in which identified aspects are expected to change. These actions ensure consistency and safeguard against distractions. Thus, the problem solver can now recognize and identify the factors that influence the problem although they are outside of the problematic situation. However, the problem solver possesses no control over them. With the help of such context analysis, the problem solver constructs a thorough understanding of the problem. Moreover, the problem solver becomes ready to look at the problem from different perspectives.

The third step is ‘ Perspectives emerging in the problem ’. Ims and Zsolnai (2009) argue that problem solving usually contains a ‘problematic search’. Such a search is a pragmatic activity as the problem itself induces it. Thus, the problem solver searches for a superficial solution. As a result, the focus is on control over the problem rather than a deeper understanding of the problem itself. The analysis of the problem, especially including value-based approaches, reveals the necessity to consider the problem from a variety of perspectives. Mitroff (2000) builds on Linstone (1989) ideas and claims that a sound foundation of both naming and solving any problem lays in such perspectives: the technical/scientific, the interpersonal/social, the existential, and the systemic (see Table 1 ).

The main characteristics of four perspectives for problem solving

Whereas all problems have significant aspects of each perspective, disregarding one or another may lead to the wrong way of solving the problem. While analysing all four perspectives is essential, this does not mean that they all are equally important. Therefore, it is necessary to justify why one or another perspective is more relevant and significant in a particular case. Such analysis, according to Linstone (1989) , ‘forces us to distinguish how we are looking from what we are looking at’ (p.312; italic in original). Hence, the problem solver broadens the understanding of various perspectives and develops the capability to see the bigger picture ( Hall & Davis, 2007 ).

The problem solver aims to identify and describe four perspectives that have emerged in the problem during this step. In order to identify perspectives, the problem solver search answers to the following questions. First, regarding the technical/scientific perspective: What technical/scientific reasons are brought out in the problem? How and to what extent do they influence a problem and its context? Second, regarding the interpersonal/social perspective: What is the impact of the problem on stakeholders? How does it influence their attitudes, living conditions, interests, needs? Third, regarding the existential perspective: How does the problem affect human feelings, experiences, perception, and/or discovery of meaning? Fourth, regarding the systemic perspective: What is the effect of the problem on the person → community → society → the world? Based on the analysis of this step, the problem solver obtains a comprehensive picture of the problem. The next stage is to choose the value(s) that will address the problem.

The second stage - ‘ The choice of value(s): What is the background for the solution?’ - includes the fourth and the fifth steps. The fourth step is ‘ The identification of value(s) as a base for the solution ’. During this step, the problem solver should activate his/her value(s) making it (them) explicit. In order to do this, the problem solver proceeds several sub-steps. First, the problem solver reflects taking into account the analysis done in previous steps. He/she raises up questions revealing values that lay in the background of this analysis: What values does this analyzed context allow me to notice? What values do different perspectives of the problem ‘offer’? Such questioning is important as values are deeply hidden ( Verplanken & Holland, 2002 ) and they form a bias, which restricts the development of the capability to see from various points of view ( Hall & Paradice, 2007 ). In the 4W framework, this bias is relatively eliminated due to the analysis of the context and exploration of the perspectives of a problem. As a result, the problem solver discovers distinct value-based positions and gets an opportunity to identify the ‘value uncaptured’ ( Yang, Evans, Vladimirova, & Rana, 2017, p.1796 ) within the problem analyzed. The problem solver observes that some values exist in the context (the second step) and the disclosed perspectives (the third step). Some of the identified values do not affect the current situation as they are not required, or their potential is not exploited. Thus, looking through various value-based lenses, the problem solver can identify and discover a congruence between the opportunities offered by the values in the problem’s context, disclosed perspectives and his/her value(s). Consequently, the problem solver decides what values he/she chooses as a basis for the desired solution. Since problems usually call for a list of values, it is important to find out their order of priority. Thus, the last sub-step requires the problem solver to choose between fundamentally and superficially laden values.

In some cases, the problem solver identifies that a set of values (more than one value) can lead to the desired solution. If a person chooses this multiple value-based position, two options emerge. The first option is concerned with the analysis of each value-based position separately (from the fifth to the seventh step). In the second option, a person has to uncover which of his/her chosen values are fundamentally laden and which are superficially chosen, considering the desired outcome in the current situation. Such clarification could act as a strategy where the path for the desired solution is possible going from superficially chosen value(s) to fundamentally laden one. When a basis for the solution is established, the problem solver formulates the goal for the desired solution.

The fifth step is ‘ The formulation of the goal for the solution ’. Problem solving highlights essential points that reveal the structure of a person’s goals; thus, a goal is the core element of problem solving ( Funke, 2014 ). Meantime, values reflect the motivational content of the goals ( Schwartz, 1992 ). The attention on the chosen value not only activates it, but also motivates the problem solver. The motivation directs the formulation of the goal. In such a way, values explicitly become a basis of the goal for the solution. Thus, this step involves the problem solver in formulating the goal for the solution as the desired outcome.

The way how to take into account value(s) when formulating the goal is the integration of value(s) chosen by the problem solver in the formulation of the goal ( Keeney, 1994 ). For this purpose the conjunction of a context for a solution (it is analyzed during the second step) and a direction of preference (the chosen value reveals it) serves for the formulation of the goal (that represents the desired solution). In other words, a value should be directly included into the formulation of the goal. The goal could lose value, if value is not included into the goal formulation and remains only in the context of the goal. Let’s take the actual example concerning COVID-19 situation. Naturally, many countries governments’ preference represents such value as human life (‘it is important of every individual’s life’). Thus, most likely the particular country government’s goal of solving the COVID situation could be to save the lifes of the country people. The named problem is a complex where the goal of its solution is also complex, although it sounds simple. However, if the goal as desired outcome is formulated without the chosen value, this value remains in the context and its meaning becomes tacit. In the case of above presented example - the goal could be formulated ‘to provide hospitals with the necessary equipment and facilities’. Such goal has the value ‘human’s life’ in the context, but eliminates the complexity of the problem that leads to a partial solution of the problem. Thus, this step from the problem solver requires caution when formulating the goal as the desired outcome. For this reason, maintaining value is very important when formulating the goal’s text. To avoid the loss of values and maintain their proposed direction, is necessary to take into account values again when creating alternatives.

The third stage - ‘ Search for the alternative ways for a solution: How? ’ - encompasses the sixth step, which is called ‘ Creation of value-based alternatives ’. Frequently problem solver invokes a traditional view of problem identification, generation of alternatives, and selection of criteria for evaluating findings. Keeney (1994) ; Ims and Zsolnai (2009) criticize this rational approach as it supports a search for a partial solution where an active search for alternatives is neglected. Moreover, a problematic situation, according to Perkins (2009) , can create the illusion of a fully framed problem with some apparent weighting and some variations of choices. In this case, essential and distinct alternatives to the solution frequently become unnoticeable. Therefore, Perkins (2009) suggest to replace the focus on the attempts to comprehend the problem itself. Thinking through the ‘value lenses’ offers such opportunities. The deep understanding of the problem leads to the search for the alternative ways of a solution.

Thus, the aim of this step is for the problem solver to reveal the possible alternative ways for searching a desired solution. Most people think they know how to create alternatives, but often without delving into the situation. First of all, the problem solver based on the reflection of (but not limited to) the analysis of the context and the perspectives of the problem generates a range of alternatives. Some of these alternatives represent anchored thinking as he/she accepts the assumptions implicit in generated alternatives and with too little focus on values.

The chosen value with the formulated goal indicates direction and encourages a broader and more creative search for a solution. Hence, the problem solver should consider some of the initial alternatives that could best support the achievement of the desired solution. Values are the principles for evaluating the desirability of any alternative or outcome ( Keeney, 1994 ). Thus, planned actions should reveal the desirable mode of conduct. After such consideration, he/she should draw up a plan setting out the actions required to implement each of considered alternatives.

Lastly, after a thorough examination of each considered alternative and a plan of its implementation, the problem solver chooses one of them. If the problem solver does not see an appropriate alternative, he/she develops new alternatives. However, the problem solver may notice (and usually does) that more than one alternative can help him/her to achieve the desired solution. In this case, he/she indicates which alternative is the main one and has to be implemented in the first place, and what other alternatives and in what sequence will contribute in searching for the desired solution.

The fourth stage - ‘ The rationale for the solution: Why ’ - leads to the seventh step: ‘ The justification of the chosen alternative ’. Keeney (1994) emphasizes the compatibility of alternatives in question with the values that guide the action. This underlines the importance of justifying the choices a person makes where the focus is on taking responsibility. According to Zsolnai (2008) , responsibility means a choice, i.e., the perceived responsibility essentially determines its choice. Responsible justification allows for discovering optimal balance when choosing between distinct value-based alternatives. It also refers to the alternative solution that best reflects responsibility in a particular value context, choice, and implementation.

At this stage, the problem solver revisits the chosen solution and revises it. The problem solver justifies his/her choice based on the following questions: Why did you choose this? Why is this alternative significant looking from the technical/scientific, the interpersonal/social, the existential, and the systemic perspectives? Could you take full responsibility for the implementation of this alternative? Why? How clearly do envisaged actions reflect the goal of the desired solution? Whatever interests and for what reasons do this alternative satisfies in principle? What else do you see in the chosen alternative?

As mentioned above, each person gives priority to one aspect or another. The problem solver has to provide solid arguments for the justification of the chosen alternative. The quality of arguments, according to Jonassen (2011) , should be judged based on the quality of the evidence supporting the chosen alternative and opposing arguments that can reject solutions. Besides, the pursuit of value-based goals reflects the interests of the individual or collective interests. Therefore, it becomes critical for the problem solver to justify the level of responsibility he/she takes in assessing the chosen alternative. Such a complex evaluation of the chosen alternative ensures the acceptance of an integral rather than unilateral solution, as ‘recognizing that, in the end, people benefit most when they act for the common good’ ( Sternberg, 2012, p.46 ).

5. Discussion

The constant emphasis on thinking about values as explicit reasoning in the 4W framework (especially from the choice of the value(s) to the rationale for problem solution) reflects the pursuit of virtues. Virtues form the features of the character that are related to the choice ( Argandoña, 2003 ; McLaughlin, 2005 ). Hence, the problem solver develops value-grounded problem solving capability as the virtuality instead of employing rationality for problem solving.

Argandoña (2003) suggests that, in order to make a sound valuation process of any action, extrinsic, transcendent, and intrinsic types of motives need to be considered. They cover the respective types of values. The 4W framework meets these requirements. An extrinsic motive as ‘attaining the anticipated or expected satisfaction’ ( Argandoña, 2003, p.17 ) is reflected in the formulation of the goal of the solution, the creation of alternatives and especially in the justification of the chosen alternative way when the problem solver revisits the external effect of his/her possible action. Transcendent motive as ‘generating certain effects in others’ ( Argandoña, 2003, p.17 ) is revealed within the analysis of the context, perspectives, and creating alternatives. When the learner considers the creation of alternatives and revisits the chosen alternative, he/she pays more attention to these motives. Two types of motives mentioned so far are closely related to an intrinsic motive that emphasizes learning development within the problem solver. These motives confirm that problem solving is, in fact, lifelong learning. In light of these findings, the 4W framework is concerned with some features of value internalization as it is ‘a psychological outcome of conscious mind reasoning about values’ ( Yazdani & Akbarilakeh, 2017, p.1 ).

The 4W framework is complicated enough in terms of learning. One issue is concerned with the educational environments ( Jucevičienė, 2008 ) required to enable the 4W framework. First, the learning paradigm, rather than direct instruction, lies at the foundation of such environments. Second, such educational environments include the following dimensions: (1) educational goal; (2) learning capacity of the learners; (3) educational content relevant to the educational goal: ways and means of communicating educational content as information presented in advance (they may be real, people among them, as well as virtual); (5) methods and means of developing educational content in the process of learners’ performance; (6) physical environment relevant to the educational goal and conditions of its implementation as well as different items in the environment; (7) individuals involved in the implementation of the educational goal.

Another issue is related to exercising this framework in practice. Despite being aware of the 4W framework, a person may still not want to practice problem solving through values, since most of the solutions are going to be complicated, or may even be painful. One idea worth looking into is to reveal the extent to which problem solving through values can become a habit of mind. Profound focus on personal values, context analysis, and highlighting various perspectives can involve changes in the problem solver’s habit of mind. The constant practice of problem solving through values could first become ‘the epistemic habit of mind’ ( Mezirow, 2009, p.93 ), which means a personal way of knowing things and how to use that knowledge. This echoes Kirkman (2017) findings. The developed capability to notice moral values in situations that students encountered changed some students’ habit of mind as ‘for having “ruined” things by making it impossible not to attend to values in such situations!’ (the feedback from one student; Kirkman, 2017, p.12 ). However, this is not enough, as only those problems that require a value-based approach are addressed. Inevitably, the problem solver eventually encounters the challenges of nurturing ‘the moral-ethical habit of mind’ ( Mezirow, 2009, p.93 ). In pursuance to develop such habits of mind, the curriculum should include the necessity of the practising of the 4W framework.

Thinking based on values when solving problems enables the problem solver to engage in thoughtful reflection in contrast to pragmatic and superficial thinking supported by the consumer society. Reflection begins from the first stage of the 4W framework. As personal values are the basis for the desired solution, the problem solver is also involved in self-reflection. The conscious and continuous reflection on himself/herself and the problematic situation reinforce each step of the 4W framework. Moreover, the fourth stage (‘The rationale for the solution: Why’) involves the problem solver in critical reflection as it concerned with justification of ‘the why , the reasons for and the consequences of what we do’ (italic, bold in original; Mezirow, 1990, p.8 ). Exercising the 4W framework in practice could foster reflective practice. Empirical evidence shows that reflective practice directly impacts knowledge, skills and may lead to changes in personal belief systems and world views ( Slade, Burnham, Catalana, & Waters, 2019 ). Thus, with the help of reflective practice it is possible to identify in more detail how and to what extent the 4W framework has been mastered, what knowledge gained, capabilities developed, how point of views changed, and what influence the change process.

Critical issues related to the development of problem solving through values need to be distinguished when considering and examining options for the implementation of the 4W framework at educational institutions. First, the question to what extent can the 4W framework be incorporated into various subjects needs to be answered. Researchers could focus on applying the 4W framework to specific subjects in the humanities and social sciences. The case is with STEM subjects. Though value issues of sustainable development and ecology are of great importance, in reality STEM teaching is often restricted to the development of knowledge and skills, leaving aside the thinking about values. The special task of the researchers is to help practitioners to apply the 4W framework in STEM subjects. Considering this, researchers could employ the concept of ‘dialogic space’ ( Wegerif, 2011, p.3 ) which places particular importance of dialogue in the process of education emphasizing both the voices of teachers and students, and materials. In addition, the dimensions of educational environments could be useful aligning the 4W framework with STEM subjects. As STEM teaching is more based on solving various special tasks and/or integrating problem-based learning, the 4W framework could be a meaningful tool through which content is mastered, skills are developed, knowledge is acquired by solving pre-prepared specific tasks. In this case, the 4W framework could act as a mean addressing values in STEM teaching.

Second is the question of how to enable the process of problem solving through values. In the current paper, the concept of enabling is understood as an integral component of the empowerment. Juceviciene et al. (2010) specify that at least two perspectives can be employed to explain empowerment : a) through the power of legitimacy (according to Freire, 1996 ); and b) through the perspective of conditions for the acquisition of the required knowledge, capabilities, and competence, i.e., enabling. In this paper the 4W framework does not entail the issue of legitimacy. This issue may occur, for example, when a teacher in economics is expected to provide students with subject knowledge only, rather than adding tasks that involve problem solving through values. Yet, the issue of legitimacy is often implicit. A widespread phenomenon exists that teaching is limited to certain periods that do not have enough time for problem solving through values. The issue of legitimacy as an organizational task that supports/or not the implementation of the 4W framework in any curriculum is a question that calls for further discussion.

Third (if not the first), the issue of an educator’s competence to apply such a framework needs to be addressed. In order for a teacher to be a successful enabler, he/she should have the necessary competence. This is related to the specific pedagogical knowledge and skills, which are highly dependent on the peculiarities of the subject being taught. Nowadays actualities are encouraging to pay attention to STEM subjects and their teacher training. For researchers and teacher training institutions, who will be interested in implementing the 4W framework in STEM subjects, it would be useful to draw attention to ‘a material-dialogic approach to pedagogy’ ( Hetherington & Wegerif, 2018, p.27 ). This approach creates the conditions for a deep learning of STEM subjects revealing additional opportunities for problem solving through values in teaching. Highlighting these opportunities is a task for further research.

In contrast to traditional problem solving models, the 4W framework is more concerned with educational purposes. The prescriptive approach to teaching ( Thorne, 1994 ) is applied to the 4W framework. This approach focuses on providing guidelines that enable students to make sound decisions by making explicit value judgements. The limitation is that the 4W framework is focused on thinking but not executing. It does not include the fifth stage, which would focus on the execution of the decision how to solve the problem. This stage may contain some deviation from the predefined process of the solution of the problem.

6. Conclusions

The current paper focuses on revealing the essence of the 4W framework, which is based on enabling the problem solver to draw attention to when, how, and why it is essential to think about values during the problem solving process from the perspective of it’s design. Accordingly, the 4W framework advocates the coherent approach when solving a problem by using a creative potential of values.

The 4W framework allows the problem solver to look through the lens of his/her values twice. The first time, while formulating the problem solving goal as the desired outcome. The second time is when the problem solver looks deeper into his/her values while exploring alternative ways to solve problems. The problem solver is encouraged to reason about, find, accept, reject, compare values, and become responsible for the consequences of the choices grounded on his/her values. Thus, the problem solver could benefit from the 4W framework especially when dealing with issues having crucial consequences.

An educational approach reveals that the 4W framework could enable the development of value-grounded problem solving capability. As problem solving encourages the development of higher-order thinking skills, the consistent inclusion of values enriches them.

The 4W framework requires the educational environments for its enablement. The enablement process of problem solving through values could be based on the perspective of conditions for the acquisition of the required knowledge and capability. Continuous practice of this framework not only encourages reflection, but can also contribute to the creation of the epistemic habit of mind. Applying the 4W framework to specific subjects in the humanities and social sciences might face less challenge than STEM ones. The issue of an educator’s competence to apply such a framework is highly important. The discussed issues present significant challenges for researchers and educators. Caring that the curriculum of different courses should foresee problem solving through values, both practicing and empirical research are necessary.

Declaration of interests

This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

Both authors have approved the final article.

• Argandoña A. Fostering values in organizations. Journal of Business Ethics. 2003; 45 (1–2):15–28. https://link.springer.com/content/pdf/10.1023/A:1024164210743.pdf [ Google Scholar ]
• Barber S. A truly “Transformative” MBA: Executive education for the fourth industrial revolution. Journal of Pedagogic Development. 2018; 8 (2):44–55. [ Google Scholar ]
• Barnett R. McGraw-Hill Education; UK): 2007. Will to learn: Being a student in an age of uncertainty. [ Google Scholar ]
• Baron R.A., Zhao H., Miao Q. Personal motives, moral disengagement, and unethical decisions by entrepreneurs: Cognitive mechanisms on the “slippery slope” Journal of Business Ethics. 2015; 128 (1):107–118. doi: 10.1007/s10551-014-2078-y. [ CrossRef ] [ Google Scholar ]
• Basadur M., Ellspermann S.J., Evans G.W. A new methodology for formulating ill-structured problems. Omega. 1994; 22 (6):627–645. doi: 10.1016/0305-0483(94)90053-1. [ CrossRef ] [ Google Scholar ]
• Blanco E., Schirmbeck F., Costa C. International Conference on Remote Engineering and Virtual Instrumentation . Springer; Cham: 2018. Vocational Education for the Industrial Revolution; pp. 649–658. [ Google Scholar ]
• Chua B.L., Tan O.S., Liu W.C. Journey into the problem-solving process: Cognitive functions in a PBL environment. Innovations in Education and Teaching International. 2016; 53 (2):191–202. doi: 10.1080/14703297.2014.961502. [ CrossRef ] [ Google Scholar ]
• Collins R.H., Sibthorp J., Gookin J. Developing ill-structured problem-solving skills through wilderness education. Journal of Experiential Education. 2016; 39 (2):179–195. doi: 10.1177/1053825916639611. [ CrossRef ] [ Google Scholar ]
• Csapó B., Funke J., editors. The nature of problem solving: Using research to inspire 21st century learning. OECD Publishing; 2017. The development and assessment of problem solving in 21st-century schools. (Chapter 1). [ CrossRef ] [ Google Scholar ]
• Dollinger S.J., Burke P.A., Gump N.W. Creativity and values. Creativity Research Journal. 2007; 19 (2-3):91–103. doi: 10.1080/10400410701395028. [ CrossRef ] [ Google Scholar ]
• Donovan S.J., Guss C.D., Naslund D. Improving dynamic decision making through training and self-reflection. Judgment and Decision Making. 2015; 10 (4):284–295. http://digitalcommons.unf.edu/apsy_facpub/2 [ Google Scholar ]
• Dorst K. Design problems and design paradoxes. Design Issues. 2006; 22 (3):4–17. doi: 10.1162/desi.2006.22.3.4. [ CrossRef ] [ Google Scholar ]
• Dostál J. Theory of problem solving. Procedia-Social and Behavioral Sciences. 2015; 174 :2798–2805. doi: 10.1016/j.sbspro.2015.01.970. [ CrossRef ] [ Google Scholar ]
• Fields A.M. Ill-structured problems and the reference consultation: The librarian’s role in developing student expertise. Reference Services Review. 2006; 34 (3):405–420. doi: 10.1108/00907320610701554. [ CrossRef ] [ Google Scholar ]
• Freire P. Continuum; New York: 1996. Pedagogy of the oppressed (revised) [ Google Scholar ]
• Funke J. Problem solving: What are the important questions?. Proceedings of the 36th Annual Conference of the Cognitive Science Society; Austin, TX: Cognitive Science Society; 2014. pp. 493–498. [ Google Scholar ]
• Hall D.J., Davis R.A. Engaging multiple perspectives: A value-based decision-making model. Decision Support Systems. 2007; 43 (4):1588–1604. doi: 10.1016/j.dss.2006.03.004. [ CrossRef ] [ Google Scholar ]
• Hall D.J., Paradice D. Investigating value-based decision bias and mediation: do you do as you think? Communications of the ACM. 2007; 50 (4):81–85. [ Google Scholar ]
• Halstead J.M. Values and values education in schools. In: Halstead J.M., Taylor M.J., editors. Values in education and education in values. The Falmer Press; London: 1996. pp. 3–14. [ Google Scholar ]
• Harland T., Pickering N. Routledge; 2010. Values in higher education teaching. [ Google Scholar ]
• Hester P.T., MacG K. Springer; New York: 2017. Systemic decision making: Fundamentals for addressing problems and messes. [ Google Scholar ]
• Hetherington L., Wegerif R. Developing a material-dialogic approach to pedagogy to guide science teacher education. Journal of Education for Teaching. 2018; 44 (1):27–43. doi: 10.1080/02607476.2018.1422611. [ CrossRef ] [ Google Scholar ]
• Huitt W. Problem solving and decision making: Consideration of individual differences using the Myers-Briggs type indicator. Journal of Psychological Type. 1992; 24 (1):33–44. [ Google Scholar ]
• Ims K.J., Zsolnai L. The future international manager. Palgrave Macmillan; London: 2009. Holistic problem solving; pp. 116–129. [ Google Scholar ]
• Jonassen D. Supporting problem solving in PBL. Interdisciplinary Journal of Problem-based Learning. 2011; 5 (2):95–119. doi: 10.7771/1541-5015.1256. [ CrossRef ] [ Google Scholar ]
• Jonassen D.H. Instructional design models for well-structured and III-structured problem-solving learning outcomes. Educational Technology Research and Development. 1997; 45 (1):65–94. doi: 10.1007/BF02299613. [ CrossRef ] [ Google Scholar ]
• Jucevičienė P. Educational and learning environments as a factor for socioeducational empowering of innovation. Socialiniai mokslai. 2008; 1 :58–70. [ Google Scholar ]
• Jucevičienė P., Gudaitytė D., Karenauskaitė V., Lipinskienė D., Stanikūnienė B., Tautkevičienė G. Technologija; Kaunas: 2010. Universiteto edukacinė galia: Atsakas XXI amžiaus iššūkiams [The educational power of university: the response to the challenges of the 21st century] [ Google Scholar ]
• Kasof J., Chen C., Himsel A., Greenberger E. Values and creativity. Creativity Research Journal. 2007; 19 (2–3):105–122. doi: 10.1080/10400410701397164. [ CrossRef ] [ Google Scholar ]
• Keeney R.L. Creativity in decision making with value-focused thinking. MIT Sloan Management Review. 1994; 35 (4):33–41. [ Google Scholar ]
• Kirkman R. Problem-based learning in engineering ethics courses. Interdisciplinary Journal of Problem-based Learning. 2017; 11 (1) doi: 10.7771/1541-5015.1610. [ CrossRef ] [ Google Scholar ]
• Lebedeva N., Schwartz S., Plucker J., Van De Vijver F. Domains of everyday creativity and personal values. Frontiers in Psychology. 2019; 9 :1–16. doi: 10.3389/fpsyg.2018.02681. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Linstone H.A. Multiple perspectives: Concept, applications, and user guidelines. Systems Practice. 1989; 2 (3):307–331. [ Google Scholar ]
• Litzinger T.A., Meter P.V., Firetto C.M., Passmore L.J., Masters C.B., Turns S.R.…Zappe S.E. A cognitive study of problem solving in statics. Journal of Engineering Education. 2010; 99 (4):337–353. [ Google Scholar ]
• Maslow A.H. Vaga; Vilnius: 2011. Būties psichologija. [Psychology of Being] [ Google Scholar ]
• Mayer R., Wittrock M. Problem solving. In: Alexander P., Winne P., editors. Handbook of educational psychology. Psychology Press; New York, NY: 2006. pp. 287–303. [ Google Scholar ]
• McLaughlin T. The educative importance of ethos. British Journal of Educational Studies. 2005; 53 (3):306–325. doi: 10.1111/j.1467-8527.2005.00297.x. [ CrossRef ] [ Google Scholar ]
• McLaughlin T.H. Technologija; Kaunas: 1997. Šiuolaikinė ugdymo filosofija: demokratiškumas, vertybės, įvairovė [Contemporary philosophy of education: democracy, values, diversity] [ Google Scholar ]
• Mezirow J. Jossey-Bass Publishers; San Francisco: 1990. Fostering critical reflection in adulthood; pp. 1–12. https://my.liberatedleaders.com.au/wp-content/uploads/2017/02/How-Critical-Reflection-triggers-Transformative-Learning-Mezirow.pdf [ Google Scholar ]
• Mezirow J. Contemporary theories of learning. Routledge; 2009. An overview on transformative learning; pp. 90–105. (Chapter 6) [ Google Scholar ]
• Mitroff I. Šviesa; Kaunas: 2000. Kaip neklysti šiais beprotiškais laikais: ar mokame spręsti esmines problemas. [How not to get lost in these crazy times: do we know how to solve essential problems] [ Google Scholar ]
• Morton L. Teaching creative problem solving: A paradigmatic approach. Cal. WL Rev. 1997; 34 :375. [ Google Scholar ]
• Nadda P. Need for value based education. International Education and Research Journal. 2017; 3 (2) http://ierj.in/journal/index.php/ierj/article/view/690/659 [ Google Scholar ]
• Newell A., Simon H.A. Prentice-Hall; Englewood Cliffs, NJ: 1972. Human problem solving. [ Google Scholar ]
• OECD . PISA, OECD Publishing; Paris: 2013. PISA 2012 assessment and analytical framework: Mathematics, reading, science, problem solving and financial literacy . https://www.oecd.org/pisa/pisaproducts/PISA%202012%20framework%20e-book_final.pdf [ Google Scholar ]
• OECD . PISA, OECD Publishing; 2018. PISA 2015 results in focus . https://www.oecd.org/pisa/pisa-2015-results-in-focus.pdf [ Google Scholar ]
• O’Loughlin A., McFadzean E. Toward a holistic theory of strategic problem solving. Team Performance Management: An International Journal. 1999; 5 (3):103–120. [ Google Scholar ]
• Perkins D.N. Decision making and its development. In: Callan E., Grotzer T., Kagan J., Nisbett R.E., Perkins D.N., Shulman L.S., editors. Education and a civil society: Teaching evidence-based decision making. American Academy of Arts and Sciences; Cambridge, MA: 2009. pp. 1–28. (Chapter 1) [ Google Scholar ]
• Roccas S., Sagiv L., Navon M. Values and behavior. Cham: Springer; 2017. Methodological issues in studying personal values; pp. 15–50. [ Google Scholar ]
• Rogers C.R. Houghton Mifflin Harcourt; Boston: 1995. On becoming a person: A therapist’s view of psychotherapy. [ Google Scholar ]
• Saito M. Amartya Sen’s capability approach to education: A critical exploration. Journal of Philosophy of Education. 2003; 37 (1):17–33. doi: 10.1111/1467-9752.3701002. [ CrossRef ] [ Google Scholar ]
• Schwartz S.H. Universals in the content and structure of values: Theoretical advances and empirical tests in 20 countries. In: Zanna M.P., editor. Vol. 25. Academic Press; 1992. pp. 1–65. (Advances in experimental social psychology). [ Google Scholar ]
• Schwartz S.H. Are there universal aspects in the structure and contents of human values? Journal of social issues. 1994; 50 (4):19–45. [ Google Scholar ]
• Schwartz S.H. An overview of the Schwartz theory of basic values. Online Readings in Psychology and Culture. 2012; 2 (1):1–20. doi: 10.9707/2307-0919.1116. [ CrossRef ] [ Google Scholar ]
• Sen A. Development as capability expansion. The community development reader. 1990:41–58. http://www.masterhdfs.org/masterHDFS/wp-content/uploads/2014/05/Sen-development.pdf [ Google Scholar ]
• Sheehan N.T., Schmidt J.A. Preparing accounting students for ethical decision making: Developing individual codes of conduct based on personal values. Journal of Accounting Education. 2015; 33 (3):183–197. doi: 10.1016/j.jaccedu.2015.06.001. [ CrossRef ] [ Google Scholar ]
• Shepherd D.A., Patzelt H., Baron R.A. “I care about nature, but…”: Disengaging values in assessing opportunities that cause harm. The Academy of Management Journal. 2013; 56 (5):1251–1273. doi: 10.5465/amj.2011.0776. [ CrossRef ] [ Google Scholar ]
• Shin N., Jonassen D.H., McGee S. Predictors of well‐structured and ill‐structured problem solving in an astronomy simulation. Journal of Research in Science Teaching. 2003; 40 (1):6–33. doi: 10.1002/tea.10058. [ CrossRef ] [ Google Scholar ]
• Slade M.L., Burnham T.J., Catalana S.M., Waters T. The impact of reflective practice on teacher candidates’ learning. International Journal for the Scholarship of Teaching and Learning. 2019; 13 (2):15. doi: 10.20429/ijsotl.2019.130215. [ CrossRef ] [ Google Scholar ]
• Snyder H. Literature review as a research methodology: An overview and guidelines. Journal of Business Research. 2019; 104 :333–339. doi: 10.1016/j.jbusres.2019.07.039. [ CrossRef ] [ Google Scholar ]
• Sternberg R. Teaching for ethical reasoning. International Journal of Educational Psychology. 2012; 1 (1):35–50. doi: 10.4471/ijep.2012.03. [ CrossRef ] [ Google Scholar ]
• Sternberg R. Speculations on the role of successful intelligence in solving contemporary world problems. Journal of Intelligence. 2017; 6 (1):4. doi: 10.3390/jintelligence6010004. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Thorne D.M. Environmental ethics in international business education: Descriptive and prescriptive dimensions. Journal of Teaching in International Business. 1994; 5 (1–2):109–122. doi: 10.1300/J066v05n01_08. [ CrossRef ] [ Google Scholar ]
• Treffinger D.J., Isaksen S.G. Creative problem solving: The history, development, and implications for gifted education and talent development. The Gifted Child Quarterly. 2005; 49 (4):342–353. doi: 10.1177/001698620504900407. [ CrossRef ] [ Google Scholar ]
• Verplanken B., Holland R.W. Motivated decision making: Effects of activation and self-centrality of values on choices and behavior. Journal of Personality and Social Psychology. 2002; 82 (3):434–447. doi: 10.1037/0022-3514.82.3.434. [ PubMed ] [ CrossRef ] [ Google Scholar ]
• Webster R.S. Re-enchanting education and spiritual wellbeing. Routledge; 2017. Being spiritually educated; pp. 73–85. [ Google Scholar ]
• Wegerif R. Towards a dialogic theory of how children learn to think. Thinking Skills and Creativity. 2011; 6 (3):179–190. doi: 10.1016/j.tsc.2011.08.002. [ CrossRef ] [ Google Scholar ]
• Yang M., Evans S., Vladimirova D., Rana P. Value uncaptured perspective for sustainable business model innovation. Journal of Cleaner Production. 2017; 140 :1794–1804. doi: 10.1016/j.jclepro.2016.07.102. [ CrossRef ] [ Google Scholar ]
• Yazdani S., Akbarilakeh M. The model of value-based curriculum for medicine and surgery education in Iran. Journal of Minimally Invasive Surgical Sciences. 2017; 6 (3) doi: 10.5812/minsurgery.14053. [ CrossRef ] [ Google Scholar ]
• Zsolnai L. Transaction Publishers; New Brunswick and London: 2008. Responsible decision making. [ Google Scholar ]

Problem Solving

• Reference work entry
• pp 2680–2683
• Cite this reference work entry

• David H. Jonassen 2 &
• Woei Hung 3  

1840 Accesses

11 Citations

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

• Available as PDF
• Read on any device
• Instant download
• Own it forever
• Available as EPUB and PDF
• Durable hardcover edition
• Dispatched in 3 to 5 business days
• Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Bransford, J., & Stein, B. S. (1984). The IDEAL problem solver: A guide for improving thinking, learning, and creativity . New York: WH Freeman.

Google Scholar  

Frensch, P. A., & Funke, J. (Eds.). (1995). Complex problem solving: The European perspective . Hillsdale: Erlbaum.

Gick, M. L., & Holyoak, K. J. (1983). Schema induction and analogical transfer. Cognitive Psychology, 15 , 1–38.

Article   Google Scholar  

Jonassen, D. H. (2010). Learning to solve problems: A handbook . New York: Routledge.

Jonassen, D. H., & Hung, W. (2008). All problems are not equal: Implications for PBL. Interdisciplinary Journal of Problem-Based Learning, 2 (2), 6–28.

Jonassen, D. H. (2000). Toward a design theory of problem solving. Educational Technology: Research & Development, 48 (4), 63–85.

Jonassen, D. H. (2011). Learning to solve problems: A handbook for designing problem-solving learning environments . New York: Routledge.

Klein, G. A. (1998). Sources of power: How people make decisions . Cambridge, MA: MIT Press.

Lehman, D., Lempert, R., & Nisbett, R. E. (1988). The effects of graduate training on reasoning: Formal discipline and thinking about everyday-life events. Educational Psychologist, 43 , 431–442.

Newell, A., & Simon, H. (1972). Human problem solving . Englewood Cliffs: Prentice Hall.

Rumelhart, D. E., & Norman, D. A. (1988). Representation in memory. In R. C. Atkinson, R. J. Herrnstein, G. Lindzey, & R. D. Luce (Eds.), Steven’s handbook of experimental psychology (Learning and cognition 2nd ed., Vol. 2, pp. 511–587). New York: Wiley.

Sinnott, J. D. (1989). Everyday problem solving: Theory and applications (pp. 72–99). New York: Praeger.

Wood, P. K. (1983). Inquiring systems and problem structures: Implications for cognitive development. Human Development, 26 , 249–265.

Download references

Author information

Authors and affiliations.

School of Information Science and Learning Technologies, University of Missouri, 221C Townsend Hall, 65211, Columbia, MO, USA

Dr. David H. Jonassen

College of Education and Human Development, University of North Dakota, 231 Centennial Drive, Stop 7189, 58202, Grand Forks, ND, USA

Dr. Woei Hung

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to David H. Jonassen .

Editor information

Editors and affiliations.

Faculty of Economics and Behavioral Sciences, Department of Education, University of Freiburg, 79085, Freiburg, Germany

Norbert M. Seel

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer Science+Business Media, LLC

About this entry

Cite this entry.

Jonassen, D.H., Hung, W. (2012). Problem Solving. In: Seel, N.M. (eds) Encyclopedia of the Sciences of Learning. Springer, Boston, MA. https://doi.org/10.1007/978-1-4419-1428-6_208

Download citation

DOI : https://doi.org/10.1007/978-1-4419-1428-6_208

Publisher Name : Springer, Boston, MA

Print ISBN : 978-1-4419-1427-9

Online ISBN : 978-1-4419-1428-6

eBook Packages : Humanities, Social Sciences and Law

Share this entry

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Publish with us

Policies and ethics

• Find a journal
• Track your research

• Open access
• Published: 05 February 2018

The role of problem solving ability on innovative behavior and opportunity recognition in university students

• Ji Young Kim 1 ,
• Dae Soo Choi 1 ,
• Chang-Soo Sung 1 &
• Joo Y. Park 2  

Journal of Open Innovation: Technology, Market, and Complexity volume  4 , Article number:  4 ( 2018 ) Cite this article

24k Accesses

30 Citations

1 Altmetric

Metrics details

Universities engage in entrepreneurship education to increase social value creation, through students’ new opportunities recognition. However, there are not enough of empirical researches on whether the current entrepreneurship education can be differentiated from other curriculum to improve the opportunity recognition process. This study argues that it is very important for cognitive abilities to be manifested as behavior when students in university are new opportunities recognition. For this purpose, the relationship between problem solving ability, innovation behavior, and opportunity perception was verified empirically. This study was conducted on 203 students who took entrepreneurship education courses at Korean universities. The results of this study showed that problem solving ability positively influenced innovation behavior and opportunity perception. Innovation behavior was identified as a key parameter that partially mediated the relationship between problem solving ability and innovation behavior. The implication of this study is to prove the relationship between individual ‘s problem - solving ability considering the characteristics of education in Korea and the opportunity through innovative behavior and various learning strategies to help entrepreneurship education to design better courses for the future It has important implications for strategic pedagogy that can enhance behavioral elements in development.

It is the new opportunity recognition that all firms focus on for a new economic paradigm (Ancona and Caldwell, 1992 ). Recognizing high opportunities can significantly improve profit, growth, and / or competitive positioning. And this new opportunity leads to innovation. From a conceptual point of view, research is continuing on the question of ‘what is opportunity’ and ‘where is opportunity’ (Gartner and Carter, 2003 ; Venkataraman & Sarasvathy, 2001 ). Research on the discovery and realization of new opportunities is a very important research area that suggests how to discover and utilize creative opportunities that create new value and profit for pre-service workers, and is the ultimate goal of entrepreneurship education. (Kim et al., 2016 ). Particularly, there is a lot of debate about the relationship between opportunity perception and personal characteristics. Despite many arguments, however, research on individual characteristics and opportunity perceptions is still insufficient, and a unified opinion has not been created due to differences between cognitive and behavioral theories (Ko & Butler, 2003 ). In particular, there is much controversy over the relationship between opportunity recognition and personal traits, and research has been continuing to demonstrate that organizational learning in organizations can influence opportunity recognition (Shane & Venkataraman, 2000 ). In particular, learning enhances cognitive ability, which is an opportunity that leads to opportunity recognition through the manifestation of behavior (Lumpkin and Dess, 2004 ). Many studies have also demonstrated the difference in behavior that successful entrepreneurs see as contributing to their ability to recognize opportunities and create innovative business ideas (Dyer et al., 2008 ; Kim et al., 2017 ). For example, Alvarez and Barney ( 2005 ) argue for mountain climbing and mountain building to understand the implications of entrepreneurial behavior in relation to these theories. In other words, a new opportunity for entrepreneurs is not a passive case that is generally found and climbed by climbers such as mountains, but rather by the actions of entrepreneurs, creating competition for the market, creating another market, Is the same. Therefore, in order for a person’s cognitive ability to recognize a new opportunity, it must focus on manifesting an action that can realize an innovative idea. In this regard, Kanter ( 1988 ) proved the relationship between new opportunity recognition and those with innovative tendencies and regarded this new opportunity recognition as innovation activity through organizational education. Scott and Bruce ( 1994 ) have integrated a number of research flows into innovation pioneers to develop and test individual innovative behavioral models. In particular, they argued that individual problem-solving styles are very important to induce innovative behavior. Although there are a number of studies on problem solving ability, innovation behavior, and new opportunities, most of the opportunistic researches have been conducted in organizational units of companies. Is still insufficient. Furthermore, unified opinions were not created due to differences between cognitive theory and behavioral theory (Ko & Butler, 2003 ). It is also true that the effects of entrepreneurship education in university have not been studied empirically because they are mainly focused on promoting cognitive ability and applied to various kinds of teaching methods.

This study argues that it is very important for cognitive abilities to be manifested as behavior that. “Through” courses, In other words, it is very important to induce students to act through ‘learning through process’ learning through behavioral learning by providing students with some (virtual or real) business to start doing some of the actions of the entrepreneur. When students in university are new opportunity recognition. Especially, entrepreneurship education, which ultimately focuses on whether it is a new opportunity, is very important to induce behavior through behavior learning beyond the cognitive ability as the general education curriculum. Particularly, innovative behaviors that create and realize innovative ideas are very important for new opportunity recognition (Paine & Organ, 2000 ).In order to achieve this, various kinds of teaching methods are being pursued in the university, but studies on the effectiveness of behavioral learning have not been studied yet. In this study, we are based on team-based learning among various teaching methods for behavior learning that leads to innovative behaviors. Team learning instructional activity sequence designed by Michaelsen and Sweet ( 2008 ), the most well known team-based learning in entrepreneurship education as in class-primarily group work and outside class-primarily individual work. In this way, we demonstrate empirically the relationship between individual problem solving ability and opportunity through innovative behavior, and develop a variety of learning strategies that help entrepreneurship education to design better courses for the future. I would like to point out some implications for strategic pedagogy to increase the element.

The paper proceeds as follows: Initially we present the theory of innovative behavior with individual problem-solving ability, innovative behavior and opportunity recognition. We develop hypotheses to confirm its basic predictions in the student context. Finally, we link the findings with the wider social effect of entrepreneurship literature and highlight the theoretical contributions and practical implications.

Theoretical background

‘opportunity recognition’ as entrepreneurship education unit of analysis.

A commonly focused analysis in entrepreneurship research over the last 30 years has been the ‘opportunity’, most simply defined as any situation in which new products or services can be development of production (Casson, 1982 ; Shane & Venkataraman, 2000 ; Venkataraman, 1997 ). The definition of opportunity recognition is defined in many ways, but opportunity is defined as a perceived means of generating economic value (ie, profit) that has not been exploited previously and is not currently exploited by others. If opportunity is defined in this way, opportunity recognition can be defined as a cognitive process (or process) that concludes that an individual has identified an opportunity (Baron and Ensley, 2006 ). Kirzner ( 1997 ) pointed out that the distribution of information in society affects the discovery of entrepreneurial opportunities and that only a few individuals can identify and recognize specific opportunities in the market. The process of finding opportunities also depends on the individual’s ability and discovery (Stevenson & Gumpert, 1985 ). For example, people may miss opportunities due to a lack of cognitive ability to change external environments (Stevenson & Gumpert, 1985 ). Only those who recognize and value the existence of opportunity can benefit from new opportunities (Ardichvili et al., 2003a , b ; Shane & Venkataraman, 2000 ). Opportunity recognition is an early step in transforming value into a business concept that creates value and generates revenue and distinguishes it from the aggressive stages of detailed assessment and development of recognized opportunities and potential economic value. The focus of the new venture business is also an innovative opportunity to create new opportunities rather than merely expanding or repeating existing business models (Gaglio & Katz, 2001 ). As a result, universities need to make use of a variety of initiatives to educate students to recognize innovative opportunities. Therefore, entrepreneurship education aimed at a new opportunity recognition should be able to provide learning opportunities based on various theories of favorable conditions for new business creation and the types of traits required for new ventures (Garavan & O’Cinne’ide, 1994 ).

Based on these considerations, we also define opportunity recognition as the formation of beliefs that can be translated into actions in order to understand the signals of change (new information on new conditions) and respond to these changes.

Problem-solving ability and innovative behavior of education for students

Problem-solving abilities have been proven to be one of the key factors for success in organizations and personal careers (Anderson & Anderson 1995 ). Through decades of research data, organizations and schools have studied factors that affect improvement. Problem-solving abilities are defined in a number of prior studies, and problem-solving abilities in a volatile and sophisticated knowledge- and technology-based industry are an important ability to drive innovation and sustainable growth and development in the industry. Table  1 show the concept of problem solving ability defined in previous research.

There have been a number of previous studies, emphasis has been placed on the importance and meaning of rational problem-solving processes in order to improve problem-solving abilities, and research has focused on individual problem solving styles (Woodman et al., 1993 ; Scott & Bruce, 1994 ). According to the personal innovation behavior model of Scott and Bruce ( 1994 ), climate has shown individual innovative behavior as a result of individuals signaling the organization’s expectations of behavior and the potential consequences of action. Innovative organizations are, last but not least, equipment, facilities and time, including the direction of creativity and innovative change (Kanter, 1983 ; Siegel & Kaemmerer, 1978 ) Proper supply of such resources is important to innovation (Amabile, 1988 ; Van de Ven & Angle, 1989 ; Dubickis & Gaile-Sarkane, 2017 ). Based on a study of Koestler’s ( 1964 ) creative thinking, Jabri conceptualized a problem-solving style consisting of two independent thinking styles. He uses a structured problem-solving styles that is based on associative thinking, follows a set of rules, resolves reasonably logically, and uses an intuitive problem-solving ability that focuses on problem-solving, not tied to existing rules with multiple ideas. Intuitive problem solving styles tend to process information from different paradigms simultaneously. It is therefore more likely to create new problem solutions as possible (Isaksen, 1987 ; Kirton, 1976 ). However, style assessment is not desirable because the style of problem solving affects style differently depending on the individual problem-solving situations (Scott & Bruce, 1994 ). We are proposing a role for the University to encourage innovative behavior based on the individuality of our students in order to recognize new opportunities through education about Scott and Bruce’s innovative behavioral models and diverse entrepreneurship education approaches. And involvement of resources, such as entrepreneurship awareness programs, ultimately leads to the identification of individual characteristics and innovation. In addition, current Korean entrepreneurship education is mainly focused on cognitive learning to improve problem solving ability, and one aspect of cognitive learning plays an important role in learning process of new venture firms. This study has a more direct focus on behavior learning such as team-based learning.

Hypothesis development

Problem-solving ability and innovative behavior.

Problem solving is to discover knowledge and skills that reach the target country by interfering with a set of processes and goals where the solution is unknown, unfamiliar, or reaching a new state of goal (Jonassen, 2004 ; Inkinen, 2015 ). There are various approaches to solve this problem. To solve problems and improve problem solving with a successful solution experience, you should adopt the method that best suits your problem solution. You need to select the appropriate inputs for the solution elements and a flexible process structure. Problem solving ability has been recognized as a key element of innovative behavior in responding to rapid changes with the ability to find various alternatives and predict outcomes from these alternatives to maximize positive results, minimize negative consequences, and select solutions to problems (Barron & Harrington, 1981 ; Jabri, 1991 ; Kirton, 1976 ). We pose the following hypotheses:

Hypothesis 1: Individual problem-solving ability has an effect on the innovative behavior of students.

Innovative behavior and opportunity recognition

Innovation involves introducing ideas from outside the organization, through creative processes, and linking these ideas to products or processes. Many scholars studying innovation recognize that designing ideas is only one step in the innovation process (Kanter, 1988 ). Innovation is changing at the organizational or individual level. Kanter, Scott and Bruce defined personal innovation. In other words, an innovation act starts with recognition of a problem, adoption of a new idea, or creation of a solution, and an individual with an innovative tendency wants to create a realistically realizable group with the sympathy of such an idea. Innovative individuals create prototypes for innovations that enable ideas to be realized specifically with goods or services and become productive use and social day merchandising. According to previous studies, opportunity perception can be seen as an individual’s corporate strategy that focuses on the perception and exploitation of individuals about potential business ideas and opportunities and finds resources to create innovative outcomes (Manev et al., 2005 ). New Venture Ideas (NVI) are imaginary combinations of product/service offerings; potential markets or users, and means of bringing these offerings into existence (Davidsson, 2015 ). From the viewpoint of a potential entrepreneur like a university student, entrepreneurship starts with an idea. This process continues with a range of practices including attractiveness and feasibility of an idea, gathering information to minimize value-related uncertainty and possibility and perhaps the main idea’s conformity ratio in terms of newly discovered needs (Hayton & Cholakova, 2012 ). Earlier we proposed that the program as a whole increases the students’ innovative behavior and that innovative performance is the new venture ideas. Since it is logical to assume that the relationship between innovative behavior and opportunity recognition. We pose the following hypotheses:

Hypothesis 2: Innovative behavior will be a more potent inducer of opportunity recognition.

Problem-solving ability and opportunity recognition

Among the many factors influencing opportunity perception, the problems that arise in the fourth industry, the knowledge-based industry of the twenty-first century, are unpredictable and unstructured; they cannot be solved with existing solutions and require creative problem-solving skills. In order to determine how to solve problem situations that are different from the current situation and have unknown results, problems are solved through the process of adjusting previous experience, knowledge, and intuition (Charles & Lester, 1982 ). Experience, knowledge, and intuition are applied simultaneously to a single problem, not individually or collectively, and the intellectual and creative results that can be quickly and effectively solved in problem solving are seen as problem solving abilities (Ardichvili et al., 2003a , b ). Empirical studies of problem-solving abilities and opportunity perceptions have provided strong evidence that there is a positive relationship between theoretical integrative processes and corporate opportunity recognition (Ucbasaran et al., 2009 ). Therefore, we hypothesized that:

Hypothesis 3: Problem solving ability has an effect on the opportunity recognition.

The respondents for this study were randomly selected from three universities in Korea. Most of the respondents in this study were Korean university students who experienced team-based learning during behavioral learning through entrepreneurship education. Since then, we have been guided by two main criteria when choosing these universities. First, students who take entrepreneurship courses are critical to their innovation behavior. This led us to realize that innovative behavior is an important factor in an individual’s survival and growth. The second is that the parallel process of theoretical and behavioral learning is highly satisfied. A pilot study was conducted to verify the reliability and validity of the research measurements with 28 students at a university. The results of the pilot study showed high clarity and reliability (Cronbach ‘s alphas were all above 0.70) ​​of the research measurements. The sample of the pilot study was not incorporated in the present study.

This study was conducted in a four - year undergraduate course (various majors) that took entrepreneurship courses in Korea university programs. Students in this course have a mix of students who have previously experienced entrepreneurship and those who have not. During the course, students were taught the theoretical lessons for 8 weeks and the team for the 8 weeks. The questionnaire was administered during the last week of the course.

The data were analyzed from 203 participants, out of a total of 209, of which 7 were not appropriate. Of the 203 participants, 27% were female and 73% were male and the grade distribution was 3% for freshmen, 12% for grade 2, 26% for grade 2, and 59% for grade 2. The main distribution is 26% in social science, 16% in business and economics, 39% in engineering, 11% in music and athletics and 7% in others (see Table  2 ).

Measurement

The structure of the model was measured by questionnaires (problem-solving ability, innovation behavior and opportunity recognition questionnaire) consisting of the scale taken from questionnaires verified in previous studies. Tool selection was performed on two criteria. First, the selected tool should measure the same structure (ie, the original measured structure had to be conceptually identical to the way the structure was defined in this study model). Secondly, the psychometric qualities of the instrument for the student had to be high.

Assessment of the factors was carried out through principal component analyses (varimax rotation with eigenvalues of 1.0 or above) of the scales connected to the same level of the model to confirm the uniqueness of the scales with respect to each other. This was supplemented by the computation of the internal consistency reliability of the scales (Cronbach’s α). These analyses were executed using the individual participants’ responses (Nunnally & Bernstein, 1994 ).

Problem- solving ability was measured on a 7-point Likert-scale (1 = ‘completely disagree’; 7 = ‘completely agree’). Jabri ( 1991 ) used a measurement tool to measure individual problem solving ability.

Innovative behavior was measured on a 7-point Likert-scale (1 = ‘completely disagree’; 7 = ‘completely agree’). In order to measure innovation behavior, we modified the questionnaire items to fit the intention of this study among the questionnaire items used by Scott and Bruce ( 1994 ) and Kim and Rho ( 2010 ).

Opportunity recognition was measured on a 7-point Likert-scale (1 = ‘completely disagree’; 7 = ‘completely agree’). In order to measure opportunity recognition, we modified the questionnaire items to fit the intention of this study among the questionnaire items used by Kim and Rho ( 2010 ).

Methods of analysis

The first two parts of the analysis were primarily based on (multiple) regression analyses. The last part of the analysis was informed through the path analyses. The adequacy of the models was assessed by AMOS 18(Arbuckle & Wothke, 2003 ). Models were all tested with standardized coefficients obtained from the Principal Component Analysis. To ascertain the model fit, we analyzed the comparative fit index (CFI), the normed fit index (NFI), the Root Mean Square Err of Approximation (RMSEA), the standardized root mean square residual (SRMR) and the chi-square test statistic.

Reliability and validity are essential psychometrics to be reported. The first step to evaluate those aspects was to use the Cronbach’s alpha and the composite reliability to test reliability of the proposed scales. The usual threshold level is 0.7 for newly developed measures (Fornell and Larcker, 1981 ). Values range from 0.69 to 0.79 in the case of Cronbach’s alpha, and from 0.85 to 0.92 in the case of composite reliability (see Table  3 ). Therefore, these scales may be considered as reliable. Next, we estimated the research model, displayed in Fig.  1 , using structural equation modeling (SEM) and AMOS 18 (Arbuckle & Wothke, 2003 ). Our analysis revealed an adequate measurement model with high factor loadings for all the items on the expected factors and communalities of each item exceeding 0.50. We discuss three fit indices that are generally considered as important (Hu & Bentler, 1998 ). First, the CFI-value represents the overall difference between observed and predicted correlations. A value of 0.04 which is situated well below the cut-off value of 0.08, suggests that the hypothesized model resembles the actual correlations. Secondly, Bentler’s CFI (comparative fit index) greater than 0.90 and 0.95 which is above the cut-off of 0.90 (Schumacker & Lomax, 1996 ). Thirdly, NFI greater greater than 0.90 and 0.95 which is above the cut-off of 0.90 (Schumacker & Lomax, 1996 ). Fourthly, the standardized root mean square residual (SRMR) value of 0.0392 which is situated well below the cut-off value of 0.05(Hu & Bentler, 1998 ), and the chi-square value of 3581.622 which is situated well below the cut-off value of 0.0005. Finally, the RMSEA (root mean square error of approximation) equals 0.04 with a 90% confidence interval between 0.03 and 0.05.

Analysis of mediation effect

The value and confidence interval are situated over but below the cut-off value of 0.1 which suggests not a great but a good fit. Factor analysis was verified by factor analysis using principal component analysis and only factors with an eigenvalue of 1 or more by orthogonal rotation method were selected. Factor loading was considered to be significant at 0.5 or more (Hair et al., 2006a , b ). As a result of the analysis, cumulative explanation for 72.4% of the total variance. Confirmatory factor analysis thus supported the differentiation of the three components Also we tested the confirmatory validity of the construct by testing whether the structural linkage of each square is greater than the mean variance extraction (AVE) of each structure. The AVE ranged from 0.52 to 0.53, reaching the recommended level of .50 for both Fornell and Larcker ( 1981 ). Therefore, all constructs showed sufficient convergent validity (see Table 3 ).

As shown in Table  4 , the AVE value of each variable has a higher value than that of other factors. Therefore, the discriminant validity of the proposed model can be judged as appropriate.

Means, standard deviations, and correlations among the study variables are shown in Table  5 .

The mean scores for the conceptual model were as follows for problem-solving ability (MD. 5.20, SD.1.08), innovative behavior (MD.5.20, SD.1.03), and opportunity recognition (MD. 5.14, SD. 1.06) conditions. The means of problem-solving ability, innovative behavior, and opportunity recognition were high. Furthermore, those variables correlated positively with each other.

Figure  1 showed that all paths and their significance levels are presented in Table  6 . The path between the latent variables problem-solving ability and innovative behavior was significant (p, 0.001), consistent with Hypotheses 1. In addition, there was innovative behavior and opportunity recognition (p, 0.01), this result provide empirical support for Hypothesis 2.

H3 proposed that Problem-solving ability is positively related to opportunity recognition. The results of the correlation analysis: The coefficient of problem solving and opportunity perception weakened from .717 to .444, but it is still partly mediated because it is still significant (C. R  = 7.604 ***). This supports H3 (see Table 6 ).

In order to verify the significance of the indirect effect, the bootstrapping must be performed in AMOS, and the actual significance test should be identified using two-tailed significance. As a result, the significance of indirect effect is 0.04 ( p  < 0.05), which is statistically significant (see Table  7 ).

Discussion and conclusion

We have tried to demonstrate the effects of behavior and its significance by differentiating from the general curriculum emphasizing cognitive effects as a model of problem solving ability emerging as innovative behavior through opportunity of university entrepreneurship education.. This supports the premise that entrepreneurship education can improve opportunities or processes through behavioral learning. The results of this study support the role of entrepreneurship education in creating opportunities for innovative behavior and problem solving abilities. Entrepreneurship education should provide different types of learning for new opportunities and focus on what is manifested in behavior.

In addition, based on previous research, we propose whether the following contents are well followed and whether it is effective. First, the emergence of innovative behavior in problem-solving abilities increases as the cognitive diversity of students with diverse majors and diverse backgrounds increases. Second, the more entrepreneurial learning experiences, the greater the chance of new opportunities. Third, it is necessary to investigate students’ problem solving style and problem-solving ability first, and then a teaching strategy based on this combination of systematic and effective theory and practice is needed. Of course, as demonstrated by many studies, it may be easier to enhance the effectiveness of opportunity recognition through cognitive learning. This is because it emphasizes the achievement of knowledge and understanding with acquiring skills and competence. This process, however, is not enough for entrepreneurship education. However, we do not support full team-based behavioral learning in the class designed by Michaelsen and Sweet ( 2008 ). As with the results of this study, problem solving ability is positively related to opportunity perception directly. As previously demonstrated in previous studies, problem solving ability can be enhanced by cognitive learning (Anderson et al., 2001 ; Charles & Lester, 1982 ).

Therefore, it has been demonstrated that it is more efficient to balance a certain level of cognitive learning and behavior learning in consideration of the level of students in a course. Also this study satisfies the need for empirical research by Lumpkin and Lichtenstein ( 2005 ) and Robinson et al. ( 2016 ) and others. This will help to improve understanding of how entrepreneurship training is linked to various learning models and their effectiveness and to design better courses for the future. Finally, this study sought to provide an awareness of entrepreneurship education as the best curriculum for solutions that evolved into innovative behaviors that create new values and ultimately represent new opportunities. This study shows that it can positively influence the social effect of creating new value, that is, not only the cognitive effect of general pedagogy, but also the innovation behavior. By providing this awareness, we have laid the groundwork for empirical research on entrepreneurship education in order to create more opportunities for prospective students in education through education and to expand their capabilities.

Limitation and future research

Indeed, the concepts presented here and the limitations of this study have important implications that can fruitfully be addressed in future research. First, we selected a sample of college students taking entrepreneurship training. However, since it is not the whole of Korean university students, it is difficult to extend the research results to all college students in Korea. Second, there is no precedent research on the role of innovation behavior as intermedia in college students. Therefore, we were forced to proceed as an exploratory study.

The ability to recognize opportunities can provide significant benefits that can remain firm and competitive in an ever-changing environment. Future research should therefore expand these insights and try to empirically test more ways in which entrepreneurship pedagogy teaches how learning methods can be integrated into venture creation and growth processes to help new process opportunities. By providing this study, we will help entrepreneurship education in the university to create more opportunities and expand the capacity of prospective members.

Alvarez, S. A., & Barney, J. B. (2005). How do entrepreneurs organize firms under conditions of uncertainty? Journal of Management, 31 (5), 776–793.

Article   Google Scholar  

Amabile, T. M. (1988). A model of creativity and innovation in organizations. Research in Organizational Behavior, 10 (1), 123–167.

Google Scholar  

Ancona, D. G., & Caldwell, D. F. (1992). Demography and design: Predictors of new product team performance. Organization Science, 3 (3), 321–341.

Anderson, P. M., & Anderson, P. M. (1995). Analysis of faulted power systems (Vol. 445). New York: IEEE press.

Anderson, L. W., Krathwohl, D. R., Airasian, P., Cruikshank, K., Mayer, R., Pintrich, P., & Wittrock, M. (2001). A taxonomy for learning, teaching and assessing: A revision of Bloom’s taxonomy . New York: Longman Publishing.

Arbuckle, J. L., & Wothke, W. (2003). AMOS 5 user’s guide . Chicago: Smallwaters.

Ardichvili, A., Cardozo, R., & Ray, S. (2003a). A theory of entrepreneurial opportunity identification and development. Journal of Business Venturing, 18 (1), 105–123.

Ardichvili, A., Cardozo, R., & Ray, S. (2003b). A theory of entrepreneurial opportunity identification and development. Journal of Business Venturing, 18 (1), 105–123.

Baron, R. A., & Ensley, M. D. (2006). Opportunity recognition as the detection of meaningful patterns: Evidence from comparisons of novice and experienced entrepreneurs. Management Science, 52 (9), 1331–1344.

Barron, F., & Harrington, D. M. (1981). Creativity, intelligence, and personality. Annual review of psychology, 32 (1), 439–476.

Casson, M. (1982). The entrepreneur: An economic theory . Lanham: Rowman & Littlefield.

Charles, R., & Lester, F. (1982). Teaching problem solving: What, why & how . Palo Alto: Dale Seymour Publications.

Davidsson, P. (2015). Entrepreneurial opportunities and the entrepreneurship nexus: A re-conceptualization. Journal of Business Venturing, 30 (5), 674–695.

Dubickis, M., & Gaile-Sarkane, E. (2017). Transfer of know-how based on learning outcomes for development of open innovation. Journal of Open Innovation : Technology, market, and complexity , 3 (1), 4.

Dyer, J. H., Gregersen, H. B., & Christensen, C. (2008). Entrepreneur behaviors, opportunity recognition, and the origins of innovative ventures. Strategic Entrepreneurship Journal, 2 (4), 317–338.

D'zurilla, T. J., & Nezu, A. M. (1990). Development and preliminary evaluation of the social problem-solving inventory. Psychological Assessment: A Journal of Consulting and Clinical Psychology, 2 (2), 156.

Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research , 39–50.

Gaglio, C. M., & Katz, J. A. (2001). The psychological basis of opportunity identification: Entrepreneurial alertness. Small Business Economics, 16 (2), 95–111.

Garavan, T. N., & O’Cinneide, B. (1994). Entrepreneurship education and training programmes: A review and evaluation-part 1. Journal of European Industrial Training, 18 (8), 3–12.

Gartner, W. B., & Carter, N. M. (2003). Entrepreneurial behavior and firm organizing processes. In Handbook of entrepreneurship research (pp. 195–221). New Mexico: Springer US.

Hair, E., Halle, T., Terry-Humen, E., Lavelle, B., & Calkins, J. (2006a). Children's school readiness in the ECLS-K: Predictions to academic, health, and social outcomes in first grade. Early Childhood Research Quarterly, 21 (4), 431–454.

Hair, J. F., Black, W. C., Babin, B. J., Anderson, R. E., & Tatham, R. L. (2006b). Multivariate Data Analysis (6th ed.). Upper Saddle River: Pearson Education, Inc..

Hayton, J. C., & Cholakova, M. (2012). The role of affect in the creation and intentional pursuit of entrepreneurial ideas. Entrepreneurship Theory and Practice, 36 (1), 41–68.

Hu, L. T., & Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3 (4), 424.

Inkinen, T. (2015). Reflections on the innovative city: Examining three innovative locations in a knowledge bases framework. Journal of Open Innovation : Technolodgy, market. Complexity, 1 (1), 8.

Isaksen, S. G. (1987). Frontiers of creativity research: Beyond the basics. Bearly Ltd.

Jabri, M. M. (1991). The development of conceptually independent subscales in the measurement of modes of problem solving. Educational and Psychological Measurement, 51 (4), 975–983.

Jonassen, D. H. (2004). Learning to solve problems: An instructional design guide (Vol. 6). Hoboken: John Wiley & Sons.

Kanter, R. M. (1983). The change masters: Binnovation and entrepreneturship in the American corporation. Touchstone Book.

Kanter, R. M. (1988). Three tiers for innovation research. Communication Research, 15 (5), 509–523.

Kim, H. C., Song, C. H., & An, B. R. (2016). A study on effects of personal characteristics on start-up opportunity and entrepreneurial intention of start-up. Korean Management Consulting review, 16 (3), 75–87.

Kim, S. A., Ryoo, H. Y., & Ahn, H. J. (2017). Student customized creative education model based on open innovation. Journal of Open Innovation : Technology, Market, and Complexity , 3 (1), 6.

Kim, T. H., & Roh, J. H. (2010). A Study of the Impact of Public Service Motivation on Innovative Behavior of Organizational Members. Korean Journal of Public Administration, 48(3).

Kirton, M. (1976). Adaptors and innovators: A description and measure. Journal of Applied Psychology, 61 (5), 622.

Kirzner, I. M. (1997). Entrepreneurial discovery and the competitive market process: An Austrian approach. Journal of Economic Literature, 35 (1), 60–85.

Ko, S., & Butler, J. E. (2003). Alertness, bisociative thinking ability, and discovery of entrepreneurial opportunities in Asian hi-tech firms.

Koestler, A. (1964). The act of creation: A study of the conscious and unconscious processes of humor, scientific discovery and art.

Lumpkin, G. T., & Dess, G. G. (2004). E-Business Strategies and Internet Business Models: How the Internet Adds Value. Organizational Dynamics, 33 (2), 161–173.

Lumpkin, G. T., & Lichtenstein, B. B. (2005). The role of organizational learning in the opportunity-recognition process. Entrepreneurship Theory and Practice, 29 (4), 451–472.

Manev, I. M., Gyoshev, B. S., & Manolova, T. S. (2005). The role of human and social capital and entrepreneurial orientation for small business performance in a transitional economy. International Journal of Entrepreneurship and Innovation Management, 5 (3–4), 298–318.

Michaelsen, L. K., & Sweet, M. (2008). The essential elements of team-based learning. New directions for teaching and learning, 2008 (116), 7–27.

Nunnally, J. C., & Bernstein, I. H. (1994). Validity. Psychometric theory, 99–132.

Paine, J. B., & Organ, D. W. (2000). The cultural matrix of organizational citizenship behavior: Some preliminary conceptual and empirical observations. Human Resource Management Review, 10 (1), 45–59.

Robinson, S., Neergaard, H., Tanggaard, L., & Krueger, N. F. (2016). New horizons in entrepreneurship education: from teacher-led to student-centered learning. Education+ Training, 58(7/8), 661–683.

Schumacker, R. E., & Lomax, R. G. (1996). A beginner's guide to structural equation modeling . Mahwah: Laurence Erlbaum Google Scholar.

Scott, S. G., & Bruce, R. A. (1994). Determinants of innovative behavior: A path model of individual innovation in the workplace. Academy of Management Journal, 37 (3), 580–607.

Shane, S. A. (2003). A general theory of entrepreneurship: The individual-opportunity nexus . Cheltenham: Edward Elgar Publishing.

Book   Google Scholar  

Shane, S., & Venkataraman, S. (2000). The promise of entrepreneurship as a field of research. Academy of Management Review, 25 (1), 217–226.

Siegel, S. M., & Kaemmerer, W. F. (1978). Measuring the perceived support for innovation in organizations. Journal of Applied Psychology, 63 (5), 553–562.

Spivack, G., Platt, J. J., & Shure, M. B. (1976). The problem-solving approach to adjustment . San Francisco: Jossey-Bass.

Stevenson, H., & Gumpert, D. (1985). The heart of entrepreneurship.

Stevenson, H. H. & J. C. Jarillo (1990). 'A paradigm of entrepreneurship: Entrepreneurial management', Strategic Management Journal, 11, pp. 17–27.

Ucbasaran, D., Westhead, P., & Wright, M. (2009). The extent and nature of opportunity identification by experienced entrepreneurs. Journal of Business Venturing, 24 (2), 99–115.

Van de Ven, A. H., & Angle, H. L. (1989). Suggestions for managing the innovation journey (No. 9). Strategic Management Research Center, University of Minnesota.

Venkataraman, S. (1997). The distinctive domain of entrepreneurship research. Advances in entrepreneurship, firm emergence and growth, 3 (1), 119–138.

Venkataraman, S., & Sarasvathy, S. D. (2001). Strategy and entrepreneurship: Outlines of an untold story.

Warner, M. (2002). Publics and counterpublics. Public Culture, 14 (1), 49–90.

Woodman, R. W., Sawyer, J. E., & Griffin, R. W. (1993). Toward a theory of organizational creativity. Academy of Management Review, 18 (2), 293–321.

Download references

Author information

Authors and affiliations.

Dept. of Technology Entrepreneurship (Graduate School), Dongguk University, 904 Chungmurogwn, Toegye-ro 36Gil, Jung-gu, Seoul, 100-272, South Korea

Ji Young Kim, Dae Soo Choi & Chang-Soo Sung

Yonsei School of Business, Yonsei University, 50 Yonsei-ro, Seodaemun-gu, Seoul, 120-749, South Korea

Joo Y. Park

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to Joo Y. Park .

Ethics declarations

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License ( http://creativecommons.org/licenses/by/4.0/ ), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Reprints and permissions

About this article

Cite this article.

Kim, J.Y., Choi, D.S., Sung, CS. et al. The role of problem solving ability on innovative behavior and opportunity recognition in university students. J. open innov. 4 , 4 (2018). https://doi.org/10.1186/s40852-018-0085-4

Download citation

Received : 12 September 2017

Accepted : 22 January 2018

Published : 05 February 2018

DOI : https://doi.org/10.1186/s40852-018-0085-4

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Problem-solving ability
• Innovative behavior
• Opportunity recognition
• Entrepreneurship education

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

• View all journals
• My Account Login
• Explore content
• About the journal
• Publish with us
• Sign up for alerts
• Review Article
• Open access
• Published: 11 January 2023

The effectiveness of collaborative problem solving in promoting students’ critical thinking: A meta-analysis based on empirical literature

• Enwei Xu   ORCID: orcid.org/0000-0001-6424-8169 1 ,
• Wei Wang 1 &
• Qingxia Wang 1  

Humanities and Social Sciences Communications volume  10 , Article number:  16 ( 2023 ) Cite this article

13k Accesses

10 Citations

3 Altmetric

Metrics details

• Science, technology and society

Collaborative problem-solving has been widely embraced in the classroom instruction of critical thinking, which is regarded as the core of curriculum reform based on key competencies in the field of education as well as a key competence for learners in the 21st century. However, the effectiveness of collaborative problem-solving in promoting students’ critical thinking remains uncertain. This current research presents the major findings of a meta-analysis of 36 pieces of the literature revealed in worldwide educational periodicals during the 21st century to identify the effectiveness of collaborative problem-solving in promoting students’ critical thinking and to determine, based on evidence, whether and to what extent collaborative problem solving can result in a rise or decrease in critical thinking. The findings show that (1) collaborative problem solving is an effective teaching approach to foster students’ critical thinking, with a significant overall effect size (ES = 0.82, z  = 12.78, P  < 0.01, 95% CI [0.69, 0.95]); (2) in respect to the dimensions of critical thinking, collaborative problem solving can significantly and successfully enhance students’ attitudinal tendencies (ES = 1.17, z  = 7.62, P  < 0.01, 95% CI[0.87, 1.47]); nevertheless, it falls short in terms of improving students’ cognitive skills, having only an upper-middle impact (ES = 0.70, z  = 11.55, P  < 0.01, 95% CI[0.58, 0.82]); and (3) the teaching type (chi 2  = 7.20, P  < 0.05), intervention duration (chi 2  = 12.18, P  < 0.01), subject area (chi 2  = 13.36, P  < 0.05), group size (chi 2  = 8.77, P  < 0.05), and learning scaffold (chi 2  = 9.03, P  < 0.01) all have an impact on critical thinking, and they can be viewed as important moderating factors that affect how critical thinking develops. On the basis of these results, recommendations are made for further study and instruction to better support students’ critical thinking in the context of collaborative problem-solving.

Similar content being viewed by others

Impact of artificial intelligence on human loss in decision making, laziness and safety in education

Sayed Fayaz Ahmad, Heesup Han, … Antonio Ariza-Montes

Artificial intelligence and illusions of understanding in scientific research

Lisa Messeri & M. J. Crockett

Interviews in the social sciences

Eleanor Knott, Aliya Hamid Rao, … Chana Teeger

Introduction

Although critical thinking has a long history in research, the concept of critical thinking, which is regarded as an essential competence for learners in the 21st century, has recently attracted more attention from researchers and teaching practitioners (National Research Council, 2012 ). Critical thinking should be the core of curriculum reform based on key competencies in the field of education (Peng and Deng, 2017 ) because students with critical thinking can not only understand the meaning of knowledge but also effectively solve practical problems in real life even after knowledge is forgotten (Kek and Huijser, 2011 ). The definition of critical thinking is not universal (Ennis, 1989 ; Castle, 2009 ; Niu et al., 2013 ). In general, the definition of critical thinking is a self-aware and self-regulated thought process (Facione, 1990 ; Niu et al., 2013 ). It refers to the cognitive skills needed to interpret, analyze, synthesize, reason, and evaluate information as well as the attitudinal tendency to apply these abilities (Halpern, 2001 ). The view that critical thinking can be taught and learned through curriculum teaching has been widely supported by many researchers (e.g., Kuncel, 2011 ; Leng and Lu, 2020 ), leading to educators’ efforts to foster it among students. In the field of teaching practice, there are three types of courses for teaching critical thinking (Ennis, 1989 ). The first is an independent curriculum in which critical thinking is taught and cultivated without involving the knowledge of specific disciplines; the second is an integrated curriculum in which critical thinking is integrated into the teaching of other disciplines as a clear teaching goal; and the third is a mixed curriculum in which critical thinking is taught in parallel to the teaching of other disciplines for mixed teaching training. Furthermore, numerous measuring tools have been developed by researchers and educators to measure critical thinking in the context of teaching practice. These include standardized measurement tools, such as WGCTA, CCTST, CCTT, and CCTDI, which have been verified by repeated experiments and are considered effective and reliable by international scholars (Facione and Facione, 1992 ). In short, descriptions of critical thinking, including its two dimensions of attitudinal tendency and cognitive skills, different types of teaching courses, and standardized measurement tools provide a complex normative framework for understanding, teaching, and evaluating critical thinking.

Cultivating critical thinking in curriculum teaching can start with a problem, and one of the most popular critical thinking instructional approaches is problem-based learning (Liu et al., 2020 ). Duch et al. ( 2001 ) noted that problem-based learning in group collaboration is progressive active learning, which can improve students’ critical thinking and problem-solving skills. Collaborative problem-solving is the organic integration of collaborative learning and problem-based learning, which takes learners as the center of the learning process and uses problems with poor structure in real-world situations as the starting point for the learning process (Liang et al., 2017 ). Students learn the knowledge needed to solve problems in a collaborative group, reach a consensus on problems in the field, and form solutions through social cooperation methods, such as dialogue, interpretation, questioning, debate, negotiation, and reflection, thus promoting the development of learners’ domain knowledge and critical thinking (Cindy, 2004 ; Liang et al., 2017 ).

Collaborative problem-solving has been widely used in the teaching practice of critical thinking, and several studies have attempted to conduct a systematic review and meta-analysis of the empirical literature on critical thinking from various perspectives. However, little attention has been paid to the impact of collaborative problem-solving on critical thinking. Therefore, the best approach for developing and enhancing critical thinking throughout collaborative problem-solving is to examine how to implement critical thinking instruction; however, this issue is still unexplored, which means that many teachers are incapable of better instructing critical thinking (Leng and Lu, 2020 ; Niu et al., 2013 ). For example, Huber ( 2016 ) provided the meta-analysis findings of 71 publications on gaining critical thinking over various time frames in college with the aim of determining whether critical thinking was truly teachable. These authors found that learners significantly improve their critical thinking while in college and that critical thinking differs with factors such as teaching strategies, intervention duration, subject area, and teaching type. The usefulness of collaborative problem-solving in fostering students’ critical thinking, however, was not determined by this study, nor did it reveal whether there existed significant variations among the different elements. A meta-analysis of 31 pieces of educational literature was conducted by Liu et al. ( 2020 ) to assess the impact of problem-solving on college students’ critical thinking. These authors found that problem-solving could promote the development of critical thinking among college students and proposed establishing a reasonable group structure for problem-solving in a follow-up study to improve students’ critical thinking. Additionally, previous empirical studies have reached inconclusive and even contradictory conclusions about whether and to what extent collaborative problem-solving increases or decreases critical thinking levels. As an illustration, Yang et al. ( 2008 ) carried out an experiment on the integrated curriculum teaching of college students based on a web bulletin board with the goal of fostering participants’ critical thinking in the context of collaborative problem-solving. These authors’ research revealed that through sharing, debating, examining, and reflecting on various experiences and ideas, collaborative problem-solving can considerably enhance students’ critical thinking in real-life problem situations. In contrast, collaborative problem-solving had a positive impact on learners’ interaction and could improve learning interest and motivation but could not significantly improve students’ critical thinking when compared to traditional classroom teaching, according to research by Naber and Wyatt ( 2014 ) and Sendag and Odabasi ( 2009 ) on undergraduate and high school students, respectively.

The above studies show that there is inconsistency regarding the effectiveness of collaborative problem-solving in promoting students’ critical thinking. Therefore, it is essential to conduct a thorough and trustworthy review to detect and decide whether and to what degree collaborative problem-solving can result in a rise or decrease in critical thinking. Meta-analysis is a quantitative analysis approach that is utilized to examine quantitative data from various separate studies that are all focused on the same research topic. This approach characterizes the effectiveness of its impact by averaging the effect sizes of numerous qualitative studies in an effort to reduce the uncertainty brought on by independent research and produce more conclusive findings (Lipsey and Wilson, 2001 ).

This paper used a meta-analytic approach and carried out a meta-analysis to examine the effectiveness of collaborative problem-solving in promoting students’ critical thinking in order to make a contribution to both research and practice. The following research questions were addressed by this meta-analysis:

What is the overall effect size of collaborative problem-solving in promoting students’ critical thinking and its impact on the two dimensions of critical thinking (i.e., attitudinal tendency and cognitive skills)?

How are the disparities between the study conclusions impacted by various moderating variables if the impacts of various experimental designs in the included studies are heterogeneous?

This research followed the strict procedures (e.g., database searching, identification, screening, eligibility, merging, duplicate removal, and analysis of included studies) of Cooper’s ( 2010 ) proposed meta-analysis approach for examining quantitative data from various separate studies that are all focused on the same research topic. The relevant empirical research that appeared in worldwide educational periodicals within the 21st century was subjected to this meta-analysis using Rev-Man 5.4. The consistency of the data extracted separately by two researchers was tested using Cohen’s kappa coefficient, and a publication bias test and a heterogeneity test were run on the sample data to ascertain the quality of this meta-analysis.

Data sources and search strategies

There were three stages to the data collection process for this meta-analysis, as shown in Fig. 1 , which shows the number of articles included and eliminated during the selection process based on the statement and study eligibility criteria.

This flowchart shows the number of records identified, included and excluded in the article.

First, the databases used to systematically search for relevant articles were the journal papers of the Web of Science Core Collection and the Chinese Core source journal, as well as the Chinese Social Science Citation Index (CSSCI) source journal papers included in CNKI. These databases were selected because they are credible platforms that are sources of scholarly and peer-reviewed information with advanced search tools and contain literature relevant to the subject of our topic from reliable researchers and experts. The search string with the Boolean operator used in the Web of Science was “TS = (((“critical thinking” or “ct” and “pretest” or “posttest”) or (“critical thinking” or “ct” and “control group” or “quasi experiment” or “experiment”)) and (“collaboration” or “collaborative learning” or “CSCL”) and (“problem solving” or “problem-based learning” or “PBL”))”. The research area was “Education Educational Research”, and the search period was “January 1, 2000, to December 30, 2021”. A total of 412 papers were obtained. The search string with the Boolean operator used in the CNKI was “SU = (‘critical thinking’*‘collaboration’ + ‘critical thinking’*‘collaborative learning’ + ‘critical thinking’*‘CSCL’ + ‘critical thinking’*‘problem solving’ + ‘critical thinking’*‘problem-based learning’ + ‘critical thinking’*‘PBL’ + ‘critical thinking’*‘problem oriented’) AND FT = (‘experiment’ + ‘quasi experiment’ + ‘pretest’ + ‘posttest’ + ‘empirical study’)” (translated into Chinese when searching). A total of 56 studies were found throughout the search period of “January 2000 to December 2021”. From the databases, all duplicates and retractions were eliminated before exporting the references into Endnote, a program for managing bibliographic references. In all, 466 studies were found.

Second, the studies that matched the inclusion and exclusion criteria for the meta-analysis were chosen by two researchers after they had reviewed the abstracts and titles of the gathered articles, yielding a total of 126 studies.

Third, two researchers thoroughly reviewed each included article’s whole text in accordance with the inclusion and exclusion criteria. Meanwhile, a snowball search was performed using the references and citations of the included articles to ensure complete coverage of the articles. Ultimately, 36 articles were kept.

Two researchers worked together to carry out this entire process, and a consensus rate of almost 94.7% was reached after discussion and negotiation to clarify any emerging differences.

Eligibility criteria

Since not all the retrieved studies matched the criteria for this meta-analysis, eligibility criteria for both inclusion and exclusion were developed as follows:

The publication language of the included studies was limited to English and Chinese, and the full text could be obtained. Articles that did not meet the publication language and articles not published between 2000 and 2021 were excluded.

The research design of the included studies must be empirical and quantitative studies that can assess the effect of collaborative problem-solving on the development of critical thinking. Articles that could not identify the causal mechanisms by which collaborative problem-solving affects critical thinking, such as review articles and theoretical articles, were excluded.

The research method of the included studies must feature a randomized control experiment or a quasi-experiment, or a natural experiment, which have a higher degree of internal validity with strong experimental designs and can all plausibly provide evidence that critical thinking and collaborative problem-solving are causally related. Articles with non-experimental research methods, such as purely correlational or observational studies, were excluded.

The participants of the included studies were only students in school, including K-12 students and college students. Articles in which the participants were non-school students, such as social workers or adult learners, were excluded.

The research results of the included studies must mention definite signs that may be utilized to gauge critical thinking’s impact (e.g., sample size, mean value, or standard deviation). Articles that lacked specific measurement indicators for critical thinking and could not calculate the effect size were excluded.

Data coding design

In order to perform a meta-analysis, it is necessary to collect the most important information from the articles, codify that information’s properties, and convert descriptive data into quantitative data. Therefore, this study designed a data coding template (see Table 1 ). Ultimately, 16 coding fields were retained.

The designed data-coding template consisted of three pieces of information. Basic information about the papers was included in the descriptive information: the publishing year, author, serial number, and title of the paper.

The variable information for the experimental design had three variables: the independent variable (instruction method), the dependent variable (critical thinking), and the moderating variable (learning stage, teaching type, intervention duration, learning scaffold, group size, measuring tool, and subject area). Depending on the topic of this study, the intervention strategy, as the independent variable, was coded into collaborative and non-collaborative problem-solving. The dependent variable, critical thinking, was coded as a cognitive skill and an attitudinal tendency. And seven moderating variables were created by grouping and combining the experimental design variables discovered within the 36 studies (see Table 1 ), where learning stages were encoded as higher education, high school, middle school, and primary school or lower; teaching types were encoded as mixed courses, integrated courses, and independent courses; intervention durations were encoded as 0–1 weeks, 1–4 weeks, 4–12 weeks, and more than 12 weeks; group sizes were encoded as 2–3 persons, 4–6 persons, 7–10 persons, and more than 10 persons; learning scaffolds were encoded as teacher-supported learning scaffold, technique-supported learning scaffold, and resource-supported learning scaffold; measuring tools were encoded as standardized measurement tools (e.g., WGCTA, CCTT, CCTST, and CCTDI) and self-adapting measurement tools (e.g., modified or made by researchers); and subject areas were encoded according to the specific subjects used in the 36 included studies.

The data information contained three metrics for measuring critical thinking: sample size, average value, and standard deviation. It is vital to remember that studies with various experimental designs frequently adopt various formulas to determine the effect size. And this paper used Morris’ proposed standardized mean difference (SMD) calculation formula ( 2008 , p. 369; see Supplementary Table S3 ).

Procedure for extracting and coding data

According to the data coding template (see Table 1 ), the 36 papers’ information was retrieved by two researchers, who then entered them into Excel (see Supplementary Table S1 ). The results of each study were extracted separately in the data extraction procedure if an article contained numerous studies on critical thinking, or if a study assessed different critical thinking dimensions. For instance, Tiwari et al. ( 2010 ) used four time points, which were viewed as numerous different studies, to examine the outcomes of critical thinking, and Chen ( 2013 ) included the two outcome variables of attitudinal tendency and cognitive skills, which were regarded as two studies. After discussion and negotiation during data extraction, the two researchers’ consistency test coefficients were roughly 93.27%. Supplementary Table S2 details the key characteristics of the 36 included articles with 79 effect quantities, including descriptive information (e.g., the publishing year, author, serial number, and title of the paper), variable information (e.g., independent variables, dependent variables, and moderating variables), and data information (e.g., mean values, standard deviations, and sample size). Following that, testing for publication bias and heterogeneity was done on the sample data using the Rev-Man 5.4 software, and then the test results were used to conduct a meta-analysis.

Publication bias test

When the sample of studies included in a meta-analysis does not accurately reflect the general status of research on the relevant subject, publication bias is said to be exhibited in this research. The reliability and accuracy of the meta-analysis may be impacted by publication bias. Due to this, the meta-analysis needs to check the sample data for publication bias (Stewart et al., 2006 ). A popular method to check for publication bias is the funnel plot; and it is unlikely that there will be publishing bias when the data are equally dispersed on either side of the average effect size and targeted within the higher region. The data are equally dispersed within the higher portion of the efficient zone, consistent with the funnel plot connected with this analysis (see Fig. 2 ), indicating that publication bias is unlikely in this situation.

This funnel plot shows the result of publication bias of 79 effect quantities across 36 studies.

Heterogeneity test

To select the appropriate effect models for the meta-analysis, one might use the results of a heterogeneity test on the data effect sizes. In a meta-analysis, it is common practice to gauge the degree of data heterogeneity using the I 2 value, and I 2  ≥ 50% is typically understood to denote medium-high heterogeneity, which calls for the adoption of a random effect model; if not, a fixed effect model ought to be applied (Lipsey and Wilson, 2001 ). The findings of the heterogeneity test in this paper (see Table 2 ) revealed that I 2 was 86% and displayed significant heterogeneity ( P  < 0.01). To ensure accuracy and reliability, the overall effect size ought to be calculated utilizing the random effect model.

The analysis of the overall effect size

This meta-analysis utilized a random effect model to examine 79 effect quantities from 36 studies after eliminating heterogeneity. In accordance with Cohen’s criterion (Cohen, 1992 ), it is abundantly clear from the analysis results, which are shown in the forest plot of the overall effect (see Fig. 3 ), that the cumulative impact size of cooperative problem-solving is 0.82, which is statistically significant ( z  = 12.78, P  < 0.01, 95% CI [0.69, 0.95]), and can encourage learners to practice critical thinking.

This forest plot shows the analysis result of the overall effect size across 36 studies.

In addition, this study examined two distinct dimensions of critical thinking to better understand the precise contributions that collaborative problem-solving makes to the growth of critical thinking. The findings (see Table 3 ) indicate that collaborative problem-solving improves cognitive skills (ES = 0.70) and attitudinal tendency (ES = 1.17), with significant intergroup differences (chi 2  = 7.95, P  < 0.01). Although collaborative problem-solving improves both dimensions of critical thinking, it is essential to point out that the improvements in students’ attitudinal tendency are much more pronounced and have a significant comprehensive effect (ES = 1.17, z  = 7.62, P  < 0.01, 95% CI [0.87, 1.47]), whereas gains in learners’ cognitive skill are slightly improved and are just above average. (ES = 0.70, z  = 11.55, P  < 0.01, 95% CI [0.58, 0.82]).

The analysis of moderator effect size

The whole forest plot’s 79 effect quantities underwent a two-tailed test, which revealed significant heterogeneity ( I 2  = 86%, z  = 12.78, P  < 0.01), indicating differences between various effect sizes that may have been influenced by moderating factors other than sampling error. Therefore, exploring possible moderating factors that might produce considerable heterogeneity was done using subgroup analysis, such as the learning stage, learning scaffold, teaching type, group size, duration of the intervention, measuring tool, and the subject area included in the 36 experimental designs, in order to further explore the key factors that influence critical thinking. The findings (see Table 4 ) indicate that various moderating factors have advantageous effects on critical thinking. In this situation, the subject area (chi 2  = 13.36, P  < 0.05), group size (chi 2  = 8.77, P  < 0.05), intervention duration (chi 2  = 12.18, P  < 0.01), learning scaffold (chi 2  = 9.03, P  < 0.01), and teaching type (chi 2  = 7.20, P  < 0.05) are all significant moderators that can be applied to support the cultivation of critical thinking. However, since the learning stage and the measuring tools did not significantly differ among intergroup (chi 2  = 3.15, P  = 0.21 > 0.05, and chi 2  = 0.08, P  = 0.78 > 0.05), we are unable to explain why these two factors are crucial in supporting the cultivation of critical thinking in the context of collaborative problem-solving. These are the precise outcomes, as follows:

Various learning stages influenced critical thinking positively, without significant intergroup differences (chi 2  = 3.15, P  = 0.21 > 0.05). High school was first on the list of effect sizes (ES = 1.36, P  < 0.01), then higher education (ES = 0.78, P  < 0.01), and middle school (ES = 0.73, P  < 0.01). These results show that, despite the learning stage’s beneficial influence on cultivating learners’ critical thinking, we are unable to explain why it is essential for cultivating critical thinking in the context of collaborative problem-solving.

Different teaching types had varying degrees of positive impact on critical thinking, with significant intergroup differences (chi 2  = 7.20, P  < 0.05). The effect size was ranked as follows: mixed courses (ES = 1.34, P  < 0.01), integrated courses (ES = 0.81, P  < 0.01), and independent courses (ES = 0.27, P  < 0.01). These results indicate that the most effective approach to cultivate critical thinking utilizing collaborative problem solving is through the teaching type of mixed courses.

Various intervention durations significantly improved critical thinking, and there were significant intergroup differences (chi 2  = 12.18, P  < 0.01). The effect sizes related to this variable showed a tendency to increase with longer intervention durations. The improvement in critical thinking reached a significant level (ES = 0.85, P  < 0.01) after more than 12 weeks of training. These findings indicate that the intervention duration and critical thinking’s impact are positively correlated, with a longer intervention duration having a greater effect.

Different learning scaffolds influenced critical thinking positively, with significant intergroup differences (chi 2  = 9.03, P  < 0.01). The resource-supported learning scaffold (ES = 0.69, P  < 0.01) acquired a medium-to-higher level of impact, the technique-supported learning scaffold (ES = 0.63, P  < 0.01) also attained a medium-to-higher level of impact, and the teacher-supported learning scaffold (ES = 0.92, P  < 0.01) displayed a high level of significant impact. These results show that the learning scaffold with teacher support has the greatest impact on cultivating critical thinking.

Various group sizes influenced critical thinking positively, and the intergroup differences were statistically significant (chi 2  = 8.77, P  < 0.05). Critical thinking showed a general declining trend with increasing group size. The overall effect size of 2–3 people in this situation was the biggest (ES = 0.99, P  < 0.01), and when the group size was greater than 7 people, the improvement in critical thinking was at the lower-middle level (ES < 0.5, P  < 0.01). These results show that the impact on critical thinking is positively connected with group size, and as group size grows, so does the overall impact.

Various measuring tools influenced critical thinking positively, with significant intergroup differences (chi 2  = 0.08, P  = 0.78 > 0.05). In this situation, the self-adapting measurement tools obtained an upper-medium level of effect (ES = 0.78), whereas the complete effect size of the standardized measurement tools was the largest, achieving a significant level of effect (ES = 0.84, P  < 0.01). These results show that, despite the beneficial influence of the measuring tool on cultivating critical thinking, we are unable to explain why it is crucial in fostering the growth of critical thinking by utilizing the approach of collaborative problem-solving.

Different subject areas had a greater impact on critical thinking, and the intergroup differences were statistically significant (chi 2  = 13.36, P  < 0.05). Mathematics had the greatest overall impact, achieving a significant level of effect (ES = 1.68, P  < 0.01), followed by science (ES = 1.25, P  < 0.01) and medical science (ES = 0.87, P  < 0.01), both of which also achieved a significant level of effect. Programming technology was the least effective (ES = 0.39, P  < 0.01), only having a medium-low degree of effect compared to education (ES = 0.72, P  < 0.01) and other fields (such as language, art, and social sciences) (ES = 0.58, P  < 0.01). These results suggest that scientific fields (e.g., mathematics, science) may be the most effective subject areas for cultivating critical thinking utilizing the approach of collaborative problem-solving.

The effectiveness of collaborative problem solving with regard to teaching critical thinking

According to this meta-analysis, using collaborative problem-solving as an intervention strategy in critical thinking teaching has a considerable amount of impact on cultivating learners’ critical thinking as a whole and has a favorable promotional effect on the two dimensions of critical thinking. According to certain studies, collaborative problem solving, the most frequently used critical thinking teaching strategy in curriculum instruction can considerably enhance students’ critical thinking (e.g., Liang et al., 2017 ; Liu et al., 2020 ; Cindy, 2004 ). This meta-analysis provides convergent data support for the above research views. Thus, the findings of this meta-analysis not only effectively address the first research query regarding the overall effect of cultivating critical thinking and its impact on the two dimensions of critical thinking (i.e., attitudinal tendency and cognitive skills) utilizing the approach of collaborative problem-solving, but also enhance our confidence in cultivating critical thinking by using collaborative problem-solving intervention approach in the context of classroom teaching.

Furthermore, the associated improvements in attitudinal tendency are much stronger, but the corresponding improvements in cognitive skill are only marginally better. According to certain studies, cognitive skill differs from the attitudinal tendency in classroom instruction; the cultivation and development of the former as a key ability is a process of gradual accumulation, while the latter as an attitude is affected by the context of the teaching situation (e.g., a novel and exciting teaching approach, challenging and rewarding tasks) (Halpern, 2001 ; Wei and Hong, 2022 ). Collaborative problem-solving as a teaching approach is exciting and interesting, as well as rewarding and challenging; because it takes the learners as the focus and examines problems with poor structure in real situations, and it can inspire students to fully realize their potential for problem-solving, which will significantly improve their attitudinal tendency toward solving problems (Liu et al., 2020 ). Similar to how collaborative problem-solving influences attitudinal tendency, attitudinal tendency impacts cognitive skill when attempting to solve a problem (Liu et al., 2020 ; Zhang et al., 2022 ), and stronger attitudinal tendencies are associated with improved learning achievement and cognitive ability in students (Sison, 2008 ; Zhang et al., 2022 ). It can be seen that the two specific dimensions of critical thinking as well as critical thinking as a whole are affected by collaborative problem-solving, and this study illuminates the nuanced links between cognitive skills and attitudinal tendencies with regard to these two dimensions of critical thinking. To fully develop students’ capacity for critical thinking, future empirical research should pay closer attention to cognitive skills.

The moderating effects of collaborative problem solving with regard to teaching critical thinking

In order to further explore the key factors that influence critical thinking, exploring possible moderating effects that might produce considerable heterogeneity was done using subgroup analysis. The findings show that the moderating factors, such as the teaching type, learning stage, group size, learning scaffold, duration of the intervention, measuring tool, and the subject area included in the 36 experimental designs, could all support the cultivation of collaborative problem-solving in critical thinking. Among them, the effect size differences between the learning stage and measuring tool are not significant, which does not explain why these two factors are crucial in supporting the cultivation of critical thinking utilizing the approach of collaborative problem-solving.

In terms of the learning stage, various learning stages influenced critical thinking positively without significant intergroup differences, indicating that we are unable to explain why it is crucial in fostering the growth of critical thinking.

Although high education accounts for 70.89% of all empirical studies performed by researchers, high school may be the appropriate learning stage to foster students’ critical thinking by utilizing the approach of collaborative problem-solving since it has the largest overall effect size. This phenomenon may be related to student’s cognitive development, which needs to be further studied in follow-up research.

With regard to teaching type, mixed course teaching may be the best teaching method to cultivate students’ critical thinking. Relevant studies have shown that in the actual teaching process if students are trained in thinking methods alone, the methods they learn are isolated and divorced from subject knowledge, which is not conducive to their transfer of thinking methods; therefore, if students’ thinking is trained only in subject teaching without systematic method training, it is challenging to apply to real-world circumstances (Ruggiero, 2012 ; Hu and Liu, 2015 ). Teaching critical thinking as mixed course teaching in parallel to other subject teachings can achieve the best effect on learners’ critical thinking, and explicit critical thinking instruction is more effective than less explicit critical thinking instruction (Bensley and Spero, 2014 ).

In terms of the intervention duration, with longer intervention times, the overall effect size shows an upward tendency. Thus, the intervention duration and critical thinking’s impact are positively correlated. Critical thinking, as a key competency for students in the 21st century, is difficult to get a meaningful improvement in a brief intervention duration. Instead, it could be developed over a lengthy period of time through consistent teaching and the progressive accumulation of knowledge (Halpern, 2001 ; Hu and Liu, 2015 ). Therefore, future empirical studies ought to take these restrictions into account throughout a longer period of critical thinking instruction.

With regard to group size, a group size of 2–3 persons has the highest effect size, and the comprehensive effect size decreases with increasing group size in general. This outcome is in line with some research findings; as an example, a group composed of two to four members is most appropriate for collaborative learning (Schellens and Valcke, 2006 ). However, the meta-analysis results also indicate that once the group size exceeds 7 people, small groups cannot produce better interaction and performance than large groups. This may be because the learning scaffolds of technique support, resource support, and teacher support improve the frequency and effectiveness of interaction among group members, and a collaborative group with more members may increase the diversity of views, which is helpful to cultivate critical thinking utilizing the approach of collaborative problem-solving.

With regard to the learning scaffold, the three different kinds of learning scaffolds can all enhance critical thinking. Among them, the teacher-supported learning scaffold has the largest overall effect size, demonstrating the interdependence of effective learning scaffolds and collaborative problem-solving. This outcome is in line with some research findings; as an example, a successful strategy is to encourage learners to collaborate, come up with solutions, and develop critical thinking skills by using learning scaffolds (Reiser, 2004 ; Xu et al., 2022 ); learning scaffolds can lower task complexity and unpleasant feelings while also enticing students to engage in learning activities (Wood et al., 2006 ); learning scaffolds are designed to assist students in using learning approaches more successfully to adapt the collaborative problem-solving process, and the teacher-supported learning scaffolds have the greatest influence on critical thinking in this process because they are more targeted, informative, and timely (Xu et al., 2022 ).

With respect to the measuring tool, despite the fact that standardized measurement tools (such as the WGCTA, CCTT, and CCTST) have been acknowledged as trustworthy and effective by worldwide experts, only 54.43% of the research included in this meta-analysis adopted them for assessment, and the results indicated no intergroup differences. These results suggest that not all teaching circumstances are appropriate for measuring critical thinking using standardized measurement tools. “The measuring tools for measuring thinking ability have limits in assessing learners in educational situations and should be adapted appropriately to accurately assess the changes in learners’ critical thinking.”, according to Simpson and Courtney ( 2002 , p. 91). As a result, in order to more fully and precisely gauge how learners’ critical thinking has evolved, we must properly modify standardized measuring tools based on collaborative problem-solving learning contexts.

With regard to the subject area, the comprehensive effect size of science departments (e.g., mathematics, science, medical science) is larger than that of language arts and social sciences. Some recent international education reforms have noted that critical thinking is a basic part of scientific literacy. Students with scientific literacy can prove the rationality of their judgment according to accurate evidence and reasonable standards when they face challenges or poorly structured problems (Kyndt et al., 2013 ), which makes critical thinking crucial for developing scientific understanding and applying this understanding to practical problem solving for problems related to science, technology, and society (Yore et al., 2007 ).

Suggestions for critical thinking teaching

Other than those stated in the discussion above, the following suggestions are offered for critical thinking instruction utilizing the approach of collaborative problem-solving.

First, teachers should put a special emphasis on the two core elements, which are collaboration and problem-solving, to design real problems based on collaborative situations. This meta-analysis provides evidence to support the view that collaborative problem-solving has a strong synergistic effect on promoting students’ critical thinking. Asking questions about real situations and allowing learners to take part in critical discussions on real problems during class instruction are key ways to teach critical thinking rather than simply reading speculative articles without practice (Mulnix, 2012 ). Furthermore, the improvement of students’ critical thinking is realized through cognitive conflict with other learners in the problem situation (Yang et al., 2008 ). Consequently, it is essential for teachers to put a special emphasis on the two core elements, which are collaboration and problem-solving, and design real problems and encourage students to discuss, negotiate, and argue based on collaborative problem-solving situations.

Second, teachers should design and implement mixed courses to cultivate learners’ critical thinking, utilizing the approach of collaborative problem-solving. Critical thinking can be taught through curriculum instruction (Kuncel, 2011 ; Leng and Lu, 2020 ), with the goal of cultivating learners’ critical thinking for flexible transfer and application in real problem-solving situations. This meta-analysis shows that mixed course teaching has a highly substantial impact on the cultivation and promotion of learners’ critical thinking. Therefore, teachers should design and implement mixed course teaching with real collaborative problem-solving situations in combination with the knowledge content of specific disciplines in conventional teaching, teach methods and strategies of critical thinking based on poorly structured problems to help students master critical thinking, and provide practical activities in which students can interact with each other to develop knowledge construction and critical thinking utilizing the approach of collaborative problem-solving.

Third, teachers should be more trained in critical thinking, particularly preservice teachers, and they also should be conscious of the ways in which teachers’ support for learning scaffolds can promote critical thinking. The learning scaffold supported by teachers had the greatest impact on learners’ critical thinking, in addition to being more directive, targeted, and timely (Wood et al., 2006 ). Critical thinking can only be effectively taught when teachers recognize the significance of critical thinking for students’ growth and use the proper approaches while designing instructional activities (Forawi, 2016 ). Therefore, with the intention of enabling teachers to create learning scaffolds to cultivate learners’ critical thinking utilizing the approach of collaborative problem solving, it is essential to concentrate on the teacher-supported learning scaffolds and enhance the instruction for teaching critical thinking to teachers, especially preservice teachers.

Implications and limitations

There are certain limitations in this meta-analysis, but future research can correct them. First, the search languages were restricted to English and Chinese, so it is possible that pertinent studies that were written in other languages were overlooked, resulting in an inadequate number of articles for review. Second, these data provided by the included studies are partially missing, such as whether teachers were trained in the theory and practice of critical thinking, the average age and gender of learners, and the differences in critical thinking among learners of various ages and genders. Third, as is typical for review articles, more studies were released while this meta-analysis was being done; therefore, it had a time limit. With the development of relevant research, future studies focusing on these issues are highly relevant and needed.

Conclusions

The subject of the magnitude of collaborative problem-solving’s impact on fostering students’ critical thinking, which received scant attention from other studies, was successfully addressed by this study. The question of the effectiveness of collaborative problem-solving in promoting students’ critical thinking was addressed in this study, which addressed a topic that had gotten little attention in earlier research. The following conclusions can be made:

Regarding the results obtained, collaborative problem solving is an effective teaching approach to foster learners’ critical thinking, with a significant overall effect size (ES = 0.82, z  = 12.78, P  < 0.01, 95% CI [0.69, 0.95]). With respect to the dimensions of critical thinking, collaborative problem-solving can significantly and effectively improve students’ attitudinal tendency, and the comprehensive effect is significant (ES = 1.17, z  = 7.62, P  < 0.01, 95% CI [0.87, 1.47]); nevertheless, it falls short in terms of improving students’ cognitive skills, having only an upper-middle impact (ES = 0.70, z  = 11.55, P  < 0.01, 95% CI [0.58, 0.82]).

As demonstrated by both the results and the discussion, there are varying degrees of beneficial effects on students’ critical thinking from all seven moderating factors, which were found across 36 studies. In this context, the teaching type (chi 2  = 7.20, P  < 0.05), intervention duration (chi 2  = 12.18, P  < 0.01), subject area (chi 2  = 13.36, P  < 0.05), group size (chi 2  = 8.77, P  < 0.05), and learning scaffold (chi 2  = 9.03, P  < 0.01) all have a positive impact on critical thinking, and they can be viewed as important moderating factors that affect how critical thinking develops. Since the learning stage (chi 2  = 3.15, P  = 0.21 > 0.05) and measuring tools (chi 2  = 0.08, P  = 0.78 > 0.05) did not demonstrate any significant intergroup differences, we are unable to explain why these two factors are crucial in supporting the cultivation of critical thinking in the context of collaborative problem-solving.

Data availability

All data generated or analyzed during this study are included within the article and its supplementary information files, and the supplementary information files are available in the Dataverse repository: https://doi.org/10.7910/DVN/IPFJO6 .

Bensley DA, Spero RA (2014) Improving critical thinking skills and meta-cognitive monitoring through direct infusion. Think Skills Creat 12:55–68. https://doi.org/10.1016/j.tsc.2014.02.001

Article   Google Scholar  

Castle A (2009) Defining and assessing critical thinking skills for student radiographers. Radiography 15(1):70–76. https://doi.org/10.1016/j.radi.2007.10.007

Chen XD (2013) An empirical study on the influence of PBL teaching model on critical thinking ability of non-English majors. J PLA Foreign Lang College 36 (04):68–72

Google Scholar  

Cohen A (1992) Antecedents of organizational commitment across occupational groups: a meta-analysis. J Organ Behav. https://doi.org/10.1002/job.4030130602

Cooper H (2010) Research synthesis and meta-analysis: a step-by-step approach, 4th edn. Sage, London, England

Cindy HS (2004) Problem-based learning: what and how do students learn? Educ Psychol Rev 51(1):31–39

Duch BJ, Gron SD, Allen DE (2001) The power of problem-based learning: a practical “how to” for teaching undergraduate courses in any discipline. Stylus Educ Sci 2:190–198

Ennis RH (1989) Critical thinking and subject specificity: clarification and needed research. Educ Res 18(3):4–10. https://doi.org/10.3102/0013189x018003004

Facione PA (1990) Critical thinking: a statement of expert consensus for purposes of educational assessment and instruction. Research findings and recommendations. Eric document reproduction service. https://eric.ed.gov/?id=ed315423

Facione PA, Facione NC (1992) The California Critical Thinking Dispositions Inventory (CCTDI) and the CCTDI test manual. California Academic Press, Millbrae, CA

Forawi SA (2016) Standard-based science education and critical thinking. Think Skills Creat 20:52–62. https://doi.org/10.1016/j.tsc.2016.02.005

Halpern DF (2001) Assessing the effectiveness of critical thinking instruction. J Gen Educ 50(4):270–286. https://doi.org/10.2307/27797889

Hu WP, Liu J (2015) Cultivation of pupils’ thinking ability: a five-year follow-up study. Psychol Behav Res 13(05):648–654. https://doi.org/10.3969/j.issn.1672-0628.2015.05.010

Huber K (2016) Does college teach critical thinking? A meta-analysis. Rev Educ Res 86(2):431–468. https://doi.org/10.3102/0034654315605917

Kek MYCA, Huijser H (2011) The power of problem-based learning in developing critical thinking skills: preparing students for tomorrow’s digital futures in today’s classrooms. High Educ Res Dev 30(3):329–341. https://doi.org/10.1080/07294360.2010.501074

Kuncel NR (2011) Measurement and meaning of critical thinking (Research report for the NRC 21st Century Skills Workshop). National Research Council, Washington, DC

Kyndt E, Raes E, Lismont B, Timmers F, Cascallar E, Dochy F (2013) A meta-analysis of the effects of face-to-face cooperative learning. Do recent studies falsify or verify earlier findings? Educ Res Rev 10(2):133–149. https://doi.org/10.1016/j.edurev.2013.02.002

Leng J, Lu XX (2020) Is critical thinking really teachable?—A meta-analysis based on 79 experimental or quasi experimental studies. Open Educ Res 26(06):110–118. https://doi.org/10.13966/j.cnki.kfjyyj.2020.06.011

Liang YZ, Zhu K, Zhao CL (2017) An empirical study on the depth of interaction promoted by collaborative problem solving learning activities. J E-educ Res 38(10):87–92. https://doi.org/10.13811/j.cnki.eer.2017.10.014

Lipsey M, Wilson D (2001) Practical meta-analysis. International Educational and Professional, London, pp. 92–160

Liu Z, Wu W, Jiang Q (2020) A study on the influence of problem based learning on college students’ critical thinking-based on a meta-analysis of 31 studies. Explor High Educ 03:43–49

Morris SB (2008) Estimating effect sizes from pretest-posttest-control group designs. Organ Res Methods 11(2):364–386. https://doi.org/10.1177/1094428106291059

Article   ADS   Google Scholar  

Mulnix JW (2012) Thinking critically about critical thinking. Educ Philos Theory 44(5):464–479. https://doi.org/10.1111/j.1469-5812.2010.00673.x

Naber J, Wyatt TH (2014) The effect of reflective writing interventions on the critical thinking skills and dispositions of baccalaureate nursing students. Nurse Educ Today 34(1):67–72. https://doi.org/10.1016/j.nedt.2013.04.002

National Research Council (2012) Education for life and work: developing transferable knowledge and skills in the 21st century. The National Academies Press, Washington, DC

Niu L, Behar HLS, Garvan CW (2013) Do instructional interventions influence college students’ critical thinking skills? A meta-analysis. Educ Res Rev 9(12):114–128. https://doi.org/10.1016/j.edurev.2012.12.002

Peng ZM, Deng L (2017) Towards the core of education reform: cultivating critical thinking skills as the core of skills in the 21st century. Res Educ Dev 24:57–63. https://doi.org/10.14121/j.cnki.1008-3855.2017.24.011

Reiser BJ (2004) Scaffolding complex learning: the mechanisms of structuring and problematizing student work. J Learn Sci 13(3):273–304. https://doi.org/10.1207/s15327809jls1303_2

Ruggiero VR (2012) The art of thinking: a guide to critical and creative thought, 4th edn. Harper Collins College Publishers, New York

Schellens T, Valcke M (2006) Fostering knowledge construction in university students through asynchronous discussion groups. Comput Educ 46(4):349–370. https://doi.org/10.1016/j.compedu.2004.07.010

Sendag S, Odabasi HF (2009) Effects of an online problem based learning course on content knowledge acquisition and critical thinking skills. Comput Educ 53(1):132–141. https://doi.org/10.1016/j.compedu.2009.01.008

Sison R (2008) Investigating Pair Programming in a Software Engineering Course in an Asian Setting. 2008 15th Asia-Pacific Software Engineering Conference, pp. 325–331. https://doi.org/10.1109/APSEC.2008.61

Simpson E, Courtney M (2002) Critical thinking in nursing education: literature review. Mary Courtney 8(2):89–98

Stewart L, Tierney J, Burdett S (2006) Do systematic reviews based on individual patient data offer a means of circumventing biases associated with trial publications? Publication bias in meta-analysis. John Wiley and Sons Inc, New York, pp. 261–286

Tiwari A, Lai P, So M, Yuen K (2010) A comparison of the effects of problem-based learning and lecturing on the development of students’ critical thinking. Med Educ 40(6):547–554. https://doi.org/10.1111/j.1365-2929.2006.02481.x

Wood D, Bruner JS, Ross G (2006) The role of tutoring in problem solving. J Child Psychol Psychiatry 17(2):89–100. https://doi.org/10.1111/j.1469-7610.1976.tb00381.x

Wei T, Hong S (2022) The meaning and realization of teachable critical thinking. Educ Theory Practice 10:51–57

Xu EW, Wang W, Wang QX (2022) A meta-analysis of the effectiveness of programming teaching in promoting K-12 students’ computational thinking. Educ Inf Technol. https://doi.org/10.1007/s10639-022-11445-2

Yang YC, Newby T, Bill R (2008) Facilitating interactions through structured web-based bulletin boards: a quasi-experimental study on promoting learners’ critical thinking skills. Comput Educ 50(4):1572–1585. https://doi.org/10.1016/j.compedu.2007.04.006

Yore LD, Pimm D, Tuan HL (2007) The literacy component of mathematical and scientific literacy. Int J Sci Math Educ 5(4):559–589. https://doi.org/10.1007/s10763-007-9089-4

Zhang T, Zhang S, Gao QQ, Wang JH (2022) Research on the development of learners’ critical thinking in online peer review. Audio Visual Educ Res 6:53–60. https://doi.org/10.13811/j.cnki.eer.2022.06.08

Download references

Acknowledgements

This research was supported by the graduate scientific research and innovation project of Xinjiang Uygur Autonomous Region named “Research on in-depth learning of high school information technology courses for the cultivation of computing thinking” (No. XJ2022G190) and the independent innovation fund project for doctoral students of the College of Educational Science of Xinjiang Normal University named “Research on project-based teaching of high school information technology courses from the perspective of discipline core literacy” (No. XJNUJKYA2003).

Author information

Authors and affiliations.

College of Educational Science, Xinjiang Normal University, 830017, Urumqi, Xinjiang, China

Enwei Xu, Wei Wang & Qingxia Wang

You can also search for this author in PubMed   Google Scholar

Corresponding authors

Correspondence to Enwei Xu or Wei Wang .

Ethics declarations

Competing interests.

The authors declare no competing interests.

Ethical approval

This article does not contain any studies with human participants performed by any of the authors.

Informed consent

Additional information.

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Supplementary tables, rights and permissions.

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ .

Reprints and permissions

About this article

Cite this article.

Xu, E., Wang, W. & Wang, Q. The effectiveness of collaborative problem solving in promoting students’ critical thinking: A meta-analysis based on empirical literature. Humanit Soc Sci Commun 10 , 16 (2023). https://doi.org/10.1057/s41599-023-01508-1

Download citation

Received : 07 August 2022

Accepted : 04 January 2023

Published : 11 January 2023

DOI : https://doi.org/10.1057/s41599-023-01508-1

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

This article is cited by

Exploring the effects of digital technology on deep learning: a meta-analysis.

Education and Information Technologies (2024)

Sustainable electricity generation and farm-grid utilization from photovoltaic aquaculture: a bibliometric analysis

• A. A. Amusa
• M. Alhassan

International Journal of Environmental Science and Technology (2024)

Impacts of online collaborative learning on students’ intercultural communication apprehension and intercultural communicative competence

• Hoa Thi Hoang Chau
• Hung Phu Bui
• Quynh Thi Huong Dinh

Education and Information Technologies (2023)

Quick links

• Explore articles by subject
• Guide to authors
• Editorial policies

• SUGGESTED TOPICS
• The Magazine
• Newsletters
• Managing Yourself
• Managing Teams
• Work-life Balance
• The Big Idea
• Data & Visuals
• Reading Lists
• Case Selections
• HBR Learning
• Topic Feeds
• Account Settings
• Email Preferences

Research: How Different Fields Are Using GenAI to Redefine Roles

• Maryam Alavi

Examples from customer support, management consulting, professional writing, legal analysis, and software and technology.

The interactive, conversational, analytical, and generative features of GenAI offer support for creativity, problem-solving, and processing and digestion of large bodies of information. Therefore, these features can act as cognitive resources for knowledge workers. Moreover, the capabilities of GenAI can mitigate various hindrances to effective performance that knowledge workers may encounter in their jobs, including time pressure, gaps in knowledge and skills, and negative feelings (such as boredom stemming from repetitive tasks or frustration arising from interactions with dissatisfied customers). Empirical research and field observations have already begun to reveal the value of GenAI capabilities and their potential for job crafting.

There is an expectation that implementing new and emerging Generative AI (GenAI) tools enhances the effectiveness and competitiveness of organizations. This belief is evidenced by current and planned investments in GenAI tools, especially by firms in knowledge-intensive industries such as finance, healthcare, and entertainment, among others. According to forecasts, enterprise spending on GenAI will increase by two-fold in 2024 and grow to $151.1 billion by 2027 .

• Maryam Alavi is the Elizabeth D. & Thomas M. Holder Chair & Professor of IT Management, Scheller College of Business, Georgia Institute of Technology .

Partner Center

The influence of cognitive apprenticeship learning models on students’ problem-solving skills in optical instruments

• Split-Screen
• Article contents
• Figures & tables
• Supplementary Data
• Peer Review
• Open the PDF for in another window
• Reprints and Permissions
• Cite Icon Cite
• Search Site

Amalia Izzatul Isma , Ai Nurlaela; The influence of cognitive apprenticeship learning models on students’ problem-solving skills in optical instruments. AIP Conf. Proc. 5 April 2024; 3058 (1): 020026. https://doi.org/10.1063/5.0202981

Download citation file:

• Ris (Zotero)
• Reference Manager

The main topics of this research are the low problem-solving skills of students and the models used by teachers in the classroom do not train learners’ problem-solving skills. The aims of this research are to find out the influence, improvement, and responses of cognitive apprenticeship learning models on students’ problem-solving skills on optical instruments . The research was conducted at MA Al-Amiriyyah for three weeks in June 2021 with a sample of 48 students. Samples were taken by purposive sampling consisting of 23 students of class XI MIA 2 (control class) and 25 students of XI MIA 3 (experimental class). The research method used was a quasi-experimental research design with a nonequivalent control group design. The hypothesis testing results on the results of posttest data using the Mann Whitney U test at a significance level of 5% with the conclusion H 0 is rejected that shows cognitive apprenticeship learning models is effect on students’ problem-solving skills. Students’ problem-solving skill in the experimental class increased (N-gain 0,56 moderate category) than the control class students (N-gain 0,09 low category). Using cognitive apprenticeship learning models make students enthusiastic to study by 85%.

Citing articles via

Publish with us - request a quote.

Sign up for alerts

• Online ISSN 1551-7616
• Print ISSN 0094-243X
• For Researchers
• For Librarians
• For Advertisers
• Our Publishing Partners  
• Physics Today
• Conference Proceedings
• Special Topics

pubs.aip.org

• Privacy Policy
• Terms of Use

Connect with AIP Publishing

This feature is available to subscribers only.

Sign In or Create an Account

IOE - Faculty of Education and Society

• Departments and centres
• Innovation and enterprise
• Teacher Education College

AI-driven personalised support to learning beyond problem solving

16 May 2024, 12:30 pm–1:30 pm

Join this event to hear Cristina Conati discuss how AI-based educational technology can effectively provide personalised support to help students learn problem-solving skills in various domains.

This event is free.

Event Information

Availability.

There is increasing interest in AI-based environments to support educational activities, such as those more exploratory in nature, like learning from interactive simulations or playing educational games. However, not all learners benefit may benefit from AI-driven personalised support that can help those who need it while maintaining the unconstrained nature of the interaction.

In this talk, Cristina will discuss the unique challenges of this endeavour and a proposed solution based on data-driven AI models that can detect and react to behaviors indicating that a learner is struggling with the exploratory process. This will include a summary of results on applying this approach to various exploratory environments and on making such models explainable to their end users, with explanations personalised to each user’s specific needs.

This event will be particularly useful for researchers, educators, teachers and students.

Please note this is a hybrid event and can be joined either in-person or online.

Related links

• UCL Knowledge Lab
• Culture, Communication and Media

About the Speaker

Dr cristina conati.

Professor of Computer Science at the University of British Columbia, Vancouver, Canada

She has been researching human-centered and AI-driven personalisation for over 25 years, with contributions in the areas of Intelligent Tutoring Systems, User Modeling, Affective Computing, Information Visualization and Explainable AI.

Related News

Related events, related case studies, related research projects, press and media enquiries.

UCL Media Relations +44 (0)7747 565 056