Problem Solving - Wikipedia
Problem Solving - Wikipedia
Problem solving is the process of achieving a goal by overcoming obstacles, a frequent part of most activities. Problems in
need of solutions range from simple personal tasks (e.g. how to turn on an appliance) to complex issues in business and
technical fields. The former is an example of simple problem solving (SPS) addressing one issue, whereas the latter is
[1]
complex problem solving (CPS) with multiple interrelated obstacles. Another classification of problem-solving tasks is
into well-defined problems with specific obstacles and goals, and ill-defined problems in which the current situation is
[2]
troublesome but it is not clear what kind of resolution to aim for. Similarly, one may distinguish formal or fact-based
problems requiring psychometric intelligence, versus socio-emotional problems which depend on the changeable emotions of
[3]
individuals or groups, such as tactful behavior, fashion, or gift choices.
Solutions require sufficient resources and knowledge to attain the goal. Professionals such as lawyers, doctors,
programmers, and consultants are largely problem solvers for issues that require technical skills and knowledge beyond
general competence. Many businesses have found profitable markets by recognizing a problem and creating a solution: the
more widespread and inconvenient the problem, the greater the opportunity to develop a scalable solution.
There are many specialized problem-solving techniques and methods in fields such as science, engineering, business,
medicine, mathematics, computer science, philosophy, and social organization. The mental techniques to identify, analyze,
and solve problems are studied in psychology and cognitive sciences. Also widely researched are the mental obstacles that
prevent people from finding solutions; problem-solving impediments include confirmation bias, mental set, and functional
fixedness.
Definition
The term problem solving has a slightly different meaning depending on the discipline. For instance, it is a mental process in
psychology and a computerized process in computer science. There are two different types of problems: ill-defined and
well-defined; different approaches are used for each. Well-defined problems have specific end goals and clearly expected
solutions, while ill-defined problems do not. Well-defined problems allow for more initial planning than ill-defined
[2]
problems. Solving problems sometimes involves dealing with pragmatics (the way that context contributes to meaning)
and semantics (the interpretation of the problem). The ability to understand what the end goal of the problem is, and what
rules could be applied, represents the key to solving the problem. Sometimes a problem requires abstract thinking or
Problem solving has two major domains: mathematical problem solving and personal problem solving. Each concerns some
[4]
difficulty or barrier that is encountered.
Psychology
[5]
Problem solving in psychology refers to the process of finding solutions to problems encountered in life. Solutions to
these problems are usually situation- or context-specific. The process starts with problem finding and problem shaping, in
which the problem is discovered and simplified. The next step is to generate possible solutions and evaluate them. Finally a
solution is selected to be implemented and verified. Problems have an end goal to be reached; how you get there depends
[6]
upon problem orientation (problem-solving coping style and skills) and systematic analysis.
Mental health professionals study the human problem-solving processes using methods such as introspection, behaviorism,
simulation, computer modeling, and experiment. Social psychologists look into the person-environment relationship aspect
[7]
of the problem and independent and interdependent problem-solving methods. Problem solving has been defined as a
higher-order cognitive process and intellectual function that requires the modulation and control of more routine or
[8]
fundamental skills.
[9]
Empirical research shows many different strategies and factors influence everyday problem solving. Rehabilitation
psychologists studying people with frontal lobe injuries have found that deficits in emotional control and reasoning can be
re-mediated with effective rehabilitation and could improve the capacity of injured persons to resolve everyday
[10]
problems. Interpersonal everyday problem solving is dependent upon personal motivational and contextual components.
One such component is the emotional valence of "real-world" problems, which can either impede or aid problem-solving
[11]
performance. Researchers have focused on the role of emotions in problem solving, demonstrating that poor emotional
control can disrupt focus on the target task, impede problem resolution, and lead to negative outcomes such as fatigue,
[12]
depression, and inertia. In conceptualization, human problem solving consists of two related processes: problem
[13]
orientation, and the motivational/attitudinal/affective approach to problematic situations and problem-solving skills.
[14]
People's strategies cohere with their goals and stem from the process of comparing oneself with others.
Cognitive sciences
Among the first experimental psychologists to study problem solving were the Gestaltists in Germany, such as Karl
[15]
Duncker in The Psychology of Productive Thinking (1935). Perhaps best known is the work of Allen Newell and
[16]
Herbert A. Simon.
Experiments in the 1960s and early 1970s asked participants to solve relatively simple, well-defined, but not previously
[17][18]
seen laboratory tasks. These simple problems, such as the Tower of Hanoi, admitted optimal solutions that could
be found quickly, allowing researchers to observe the full problem-solving process. Researchers assumed that these model
problems would elicit the characteristic cognitive processes by which more complex "real world" problems are solved.
[19]
An outstanding problem-solving technique found by this research is the principle of decomposition.
Computer science
Much of computer science and artificial intelligence involves designing automated systems to solve a specified type of
problem: to accept input data and calculate a correct or adequate response, reasonably quickly. Algorithms are recipes or
Steps for designing such systems include problem determination, heuristics, root cause analysis, de-duplication, analysis,
[20]
diagnosis, and repair. Analytic techniques include linear and nonlinear programming, queuing systems, and simulation. A
large, perennial obstacle is to find and fix errors in computer programs: debugging.
Logic
Formal logic concerns issues like validity, truth, inference, argumentation, and proof. In a problem-solving context, it can
be used to formally represent a problem as a theorem to be proved, and to represent the knowledge needed to solve the
problem as the premises to be used in a proof that the problem has a solution.
The use of computers to prove mathematical theorems using formal logic emerged as the field of automated theorem
proving in the 1950s. It included the use of heuristic methods designed to simulate human problem solving, as in the Logic
Theory Machine, developed by Allen Newell, Herbert A. Simon and J. C. Shaw, as well as algorithmic methods such as the
In addition to its use for finding proofs of mathematical theorems, automated theorem-proving has also been used for
program verification in computer science. In 1958, John McCarthy proposed the advice taker, to represent information in
formal logic and to derive answers to questions using automated theorem-proving. An important step in this direction was
made by Cordell Green in 1969, who used a resolution theorem prover for question-answering and for such other
The resolution theorem-prover used by Cordell Green bore little resemblance to human problem solving methods. In
response to criticism of that approach from researchers at MIT, Robert Kowalski developed logic programming and SLD
[21]
resolution, which solves problems by problem decomposition. He has advocated logic for both computer and human
[22] [23]
problem solving and computational logic to improve human thinking.
Engineering
When products or processes fail, problem solving techniques can be used to develop corrective actions that can be taken to
prevent further failures. Such techniques can also be applied to a product or process prior to an actual failure event—to
predict, analyze, and mitigate a potential problem in advance. Techniques such as failure mode and effects analysis can
deriving an explanation of effects in terms of causes, abduction generates new ideas or hypotheses (asking "how?");
deduction evaluates and refines hypotheses based on other plausible premises (asking "why?"); and induction justifies a
[24]
hypothesis with empirical data (asking "how much?"). The objective of abduction is to determine which hypothesis or
[25]
proposition to test, not which one to adopt or assert. In the Peircean logical system, the logic of abduction and
deduction contribute to our conceptual understanding of a phenomenon, while the logic of induction adds quantitative details
[26]
(empirical substantiation) to our conceptual knowledge.
Forensic engineering is an important technique of failure analysis that involves tracing product defects and flaws.
Reverse engineering attempts to discover the original problem-solving logic used in developing a product by disassembling
[27]
the product and developing a plausible pathway to creating and assembling its parts.
Military science
In military science, problem solving is linked to the concept of "end-states", the conditions or situations which are the
command and control level. It results from deep qualitative and quantitative understanding of possible scenarios.
[28]: IV-24
Effectiveness in this context is an evaluation of results: to what extent the end states were accomplished.
[28]: IV-1
Planning is the process of determining how to effect those end states.
Processes
Some models of problem solving involve identifying a goal and then a sequence of subgoals towards achieving this goal.
Andersson, who introduced the ACT-R model of cognition, modelled this collection of goals and subgoals as a goal stack in
which the mind contains a stack of goals and subgoals to be completed, and a single task being carried out at any
[29]: 51
time.
[29]: 56
Knowledge of how to solve one problem can be applied to another problem, in a process known as transfer.
Problem-solving strategies
Problem-solving strategies are steps to overcoming the obstacles to achieving a goal. The iteration of such strategies over
[30]
the course of solving a problem is the "problem-solving cycle".
Common steps in this cycle include recognizing the problem, defining it, developing a strategy to fix it, organizing knowledge
and resources available, monitoring progress, and evaluating the effectiveness of the solution. Once a solution is achieved,
through insight are often more incisive than those from step-by-step analysis. A quick solution process requires insight to
select productive moves at different stages of the problem-solving cycle. Unlike Newell and Simon's formal definition of a
[31]
move problem, there is no consensus definition of an insight problem.
[32]
Some problem-solving strategies include:
Abstraction
solving the problem in a tractable model system to gain insight into the real system
Analogy
adapting the solution to a previous problem which has similar features or mechanisms
Brainstorming
(especially among groups of people) suggesting a large number of solutions or ideas and combining and developing them
Bypasses
transform the problem into another problem that is easier to solve, bypassing the barrier, then transform that solution
Critical thinking
analysis of available evidence and arguments to form a judgement via rational, skeptical, and unbiased evaluation
Help-seeking
Hypothesis testing
assuming a possible explanation to the problem and trying to prove (or, in some contexts, disprove) the assumption
Lateral thinking
Means-ends analysis
Morphological analysis
Observation / Question
in the natural sciences an observation is an act or instance of noticing or perceiving and the acquisition of information
from a primary source. A question is an utterance which serves as a request for information.
Proof of impossibility
try to prove that the problem cannot be solved. The point where the proof fails will be the starting point for solving it
Reduction
transforming the problem into another problem for which solutions exist
Research
Trial-and-error
Problem-solving methods
Eight Disciplines Problem Solving – Eight disciplines of team-oriented problem solving method
Root cause analysis – Method of identifying the fundamental causes of faults or problems
RPR problem diagnosis – problem diagnosis method designed to determine the root cause of IT problems
Scientific method – is an empirical method for acquiring knowledge that has characterized the development of science.
Common barriers
Common barriers to problem solving include mental constructs that impede an efficient search for solutions. Five of the
most common identified by researchers are: confirmation bias, mental set, functional fixedness, unnecessary constraints,
Confirmation bias
Confirmation bias is an unintentional tendency to collect and use data which favors preconceived notions. Such notions may
[33]
be incidental rather than motivated by important personal beliefs: the desire to be right may be sufficient motivation.
Scientific and technical professionals also experience confirmation bias. One online experiment, for example, suggested that
professionals within the field of psychological research are likely to view scientific studies that agree with their
[34]
preconceived notions more favorably than clashing studies. According to Raymond Nickerson, one can see the
consequences of confirmation bias in real-life situations, which range in severity from inefficient government policies to
genocide. Nickerson argued that those who killed people accused of witchcraft demonstrated confirmation bias with
motivation. Researcher Michael Allen found evidence for confirmation bias with motivation in school children who worked
[35]
to manipulate their science experiments to produce favorable results.
However, confirmation bias does not necessarily require motivation. In 1960, Peter Cathcart Wason conducted an
experiment in which participants first viewed three numbers and then created a hypothesis in the form of a rule that
could have been used to create that triplet of numbers. When testing their hypotheses, participants tended to only create
additional triplets of numbers that would confirm their hypotheses, and tended not to create triplets that would negate
[36]
or disprove their hypotheses.
Mental set
Mental set is the inclination to re-use a previously successful solution, rather than search for new and better solutions. It
is a reliance on habit.
[37]
It was first articulated by Abraham S. Luchins in the 1940s with his well-known water jug experiments. Participants
were asked to fill one jug with a specific amount of water by using other jugs with different maximum capacities. After
Luchins gave a set of jug problems that could all be solved by a single technique, he then introduced a problem that could be
solved by the same technique, but also by a novel and simpler method. His participants tended to use the accustomed
[38]
technique, oblivious of the simpler alternative. This was again demonstrated in Norman Maier's 1931 experiment,
which challenged participants to solve a problem by using a familiar tool (pliers) in an unconventional manner. Participants
were often unable to view the object in a way that strayed from its typical use, a type of mental set known as functional
Rigidly clinging to a mental set is called fixation, which can deepen to an obsession or preoccupation with attempted
[39]
strategies that are repeatedly unsuccessful. In the late 1990s, researcher Jennifer Wiley found that professional
[39]
expertise in a field can create a mental set, perhaps leading to fixation.
Groupthink, in which each individual takes on the mindset of the rest of the group, can produce and exacerbate mental
[40]
set. Social pressure leads to everybody thinking the same thing and reaching the same conclusions.
Functional fixedness
Functional fixedness is the tendency to view an object as having only one function, and to be unable to conceive of any novel
use, as in the Maier pliers experiment described above. Functional fixedness is a specific form of mental set, and is one of
start searching for something to kill the bug instead of squashing it with the can, thinking only of its main function of
deodorizing.
Tim German and Clark Barrett describe this barrier: "subjects become 'fixed' on the design function of the objects, and
[41]
problem solving suffers relative to control conditions in which the object's function is not demonstrated." Their
[42]
research found that young children's limited knowledge of an object's intended function reduces this barrier Research
has also discovered functional fixedness in educational contexts, as an obstacle to understanding: "functional fixedness may
[43]
be found in learning concepts as well as in solving chemistry problems."
[44]
There are several hypotheses in regards to how functional fixedness relates to problem solving. It may waste time,
Unnecessary constraints
Unnecessary constraints are arbitrary boundaries imposed unconsciously on the task at hand, which foreclose a productive
avenue of solution. The solver may become fixated on only one type of solution, as if it were an inevitable requirement of
[45]
the problem. Typically, this combines with mental set—clinging to a previously successful method.
[46]
Visual problems can also produce mentally invented constraints. A famous example is the dot problem: nine dots
arranged in a three-by-three grid pattern must be connected by drawing four straight line segments, without lifting pen
from paper or backtracking along a line. The subject typically assumes the pen must stay within the outer square of dots,
but the solution requires lines continuing beyond this frame, and researchers have found a 0% solution rate within a brief
[47]
allotted time.
[48]
This problem has produced the expression "think outside the box". Such problems are typically solved via a sudden
[49]
insight which leaps over the mental barriers, often after long toil against them. This can be difficult depending on how
the subject has structured the problem in their mind, how they draw on past experiences, and how well they juggle this
information in their working memory. In the example, envisioning the dots connected outside the framing square requires
[48]
visualizing an unconventional arrangement, which is a strain on working memory.
Irrelevant information
[45]
Irrelevant information is a specification or data presented in a problem that is unrelated to the solution. If the solver
assumes that all information presented needs to be used, this often derails the problem solving process, making relatively
[50]
simple problems much harder.
For example: "Fifteen percent of the people in Topeka have unlisted telephone numbers. You select 200 names at random
[48]
from the Topeka phone book. How many of these people have unlisted phone numbers?" The "obvious" answer is 15%,
but in fact none of the unlisted people would be listed among the 200. This kind of "trick question" is often used in
[51]
aptitude tests or cognitive evaluations. Though not inherently difficult, they require independent thinking that is not
necessarily common. Mathematical word problems often include irrelevant qualitative or numerical information as an extra
challenge.
[51]
The disruption caused by the above cognitive biases can depend on how the information is represented: visually,
A Buddhist monk begins at dawn one day walking up a mountain, reaches the
top at sunset, meditates at the top for several days until one dawn when he
begins to walk back to the foot of the mountain, which he reaches at sunset.
Making no assumptions about his starting or stopping or about his pace during
the trips, prove that there is a place on the path which he occupies at the same
hour of the day on the two separate journeys.
The problem cannot be addressed in a verbal context, trying to describe the monk's progress on each day. It becomes much
easier when the paragraph is represented mathematically by a function: one visualizes a graph whose horizontal axis is
time of day, and whose vertical axis shows the monk's position (or altitude) on the path at each time. Superimposing the
two journey curves, which traverse opposite diagonals of a rectangle, one sees they must cross each other somewhere.
[45][52]
Similar strategies can often improve problem solving on tests.
People who are engaged in problem solving tend to overlook subtractive changes, even those that are critical elements of
efficient solutions. For example, a city planner may decide that the solution to decrease traffic congestion would be to add
another lane to a highway, rather than finding ways to reduce the need for the highway in the first place. This tendency to
solve by first, only, or mostly creating or adding elements, rather than by subtracting elements or processes is shown to
[53]
intensify with higher cognitive loads such as information overload.
People can also solve problems while they are asleep. There are many reports of scientists and engineers who solved
problems in their dreams. For example, Elias Howe, inventor of the sewing machine, figured out the structure of the
[54]
bobbin from a dream.
The chemist August Kekulé was considering how benzene arranged its six carbon and hydrogen atoms. Thinking about the
problem, he dozed off, and dreamt of dancing atoms that fell into a snakelike pattern, which led him to discover the
One of the snakes seized hold of its own tail, and the form whirled mockingly
before my eyes. As if by a flash of lightning I awoke; and this time also I spent the
rest of the night in working out the consequences of the hypothesis.[55]
There also are empirical studies of how people can think consciously about a problem before going to sleep, and then solve
the problem with a dream image. Dream researcher William C. Dement told his undergraduate class of 500 students that
he wanted them to think about an infinite series, whose first elements were OTTFF, to see if they could deduce the
[56]
principle behind it and to say what the next elements of the series would be. He asked them to think about this problem
every night for 15 minutes before going to sleep and to write down any dreams that they then had. They were instructed
to think about the problem again for 15 minutes when they awakened in the morning.
The sequence OTTFF is the first letters of the numbers: one, two, three, four, five. The next five elements of the series
are SSENT (six, seven, eight, nine, ten). Some of the students solved the puzzle by reflecting on their dreams. One
[56]
example was a student who reported the following dream:
I was standing in an art gallery, looking at the paintings on the wall. As I walked
down the hall, I began to count the paintings: one, two, three, four, five. As I
came to the sixth and seventh, the paintings had been ripped from their frames. I
stared at the empty frames with a peculiar feeling that some mystery was about
to be solved. Suddenly I realized that the sixth and seventh spaces were the
solution to the problem!
With more than 500 undergraduate students, 87 dreams were judged to be related to the problems students were
assigned (53 directly related and 34 indirectly related). Yet of the people who had dreams that apparently solved the
problem, only seven were actually able to consciously know the solution. The rest (46 out of 53) thought they did not
Albert Einstein believed that much problem solving goes on unconsciously, and the person must then figure out and
formulate consciously what the mindbrain has already solved. He believed this was his process in formulating the theory of
[57]
relativity: "The creator of the problem possesses the solution." Einstein said that he did his problem solving without
words, mostly in images. "The words or the language, as they are written or spoken, do not seem to play any role in my
mechanism of thought. The psychical entities which seem to serve as elements in thought are certain signs and more or
[58]
less clear images which can be 'voluntarily' reproduced and combined."
Cognitive sciences: two schools
[59]
Problem-solving processes differ across knowledge domains and across levels of expertise. For this reason, cognitive
sciences findings obtained in the laboratory cannot necessarily generalize to problem-solving situations outside the
laboratory. This has led to a research emphasis on real-world problem solving, since the 1990s. This emphasis has been
expressed quite differently in North America and Europe, however. Whereas North American research has typically
concentrated on studying problem solving in separate, natural knowledge domains, much of the European research has
[60]
focused on novel, complex problems, and has been performed with computerized scenarios.
Europe
[61]
In Europe, two main approaches have surfaced, one initiated by Donald Broadbent in the United Kingdom and the other
[62]
one by Dietrich Dörner in Germany. The two approaches share an emphasis on relatively complex, semantically rich,
computerized laboratory tasks, constructed to resemble real-life problems. The approaches differ somewhat in their
theoretical goals and methodology. The tradition initiated by Broadbent emphasizes the distinction between cognitive
problem-solving processes that operate under awareness versus outside of awareness, and typically employs
mathematically well-defined computerized systems. The tradition initiated by Dörner, on the other hand, has an interest
in the interplay of the cognitive, motivational, and social components of problem solving, and utilizes very complex
[63]
computerized scenarios that contain up to 2,000 highly interconnected variables.
North America
[64]
In North America, initiated by the work of Herbert A. Simon on "learning by doing" in semantically rich domains,
researchers began to investigate problem solving separately in different natural knowledge domains—such as physics,
[65]
writing, or chess playing—rather than attempt to extract a global theory of problem solving. These researchers have
[66]
focused on the development of problem solving within certain domains, that is on the development of expertise.
Areas that have attracted rather intensive attention in North America include:
[67]
calculation
[68]
computer skills
[69]
game playing
[70]
lawyers' reasoning
[71]
managerial problem solving
[72]
mathematical problem solving
[73]
mechanical problem solving
[74]
personal problem solving
[75]
political decision making
[76]
problem solving in electronics
[77]
problem solving for innovations and inventions: TRIZ
[78]
reading
[11]
social problem solving
[79]
writing
Complex problem solving (CPS) is distinguishable from simple problem solving (SPS). In SPS there is a singular and simple
obstacle. In CPS there may be multiple simultaneous obstacles. For example, a surgeon at work has far more complex
problems than an individual deciding what shoes to wear. As elucidated by Dietrich Dörner, and later expanded upon by
[1]
Joachim Funke, complex problems have some typical characteristics, which include:
enumerability
heterogeneity
temporal constraints
temporal sensitivity
phase effects
dynamic unpredictability
commencement opacity
continuation opacity
[80]
polytely (multiple goals)
inexpressivenes
opposition
transience
Collective problem solving
People solve problems on many different levels—from the individual to the civilizational. Collective problem solving refers
to problem solving performed collectively. Social issues and global issues can typically only be solved collectively.
The complexity of contemporary problems exceeds the cognitive capacity of any individual and requires different but
[81]
complementary varieties of expertise and collective problem solving ability.
Collective intelligence is shared or group intelligence that emerges from the collaboration, collective efforts, and
In collaborative problem solving people work together to solve real-world problems. Members of problem-solving groups
share a common concern, a similar passion, and/or a commitment to their work. Members can ask questions, wonder, and
[82]
try to understand common issues. They share expertise, experiences, tools, and methods. Groups may be fluid based on
need, may only occur temporarily to finish an assigned task, or may be more permanent depending on the nature of the
problems.
For example, in the educational context, members of a group may all have input into the decision-making process and a role
in the learning process. Members may be responsible for the thinking, teaching, and monitoring of all members in the group.
Group work may be coordinated among members so that each member makes an equal contribution to the whole work.
Members can identify and build on their individual strengths so that everyone can make a significant contribution to the
[83]
task. Collaborative group work has the ability to promote critical thinking skills, problem solving skills, social skills, and
self-esteem. By using collaboration and communication, members often learn from one another and construct meaningful
[84]
knowledge that often leads to better learning outcomes than individual work.
Collaborative groups require joint intellectual efforts between the members and involve social interactions to solve
problems together. The knowledge shared during these interactions is acquired during communication, negotiation, and
[85]
production of materials. Members actively seek information from others by asking questions. The capacity to use
[86]
questions to acquire new information increases understanding and the ability to solve problems.
In a 1962 research report, Douglas Engelbart linked collective intelligence to organizational effectiveness, and predicted
that proactively "augmenting human intellect" would yield a multiplier effect in group problem solving: "Three people
working together in this augmented mode [would] seem to be more than three times as effective in solving a complex
[87]
problem as is one augmented person working alone".
Henry Jenkins, a theorist of new media and media convergence, draws on the theory that collective intelligence can be
[88]
attributed to media convergence and participatory culture. He criticizes contemporary education for failing to
incorporate online trends of collective problem solving into the classroom, stating "whereas a collective intelligence
community encourages ownership of work as a group, schools grade individuals". Jenkins argues that interaction within a
knowledge community builds vital skills for young people, and teamwork through collective intelligence communities
[89]
contributes to the development of such skills.
Collective impact is the commitment of a group of actors from different sectors to a common agenda for solving a specific
After World War II the UN, the Bretton Woods organization, and the WTO were created. Collective problem solving on the
international level crystallized around these three types of organization from the 1980s onward. As these global
institutions remain state-like or state-centric it is unsurprising that they perpetuate state-like or state-centric
[90]
approaches to collective problem solving rather than alternative ones.
Crowdsourcing is a process of accumulating ideas, thoughts, or information from many independent participants, with aim
of finding the best solution for a given challenge. Modern information technologies allow for many people to be involved and
[91]
facilitate managing their suggestions in ways that provide good results. The Internet allows for a new capacity of
[92]
collective (including planetary-scale) problem solving.
See also
Philosophy portal
Psychology portal
Actuarial science – Statistics applied to risk in insurance and other financial products
Analytical skill – Crucial skill in all different fields of work and life
Community of practice
Coworking – Practice of independent contractors or scientists sharing office space without supervision
Grey problem – IT service problem where the causing technology is unknown or unconfirmed, making the problem solving
difficult to allocate