5 Structured Thinking Techniques for Data Scientists
Try 1 of these 5 structured thinking techniques as you wrestle with your next data science project.
Structured thinking is a framework for solving unstructured problems — which covers just about all data science problems. Using a structured approach to solve problems not only only helps solve problems faster but also helps identify the parts of the problem that may need some extra attention.
Think of structured thinking like the map of a city you’re visiting for the first time.Without a map, you’ll probably find it difficult to reach your destination. Even if you did eventually reach your destination, it’ll probably take you at least double the time.
What Is Structured Thinking?
Here’s where the analogy breaks down: Structured thinking is a framework and not a fixed mindset; you can modify these techniques based on the problem you’re trying to solve. Let’s look at five structured thinking techniques to use in your next data science project .
- Six Step Problem Solving Model
- Eight Disciplines of Problem Solving
- The Drill Down Technique
- The Cynefin Framework
- The 5 Whys Technique
More From Sara A. Metwalli 3 Reasons Data Scientists Need Linear Algebra
1. Six Step Problem Solving Model
This technique is the simplest and easiest to use. As the name suggests, this technique uses six steps to solve a problem, which are:
Have a clear and concise problem definition.
Study the roots of the problem.
Brainstorm possible solutions to the problem.
Examine the possible solution and choose the best one.
Implement the solution effectively.
Evaluate the results.
This model follows the mindset of continuous development and improvement. So, on step six, if your results didn’t turn out the way you wanted, go back to step four and choose another solution (or to step one and try to define the problem differently).
My favorite part about this simple technique is how easy it is to alter based on the specific problem you’re attempting to solve.
We’ve Got Your Data Science Professionalization Right Here 4 Types of Projects You Need in Your Data Science Portfolio
2. Eight Disciplines of Problem Solving
The eight disciplines of problem solving offers a practical plan to solve a problem using an eight-step process. You can think of this technique as an extended, more-detailed version of the six step problem-solving model.
Each of the eight disciplines in this process should move you a step closer to finding the optimal solution to your problem. So, after you’ve got the prerequisites of your problem, you can follow disciplines D1-D8.
D1 : Put together your team. Having a team with the skills to solve the project can make moving forward much easier.
D2 : Define the problem. Describe the problem using quantifiable terms: the who, what, where, when, why and how.
D3 : Develop a working plan.
D4 : Determine and identify root causes. Identify the root causes of the problem using cause and effect diagrams to map causes against their effects.
D5 : Choose and verify permanent corrections. Based on the root causes, assess the work plan you developed earlier and edit as needed.
D6 : Implement the corrected action plan.
D7 : Assess your results.
D8 : Congratulate your team. After the end of a project, it’s essential to take a step back and appreciate the work you’ve all done before jumping into a new project.
3. The Drill Down Technique
The drill down technique is more suitable for large, complex problems with multiple collaborators. The whole purpose of using this technique is to break down a problem to its roots to make finding solutions that much easier. To use the drill down technique, you first need to create a table. The first column of the table will contain the outlined definition of the problem, followed by a second column containing the factors causing this problem. Finally, the third column will contain the cause of the second column's contents, and you’ll continue to drill down on each column until you reach the root of the problem.
Once you reach the root causes of the symptoms, you can begin developing solutions for the bigger problem.
On That Note . . . 4 Essential Skills Every Data Scientist Needs
4. The Cynefin Framework
The Cynefin framework, like the rest of the techniques, works by breaking down a problem into its root causes to reach an efficient solution. We consider the Cynefin framework a higher-level approach because it requires you to place your problem into one of five contexts.
- Obvious Contexts. In this context, your options are clear, and the cause-and-effect relationships are apparent and easy to point out.
- Complicated Contexts. In this context, the problem might have several correct solutions. In this case, a clear relationship between cause and effect may exist, but it’s not equally apparent to everyone.
- Complex Contexts. If it’s impossible to find a direct answer to your problem, then you’re looking at a complex context. Complex contexts are problems that have unpredictable answers. The best approach here is to follow a trial and error approach.
- Chaotic Contexts. In this context, there is no apparent relationship between cause and effect and our main goal is to establish a correlation between the causes and effects.
- Disorder. The final context is disorder, the most difficult of the contexts to categorize. The only way to diagnose disorder is to eliminate the other contexts and gather further information.
Get the Job You Want. We Can Help. Apply for Data Science Jobs on Built In
5. The 5 Whys Technique
Our final technique is the 5 Whys or, as I like to call it, the curious child approach. I think this is the most well-known and natural approach to problem solving.
This technique follows the simple approach of asking “why” five times — like a child would. First, you start with the main problem and ask why it occurred. Then you keep asking why until you reach the root cause of said problem. (Fair warning, you may need to ask more than five whys to find your answer.)
IMAGES
VIDEO
COMMENTS
From my perspective, problem-solving for a data scientist is: more about “how to abstract the problem out of the business context”, not just “be handed with a specific task” more about “solve the problem with an algorithm”, not just “use the best algorithm to solve a problem”
The data science framework and associated research processes are fundamentally tied to practical problem solving, highlight data discovery as an essential but often overlooked step in most data science frameworks, and, incorporate ethical considerations as a critical feature to the research.
In this article, my aim is to use real-world use cases to help you understand the key aspects of solving a data science problem. We will also see how these would assist in identifying and solving the core business problem.
Structured thinking is a framework for solving unstructured problems — which covers just about all data science problems. Using a structured approach to solve problems not only only helps solve problems faster but also helps identify the parts of the problem that may need some extra attention.
Those problems do not go away. However, with the right resources and practice, your problem-solving skills will become more effective and efficient. This article provides a collection of different strategies for helping you build your problem-solving skills when working with data.
Definition, Examples, Tools & More. Data science is an interdisciplinary field that uses scientific methods, processes, algorithms, and systems to extract knowledge and insights from structured and unstructured data. Jul 10, 2023 · 15 min read.