Start studying
Module 14 · Data Science in Practice Module contents
Module 14  ·  Card 1 / 12beginner

Exploratory Data Analysis

Exploratory data analysis is the first open-ended look at a dataset, to learn what it contains before testing any idea.

It combines profiling, summary statistics and quick charts of each column and of key pairs of columns.

For example, exploring a subscriptions table might reveal that most cancellations happen in the first month.

Its goal is questions and hypotheses, not final answers, so its findings are checked properly afterwards.

Skipping it leads to analyses built on data nobody understood, such as averages that include impossible values.

Learn in depth ↓
Module 14 · Data Science in Practice · 12 concepts
In depth  /  15 lines

Exploratory Data Analysis, in more detail

Exploratory data analysis is how an analyst gets to know a dataset before trusting it with a question.

It exists because data rarely matches its description, and surprises are cheaper to find early.

It also produces the questions that later analysis tests properly.

A typical pass starts with the shape of the data: rows, columns, types and blanks.

Each numeric column gets summary statistics and a histogram, and each category gets value counts.

Key pairs of columns get scatter plots or grouped summaries, such as revenue by region.

Data recorded over time gets a line chart, to spot trends, seasons and breaks.

Outliers, impossible values and odd spikes are noted and investigated, not deleted on sight.

Each finding is written down as a question, such as why churn doubles in March.

Exploration is open-ended, so it is easy to find patterns that are only noise.

Treating an exploratory pattern as proven is the multiple testing problem in disguise.

Findings should be confirmed on fresh data or with a planned test before anyone acts on them.

Keeping exploration in a notebook, with notes beside each chart, makes it easy to revisit.

In practice, a short summary of what was explored and what was surprising helps the rest of the team.

The usual mistake is skipping exploration under time pressure, then finding a data problem after the results are published.

Want the full technical article? Wikipedia ↗
Test yourself

One question on this card. Every option explains itself once you pick, right or wrong.

Question 1
An analyst receives a new subscriptions table and is asked why revenue is falling. What should come first?
Data Science in Practice

12 concepts in this module, then a graded test with every answer explained.

Study this module →
↑↓ move↵ openesc close