Start studying
Module 11 · Causal Inference Module contents
Module 11  ·  Card 10 / 13advanced

Propensity Score Matching

A propensity score is the estimated probability that a unit receives the treatment, given its measured characteristics.

Matching pairs each treated unit with an untreated one with a similar score, so the groups look alike on those characteristics.

For example, customers who joined a loyalty scheme are matched with non-members of similar age, spending and history.

Outcomes are then compared within the matched groups, as if the treatment had been assigned at random among them.

It only balances the characteristics that were measured, so an unmeasured confounder still biases the result.

Learn in depth ↓
Module 11 · Causal Inference · 13 concepts
In depth  /  15 lines

Propensity Score Matching, in more detail

Propensity score matching tries to make a comparison of self-chosen groups look like a randomised one.

It rests on the idea that units with the same chance of treatment can be compared fairly.

Matching on a single score is far easier than matching on many characteristics at once.

Step 1 estimates each unit's probability of treatment from its measured characteristics.

Step 2 pairs each treated unit with an untreated unit whose score is close.

Step 3 checks balance, confirming that the matched groups now have similar characteristics.

Step 4 compares outcomes between the matched groups.

Units with no close match, such as members unlike any non-member, are dropped.

That improves balance but means the estimate applies only to the units that were matched.

Weighting by the score is an alternative to matching that keeps more of the data.

The method assumes that every important confounder was measured and used.

It cannot fix unmeasured confounding, however good the matching looks.

Including variables that the treatment itself changes introduces bias rather than removing it.

In practice, tables comparing the groups before and after matching are the main evidence that the method worked.

The usual misconception is that matching makes data as good as a trial, when it only balances what was measured.

Want the full technical article? Wikipedia ↗
Test yourself

One question on this card. Every option explains itself once you pick, right or wrong.

Question 1
Loyalty scheme members are matched with non-members of similar age, spending and history. Members still spend more. What could still bias this?
Causal Inference

13 concepts in this module, then a graded test with every answer explained.

Study this module →
↑↓ move↵ openesc close