Start studying
Module 13 · Data Engineering Basics Module contents
Module 13  ·  Card 11 / 13intermediate

ELT Pipelines

ELT loads raw data into the destination first and transforms it there, swapping the last 2 steps of ETL.

It relies on a warehouse powerful enough to do the heavy transformation work itself.

For example, raw order data lands in the warehouse untouched, and SQL models then build clean tables from it.

Keeping the raw data means transformations can be rerun or changed later without extracting everything again.

Tools such as dbt manage these SQL transformations as code, with tests that run after every change.

Learn in depth ↓
Module 13 · Data Engineering Basics · 13 concepts
In depth  /  15 lines

ELT Pipelines, in more detail

ELT swaps the last 2 steps, loading raw data first and transforming it inside the warehouse.

It relies on the warehouse's own computing power, which can be large and paid for by use.

The raw data stays in the warehouse, so every transformation can be rebuilt from it.

Extraction and loading are often handled by ready-made connectors that copy whole sources.

Transformations are written as SQL that builds clean tables from raw ones.

These SQL models are layered, from lightly cleaned staging tables to final tables for reports.

dbt is a widely used tool that manages these models, runs them in order and tests the results.

Tests check things such as unique keys and no blanks in required columns after every run.

Writing transformations as code makes them reviewable, repeatable and easy to change.

Because analysts know SQL, they can own transformations without a separate engineering team.

Raw data in the warehouse includes everything, so access to sensitive columns must be controlled.

Warehouse costs rise with heavy transformations, so careless models can be expensive.

Storing raw and transformed copies uses more space, though warehouse storage is usually cheap.

In practice, ELT is a common pattern with cloud warehouses.

The usual mistake is loading raw data and never building tested models, leaving analysts to clean it again in every query.

Want the full technical article? Wikipedia ↗
Test yourself

One question on this card. Every option explains itself once you pick, right or wrong.

Question 1
Why do teams using ELT keep the raw data in the warehouse after transforming it?
Data Engineering Basics

13 concepts in this module, then a graded test with every answer explained.

Study this module →
↑↓ move↵ openesc close