Start studying
Module 13 · Data Engineering Basics Module contents
Module 13  ·  Card 9 / 13intermediate

Data Lakehouses

A data lakehouse adds warehouse features, such as tables, schemas and reliable updates, on top of cheap lake storage.

Open table formats such as Delta Lake, Apache Iceberg and Apache Hudi track which files make up each table and each version of it.

For example, analysts can query tidy tables with SQL while data scientists read the same files directly.

Keeping one copy of the data avoids the cost and delay of moving it between a lake and a warehouse.

Storage, table format and query engine are separate pieces, so a lakehouse needs more engineering care than one warehouse.

Learn in depth ↓
Module 13 · Data Engineering Basics · 13 concepts
In depth  /  15 lines

Data Lakehouses, in more detail

Data lakehouses try to combine the low cost of a lake with the reliability of a warehouse.

They respond to the cost and drift of keeping the same data in both places.

The key piece is an open table format that sits on top of ordinary files.

The table format keeps a log of which files belong to each version of a table.

Writers add new files and update the log in one step, so readers never see half-finished changes.

That gives reliable updates and deletes, which plain lake files lack.

Old versions stay available, so a query can read a table exactly as it was last month.

The schema is stored and checked, so bad writes are rejected before they land.

Several query engines, such as Spark and SQL engines, can read the same tables.

Storage and computing stay separate, so each can be scaled and paid for on its own.

Small files and old versions pile up, so regular maintenance jobs combine and clean them.

Speed for interactive dashboards can still lag behind a dedicated warehouse in some cases.

Choosing a table format matters, since engines support them to different degrees.

In practice, teams adopt a lakehouse when they need both cheap raw storage and dependable tables.

The usual misconception is that a lakehouse removes the need for careful table design, when tables still need it.

Test yourself

One question on this card. Every option explains itself once you pick, right or wrong.

Question 1
A company copies data from its lake into a separate warehouse every night, and the 2 copies keep drifting apart. What does a lakehouse offer?
Data Engineering Basics

13 concepts in this module, then a graded test with every answer explained.

Study this module →
↑↓ move↵ openesc close