Start studying
Module 13 · Data Engineering Basics Module contents
Module 13  ·  Card 8 / 13beginner

Data Lakes

A data lake is a large, cheap store that holds raw data in its original format, whether tables, logs, images or text.

Data is saved first and given structure later, when someone needs it, which is the schema on read approach.

For example, a company might keep every raw clickstream file in a data lake in case a future analysis needs it.

Lakes are flexible and cheap, but without care they become disorganised, hard to search and hard to trust.

A lake keeps everything as it arrived, while a warehouse keeps cleaned, structured data ready for analysis.

Learn in depth ↓
Module 13 · Data Engineering Basics · 13 concepts
In depth  /  15 lines

Data Lakes, in more detail

Data lakes exist because not all valuable data fits neatly into tables when it arrives.

They store raw files of any kind in cheap storage, often cloud storage built for huge numbers of files.

Nothing has to be designed before data is saved, which makes collection fast.

Files are usually organised in folders by source and date, such as one folder per day.

Open formats such as Parquet, JSON and CSV keep the files readable by many tools.

A catalogue records what each dataset is, where it lives and what its columns mean.

Without a catalogue, a lake quickly becomes a data swamp, full of files nobody can find or trust.

Lakes are common for logs, sensor readings, images and other data with no fixed use yet.

Data scientists use lakes for exploration and for work on large raw datasets.

Raw zones keep data exactly as received, while cleaned zones hold processed versions.

Storage is cheap, but scanning huge raw files is slow and can be costly.

Access control matters, since raw data often contains personal details that were never removed.

Deleting one person's data on request is harder in a lake, because it can be spread across many files.

In practice, lakes and warehouses are often used together, with the lake feeding the warehouse.

The usual mistake is treating the lake as a dumping ground with no catalogue, owner or rules.

Want the full technical article? Wikipedia ↗
Test yourself

One question on this card. Every option explains itself once you pick, right or wrong.

Question 1
A company wants to keep years of raw clickstream logs cheaply, in case a future analysis needs them. Where should they go?
Data Engineering Basics

13 concepts in this module, then a graded test with every answer explained.

Study this module →
↑↓ move↵ openesc close