Start studying
Module 12 · Generative AI Module contents
Module 12  ·  Card 18 / 18advanced

Watermarking and Provenance

As generated media becomes indistinguishable from real media, the question is how anyone can tell.

Watermarking hides a detectable signal in the output, invisible to a viewer but readable by a detector.

For text it biases the choice between equally good tokens in a pattern only the detector knows.

Provenance takes the opposite approach, signing metadata about how a file was made and edited.

Watermarks survive light editing and not determined removal, so neither approach is proof on its own.

Learn in depth ↓
Module 12 · Generative AI · 18 concepts
In depth  /  15 lines

Watermarking and Provenance, in more detail

Generated images, audio and text have crossed the line where people cannot reliably identify them.

Two different technical responses exist, and they answer two different questions.

Watermarking asks whether this artefact was generated, using only the artefact itself.

Provenance asks where this file came from, using metadata attached to it.

For images, a watermark is a perturbation spread across the pixels, invisible but statistically detectable.

Good schemes survive resizing, compression and cropping, because those happen in ordinary use.

For text the mechanism is cleverer, since there are no pixels to perturb.

At each step the vocabulary is split into a favoured and unfavoured list by a secret key.

Sampling is nudged toward the favoured list whenever several tokens are about equally good.

Over a few hundred tokens the resulting bias is measurable, while the writing reads normally.

Short passages carry too little signal to judge, which is a real limit for detection in practice.

Provenance standards such as C2PA sign a manifest recording the origin and edit history of a file.

That manifest travels with the file and can be verified cryptographically by anyone.

Its weakness is that stripping the metadata is trivial, so absence proves nothing at all.

Both approaches raise the cost of casual deception and neither survives a motivated adversary.

Want the full technical article? Wikipedia ↗
Test yourself

One question on this card. Every option explains itself once you pick, right or wrong.

Question 1
How does watermarking generated text work?
Generative AI

18 concepts in this module, then a graded test with every answer explained.

Study this module →
↑↓ move↵ openesc close