Build a CDN

About Build a CDN

A globally-distributed reverse proxy whose only job is to (a) terminate the user's TCP/TLS milliseconds away and (b) serve a cached origin response so origin never sees the request. Internalize edge caching, anycast, TTL, revalidation, SWR, purge, the Vary footgun, origin shield, bypass, and hit ratio — and the dozen ways to misconfigure each.

Difficulty
intermediate
Time
about 75 minutes
Stages
9
Topic
Caching, Proxies & the Edge

How this problem is worked

Nine stages, from what the thing is for to how it compares with the real implementations. Each asks one question, and the simulator runs the architecture you draw against the requirements you wrote.

  1. 01Purpose & invariantsWhat is this for, and what must always be true of it?
  2. 02Workload characterizationWho writes, who reads, and in what shapes?
  3. 03Data model & on-disk formatWhat does the data look like at rest?
  4. 04Core algorithmsHow do the write path and the read path actually work?
  5. 05Distribution & replicationHow does this scale out and survive losing a machine?
  6. 06Consistency & correctnessUnder concurrency and failure, what is guaranteed?
  7. 07Failure modes & recoveryWhat actually happens when each part fails?
  8. 08Operational characteristicsCan a human run this at three in the morning?
  9. 09Trade-offs & comparisonWhere does this sit against the alternatives?

Primary sources for this problem

  • Cloudflare Learning Center — How a CDN works (cloudflare.com/learning/cdn/)
  • Fastly — Caching, Surrogate keys, VCL (docs.fastly.com)
  • MDN — HTTP Caching (developer.mozilla.org/en-US/docs/Web/HTTP/Caching)
  • Ilya Grigorik — High Performance Browser Networking, ch. 11 (hpbn.co)
  • RFC 7234 (HTTP Caching) and RFC 5861 (stale-while-revalidate)

Browse the full problem catalog, or see what the simulator does and does not model.