CDN for Streaming: Live, VOD, and Low-Latency Delivery

· James Thornton · 11 min read

Video streaming is the most bandwidth-intensive workload on the internet, accounting for over 65% of all downstream traffic. Delivering smooth, buffer-free video to millions of concurrent viewers across varying network conditions requires CDN architecture that differs fundamentally from web page delivery. The CDN is not just accelerating video—it is the infrastructure that makes large-scale streaming economically and technically viable. For a comprehensive overview, see our guide on CDN for E-Commerce: Speed That Converts — FlyFish NWA.

This guide covers the engineering of CDN-based video delivery: live versus VOD architecture, protocol selection (HLS, DASH, CMAF), adaptive bitrate ladder design, low-latency techniques, DRM delivery, cost modeling, and provider comparison. Whether you are building a streaming platform, adding video to an existing product, or optimizing an established video pipeline, these patterns apply.

How Does Live CDN Delivery Differ from VOD?

Live and VOD streaming share the same protocols (HLS, DASH) and player technology, but their CDN caching characteristics are fundamentally different.

CDN Architecture for This Use Case — How content reaches end usersCDN Architecture for This Use Case — How content reaches end users CDN Network Topology — Content Delivery Flow U User A Tokyo U User B London U User C New York Edge Server Tokyo PoP Edge Server London PoP Edge Server New York PoP Mid-Tier Cache Origin Shield Origin Server Your Server Request Cache Miss Fetch Cache Hit → Instant Response
Figure 1: CDN Architecture for This Use Case — How content reaches end users

VOD delivery. Video files are pre-encoded, segmented, and stored at the origin. The CDN caches each segment the first time it is requested. Subsequent viewers receive cache HITs. Popular content achieves 95–99% cache hit ratios. Origin load is minimal after the initial cache warm. TTLs can be set to days or weeks since content does not change.

Live delivery. Video is encoded in real time, segmented, and pushed to the origin continuously. The CDN caches each segment for its duration (typically 2–6 seconds) before it expires and a new segment replaces it. All viewers request the same segment at approximately the same time (thundering herd pattern). Origin must sustain continuous output bandwidth. Cache hit ratios are lower (60–85%) because segments are constantly expiring.

DimensionVODLive
Content availabilityPre-encoded, storedReal-time encoding
Cache TTLHours to daysSegment duration (2–6 seconds)
Cache hit ratio95–99%60–85%
Origin loadLow after warmContinuous
Latency targetStart-up onlyEnd-to-end (<3–30 seconds)
Origin shield benefitHighCritical

For live streaming, an origin shield is critical: without it, every CDN PoP independently fetches every new segment from origin, multiplying origin bandwidth by the number of PoPs. With an origin shield, all PoPs fetch from a single shield PoP, which makes one request to origin per segment. This reduces origin load by 90%+.

How Do HLS and DASH Protocols Work at CDN Scale?

Both HLS (HTTP Live Streaming, Apple) and DASH (Dynamic Adaptive Streaming over HTTP, MPEG) work by splitting video into small HTTP-downloadable segments and describing them in a manifest (playlist) file. The CDN serves both manifests and segments.

Performance Comparison: Edge vs Origin Processing
Metric Edge Processing Origin Processing Improvement
Latency (p50)8–15 ms120–300 ms15–20x faster
Cache Hit Ratio85–95%N/AReduces origin load
TLS Handshake1–5 ms (nearby PoP)50–150 ms10–30x faster
Bandwidth Cost$0.01–0.04/GB$0.05–0.12/GB3–5x cheaper
Availability99.99% (multi-PoP)99.9% (single DC)10x fewer outages

HLS architecture. The encoder produces: a master playlist (.m3u8) listing all available quality variants, a media playlist per variant listing the segments for that quality, and the segments themselves (.ts or .fmp4 files, typically 4–6 seconds each). The CDN caches segments with long TTLs and the media playlist with a short TTL (equal to one segment duration) so the player discovers new segments promptly.

DASH architecture. Similar to HLS but uses a single MPD (Media Presentation Description) manifest instead of a playlist hierarchy. Segments are typically .m4s or .mp4 files. DASH is the open standard backed by MPEG and is dominant in non-Apple ecosystems (Android, Smart TVs, game consoles). CDN caching behavior is identical to HLS.

Segment size tradeoffs. Shorter segments (2 seconds) reduce live latency but increase the number of HTTP requests (one request per segment per quality variant per viewer). Longer segments (10 seconds) reduce request overhead but increase latency. The sweet spot for most live streaming is 4–6 seconds, balancing latency and CDN efficiency. For gaming and esports where latency is critical, use Low-Latency protocols with sub-second partial segments.

How Do You Design an Adaptive Bitrate Ladder?

The bitrate ladder defines the quality variants the CDN caches and the player selects from. A well-designed ladder maximizes visual quality across all network conditions while minimizing CDN bandwidth costs.

LabelResolutionBitrateUse Case
4K Ultra HD3840x216012–16 MbpsSmart TVs, high-speed connections
1080p Full HD1920x10804.5–6 MbpsDesktop, connected TV
720p HD1280x7202.5–3.5 MbpsMobile 4G/5G, tablets
480p SD854x4801–1.5 MbpsMobile 3G, congested networks
360p Low640x3600.4–0.7 MbpsVery slow connections, data saver
240p Minimum426x2400.2–0.3 Mbps2G networks, minimal data usage

Per-title encoding. Advanced encoding uses per-title (or per-scene) bitrate optimization: each piece of content gets a custom bitrate ladder based on its visual complexity. A talking-head interview needs lower bitrates than an action sequence for the same perceived quality. This reduces CDN bandwidth by 20–40% compared to a fixed ladder, with no quality degradation. For the broader cost implications, see CDN Cost Optimization.

How Do CDNs Achieve Sub-3-Second Streaming Latency?

Standard HLS/DASH streaming has 15–30 seconds of end-to-end latency (encoding + segmenting + CDN propagation + player buffering). For sports, esports, live auctions, and interactive streaming, this is unacceptable. Low-latency protocols cut it to under 3 seconds.

Performance Gains — Measurable improvements with CDNPerformance Gains — Measurable improvements with CDN CDN Performance Dashboard — Core Web Vitals Core Web Vitals with CDN LCP 1.8s Target: < 2.5s Good FID 45ms Target: < 100ms Good CLS 0.05 Target: < 0.1 Good TTFB 120ms Target: < 800ms Good
Figure 2: Performance Gains — Measurable improvements with CDN

Low-Latency HLS (LL-HLS). Apple's extension to HLS uses partial segments (200–500 ms chunks delivered via HTTP chunked transfer) and playlist delta updates (the player fetches only new entries instead of the full playlist). The CDN must support: HTTP/2 for multiplexed partial segment delivery, chunked transfer encoding passthrough (serving incomplete segments), and blocking playlist responses (the CDN holds the playlist request until a new segment is available).

Low-Latency DASH (LL-DASH) with CMAF. CMAF (Common Media Application Format) provides a standardized container format that works with both HLS and DASH. LL-DASH with CMAF uses chunked CMAF segments, enabling the CDN to serve a segment as it is still being written at the origin. This is the lowest-latency approach, achieving 1–2 seconds end-to-end.

CDN requirements for low-latency. Not all CDNs support low-latency streaming equally. Required capabilities: HTTP chunked transfer encoding pass-through, partial segment caching (cache and serve incomplete files), short TTLs without performance penalty, and high request-per-second capacity (partial segments generate 3–5x more requests than standard segments).

How Does DRM Delivery Work Through a CDN?

Digital Rights Management protects premium content from unauthorized access. The CDN delivers both the encrypted video segments and facilitates the license acquisition process.

DRM systems. The three major DRM systems are: Widevine (Google, used by Chrome, Android, Smart TVs), FairPlay (Apple, used by Safari, iOS), and PlayReady (Microsoft, used by Edge, Xbox, Smart TVs). Each uses different encryption key formats and license server protocols, but all rely on the same underlying encryption standard: Common Encryption (CENC) with AES-128.

CDN role in DRM. The CDN caches encrypted video segments just like unencrypted ones—the CDN does not need to know the encryption key. License requests (where the player obtains the decryption key) are routed through the CDN to the license server but must not be cached (each license request is user-specific and time-limited). Configure the CDN to bypass cache for license server endpoints.

Token authentication. Protect CDN-hosted video URLs with time-limited signed tokens. The token is generated by your application server when an authorized user requests a video, and the CDN validates the token signature and expiration before serving content. This prevents URL sharing and direct-link piracy. See CDN Token Authentication for implementation details.

What Are the Cost Dynamics of Video CDN Delivery?

Video streaming is bandwidth-intensive, and CDN bandwidth is the primary cost driver. Understanding the cost model helps optimize the tradeoff between quality and affordability.

Bandwidth per viewer calculation. A 1080p stream at 5 Mbps consumes 2.25 GB per viewer per hour. At CDN pricing of $0.02–0.08 per GB (depending on provider and volume), the CDN cost per viewer-hour ranges from $0.045 to $0.18. At 10,000 concurrent viewers for a 2-hour live event, total CDN cost ranges from $900 to $3,600.

Cost optimization strategies. ABR ladder optimization (right-sized bitrates) reduces average bandwidth per viewer by 15–25%. Per-title encoding reduces it by another 20–30%. AV1 codec adoption (when viewer devices support it) reduces bitrate by 30–50% compared to H.264 for the same quality. Origin shield reduces origin egress costs by 80–95%. Combined, these optimizations can reduce video CDN costs by 50–70%. Detailed cost strategies are covered in CDN Cost Optimization.

How Do You Choose a CDN for Video Workloads?

Video workloads have specific CDN requirements that not all general-purpose CDNs meet. Evaluate providers against these criteria.

Network capacity. Video CDN must handle sustained high-bandwidth delivery, not just request-per-second capacity. A provider excellent for web page delivery may struggle with 100 Gbps of continuous video egress. Ask for the provider's total network capacity and per-PoP capacity.

Origin shield quality. For live streaming, the origin shield PoP must have high-bandwidth, low-latency connectivity to your encoding origin. Test the shield-to-origin path with your actual video bandwidth requirements.

Low-latency support. Verify support for LL-HLS, LL-DASH, and chunked transfer encoding if you need sub-3-second latency. Request a technical demo with latency measurements.

DRM integration. If you deliver premium content, verify the CDN supports your DRM workflow: token authentication, license server routing, and encrypted segment delivery.

For a broader vendor evaluation framework applicable to all CDN workloads, see Enterprise CDN. For validating your chosen provider's video performance, apply the testing methodology from CDN Testing Strategies.

External References

References & Standards: HTTP/2 specification · RFC 7234