Premium Video

This video is available to premium subscribers only

Unlock Full Access

Batch processing gives accurate results, but they arrive hours late. Stream processing gives results within seconds, but mistakes in a live pipeline are hard to fix after the fact. Many systems want both: a number that is fresh now and correct in the long run.

The Lambda architecture gets both by running a batch pipeline and a streaming pipeline side by side over the same data.

In this chapter, we will look at what the Lambda architecture is, how its three layers work together, why it was introduced, and the trade-offs that have led many teams to consider simpler alternatives.