Generator memory advantage

Question

Accepted Answer

Generators are lazy - they produce one value at a time on demand. Opening a file and iterating it directly (for line in f) uses generator-like behavior: only one line is in memory at a time. Calling list(f) would read the entire file into memory. For a 10 GB file on a machine with 8 GB RAM, that crashes. This is a core reason generators matter in data engineering pipelines.