I scraped 100,000 products and saved them to a JSON file. The file was 500MB. I wanted to find products under $50. I had to load the entire 500MB file into memory just to search it.

My computer crashed.

Then I learned to save data to a database. I could search instantly. Filter by price. Sort by date. Update products. All without loading...