The Entropic Web: Why The Old Ways Are Dying


The history of web scraping is a history of fighting entropy. In the early days of the internet, the "document" was the fundamental unit of the web. HTML was a semantic markup language intended to structure text. A <table> tag invariably contained tabular data; an <h1> tag invariably...