TL;DR Reddit's public .json listings let you scrape a subreddit in about 100 lines of Go. You decode the listing envelope, follow the after cursor, send an honest User-Agent, and back off on HTTP 429. There are two hard limits: a listing stops at roughly 1,000 items, and requests from cloud or datacenter IPs often get a flat 403. For anything in... Weiterlesen: Building a Reddit Scraper in Go: JSON Listings, Pagination, Rate Limi…
Intelligence View
⚡ tsecurity.de Intelligence
Building a Reddit Scraper in Go: JSON Listings, Pagination, Rate Limits, and Where It Breaks
TL;DR Reddit's public .json listings let you scrape a subreddit in about 100 lines of Go. You decode the listing envelope, follow the after cursor, send an…
Intelligence Digest — kostenlos Täglich die wichtigsten Security-News · jederzeit abbestellbar