Writing · Nº 041065 essays
The writing
Ideas from inside the work. Explore technology, entrepreneurship, and the practice of building things that last.
3 essays found · Page 1 of 1
Clear filtersEngineeringBrowser Fingerprinting Is Why Your Scraper Gets BlockedRotating proxies will not save a scraper with a bot fingerprint. Browser fingerprinting blocks scrapers by the signals they send. Here is what leaks and how to fix it.EngineeringHeadless Browsers Are Your Biggest Scraping CostFor most crawls the headless browser is the largest line item, not proxies. Here is why headless browser scraping costs so much and how to cut it hard.EngineeringWhen to Render JavaScript for Scraping (and When Not To)Rendering JavaScript for scraping costs ten times more than an HTTP fetch. Here is how to tell when a site actually needs a browser and when it does not.