Writing · Nº 041065 essays

The writing

Ideas from inside the work. Explore technology, entrepreneurship, and the practice of building things that last.

1 essay found · Page 1 of 1

Clear filters
EngineeringDoes robots.txt Actually Bind Your Scraper?Is robots.txt legally binding for a web scraper? Mostly no, but ignoring it is still a mistake. Here is what robots.txt really controls and how to treat it.Apr 5, 2026 · 4 min
Generative score