Writing · Nº 041065 essays
The writing
Ideas from inside the work. Explore technology, entrepreneurship, and the practice of building things that last.
14 essays found · Page 1 of 2
Clear filtersEngineeringWhen Scraping Breaks at Scale, and How to Design Around ItSmall scrapers work until they do not. The failures at scale are predictable, and you can design for them up front instead of firefighting later.EngineeringHow to Monitor Scrapers Before They Break SilentlyHow to monitor web scrapers so they fail loud, not silent: track real success rate, watch for soft blocks and data drift, and alert before a job dies quietly.OperatingHow to Use CRM Custom Fields Without Making a MessCRM custom fields let you fit the tool to your business, but too many turn it into chaos. Here is how to add custom fields without wrecking your data.EngineeringIs Web Scraping Legal? What Actually MattersIs web scraping legal? The honest answer for operators: public data, terms of service, personal data, and rate limits matter more than the yes-or-no question.OperatingClean Your Data Before You Migrate PlatformsDirty data is why platform migrations fail. Here is how to clean your data before you migrate: dedupe, standardize, and fix keys so the import goes smoothly.EngineeringHow to Evaluate a Web Scraping ProviderA checklist for evaluating a web scraping provider: real success rates, target coverage, cost at scale, control, and what happens when a target fights back.ThesisHaving a Data Moat Does Not Make You AI-NativeProprietary data is not the same as being AI-native. Here is why a data moat means nothing if your product workflow was still built around forms and fields.OperatingWhere Does Our Data Go: The Enterprise AI QuestionWhere does our data go is the question behind every enterprise AI purchase. Here is how to answer it on data residency, training, and model providers so buyers commit.EngineeringWeb Scraping Mistakes That Get You BlockedThe common web scraping mistakes that get you blocked: bad rate limits, obvious fingerprints, ignoring soft blocks, and treating every target the same way.EngineeringBuy or Build Your Scraping Stack: How to DecideShould you buy a scraping API or build your own stack? A clear decision framework on cost, control, and scale for owning your scraping infrastructure.EngineeringResidential vs Datacenter Proxies: Which to Use WhenA practical breakdown of residential vs datacenter proxies for web scraping: cost, speed, block rates, and how to pick the right one per target.OperatingHow to Migrate Your CRM Off Spreadsheets Without Losing HistoryA practical way to migrate a CRM off spreadsheets: map your columns, keep every note and date, and import so nothing gets orphaned or duplicated.