Writing · Nº 041065 essays
The writing
Ideas from inside the work. Explore technology, entrepreneurship, and the practice of building things that last.
43 essays found · Page 3 of 4
Clear filtersStrategyWhen to Build Shared Infrastructure (and When Not To)A decision checklist for when to build shared infrastructure versus copy per project, based on ship frequency, overlap, and the maintenance tax you can carry.EngineeringBuy or Build Your Scraping Stack: How to DecideShould you buy a scraping API or build your own stack? A clear decision framework on cost, control, and scale for owning your scraping infrastructure.EngineeringHow to Own Your Deploy Pipeline End to EndOwn your deploy pipeline so no vendor controls how your code ships. Here is how to build a git-push deploy on your own server you fully control.EngineeringHow to Put Cloudflare in Front of Your Own ServerPut Cloudflare in front of your own server to get a CDN, DDoS protection, and TLS without giving up ownership of the box, the data, or the ability to leave.OperatingOwn Your DNS, Not Just Your Domain NameOwning your domain is not the same as owning your DNS. How to keep control of your DNS zones so no vendor can hold your traffic routing hostage.EngineeringResidential vs Datacenter Proxies: Which to Use WhenA practical breakdown of residential vs datacenter proxies for web scraping: cost, speed, block rates, and how to pick the right one per target.EngineeringWhat You Should Never Self-HostOwning your stack does not mean self-hosting everything. Here is what you should never self-host, and why the hybrid line is where ownership pays off.EngineeringHow to Calculate the True Cost Per Page of ScrapingYour cost per page of scraping is not the proxy bill. It is proxies plus compute plus retries plus parsing plus storage. Here is how to compute the real number.EngineeringWhat No Vendor Lock-In Actually Requires: A ChecklistNo vendor lock-in is a claim most tools fail. Here is the checklist for what real portability requires: open formats, standard runtimes, and a tested exit.EngineeringThe Hard Part of Scraping Is Proxy ManagementParsing HTML is easy. Proxy management is where scraping projects die. Here is why proxies, not selectors, decide whether your data pipeline survives.EngineeringHow to Spot Vendor Lock-In Before You Sign the ContractVendor lock-in hides in defaults, not fine print. Here is how to spot lock-in before you sign a hosting contract and keep your exit cheap and real.EngineeringTransactional vs Marketing Email: Split the StreamsTransactional and marketing email belong on separate sending streams. Here is why mixing them wrecks deliverability and how I split them across every product I run.