Writing · Nº 041065 essays
The writing
Ideas from inside the work. Explore technology, entrepreneurship, and the practice of building things that last.
4 essays found · Page 1 of 1
Clear filtersEngineeringHow to Extract Clean Structured Data From Messy HTMLGetting the page is the easy part of scraping. Turning messy HTML into clean structured data is where most projects fail. Here is how to extract reliable fields.EngineeringScraping Real Estate Listings for Market AnalysisReal estate listing scraping is only useful if you handle duplicates, stale listings, and price changes. Here is how to scrape listings into real market analysis.EngineeringHow to Validate Scraped Data Quality Before It Poisons YouScraped data quality fails silently. A selector drifts and you store nulls for a week. Here is how to validate scraped data at ingestion before it reaches users.EngineeringHow to Deduplicate Scraped Data Without Losing RecordsDeduplicating scraped data is not a DISTINCT query. Here is how to pick a real identity key, handle near-duplicates, and merge records without deleting good data.