Writing · Nº 041065 essays
The writing
Ideas from inside the work. Explore technology, entrepreneurship, and the practice of building things that last.
4 essays found · Page 1 of 1
Clear filtersEngineeringReal-Time Latency Is a Product Decision, Not a MetricReal-time latency is not one number to minimize. It is a product decision about what has to feel instant. Here is how to set a latency budget that actually fits.EngineeringHow to Set a Latency Budget for AI FeaturesA latency budget forces you to decide how slow an AI feature is allowed to be before you build it. How to set one, spend it across the pipeline, and design around it.EngineeringHow to Cut the Latency of Time-Critical App EmailsLogin codes and password resets that take minutes cost you signups. Here is how to cut transactional email latency so time-critical app emails arrive in seconds.AIStream the Answer, Don't Spin: AI-Native Latency UXAI-native latency UX means streaming tokens as they arrive, not showing a spinner. Here is why perceived speed beats raw speed for model-backed features.