10What service level objectives would you promise researchers on a training platform, and how would you measure each?▼mediumGoogleMetaOpenAI4 repliesunlockedPromise measurable job outcomes: time to useful work, recoverable progress and successful restoration. Define the population and exclusions before choosing targets, and give each error budget an agreed operating policy.Open full answer →
11Define the service level objectives for an LLM serving fleet, and the alerting that tells you when one is about to be missed.▼mediumOpenAIAnthropicBaseten4 replies○ sign inDefine request success, first-output latency and streaming continuity for each service class. Count bad outcomes against an explicit budget, then use paired long and short windows to detect significant ongoing degradation.Open full answer →
19Design observability for an inference fleet: per-request spans, GPU metrics, and cost attribution per tenant.▼mediumBasetenOpenAI4 replies○ sign inTrace a stalled stream without unbounded telemetry, understand what sampling loses, and reconcile GPU allocation with a stated cost policy.Open full answer →
01Tell me about a time you pushed back on a launch because of a reliability concern.▼easy★ EssentialGoogleMetaOpenAI4 repliesunlockedExplain a reliability concern with evidence, a specific proposal and an honest outcome. Show how you weighed the cost of delaying a launch and what changed afterward.Open full answer →