34Design real-time spelling or code suggestions while the user keeps typing▼hard2 replies◆ premiumTrace document revisions, cancellation and deadlines so a late correct answer cannot overwrite newer text. Size useful suggestions rather than every keystroke.Open full answer →
23The model authors publish a new revision. How do you roll it out without a quality regression?▼mediumBasetenTogether AIModal4 replies◆ premiumA minor revision can change weights, encoding or response behavior. Compare pinned deployment bundles, evaluate task slices, monitor a representative canary and keep enough capacity to restore the old service.Open full answer →
39A replica restarts and loads different weights than its siblings. How did that happen?▼mediumBasetenTogether AIModal4 replies◆ premiumA mutable branch or local model directory can change what a restarted replica loads. Establish the actual artifact identity, separate disk evidence from loaded state, and make rollout and restart behavior reproducible.Open full answer →
14Design the registry and deploy pipeline for model weights: 141 GB artifacts, versioning, distribution to a thousand nodes, integrity.▼mediumDatabricksHugging Face4 replies○ sign inBind weights, tokenizer, configuration and evaluation to one immutable release. Follow verification, prefetch, canary readiness and rollback, with bandwidth floors that do not pretend to be rollout measurements.Open full answer →
05Implement a key-value store where a read can ask for the value as of an earlier version. What is the data structure?▼medium★ EssentialOpenAI4 repliesunlockedPer key, an ascending list of versions and a parallel list of values, with reads doing a binary search. The three cases that decide whether the design is right: a key that did not exist yet, a key that was deleted, and a version at which some other key was written.Open full answer →