23The model authors publish a new revision. How do you roll it out without a quality regression?▼mediumNewBasetenTogether AIModal4 replies◆ premiumA model update is a deploy whose failures are invisible to every deployment metric. What has to be re-validated even for a point release, the canary that watches output shape rather than error rate, and the fingerprint that makes a customer report investigable.Open full answer →
39A replica restarts and loads different weights than its siblings. How did that happen?▼mediumNewBasetenTogether AIModal4 replies◆ premiumA model reference that names a branch points at whatever is current, so a restart months after a deploy loads whatever the authors published since. What that produces, why the fleet ends up half-updated, and the three changes that make a deployment reproducible.Open full answer →
14Design the registry and deploy pipeline for model weights: 141 GB artifacts, versioning, distribution to a thousand nodes, integrity.▼mediumNewDatabricksHugging Face4 replies○ sign inA 141 GB artifact is not a Docker image, and shipping it like one costs an hour per node and a registry that melts under a rollout. Content-addressed chunks, a manifest per version, a fan-out that turns one origin into a thousand nodes in minutes, integrity that fails closed, and promotion tied to evaluation.Open full answer →
05Implement a key-value store where a read can ask for the value as of an earlier version. What is the data structure?▼medium★ EssentialNewOpenAI4 repliesunlockedPer key, an ascending list of versions and a parallel list of values, with reads doing a binary search. The three cases that decide whether the design is right: a key that did not exist yet, a key that was deleted, and a version at which some other key was written.Open full answer →