20Design the control plane for a GPU cloud: tenancy, provisioning, health, billing, and the API a customer sees.▼hardNewCoreWeaveNebiusLambda4 replies○ sign inA GPU cloud sells whole nodes and fabric slices to tenants who expect them in minutes and expect them to work. The node state machine, the reconciler that keeps thousands converging, the isolation lines on shared fabric, the health loop that pulls a bad node first, and billing that survives a control-plane outage.Open full answer →
27Design token-level billing and metering for an LLM API: count at the engine, aggregate, reconcile, and survive the failure modes.▼mediumNewOpenAITogether AI4 replies◆ premiumBilling is the one pipeline where a dropped event is money and a duplicated one is a support ticket. Where tokens are counted and by whom, the usage event and its idempotency key, the aggregation that closes a month, the reconciliation that proves the ledger against the engines, and the six ways it goes wrong.Open full answer →