← Coding for Infra / 38

hardNew

Implement symmetric INT8 quantization and prove where the reconstruction-error bound applies

Derive the scale, handle zero tensors, clamp before casting, and separate rounding error from clipping. Compare one outlier under tensor and channel scales.

Updated Sep 2026 · Learn how AI infrastructure works through explanations, worked examples and diagrams, then practise applying it to interview questions.

Derive the scale, handle zero tensors, clamp before casting, and separate rounding error from clipping. Compare one outlier under tensor and channel scales.

The full answer is part of Premium. A free account includes more answers in each topic, but does not unlock this one.

20 answers per topic instead of 10, plus saved progress and bookmarks · no cardor unlock all 303 remaining answers · ₹2,000 / $25

The concepts behind this question

Use these concept explanations to review the ideas behind this question.

🧮 Open Weights & Serving Engines

Weight Formats: FP8 Blocks, MXFP4 and AWQDerive the storage cost of low-precision tensors, including scales, zero points and higher-precision exceptions. Distinguish formats from quantization methods, understand fused dequantization, and test whether a smaller checkpoint actually improves serving capacity without unacceptable quality loss.

🧩 GPU & Accelerator ArchitectureSign in

Numerics: FP32, BF16, FP8 and FP4Floating-point formats trade range and precision for storage and compute cost. Understand exponent bits, significand bits, scaling and accumulation before choosing a format.

🚀 Inference & Serving🔒 Premium

Quantization for InferenceQuantization reduces weight, activation or cache precision. Calculate payload plus scales, estimate whole-step speedup, and test task quality before choosing a smaller representation.

💻 Coding for Infra

The GPU Credit Scheduler PatternA credit scheduler admits jobs without overspending an account’s balance. Clear state transitions make priority, cancellation and refunds easier to implement correctly.

Explore the full curriculum →

UP NEXT ON YOUR JOURNEY

Closest to this topicImplement sliding-window attention without confusing token positions with ring-buffer slots Closest to this topicIn an int8 or fp8 GEMM, what exactly gets scaled, where does the dequantization happen, and what breaks if you get it wrong?Closest to this topicImplement a LoRA forward pass and merge two adapters without inventing cross terms

DISCUSSION · 0

No comments yet — be the first to share your approach.