← Coding for Infra

Advanced

Interval Merging and Utilization Logs

Interval merging finds periods of activity and gaps between them. A sweep over start and end events also measures concurrency and utilization.

This concept is part of Premium, which includes all concepts, course lessons and answers.

Get Premium · ₹2,000 / $256 months of access · one payment · no auto-renew

RELATED CONCEPTS

The GPU Credit Scheduler Pattern Parsing Kernel Traces and Logs Capacity Planning and Utilization The Practical Coding Screen Playbook DCGM and GPU Telemetry GPU Job Scheduler Design

PRACTICE THIS IN REAL QUESTIONS

Coding for InfraGiven per-GPU idle intervals, compute when any GPU was idle and when every GPU was idle. Write both.→Coding for InfraCompute per-tenant GPU-hours for a billing period from a log of allocation start and stop events.→Coding for InfraGiven usage records of GPU allocations, compute what each tenant owes. Write it, and say what you would test.→CUDA, Triton & Kernel EngineeringGiven the addresses each thread in a warp touched, classify the access pattern: coalesced, strided or random. Write the classifier.→Napkin Math, Cost & CapacityWhat does it cost per million output tokens to serve a 70B model on eight H100s?→Distributed Training & ParallelismWhat is MFU, how do you compute it from a running job, and what counts as a good number?→