deployment
AI infra interview questions tagged deployment, across every topic.
40 questions · 7 unlocked for you
Concepts behind "deployment"
Review the concepts used in these questions.
Foundational
SXM, PCIe and Rack-Scale Form FactorsGPU form factors determine how accelerators connect, receive power and get serviced. Compare PCIe cards, SXM modules and rack-scale systems against the workload and the facility.🖧 Hardware & Cluster Build-Out
Foundational
Cables, Transceivers and the Optics Power BudgetCable selection depends on distance, port compatibility and power. Count both ends of optical links and check the exact part numbers before ordering.🖧 Hardware & Cluster Build-Out
Foundational
Rack Power Delivery and BuswaysRack power determines current, distribution equipment and redundancy requirements. Training workloads can also create load swings that average power hides.🖧 Hardware & Cluster Build-Out
Foundational
Direct-to-Chip Liquid Cooling and CDUsDirect-to-chip cooling carries heat from cold plates to a coolant distribution unit. Flow, temperature, pressure and coolant quality all matter to the design.🖧 Hardware & Cluster Build-Out
Foundational
The Bill of Materials for a Training ClusterA cluster bill of materials includes networking, storage, management, power, cooling and spares as well as GPUs. Size each from the workload and topology.🖧 Hardware & Cluster Build-Out
Advanced
Serving Engines: vLLM, SGLang and TensorRT-LLMAn inference engine coordinates model work and request state. Memory fit and batch throughput do not establish a response deadline; test the actual execution loop before choosing an engine.🚀 Inference & Serving🔒 Premium
