AI Infra Interviews logo

Meta Coding for Infra interview questions

Meta’s Llama 3 report describes large distributed training runs and their interruptions. Use that operational setting for a systems-coding exercise, without treating it as a published Meta interview question. Questions tagged to Meta appear first, followed by additional practice from our Coding for Infra track. Company tags indicate preparation relevance, not confirmed interview appearances. Confirm the current interview format with your recruiter.

Implement a failure detector with explicit uncertainty

  1. Track observed state. Maintain worker identifiers, heartbeat times and a timeout using a monotonic clock. Distinguish an unreachable worker from proof that its process has stopped.
  2. Prevent duplicate ownership. Model a late heartbeat after replacement and a delayed result from the old worker. Require an ownership generation or equivalent fencing rule before accepting updates, then test expiry and reassignment at the same instant.

Sources: Meta: The Llama 3 Herd of Models. Reviewed .

Start with the first company-tagged practice question · Continue through the full topic track. Check each resource’s access level.

Coding for Infra questions tagged to Meta

3 questions · 0 unlocked for you

Additional Coding for Infra practice

These questions cover the same topic and are not tagged to Meta. Use them to practise applying the ideas in a different situation.

15 questions · 10 unlocked for you

Concepts for Coding for Infra preparation

These concept explanations cover the ideas used in the questions. Check each card for its access level.

Foundational
The GPU Credit Scheduler PatternA credit scheduler admits jobs without overspending an account’s balance. Clear state transitions make priority, cancellation and refunds easier to implement correctly.
Core
Sign in
Rate-Limiting AlgorithmsRate limiters control how much work a caller may submit over time. Token buckets, queues and sliding windows allow different burst and waiting behavior.
Advanced
🔒 Premium
Batching Queues and BackpressureA request batcher groups work to reduce processing overhead. Queue bounds, dispatch timing and failure handling keep that efficiency from becoming uncontrolled waiting.
Core
Sign in
Retry, Backoff and IdempotencyRetries can recover transient failures, but they also add load and may repeat side effects. Backoff, retry budgets and idempotency make that behavior explicit.
Advanced
🔒 Premium
Interval Merging and Utilization LogsInterval merging finds periods of activity and gaps between them. A sweep over start and end events also measures concurrency and utilization.
Advanced
🔒 Premium
Concurrency in Python, Go and C++Concurrency primitives coordinate overlapping work and shared state. Choose threads, processes or asynchronous tasks from the runtime and the work they must perform.
Advanced
🔒 Premium
Producer-Consumer PipelinesProducer-consumer pipelines connect stages that run at different rates. Bounded buffers absorb temporary variation, while the slowest sustained stage limits throughput.
Advanced
🔒 Premium
Parsing Kernel Traces and LogsTrace analysis combines parsing, classification and aggregation. Stream large inputs and define the timing metric before deciding which operations dominate.
META CODING FOR INFRA FAQ

This collection includes practice questions such as "Given per-rank heartbeats from a training job, detect which rank has stopped and when. What produces false positives?", "Implement dominant resource fairness for a cluster where jobs need different mixes of GPU, CPU and memory.", "A multi-GPU training job hangs at step 400 with every GPU at 100 percent utilization. Debug it.". Company tags describe relevance to preparation; they do not confirm that Meta asked these questions. Check each question for answer access.

Other topics for Meta preparation

Explore the other topics mapped to Meta in our preparation guide.

Continue your Meta interview preparation

Continue with related questions and the concept curriculum. Free questions are available in every track; check pricing for full access.

Independent and not affiliated with Meta. All trademarks belong to their owners.