AI Infra Interviews logo

Companies Hiring AI Infrastructure Engineers in 2026

Find AI infrastructure employers, dated examples of official job postings, relevant job titles and an employer directory for GPU, training, serving and platform roles.

7 MIN READ · UPDATED 21 OCTOBER 2026

PRACTICE THIS:AI Infrastructure System Design ·GPU Fleet Reliability & Observability ·LLM Inference & Serving ·Napkin Math, Cost & Capacity

Where to start your search

OpenAI, Anthropic and Sarvam have official postings describing AI infrastructure work in the examples reviewed below on 22 October 2026. The roles span fleet reliability, GPU performance, inference and platform engineering. This is a dated sample, not a count of the whole market or a ranking of who hires most.

The directory below provides a wider set of employers and careers links. Use it to find leads, then check the employer’s live posting before applying. A company’s inclusion does not mean every listed specialty or location has an opening today. If you are unsure which roles fit, begin with what an AI infrastructure engineer does.

Official postings reviewed on 22 October 2026

Openings can close or change after this review. The linked descriptions are evidence for the responsibilities and locations shown, not evidence of interview rounds or questions.

A small, dated sample of employer postings
Employer and official roleLocation shownWork described
OpenAI: Software Engineer, GPU Infrastructure – HPCSan Francisco and New York CityFleet health, provisioning and failure automation
Anthropic: Performance Engineer, GPUSan Francisco, New York City and SeattleGPU kernels, profiling and model performance
Anthropic: Performance Engineer, Inference SystemsSan Francisco, New York City and SeattleCross-stack serving performance investigations
Sarvam: Platform Engineer – AI InfrastructureBengaluru, on siteKubernetes platform, scheduling and tenant isolation

Search company families, then read the team’s responsibility

For model labs, use the directory links for OpenAI, Anthropic, Google DeepMind, Meta, Microsoft AI, xAI and Mistral. Search for terms such as GPU infrastructure, training systems, inference systems, runtime and performance engineer. A lab can have both fleet-operations and kernel-development teams; the company name does not tell you which one is hiring for your background.

For chip makers and accelerator platforms, investigate NVIDIA, AMD, AWS Annapurna, Google TPU, Cerebras and Groq. Search terms such as compiler, kernel, cluster validation and distributed training help distinguish software performance work from datacenter operations. Follow the named platform in the posting: CUDA preparation alone does not cover a role centered on ROCm or another accelerator stack.

For GPU clouds, investigate CoreWeave, Lambda, Crusoe, Nebius and Together AI. Read whether the team owns host provisioning, schedulers, customer-facing services or model execution. For inference providers and platforms, investigate Fireworks AI, Baseten, Modal, Anyscale and Hugging Face. Look for the boundary between serving-engine development, platform engineering and customer implementation.

For product-company platforms, investigate Uber, Netflix, Databricks and Snowflake. Search for ML platform, model serving, feature infrastructure and reliability. A data-platform role may involve little GPU programming; a model-serving role may require it. These company groups are search leads for the directory, not a statement that every company currently has each kind of opening.

Finding AI infrastructure roles in India

A verified example is Sarvam’s Platform Engineer – AI Infrastructure posting, listed as Bengaluru, full time and on site when reviewed. It asks for at least five years of infrastructure or platform engineering experience and describes Go or Python plus Kubernetes internals. That particular posting is not an entry-level opening.

For a broader search, use the directory’s official careers links and apply India or city filters on the employer’s own site. Check the job’s location field, work arrangement and eligibility details. A company having an India office, or a posting saying remote, does not by itself establish that a specific role can employ someone based in India.

Compare responsibilities and level before comparing offers. Use the salary guide for dated compensation examples and their limits. A US salary band should not be converted into an Indian salary estimate; obtain the local package and its base, bonus and equity terms.

Turn a posting into a preparation plan

Copy the responsibilities into three columns: the system owned, the performance or reliability constraint, and the skills you can demonstrate. For a kernel role, a useful example is a profiled operation with correctness tests across shapes. For a fleet role, it could be a diagnosis and recovery workflow with an explicit failure model. For serving, explain how a load test measures throughput while enforcing a latency target.

Use kernel engineering, distributed training, inference and serving, or GPU scheduling according to those responsibilities. Keep the baseline and the validation alongside the result. A measured improvement on a small system is more defensible than an untested claim about operating a large one.

This is preparation advice. A job description naming CUDA does not prove a live CUDA-coding round; a description emphasizing collaboration does not prove a pairing interview. Ask the recruiter about the current format, assessment tools, expected level and whether any exercise uses a company codebase.

How to use the directory below

The directory links to official careers pages and our company preparation guides. Company guides provide source and confidence notes; question tags express preparation relevance and do not confirm that an employer asked a question. Check answer access on each question.

Use the posting as the final authority for current availability. Record its URL, location and review date when you shortlist it, and check again before submitting. If the job changes from kernel optimization to platform ownership, change the preparation plan with it. You do not need to study every category before applying for a role that matches your experience.

The directory: 47 companies, and where to apply

Each entry links to our interview preparation for the company and, where available, its official careers page. Check that page for current openings and requirements.

SEARCH THESE TITLES TOO

Search these related titles, then read the responsibilities. Kernel, inference and fleet roles need different skills; a broad platform or SRE title alone does not establish AI infrastructure work.

AI infrastructure engineerGPU infrastructure engineerInference engineerML systems engineerKernel engineerGPU performance engineerML platform engineerSite reliability engineer, AI infrastructure

AI infrastructure, GPU and training teams

Posts AI infrastructure, GPU, kernel or training-infra roles by name. Start here.

OpenAI
GPU infrastructure, inference and kernel engineering · 2-stage loop documented
Anthropic
Performance engineering and infrastructure · 2-stage loop documented · comp band on file
Google DeepMind
Software Engineer, Model Inference / Research Engineer · 4-stage loop documented · comp band on file
Google Cloud and TPU
Software Engineer (TPU, Cloud AI, ML infrastructure) · 4-stage loop documented
xAI
Member of Technical Staff (Infrastructure, Inference, Supercomputing) · 6-stage loop documented · comp band on file
Meta
Software Engineer, Systems ML / Production Engineer, AI Infrastructure · 3-stage loop documented · comp band on file
Mistral AI
Software Engineer, Technical Lead, Inference / Site Reliability Engineer
Cohere
Infrastructure Engineer (training, inference, private deployment)
Amazon Web Services
Software Engineer / ML Engineer, AWS Neuron (Annapurna Labs) · 3-stage loop documented · comp band on file
Microsoft
Software Engineer, Azure AI / HPC-AI; Member of Technical Staff, Microsoft AI
NVIDIA
Deep Learning Software Engineer / GPU and HPC Infrastructure Engineer / DGX Cloud Performance Engineer · 2-stage loop documented · comp band on file
AMD
GPU Software Developer (ROCm) / AI Cluster Validation Engineer · 4-stage loop documented
Cerebras
AI Inference Core, Infrastructure Software Engineer / AI Infrastructure Operations Engineer
Groq
Senior Staff Software Engineer, High Performance Inference System / Principal Inference Stack Engineer · comp band on file
SambaNova
Compiler, runtime and serving engineer
Tenstorrent
Kernel, compiler and systems engineer
Intel
AI software and systems engineer (Gaudi, oneAPI, datacenter AI)
Apple
GPU Software Architecture Engineer · comp band on file
Qualcomm
ML compiler and accelerator software roles
Arista Networks
Software Engineer, EOS / networking platform

GPU clouds and serving platforms

Cluster, scheduling and inference-engine work under titles like infrastructure engineer, platform engineer or performance engineer.

CoreWeave
GPU cloud and platform engineering
Together AI
AI Infrastructure Systems Engineer / Staff Software Engineer, Inference and Compute Infrastructure · comp band on file
Fireworks AI
Systems and ML infrastructure engineer (inference optimization, kernels, serving)
Baseten
AI Inference Engineer / Software Engineer, Model Performance / Baseten Inference Stack · comp band on file
Modal
Member of Technical Staff, ML Performance / Systems
Lambda
Software Engineer, Platform / Staff Software Engineer, Managed Kubernetes · comp band on file
Nebius
GPU Performance / AI Infrastructure Systems / Inference Platform SRE / GPU Cluster Architect · comp band on file
Crusoe
Site Reliability Engineer, Managed AI / Production Engineer · comp band on file
RunPod
GPU platform engineer (serverless and on-demand)
Anyscale
Software Engineer (ML Platform), Ray Serve · comp band on file
Red Hat
Software Engineer, OpenShift AI / vLLM / llm-d
Perplexity
Infrastructure engineer (serving, GPU fleet, retrieval)
Hugging Face
Machine Learning Engineer, Fast Optimized Inference / infrastructure
Sarvam AI
GPU Infrastructure Engineer / Platform Engineer, AI Infrastructure
Yotta
GPU cloud and datacenter engineer (Shakti Cloud)
E2E Networks
GPU cloud and AI platform engineer
Cloudflare
Senior Systems Engineer, Workers AI · 3-stage loop documented
Scale AI
Software Engineer, Frontier AI Infrastructure (Public Sector) · comp band on file

Adjacent: strong ML and platform engineering

ML systems and platform roles can share infrastructure responsibilities. Check the team and job description for GPU, training or serving work.

Databricks
Senior Machine Learning Engineer, GenAI Platform (Mosaic AI)
Snowflake
Software Engineer / Staff Software Engineer, Cortex AI Infrastructure
Netflix
Software Engineer L4/L5, ML Platform / ML Platform Reliability Engineer L5
Uber
Staff / Software Engineer, AI Platform (Michelangelo)
LinkedIn
AI platform infrastructure engineer
Pinterest
ML infrastructure engineer
Tesla
AI infrastructure engineer (training clusters, data pipelines, on-vehicle inference)
ByteDance
Software Engineer - AI Compute Infrastructure · comp band on file

We do not host or verify individual job listings. Openings, titles and requirements change constantly, so always confirm on the company’s own careers page.

PRACTISE THIS

Turn the theory into offers — work the question topics this maps to:

FAQ

Official postings reviewed on 22 October 2026 include OpenAI for GPU fleet infrastructure, Anthropic for GPU and inference performance, and Sarvam for an AI infrastructure platform role. These are examples, not an exhaustive vacancy list. Follow the linked employer pages to confirm current availability.