Machine Learning Infrastructure Engineer (AI)

TL;DR

Machine Learning Infrastructure Engineer (AI): Designing, building, and maintaining training and serving infrastructure for ML research with an accent on maximizing GPU allocation and utilization. Focus on diagnosing cluster issues, managing experiments, and supporting ML research.

Location: Redwood City, CA

Compensation Range: $150K - $350K

Company

Character.AI empowers people to connect, learn and tell stories through interactive entertainment.

What you will do

• Provide infrastructure support to ML research and product.
• Build tooling to diagnose cluster issues and hardware failures.
• Monitor deployments, manage experiments, and support research.
• Maximize GPU allocation and utilization for serving and training.

Requirements

• 4+ years of experience supporting infrastructure within an ML environment.
• Experience in developing tools for diagnosing ML infrastructure problems.
• Experience with cloud platforms (e.g., Compute Engine, Kubernetes, Cloud Storage).
• Experience working with GPUs.

Nice to have

• Experience with large GPU clusters and high-performance computing.
• Experience with supporting large language model training.
• Experience with ML frameworks like Pytorch/TensorFlow/JAX.
• Experience with GPU kernel development.