ML Research Engineer (AI)

TL;DR

ML Research Engineer (AI): Building and optimizing a distributed framework for large language model training and inference with an accent on system optimization and collaboration with ML teams. Focus on integrating state-of-the-art technologies to enhance ML systems.

Location: San Francisco, CA; Seattle, WA; New York, NY

Salary: $218,400—$273,000 USD

Company

At Scale, our mission is to develop reliable AI systems for the world's most important decisions.

What you will do

• Build, profile and optimize our training and inference framework
• Collaborate with ML teams to accelerate their research and development
• Research and integrate state-of-the-art technologies to optimize our ML system

Requirements

• Strong excitement about system optimization
• Experience with multi-node LLM training and inference
• Experience with developing large-scale distributed ML systems
• Strong software engineering skills, proficient in frameworks and tools such as CUDA, Pytorch, transformers
• Strong written and verbal communication skills

Nice to have

• Demonstrated expertise in post-training methods for large language models