Senior Software Engineer (AI/ML)

TL;DR

Senior Software Engineer (AI/ML): Designing and building systems for high-throughput, low-latency inference across CPU and GPU workloads with an accent on scalability, reliability, and operational excellence. Focus on driving architectural decisions and optimizing performance for model serving infrastructure.

Company

Databricks is the data and AI company, providing a platform for data intelligence used by over 10,000 organizations worldwide.

What you will do

• Design and implement core systems and APIs for Databricks Model Serving.
• Drive architectural decisions to optimize performance for CPU and GPU workloads.
• Contribute to key components of the serving infrastructure.
• Collaborate with cross-functional teams to meet customer needs.
• Lead initiatives to improve latency and availability.
• Establish best practices and mentor other engineers.

Requirements

• 5+ years of experience in large-scale distributed systems.
• Experience in model serving and inference systems.
• Strong foundation in algorithms and system design.
• Proven ability to deliver high-impact initiatives.
• Experience with CPU/GPU inference systems.
• Strong communication skills and customer-focused mindset.