Software Engineer (AI)

TL;DR

Software Engineer (AI): Building and integrating AI agents and LLM-powered workflows to enhance internal team productivity across the SDLC with an accent on evaluating, deploying, and maintaining AI tooling. Focus on creating custom internal agents for tasks like incident triage and codebase Q&A, and driving AI adoption strategy within the engineering organization.

Location: Onsite in San Francisco, New York, or Montreal. US-specific benefits are mentioned (401k, health insurance).

Salary: $150,000–$230,000

Company

Baseten powers mission-critical inference for dynamic AI companies, enabling them to bring cutting-edge models into production.

What you will do

• Own and operate the end-to-end internal AI stack, from model selection to deployment and monitoring.
• Build and maintain custom AI agents and LLM-powered tools tailored to Baseten's engineering workflows.
• Evaluate and roll out third-party AI developer tools, configurations, and onboarding.
• Instrument AI tool usage and measure its impact on engineering velocity, code quality, and developer satisfaction.
• Stay at the cutting edge of AI tooling, agents, and developer productivity research.
• Actively support engineering teams, ensuring they have the AI-powered resources and workflows necessary.

Requirements

• Experience building, integrating, and operating AI agents and LLM-powered workflows.
• Ability to evaluate and deploy coding assistants and agentic tools tuned to specific needs.
• Proficiency in building custom agents for tasks like incident triage, on-call support, and codebase Q&A.
• Understanding of the full SDLC and how AI can enhance productivity across it.
• Strong problem-solving skills for high-autonomy, high-impact AI-internal challenges.
• English: B2 required.

Culture & Benefits

• Competitive compensation, including meaningful equity.
• 100% coverage of medical, dental, and vision insurance for employee and dependents.
• Generous PTO policy, including a company-wide Winter Break.
• Paid parental leave.
• Company-facilitated 401(k).
• Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
• Commitment to fostering a diverse and inclusive workplace.