Senior Machine Learning Engineer (LLM)

TL;DR

Senior Machine Learning Engineer (LLM/Orchestration): Developing and optimizing evaluation pipelines and safety frameworks for Large Language Models with an accent on model alignment and factuality. Focus on bridging the gap between research and production through systematic experimentation and robustness testing.

Location: Hybrid work in France

What you will do

• Bridge the gap between research and production for Machine Learning models.
• Define and implement comprehensive evaluation strategies focusing on factuality, reasoning, and robustness.
• Develop and maintain evaluation pipelines to measure model alignment and quality.
• Collaborate with researchers to assess model safety and user experience.
• Run systematic experiments and monitor model quality over time.
• Share expertise in LLM evaluation within the technical team.

Requirements

• Strong experience in Machine Learning and Natural Language Processing (NLP).
• Proficiency in Python and JVM languages (Java, Kotlin).
• Deep knowledge of LLM evaluation, alignment, and safety metrics.
• Proven ability to design experiments and handle complex data sets.
• Must be available for hybrid work in France.

Culture & Benefits

• Comprehensive health insurance and free mental health services.
• Hybrid work model with additional work flexibility days.
• Enhanced leave policies, including extra leave days and additional parental leave.
• Practical perks such as lunch vouchers and Work Council subsidies.
• Professional support through coaching services and accommodation for disabilities.