Software Engineer (AI for Data Engineering)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
TL;DR
Software Engineer (AI for Data Engineering): Design and build a global context layer for data that powers semantic search, retrieval, and code generation, with an accent on applied AI systems using LLMs, embeddings, and information-retrieval techniques at global scale. Focus on turning applied research into production-ready developer tools and influencing the technical vision and architecture for next-generation AI-driven data products.
Company
builds Astro, a unified DataOps platform powered by Apache Airflow, and develops commercial products around Airflow.
What you will do
- Design and engineer the core components of ’s context layer for data modeling, semantic search, retrieval, and code generation.
- Experiment with LLMs, embeddings, and advanced retrieval techniques to build developer tools that deliver insights.
- Collaborate with R&D and product teams to bring early AI concepts into the product experience.
- Solve high-impact information retrieval and search challenges using ’s visibility into data pipelines across industries.
- Influence the technical vision and architecture for AI-driven data products.
- Represent through open-source contributions, technical talks, and publications.
Requirements
- 5–8 years of software engineering experience with Python or Go.
- Experience with LLMs and applied AI areas (e.g., embeddings, vector databases) or strong desire to dive in.
- Familiarity with Apache Airflow or other orchestration tools.
- Experience in search, information retrieval, or large-scale data infrastructure.
- Comfort working in early-stage, ambiguity-driven environments.
- Strong collaboration and communication skills to explain complex systems to technical and non-technical audiences.
Culture & Benefits
- Hybrid work model based in New York City.
- Estimated total compensation: $200,000–$230,000 plus equity and a comprehensive benefits package.
- Small, highly skilled team focused on velocity, creativity, and impact.
- Research-driven environment where ideas move quickly.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →