Senior Software Engineer (Distributed Data Systems)

TL;DR

Senior Software Engineer (AI): Building the next generation distributed data storage and processing systems that can outperform specialized SQL query engines. Focus on query optimizer and execution engine that's fast, tuning free, scalable, and robust.

Location: San Francisco

Salary: $157,700—$213,800 USD

Company

Databricks is the data and AI company that unifies and democratizes data, analytics and AI.

What you will do

• Develop the de facto open source standard framework for big data (Apache Spark™).
• Provide reliable and high performance services and client libraries for storing and accessing humongous amount of data on cloud storage backends (e.g., AWS S3, Azure Blob Store).
• Combine the scale and cost-efficiency of data lakes, the performance and reliability of a data warehouse, and the low latency of streaming (Delta Lake).
• Provide a higher level abstraction for expressing data pipelines and enables customers to deploy, test & upgrade pipelines and eliminate operational burdens for managing and building high quality data pipelines (Delta Pipelines).
• Build the next generation query optimizer and execution engine that's fast, tuning free, scalable, and robust.

Requirements

• BS (or higher) in Computer Science, related technical field or equivalent practical experience.
• Comfortable working towards a multi-year vision with incremental deliverables.
• Motivated by delivering customer value and impact.
• 5+ years of production level experience in either Java, Scala or C++.
• Strong foundation in algorithms and data structures and their real-world use cases.
• Experience with distributed systems, databases, and big data systems (Apache Spark, Hadoop).

Culture & Benefits

• Comprehensive benefits and perks that meet the needs of all employees.
• Committed to fostering a diverse and inclusive culture where everyone can excel.
• Hiring practices are inclusive and meet equal employment opportunity standards.