Senior Data Engineer (Python/Cloud)

Senior Data Engineer

Company

VIA Science, Inc.

Conditions

13 hours agoSeniorSalary: 120K - 160KSomerville, Massachusetts, United States Hybrid Full Time Engineering Jobs by VIA Science, Inc.

Skills

Pipeline Airflow Architecture Security Monitoring Cloud Dagster Ci/Cd Mlops Streaming Database Git Sql Python Nosql Sqlalchemy Api Data Elt Etl Governance

About the Role

You will design and implement cloud based data storage solutions for multi tenant environments, optimize schemas for multi tenant environments while ensuring data accessibility and security, and uphold a high standard of trust and transparency. You will build real time streaming and batch ETL and ELT pipelines to ensure data flows from raw ingestion to production ready applications. You will create and manage data access layers including REST APIs and streaming services to empower downstream users. You will help implement data governance and best practices to maintain data health, integrity and security. You will operationalize AI models by managing versioning, containerization, and deployment. You will monitor and optimize infrastructure to track data health and system performance and proactively remediate bottlenecks.

Requirements

• Bachelor’s degree or higher in Computer Science, Engineering, or Data Science
• 5+ years of professional experience in data engineering or a related role
• Strong foundation in Python including testing frameworks such as pytest and ORMs such as SQLAlchemy
• Ability to define clear scopes and responsibilities within a large codebase
• Experience architecting scalable relational and non relational SQL NoSQL schemas
• Experience managing the end to end database lifecycle from design to production maintenance
• Expertise in performance engineering including query tuning, indexing, and execution plan analysis to eliminate bottlenecks
• Experience with cloud based databases such as AWS RDS or Azure Database
• Ability to configure compute resources, backups, and geolocation requirements
• Experience building resilient data pipelines with Dagster or Apache Airflow
• Experience maintaining data health for real time streaming and batch processing
• Systems thinking and understanding of how data infrastructure integrates into broader app architecture
• Experience with modern software development practices including Git, CI/CD, and high quality maintainable code

Responsibilities

• Architect secure solutions by designing and implementing robust cloud based data storage solutions, optimizing schemas for multi tenant environments while ensuring data accessibility and security and a high standard of trust and transparency
• Engineer data pipelines by developing, deploying, and maintaining resilient ETL ELT pipelines for real time streaming and batch processing, ensuring seamless data flow from raw ingestion to production ready applications
• Facilitate data accessibility by building and managing data access layers, including REST APIs and streaming services, to empower downstream users
• Drive data governance and best practices by contributing across teams to recommend tools, processes, and best practices for maintaining data health, integrity, and security
• Operationalize AI models by supporting AI operations (MLOps) through managing versioning, containerization, and deployment of AI models
• Monitor and optimize infrastructure by building monitoring and alerting systems to track data health and system performance, proactively identifying and remediating bottlenecks

Benefits

• 401K plan with up to 5% employer contribution
• Fully funded health benefits plan including vision and dental coverage
• Up to 24 weeks paid parental leave
• 4 week paid ramp back program
• $10K family forming benefit (fertility treatments adoption and surrogacy)
• Flexible Vacation Policy with no set annual limit
• Summer Fridays
• Extended holiday period in December
• Remote work flexibility with access to four offices and the ability to work remotely from eligible locations up to 2 months per year
• Individualized growth opportunities including internal and external mentorship panels and learning programs
• Dedicated wellness advisor
• Transit benefits to support commuting costs
• In person events to foster team bonding and collaboration

Показать контакты