Senior Data Engineer

To help keep everyone safe, we encourage all applicants to pay close attention to protect themselves during their job search. When applying for a position online you are at risk of being targeted by malicious actors looking for personal data. Please be aware we will only reach out via email using the domain quanata.com. Anything that does not match those domains should be ignored and considered a security risk. About Us Quanata is on a mission to help ensure a better world through context-based insurance solutions. We are an exceptional, customer centered team with a passion for creating innovative technologies, digital products, and brands. We blend some of the best Silicon Valley talent and cutting-edge thinking with the long-term backing of leading insurer, State Farm. Learn more about us and our work at quanata.com Our Team From data scientists and actuaries to engineers, designers and marketers, we’re a world class team of tech-minded professionals from some of the best companies in Silicon Valley, and around the world. We’ve come together to create the context-based insurance solutions and experiences of the future. We know that the key to our success isn't just about nailing the technology—it’s hiring the talented people who will help us continue to make a quantifiable impact. The role We're looking for a Senior Data Engineer to help the team deliver data science services and streaming data pipelines. Over the course of your time with Quanata, you will have the opportunity to develop data pipelines that bring together data from multiple sources to evaluate insured risk, deliver services that enable data science models, and enable business and partner access to key datasets. Your day-to-day Design and build robust data pipelines that integrate data from diverse sources to support risk evaluation and business intelligence. Build streaming data pipelines using Kafka and AWS services to enable real-time data processing and decision-making. Create and operate data services that make curated datasets accessible to internal teams and external partners through APIs and scheduled deliveries. Support data science workflows by building infrastructure that enables model training, feature engineering, and production inference. Implement data quality frameworks including validation, monitoring, and alerting to maintain trust in our data assets. Contribute to CI/CD pipelines and infrastructure-as-code practices to ensure reliable, repeatable deployments. Deliver highly reliable services by following engineering best practices and participating in an on-call rotation to support production systems. Contribute to the data warehouse by creating well-modeled datasets in Snowflake that empower analysts and data scientists. Collaborate with data scientists, analysts, and business stakeholders to understand requirements and deliver solutions that drive value. About you Bachelor's degree or equivalent relevant experience and; 6-8 years of industry experience in data engineering or software engineering with a focus on data systems. Strong proficiency in Python and SQL for data pipeline development and analysis. Experience with AWS data platforms (Glue, S3, Athena, Lambda, Step Functions). Familiarity with Snowflake or similar cloud data platforms. Familiarity with streaming technologies such as Kafka or Kinesis. Experience with workflow orchestration tools (Airflow, Step Functions, or similar). Proficiency in infrastructure-as-code tools like Terraform. Understanding of data modeling principles. Excellent written and verbal communication with a strong collaborative focus. Experience with CI/CD tailored for machine learning systems (e.g., automating model training, validation, and deployment) Bonus points Prior experience working within the insurance industry or another highly regulated environment, demonstrating an understanding of pertinent regulatory, security, and data governance challenges. Familiarity with ML infrastructure and supporting data science teams in productionizing models. Experience designing and building feature stores or real-time feature serving systems. Exposure to data governance and cataloging tools (e.g., DataHub, Atlan, or similar). Salary: $215,000 to $300,000* *Please note that the final salary offered will be determined based on the selected candidate's skills, and experience, as well as the internal salary structure at Quanata. Our aim is to offer a competitive and equitable compensation package that reflects the candidate's expertise and contributions to our organization. Additional Details: Benefits : We provide a wide variety of health, wellness and other benefits.These include medical, dental, vision, life insurance and supplemental income plans for you and your dependents, a Headspace app subscription, monthly wellness allowance and a 401(k) Plan with a company match. Work from Home Equipment : Given our virtual environment— in order to set you up for success at home, a one-time payment of $