Lead Data Engineer

📋 Description Own the middle layer of the data pipeline, combining Quantum interaction data with account, device Build and maintain ETL workflows that transform data on daily, weekly, and monthly schedules. Develop and manage AWS processing resources, validate outputs, and prepare reliable datasets for Design and maintain application data structures that minimize compute requirements and support Investigate data discrepancies, troubleshoot pipeline issues, and adapt workflows as application Collaborate with the engineering lead, fellow data engineers, application developers, and data 🎯 Requirements 5+ years of experience in Data Engineering, Data Architecture, or a related field Strong hands-on AWS experience, including managing resources for data processing Proficiency in SQL and experience with Spark Experience building ETL pipelines, integrating multiple data sources, and organizing data for An investigative mindset and the ability to independently work through ambiguous technical problems A collaborative approach, with the ability to take ownership of assigned work within an established 🎁 Benefits Certifications in AWS (we are AWS Partners), Databricks, and Snowflake Access to AI learning paths to stay up to date with the latest technologies Study plans, courses, and additional certifications tailored to your role Access to Udemy Business, offering thousands of courses to boost your technical and soft skills English lessons to support your professional communication Travel opportunities to attend industry conferences and meet clients