Data Engineering Manager

Salary: $85000 - 122000 per year Requirements: We require at least 4 years of relevant work experience, with 5 or more years preferred. We strongly prefer experience in data engineering with corporate finance data. We value familiarity with major cloud platforms such as AWS, GCP, or Azure. We look for experience with modern data architectures, including data lakes, data lakehouses, and data hubs, as well as ingestion, governance, modeling, and observability. We prefer proficiency with data collection and ingestion tools such as Kafka and AWS Glue, along with storage formats like Iceberg and Parquet. We seek knowledge of streaming architectures and tools such as Kafka and Flink. We want a strong background in data transformation and modeling using SQL-based frameworks and orchestration tools such as dbt, AWS Glue, and Airflow. We prefer experience with modeling concepts such as slowly changing dimensions and schema evolution. We value familiarity with Spark for data transformation, including streaming, performance tuning, and debugging with Spark UI. We expect proficiency in Python, Java, Scala, or similar programming languages. We require expert-level SQL skills for data manipulation and optimization. We prefer demonstrated experience with DevOps practices, including code management, CI/CD, and deployment strategies. We value understanding of data governance principles, including data quality, privacy, and security in data product development and use. Responsibilities: We set goals and objectives for the team responsible for designing, building, and maintaining robust data systems that support analysis and reporting. We lead the end-to-end process that enables large datasets to be processed efficiently and made accessible for decision-making. We oversee the development of scalable, sustainable, and robust data products and solutions using big data and cloud-based technologies. We develop and monitor streaming and batch data pipelines that ingest data from multiple sources, transform it into usable information, and load it into data lakes, data warehouses, and other stores. We review existing data systems and architectures to identify opportunities for improvement and optimization. We oversee data infrastructure preparation to support efficient storage and retrieval. We evaluate data formats and resolve the most suitable options to improve usability and access across the organization. We partner with cross-functional data and advanced analytics teams to gather requirements and ensure solutions meet both functional and non-functional needs. We build complex prototypes to validate new concepts and guide implementation of data engineering frameworks and architectures that strengthen processing capabilities and advanced analytics. We oversee automated deployment pipelines to improve code deployment efficiency with appropriate governance. We guide the team in data modeling aligned to datastore technology to ensure long-term performance and accessibility. We manage team members by setting expectations, aligning goals, coaching, monitoring progress, giving feedback, recognizing achievement, and fostering an inclusive culture. Technologies: Airflow AWS AWS Glue Azure Big Data CI/CD Cloud DevOps Flink GCP Support Java Kafka Python SQL Scala Security Spark dbt UX UI Design Data Warehouse More: We are Keystone AI, a family company with the scale to make a positive impact in the world. Our purpose is to nourish the world in a safe, responsible, and sustainable way by providing food, ingredients, agricultural solutions, and industrial products that are vital for living. We connect farmers with markets, customers with ingredients, and families with daily essentials across eggs, edible oils, salt, skincare, feed, and alternative fuel. With 160,000 colleagues operating in 70 countries, we help touch billions of lives every day. In this role, we are looking for a Manager, Data Engineering to lead a team focused on building and maintaining data systems that enable analysis, reporting, and advanced analytics. We are an equal opportunity employer, including Disability/Vet, and we do not sponsor work visas for this position. last updated 25 week of 2026