Lead Data Engineer

Salary: $109000 - 182000 per year Requirements: We are looking for a Principal Level Data Engineer who is adept at influencing other technical leaders and teams to align with shared practices, frameworks, and tool usage. You should be proactive in collaborating with business leaders on solution options and recommendations that meet their requirements, including the integration of self-service data processes into the architecture. Experience in Agile methodologies and crafting coherent user stories that contribute to solutions is essential. You must also possess software engineering skills across design, build, testing, and production support. Leadership capabilities in managing technical projects and distributing work among team members are crucial. Additionally, the ability to mentor and guide fellow data professionals for their growth is expected. Comfort with ambiguity and having an influence on the process is advantageous. Responsibilities: In this role, you will be responsible for designing, constructing, testing, and providing production support for analytical pipelines. You'll implement DataBricks streaming and analytical data processes, lead in establishing design and coding standards, including conducting code reviews. Your duties will also include building and reusing data tests for future releases and managing Delta tables with streaming pipelines, including APIs for user experience consumption. You will optimize Spark performance by utilizing cluster and coding optimization techniques, monitor production, and resolve defects. Additionally, you will implement CI/CD in analytical pipelines and be capable of performing proofs of concept to showcase the effectiveness of new coding features, DataBricks capabilities, and AI programming and code generation. Technologies: AI CI/CD Databricks Support Spark Architect Cloud Product Owner Security UX UI Design More: At Keystone AI, we empower families to confidently navigate aging by providing compassionate, experienced support through our guidance, products, and services. Our team comprises individuals who experience care needs firsthand, such as spouses, children, siblings, friends, and neighbors, enriching our mission to serve millions of policyholders daily. We apply kindness and understanding internally and within our local communities. Valuing diverse perspectives, characteristics, and experiences, we foster an environment where employees can contribute their authentic selves, which is vital for collective success. Our dedication to diversity and inclusion helps to cultivate a sense of belonging among all associates. We also actively support our local communities via grants from the Keystone AI Foundation, sponsorships for events, and employee volunteer initiatives. Guided by our core values—making it human, focusing on others, driving progress, and continuous improvement—we cultivate fulfilling, purpose-driven careers through collaboration and learning. Please note that this position is not eligible for employment visa sponsorship. We offer competitive compensation starting from $120,000 up to $200,000, performance-based incentives, and comprehensive employee benefits. last updated 26 week of 2026