Principal Data Architect: Data Movement, Enrichment, and Orchestration

Company : enGen Job Description : JOB SUMMARY We are seeking a hands-on Principal Data Architect toserve as a leader inourongoingdata and digital transformation,leveraginga modern open data ecosystem build on foundational iceberglakehousepatterns for both humans and AI to thrive. This role willown defining and delivering our enterprise strategy andarchitecturalapproach towards data movement [including integration and interoperability], Enrichment, and Orchestration.This scope will span the full enterprise of a complex hybrid ecosystem: We are not a skunkworks team just trying outnew technologyand you will make our implementations withdbt, airflow,kafka, and iceberg real for a $30B+ companyimpactingmillions oflives across the country. Not only willthisperson be aleader of ourrapidmodernization butwillinsistentlykeep a business andcustomerfirstmentality.The rightleaderunderstands theefficiencies and innovations needed totransform will also couple with deprecatinga number of existing operational/legacyplatforms.Werequirea naturalthought leader and strategic advisor, shaping and driving the evolution of complex architecturesacross multiple domains,necessitatingtradeoffs on time, cost, and complexity, butnever trading off thepositiveexperiences andimpactsto our members. Success in this role requires experience drivingadoption of best practices and emerging technologies(ielakehouse, iceberg, ELT vs ETL,and open source trends and tradeoffs), driving innovation and continuous improvement across the organization(teaching and mentoring is a passion for this person), and understanding the evolution of the space and patterns to make decisions that set the company and teams up for success short, mid, and long-term(ieyou know what’s ready for exploration vs what’s ready for enterprise scale). ESSENTIAL RESPONSIBILITIES Lead the development and articulation of complex architecture vision and strategy, ensuring alignment with business goals and strategic initiatives. Champion the adoption of best practices and emerging technologies, driving innovation and continuous improvement across the organization. Collaborate with senior stakeholders across the organization, influencing decision-making and ensuring alignment on complex architectural solutions. Lead the evaluation and selection of new technologies and solutions, ensuring they meet the organization's evolving needs and strategic direction. Develop and maintain comprehensive architectural documentation, ensuring clarity and consistency across all stakeholders. Proactively identify and mitigate potential risks and challenges, ensuring the successful implementation and ongoing operation of complex architectures. Serve as a subject matter expert and advocate for architectural best practices, contributing to the development of organizational standards and policies. Provide expert guidance and mentorship, fostering a culture of collaboration and knowledge sharing. Other duties as assigned or requested. EXPERIENCE Required 10 years of experience in Architecture, design, and implementation of complex systems and solutions. Preferred 5+ years of enterprise data architecture experience driving transformation through data platform modernization 5+ years of architecture frameworks andmethodologies: This person will have a strong opinion of if medallion architecture is a framework,methodology, or a marketing term(You might getbonus points with examples of all three being an “ok” answer andmaygive a good use case argument where each may be the “best” answer) 7+ years of experience with data movement platforms as an engineer, architect, or technical product manager/owner Strong experience and knowledge ofthebelowrelevant platforms to this role:(Most critical being Airflow, Kafka, Flink,Iceberg Lakehouseand DBT) Heavy Emphasis for Modernization:Google Cloud Platform (GCP), Airflow (includingCloudComposer), Beam (includingDataFlow), DBT,Kafka(Confluent),Flink(Confluent), Spark (includingDataProcand Databricks), Iceberg Format,Monte Carlo, Dynatrace,Atlan, Starburst,VertexAI, GitLab, GPT,and more SKILLS Architecture frameworks and methodologies Software Development Knowledge of emerging technologies Strategic thinking and influencing Critical thinking and decision making While not required to possess expertise in all of the following technologies/areas, Principal Architects must demonstrate proficiency in those relevant to the applications they support: IMS, DB2, Oracle, Teradata, Data Warehousing, COBAL, Visual Basic, C, C++, SAS, Java/JavaScript Framework, PEGA, CSS3, Mobile, JSON, Cognos, Hadoop, SQL, J2EE, HTML5/XML, Waterfall, Agile. EDUCATION Required Bachelor’s degree in Computer Science, Information Technology or closely related discipline Preferred Master's degree in Computer Science, Information Technology or closely related discipline LICENSES or CERTIFICATIONS Required None Preferred None Language (Other than English): None Travel Requirement: 0% - 25% PHYSICAL, MENTAL DEMAND