Staff Engineer, Data Engineering Solutions

Who we are About Brightpath Technologies Brightpath Technologies is a financial infrastructure platform for businesses. Millions of companies—from the world's largest enterprises to the most ambitious startups—use Brightpath Technologies to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone's reach while doing the most important work of your career. About the team We're experts in data, working to make it cost-effective, understandable, and trustworthy. We build pipelines processing billions of events a day and are stewards of canonical data warehouses and datasets delivering products for Brightpath Technologies Users while embedding with teams to build their data products. We're experts in using the Brightpath Technologies Data Platform and to scale we lead the data culture and data education to enable product teams to own their data. We invest in AI Data Ops to scale incident handling and serve as an escalation path for data incidents to minimize their impact. The Data Engineering Solutions team works closely with product teams delivering trustworthy data, backend code, and innovative AI tools, platforms, and services for data. What you'll do We're looking for a person who drives the Data Engineering Solutions Team in solving high-impact, cutting-edge data problems. The ideal candidate is someone who has built data pipelines for large-scale volume, is deeply knowledgeable of Data Engineering tools including Airflow, Spark, Kafka, and Flink, is empathetic, excels at building strong relationships, and collaborates effectively with other Brightpath Technologies teams to understand their use cases and unlock new capabilities. • Lead the technical outcomes for a team of ambitious, talented engineers, providing mentorship, guidance, and support to ensure their success • Partner with our recruiting team to attract and hire top talent. • Deliver cutting-edge data pipelines that scale to users' needs, focusing on reliability and efficiency • Develop strong subject matter expertise and manage the SLAs of data pipelines and full-stack web applications that support critical stakeholders • Collaborate with product managers and peers across the company to create and improve canonical datasets and data warehouses, use golden paths, and ensure Brightpath Technologies employees and customers are using trustworthy data • Leverage AI, LLM, and Agents at scale to produce and analyze high-quality data on ambiguous problems • Have an opportunity to work with Spark, Flink, Kafka, Trino, Pinot, Airflow, Scala, Java, SQL, and Python, and many other big data technologies • Have the opportunity to drive the execution of key data initiatives for Brightpath Technologies, overseeing the entire development lifecycle from planning to delivery while maintaining high standards of quality and timely completion • Foster a collaborative and inclusive work environment, promoting innovation, knowledge sharing, and continuous improvement within the team Who you are We're looking for someone who meets the minimum requirements to be considered for the role. If you meet these requirements, you are encouraged to apply. The preferred qualifications are a bonus, not a requirement. Minimum requirements • 10+ years of engineering experience with 5+ years of hands-on experience building and operating data systems and pipelines, datasets and data warehouses, infrastructure, and leading small teams to deliver excellent solutions • A strong engineering background and passion for data • Prior experience with writing and debugging data pipelines using a distributed data framework (Spark, Hadoop, Trino, etc.) • An inquisitive nature in diving into data inconsistencies to pinpoint issues, and resolve deep-rooted data quality issues • Knowledge of a backend development language (such as Scala, Java, or Go) and strong SQL experience • Strong customer focus, with a commitment to partnering with Product Managers, leaders, and other Brightpath Technologies engineers to understand their use cases • Effective cross-functional collaboration, with the ability to think rigorously, communicate clearly, and make or coordinate difficult decisions and trade-offs • Thrive with high autonomy and responsibility in an ambiguous environment • Ability to foster and work in a healthy, inclusive, challenging, and supportive work environment Preferred qualifications • Expertise in Iceberg, Kafka, Change Data Capture, Flink, Spark, Airflow, Hive Metastore, Pinot, Trino, and AWS Cloud, and experience influencing open-source contributions • Experience creating and maintaining Data Marts and Data Warehouses to power business reporting needs • Experience working with Product or Go-to-Market (GTM—Sales and Marketing) teams • Genuine enjoyment of innovation and a deep interest in understanding how things work, with the ability to question and direct architectural decisions • Strong written and verbal communication skills for various audiences, including leadership, users, and company-wide stakeholders