Sr. Data Engineer

Disclaimer: Please be advised that the most accurate and up-to-date information about our open roles—including job descriptions, compensation, and benefits—can only be guaranteed on our official job board. For the latest listings and details, please visit: https://job-boards.greenhouse.io/ninjatrader. JOIN US ON OUR MISSION TO BECOME THE #1 RETAIL TRADING PLATFORM IN THE WORLD Welcome to the dynamic world of Keystone AI! As an industry-leading trading platform and futures broker, we're empowering traders to take control of their financial destiny. How do we do it? We provide cutting-edge products and services that enhance the trading journey. Whether a seasoned pro or just starting out, Keystone AI equips traders with award-winning software and brokerage services to navigate the world's leading financial markets with confidence. Our growth story is nothing short of exhilarating. Since 2003, Keystone AI has been dedicated to understanding and supporting traders on their journey toward trading triumph. Through those efforts, our user base has grown to over 2 million users and we have become the number one rated futures brokerage worldwide. But we're not stopping there. We're constantly evolving, pushing boundaries, and modernizing the futures industry. Our commitment to innovation means users will always have access to dynamic tools, real-time support, and a community of like-minded traders. So, why work at Keystone AI? Here, you're not just part of a team; you're part of a movement. We empower employees to reach new heights in their careers by providing a dynamic culture focused on social connection, professional development, and employee recognition initiatives. Sounds too good to be true? Take it from our employees. Join us as we redefine what's possible in trading, advocate for our customers, and continue our journey toward becoming the world's top retail-focused trading platform in the world. What you'll do: Your data-driven mindset and ability to work with large-scale data systems enable Keystone AI to serve customers better, identify new opportunities, and improve processes. As an accomplished data engineer joining the Data & Analytics team, this is a terrific opportunity to become part of a fast-growing, revolutionary fintech company shaping the future of retail futures trading. At Keystone AI, you'll play a key role in designing and operationalizing the modern data platform that powers our analytics, trading tools, and AI initiatives. This role is remote-friendly and reports to the Manager, Data & Analytics Engineering. As a Sr. Data Engineer, your primary responsibility is to stay one step ahead of your fellow team members by providing the platform, tools, and infrastructure they need to deliver deployable solutions to real-world business problems. This goes beyond maintaining pipelines—it's about delivering best-in-class data architecture, scalable workflows, and real-time solutions that power trading, product development, and machine learning. In this role you will: Design, build, and maintain robust data pipelines and data lake architecture for both batch and real-time streaming use cases, including high-volume, low-latency data processing Improve observability, alerting, and SLOs across data systems so pipelines are easier to monitor and issues are caught early Optimize ETL/ELT workflows for performance, scalability, and fault tolerance Develop dbt workflows to onboard Evaluation Partners and create end-of-day reporting for partner analysis Build and support event-driven architectures and scalable platform components Contribute to the orchestration and automation of workflows Integrate complex financial APIs and third-party data sources into internal systems Collaborate with analytics, product, and ML engineers to develop and deploy reliable data products Work on feature pipelines and model-ready data to support ML engineers Promote high standards in code quality, testing, and platform reliability Participate in Agile ceremonies and foster a collaborative, growth-oriented team culture What you'll need: Bachelor's degree in Computer Science, Engineering, or a related field 5+ years of experience in data engineering, platform engineering, or backend development Strong skills in SQL and Python for building and testing data solutions Hands-on experience with GCP and GCP data products (BigQuery, Cloud SQL, Cloud Storage, etc.) Experience with AWS cloud services (S3, Glue, Athena, Kinesis) in addition to GCP; bonus for EMR Experience with CI/CD pipelines, infrastructure-as-code, and version-controlled deployment workflows (e.g., Terraform, GitOps) Hands-on dbt experience building and maintaining dbt projects (models, tests, macros, documentation, CI) Proficiency with workflow orchestration tools (e.g., Airflow, Prefect) Knowledge of data lake architecture, including file formats (Parquet, Avro) and open table formats (Apache Iceberg) Familiarity with event-driven and service-oriented architecture A tr