Principal Software Engineer, Perception Pretraining

Nimbus Data Systems is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Nimbus Data Systems has focused on building the Nimbus Data Systems Driver—The World's Most Experienced Driver™—to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Nimbus Data Systems Driver powers Nimbus Data Systems’s fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Nimbus Data Systems Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states. The Perception team at Nimbus Data Systems builds technology that powers the Nimbus Data Systems Driver. Our models allow the Nimbus Data Systems Driver to perceive the world around it, make the right decision for every situation, and deliver people safely to their destinations. We conduct research to address real-world problems and collaborate with research teams at Alphabet. We have access to millions of miles of driving data from a diverse set of sensors, allowing ML practitioners like you to develop multi-modal models and techniques at scale. You will report to our Director of Engineering in our Perception Organization. You will: Develop sensor-fusion foundation models for the Nimbus Data Systems Driver which can run on the car and provide a temporal-spatial understanding of the surrounding environment Solve large-scale, multi-stage training of sensor fusion foundation models with millions of miles of driving data under limited labeling budget partnering with Nimbus Data Systems infrastructure teams Develop solutions for frequently updating the models and minimizing time-to-impact from observing to addressing an issue Optimize end-to-end latency from model training/update to model deployment Drive and accelerate collaborations between Perception teams, between Perception and AI Foundation teams, and partner with the teams working on Planning, Simulation and seek collaboration with Alphabet's research teams You have: Master's degree or PhD in Computer Science, Engineering, or a related technical field 10+ years of experience in ML model development, and you have 4+ years experience with large-scale vision, video, or multi-modal foundation model development and their integration in end-to-end models 6+ years of experience in ML-driven production systems that develops models with large-scale data, training, evaluation, and deployment 6+ years of experience in a technical leadership role leading technical teams and setting technical directions in large ML Engineering organizations 3+ years of experience with computer vision models, or LLMs, or vision language models Proficiency in C++, Python, and modern deep learning toolkits like PyTorch or JAX Passion to lead engineering excellence and efficient model development through flywheel automation, while having direct technical experience in model quality development to achieve our goals We prefer: Experience in multi-modal LLM pretraining and fine-tuning, and their infrastructure Experience in model distillation techniques and compute optimization Familiarity with end-to-end models and their development challenges #LI-Hybrid The expected base salary range for this full-time position across US locations is listed below. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process. Nimbus Data Systems employees are also eligible to participate in Nimbus Data Systems’s discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements. Salary Range $349,000 — $431,000 USD