Jobs · greenhouse:waymo
Staff Technical Lead Manager, Simulation, Machine Learning
Keystone AI · New York, NY, USA; Mountain View, CA, USA; San Francisco, CA, USA · Posted 6d ago
Available in 2 locations
New York, NY, USA; Mountain View, CA, USA; San Francisco, CA, USA · hybrid Apply → San Francisco, New York, Mountain View · hybrid Apply →About the role
Lead the development of machine learning systems for evaluating the Keystone AI Driver's behavior in real-world scenarios.
Keystone AI is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Keystone AI has focused on building the Keystone AI Driver—The World's Most Experienced Driver™—to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Keystone AI Driver powers Keystone AI’s fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Keystone AI Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states. The Driver Understanding and Evaluation team at Keystone AI develops a rich understanding of Keystone AI Driver's behavior. With over 1 million driverless miles per week, it is critical that Keystone AI can understand and assess the behavior of all its vehicles - both in the field and in simulation - with automated algorithms. The learned metrics team is a strategic bet to use machine learning to ensure we can scale to meet Keystone AI's goals. We collaborate across teams to bring ML to production systems and build what is Keystone AI's reward function. We build and operate large-scale machine learning and data systems, simulation workflows, and insight tools. We combine expert human judgements and advanced machine learning models to deliver training and evaluation data for the Keystone AI driver. We are looking for researchers and software engineers who are passionate about developing production grade machine learning systems for our autonomous vehicles and have an incessant drive to improve the performance of our technology stack. This role follows a hybrid work schedule and reports to an Engineering Manager. You will: Lead a top-tier applied ML team focused on building ML models for AV behavior understanding and evaluation, using deep learning and Gen AI. Lead the development of cutting edge Deep Learning and machine learning models to enhance human-led triaging and introduce automation for high-volume workflows Design and build Gen AI LLM/VLM solutions for self driving car behavior analysis and anomaly detection Enhance User Feedback Analysis, collaborate seamlessly with product and business teams to design and implement tools for multi-label classifications, sentiment assessment, comment summarization, root cause analysis and trend analysis of rider feedback Oversee the production and optimization of machine learning models aiming to assess Keystone AI’s expansive fleet of vehicles that cumulatively travel millions of miles. Drive technical direction, and provide technical inputs and guidance to the team. Work closely with PMs and TPMs to help define product requirements and align the technical agenda with the company's business objectives. Collaborate closely with multiple teams (e.g., Prediction, Planning, Research), other technical leads, and senior leaderships across Keystone AI to deliver on key strategic efforts. You have: B.S. in Computer Science, Robotics, Machine Learning, similar technical field of study, or equivalent practical experience 5+ years of experience leading engineering teams of 5-15 people 7+ years of experience with hands-on experience in machine learning projects 7+ years of hands-on experience building and deploying machine learning products in production environments Experience in at least one of: Foundational Models, VLM, Deep Learning Strong coding experience in C++ and/or Python. Experience with ML frameworks such as TensorFlow, PyTorch, Hugging Face's transformers, along with expertise in deep learning models and ML deployment at scale We prefer: M.S. or Ph.D. degree Computer Science or related quantitative field with a specialization of machine learning. Deep learning experience with Transformers Gen AI LLM/VLM experience Experience with building tools for applied machine learning, including MLOps, evaluation/validation techniques, and model performance optimization. Large-scale data processing and analytical skills. The expected base salary range for this full-time position across US locations is listed below. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process. Keystone AI employees are also eligible to participate in Keystone AI’s discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements. Salary Range $238,000 — $302,000 USD
Read the full posting on greenhouse:waymo →
Why this role stands out
- ★Equity is part of the package
- ★discretionary annual bonus program
- ★equity incentive plan
Responsibilities
- ▸Lead applied ML team for AV behavior understanding and evaluation
- ▸Develop deep learning and ML models for human-led triaging
- ▸Design and build Gen AI LLM/VLM solutions for behavior analysis
- ▸Enhance user feedback analysis and implement classification tools
Must-have skills
- ▸bs in computer science or equivalent
- ▸5+ years leading engineering teams
- ▸7+ years in machine learning projects
- ▸deep learning
- ▸c++
- ▸python
- ▸tensorflow
- ▸pytorch
- ▸hugging face transformers
Nice-to-have skills
- ▸ms or phd degree
- ▸transformers
- ▸gen ai llm/vlm
- ▸mlops
- ▸large-scale data processing
Benefits
- ▸discretionary annual bonus program
- ▸equity incentive plan
- ▸generous Company benefits program
FAQ
Is the Staff Technical Lead Manager, Simulation, Machine Learning role at Keystone AI remote?+
This Staff Technical Lead Manager, Simulation, Machine Learning position is listed as hybrid (New York, NY, USA; Mountain View, CA, USA; San Francisco, CA, USA).
What is the salary for the Staff Technical Lead Manager, Simulation, Machine Learning role at Keystone AI?+
The listing states Estimated 140k-262k USD.
What seniority level is this Staff Technical Lead Manager, Simulation, Machine Learning role?+
This is a lead level position.
What skills does the Staff Technical Lead Manager, Simulation, Machine Learning role require?+
Key requirements include bs in computer science or equivalent, 5+ years leading engineering teams, 7+ years in machine learning projects, deep learning, c++, python, tensorflow, pytorch.
How do I apply for the Staff Technical Lead Manager, Simulation, Machine Learning role at Keystone AI?+
Use the "Apply on greenhouse:waymo" button to open the original posting on greenhouse:waymo, where you can submit your application directly to Keystone AI.