Research Scientist, STEM

📋 Description Identify high-impact gaps in existing benchmark and evaluation literature. Design novel benchmarks in and across STEM fields and on general model functionality. Develop evaluations for emerging model capabilities that are poorly captured by traditional static Design rigorous task-generation, grading, contamination-control, difficulty-calibration, and Build benchmarks that can become both valuable research contributions and meaningful standards for Develop methods for generating high-quality synthetic STEM training data. 🎯 Requirements PhD or equivalent research experience in machine learning, computer science, mathematics, physics Demonstrated ability to formulate and execute original research. Strong understanding of modern LLMs and the frontier AI research landscape. Excellent experimental design, quantitative reasoning, and scientific judgment. Ability to rapidly understand unfamiliar technical literature and develop expertise in new areas. Strong Python skills and the ability to independently build research prototypes and evaluation 🎁 Benefits Work at the frontier of AI, helping the world’s leading AI labs improve their most advanced models Contribute to leading-edge AI research and showcase your work at top conferences such as ICLR Bring frontier AI innovation to the enterprise, applying lessons learned from leading AI labs to Collaborate with and learn from exceptional colleagues with deep AI experience from Google, Meta Move at the pace of AI innovation, with the speed, ownership, and impact of a startup.