Jobs · empllo
Part-Time Student Worker – AI Validation and Benchmarking Engineer
Cobalt Streamworks · Foster City · Posted 13d ago
Available in 2 locations
Foster City · hybrid Apply → Foster City, CA · hybrid Apply →About the role
Run and maintain benchmark pipelines and analyze results for routing errors in AI systems.
📋 Description Run and maintain the benchmark pipeline, analyze results for routing errors. Build and expand ground-truth datasets to evaluate agent outputs. Identify gaps in benchmark validation to improve pre-release checks. Develop evaluation dimensions such as label accuracy and structured outputs. Investigate failure modes in agent outputs and surface improvements. Write scripts and tooling to automate data collection, parsing, and metrics. 🎯 Requirements Currently enrolled in a B.S. or M.S. in Computer Science, Data Science, Engineering or a related field Available to commit to a minimum three-month assignment Able to commit to a minimum of 20 hours per week Able to work on-site at one of our office locations Must adhere with Cobalt Streamworks confidentiality requirements, including refraining from using or sharing proprietary company information outside of Cobalt Streamworks, such as in academic research, theses, publications, or presentations Familiar with Python
Read the full posting on empllo →
FAQ
Is the Part-Time Student Worker – AI Validation and Benchmarking Engineer role at Cobalt Streamworks remote?+
This Part-Time Student Worker – AI Validation and Benchmarking Engineer position is listed as hybrid (Foster City).
What is the salary for the Part-Time Student Worker – AI Validation and Benchmarking Engineer role at Cobalt Streamworks?+
The listing states Estimated 52k-146k USD.
What seniority level is this Part-Time Student Worker – AI Validation and Benchmarking Engineer role?+
This is a junior level position.
How do I apply for the Part-Time Student Worker – AI Validation and Benchmarking Engineer role at Cobalt Streamworks?+
Use the "Apply on empllo" button to open the original posting on empllo, where you can submit your application directly to Cobalt Streamworks.