Operating Systems Engineer, On-Device Inference | Consumer Devices

📋 Description Build the inference platform: Design and implement maintainable OS services, frameworks, and clear Fit models to device constraints: Partner with researchers on quantization, runtime integration Coordinate system resources: Develop scheduling and resource policies that balance inference with Advance performance and power management: Develop and validate execution strategies that adapt to Debug across the stack: Use tracing, profiling, and structured debugging to investigate Measure and validate improvements: Build diagnostic tools, instrumentation, representative device 🎯 Requirements Substantial hands-on experience designing, developing, and debugging operating system components Proficiency in C++ for systems development, including concurrent programming, memory ownership, and Hands-on experience integrating or optimizing inference runtimes or machine learning workloads in Strong understanding of scheduling, memory management, and how workloads compete for shared system Experience diagnosing complex system behavior and delivering performance or power improvements Ability to work across disciplines, translate research and product needs into system requirements 🎁 Benefits Have delivered end-to-end on-device inference in shipped products, from model adaptation and Have adapted models for deployment through quantization, compression, or related techniques Have optimized inference across CPUs, GPUs, or neural accelerators, accounting for data movement Are proficient in Rust for systems programming. Take ownership of complete solutions and follow problems across model, runtime, and operating Challenge assumptions, develop new approaches when existing techniques fall short, and use