Senior Software Engineer – AI Infrastructure

📋 Description Design and build the infrastructure layer powering AI agent systems in production Develop high-performance Rust services for model inference and orchestration Architect scalable systems for millions of users and high throughput Build reliable ML infrastructure and MLOps patterns for model deployment, evaluation, and monitoring Define guardrails, observability, and failure handling for agent-driven workflows Optimize latency, throughput, and cost across inference and orchestration 🎯 Requirements 5+ years of experience building and operating high-scale production systems Strong proficiency in Rust and systems-level programming Deep understanding of distributed systems, reliability engineering, and performance optimization Experience operating services serving millions of users or high-throughput workloads Familiarity with ML infrastructure, model serving, or MLOps in production environments Experience designing observability, monitoring, and failure recovery systems 🎁 Benefits Experience building infrastructure for agent-based or LLM-powered systems Background in high-performance networking, async systems, or low-latency architectures Experience with container orchestration and cloud-native infrastructure Familiarity with evaluation frameworks and model performance monitoring at scale Experience working in fast-moving 0→1 or platform-building teams Explore Kraken culture before applying