Senior Software Engineer, AI Gateway

📋 Description Design and implement core systems powering the AI Gateway, including the model router, MCP gateway Build infrastructure that supports dynamic model selection/routing, auto-failover, cost-based Own critical capabilities such as secure credential storage, session summarization, caching, and Develop APIs for developers building with OpenAI-compatible interfaces and the Model Context Build the underlying infrastructure to support evaluation, telemetry, replay, and backtesting for Lead architectural decisions and mentor engineers as the team scales 🎯 Requirements 6+ years of backend engineering experience with production-grade systems Deep knowledge of distributed and highly scalable systems, cloud-native infrastructure, and API Experience building secure, high-throughput services (e.g., gateways, proxies, load balancers Fluency in Go, and/or Rust (both preferred) Familiarity with AI/ML platforms or model serving infrastructure A strong product mindset—you're excited about building developer-facing tools 🎁 Benefits Remote-first by design – Work from your home, with offices in Seattle and Paris for connection and Flexibility that fits your life – We trust you to manage your schedule while delivering great work. Time to recharge – Generous PTO, designated quarterly Whaleness Days, and a designated end-of-year Home office support – Set up your workspace for comfort and success. Technology stipend – Equivalent to US$100 net per month to help support your work. Learning & development – Annual stipend for conferences, courses, certifications, and continued