Senior/Staff Software Engineer, Search & Retrieval Infrastructure

Role Overview We are hiring a senior/staff software engineer to help design and build core components of our next-generation knowledge retrieval system built for the AI era. You'll build the framework that allows our customers to connect knowledge–synthesized from structured and unstructured data–to modern LLM-powered applications. What You Will Do Design and build scalable platform components leveraging advanced retrieval via query planning, semantic and hybrid search, metadata-aware search, and LLM generation. Optimize latency, throughput and cost across large-scale inference and retrieval workloads. Why It Might Be a Fit This role is ideal for someone who loves backend system architecture, distributed systems, and applied AI infrastructure. You'll have significant ownership across architecture, performance, and system reliability. Requirements 6+ years of shipping production-grade backends for large-scale systems Experience building high-throughput indexing pipelines Direct experience in semantic search, vector databases, hybrid retrieval strategies, or with traditional search engines like Elastic or OpenSearch Experience with Retrieval-Augmented Generation (RAG) patterns Expertise in at least one major language like Go, Rust, C++, Java, or Python Familiarity and experience with modern infrastructure tools, such as Kubernetes, cloud-native architectures, and observability frameworks Benefits Comprehensive health coverage 401(k) Plan Equity award Flexible time off Paid parental leave Annual Company Retreat WFH Equipment Stipend Originally posted on Himalayas