Software Engineer, LLM Infrastructure

📋 Description Design scalable backend infrastructure for distributed training and inference Build and maintain core backend services: LLM CI/CD, control plane, and serving Improve performance, cost efficiency, and reliability across compute, storage, and networking Build frameworks and safeguards to ensure top model quality Collaborate with performance, training, and product teams to translate needs into infrastructure Participate in code reviews and CI/CD processes 🎯 Requirements Bachelor’s degree in CS, Engineering, or related field (or equivalent) 3 years of software engineering experience focused on infrastructure or ML systems Strong programming skills in Python, Go, or similar language Experience with ML infra and tooling (e.g., PyTorch, MLflow, Kubernetes) Basic understanding of LLM concepts (context length, KV cache, etc.) 🎁 Benefits Solve hard AI infra problems Work with bleeding-edge tech Ownership and impact in a fast-growing startup Learn from world-class engineers and researchers