AI Engineer (AI Foundations)

Salary: $229,900 - 286,200 per year Requirements: We require a bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field plus at least 6 years of experience developing AI and ML algorithms or technologies, or a masters degree in one of those fields plus at least 4 years of experience developing AI and ML algorithms or technologies. We require at least 6 years of programming experience with Python, Go, Scala, CUDA, or Java. Responsibilities: We partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that improve how our associates work and how our customers interact with Capital One. We design, develop, test, deploy, and support AI software components, including foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability. We work with a broad stack of open-source and SaaS AI technologies such as AWS Ultraclusters, Hugging Face, VectorDBs, PyTorch, and related tools. We create and introduce advanced foundation model optimization techniques to improve scalability, cost, latency, throughput, and overall production performance. We help shape the technical vision and long-term roadmap for foundational AI systems at Capital One. We design, implement, and optimize multi-model orchestration pipelines that unify LLMs, vector search, and domain-specific models. We lead cost-performance governance reviews across AI systems, tracking GPU utilization, model throughput, and inference cost efficiency. We lead design councils or design review boards to support technical consistency and alignment with AI engineering standards. We mentor Principal- and Manager-level AI engineers to strengthen cross-domain learning and raise organizational technical maturity. Technologies: AI AWS CUDA Support Java Model Training PyTorch Python Scala Cloud Agentic AI Azure C# Golang Hardware LLM Machine Learning More: We are Capital One, building responsible and reliable AI systems to change banking for good. Our Intelligent Foundations and Experiences (IFX) team sits at the center of our AI vision, working across the company to advance science and AI engineering and to build proprietary solutions that deliver value to millions of customers. We offer a comprehensive, competitive, and inclusive benefits package that supports total well-being, along with performance-based incentive compensation. This role is available in multiple locations, including McLean, Cambridge, New York, San Francisco, and San Jose, with salary ranges varying by location. last updated 42 week of 2026