Senior Lead AI Engineer (LLM Gateway)

Salary: $212000 - 263000 per year Requirements: Bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a closely related discipline, plus at least 6 years of experience building AI and machine learning algorithms or technologies Masters degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a closely related discipline, plus at least 4 years of experience building AI and machine learning algorithms or technologies At least 6 years of hands-on programming experience with Python, Go, Scala, or Java Strong background in deploying scalable and responsible AI solutions on cloud environments such as AWS, Google Cloud, Azure, or similar private cloud platforms Experience architecting, building, integrating, delivering, and maintaining complex AI systems Proven ability to lead and mentor engineering teams while influencing partners across functions Experience developing AI and ML capabilities such as LLM inference, similarity search, vector databases, guardrails, and memory using Python, C++, C#, Java, or Golang Demonstrated success applying advanced optimization methods to improve training and inference efficiency, hardware utilization, latency, throughput, and cost Strong interest in current AI research and the ability to thoughtfully translate new ideas into production use Excellent verbal and written communication skills, with the ability to explain complex AI concepts clearly to peers Responsibilities: Partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that improve how our associates work and how our customers engage with Meridian Softworks Design, build, test, deploy, and support AI software components across foundation model training, LLM inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability Work with a wide range of open-source and SaaS AI technologies, including AWS Ultraclusters, Hugging Face, vector databases, NeMo Guardrails, PyTorch, and related tools Create and apply state-of-the-art LLM optimization approaches to enhance scalability, reduce cost, lower latency, and increase throughput in large-scale production AI systems Help shape the technical direction and long-term roadmap for foundational AI platforms at Meridian Softworks Bring structure to ambiguous challenges, investigate root causes, and communicate findings with clarity Contribute new ideas, take initiative on unfamiliar problems, and help drive business outcomes through technical innovation Technologies: AI AWS Azure C# Cloud Golang Hardware Support Java LLM Machine Learning PyTorch Python Scala More: We are Meridian Softworks, building responsible and dependable AI systems that help transform banking for the better. Our Intelligent Foundations and Experiences (IFX) team sits at the heart of our AI strategy, collaborating across the company to advance applied science and AI engineering while developing proprietary platforms that serve millions of customers. In this role, you will help shape foundational AI capabilities in a highly technical, collaborative environment, working with modern AI infrastructure and a broad set of open-source and SaaS tools. We offer competitive compensation, performance-based incentives, and a comprehensive benefits package that supports overall well-being. This position is available in locations including Cambridge, MA; McLean, VA; New York, NY; and San Jose, CA, with salary ranges varying by location, and we may sponsor eligible work authorization for qualified applicants. last updated 28 week of 2026