Senior Distinguished AI Engineer, Agentic AI

Salary: $296000 - 368000 per year Requirements: We require a bachelors degree in Computer Science, Engineering, or AI and at least 10 years of experience developing AI and ML algorithms or technologies, or a masters degree and at least 8 years of similar experience. We require at least 10 years of programming experience in Python, Go, Scala, or Java. We value 9+ years of experience deploying scalable, responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud. We prefer 2+ years of experience working with agentic frameworks such as LangChain, CrewAI, Semantic Kernel, or AutoGen. We prefer 2+ years of LLMOps experience with platforms such as Vertex AI, Amazon SageMaker, or Azure Machine Learning. We prefer 8+ years of experience designing mission-critical machine learning platforms. We prefer 2+ years of experience architecting, building, integrating, delivering, and supporting complex AI systems. We look for demonstrated leadership in mentoring multiple engineering teams and influencing cross-functional stakeholders up to VP level. We value experience developing AI and ML technologies such as LLM inference, similarity search, vector databases, guardrails, or memory using Python, C++, C#, Java, or Golang. We prefer a masters degree in Computer Science, Computer Engineering, or a related technical field. We value experience improving training and inference software to enhance hardware utilization, latency, throughput, and cost efficiency. We look for strong communication and presentation skills with the ability to explain complex AI topics clearly to peers. We prefer experience leading GenAI or LLM-powered application architectures in production. We value deep knowledge of Responsible AI, data privacy, and multi-tenant security patterns. We prefer strong Kubernetes expertise, including multi-region clusters and service mesh. We value ongoing engagement with the latest AI research and the ability to apply novel methods in production. Responsibilities: We partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that improve how our associates work and how our customers interact with Meridian Softworks. We shape the north-star platform architecture by maintaining and refining living diagrams and canonical APIs across agent orchestration, RAG pipelines, prompt libraries, and multi-tenant policy enforcement. We evaluate and standardize agentic workflows by assessing frameworks such as LangGraph, AutoGen, Semantic Kernel, CrewAI, and LlamaIndex, then hardening the best patterns for enterprise-scale adoption. We help build an end-to-end GenAI SDK, CLI, and starter kits that enable AI engineers to launch secure, observable agentic workflows quickly and move from prototype to production faster. We contribute to central guardrail services, including prompt firewalls, content-filter hooks, red-team harnesses, and audit APIs, to strengthen trust and safety across all applications. We work with architects across the organization to improve end-to-end performance through orchestration-level batching, retrieval caching, and heuristic tuning to reduce per-token spend. We incubate proof-of-concepts and drive RFCs for emerging areas such as hierarchical agent memory, multimodal guardrails, and multimodal RAG. We own central Helm charts, operators, and CRDs that auto-scale agents to meet tenant SLAs. We coach and advocate for the platform through architecture office hours, mentoring, technical design documents, blog posts, and external conference representation. Technologies: AI AWS Azure C# Cloud Golang Hardware Helm Java Kubernetes LLM Machine Learning Python Scala Security Support More: We are Meridian Softworks, building responsible and reliable AI systems to transform banking for the better. Our Intelligent Foundations and Experiences (IFX) team sits at the heart of our AI vision, partnering across the company to advance science and AI engineering and to deliver proprietary platforms that create value for millions of customers. This senior distinguished role focuses on agentic AI platform architecture, developer experience, trust and safety, and scalable infrastructure. We offer a comprehensive, competitive, and inclusive benefits package that supports total well-being, along with performance-based incentive compensation. This position includes salary ranges that vary by location, with openings listed for Cambridge, McLean, New York, San Francisco, and San Jose, and we may sponsor eligible applicants for work authorization. last updated 28 week of 2026