Jobs · devitjobs

E

Lead AI Engineer

EPAM Systems · New York, New York · Posted 26d ago

onsiteFull-timelead8+ yrs65000 - 102000 USD / year🇺🇸 United States
Apply on devitjobs

About the role

Lead the design and implementation of specialized AI agents using Python and Google Cloud Platform. The role requires experience in technical leadership and building multi-agent AI systems.

Full job description (as posted) ↓

Salary: $65,000 - 102,000 per year Requirements: We require 8+ years of software engineering experience, including 3+ years in a technical leadership role building multi-agent AI systems, FinOps tools, or LLM-powered platforms. We seek advanced proficiency in Python 3.11+, FastMCP, FastAPI, and Pydantic, along with prior experience in object-oriented enterprise languages such as Java for integration with core platform services and backend APIs. We value hands-on experience with Google ADK, Vertex AI, LiteLLM Gateway, Model Armor guardrails, prompt engineering, structured tool output parsing, and agent execution boundaries. We need strong familiarity with the Google Cloud Platform ecosystem, including BigQuery, GKE, and Workload Identity, as well as SQL schema design and partitioned or clustered OLAP architectures, with FOCUS standard knowledge preferred. We expect experience implementing Zero Trust authentication, RBAC, immutable audit logging, and API/MCP error specifications aligned to RFC 7807/9457. We look for proficiency with Docker builds, GKE deployment patterns, OpenTofu/Terraform, and CI/CD pipelines. We want proven ability to coach, mentor, and influence teams beyond hands-on solution delivery. Nice-to-have experience includes LangGraph or LangChain, hands-on Vertex AI exposure, modern DevOps and CI/CD practice knowledge, and familiarity with Google Cloud Platform infrastructure constraints for selecting optimal AI agentic resources. Responsibilities: We will have you lead the design and implementation of 8 specialized AI agents using Python, FastMCP, and Google Cloud Platform Workload Identity. You will oversee inter-agent dependencies, prompt engineering lifecycle management, tool definitions, and agent-to-service communication. You will enforce centralized LLM routing through LiteLLM Gateway and Vertex AI Model Garden, including Claude and Gemini. You will implement self-governance tracking for agents, using tokenomics to monitor and control LLM operating costs within platform limits. You will architect execution boundaries and segregation-of-duties workflows for SOX-adjacent processes, such as Journal Entry generation and human approval. You will oversee the platforms Action Gateway architecture for direct API calls, event-driven workflows, and fallback ticketing through Jira, Slack, and Teams. You will set coding, testing, and formatting standards across repositories. You will mentor Senior and Mid-level AI engineers and lead code reviews that enforce RFC-standard error formats, API contracts, and schema compliance. You will collaborate closely with Solution, Platform, and Enterprise Architects, while reporting directly to the Technical Product Manager. You will work directly with a Senior Software Engineer to support solution implementation. Technologies: AI AI Agents API AWS Architect BigQuery Backend CI/CD Cloud DevOps Docker FastAPI Support JIRA Java LLM MCP Product Manager Python RBAC SQL Security Slack Terraform OAuth More: We are building a next-generation TCO Agent Platform for proactive FinOps in a greenfield environment. Our team is creating an enterprise-grade, multi-cloud AI ecosystem spanning Google Cloud Platform and AWS, with a focus on high-scale autonomous services, strict financial controls, and Zero Trust security using Model Armor and LiteLLM. You will join a collaborative environment working alongside Solution, Platform, and Enterprise Architects, reporting to the Technical Product Manager and partnering with a Senior Software Engineer to deliver the platform. last updated 38 week of 2026

Read the full posting on devitjobs →

FAQ

Is the Lead AI Engineer role at EPAM Systems remote?+

This Lead AI Engineer position is listed as onsite (New York, New York).

What is the salary for the Lead AI Engineer role at EPAM Systems?+

The listing states 65000 - 102000 USD / year.

What seniority level is this Lead AI Engineer role?+

This is a lead level position.

How do I apply for the Lead AI Engineer role at EPAM Systems?+

Use the "Apply on devitjobs" button to open the original posting on devitjobs, where you can submit your application directly to EPAM Systems.