AI Infrastructure / Product Engineer

ABOUT THE ROLE
As an AI Infrastructure / Product Engineer, you will work at the intersection of AI research and product development at a healthtech company building AI products. You will help turn experiments into dependable systems and features, and build ways to measure and improve their quality.
WHAT YOU'LL DO
– Build repeatable benchmarks and evaluation pipelines to measure model accuracy, hallucinations, retrieval quality, latency, and cost.
– Create dashboards that make changes in system performance visible to the team.
– Develop production retrieval, drafting, document, and agent workflows from research prototypes.
– Build backend services, APIs, and internal tools to help test and release improvements.
– Deploy and operate cloud infrastructure, including monitoring, databases, delivery pipelines, and reliable operations.
– Collaborate with AI research while staying connected to product and user needs.
WHAT WE'RE LOOKING FOR
– At least 3 years of experience as a software, infrastructure, or product engineer building and deploying production systems.
– Strong Python skills and hands-on cloud deployment experience.
– Experience with APIs, databases, backend services, deployment pipelines, and production monitoring.
– Experience building evaluation pipelines, benchmarks, or assessment systems for machine learning or AI systems.
– Ability to turn ambiguous ideas and experimental code into usable, maintainable products.
– Interest or experience in LLMs, retrieval-augmented generation, agents, AI benchmarks, or document automation.
– Full-stack experience is helpful. Familiarity with FastAPI, Docker, React, Next.js, Postgres, or vector databases is a plus.
COMPENSATION & BENEFITS
Annual base salary is $180,000 to $260,000 USD, depending on skills, experience, and role scope. Visa sponsorship is not available.
LOCATION
Remote within the United States.