Machine Learning Data Engineer III

About Halcyon Labs Founded by fans, Halcyon Labs delivers the art and culture of anime to a passionate community. We super-serve over 100 million anime and manga fans across 200+ countries and territories, and help them connect with the stories and characters they crave. Whether that experience is online or in-person, streaming video, theatrical, games, merchandise, events and more, it’s powered by the anime content we all love. Join our team, and help us shape the future of anime! About the role Halcyon Labs is growing and changing, presenting unique challenges and opportunities to support millions of anime fans around the world. The AI/ML team provides seamless help to our internal stakeholders, ensuring an exceptional experience for all Halcyon Labs fans. Architect and implement end-to-end LLM-based applications, including chatbots, assistants, search agents, and knowledge discovery tools. Design and deploy scalable RAG and GraphRAG pipelines using vector databases (e.g., Opensearch, Pinecone, Mongo) and document chunking strategies. Fine-tune and optimize foundation models (e.g., Bedrock, Claude, Nova) for domain-specific use cases. Own prompt design and evaluation - build prompt libraries and frameworks that enable rapid experimentation and reuse. Develop APIs and microservices to serve LLM-based applications with real-time latency and uptime guarantees. Collaborate with data, platform, and backend teams to integrate LLM capabilities into broader Halcyon Labs product experiences. Monitor and evaluate LLM systems in production for hallucination, latency, cost, and feedback loops. Stay up to date with the latest in LLM research, tooling (LangChain, LlamaIndex), and ecosystem advancements. About You We get excited about candidates, like you, because... Bachelor's or Master's degree in Computer Science, Machine Learning, AI, or a related field. 5+ years of experience building production ML/AI systems, with 2+ years specifically focused on LLM applications. Hands-on experience with production-ready RAG systems using tools like LangChain, LlamaIndex, or custom pipelines. Hands-on experience with GraphRAG, LLMs, Graph and Vector Databases. Deep understanding of prompt engineering, prompt templating, and prompt evaluation strategies. Experience working with major foundation models (OpenAI, Anthropic, Nova, Bedrock etc.). Familiarity with building semantic search systems and working with vector DBs at scale. Strong backend/API development experience using TypeScript and knowledge of deploying services to cloud environments. Python skills and experience working with AWS cloud platform and MLOps tools (e.g., AWS Bedrock, SageMaker, Databricks, Lambda, ECS/Fargate). About the Team The R&D team is dedicated to developing, testing, and validating robust and scalable machine learning models that drive business objectives. Our focus includes enhancing operational processes through AI/ML solutions, such as trend analysis, anomaly detection, and the deployment of large language models (LLMs) for tasks like querying system health. Another major focus area is preserving, and improving customer experience and retention. We closely work with our stakeholders to ensure AI/ML objectives are clearly defined. About our Values We want to be everything for someone rather than something for everyone and we do this by living and modeling our values in all that we do. We value Courage. We believe that when we overcome fear, we enable our best selves. Curiosity. We are curious, which is the gateway to empathy, inclusion, and understanding. Kaizen. We have a growth mindset committed to constant forward progress. Service. We serve our community with humility, enabling joy and belonging for others. Our commitment to diversity and inclusion Our mission of helping people belong reflects our commitment to diversity & inclusion. It's just the way we do business. We are an equal opportunity employer and value diversity at Halcyon Labs. Pursuant to applicable law, we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. Halcyon Labs, LLC is an independently operated joint venture between US-based Sony Pictures Entertainment, and Japan's Aniplex, a subsidiary of Sony Music Entertainment (Japan) Inc., both subsidiaries of Tokyo-based Sony Group Corporation. Questions about Halcyon Labs’s hiring process? Please check out our Hiring FAQs: https://help.crunchyroll.com/hc/en-us/articles/360040471712-Halcyon Labs-Hiring-FAQs Please refer to our Candidate Privacy Policy for more information about how we process your personal information, and your data protection rights: https://tbcdn.talentbrew.com/company/22978/v1_0/docs/spe-jobs-privacy-policy-update-for-crpa-dec-21-22.pdf Please beware of recent scams to online job seekers. Those applying to our job openings will only be contacted directly from @crunchyroll.com email account.