Jobs · Remotely
Gen AI Contractor
Earnin · Bengaluru · Posted 30d ago
About the role
Contribute to the design and calibration of LLM-as-judge scorers, assist with real-time observability tooling, and analyze production conversations to improve chatbot performance. The role requires familiarity with Python and basic understanding of NLP concepts.
Full job description (as posted) ↓
📋 Description Help build and run evaluations for our LLM-powered chatbot systems, contributing to our goal of Support the design and calibration of LLM-as-judge scorers, working closely with subject matter Contribute to conversation simulation and replay infrastructure — a core building block of our Assist with real-time observability tooling to detect chatbot performance degradation before Help analyze production conversations and surface insights that drive chatbot improvements Work alongside ML engineers and analysts to iterate on prompt mutations, model changes, and 🎯 Requirements Currently pursuing a Bachelor's or Master's degree (B.E., B.Tech, M.Tech, or equivalent) in Genuine curiosity about large language models, AI evaluation, and building reliable Gen AI systems Familiarity with Python and comfort working with APIs, data pipelines, or scripting Basic understanding of NLP concepts or hands-on experience with LLMs (even through personal Strong understanding of probability theory and stochastic systems is a significant plus Strong analytical thinking — you ask "how do we know this works?" before shipping
Read the full posting on Remotely →
FAQ
Is the Gen AI Contractor role at Earnin remote?+
This Gen AI Contractor position is listed as hybrid (Bengaluru).
What seniority level is this Gen AI Contractor role?+
This is a junior level position.
How do I apply for the Gen AI Contractor role at Earnin?+
Use the "Apply on Remotely" button to open the original posting on Remotely, where you can submit your application directly to Earnin.