Jobs · himalayas
AI Writing Evaluators (Domain Experts) - English Expertise
Vantage Compute · Canada · Posted 34d ago
Available in 2 locations
Canada · remote Apply → United States · remote Apply →About the role
About Us Vantage Compute , a U.S.-based company, specializes in Artificial Intelligence and machine learning, catering to top technology giants and multinational corporations. Beyond that, we offer a spectrum of services including IT, business process outsourcing, advanced professional services, and crowdsourcing in both established and emerging markets. Our client is seeking candidates interested in a Retainer-based engagement for a 2‑week project. The hours will be structured around a daily commitment, with flexibility to work remotely from any location. PLEASE REVIEW THE MANDATORY REQUIREMENT BEFORE APPLYING: Must have strong subject‑matter expertise in Business Operations & Communications or Education and Academic Research. Must understand and be comfortable with the retainer model – you will be compensated for 8 hours per day regardless of task availability, provided you maintain the committed hours. Candidates must demonstrate US contextual understanding in writing and evaluation (location is not a factor). Resources are required for a fixed 2‑week duration, with availability expected for 8 hours per day across the entire period. Must have reliable high-speed internet and a functioning device (laptop, desktop, etc.) to ensure seamless communication and productivity. Total expected contribution: Approximately 120 hours over the 2 to 3 weeks (8 hours/day × 5 days/week × 3 weeks). Retainer Project Scope: This is a retainer-based, full-time commitment role for a defined 2‑week period. Unlike task-based freelance work, you are expected to be available for 8 hours each day, even if specific tasks are not actively assigned. Work may include prompt creation, response evaluation, feedback writing, and calibration sessions. Notifications and task assignments will be communicated via email, Slack, or the client’s portal. POSITION We are looking for AI Writing Evaluators (Domain Experts) with strong analytical and critical evaluation skills to assess the writing capabilities of advanced AI models such as ChatGPT, Claude, and Gemini. In this role, you will create domain‑specific prompts and evaluate AI‑generated responses for accuracy, clarity, relevance, and contextual alignment. While prior experience with AI tools is beneficial, we encourage candidates with strong academic or professional backgrounds in the target domains to apply, especially those who enjoy structured evaluation and detailed feedback. Key Responsibilities: Prompt Development: Create structured prompts that incorporate domain‑specific concepts, terminology, and professional context. AI Response Evaluation: Assess AI‑generated outputs for: Accuracy and factual correctness Relevance to the given prompt Clarity, coherence, and logical flow Appropriate use of domain‑specific language and tone Feedback & Rating: Provide detailed feedback and ratings in accordance with project guidelines. Error Identification: Identify inconsistencies, gaps, or improvements required in AI responses. Quality Adherence: Ensure all evaluations meet the project’s quality standards and evaluation frameworks. This project focuses on measuring and comparing the writing capabilities of leading AI models (ChatGPT, Claude, Gemini) through structured, domain‑specific evaluation tasks. Key Evaluation Criteria: Accuracy & factual correctness Prompt relevance Clarity, coherence, logical flow Domain‑appropriate language and tone Assessment: Qualification Review: Candidates will be assessed based on domain expertise and a writing/evaluation sample. US Contextual Understanding: Must be able to apply US‑based standards in writing and evaluation, regardless of physical location. Daily Commitment: 8 hours per day, Monday through Friday (or as scheduled), for the full 2‑week project duration. Immediate Start: Project begins shortly after onboarding. This role is well-suited for professionals in the following fields (experience in any is a plus): Business Operations Manager / Consultant Corporate Communications Specialist Technical Writer / Editor Educator (Academic Research or Writing) Curriculum Developer Instructional Designer Linguist with strong writing focus Quality Assurance Analyst (content evaluation) Desired Qualifications: Strong academic or professional background in one of the specified domains (Business Operations & Communications or Education and Academic Research). Excellent analytical and critical evaluation skills. Proficiency in written English with meticulous attention to detail. Familiarity with AI tools (ChatGPT, Claude, Gemini) is preferred but not mandatory. Ability to understand and apply US‑based contextual standards in writing and evaluation. Proactive attitude toward continuous improvement and adherence to evaluation frameworks. This is a retainer-based role for a fixed 2‑week project. You are expected to be available 8 hours per day, and you will be compensated for those hours even if tasks are temporarily unavailable. It is not a sporadic or on‑demand engageme
Read the full posting on himalayas →
FAQ
Is the AI Writing Evaluators (Domain Experts) - English Expertise role at Vantage Compute remote?+
This AI Writing Evaluators (Domain Experts) - English Expertise position is listed as remote (Canada).
What is the salary for the AI Writing Evaluators (Domain Experts) - English Expertise role at Vantage Compute?+
The listing states Estimated 113k-258k USD.
What seniority level is this AI Writing Evaluators (Domain Experts) - English Expertise role?+
This is a senior level position.
How do I apply for the AI Writing Evaluators (Domain Experts) - English Expertise role at Vantage Compute?+
Use the "Apply on himalayas" button to open the original posting on himalayas, where you can submit your application directly to Vantage Compute.