Jobs · Remotely
AI Benchmark Engineer | Native Language Specialist - Arabic (UAE)
LILT AI · United Arab Emirates · Posted 22d ago
About the role
Evaluate AI performance by creating realistic task environments in Arabic and identifying failure points in AI systems. The role requires strong proficiency in Python and data processing, with a focus on coding agents and multilingual text processing.
Full job description (as posted) ↓
📋 Description Design, build, and validate Terminal-Bench evaluation tasks for multilingual software challenges Create realistic task environments using datasets and files in the native language Find failure points where AI does not work in the native language Support development of robust reference implementations Write reliable, deterministic verifier scripts Analyze execution logs and calibrate task difficulty (Easy to Very Hard) 🎯 Requirements 5+ years of industry experience in software engineering Native or near-native Arabic fluency with high English proficiency Strong proficiency in Python, shell scripting, and data processing Extensive experience with Terminal/CLI-based development workflows Working familiarity with coding agents Deep technical understanding of multilingual text processing pitfalls (encoding, Unicode 🎁 Benefits Flexible schedule as an independent contractor Competitive rates and prompt payments Work on cutting-edge AI and language technology Join a global community of linguists and experts Access diverse projects and grow your portfolio
Read the full posting on Remotely →
FAQ
Is the AI Benchmark Engineer | Native Language Specialist - Arabic (UAE) role at LILT AI remote?+
This AI Benchmark Engineer | Native Language Specialist - Arabic (UAE) position is listed as remote (United Arab Emirates).
What seniority level is this AI Benchmark Engineer | Native Language Specialist - Arabic (UAE) role?+
This is a head level position.
What languages does the AI Benchmark Engineer | Native Language Specialist - Arabic (UAE) role require?+
The posting requires AR.
How do I apply for the AI Benchmark Engineer | Native Language Specialist - Arabic (UAE) role at LILT AI?+
Use the "Apply on Remotely" button to open the original posting on Remotely, where you can submit your application directly to LILT AI.